[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
courses:mapreduce-tutorial [2012/01/24 22:42]
straka
courses:mapreduce-tutorial [2012/01/25 12:19]
straka
Line 21: Line 21:
   * [[.:mapreduce-tutorial:Step 6]]: Running on cluster.   * [[.:mapreduce-tutorial:Step 6]]: Running on cluster.
   * [[.:mapreduce-tutorial:Step 7]]: Dynamic Hadoop cluster for several computations.   * [[.:mapreduce-tutorial:Step 7]]: Dynamic Hadoop cluster for several computations.
 +
 +**From now on, run all examples using a one-machine cluster. Running the scripts locally without any cluster has several disadvantages, most notably having only one reducer per job.**
  
 === MapReduce extended === === MapReduce extended ===
-Setup, cleanup +  * [[.:mapreduce-tutorial:Step 8]]: Multiple reducers and partitioning. 
-Multiple reducers + Partitions +Mappers, splits 
-Combiners, perl inplace+Hadoop properties 
 +Combiners 
 +setup, cleanup, perl inplace
 Work dir Work dir
  

[ Back to the navigation ] [ Back to the content ]