[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
courses:mapreduce-tutorial:step-31 [2012/02/06 08:21]
straka
courses:mapreduce-tutorial:step-31 [2012/02/06 08:26]
straka
Line 35: Line 35:
  
 ===== Example ===== ===== Example =====
-This example reads the keys of ''/net/projects/hadoop/examples/inputs/numbers-small/numbers.txt'', computes the sum of all the keys and print it:+This example reads the keys of ''/net/projects/hadoop/examples/inputs/numbers-small'', computes the sum of all the keys and print it:
 <code java Sum.java> <code java Sum.java>
 import org.apache.hadoop.mapreduce.*; import org.apache.hadoop.mapreduce.*;
Line 112: Line 112:
 ===== Exercise 1 ===== ===== Exercise 1 =====
  
-Implement an AllReduce job on +Implement an AllReduce job on ''/net/projects/hadoop/examples/inputs/numbers-small'', which computes 
 +  * number of keys 
 +  * mean of the keys 
 +  * variance of the keys 
 +  * minimum of the keys 
 +  * maximum of the keys 
 +You can download the template {{:courses:mapreduce-tutorial:step-31-exercise1.txt|Statistics.java}} and execute it using: 
 +  wget --no-check-certificate 'https://wiki.ufal.ms.mff.cuni.cz/_media/courses:mapreduce-tutorial:step-31-exercise1.txt' -O Statistics.java 
 +  # NOW VIEW THE FILE 
 +  # $EDITOR Statistics.java 
 +  make -f /net/projects/hadoop/java/Makefile Statistics.java 
 +  rm -rf step-31-out; /net/projects/hadoop/bin/hadoop Statistics.jar 
 +  less step-31-out/part-* 

[ Back to the navigation ] [ Back to the content ]