Differences
This shows you the differences between two versions of the page.
Both sides previous revision
Previous revision
Next revision
|
Previous revision
|
courses:mapreduce-tutorial:step-25 [2012/01/31 12:20] straka |
courses:mapreduce-tutorial:step-25 [2012/01/31 15:12] (current) majlis Fixed code for sorting execution. |
rm -rf step-25-out-ex2; /net/projects/hadoop/bin/hadoop ArticlesAndWords.jar -c 2 -r 2 /home/straka/wiki/cs-text-small step-25-out-ex2 | rm -rf step-25-out-ex2; /net/projects/hadoop/bin/hadoop ArticlesAndWords.jar -c 2 -r 2 /home/straka/wiki/cs-text-small step-25-out-ex2 |
less step-25-out-ex2/part-* | less step-25-out-ex2/part-* |
| |
| ===== Exercise ===== |
| |
| Implement the [[.:step-13|sorting exercise]] in Java -- only the part with uniform keys. |
| |
| **Remark:** Values of type ''Text'' are sorted lexicographically, but values of type ''IntWritable'' are sorted according to value. Your mapper should therefore produce pairs of types (''IntWritable'', ''Text''). |
| |
| You can download the {{:courses:mapreduce-tutorial:step-25.txt|Sorting.java}} template and execute it. |
| |
| wget --no-check-certificate 'https://wiki.ufal.ms.mff.cuni.cz/_media/courses:mapreduce-tutorial:step-25.txt' -O 'SortingUniform.java' |
| # NOW VIEW THE FILE |
| # $EDITOR SortingUniform.java |
| make -f /net/projects/hadoop/java/Makefile SortingUniform.jar |
| rm -rf step-25-out-uniform; /net/projects/hadoop/bin/hadoop SortingUniform.jar -c 2 -r 2 /net/projects/hadoop/examples/inputs/numbers-small step-25-out-uniform |
| less step-25-out-uniform/part-* |
| |
| wget --no-check-certificate 'https://wiki.ufal.ms.mff.cuni.cz/_media/courses:mapreduce-tutorial:step-25.txt' -O 'SortingNonuniform.java' |
| # NOW VIEW THE FILE |
| # $EDITOR SortingUniform.java |
| make -f /net/projects/hadoop/java/Makefile SortingNonuniform.jar |
| rm -rf step-25-out-nonuniform; /net/projects/hadoop/bin/hadoop SortingNonuniform.jar -c 2 -r 2 /net/projects/hadoop/examples/inputs/nonuniform-small step-25-out-nonuniform |
| less step-25-out-nonuniform/part-* |
| |
---- | ---- |