Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Last revision Both sides next revision | ||
courses:mapreduce-tutorial:step-11 [2012/01/28 23:04] majlis Added links to previous and next chapter. |
courses:mapreduce-tutorial:step-11 [2012/01/30 16:45] dusek |
||
---|---|---|---|
Line 18: | Line 18: | ||
wget --no-check-certificate ' | wget --no-check-certificate ' | ||
+ | # NOW EDIT THE FILE | ||
+ | # $EDITOR step-11-exercise.pl | ||
rm -rf step-11-out-wout; | rm -rf step-11-out-wout; | ||
less step-11-out-wout/ | less step-11-out-wout/ | ||
Line 27: | Line 29: | ||
wget --no-check-certificate ' | wget --no-check-certificate ' | ||
+ | # NOW VIEW THE FILE | ||
+ | # $EDITOR step-11-solution.pl | ||
rm -rf step-11-out-with-hash; | rm -rf step-11-out-with-hash; | ||
less step-11-out-with-hash/ | less step-11-out-with-hash/ | ||
Line 47: | Line 51: | ||
| Wordcount with combiner | 1min, 51sec | 51MB | | | Wordcount with combiner | 1min, 51sec | 51MB | | ||
| Wordcount with hash in mapper | 1min, 14sec | 51MB | | | Wordcount with hash in mapper | 1min, 14sec | 51MB | | ||
- | Using the combiner is beneficial, although | + | Using the combiner is beneficial, although combining the word occurrences in mapper manually is still faster. |
---- | ---- |