Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
courses:mapreduce-tutorial:step-7 [2012/01/25 22:01] straka |
courses:mapreduce-tutorial:step-7 [2012/01/29 23:51] majlis |
||
---|---|---|---|
Line 4: | Line 4: | ||
A cluster can be created using | A cluster can be created using | ||
- | /home/straka/ | + | /net/projects/ |
The syntax is the same as in '' | The syntax is the same as in '' | ||
Line 15: | Line 15: | ||
===== Example ===== | ===== Example ===== | ||
- | Try running the same script {{: | + | Try running the same script {{: |
- | /home/straka/ | + | |
- | perl wordcount.pl run -jt cluster_master: | + | / |
+ | | ||
+ | # $EDITOR step-7-solution.pl | ||
+ | rm -rf step-7-out-sol; | ||
+ | less less step-7-out-sol/ | ||
+ | Remarks: | ||
+ | * The reducers seem to start running before the mappers finish. In the web interface, the running time of reducers is divided into thirds: | ||
+ | * during the first 33%, the mapper outputs are copied to the machine where reducer runs. | ||
+ | * during the second 33%, the (key, value) pairs are sorted. | ||
+ | * during the last 33%, the user-defined reducer runs. | ||
+ | |||
+ | ---- | ||
+ | |||
+ | < | ||
+ | <table style=" | ||
+ | < | ||
+ | <td style=" | ||
+ | <td style=" | ||
+ | <td style=" | ||
+ | </ | ||
+ | </ | ||
+ | </ | ||