Differences

This shows you the differences between two versions of the page.

--- courses:mapreduce-tutorial:step-8 [2012/01/30 00:38]
straka Improving package names of Perl programs.
+++ courses:mapreduce-tutorial:step-8 [2012/01/31 15:55] (current)
straka
@@ Line 12: / Line 12: @@
 To use multiple reducers, the MR job must be executed by a cluster (even with one computer), not locally. The number of reducers is specified by ''-r'' flag:
-  perl script.pl run [-jt cluster_master | -c cluster_size [-w sec_to_wait]] [-r number_of_reducers]
+  perl script.pl [-jt cluster_master | -c cluster_size [-w sec_to_wait]] [-r number_of_reducers]
 Optimal number of reducers is the same as the number of machines in the cluster, so that all the reducers can run in parallel at the same time.
@@ Line 52: / Line 52: @@
 ===== The order of keys during reduce =====
-It is guaranteed that every reducer processes the keys in //ascending order//.
+It is guaranteed that every reducer processes the keys in //ascending lexicographic order//.
 On the other hand, the order of values belonging to one key is undefined.
@@ Line 62: / Line 62: @@
   # NOW EDIT THE FILE
   # $EDITOR step-8-exercise.pl
-  rm -rf step-8-out-ex; perl step-8-exercise.pl run /home/straka/wiki/cs-text-medium/ step-8-out-ex
+  rm -rf step-8-out-ex; perl step-8-exercise.pl -c 2 -r 2 /home/straka/wiki/cs-text-medium/ step-8-out-ex
   less step-8-out-ex/part-*
@@ Line 70: / Line 70: @@
   # NOW VIEW THE FILE
   # $EDITOR step-8-solution.pl
-  rm -rf step-8-out-sol; perl step-8-solution.pl run /home/straka/wiki/cs-text-medium/ step-8-out-sol
+  rm -rf step-8-out-sol; perl step-8-solution.pl -c 2 -r 2 /home/straka/wiki/cs-text-medium/ step-8-out-sol
   less step-8-out-sol/part-*

[ Back to the navigation ] [ Back to the content ]

Institute of Formal and Applied Linguistics Wiki

Differences