[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Last revision Both sides next revision
courses:mapreduce-tutorial:step-8 [2012/01/31 09:36]
straka The number of reducers must be specified in the exercise.
courses:mapreduce-tutorial:step-8 [2012/01/31 09:37]
straka Change Perl commandline syntax.
Line 12: Line 12:
  
 To use multiple reducers, the MR job must be executed by a cluster (even with one computer), not locally. The number of reducers is specified by ''-r'' flag: To use multiple reducers, the MR job must be executed by a cluster (even with one computer), not locally. The number of reducers is specified by ''-r'' flag:
-  perl script.pl run [-jt cluster_master | -c cluster_size [-w sec_to_wait]] [-r number_of_reducers]+  perl script.pl [-jt cluster_master | -c cluster_size [-w sec_to_wait]] [-r number_of_reducers]
  
 Optimal number of reducers is the same as the number of machines in the cluster, so that all the reducers can run in parallel at the same time. Optimal number of reducers is the same as the number of machines in the cluster, so that all the reducers can run in parallel at the same time.

[ Back to the navigation ] [ Back to the content ]