[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki

[ Back to the navigation ]

You are here: start » courses » mapreduce-tutorial » step-9

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
courses:mapreduce-tutorial:step-9 [2012/01/25 22:11]
straka 		courses:mapreduce-tutorial:step-9 [2012/01/31 09:42] (current)
straka Change Perl commandline syntax.
Line 4: Line 4:
  
 The Hadoop itself uses many configuration options. The options can be set on command line using the ''-Dname=value'' syntax: The Hadoop itself uses many configuration options. The options can be set on command line using the ''-Dname=value'' syntax:
-  perl script.pl run [-jt cluster_master | -c cluster_size [-w sec_to_wait]] [-r number_of_reducers] [Hadoop options] input_path output_path+  perl script.pl [-jt cluster_master | -c cluster_size [-w sec_to_wait]] [-r number_of_reducers] [-Dname=value -Dname=value ...] input output_path
 Mind that the order of options matters -- the ''-jt'', ''-c'', ''-w'' and ''-r'' must precede Hadoop options to be recognized. Mind that the order of options matters -- the ''-jt'', ''-c'', ''-w'' and ''-r'' must precede Hadoop options to be recognized.
  
Line 25: Line 25:
 | no options \\ (running locally) | ''-Dmapred.job.tracker=local'' \\ ''-Dmapred.local.dir=hadoop-localrunner-tmp'' \\ ''-Dhadoop.tmp.dir=hadoop-localrunner-tmp'' | | no options \\ (running locally) | ''-Dmapred.job.tracker=local'' \\ ''-Dmapred.local.dir=hadoop-localrunner-tmp'' \\ ''-Dhadoop.tmp.dir=hadoop-localrunner-tmp'' |
 | ''-jt cluster_master'' | ''-Dmapred.job.tracker=cluster_master'' | | ''-jt cluster_master'' | ''-Dmapred.job.tracker=cluster_master'' |
-| ''-c cluster_machines'' | configuration of new cluster contains \\ ''-Dmapred.job.tracker=cluster_master'' |+| ''-c cluster_machines'' | The configuration of new cluster contains \\ ''-Dmapred.job.tracker=cluster_master'' |
 | ''-r number_of_reducers'' | ''-Dmapred.reduce.tasks=number_of_reducers'' | | ''-r number_of_reducers'' | ''-Dmapred.reduce.tasks=number_of_reducers'' |
  
 +----
 +
 +<html>
 +<table style="width:100%">
 +<tr>
 +<td style="text-align:left; width: 33%; "></html>[[step-8|Step 8]]: Multiple mappers, reducers and partitioning.<html></td>
 +<td style="text-align:center; width: 33%; "></html>[[.|Overview]]<html></td>
 +<td style="text-align:right; width: 33%; "></html>[[step-10|Step 10]]: Combiners.<html></td>
 +</tr>
 +</table>
 +</html>

[ Back to the navigation ] [ Back to the content ]