Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
courses:mapreduce-tutorial:step-9 [2012/01/25 15:56] straka |
courses:mapreduce-tutorial:step-9 [2012/01/25 16:18] straka |
||
---|---|---|---|
Line 5: | Line 5: | ||
The Hadoop itself uses many configuration options. Every option has a (dot-separated) name and a value and can be set on the command line using '' | The Hadoop itself uses many configuration options. Every option has a (dot-separated) name and a value and can be set on the command line using '' | ||
perl script.pl run [-jt cluster_master | -c cluster_size [-w sec_to_wait]] [-r number_of_reducers] [Hadoop options] input_path output_path | perl script.pl run [-jt cluster_master | -c cluster_size [-w sec_to_wait]] [-r number_of_reducers] [Hadoop options] input_path output_path | ||
- | Mind that the order of options matters -- the '' | + | Mind that the order of options matters -- the '' |
+ | Every Hadoop option has a read-only default. These are overridden by cluster specific options. Lastly, all of these are overriden by job specific options given on the command line (or set using the Java API). | ||
+ | ===== A brief list of Hadoop options ===== | ||
+ | ^ Hadoop option ^ Default value ^ Description ^ | ||
+ | | '' | ||
+ | | '' | ||
+ | | '' | ||
+ | | '' | ||
+ | | '' | ||
+ | | '' | ||
+ | | '' | ||
+ | |||
+ | A more complete list (but not exhaustive) can be found [[http:// | ||
+ | |||
+ | ===== Mapping of Perl options to Hadoop ===== | ||
+ | ^ Perl options ^ Hadoop options ^ | ||
+ | | no options \\ (running locally) | '' | ||
+ | | '' | ||
+ | | '' | ||
+ | | '' | ||