Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
courses:mapreduce-tutorial:step-9 [2012/01/25 16:07] straka |
courses:mapreduce-tutorial:step-9 [2012/01/26 23:12] straka |
||
---|---|---|---|
Line 3: | Line 3: | ||
We have controlled the Hadoop jobs using the Perl API so far, which is quite limited. | We have controlled the Hadoop jobs using the Perl API so far, which is quite limited. | ||
- | The Hadoop itself uses many configuration options. | + | The Hadoop itself uses many configuration options. |
perl script.pl run [-jt cluster_master | -c cluster_size [-w sec_to_wait]] [-r number_of_reducers] [Hadoop options] input_path output_path | perl script.pl run [-jt cluster_master | -c cluster_size [-w sec_to_wait]] [-r number_of_reducers] [Hadoop options] input_path output_path | ||
Mind that the order of options matters -- the '' | Mind that the order of options matters -- the '' | ||
- | Every Hadoop option has a read-only default. These are overridden by cluster specific options. Lastly, all of these are overriden | + | Every Hadoop option has a read-only default. These are overridden by cluster specific options. Lastly, all of these are overridden |
+ | |||
+ | ===== A brief list of Hadoop options ===== | ||
+ | ^ Hadoop option ^ Default value ^ Description ^ | ||
+ | | '' | ||
+ | | '' | ||
+ | | '' | ||
+ | | '' | ||
+ | | '' | ||
+ | | '' | ||
+ | | '' | ||
+ | |||
+ | A more complete list (but not exhaustive) can be found [[http:// | ||
===== Mapping of Perl options to Hadoop ===== | ===== Mapping of Perl options to Hadoop ===== | ||
Line 13: | Line 25: | ||
| no options \\ (running locally) | '' | | no options \\ (running locally) | '' | ||
| '' | | '' | ||
- | | '' | + | | '' |
| '' | | '' | ||
+ |