Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
courses:mapreduce-tutorial:step-9 [2012/01/25 16:17] straka |
courses:mapreduce-tutorial:step-9 [2012/01/25 22:11] straka |
||
---|---|---|---|
Line 3: | Line 3: | ||
We have controlled the Hadoop jobs using the Perl API so far, which is quite limited. | We have controlled the Hadoop jobs using the Perl API so far, which is quite limited. | ||
- | The Hadoop itself uses many configuration options. | + | The Hadoop itself uses many configuration options. |
perl script.pl run [-jt cluster_master | -c cluster_size [-w sec_to_wait]] [-r number_of_reducers] [Hadoop options] input_path output_path | perl script.pl run [-jt cluster_master | -c cluster_size [-w sec_to_wait]] [-r number_of_reducers] [Hadoop options] input_path output_path | ||
Mind that the order of options matters -- the '' | Mind that the order of options matters -- the '' | ||
- | Every Hadoop option has a read-only default. These are overridden by cluster specific options. Lastly, all of these are overriden | + | Every Hadoop option has a read-only default. These are overridden by cluster specific options. Lastly, all of these are overridden |
===== A brief list of Hadoop options ===== | ===== A brief list of Hadoop options ===== | ||
^ Hadoop option ^ Default value ^ Description ^ | ^ Hadoop option ^ Default value ^ Description ^ | ||
- | | '' | + | | '' |
- | | '' | + | | '' |
- | | '' | + | | '' |
- | | '' | + | | '' |
- | | '' | + | | '' |
- | | '' | + | | '' |
- | | '' | + | | '' |
A more complete list (but not exhaustive) can be found [[http:// | A more complete list (but not exhaustive) can be found [[http:// | ||
- | ==== Mapping of Perl options to Hadoop ==== | + | ===== Mapping of Perl options to Hadoop |
^ Perl options ^ Hadoop options ^ | ^ Perl options ^ Hadoop options ^ | ||
| no options \\ (running locally) | '' | | no options \\ (running locally) | '' |