Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
courses:mapreduce-tutorial:step-7 [2012/01/25 00:51] straka |
courses:mapreduce-tutorial:step-7 [2012/01/25 22:01] straka |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== MapReduce Tutorial : Dynamic Hadoop cluster for several computations ====== | ====== MapReduce Tutorial : Dynamic Hadoop cluster for several computations ====== | ||
- | When multiple | + | When multiple |
A cluster can be created using | A cluster can be created using | ||
Line 10: | Line 10: | ||
===== Using a running cluster ===== | ===== Using a running cluster ===== | ||
- | Running cluster is identified by its master. When running a Perl MR job, existing cluster can be used by | + | Running cluster is identified by its master. When running a Hadoop |
- | perl script.pl run -jt hostname_of_cluster_master:9001 ... | + | perl script.pl run -jt cluster_master:9001 ... |
===== Example ===== | ===== Example ===== | ||
- | Try running the same script {{: | + | Try running the same script {{: |
- | / | + | / |
- | perl wordcount.pl -jt hostname_of_cluster_master:9001 -Dmapred.max.split.size=1000000 / | + | perl wordcount.pl |