[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
courses:mapreduce-tutorial:running-jobs [2012/02/05 21:19]
straka
courses:mapreduce-tutorial:running-jobs [2012/02/05 21:21]
straka
Line 8: Line 8:
  
 | ^ Command ^ | ^ Command ^
-^ Run Perl script ''script.pl'' | ''perl script.pl'' |+^ Run Perl script ''script.pl'' | ''perl script.pl'' //options// | 
 +^ Run Java job ''job.jar'' | ''/net/projects/hadoop/bin/hadoop job.jar'' //options// |
  
-  * When running Perl script ''script.pl'', use +The options are the same for Perl and java:
  
-Choosing mode of operation: +| ^ Options 
-| ^ Command +^ Run locally | ''input output''
-^ Run locally | ''perl script.pl input output''+^ Run using specified jobtracker | ''-jt jobtracker:port input output''
-^ Run using specified jobtracker | ''perl script.pl -jt jobtracker:port input output''+^ Run job in dedicated cluster | ''-c number_of_machines input output''
-^ Run job in dedicated cluster | ''perl script.pl -c number_of_machines input output''+^ Run job in dedicated cluster and after it finishes, \\ wait for //W// seconds before stopping the cluster | ''-c number_of_machines -w W_seconds input output''
-^ Run job in dedicated cluster and after it finishes, \\ wait for //W// seconds before stopping the cluster | ''perl script.pl -c number_of_machines -w W_seconds input output'' | +^ Run using //R// reducers \\ (//R//>1 not working when running locally)| ''-r R input output''
- +^ Run using //M// mappers | ''`/net/projects/hadoop/bin/compute-splitsize input M` input output'' |
-Specifying number of mappers and reducers: +
-| ^ Command ^ +
-^ Run using //R// reducers \\ (//R//>1 not working when running locally)| ''perl script.pl -r R script.pl input output''+
-^ Run using //M// mappers | ''perl script.pl `/net/projects/hadoop/bin/compute-splitsize input M` input output''+
- +
-===== Run Java jobs ===== +
-Choosing mode of operation: +
-| ^ Command ^ +
-^ Run locally | ''/net/projects/hadoop/bin/hadoop job.jar input output''+
-^ Run using specified jobtracker | ''/net/projects/hadoop/bin/hadoop job.jar -jt jobtracker:port input output''+
-^ Run job in dedicated cluster | ''/net/projects/hadoop/bin/hadoop job.jar -c number_of_machines input output''+
-^ Run job in dedicated cluster and after it finishes, \\ wait for //W// seconds before stopping the cluster | ''/net/projects/hadoop/bin/hadoop job.jar -c number_of_machines -w W_seconds input output''+
- +
-Specifying number of mappers and reducers: +
-| ^ Command ^ +
-^ Run using //R// reducers \\ (//R//>1 not working when running locally)| ''/net/projects/hadoop/bin/hadoop job.jar -r R script.pl input output''+
-^ Run using //M// mappers | ''/net/projects/hadoop/bin/hadoop job.jar `/net/projects/hadoop/bin/compute-splitsize input M` input output'' |+
  

[ Back to the navigation ] [ Back to the content ]