[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
courses:mapreduce-tutorial:running-jobs [2012/02/05 21:24]
straka
courses:mapreduce-tutorial:running-jobs [2013/02/08 14:33] (current)
popel Milan improved our Hadoop
Line 20: Line 20:
 ^ Run using //R// reducers \\ (//R//>1 not working when running locally)| ''​-r R input output''​ | ^ Run using //R// reducers \\ (//R//>1 not working when running locally)| ''​-r R input output''​ |
 ^ Run using //M// mappers | ''​`/​net/​projects/​hadoop/​bin/​compute-splitsize input M` input output''​ | ^ Run using //M// mappers | ''​`/​net/​projects/​hadoop/​bin/​compute-splitsize input M` input output''​ |
 +
 +From February 2012, using the parameter ''​-w''​ makes Hadoop to wait W seconds after the **last** task is finished. This means that you can start a cluster for one task (with ''​-c N_machines -w W_seconds''​) and reuse it (with ''​-jt jobtracker:​port''​) for other tasks without worries that the other tasks will be killed before finishing.
  
 ===== Running multiple jobs ===== ===== Running multiple jobs =====

[ Back to the navigation ] [ Back to the content ]