[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
courses:mapreduce-tutorial:step-6 [2012/01/25 00:11]
straka
courses:mapreduce-tutorial:step-6 [2012/01/25 00:28]
straka
Line 20: Line 20:
   * running, failed and successfully completed jobs   * running, failed and successfully completed jobs
   * for running job, current progress and counters of the whole job and also of each mapper and reducer is available   * for running job, current progress and counters of the whole job and also of each mapper and reducer is available
-  * for any job, the counters and outputs of all mappers and reducers are stored+  * for any job, the counters and outputs of all mappers and reducers 
 +  * for any job, all Hadoop settings
  
 +===== Example =====
 +
 +Try running the {{:courses:mapreduce-tutorial:step-6.txt|wordcount.pl}} using
 +  perl wordcount.pl -c 1 -w 300 -Dmapred.max.split.size=1000000 /home/straka/wiki/cs-text-medium some_output_directory
 +and explore the web interface.
 +
 +If you cannot access directly the ''*.ufal.hide.ms.mff.cuni.cz'', you can use for example
 +  ssh -N -L 50030:pandora3:50030 geri
 +to create a tunnel from local port 50030 to machine ''pandora3:50030''

[ Back to the navigation ] [ Back to the content ]