[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Last revision Both sides next revision
courses:mapreduce-tutorial:managing-a-hadoop-cluster [2012/02/05 19:56]
straka
courses:mapreduce-tutorial:managing-a-hadoop-cluster [2013/02/08 14:35]
popel Milan improved our Hadoop
Line 13: Line 13:
  
 A Hadoop cluster is stopped: A Hadoop cluster is stopped:
-  * after the timeout specified by ''-w''+  * after the timeout specified by ''-w'' after the last task is finished
   * when the ''HadoopCluster.c$SGE_JOBID'' file is deleted   * when the ''HadoopCluster.c$SGE_JOBID'' file is deleted
   * using ''qdel''.   * using ''qdel''.
 +
 +===== Web interface =====
 +
 +The web interface provides a lot of useful information:
 +  * running, failed and successfully completed jobs
 +  * for running job, current progress and counters of the whole job and also of each mapper and reducer is available
 +  * for any job, the counters and outputs of all mappers and reducers
 +  * for any job, all Hadoop settings
  
 ===== Killing running jobs ===== ===== Killing running jobs =====
  
-Jobs running +Jobs running in a cluster can be stopped using 
 +<code>/SGE/HADOOP/active/bin/hadoop -jt jobtracker:port -kill hadoop-job-id</code> 
 + 
 +The jobs running on a cluster are present in the web interface, or can be printed using 
 +<code>/SGE/HADOOP/active/bin/hadoop -jt jobtracker:port -list</code> 

[ Back to the navigation ] [ Back to the content ]