[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
courses:mapreduce-tutorial:step-6 [2012/01/31 09:41]
straka Change Perl commandline syntax.
courses:mapreduce-tutorial:step-6 [2012/02/06 13:55]
straka
Line 17: Line 17:
 ===== Web interface ===== ===== Web interface =====
  
-The cluster master provides a web interface on port 50030 (the port may change in the future). The cluster master address can be found at the first line of ''script.pl.c$SGE_JOBID'', or using ''qstat -j $SGE_JOBID'' (context variable ''hdfs_jobtracker_admin'').+The cluster master provides a web interface on address printed by the ''hadoop-cluster'' script. The address is also present on the second line of ''script.pl.c$SGE_JOBID'', or using ''qstat -j $SGE_JOBID''context variable ''hdfs_jobtracker_admin''.
  
 The web interface provides a lot of useful information: The web interface provides a lot of useful information:
Line 25: Line 25:
   * for any job, all Hadoop settings   * for any job, all Hadoop settings
  
-===== If things go wrong ===== 
  
-If the Hadoop job crashes, there are several ways you can do: 
-  * run the computation locally in single threaded mode. This is more useful for Hadoop jobs written in Java, because then you can use a debugger. When using Perl API, new subprocess are created for Perl tasks anyway. 
-  * use standard error output for log messages. You can access the stderr logs of all Hadoop tasks using the web interface. 
  
 ===== Example ===== ===== Example =====

[ Back to the navigation ] [ Back to the content ]