[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki

• ÚFAL Wiki Home
• ÚFAL Home
• Sitemap
• RSS
• ÚFAL calendar
• Recent changes
• Login
• Hledat:

[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

View differences: Side by SideInline Go

Link to this comparison view

Both sides previous revision Previous revision 2013/02/08 14:33 popel Milan improved our Hadoop2012/02/05 21:24 straka 2012/02/05 21:21 straka 2012/02/05 21:21 straka 2012/02/05 21:19 straka 2012/02/05 21:16 straka 2012/02/05 21:15 straka 2012/02/05 21:15 straka 2012/02/05 21:15 straka 2012/02/05 21:14 straka 2012/02/05 21:06 straka 2012/02/05 21:05 straka 2012/02/05 21:04 straka 2012/02/05 20:00 straka 2012/02/05 19:37 straka vytvořeno Go Next revision		Previous revision 2013/02/08 14:33 popel Milan improved our Hadoop2012/02/05 21:24 straka 2012/02/05 21:21 straka 2012/02/05 21:21 straka 2012/02/05 21:19 straka 2012/02/05 21:16 straka 2012/02/05 21:15 straka 2012/02/05 21:15 straka 2012/02/05 21:15 straka 2012/02/05 21:14 straka 2012/02/05 21:06 straka 2012/02/05 21:05 straka 2012/02/05 21:04 straka 2012/02/05 20:00 straka 2012/02/05 19:37 straka vytvořeno Go Last revision Both sides next revision
courses:mapreduce-tutorial:running-jobs [2012/02/05 21:21] straka		courses:mapreduce-tutorial:running-jobs [2012/02/05 21:24] straka
Line 8:		Line 8:
	| ^ Command ^		| ^ Command ^
-	^ Run Perl script ''script.pl'' | ''perl script.pl'' options |	+	^ Run Perl script ''script.pl'' | ''perl script.pl'' //options// |
-	^ Run Java job ''job.jar'' | ''/net/projects/hadoop/bin/hadoop job.jar'' options |	+	^ Run Java job ''job.jar'' | ''/net/projects/hadoop/bin/hadoop job.jar'' //options// |
	The options are the same for Perl and java:		The options are the same for Perl and java:
Line 21:		Line 21:
	^ Run using //M// mappers | ''`/net/projects/hadoop/bin/compute-splitsize input M` input output'' |		^ Run using //M// mappers | ''`/net/projects/hadoop/bin/compute-splitsize input M` input output'' |
		+	===== Running multiple jobs =====
		+	There are several ways of running multiple jobs:
		+	* Java only: Create multiple ''Job'' instances and call ''submit'' or ''waitForCompletion'' multiple times
		+	* Create a cluster using ''/net/projects/hadoop/bin/hadoop-cluster'', parse the jobtracker:port using ''head -1'' and run the jobs using ''-jt jobtracker:port''
		+	* Create a shell script running multiple jobs using ''-jt HADOOP_JOBTRACKER''. Then run it using ''//net/projects/hadoop/bin/hadoop-cluster -c machines script.sh''.

---

[ Back to the navigation ] [ Back to the content ]