[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki

• ÚFAL Wiki Home
• ÚFAL Home
• Sitemap
• RSS
• ÚFAL calendar
• Recent changes
• Login
• Hledat:

[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

View differences: Side by SideInline Go

Link to this comparison view

Both sides previous revision Previous revision 2012/01/30 15:38 majlis 2012/01/30 15:04 majlis 2012/01/28 17:55 straka 2012/01/27 23:57 straka 2012/01/27 23:48 straka 2012/01/27 23:47 straka 2012/01/27 23:46 straka 2012/01/27 22:20 straka 2012/01/27 22:17 straka 2012/01/27 22:17 straka 2012/01/27 22:16 straka 2012/01/27 22:16 straka 2012/01/27 22:08 straka 2012/01/27 22:08 straka 2012/01/27 22:01 straka 2012/01/27 21:56 straka 2012/01/27 21:52 straka 2012/01/27 21:47 straka 2012/01/27 21:41 straka 2012/01/27 21:32 straka 2012/01/27 21:28 straka 2012/01/27 21:28 straka 2012/01/27 21:27 straka 2012/01/27 21:27 straka 2012/01/27 21:02 straka 2012/01/27 21:01 straka 2012/01/27 20:56 straka 2012/01/27 20:40 straka 2012/01/27 20:11 straka vytvořeno Go		2012/01/30 15:38 majlis 2012/01/30 15:04 majlis 2012/01/28 17:55 straka 2012/01/27 23:57 straka 2012/01/27 23:48 straka 2012/01/27 23:47 straka 2012/01/27 23:46 straka 2012/01/27 22:20 straka 2012/01/27 22:17 straka 2012/01/27 22:17 straka 2012/01/27 22:16 straka 2012/01/27 22:16 straka 2012/01/27 22:08 straka 2012/01/27 22:08 straka 2012/01/27 22:01 straka 2012/01/27 21:56 straka 2012/01/27 21:52 straka 2012/01/27 21:47 straka 2012/01/27 21:41 straka 2012/01/27 21:32 straka 2012/01/27 21:28 straka 2012/01/27 21:28 straka 2012/01/27 21:27 straka 2012/01/27 21:27 straka 2012/01/27 21:02 straka 2012/01/27 21:01 straka 2012/01/27 20:56 straka 2012/01/27 20:40 straka 2012/01/27 20:11 straka vytvořeno Go Next revision Both sides next revision
courses:mapreduce-tutorial:step-24 [2012/01/27 20:56] straka		courses:mapreduce-tutorial:step-24 [2012/01/27 21:01] straka
Line 18:		Line 18:
	public void setup(Context context) {		public void setup(Context context) {
	}		}
-		+
	public void map(Text key, Text value, Context context) throws IOException, InterruptedException {		public void map(Text key, Text value, Context context) throws IOException, InterruptedException {
	if (key.getLength() > 0 && Character.toUpperCase(key.charAt(0)) == 'A') {		if (key.getLength() > 0 && Character.toUpperCase(key.charAt(0)) == 'A') {
Line 26:		Line 26:
	public void cleanup(Context context) {		public void cleanup(Context context) {
-	}	+	}
	}		}
-		+
	// Job configuration		// Job configuration
	public int run(String[] args) throws Exception {		public int run(String[] args) throws Exception {
Line 35:		Line 35:
	return 1;		return 1;
	}		}
-		+
	Job job = new Job(getConf(), this.getClass().getName());		Job job = new Job(getConf(), this.getClass().getName());
-		+
	job.setJarByClass(this.getClass());		job.setJarByClass(this.getClass());
	job.setMapperClass(TheMapper.class);		job.setMapperClass(TheMapper.class);
	job.setOutputKeyClass(Text.class);		job.setOutputKeyClass(Text.class);
	job.setOutputValueClass(Text.class);		job.setOutputValueClass(Text.class);
-		+
	job.setInputFormatClass(KeyValueTextInputFormat.class);		job.setInputFormatClass(KeyValueTextInputFormat.class);
-		+
	FileInputFormat.addInputPath(job, new Path(args[0]));		FileInputFormat.addInputPath(job, new Path(args[0]));
	FileOutputFormat.setOutputPath(job, new Path(args[1]));		FileOutputFormat.setOutputPath(job, new Path(args[1]));
-		+
	return job.waitForCompletion(true) ? 0 : 1;		return job.waitForCompletion(true) ? 0 : 1;
	}		}
Line 57:		Line 57:
	System.exit(res);		System.exit(res);
	}		}
-	}	+	}
	</file>		</file>
		+
		+	===== Running the job =====
		+	Download the source and compile it.
		+
		+	The //official// way of running Hadoop jobs is using ''//SGE/HADOOP/active/bin/hadoop'' script. This script has no user-friendly options and only Hadoop properties can be set. Therefore a wrapper script is provided. This script has the same options as the Perl API runner:
		+	* ''net/projects/hadoop/bin/hadoop job.jar input_path output_path'' executes teh given job locally in a single thread. It is useful for debugging.
		+

---

[ Back to the navigation ] [ Back to the content ]