[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki

• ÚFAL Wiki Home
• ÚFAL Home
• Sitemap
• RSS
• ÚFAL calendar
• Recent changes
• Login
• Hledat:

[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

View differences: Side by SideInline Go

Link to this comparison view

Both sides previous revision Previous revision 2012/01/30 15:04 majlis 2012/01/28 17:55 straka 2012/01/27 23:57 straka 2012/01/27 23:48 straka 2012/01/27 23:47 straka 2012/01/27 23:46 straka 2012/01/27 22:20 straka 2012/01/27 22:17 straka 2012/01/27 22:17 straka 2012/01/27 22:16 straka 2012/01/27 22:16 straka 2012/01/27 22:08 straka 2012/01/27 22:08 straka 2012/01/27 22:01 straka 2012/01/27 21:56 straka 2012/01/27 21:52 straka 2012/01/27 21:47 straka 2012/01/27 21:41 straka 2012/01/27 21:32 straka 2012/01/27 21:28 straka 2012/01/27 21:28 straka 2012/01/27 21:27 straka 2012/01/27 21:27 straka 2012/01/27 21:02 straka 2012/01/27 21:01 straka 2012/01/27 20:56 straka 2012/01/27 20:40 straka 2012/01/27 20:11 straka vytvořeno Go		2012/01/30 15:04 majlis 2012/01/28 17:55 straka 2012/01/27 23:57 straka 2012/01/27 23:48 straka 2012/01/27 23:47 straka 2012/01/27 23:46 straka 2012/01/27 22:20 straka 2012/01/27 22:17 straka 2012/01/27 22:17 straka 2012/01/27 22:16 straka 2012/01/27 22:16 straka 2012/01/27 22:08 straka 2012/01/27 22:08 straka 2012/01/27 22:01 straka 2012/01/27 21:56 straka 2012/01/27 21:52 straka 2012/01/27 21:47 straka 2012/01/27 21:41 straka 2012/01/27 21:32 straka 2012/01/27 21:28 straka 2012/01/27 21:28 straka 2012/01/27 21:27 straka 2012/01/27 21:27 straka 2012/01/27 21:02 straka 2012/01/27 21:01 straka 2012/01/27 20:56 straka 2012/01/27 20:40 straka 2012/01/27 20:11 straka vytvořeno Go Next revision Both sides next revision
courses:mapreduce-tutorial:step-24 [2012/01/27 20:40] straka		courses:mapreduce-tutorial:step-24 [2012/01/27 20:56] straka
Line 2:		Line 2:
	We start by exploring a simple Hadoop job with Mapper only. The Mapper outputs only keys starting with ''A''.		We start by exploring a simple Hadoop job with Mapper only. The Mapper outputs only keys starting with ''A''.
		+	<file java MapperOnlyHadoopJob.java>
		+	import java.io.IOException;
		+	import org.apache.hadoop.conf.*;
		+	import org.apache.hadoop.fs.Path;
		+	import org.apache.hadoop.io.*;
		+	import org.apache.hadoop.mapreduce.*;
		+	import org.apache.hadoop.mapreduce.lib.input.*;
		+	import org.apache.hadoop.mapreduce.lib.output.*;
		+	import org.apache.hadoop.util.*;
		+
		+	public class MapperOnlyHadoopJob extends Configured implements Tool {
		+	// Mapper
		+	public static class TheMapper extends Mapper<Text, Text, Text, Text>{
		+	public void setup(Context context) {
		+	}
		+
		+	public void map(Text key, Text value, Context context) throws IOException, InterruptedException {
		+	if (key.getLength() > 0 && Character.toUpperCase(key.charAt(0)) == 'A') {
		+	context.write(key, value);
		+	}
		+	}
		+
		+	public void cleanup(Context context) {
		+	}
		+	}
		+
		+	// Job configuration
		+	public int run(String[] args) throws Exception {
		+	if (args.length < 2) {
		+	System.err.printf("Usage: %s.jar in-path out-path", this.getClass().getName());
		+	return 1;
		+	}
		+
		+	Job job = new Job(getConf(), this.getClass().getName());
		+
		+	job.setJarByClass(this.getClass());
		+	job.setMapperClass(TheMapper.class);
		+	job.setOutputKeyClass(Text.class);
		+	job.setOutputValueClass(Text.class);
		+
		+	job.setInputFormatClass(KeyValueTextInputFormat.class);
		+
		+	FileInputFormat.addInputPath(job, new Path(args[0]));
		+	FileOutputFormat.setOutputPath(job, new Path(args[1]));
		+
		+	return job.waitForCompletion(true) ? 0 : 1;
		+	}
		+
		+	// Main method
		+	public static void main(String[] args) throws Exception {
		+	int res = ToolRunner.run(new MapperOnlyHadoopJob(), args);
		+
		+	System.exit(res);
		+	}
		+	}
		+	</file>

---

[ Back to the navigation ] [ Back to the content ]