HadoopJob

Hadoop Job的提交,到底提交了什么?

两盒软妹~` 提交于 2019-12-04 05:04:36
##一个最基本的Hadoo任务 WordCountMapper: <pre class="prettyprint lang-java"> private final static IntWritable one = new IntWritable(1); @Override public void map(LongWritable key, Text value, Context context) throws IOException, InterruptedException { StringTokenizer tokenizer = new StringTokenizer(value.toString()); while (tokenizer.hasMoreTokens()) { String str = tokenizer.nextToken(); context.write(new Text(StringUtils.trim(str.replaceAll("\\W", ""))), one); } } </pre> WordCountReduce: <pre class="prettyprint lang-java"> @Override public void reduce(Text key, Iterable<IntWritable> values, Context