Skip to content

Commit 0c8607a

Browse files
stotywchevreuil
authored andcommitted
HBASE-26398 CellCounter fails for large tables filling up local disk (apache#3798)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org> (cherry picked from commit 60254bc)
1 parent 385e0d6 commit 0c8607a

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/CellCounter.java

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -215,14 +215,14 @@ public static Job createSubmittableJob(Configuration conf, String[] args)
215215
Scan scan = getConfiguredScanForJob(conf, args);
216216
TableMapReduceUtil.initTableMapperJob(tableName, scan,
217217
CellCounterMapper.class, ImmutableBytesWritable.class, Result.class, job);
218-
job.setNumReduceTasks(1);
219218
job.setMapOutputKeyClass(Text.class);
220219
job.setMapOutputValueClass(IntWritable.class);
221220
job.setOutputFormatClass(TextOutputFormat.class);
222221
job.setOutputKeyClass(Text.class);
223222
job.setOutputValueClass(IntWritable.class);
224223
FileOutputFormat.setOutputPath(job, outputDir);
225224
job.setReducerClass(IntSumReducer.class);
225+
job.setCombinerClass(IntSumReducer.class);
226226
return job;
227227
}
228228

0 commit comments

Comments
 (0)