org.apache.hadoop.mapred.Task.createReduceContext()方法的使用及代码示例

x33g5p2x  于2022-01-30 转载在 其他  
字(4.2k)|赞(0)|评价(0)|浏览(94)

本文整理了Java中org.apache.hadoop.mapred.Task.createReduceContext()方法的一些代码示例,展示了Task.createReduceContext()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Task.createReduceContext()方法的具体详情如下:
包路径:org.apache.hadoop.mapred.Task
类名称:Task
方法名:createReduceContext

Task.createReduceContext介绍

暂无

代码示例

代码示例来源:origin: io.hops/hadoop-mapreduce-client-core

@SuppressWarnings("unchecked")
 @Override
 public void combine(RawKeyValueIterator iterator, 
        OutputCollector<K,V> collector
        ) throws IOException, InterruptedException,
            ClassNotFoundException {
  // make a reducer
  org.apache.hadoop.mapreduce.Reducer<K,V,K,V> reducer =
   (org.apache.hadoop.mapreduce.Reducer<K,V,K,V>)
    ReflectionUtils.newInstance(reducerClass, job);
  org.apache.hadoop.mapreduce.Reducer.Context 
     reducerContext = createReduceContext(reducer, job, taskId,
                       iterator, null, inputCounter, 
                       new OutputConverter(collector),
                       committer,
                       reporter, comparator, keyClass,
                       valueClass);
  reducer.run(reducerContext);
 } 
}

代码示例来源:origin: com.github.jiayuhan-it/hadoop-mapreduce-client-core

@SuppressWarnings("unchecked")
 @Override
 public void combine(RawKeyValueIterator iterator, 
        OutputCollector<K,V> collector
        ) throws IOException, InterruptedException,
            ClassNotFoundException {
  // make a reducer
  org.apache.hadoop.mapreduce.Reducer<K,V,K,V> reducer =
   (org.apache.hadoop.mapreduce.Reducer<K,V,K,V>)
    ReflectionUtils.newInstance(reducerClass, job);
  org.apache.hadoop.mapreduce.Reducer.Context 
     reducerContext = createReduceContext(reducer, job, taskId,
                       iterator, null, inputCounter, 
                       new OutputConverter(collector),
                       committer,
                       reporter, comparator, keyClass,
                       valueClass);
  reducer.run(reducerContext);
 } 
}

代码示例来源:origin: io.prestosql.hadoop/hadoop-apache

@SuppressWarnings("unchecked")
 @Override
 public void combine(RawKeyValueIterator iterator, 
        OutputCollector<K,V> collector
        ) throws IOException, InterruptedException,
            ClassNotFoundException {
  // make a reducer
  org.apache.hadoop.mapreduce.Reducer<K,V,K,V> reducer =
   (org.apache.hadoop.mapreduce.Reducer<K,V,K,V>)
    ReflectionUtils.newInstance(reducerClass, job);
  org.apache.hadoop.mapreduce.Reducer.Context 
     reducerContext = createReduceContext(reducer, job, taskId,
                       iterator, null, inputCounter, 
                       new OutputConverter(collector),
                       committer,
                       reporter, comparator, keyClass,
                       valueClass);
  reducer.run(reducerContext);
 } 
}

代码示例来源:origin: ch.cern.hadoop/hadoop-mapreduce-client-core

@SuppressWarnings("unchecked")
 @Override
 public void combine(RawKeyValueIterator iterator, 
        OutputCollector<K,V> collector
        ) throws IOException, InterruptedException,
            ClassNotFoundException {
  // make a reducer
  org.apache.hadoop.mapreduce.Reducer<K,V,K,V> reducer =
   (org.apache.hadoop.mapreduce.Reducer<K,V,K,V>)
    ReflectionUtils.newInstance(reducerClass, job);
  org.apache.hadoop.mapreduce.Reducer.Context 
     reducerContext = createReduceContext(reducer, job, taskId,
                       iterator, null, inputCounter, 
                       new OutputConverter(collector),
                       committer,
                       reporter, comparator, keyClass,
                       valueClass);
  reducer.run(reducerContext);
 } 
}

代码示例来源:origin: com.facebook.hadoop/hadoop-core

@SuppressWarnings("unchecked")
 @Override
 void combine(RawKeyValueIterator iterator, 
        OutputCollector<K,V> collector
        ) throws IOException, InterruptedException,
            ClassNotFoundException {
  // make a reducer
  org.apache.hadoop.mapreduce.Reducer<K,V,K,V> reducer =
   (org.apache.hadoop.mapreduce.Reducer<K,V,K,V>)
    ReflectionUtils.newInstance(reducerClass, job);
  org.apache.hadoop.mapreduce.Reducer.Context 
     reducerContext = createReduceContext(reducer, job, taskId,
                       iterator, null, inputCounter, 
                       new OutputConverter(collector),
                       committer,
                       reporter, comparator, keyClass,
                       valueClass);
  reducer.run(reducerContext);
 }
}

代码示例来源:origin: org.apache.hadoop/hadoop-mapred

@SuppressWarnings("unchecked")
 @Override
 void combine(RawKeyValueIterator iterator, 
        OutputCollector<K,V> collector
        ) throws IOException, InterruptedException,
            ClassNotFoundException {
  // make a reducer
  org.apache.hadoop.mapreduce.Reducer<K,V,K,V> reducer =
   (org.apache.hadoop.mapreduce.Reducer<K,V,K,V>)
    ReflectionUtils.newInstance(reducerClass, job);
  org.apache.hadoop.mapreduce.Reducer.Context 
     reducerContext = createReduceContext(reducer, job, taskId,
                       iterator, null, inputCounter, 
                       new OutputConverter(collector),
                       committer,
                       reporter, comparator, keyClass,
                       valueClass);
  reducer.run(reducerContext);
 } 
}

相关文章

微信公众号

最新文章

更多