org.apache.hadoop.mapred.Task.getCounters()方法的使用及代码示例

x33g5p2x  于2022-01-30 转载在 其他  
字(2.4k)|赞(0)|评价(0)|浏览(69)

本文整理了Java中org.apache.hadoop.mapred.Task.getCounters()方法的一些代码示例,展示了Task.getCounters()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Task.getCounters()方法的具体详情如下:
包路径:org.apache.hadoop.mapred.Task
类名称:Task
方法名:getCounters

Task.getCounters介绍

暂无

代码示例

代码示例来源:origin: org.jvnet.hudson.hadoop/hadoop-core

/**
 * Updates counters corresponding to completed tasks.
 * @param task A map or reduce task which has just been 
 * successfully completed
 */ 
private void updateCounters(Task task) {
 completedTaskCounters.incrAllCounters(task.getCounters());
}

代码示例来源:origin: com.facebook.hadoop/hadoop-core

public TaskInProgress(Task task, JobConf conf,
  TaskLauncher launcher, Writable extensible) {
 this.task = task;
 this.launcher = launcher;
 this.lastProgressReport = System.currentTimeMillis();
 this.defaultJobConf = conf;
 this.extensible = extensible;
 localJobConf = null;
 taskStatus = TaskStatus.createTaskStatus(task.isMapTask(), task.getTaskID(),
                      0.0f,
                      task.getNumSlotsRequired(),
                      task.getState(),
                      diagnosticInfo.toString(),
                      "initializing",
                      getName(),
                      task.isTaskCleanupTask() ?
                       TaskStatus.Phase.CLEANUP :
                      task.isMapTask()? TaskStatus.Phase.MAP:
                      TaskStatus.Phase.SHUFFLE,
                      task.getCounters());
 taskTimeout = (10 * 60 * 1000);
}

代码示例来源:origin: org.jvnet.hudson.hadoop/hadoop-core

public TaskInProgress(Task task, JobConf conf, TaskLauncher launcher) {
 this.task = task;
 this.launcher = launcher;
 this.lastProgressReport = System.currentTimeMillis();
 this.defaultJobConf = conf;
 localJobConf = null;
 taskStatus = TaskStatus.createTaskStatus(task.isMapTask(), task.getTaskID(), 
                      0.0f, 
                      task.getState(),
                      diagnosticInfo.toString(), 
                      "initializing",  
                      getName(), 
                      task.isTaskCleanupTask() ? 
                       TaskStatus.Phase.CLEANUP :  
                      task.isMapTask()? TaskStatus.Phase.MAP:
                      TaskStatus.Phase.SHUFFLE,
                      task.getCounters()); 
 taskTimeout = (10 * 60 * 1000);
}

代码示例来源:origin: org.apache.hadoop/hadoop-mapred

public TaskInProgress(Task task, JobConf conf, TaskLauncher launcher) {
 this.task = task;
 this.launcher = launcher;
 this.lastProgressReport = System.currentTimeMillis();
 this.defaultJobConf = conf;
 localJobConf = null;
 taskStatus = TaskStatus.createTaskStatus(task.isMapTask(), task.getTaskID(), 
                      0.0f, 
                      task.getNumSlotsRequired(),
                      task.getState(),
                      diagnosticInfo.toString(), 
                      "initializing",  
                      getName(), 
                      task.isTaskCleanupTask() ? 
                       TaskStatus.Phase.CLEANUP :  
                      task.isMapTask()? TaskStatus.Phase.MAP:
                      TaskStatus.Phase.SHUFFLE,
                      task.getCounters()); 
 taskTimeout = (10 * 60 * 1000);
}

代码示例来源:origin: ch.cern.hadoop/hadoop-mapreduce-client-core

getCounters().toString());

相关文章

微信公众号

最新文章

更多