org.apache.hadoop.mapred.Task.isJobCleanupTask()方法的使用及代码示例

x33g5p2x  于2022-01-30 转载在 其他  
字(3.2k)|赞(0)|评价(0)|浏览(82)

本文整理了Java中org.apache.hadoop.mapred.Task.isJobCleanupTask()方法的一些代码示例,展示了Task.isJobCleanupTask()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Task.isJobCleanupTask()方法的具体详情如下:
包路径:org.apache.hadoop.mapred.Task
类名称:Task
方法名:isJobCleanupTask

Task.isJobCleanupTask介绍

暂无

代码示例

代码示例来源:origin: com.facebook.hadoop/hadoop-core

boolean isJobAbortTask() {
 // the task is an abort task if its marked for cleanup and the final 
 // expected state is either failed or killed.
 return isJobCleanupTask() 
     && (jobRunStateForCleanup == JobStatus.State.KILLED 
       || jobRunStateForCleanup == JobStatus.State.FAILED);
}

代码示例来源:origin: io.hops/hadoop-mapreduce-client-core

boolean isJobAbortTask() {
 // the task is an abort task if its marked for cleanup and the final 
 // expected state is either failed or killed.
 return isJobCleanupTask() 
     && (jobRunStateForCleanup == JobStatus.State.KILLED 
       || jobRunStateForCleanup == JobStatus.State.FAILED);
}

代码示例来源:origin: com.github.jiayuhan-it/hadoop-mapreduce-client-core

boolean isJobAbortTask() {
 // the task is an abort task if its marked for cleanup and the final 
 // expected state is either failed or killed.
 return isJobCleanupTask() 
     && (jobRunStateForCleanup == JobStatus.State.KILLED 
       || jobRunStateForCleanup == JobStatus.State.FAILED);
}

代码示例来源:origin: ch.cern.hadoop/hadoop-mapreduce-client-core

boolean isJobAbortTask() {
 // the task is an abort task if its marked for cleanup and the final 
 // expected state is either failed or killed.
 return isJobCleanupTask() 
     && (jobRunStateForCleanup == JobStatus.State.KILLED 
       || jobRunStateForCleanup == JobStatus.State.FAILED);
}

代码示例来源:origin: io.prestosql.hadoop/hadoop-apache

boolean isJobAbortTask() {
 // the task is an abort task if its marked for cleanup and the final 
 // expected state is either failed or killed.
 return isJobCleanupTask() 
     && (jobRunStateForCleanup == JobStatus.State.KILLED 
       || jobRunStateForCleanup == JobStatus.State.FAILED);
}

代码示例来源:origin: org.apache.hadoop/hadoop-mapred

boolean isJobAbortTask() {
 // the task is an abort task if its marked for cleanup and the final 
 // expected state is either failed or killed.
 return isJobCleanupTask() 
     && (jobRunStateForCleanup == JobStatus.State.KILLED 
       || jobRunStateForCleanup == JobStatus.State.FAILED);
}

代码示例来源:origin: com.facebook.hadoop/hadoop-core

!tip.getTask().isJobCleanupTask() &&
 !tip.getTask().isJobSetupTask()) {
if (!mapperWaitThreadMap.containsKey(tip)) {

代码示例来源:origin: com.facebook.hadoop/hadoop-core

/**
 * The primary public method that should be called to 'run' a task. Handles
 * both map and reduce tasks and marks them as completed after the configured
 * time interval
 * @param tip
 */
public void launchTask(TaskInProgress tip) throws IOException {
 LOG.info("Launching simulated task " + tip.getTask().getTaskID() +
   " for job " + tip.getTask().getJobID());
 TaskUmbilicalProtocol umbilicalProtocol = taskTracker.getUmbilical(tip);
 // For map tasks, we can just finish the task after some time. Same thing
 // with cleanup tasks, as we don't need to be waiting for mappers to finish
 if (tip.getTask().isMapTask() || tip.getTask().isTaskCleanupTask() ||
  tip.getTask().isJobCleanupTask() || tip.getTask().isJobSetupTask() ) {
  addTipToFinish(tip, umbilicalProtocol);
 } else {
  MapperWaitThread mwt =
    new MapperWaitThread(tip, this, umbilicalProtocol);
  // Save a reference to the mapper wait thread so that we can stop them if
  // the task gets killed
  mapperWaitThreadMap.put(tip, mwt);
  mwt.start();
 }
}

相关文章

微信公众号

最新文章

更多