org.apache.hadoop.mapred.Task.setTaskCleanupTask()方法的使用及代码示例

x33g5p2x  于2022-01-30 转载在 其他  
字(2.8k)|赞(0)|评价(0)|浏览(78)

本文整理了Java中org.apache.hadoop.mapred.Task.setTaskCleanupTask()方法的一些代码示例,展示了Task.setTaskCleanupTask()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Task.setTaskCleanupTask()方法的具体详情如下:
包路径:org.apache.hadoop.mapred.Task
类名称:Task
方法名:setTaskCleanupTask

Task.setTaskCleanupTask介绍

暂无

代码示例

代码示例来源:origin: org.apache.hadoop/hadoop-mapred-test

public void testCommitNotRequiredForTaskCleanup() throws Exception {
 Task testTask = createDummyTask(TaskType.REDUCE);
 testTask.setTaskCleanupTask();
 assertFalse("Task cleanup task should not need commit", 
   testTask.isCommitRequired());
}

代码示例来源:origin: org.apache.hadoop/hadoop-mapred-test

/**
 * Validates if task cleanup is done properly for a task that is not succeeded
 * @throws IOException
 */
public void testFailedTaskFilesRemoval()
throws Exception {
 if (!canRun()) {
  return;
 }
 testTaskFilesRemoval(true, false);// needCleanup; no jvmReuse
 // initialize a cleanupAttempt for the task.
 task.setTaskCleanupTask();
 // localize task cleanup attempt
 initializeTask();
 checkTaskLocalization();
 // verify the cleanup of cleanup attempt.
 testTaskFilesRemoval(true, false);// needCleanup; no jvmReuse
}

代码示例来源:origin: ch.cern.hadoop/hadoop-mapreduce-client-jobclient

public void testCommitNotRequiredForTaskCleanup() throws Exception {
 Task testTask = createDummyTask(TaskType.REDUCE);
 testTask.setTaskCleanupTask();
 assertFalse("Task cleanup task should not need commit", 
   testTask.isCommitRequired());
}

代码示例来源:origin: org.apache.hadoop/hadoop-mapred

t.setTaskCleanupTask();
t.setState(taskStatuses.get(taskid).getRunState());
cleanupTasks.put(taskid, taskTracker);

代码示例来源:origin: com.facebook.hadoop/hadoop-core

t.setTaskCleanupTask();
t.setState(taskStatuses.get(taskid).getRunState());
cleanupTasks.put(taskid, taskTracker);

代码示例来源:origin: org.jvnet.hudson.hadoop/hadoop-core

t.setTaskCleanupTask();
t.setState(taskStatuses.get(taskid).getRunState());
cleanupTasks.put(taskid, taskTracker);

代码示例来源:origin: org.apache.hadoop/hadoop-mapred-test

/**
  * Localizes a cleanup task and validates permissions.
  * 
  * @throws InterruptedException 
  * @throws IOException 
  */
 public void testCleanupTaskLocalization() throws IOException,
   InterruptedException {
  if (!canRun()) {
   return;
  }

  task.setTaskCleanupTask();
  // register task
  tip = tracker.new TaskInProgress(task, trackerFConf);

  // localize the job.
  RunningJob rjob = tracker.localizeJob(tip);
  localizedJobConf = rjob.getJobConf();
  checkJobLocalization();

  // localize task cleanup attempt
  initializeTask();
  checkTaskLocalization();

 }
}

代码示例来源:origin: org.apache.hadoop/hadoop-mapred-test

task.setTaskCleanupTask();
MyUmbilical umbilical = new MyUmbilical();
task.run(job, umbilical);

代码示例来源:origin: org.apache.hadoop/hadoop-mapred-test

task.setTaskCleanupTask();

代码示例来源:origin: org.apache.hadoop/hadoop-mapred-test

task.setTaskCleanupTask();

代码示例来源:origin: ch.cern.hadoop/hadoop-mapreduce-client-jobclient

task.setTaskCleanupTask();
MyUmbilical umbilical = new MyUmbilical();
task.run(job, umbilical);

相关文章

微信公众号

最新文章

更多