本文整理了Java中org.apache.hadoop.mapred.Task.setTaskCleanupTask()
方法的一些代码示例,展示了Task.setTaskCleanupTask()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Task.setTaskCleanupTask()
方法的具体详情如下:
包路径:org.apache.hadoop.mapred.Task
类名称:Task
方法名:setTaskCleanupTask
暂无
代码示例来源:origin: org.apache.hadoop/hadoop-mapred-test
public void testCommitNotRequiredForTaskCleanup() throws Exception {
Task testTask = createDummyTask(TaskType.REDUCE);
testTask.setTaskCleanupTask();
assertFalse("Task cleanup task should not need commit",
testTask.isCommitRequired());
}
代码示例来源:origin: org.apache.hadoop/hadoop-mapred-test
/**
* Validates if task cleanup is done properly for a task that is not succeeded
* @throws IOException
*/
public void testFailedTaskFilesRemoval()
throws Exception {
if (!canRun()) {
return;
}
testTaskFilesRemoval(true, false);// needCleanup; no jvmReuse
// initialize a cleanupAttempt for the task.
task.setTaskCleanupTask();
// localize task cleanup attempt
initializeTask();
checkTaskLocalization();
// verify the cleanup of cleanup attempt.
testTaskFilesRemoval(true, false);// needCleanup; no jvmReuse
}
代码示例来源:origin: ch.cern.hadoop/hadoop-mapreduce-client-jobclient
public void testCommitNotRequiredForTaskCleanup() throws Exception {
Task testTask = createDummyTask(TaskType.REDUCE);
testTask.setTaskCleanupTask();
assertFalse("Task cleanup task should not need commit",
testTask.isCommitRequired());
}
代码示例来源:origin: org.apache.hadoop/hadoop-mapred
t.setTaskCleanupTask();
t.setState(taskStatuses.get(taskid).getRunState());
cleanupTasks.put(taskid, taskTracker);
代码示例来源:origin: com.facebook.hadoop/hadoop-core
t.setTaskCleanupTask();
t.setState(taskStatuses.get(taskid).getRunState());
cleanupTasks.put(taskid, taskTracker);
代码示例来源:origin: org.jvnet.hudson.hadoop/hadoop-core
t.setTaskCleanupTask();
t.setState(taskStatuses.get(taskid).getRunState());
cleanupTasks.put(taskid, taskTracker);
代码示例来源:origin: org.apache.hadoop/hadoop-mapred-test
/**
* Localizes a cleanup task and validates permissions.
*
* @throws InterruptedException
* @throws IOException
*/
public void testCleanupTaskLocalization() throws IOException,
InterruptedException {
if (!canRun()) {
return;
}
task.setTaskCleanupTask();
// register task
tip = tracker.new TaskInProgress(task, trackerFConf);
// localize the job.
RunningJob rjob = tracker.localizeJob(tip);
localizedJobConf = rjob.getJobConf();
checkJobLocalization();
// localize task cleanup attempt
initializeTask();
checkTaskLocalization();
}
}
代码示例来源:origin: org.apache.hadoop/hadoop-mapred-test
task.setTaskCleanupTask();
MyUmbilical umbilical = new MyUmbilical();
task.run(job, umbilical);
代码示例来源:origin: org.apache.hadoop/hadoop-mapred-test
task.setTaskCleanupTask();
代码示例来源:origin: org.apache.hadoop/hadoop-mapred-test
task.setTaskCleanupTask();
代码示例来源:origin: ch.cern.hadoop/hadoop-mapreduce-client-jobclient
task.setTaskCleanupTask();
MyUmbilical umbilical = new MyUmbilical();
task.run(job, umbilical);
内容来源于网络,如有侵权,请联系作者删除!