org.apache.hadoop.mapred.YARNRunner.addHistoryToken()方法的使用及代码示例

x33g5p2x  于2022-02-05 转载在 其他  
字(2.8k)|赞(0)|评价(0)|浏览(62)

本文整理了Java中org.apache.hadoop.mapred.YARNRunner.addHistoryToken()方法的一些代码示例,展示了YARNRunner.addHistoryToken()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。YARNRunner.addHistoryToken()方法的具体详情如下:
包路径:org.apache.hadoop.mapred.YARNRunner
类名称:YARNRunner
方法名:addHistoryToken

YARNRunner.addHistoryToken介绍

暂无

代码示例

代码示例来源:origin: org.apache.hadoop/hadoop-mapreduce-client-jobclient

@Override
public JobStatus submitJob(JobID jobId, String jobSubmitDir, Credentials ts)
throws IOException, InterruptedException {
 
 addHistoryToken(ts);
 ApplicationSubmissionContext appContext =
  createApplicationSubmissionContext(conf, jobSubmitDir, ts);
 // Submit to ResourceManager
 try {
  ApplicationId applicationId =
    resMgrDelegate.submitApplication(appContext);
  ApplicationReport appMaster = resMgrDelegate
    .getApplicationReport(applicationId);
  String diagnostics =
    (appMaster == null ?
      "application report is null" : appMaster.getDiagnostics());
  if (appMaster == null
    || appMaster.getYarnApplicationState() == YarnApplicationState.FAILED
    || appMaster.getYarnApplicationState() == YarnApplicationState.KILLED) {
   throw new IOException("Failed to run job : " +
     diagnostics);
  }
  return clientCache.getClient(jobId).getJobStatus(jobId);
 } catch (YarnException e) {
  throw new IOException(e);
 }
}

代码示例来源:origin: com.github.jiayuhan-it/hadoop-mapreduce-client-jobclient

@Override
public JobStatus submitJob(JobID jobId, String jobSubmitDir, Credentials ts)
throws IOException, InterruptedException {
 
 addHistoryToken(ts);
 
 // Construct necessary information to start the MR AM
 ApplicationSubmissionContext appContext =
  createApplicationSubmissionContext(conf, jobSubmitDir, ts);
 // Submit to ResourceManager
 try {
  ApplicationId applicationId =
    resMgrDelegate.submitApplication(appContext);
  ApplicationReport appMaster = resMgrDelegate
    .getApplicationReport(applicationId);
  String diagnostics =
    (appMaster == null ?
      "application report is null" : appMaster.getDiagnostics());
  if (appMaster == null
    || appMaster.getYarnApplicationState() == YarnApplicationState.FAILED
    || appMaster.getYarnApplicationState() == YarnApplicationState.KILLED) {
   throw new IOException("Failed to run job : " +
     diagnostics);
  }
  return clientCache.getClient(jobId).getJobStatus(jobId);
 } catch (YarnException e) {
  throw new IOException(e);
 }
}

代码示例来源:origin: ch.cern.hadoop/hadoop-mapreduce-client-jobclient

yarnRunner.addHistoryToken(creds);
verify(mockHsProxy, times(0)).getDelegationToken(
  any(GetDelegationTokenRequest.class));
yarnRunner.addHistoryToken(creds);
verify(mockHsProxy, times(0)).getDelegationToken(
  any(GetDelegationTokenRequest.class));
yarnRunner.addHistoryToken(creds);
verify(mockHsProxy, times(0)).getDelegationToken(
  any(GetDelegationTokenRequest.class));
yarnRunner.addHistoryToken(creds);
verify(mockHsProxy, times(1)).getDelegationToken(
  any(GetDelegationTokenRequest.class));
yarnRunner.addHistoryToken(creds);
verify(mockHsProxy, times(1)).getDelegationToken(
  any(GetDelegationTokenRequest.class));

相关文章