org.apache.hadoop.yarn.api.ApplicationClientProtocol.getApplications()方法的使用及代码示例

x33g5p2x  于2022-01-16 转载在 其他  
字(13.0k)|赞(0)|评价(0)|浏览(143)

本文整理了Java中org.apache.hadoop.yarn.api.ApplicationClientProtocol.getApplications()方法的一些代码示例,展示了ApplicationClientProtocol.getApplications()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。ApplicationClientProtocol.getApplications()方法的具体详情如下:
包路径:org.apache.hadoop.yarn.api.ApplicationClientProtocol
类名称:ApplicationClientProtocol
方法名:getApplications

ApplicationClientProtocol.getApplications介绍

暂无

代码示例

代码示例来源:origin: apache/hive

/**
  * Queries RM for the list of applications with the given tag that have started
  * after the given timestamp.
  */
 private Set<ApplicationId> getYarnChildJobs(String tag, long timestamp) {
  Set<ApplicationId> childYarnJobs = new HashSet<ApplicationId>();

  LOG.info(String.format("Querying RM for tag = %s, starting with ts = %s", tag, timestamp));

  GetApplicationsRequest gar = GetApplicationsRequest.newInstance();
  gar.setScope(ApplicationsRequestScope.OWN);
  gar.setStartRange(timestamp, System.currentTimeMillis());
  gar.setApplicationTags(Collections.singleton(tag));
  try {
   ApplicationClientProtocol proxy = ClientRMProxy.createRMProxy(conf,
     ApplicationClientProtocol.class);
   GetApplicationsResponse apps = proxy.getApplications(gar);
   List<ApplicationReport> appsList = apps.getApplicationList();
   for(ApplicationReport appReport : appsList) {
    childYarnJobs.add(appReport.getApplicationId());
   }
  } catch (IOException ioe) {
   throw new RuntimeException("Exception occurred while finding child jobs", ioe);
  } catch (YarnException ye) {
   throw new RuntimeException("Exception occurred while finding child jobs", ye);
  }
  return childYarnJobs;
 }
}

代码示例来源:origin: apache/hive

public static Set<ApplicationId> getChildYarnJobs(Configuration conf, String tag) throws IOException, YarnException {
 Set<ApplicationId> childYarnJobs = new HashSet<ApplicationId>();
 GetApplicationsRequest gar = GetApplicationsRequest.newInstance();
 gar.setScope(ApplicationsRequestScope.OWN);
 gar.setApplicationTags(Collections.singleton(tag));
 ApplicationClientProtocol proxy = ClientRMProxy.createRMProxy(conf, ApplicationClientProtocol.class);
 GetApplicationsResponse apps = proxy.getApplications(gar);
 List<ApplicationReport> appsList = apps.getApplicationList();
 for(ApplicationReport appReport : appsList) {
  if (isAdmin() || appReport.getApplicationTags().contains(QueryState.USERID_TAG + "=" + SessionState.get()
      .getUserName())) {
   childYarnJobs.add(appReport.getApplicationId());
  }
 }
 if (childYarnJobs.isEmpty()) {
  LOG.info("No child applications found");
 } else {
  LOG.info("Found child YARN applications: " + StringUtils.join(childYarnJobs, ","));
 }
 return childYarnJobs;
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-router

@Override
public GetApplicationsResponse getApplications(GetApplicationsRequest request)
  throws YarnException, IOException {
 return clientRMProxy.getApplications(request);
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-client

@Override
public List<ApplicationReport> getApplications(
  GetApplicationsRequest request) throws YarnException, IOException {
 GetApplicationsResponse response = rmClient.getApplications(request);
 return response.getApplicationList();
}

代码示例来源:origin: io.hops/hadoop-yarn-client

@Override
public List<ApplicationReport> getApplications(Set<String> applicationTypes,
  EnumSet<YarnApplicationState> applicationStates) throws YarnException,
  IOException {
 GetApplicationsRequest request =
   GetApplicationsRequest.newInstance(applicationTypes, applicationStates);
 GetApplicationsResponse response = rmClient.getApplications(request);
 return response.getApplicationList();
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-client

@Override
public List<ApplicationReport> getApplications(Set<String> applicationTypes,
  EnumSet<YarnApplicationState> applicationStates) throws YarnException,
  IOException {
 GetApplicationsRequest request =
   GetApplicationsRequest.newInstance(applicationTypes, applicationStates);
 GetApplicationsResponse response = rmClient.getApplications(request);
 return response.getApplicationList();
}

代码示例来源:origin: com.github.jiayuhan-it/hadoop-yarn-client

@Override
public List<ApplicationReport> getApplications(Set<String> applicationTypes,
  EnumSet<YarnApplicationState> applicationStates) throws YarnException,
  IOException {
 GetApplicationsRequest request =
   GetApplicationsRequest.newInstance(applicationTypes, applicationStates);
 GetApplicationsResponse response = rmClient.getApplications(request);
 return response.getApplicationList();
}

代码示例来源:origin: org.springframework.data/spring-yarn-core

@Override
  public List<ApplicationReport> doInYarn(ApplicationClientProtocol proxy) throws YarnException, IOException {
    GetApplicationsRequest request = Records.newRecord(GetApplicationsRequest.class);
    GetApplicationsResponse response = proxy.getApplications(request);
    return response.getApplicationList();
  }
});

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-client

@Override
public List<ApplicationReport> getApplications(Set<String> applicationTypes,
  EnumSet<YarnApplicationState> applicationStates) throws YarnException,
  IOException {
 GetApplicationsRequest request =
   GetApplicationsRequest.newInstance(applicationTypes, applicationStates);
 GetApplicationsResponse response = rmClient.getApplications(request);
 return response.getApplicationList();
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-client

@Override
public List<ApplicationReport> getApplications(Set<String> applicationTypes,
  EnumSet<YarnApplicationState> applicationStates,
  Set<String> applicationTags) throws YarnException, IOException {
 GetApplicationsRequest request =
   GetApplicationsRequest.newInstance(applicationTypes, applicationStates);
 request.setApplicationTags(applicationTags);
 GetApplicationsResponse response = rmClient.getApplications(request);
 return response.getApplicationList();
}

代码示例来源:origin: org.apache.hive.shims/hive-shims-0.23

/**
  * Queries RM for the list of applications with the given tag that have started
  * after the given timestamp.
  */
 private Set<ApplicationId> getYarnChildJobs(String tag, long timestamp) {
  Set<ApplicationId> childYarnJobs = new HashSet<ApplicationId>();

  LOG.info(String.format("Querying RM for tag = %s, starting with ts = %s", tag, timestamp));

  GetApplicationsRequest gar = GetApplicationsRequest.newInstance();
  gar.setScope(ApplicationsRequestScope.OWN);
  gar.setStartRange(timestamp, System.currentTimeMillis());
  gar.setApplicationTags(Collections.singleton(tag));
  try {
   ApplicationClientProtocol proxy = ClientRMProxy.createRMProxy(conf,
     ApplicationClientProtocol.class);
   GetApplicationsResponse apps = proxy.getApplications(gar);
   List<ApplicationReport> appsList = apps.getApplicationList();
   for(ApplicationReport appReport : appsList) {
    childYarnJobs.add(appReport.getApplicationId());
   }
  } catch (IOException ioe) {
   throw new RuntimeException("Exception occurred while finding child jobs", ioe);
  } catch (YarnException ye) {
   throw new RuntimeException("Exception occurred while finding child jobs", ye);
  }
  return childYarnJobs;
 }
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-client

@Override
public List<ApplicationReport> getApplications(Set<String> queues,
  Set<String> users, Set<String> applicationTypes,
  EnumSet<YarnApplicationState> applicationStates) throws YarnException,
  IOException {
 GetApplicationsRequest request =
   GetApplicationsRequest.newInstance(applicationTypes, applicationStates);
 request.setQueues(queues);
 request.setUsers(users);
 GetApplicationsResponse response = rmClient.getApplications(request);
 return response.getApplicationList();
}

代码示例来源:origin: io.hops/hadoop-yarn-client

@Override
public List<ApplicationReport> getApplications(Set<String> queues,
  Set<String> users, Set<String> applicationTypes,
  EnumSet<YarnApplicationState> applicationStates) throws YarnException,
  IOException {
 GetApplicationsRequest request =
   GetApplicationsRequest.newInstance(applicationTypes, applicationStates);
 request.setQueues(queues);
 request.setUsers(users);
 GetApplicationsResponse response = rmClient.getApplications(request);
 return response.getApplicationList();
}

代码示例来源:origin: org.springframework.data/spring-yarn-core

@Override
  public List<ApplicationReport> doInYarn(ApplicationClientProtocol proxy) throws YarnException, IOException {
    GetApplicationsRequest request = Records.newRecord(GetApplicationsRequest.class);
    request.setApplicationStates(states);
    request.setApplicationTypes(types);
    GetApplicationsResponse response = proxy.getApplications(request);
    return response.getApplicationList();
  }
});

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-common

@Override
public GetApplicationsResponseProto getApplications(
  RpcController controller, GetApplicationsRequestProto proto)
  throws ServiceException {
 GetApplicationsRequestPBImpl request =
  new GetApplicationsRequestPBImpl(proto);
 try {
  GetApplicationsResponse response = real.getApplications(request);
  return ((GetApplicationsResponsePBImpl)response).getProto();
 } catch (YarnException e) {
  throw new ServiceException(e);
 } catch (IOException e) {
  throw new ServiceException(e);
 }
}

代码示例来源:origin: com.github.jiayuhan-it/hadoop-yarn-common

@Override
public GetApplicationsResponseProto getApplications(
  RpcController controller, GetApplicationsRequestProto proto)
  throws ServiceException {
 GetApplicationsRequestPBImpl request =
  new GetApplicationsRequestPBImpl(proto);
 try {
  GetApplicationsResponse response = real.getApplications(request);
  return ((GetApplicationsResponsePBImpl)response).getProto();
 } catch (YarnException e) {
  throw new ServiceException(e);
 } catch (IOException e) {
  throw new ServiceException(e);
 }
}

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-common

@Override
public GetApplicationsResponseProto getApplications(
  RpcController controller, GetApplicationsRequestProto proto)
  throws ServiceException {
 GetApplicationsRequestPBImpl request =
  new GetApplicationsRequestPBImpl(proto);
 try {
  GetApplicationsResponse response = real.getApplications(request);
  return ((GetApplicationsResponsePBImpl)response).getProto();
 } catch (YarnException e) {
  throw new ServiceException(e);
 } catch (IOException e) {
  throw new ServiceException(e);
 }
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

private void verifyOwnerAccess() throws Exception {
 AccessControlList viewACL = new AccessControlList("");
 viewACL.addGroup(FRIENDLY_GROUP);
 AccessControlList modifyACL = new AccessControlList("");
 modifyACL.addUser(FRIEND);
 ApplicationId applicationId = submitAppAndGetAppId(viewACL, modifyACL);
 final GetApplicationReportRequest appReportRequest = recordFactory
   .newRecordInstance(GetApplicationReportRequest.class);
 appReportRequest.setApplicationId(applicationId);
 final KillApplicationRequest finishAppRequest = recordFactory
   .newRecordInstance(KillApplicationRequest.class);
 finishAppRequest.setApplicationId(applicationId);
 // View as owner
 rmClient.getApplicationReport(appReportRequest);
 // List apps as owner
 Assert.assertEquals("App view by owner should list the apps!!", 1,
   rmClient.getApplications(
     recordFactory.newRecordInstance(GetApplicationsRequest.class))
     .getApplicationList().size());
 // Kill app as owner
 rmClient.forceKillApplication(finishAppRequest);
 resourceManager.waitForState(applicationId, RMAppState.KILLED);
}

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

private void verifyOwnerAccess() throws Exception {
 AccessControlList viewACL = new AccessControlList("");
 viewACL.addGroup(FRIENDLY_GROUP);
 AccessControlList modifyACL = new AccessControlList("");
 modifyACL.addUser(FRIEND);
 ApplicationId applicationId = submitAppAndGetAppId(viewACL, modifyACL);
 final GetApplicationReportRequest appReportRequest = recordFactory
   .newRecordInstance(GetApplicationReportRequest.class);
 appReportRequest.setApplicationId(applicationId);
 final KillApplicationRequest finishAppRequest = recordFactory
   .newRecordInstance(KillApplicationRequest.class);
 finishAppRequest.setApplicationId(applicationId);
 // View as owner
 rmClient.getApplicationReport(appReportRequest);
 // List apps as owner
 Assert.assertEquals("App view by owner should list the apps!!", 1,
   rmClient.getApplications(
     recordFactory.newRecordInstance(GetApplicationsRequest.class))
     .getApplicationList().size());
 // Kill app as owner
 rmClient.forceKillApplication(finishAppRequest);
 resourceManager.waitForState(applicationId, RMAppState.KILLED);
}

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

private void verifyFriendAccess() throws Exception {
 AccessControlList viewACL = new AccessControlList("");
 viewACL.addGroup(FRIENDLY_GROUP);
 AccessControlList modifyACL = new AccessControlList("");
 modifyACL.addUser(FRIEND);
 ApplicationId applicationId = submitAppAndGetAppId(viewACL, modifyACL);
 final GetApplicationReportRequest appReportRequest = recordFactory
   .newRecordInstance(GetApplicationReportRequest.class);
 appReportRequest.setApplicationId(applicationId);
 final KillApplicationRequest finishAppRequest = recordFactory
   .newRecordInstance(KillApplicationRequest.class);
 finishAppRequest.setApplicationId(applicationId);
 ApplicationClientProtocol friendClient = getRMClientForUser(FRIEND);
 // View as the friend
 friendClient.getApplicationReport(appReportRequest);
 // List apps as friend
 Assert.assertEquals("App view by a friend should list the apps!!", 3,
   friendClient.getApplications(
     recordFactory.newRecordInstance(GetApplicationsRequest.class))
     .getApplicationList().size());
 // Kill app as the friend
 friendClient.forceKillApplication(finishAppRequest);
 resourceManager.waitForState(applicationId, RMAppState.KILLED);
}

相关文章

微信公众号

最新文章

更多

ApplicationClientProtocol类方法