org.apache.hadoop.yarn.api.records.Container.setId()方法的使用及代码示例

x33g5p2x  于2022-01-18 转载在 其他  
字(12.4k)|赞(0)|评价(0)|浏览(138)

本文整理了Java中org.apache.hadoop.yarn.api.records.Container.setId()方法的一些代码示例，展示了Container.setId()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。Container.setId()方法的具体详情如下：
包路径：org.apache.hadoop.yarn.api.records.Container
类名称：Container
方法名：setId

Container.setId介绍

暂无

代码示例

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Override
 public void setContainerId(ContainerId containerId) {
  // In some cases, for example, global scheduling. It is possible that
  // container created without container-id assigned, so we will publish
  // container creation event to timeline service when id assigned.
  container.setId(containerId);

  if (containerId != null) {
   rmContext.getRMApplicationHistoryWriter().containerStarted(this);
  }
 }
}

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-common

public static Container newContainer(ContainerId containerId, NodeId nodeId,
  String nodeHttpAddress, Resource resource, Priority priority,
  Token containerToken) {
 Container container = recordFactory.newRecordInstance(Container.class);
 container.setId(containerId);
 container.setNodeId(nodeId);
 container.setNodeHttpAddress(nodeHttpAddress);
 container.setResource(resource);
 container.setPriority(priority);
 container.setContainerToken(containerToken);
 return container;
}

代码示例来源：origin: com.github.jiayuhan-it/hadoop-yarn-server-common

public static Container newContainer(ContainerId containerId, NodeId nodeId,
  String nodeHttpAddress, Resource resource, Priority priority,
  Token containerToken) {
 Container container = recordFactory.newRecordInstance(Container.class);
 container.setId(containerId);
 container.setNodeId(nodeId);
 container.setNodeHttpAddress(nodeHttpAddress);
 container.setResource(resource);
 container.setPriority(priority);
 container.setContainerToken(containerToken);
 return container;
}

代码示例来源：origin: io.hops/hadoop-yarn-server-common

public static Container newContainer(ContainerId containerId, NodeId nodeId,
  String nodeHttpAddress, Resource resource, Priority priority,
  Token containerToken) {
 Container container = recordFactory.newRecordInstance(Container.class);
 container.setId(containerId);
 container.setNodeId(nodeId);
 container.setNodeHttpAddress(nodeHttpAddress);
 container.setResource(resource);
 container.setPriority(priority);
 container.setContainerToken(containerToken);
 return container;
}

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

protected RMAppAttempt storeAttempt(RMStateStore store,
  ApplicationAttemptId attemptId,
  String containerIdStr, Token<AMRMTokenIdentifier> appToken,
  SecretKey clientTokenMasterKey, TestDispatcher dispatcher)
  throws Exception {
 RMAppAttemptMetrics mockRmAppAttemptMetrics = 
   mock(RMAppAttemptMetrics.class);
 Container container = new ContainerPBImpl();
 container.setId(ContainerId.fromString(containerIdStr));
 RMAppAttempt mockAttempt = mock(RMAppAttempt.class);
 when(mockAttempt.getAppAttemptId()).thenReturn(attemptId);
 when(mockAttempt.getMasterContainer()).thenReturn(container);
 when(mockAttempt.getAMRMToken()).thenReturn(appToken);
 when(mockAttempt.getClientTokenMasterKey())
   .thenReturn(clientTokenMasterKey);
 when(mockAttempt.getRMAppAttemptMetrics())
   .thenReturn(mockRmAppAttemptMetrics);
 when(mockRmAppAttemptMetrics.getAggregateAppResourceUsage())
   .thenReturn(new AggregateAppResourceUsage(new HashMap<>()));
 dispatcher.attemptId = attemptId;
 store.storeNewApplicationAttempt(mockAttempt);
 waitNotify(dispatcher);
 return mockAttempt;
}

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

protected ContainerId storeAttempt(RMStateStore store,
  ApplicationAttemptId attemptId,
  String containerIdStr, Token<AMRMTokenIdentifier> appToken,
  SecretKey clientTokenMasterKey, TestDispatcher dispatcher)
  throws Exception {
 RMAppAttemptMetrics mockRmAppAttemptMetrics = 
   mock(RMAppAttemptMetrics.class);
 Container container = new ContainerPBImpl();
 container.setId(ConverterUtils.toContainerId(containerIdStr));
 RMAppAttempt mockAttempt = mock(RMAppAttempt.class);
 when(mockAttempt.getAppAttemptId()).thenReturn(attemptId);
 when(mockAttempt.getMasterContainer()).thenReturn(container);
 when(mockAttempt.getAMRMToken()).thenReturn(appToken);
 when(mockAttempt.getClientTokenMasterKey())
   .thenReturn(clientTokenMasterKey);
 when(mockAttempt.getRMAppAttemptMetrics())
   .thenReturn(mockRmAppAttemptMetrics);
 when(mockRmAppAttemptMetrics.getAggregateAppResourceUsage())
   .thenReturn(new AggregateAppResourceUsage(0, 0));
 dispatcher.attemptId = attemptId;
 store.storeNewApplicationAttempt(mockAttempt);
 waitNotify(dispatcher);
 return container.getId();
}

代码示例来源：origin: com.github.jiayuhan-it/hadoop-yarn-api

@Private
@Unstable
public static Container newInstance(ContainerId containerId, NodeId nodeId,
  String nodeHttpAddress, Resource resource, Priority priority,
  Token containerToken) {
 Container container = Records.newRecord(Container.class);
 container.setId(containerId);
 container.setNodeId(nodeId);
 container.setNodeHttpAddress(nodeHttpAddress);
 container.setResource(resource);
 container.setPriority(priority);
 container.setContainerToken(containerToken);
 return container;
}

代码示例来源：origin: io.hops/hadoop-yarn-api

@Private
@Unstable
public static Container newInstance(ContainerId containerId, NodeId nodeId,
  String nodeHttpAddress, Resource resource, Priority priority,
  Token containerToken) {
 Container container = Records.newRecord(Container.class);
 container.setId(containerId);
 container.setNodeId(nodeId);
 container.setNodeHttpAddress(nodeHttpAddress);
 container.setResource(resource);
 container.setPriority(priority);
 container.setContainerToken(containerToken);
 return container;
}

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-api

@Private
@Unstable
public static Container newInstance(ContainerId containerId, NodeId nodeId,
  String nodeHttpAddress, Resource resource, Priority priority,
  Token containerToken) {
 Container container = Records.newRecord(Container.class);
 container.setId(containerId);
 container.setNodeId(nodeId);
 container.setNodeHttpAddress(nodeHttpAddress);
 container.setResource(resource);
 container.setPriority(priority);
 container.setContainerToken(containerToken);
 return container;
}

代码示例来源：origin: apache/incubator-slider

String nodeHttpAddress) {
Container container = new ContainerPBImpl();
container.setId(containerId);
NodeId nodeId = NodeId.newInstance(host, amPort);
container.setNodeId(nodeId);

代码示例来源：origin: org.apache.slider/slider-core

String nodeHttpAddress) {
Container container = new ContainerPBImpl();
container.setId(containerId);
NodeId nodeId = NodeId.newInstance(host, amPort);
container.setNodeId(nodeId);

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-api

@Private
@Unstable
public static Container newInstance(ContainerId containerId, NodeId nodeId,
  String nodeHttpAddress, Resource resource, Priority priority,
  Token containerToken, ExecutionType executionType) {
 Container container = Records.newRecord(Container.class);
 container.setId(containerId);
 container.setNodeId(nodeId);
 container.setNodeHttpAddress(nodeHttpAddress);
 container.setResource(resource);
 container.setPriority(priority);
 container.setContainerToken(containerToken);
 container.setExecutionType(executionType);
 return container;
}

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-common

getApplicationAttemptId(1), containerIndex.incrementAndGet());
Container container = Records.newRecord(Container.class);
container.setId(containerId);
container.setPriority(rr.getPriority());

代码示例来源：origin: org.apache.hadoop/hadoop-mapreduce-client-app

container.setId(cId);
NodeId nodeId = NodeId.newInstance("dummy", 1234);
container.setNodeId(nodeId);

代码示例来源：origin: com.github.jiayuhan-it/hadoop-mapreduce-client-app

@SuppressWarnings("unchecked")
@Override
public void handle(ContainerAllocatorEvent event) {
 if (event.getType() == ContainerAllocator.EventType.CONTAINER_REQ) {
  LOG.info("Processing the event " + event.toString());
  // Assign the same container ID as the AM
  ContainerId cID =
    ContainerId.newContainerId(getContext().getApplicationAttemptId(),
     this.containerId.getContainerId());
  Container container = recordFactory.newRecordInstance(Container.class);
  container.setId(cID);
  NodeId nodeId = NodeId.newInstance(this.nmHost, this.nmPort);
  container.setNodeId(nodeId);
  container.setContainerToken(null);
  container.setNodeHttpAddress(this.nmHost + ":" + this.nmHttpPort);
  // send the container-assigned event to task attempt
  if (event.getAttemptID().getTaskId().getTaskType() == TaskType.MAP) {
   JobCounterUpdateEvent jce =
     new JobCounterUpdateEvent(event.getAttemptID().getTaskId()
       .getJobId());
   // TODO Setting OTHER_LOCAL_MAP for now.
   jce.addCounterUpdate(JobCounter.OTHER_LOCAL_MAPS, 1);
   eventHandler.handle(jce);
  }
  eventHandler.handle(new TaskAttemptContainerAssignedEvent(
    event.getAttemptID(), container, applicationACLs));
 }
}

代码示例来源：origin: io.hops/hadoop-mapreduce-client-app

@SuppressWarnings("unchecked")
@Override
public void handle(ContainerAllocatorEvent event) {
 if (event.getType() == ContainerAllocator.EventType.CONTAINER_REQ) {
  LOG.info("Processing the event " + event.toString());
  // Assign the same container ID as the AM
  ContainerId cID =
    ContainerId.newContainerId(getContext().getApplicationAttemptId(),
     this.containerId.getContainerId());
  Container container = recordFactory.newRecordInstance(Container.class);
  container.setId(cID);
  NodeId nodeId = NodeId.newInstance(this.nmHost, this.nmPort);
  container.setNodeId(nodeId);
  container.setContainerToken(null);
  container.setNodeHttpAddress(this.nmHost + ":" + this.nmHttpPort);
  // send the container-assigned event to task attempt
  if (event.getAttemptID().getTaskId().getTaskType() == TaskType.MAP) {
   JobCounterUpdateEvent jce =
     new JobCounterUpdateEvent(event.getAttemptID().getTaskId()
       .getJobId());
   // TODO Setting OTHER_LOCAL_MAP for now.
   jce.addCounterUpdate(JobCounter.OTHER_LOCAL_MAPS, 1);
   eventHandler.handle(jce);
  }
  eventHandler.handle(new TaskAttemptContainerAssignedEvent(
    event.getAttemptID(), container, applicationACLs));
 }
}

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

private void finishAppWithAttempts(RMState state, RMStateStore store,
  TestDispatcher dispatcher, ApplicationAttemptId attemptId,
  long submitTime, long startTime, int amExitStatus, long finishTime,
  boolean createNewApp) throws Exception {
 ApplicationId appId = attemptId.getApplicationId();
 ApplicationStateData appStateNew = null;
 if (createNewApp) {
  ApplicationSubmissionContext context =
    new ApplicationSubmissionContextPBImpl();
  context.setApplicationId(appId);
  context.setAMContainerSpec(new ContainerLaunchContextPBImpl());
  appStateNew = createAppState(context, submitTime, startTime, finishTime,
    true);
 } else {
  ApplicationStateData appState = state.getApplicationState().get(appId);
  appStateNew = createAppState(appState.getApplicationSubmissionContext(),
    submitTime, startTime, finishTime, true);
  appStateNew.attempts.putAll(appState.attempts);
 }
 store.updateApplicationState(appStateNew);
 waitNotify(dispatcher);
 Container container = new ContainerPBImpl();
 container.setId(ContainerId.newContainerId(attemptId, 1));
 ApplicationAttemptStateData newAttemptState =
   createFinishedAttempt(attemptId, container, startTime, amExitStatus);
 updateAttempt(store, dispatcher, newAttemptState);
}

代码示例来源：origin: org.apache.hadoop/hadoop-mapreduce-client-app

@SuppressWarnings("unchecked")
@Override
public void handle(ContainerAllocatorEvent event) {
 if (event.getType() == ContainerAllocator.EventType.CONTAINER_REQ) {
  LOG.info("Processing the event " + event.toString());
  // Assign the same container ID as the AM
  ContainerId cID =
    ContainerId.newContainerId(getContext().getApplicationAttemptId(),
     this.containerId.getContainerId());
  Container container = recordFactory.newRecordInstance(Container.class);
  container.setId(cID);
  NodeId nodeId = NodeId.newInstance(this.nmHost, this.nmPort);
  container.setResource(Resource.newInstance(0, 0));
  container.setNodeId(nodeId);
  container.setContainerToken(null);
  container.setNodeHttpAddress(this.nmHost + ":" + this.nmHttpPort);
  // send the container-assigned event to task attempt
  if (event.getAttemptID().getTaskId().getTaskType() == TaskType.MAP) {
   JobCounterUpdateEvent jce =
     new JobCounterUpdateEvent(event.getAttemptID().getTaskId()
       .getJobId());
   // TODO Setting OTHER_LOCAL_MAP for now.
   jce.addCounterUpdate(JobCounter.OTHER_LOCAL_MAPS, 1);
   eventHandler.handle(jce);
  }
  eventHandler.handle(new TaskAttemptContainerAssignedEvent(
    event.getAttemptID(), container, applicationACLs));
 }
}

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

final Container masterContainer = Records.newRecord(Container.class);
ContainerId containerId = ContainerId.newContainerId(appAttemptId, 0);
masterContainer.setId(containerId);
masterContainer.setNodeHttpAddress("node:port");
final String user = newUserName();

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

final Container masterContainer = Records.newRecord(Container.class);
ContainerId containerId = ContainerId.newContainerId(appAttemptId, 0);
masterContainer.setId(containerId);
masterContainer.setNodeHttpAddress("node:port");
final String user = newUserName();

内容来源于网络，如有侵权，请联系作者删除！

Container

相关文章

    查看更多
    微信公众号

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com