org.apache.hadoop.yarn.api.records.Resource.setMemory()方法的使用及代码示例

x33g5p2x  于2022-01-28 转载在 其他  
字(6.4k)|赞(0)|评价(0)|浏览(91)

本文整理了Java中org.apache.hadoop.yarn.api.records.Resource.setMemory方法的一些代码示例,展示了Resource.setMemory的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Resource.setMemory方法的具体详情如下:
包路径:org.apache.hadoop.yarn.api.records.Resource
类名称:Resource
方法名:setMemory

Resource.setMemory介绍

[英]Set memory of the resource. Note - while memory has never had a unit specified, all YARN configurations have specified memory in MB. The assumption has been that the daemons and applications are always using the same units. With the introduction of the ResourceInformation class we have support for units - so this function will continue to set memory but the assumption is that the value passed is in units of MB.
[中]设置资源的内存。注意——虽然内存从未指定过单位,但所有纱线配置都以MB为单位指定了内存。假设守护进程和应用程序总是使用相同的单元。随着ResourceInformation类的引入,我们支持单位——因此这个函数将继续设置内存,但假设传递的值是以MB为单位的。

代码示例

代码示例来源:origin: apache/drill

public Resource getCapability() {
 // Set up resource type requirements for ApplicationMaster
 Resource capability = Records.newRecord(Resource.class);
 capability.setMemory(memoryMb);
 capability.setVirtualCores(vCores);
 DoYUtil.callSetDiskIfExists(capability, disks);
 return capability;
}

代码示例来源:origin: Qihoo360/XLearning

priority.setPriority(appPriority);
Resource workerCapability = Records.newRecord(Resource.class);
workerCapability.setMemory(workerMemory);
workerCapability.setVirtualCores(workerVCores);
workerContainerRequest = new ContainerRequest(workerCapability, hostLocals, null, priority);
 psCapability.setMemory(psMemory);
 psCapability.setVirtualCores(psVCores);
 psContainerRequest = new ContainerRequest(psCapability, hostLocals, null, priority);

代码示例来源:origin: apache/incubator-gobblin

private void requestContainer(Optional<String> preferredNode) {
 Priority priority = Records.newRecord(Priority.class);
 priority.setPriority(0);
 Resource capability = Records.newRecord(Resource.class);
 int maxMemoryCapacity = this.maxResourceCapacity.get().getMemory();
 capability.setMemory(this.requestedContainerMemoryMbs <= maxMemoryCapacity ?
   this.requestedContainerMemoryMbs : maxMemoryCapacity);
 int maxCoreCapacity = this.maxResourceCapacity.get().getVirtualCores();
 capability.setVirtualCores(this.requestedContainerCores <= maxCoreCapacity ?
   this.requestedContainerCores : maxCoreCapacity);
 String[] preferredNodes = preferredNode.isPresent() ? new String[] {preferredNode.get()} : null;
 this.amrmClientAsync.addContainerRequest(
   new AMRMClient.ContainerRequest(capability, preferredNodes, null, priority));
}

代码示例来源:origin: apache/drill

capability.setMemory(memoryMb);
capability.setVirtualCores(vCores);
DoYUtil.callSetDiskIfExists(capability, disks);

代码示例来源:origin: apache/flink

capability.setMemory(clusterSpecification.getMasterMemoryMB());
capability.setVirtualCores(1);

代码示例来源:origin: Qihoo360/XLearning

capability.setMemory(conf.getInt(XLearningConfiguration.XLEARNING_AM_MEMORY, XLearningConfiguration.DEFAULT_XLEARNING_AM_MEMORY));
capability.setVirtualCores(conf.getInt(XLearningConfiguration.XLEARNING_AM_CORES, XLearningConfiguration.DEFAULT_XLEARNING_AM_CORES));
applicationContext.setResource(capability);

代码示例来源:origin: apache/ignite

capability.setMemory((int)props.totalMemoryPerNode());
capability.setVirtualCores((int)props.cpusPerNode());

代码示例来源:origin: apache/ignite

capability.setMemory(512);
capability.setVirtualCores(1);

代码示例来源:origin: uber/AthenaX

capability.setMemory(getFlinkConfiguration()
  .getInteger(JobManagerOptions.JOB_MANAGER_HEAP_MEMORY));
capability.setVirtualCores(1);

代码示例来源:origin: com.github.jiayuhan-it/hadoop-yarn-server-common

public static Resource newResource(int memory, int vCores) {
 Resource resource = recordFactory.newRecordInstance(Resource.class);
 resource.setMemory(memory);
 resource.setVirtualCores(vCores);
 return resource;
}

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

public static Resource newResource(int mem) {
 Resource rs = recordFactory.newRecordInstance(Resource.class);
 rs.setMemory(mem);
 return rs;
}

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-common

public static Resource multiplyTo(Resource lhs, double by) {
 lhs.setMemory((int)(lhs.getMemory() * by));
 lhs.setVirtualCores((int)(lhs.getVirtualCores() * by));
 return lhs;
}

代码示例来源:origin: com.microsoft.reef/reef-runtime-yarn

private synchronized Resource getResource(final DriverRuntimeProtocol.ResourceRequestProto resourceRequestProto) {
 final Resource result = Records.newRecord(Resource.class);
 final int memory = getMemory(resourceRequestProto.getMemorySize());
 final int core = resourceRequestProto.getVirtualCores();
 LOG.log(Level.FINEST, "Resource requested: memory = {0}, virtual core count = {1}.",  new Object[]{ memory, core } );
 result.setMemory(memory);
 result.setVirtualCores(core);
 return result;
}

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-common

public static Resource multiplyAndRoundDown(Resource lhs, double by) {
 Resource out = clone(lhs);
 out.setMemory((int)(lhs.getMemory() * by));
 out.setVirtualCores((int)(lhs.getVirtualCores() * by));
 return out;
}

代码示例来源:origin: com.github.jiayuhan-it/hadoop-yarn-common

public static Resource multiplyAndRoundDown(Resource lhs, double by) {
 Resource out = clone(lhs);
 out.setMemory((int)(lhs.getMemory() * by));
 out.setVirtualCores((int)(lhs.getVirtualCores() * by));
 return out;
}

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-api

@Public
@Stable
public static Resource newInstance(int memory, int vCores) {
 Resource resource = Records.newRecord(Resource.class);
 resource.setMemory(memory);
 resource.setVirtualCores(vCores);
 return resource;
}

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

public static Resource newUsedResource(Resource total) {
 Resource rs = recordFactory.newRecordInstance(Resource.class);
 rs.setMemory((int)(Math.random() * total.getMemory()));
 return rs;
}

代码示例来源:origin: org.apache.reef/reef-runtime-yarn

private synchronized Resource getResource(final ResourceRequestEvent resourceRequestEvent) {
 final Resource result = Records.newRecord(Resource.class);
 final int memory = getMemory(resourceRequestEvent.getMemorySize().get());
 final int core = resourceRequestEvent.getVirtualCores().get();
 LOG.log(Level.FINEST, "Resource requested: memory = {0}, virtual core count = {1}.", new Object[]{memory, core});
 result.setMemory(memory);
 result.setVirtualCores(core);
 return result;
}

代码示例来源:origin: io.hops/hadoop-yarn-api

@Public
@Stable
public static Resource newInstance(int memory, int vCores, int gpus) {
 Resource resource = Records.newRecord(Resource.class);
 resource.setMemory(memory);
 resource.setVirtualCores(vCores);
 resource.setGPUs(gpus);
 return resource;
}

代码示例来源:origin: com.github.jiayuhan-it/hadoop-yarn-common

public static Resource addTo(Resource lhs, Resource rhs) {
 lhs.setMemory(lhs.getMemory() + rhs.getMemory());
 lhs.setVirtualCores(lhs.getVirtualCores() + rhs.getVirtualCores());
 return lhs;
}

相关文章