org.apache.hadoop.yarn.util.resource.Resources.lessThanOrEqual()方法的使用及代码示例

x33g5p2x  于2022-01-29 转载在 其他  
字(12.3k)|赞(0)|评价(0)|浏览(105)

本文整理了Java中org.apache.hadoop.yarn.util.resource.Resources.lessThanOrEqual方法的一些代码示例，展示了Resources.lessThanOrEqual的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。Resources.lessThanOrEqual方法的具体详情如下：
包路径：org.apache.hadoop.yarn.util.resource.Resources
类名称：Resources
方法名：lessThanOrEqual

Resources.lessThanOrEqual介绍

暂无

代码示例

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

synchronized public NodeId getNodeIdToUnreserve(Priority priority,
  Resource resourceNeedUnreserve, ResourceCalculator rc,
  Resource clusterResource) {
 // first go around make this algorithm simple and just grab first
 // reservation that has enough resources
 Map<NodeId, RMContainer> reservedContainers = this.reservedContainers
   .get(priority);
 if ((reservedContainers != null) && (!reservedContainers.isEmpty())) {
  for (Map.Entry<NodeId, RMContainer> entry : reservedContainers.entrySet()) {
   NodeId nodeId = entry.getKey();
   Resource containerResource = entry.getValue().getContainer().getResource();
   
   // make sure we unreserve one with at least the same amount of
   // resources, otherwise could affect capacity limits
   if (Resources.lessThanOrEqual(rc, clusterResource,
     resourceNeedUnreserve, containerResource)) {
    if (LOG.isDebugEnabled()) {
     LOG.debug("unreserving node with reservation size: "
       + containerResource
       + " in order to allocate container with size: " + resourceNeedUnreserve);
    }
    return nodeId;
   }
  }
 }
 return null;
}

代码示例来源：origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

synchronized public NodeId getNodeIdToUnreserve(Priority priority,
  Resource resourceNeedUnreserve, ResourceCalculator rc,
  Resource clusterResource) {
 // first go around make this algorithm simple and just grab first
 // reservation that has enough resources
 Map<NodeId, RMContainer> reservedContainers = this.reservedContainers
   .get(priority);
 if ((reservedContainers != null) && (!reservedContainers.isEmpty())) {
  for (Map.Entry<NodeId, RMContainer> entry : reservedContainers.entrySet()) {
   NodeId nodeId = entry.getKey();
   Resource containerResource = entry.getValue().getContainer().getResource();
   
   // make sure we unreserve one with at least the same amount of
   // resources, otherwise could affect capacity limits
   if (Resources.lessThanOrEqual(rc, clusterResource,
     resourceNeedUnreserve, containerResource)) {
    if (LOG.isDebugEnabled()) {
     LOG.debug("unreserving node with reservation size: "
       + containerResource
       + " in order to allocate container with size: " + resourceNeedUnreserve);
    }
    return nodeId;
   }
  }
 }
 return null;
}

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

if (Resources.lessThanOrEqual(rc, clusterResource, skippedAMSize,
  maxAMCapacityForThisQueue)) {
 break;

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

for (RMContainer c : skippedAMContainerlist) {
 if (Resources.lessThanOrEqual(rc, clusterResource, resToObtain,
   Resources.none())) {
  break;
 if (Resources.lessThanOrEqual(rc, clusterResource, skippedAMSize,
   maxAMCapacityForThisQueue)) {
  break;

代码示例来源：origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

for (RMContainer c : skippedAMContainerlist) {
 if (Resources.lessThanOrEqual(rc, clusterResource, resToObtain,
   Resources.none())) {
  break;
 if (Resources.lessThanOrEqual(rc, clusterResource, skippedAMSize,
   maxAMCapacityForThisQueue)) {
  break;

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

if (!Resources.lessThanOrEqual(
 resourceCalculator, lastClusterResource, amIfStarted, amLimit)) {
 if (getNumActiveApplications() < 1) {
  user.getConsumedAMResources());
if (!Resources.lessThanOrEqual(
  resourceCalculator, lastClusterResource, userAmIfStarted, 
  userAMLimit)) {

代码示例来源：origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

if (!Resources.lessThanOrEqual(
 resourceCalculator, lastClusterResource, amIfStarted, amLimit)) {
 if (getNumActiveApplications() < 1) {
  user.getConsumedAMResources());
if (!Resources.lessThanOrEqual(
  resourceCalculator, lastClusterResource, userAmIfStarted, 
  userAMLimit)) {

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

if (Resources.lessThanOrEqual(resourceCalculator, clusterResource,
  Resources.subtract(user.getUsed(),
    application.getCurrentReservation()), limit)) {

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

if (Resources.lessThanOrEqual(
  resourceCalculator,
  clusterResource,

代码示例来源：origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

if (Resources.lessThanOrEqual(
  resourceCalculator,
  clusterResource,

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

while (desc.hasNext()) {
 FiCaSchedulerApp fc = desc.next();
 if (Resources.lessThanOrEqual(rc, clusterResource, resToObtain,
   Resources.none())) {
  break;

代码示例来源：origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

new ArrayList<RMContainer>(app.getReservedContainers());
for (RMContainer c : reservations) {
 if (Resources.lessThanOrEqual(rc, clusterResource,
   rsrcPreempt, Resources.none())) {
  return ret;
 if (Resources.lessThanOrEqual(rc, clusterResource,
    rsrcPreempt, Resources.none())) {
  return ret;

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

new ArrayList<RMContainer>(app.getReservedContainers());
for (RMContainer c : reservations) {
 if (Resources.lessThanOrEqual(rc, clusterResource,
   rsrcPreempt, Resources.none())) {
  return ret;
 if (Resources.lessThanOrEqual(rc, clusterResource,
    rsrcPreempt, Resources.none())) {
  return ret;

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

private void calculateToBePreemptedResourcePerApp(Resource clusterResource,
  TreeSet<TempAppPerPartition> orderedApps, Resource preemptionLimit) {
 for (TempAppPerPartition tmpApp : orderedApps) {
  if (Resources.lessThanOrEqual(rc, clusterResource, preemptionLimit,
    Resources.none())
    || Resources.lessThanOrEqual(rc, clusterResource, tmpApp.getUsed(),
      Resources.none())) {
   continue;
  }
  Resource preemtableFromApp = Resources.subtract(tmpApp.getUsed(),
    tmpApp.idealAssigned);
  Resources.subtractFromNonNegative(preemtableFromApp, tmpApp.selected);
  Resources.subtractFromNonNegative(preemtableFromApp, tmpApp.getAMUsed());
  if (context.getIntraQueuePreemptionOrderPolicy()
     .equals(IntraQueuePreemptionOrderPolicy.USERLIMIT_FIRST)) {
   Resources.subtractFromNonNegative(preemtableFromApp,
    tmpApp.getFiCaSchedulerApp().getCSLeafQueue().getMinimumAllocation());
  }
  // Calculate toBePreempted from apps as follows:
  // app.preemptable = min(max(app.used - app.selected - app.ideal, 0),
  // intra_q_preemptable)
  tmpApp.toBePreempted = Resources.min(rc, clusterResource, Resources
    .max(rc, clusterResource, preemtableFromApp, Resources.none()),
    Resources.clone(preemptionLimit));
  preemptionLimit = Resources.subtractFromNonNegative(preemptionLimit,
    tmpApp.toBePreempted);
 }
}

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

return Resources.lessThanOrEqual(rc, clusterResource,
  Resources.subtract(usedResource, c.getAllocatedResource()), userLimit)
  && context.getIntraQueuePreemptionOrderPolicy()

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

/**
 * Whether this app has containers requests that could be satisfied on the
 * given node, if the node had full space.
 */
public boolean hasContainerForNode(Priority prio, FSSchedulerNode node) {
 ResourceRequest anyRequest = getResourceRequest(prio, ResourceRequest.ANY);
 ResourceRequest rackRequest = getResourceRequest(prio, node.getRackName());
 ResourceRequest nodeRequest = getResourceRequest(prio, node.getNodeName());
 return
   // There must be outstanding requests at the given priority:
   anyRequest != null && anyRequest.getNumContainers() > 0 &&
     // If locality relaxation is turned off at *-level, there must be a
     // non-zero request for the node's rack:
     (anyRequest.getRelaxLocality() ||
       (rackRequest != null && rackRequest.getNumContainers() > 0)) &&
     // If locality relaxation is turned off at rack-level, there must be a
     // non-zero request at the node:
     (rackRequest == null || rackRequest.getRelaxLocality() ||
       (nodeRequest != null && nodeRequest.getNumContainers() > 0)) &&
     // The requested container must be able to fit on the node:
     Resources.lessThanOrEqual(RESOURCE_CALCULATOR, null,
       anyRequest.getCapability(), node.getRMNode().getTotalCapability());
}

代码示例来源：origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

/**
 * Whether this app has containers requests that could be satisfied on the
 * given node, if the node had full space.
 */
public boolean hasContainerForNode(Priority prio, FSSchedulerNode node) {
 ResourceRequest anyRequest = getResourceRequest(prio, ResourceRequest.ANY);
 ResourceRequest rackRequest = getResourceRequest(prio, node.getRackName());
 ResourceRequest nodeRequest = getResourceRequest(prio, node.getNodeName());
 return
   // There must be outstanding requests at the given priority:
   anyRequest != null && anyRequest.getNumContainers() > 0 &&
     // If locality relaxation is turned off at *-level, there must be a
     // non-zero request for the node's rack:
     (anyRequest.getRelaxLocality() ||
       (rackRequest != null && rackRequest.getNumContainers() > 0)) &&
     // If locality relaxation is turned off at rack-level, there must be a
     // non-zero request at the node:
     (rackRequest == null || rackRequest.getRelaxLocality() ||
       (nodeRequest != null && nodeRequest.getNumContainers() > 0)) &&
     // The requested container must be able to fit on the node:
     Resources.lessThanOrEqual(RESOURCE_CALCULATOR, null,
       anyRequest.getCapability(), node.getRMNode().getTotalCapability());
}

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-common

private void assertResourcesOperations(Resource clusterResource,
  Resource lhs, Resource rhs, boolean lessThan, boolean lessThanOrEqual,
  boolean greaterThan, boolean greaterThanOrEqual, Resource max,
  Resource min) {
 assertEquals("Less Than operation is wrongly calculated.", lessThan,
   Resources.lessThan(resourceCalculator, clusterResource, lhs, rhs));
 assertEquals(
   "Less Than Or Equal To operation is wrongly calculated.",
   lessThanOrEqual, Resources.lessThanOrEqual(resourceCalculator,
     clusterResource, lhs, rhs));
 assertEquals("Greater Than operation is wrongly calculated.",
   greaterThan,
   Resources.greaterThan(resourceCalculator, clusterResource, lhs, rhs));
 assertEquals(
   "Greater Than Or Equal To operation is wrongly calculated.",
   greaterThanOrEqual, Resources.greaterThanOrEqual(resourceCalculator,
     clusterResource, lhs, rhs));
 assertEquals("Max(value) Operation wrongly calculated.", max,
   Resources.max(resourceCalculator, clusterResource, lhs, rhs));
 assertEquals("Min(value) operation is wrongly calculated.", min,
   Resources.min(resourceCalculator, clusterResource, lhs, rhs));
}

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-common

private void assertResourcesOperations(Resource clusterResource,
  Resource lhs, Resource rhs, boolean lessThan, boolean lessThanOrEqual,
  boolean greaterThan, boolean greaterThanOrEqual, Resource max,
  Resource min) {
 Assert.assertEquals("Less Than operation is wrongly calculated.", lessThan,
   Resources.lessThan(resourceCalculator, clusterResource, lhs, rhs));
 Assert.assertEquals(
   "Less Than Or Equal To operation is wrongly calculated.",
   lessThanOrEqual, Resources.lessThanOrEqual(resourceCalculator,
     clusterResource, lhs, rhs));
 Assert.assertEquals("Greater Than operation is wrongly calculated.",
   greaterThan,
   Resources.greaterThan(resourceCalculator, clusterResource, lhs, rhs));
 Assert.assertEquals(
   "Greater Than Or Equal To operation is wrongly calculated.",
   greaterThanOrEqual, Resources.greaterThanOrEqual(resourceCalculator,
     clusterResource, lhs, rhs));
 Assert.assertEquals("Max(value) Operation wrongly calculated.", max,
   Resources.max(resourceCalculator, clusterResource, lhs, rhs));
 Assert.assertEquals("Min(value) operation is wrongly calculated.", min,
   Resources.min(resourceCalculator, clusterResource, lhs, rhs));
}

代码示例来源：origin: io.hops/hadoop-yarn-common

private void assertResourcesOperations(Resource clusterResource,
  Resource lhs, Resource rhs, boolean lessThan, boolean lessThanOrEqual,
  boolean greaterThan, boolean greaterThanOrEqual, Resource max,
  Resource min) {
 Assert.assertEquals("Less Than operation is wrongly calculated.", lessThan,
   Resources.lessThan(resourceCalculator, clusterResource, lhs, rhs));
 Assert.assertEquals(
   "Less Than Or Equal To operation is wrongly calculated.",
   lessThanOrEqual, Resources.lessThanOrEqual(resourceCalculator,
     clusterResource, lhs, rhs));
 Assert.assertEquals("Greater Than operation is wrongly calculated.",
   greaterThan,
   Resources.greaterThan(resourceCalculator, clusterResource, lhs, rhs));
 Assert.assertEquals(
   "Greater Than Or Equal To operation is wrongly calculated.",
   greaterThanOrEqual, Resources.greaterThanOrEqual(resourceCalculator,
     clusterResource, lhs, rhs));
 Assert.assertEquals("Max(value) Operation wrongly calculated.", max,
   Resources.max(resourceCalculator, clusterResource, lhs, rhs));
 Assert.assertEquals("Min(value) operation is wrongly calculated.", min,
   Resources.min(resourceCalculator, clusterResource, lhs, rhs));
}

内容来源于网络，如有侵权，请联系作者删除！

resources

相关文章

    查看更多
    微信公众号

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com