org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.QueuePlacementPolicy.fromConfiguration()方法的使用及代码示例

x33g5p2x  于2022-01-28 转载在 其他  
字(5.1k)|赞(0)|评价(0)|浏览(110)

本文整理了Java中org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.QueuePlacementPolicy.fromConfiguration方法的一些代码示例,展示了QueuePlacementPolicy.fromConfiguration的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。QueuePlacementPolicy.fromConfiguration方法的具体详情如下:
包路径:org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.QueuePlacementPolicy
类名称:QueuePlacementPolicy
方法名:fromConfiguration

QueuePlacementPolicy.fromConfiguration介绍

[英]Build a simple queue placement policy from the allow-undeclared-pools and user-as-default-queue configuration options.
[中]从“允许未声明的池”和“用户作为默认队列配置”选项中构建一个简单的队列放置策略。

代码示例

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

public AllocationConfiguration(Configuration conf) {
 minQueueResources = new HashMap<String, Resource>();
 maxQueueResources = new HashMap<String, Resource>();
 queueWeights = new HashMap<String, ResourceWeights>();
 queueMaxApps = new HashMap<String, Integer>();
 userMaxApps = new HashMap<String, Integer>();
 queueMaxAMShares = new HashMap<String, Float>();
 userMaxAppsDefault = Integer.MAX_VALUE;
 queueMaxAppsDefault = Integer.MAX_VALUE;
 queueMaxAMShareDefault = 0.5f;
 queueAcls = new HashMap<String, Map<QueueACL, AccessControlList>>();
 minSharePreemptionTimeouts = new HashMap<String, Long>();
 fairSharePreemptionTimeouts = new HashMap<String, Long>();
 fairSharePreemptionThresholds = new HashMap<String, Float>();
 schedulingPolicies = new HashMap<String, SchedulingPolicy>();
 defaultSchedulingPolicy = SchedulingPolicy.DEFAULT_POLICY;
 reservableQueues = new HashSet<>();
 configuredQueues = new HashMap<FSQueueType, Set<String>>();
 for (FSQueueType queueType : FSQueueType.values()) {
  configuredQueues.put(queueType, new HashSet<String>());
 }
 placementPolicy = QueuePlacementPolicy.fromConfiguration(conf,
   configuredQueues);
}

代码示例来源:origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

public AllocationConfiguration(Configuration conf) {
 minQueueResources = new HashMap<String, Resource>();
 maxQueueResources = new HashMap<String, Resource>();
 queueWeights = new HashMap<String, ResourceWeights>();
 queueMaxApps = new HashMap<String, Integer>();
 userMaxApps = new HashMap<String, Integer>();
 queueMaxAMShares = new HashMap<String, Float>();
 userMaxAppsDefault = Integer.MAX_VALUE;
 queueMaxAppsDefault = Integer.MAX_VALUE;
 queueMaxAMShareDefault = 0.5f;
 queueAcls = new HashMap<String, Map<QueueACL, AccessControlList>>();
 minSharePreemptionTimeouts = new HashMap<String, Long>();
 fairSharePreemptionTimeouts = new HashMap<String, Long>();
 fairSharePreemptionThresholds = new HashMap<String, Float>();
 schedulingPolicies = new HashMap<String, SchedulingPolicy>();
 defaultSchedulingPolicy = SchedulingPolicy.DEFAULT_POLICY;
 reservableQueues = new HashSet<>();
 configuredQueues = new HashMap<FSQueueType, Set<String>>();
 for (FSQueueType queueType : FSQueueType.values()) {
  configuredQueues.put(queueType, new HashSet<String>());
 }
 placementPolicy = QueuePlacementPolicy.fromConfiguration(conf,
   configuredQueues);
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

public AllocationConfiguration(Configuration conf) {
 minQueueResources = new HashMap<>();
 maxChildQueueResources = new HashMap<>();
 maxQueueResources = new HashMap<>();
 queueWeights = new HashMap<>();
 queueMaxApps = new HashMap<>();
 userMaxApps = new HashMap<>();
 queueMaxAMShares = new HashMap<>();
 userMaxAppsDefault = Integer.MAX_VALUE;
 queueMaxAppsDefault = Integer.MAX_VALUE;
 queueMaxResourcesDefault = new ConfigurableResource(Resources.unbounded());
 queueMaxAMShareDefault = 0.5f;
 queueAcls = new HashMap<>();
 resAcls = new HashMap<>();
 minSharePreemptionTimeouts = new HashMap<>();
 fairSharePreemptionTimeouts = new HashMap<>();
 fairSharePreemptionThresholds = new HashMap<>();
 schedulingPolicies = new HashMap<>();
 defaultSchedulingPolicy = SchedulingPolicy.DEFAULT_POLICY;
 reservableQueues = new HashSet<>();
 configuredQueues = new HashMap<>();
 for (FSQueueType queueType : FSQueueType.values()) {
  configuredQueues.put(queueType, new HashSet<>());
 }
 placementPolicy =
   QueuePlacementPolicy.fromConfiguration(conf, configuredQueues);
 nonPreemptableQueues = new HashSet<>();
 queueMaxContainerAllocationMap = new HashMap<>();
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

private QueuePlacementPolicy getQueuePlacementPolicy(
  AllocationFileParser allocationFileParser,
  QueueProperties queueProperties, Configuration conf)
  throws AllocationConfigurationException {
 if (allocationFileParser.getQueuePlacementPolicy().isPresent()) {
  return QueuePlacementPolicy.fromXml(
    allocationFileParser.getQueuePlacementPolicy().get(),
    queueProperties.getConfiguredQueues(), conf);
 } else {
  return QueuePlacementPolicy.fromConfiguration(conf,
    queueProperties.getConfiguredQueues());
 }
}

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

configuredQueues, conf);
} else {
 newPlacementPolicy = QueuePlacementPolicy.fromConfiguration(conf,
   configuredQueues);

代码示例来源:origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

configuredQueues, conf);
} else {
 newPlacementPolicy = QueuePlacementPolicy.fromConfiguration(conf,
   configuredQueues);

相关文章