org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.QueueManager.getLeafQueue()方法的使用及代码示例

x33g5p2x  于2022-01-28 转载在 其他  
字(9.3k)|赞(0)|评价(0)|浏览(158)

本文整理了Java中org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.QueueManager.getLeafQueue方法的一些代码示例,展示了QueueManager.getLeafQueue的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。QueueManager.getLeafQueue方法的具体详情如下:
包路径:org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.QueueManager
类名称:QueueManager
方法名:getLeafQueue

QueueManager.getLeafQueue介绍

[英]Get a leaf queue by name, creating it if the create param is true and is necessary. If the queue is not or can not be a leaf queue, i.e. it already exists as a parent queue, or one of the parents in its name is already a leaf queue, null is returned. The root part of the name is optional, so a queue underneath the root named "queue1" could be referred to as just "queue1", and a queue named "queue2" underneath a parent named "parent1" that is underneath the root could be referred to as just "parent1.queue2".
[中]按名称获取叶队列,如果create参数为true并且是必需的,则创建它。如果队列不是或不能是叶队列,即它已经作为父队列存在,或者其名称中的父队列之一已经是叶队列,则返回null。名称的根部分是可选的,因此名为“queue1”的根下面的队列可以称为“queue1”,而名为“parent1”的父下面名为“queue2”的队列可以称为“parent1.queue2”。

代码示例

代码示例来源:origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

public void initialize(Configuration conf) throws IOException,
  SAXException, AllocationConfigurationException, ParserConfigurationException {
 rootQueue = new FSParentQueue("root", scheduler, null);
 queues.put(rootQueue.getName(), rootQueue);
 
 // Create the default queue
 getLeafQueue(YarnConfiguration.DEFAULT_QUEUE_NAME, true);
}

代码示例来源:origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

@Override
protected void addReservationQueue(String planQueueName, Queue queue,
  String currResId) {
 String leafQueueName = getReservationQueueName(planQueueName, currResId);
 fs.getQueueManager().getLeafQueue(leafQueueName, true);
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Override
protected void addReservationQueue(String planQueueName, Queue queue,
  String currResId) {
 String leafQueueName = getReservationQueueName(planQueueName, currResId);
 fs.getQueueManager().getLeafQueue(leafQueueName, true);
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Override
public void setEntitlement(String queueName,
  QueueEntitlement entitlement) throws YarnException {
 FSLeafQueue reservationQueue = queueMgr.getLeafQueue(queueName, false);
 if (reservationQueue == null) {
  throw new YarnException("Target queue " + queueName
    + " not found or is not a leaf queue.");
 }
 reservationQueue.setWeights(entitlement.getCapacity());
 // TODO Does MaxCapacity need to be set for fairScheduler ?
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Override
protected void createDefaultReservationQueue(String planQueueName,
  Queue queue, String defReservationId) {
 String defReservationQueueName = getReservationQueueName(planQueueName,
   defReservationId);
 if (!fs.getQueueManager().exists(defReservationQueueName)) {
  fs.getQueueManager().getLeafQueue(defReservationQueueName, true);
 }
}

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

@Override
protected void createDefaultReservationQueue(String planQueueName,
  Queue queue, String defReservationId) {
 String defReservationQueueName = getReservationQueueName(planQueueName,
   defReservationId);
 if (!fs.getQueueManager().exists(defReservationQueueName)) {
  fs.getQueueManager().getLeafQueue(defReservationQueueName, true);
 }
}

代码示例来源:origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

@Override
protected void createDefaultReservationQueue(String planQueueName,
  Queue queue, String defReservationId) {
 String defReservationQueueName = getReservationQueueName(planQueueName,
   defReservationId);
 if (!fs.getQueueManager().exists(defReservationQueueName)) {
  fs.getQueueManager().getLeafQueue(defReservationQueueName, true);
 }
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Override
protected Queue getReservationQueue(String r) {
 return fs.getQueueManager().getLeafQueue(
   plan.getQueueName() + "" + "." + r, false);
}

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

@Override
protected Queue getReservationQueue(String r) {
 return fs.getQueueManager().getLeafQueue(plan.getQueueName() + "" +
   "." +
   r, false);
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Override
protected Resource getReservationQueueResourceIfExists(Plan plan,
  ReservationId reservationId) {
 String reservationQueueName = getReservationQueueName(plan.getQueueName(),
   reservationId.toString());
 FSLeafQueue reservationQueue =
   fs.getQueueManager().getLeafQueue(reservationQueueName, false);
 Resource reservationResource = null;
 if (reservationQueue != null) {
  reservationResource = reservationQueue.getSteadyFairShare();
 }
 return reservationResource;
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

private void verifyLeafQueueStarvation() {
 for (String q : QUEUES) {
  if (!q.equals("no-preemption")) {
   boolean isStarved =
     scheduler.getQueueManager().getLeafQueue(q, false).isStarved();
   assertTrue(isStarved);
  }
 }
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Override
protected void assertReservationQueueExists(ReservationId r,
  double expectedCapacity, double expectedMaxCapacity) {
 FSLeafQueue q =
   fs.getQueueManager().getLeafQueue(plan.getQueueName() + "" + "." + r,
     false);
 assertNotNull(q);
 // For now we are setting both to same weight
 Assert.assertEquals(expectedCapacity, q.getWeight(), 0.01);
}

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

private void verifyQueueNumRunnable(String queueName, int numRunnableInQueue,
  int numNonRunnableInQueue) {
 FSLeafQueue queue = scheduler.getQueueManager().getLeafQueue(queueName, false);
 assertEquals(numRunnableInQueue, queue.getNumRunnableApps());
 assertEquals(numNonRunnableInQueue, queue.getNumNonRunnableApps());
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

private void verifyQueueNumRunnable(String queueName, int numRunnableInQueue,
  int numNonRunnableInQueue) {
 FSLeafQueue queue = scheduler.getQueueManager().getLeafQueue(queueName, false);
 assertEquals(numRunnableInQueue, queue.getNumRunnableApps());
 assertEquals(numNonRunnableInQueue, queue.getNumNonRunnableApps());
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Test
public void testUserAsDefaultQueue() throws Exception {
 conf.set(FairSchedulerConfiguration.USER_AS_DEFAULT_QUEUE, "true");
 scheduler.reinitialize(conf, resourceManager.getRMContext());
 ApplicationAttemptId appAttemptId = createAppAttemptId(1, 1);
 createApplicationWithAMResource(appAttemptId, "default", "user1", null);
 assertEquals(1, scheduler.getQueueManager().getLeafQueue("user1", true)
   .getNumRunnableApps());
 assertEquals(0, scheduler.getQueueManager().getLeafQueue("default", true)
   .getNumRunnableApps());
 assertEquals("root.user1", resourceManager.getRMContext().getRMApps()
   .get(appAttemptId.getApplicationId()).getQueue());
}

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

@Override
protected void assertReservationQueueExists(ReservationId r,
  double expectedCapacity, double expectedMaxCapacity) {
 FSLeafQueue q = fs.getQueueManager().getLeafQueue(plan.getQueueName() + "" +
   "." +
   r, false);
 assertNotNull(q);
 // For now we are setting both to same weight
 Assert.assertEquals(expectedCapacity, q.getWeights().getWeight
   (ResourceType.MEMORY), 0.01);
}

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

@Test (expected = YarnException.class)
public void testMoveWouldViolateMaxAppsConstraints() throws Exception {
 scheduler.init(conf);
 scheduler.start();
 scheduler.reinitialize(conf, resourceManager.getRMContext());
 QueueManager queueMgr = scheduler.getQueueManager();
 queueMgr.getLeafQueue("queue2", true);
 scheduler.getAllocationConfiguration().queueMaxApps.put("root.queue2", 0);
 
 ApplicationAttemptId appAttId =
   createSchedulingRequest(1024, 1, "queue1", "user1", 3);
 
 scheduler.moveApplication(appAttId.getApplicationId(), "queue2");
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

/**
 * Test simple leaf queue creation.
 */
@Test
public void testCreateLeafQueue() {
 AllocationConfiguration allocConf = scheduler.getAllocationConfiguration();
 queueManager.updateAllocationConfiguration(allocConf);
 FSQueue q1 = queueManager.createQueue("root.queue1", FSQueueType.LEAF);
 assertNotNull("Leaf queue root.queue1 was not created",
   queueManager.getLeafQueue("root.queue1", false));
 assertEquals("createQueue() returned wrong queue",
   "root.queue1", q1.getName());
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Test (expected = YarnException.class)
public void testMoveToNonexistentQueue() throws Exception {
 scheduler.init(conf);
 scheduler.start();
 scheduler.reinitialize(conf, resourceManager.getRMContext());
 scheduler.getQueueManager().getLeafQueue("queue1", true);
 
 ApplicationAttemptId appAttId =
   createSchedulingRequest(1024, 1, "queue1", "user1", 3);
 scheduler.moveApplication(appAttId.getApplicationId(), "queue2");
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Test (expected = YarnException.class)
public void testMoveWouldViolateMaxAppsConstraints() throws Exception {
 scheduler.init(conf);
 scheduler.start();
 scheduler.reinitialize(conf, resourceManager.getRMContext());
 QueueManager queueMgr = scheduler.getQueueManager();
 FSQueue queue2 = queueMgr.getLeafQueue("queue2", true);
 queue2.setMaxRunningApps(0);
 ApplicationAttemptId appAttId =
   createSchedulingRequest(1024, 1, "queue1", "user1", 3);
 scheduler.moveApplication(appAttId.getApplicationId(), "queue2");
}

相关文章