org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.AllocationFileLoaderService.getAllocationFile()方法的使用及代码示例

x33g5p2x  于2022-01-17 转载在 其他  
字(4.0k)|赞(0)|评价(0)|浏览(119)

本文整理了Java中org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.AllocationFileLoaderService.getAllocationFile()方法的一些代码示例,展示了AllocationFileLoaderService.getAllocationFile()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。AllocationFileLoaderService.getAllocationFile()方法的具体详情如下:
包路径:org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.AllocationFileLoaderService
类名称:AllocationFileLoaderService
方法名:getAllocationFile

AllocationFileLoaderService.getAllocationFile介绍

[英]Path to XML file containing allocations. If the path is relative, it is searched for in the classpath, but loaded like a regular File.
[中]包含分配的XML文件的路径。如果路径是相对的,则会在类路径中搜索,但会像普通文件一样加载。

代码示例

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

@Override
public void serviceInit(Configuration conf) throws Exception {
 this.allocFile = getAllocationFile(conf);
 if (allocFile != null) {
  reloadThread = new Thread() {

代码示例来源:origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

@Override
public void serviceInit(Configuration conf) throws Exception {
 this.allocFile = getAllocationFile(conf);
 if (allocFile != null) {
  reloadThread = new Thread() {

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Override
public void serviceInit(Configuration conf) throws Exception {
 this.allocFile = getAllocationFile(conf);
 if (this.allocFile != null) {
  this.fs = allocFile.getFileSystem(conf);

代码示例来源:origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

@Test
public void testGetAllocationFileFromClasspath() {
 Configuration conf = new Configuration();
 conf.set(FairSchedulerConfiguration.ALLOCATION_FILE,
   "test-fair-scheduler.xml");
 AllocationFileLoaderService allocLoader = new AllocationFileLoaderService();
 File allocationFile = allocLoader.getAllocationFile(conf);
 assertEquals("test-fair-scheduler.xml", allocationFile.getName());
 assertTrue(allocationFile.exists());
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Test (expected = UnsupportedFileSystemException.class)
public void testDenyGetAllocationFileFromUnsupportedFileSystem()
  throws UnsupportedFileSystemException {
 Configuration conf = new YarnConfiguration();
 conf.set(FairSchedulerConfiguration.ALLOCATION_FILE, "badfs:///badfile");
 AllocationFileLoaderService allocLoader = new AllocationFileLoaderService();
 allocLoader.getAllocationFile(conf);
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Test
public void testGetAllocationFileFromClasspath() {
 try {
  Configuration conf = new Configuration();
  FileSystem fs = FileSystem.get(conf);
  conf.set(FairSchedulerConfiguration.ALLOCATION_FILE,
    TEST_FAIRSCHED_XML);
  AllocationFileLoaderService allocLoader =
    new AllocationFileLoaderService();
  Path allocationFile = allocLoader.getAllocationFile(conf);
  assertEquals(TEST_FAIRSCHED_XML, allocationFile.getName());
  assertTrue(fs.exists(allocationFile));
 } catch (IOException e) {
  fail("Unable to access allocation file from classpath: " + e);
 }
}

代码示例来源:origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Test
public void testGetAllocationFileFromFileSystem()
  throws IOException, URISyntaxException {
 Configuration conf = new YarnConfiguration();
 File baseDir =
   new File(TEST_DIR + Path.SEPARATOR + "getAllocHDFS").getAbsoluteFile();
 FileUtil.fullyDelete(baseDir);
 conf.set(MiniDFSCluster.HDFS_MINIDFS_BASEDIR, baseDir.getAbsolutePath());
 MiniDFSCluster.Builder builder = new MiniDFSCluster.Builder(conf);
 MiniDFSCluster hdfsCluster = builder.build();
 String fsAllocPath = "hdfs://localhost:" + hdfsCluster.getNameNodePort()
   + Path.SEPARATOR + TEST_FAIRSCHED_XML;
 URL fschedURL = Thread.currentThread().getContextClassLoader()
   .getResource(TEST_FAIRSCHED_XML);
 FileSystem fs = FileSystem.get(conf);
 fs.copyFromLocalFile(new Path(fschedURL.toURI()), new Path(fsAllocPath));
 conf.set(FairSchedulerConfiguration.ALLOCATION_FILE, fsAllocPath);
 AllocationFileLoaderService allocLoader = new AllocationFileLoaderService();
 Path allocationFile = allocLoader.getAllocationFile(conf);
 assertEquals(fsAllocPath, allocationFile.toString());
 assertTrue(fs.exists(allocationFile));
 hdfsCluster.shutdown(true);
}

相关文章