h2o不起作用

bxfogqkk  于 2021-05-29  发布在  Hadoop
关注(0)|答案(0)|浏览(275)

我正在hadoop上运行h2o:
hadoop 2.7.1(单节点)
h2o驱动器-h2o-3.10.4.3-mapr5.1
使用以下命令: hadoop jar h2odriver.jar -nodes 1 -mapperXmx 6g -output hdfsOutputDirName 得到这个错误:

----- YARN cluster metrics -----
Number of YARN worker nodes: 1

----- Nodes -----
Node: http://DESKTOP-BPF0VCF:8042 Rack: /default-rack, RUNNING, 0 containers used, 0,0 / 16,0 GB used, 0 / 4 vcores used

----- Queues -----
Queue name:            default
    Queue state:       RUNNING
    Current capacity:  0,00
    Capacity:          1,00
    Maximum capacity:  1,00
    Application count: 0

Queue 'default' approximate utilization: 0,0 / 16,0 GB used, 0 / 4 vcores used

----------------------------------------------------------------------

ERROR: Unable to start any H2O nodes; please contact your YARN administrator.

       A common cause for this is the requested container size (6,6 GB)
       exceeds the following YARN settings:

           yarn.nodemanager.resource.memory-mb
           yarn.scheduler.maximum-allocation-mb

----------------------------------------------------------------------

For YARN users, logs command is 'yarn logs -applicationId application_1492203365290_0001'

以下是my yarn-site.xml:

<configuration>
   <property>
       <name>yarn.nodemanager.aux-services</name>
       <value>mapreduce_shuffle</value>
   </property>
   <property>
       <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
       <value>org.apache.hadoop.mapred.ShuffleHandler</value>
   </property>
      <property>
       <name>yarn.resourcemanager.scheduler.class</name>
       <value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler</value>
   </property>

   <property>
       <name>yarn.scheduler.maximum-allocation-mb</name>
       <value>16384</value>
   </property>

   <property>
       <name>yarn.nodemanager.resource.memory-mb</name>
       <value>16384</value>
   </property>

   <property>
       <name>yarn.scheduler.maximum-allocation-vcores</name>
       <value>8</value>
   </property>

   <property>
       <name>yarn.nodemanager.resource.cpu-vcores</name>
       <value>4</value>
   </property>

</configuration>

所以,很明显,记忆是足够的,但它仍然不起作用。这个帖子也没用:水从Yarn上开始不起作用

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题