无尽信息客户端:应用程序的应用程序报告\u xx(状态:已接受)spark提交的消息

6mzjoqzu  于 2021-05-29  发布在  Hadoop
关注(0)|答案(1)|浏览(382)

当我在集群模式下使用hadoop和yarn提交spark应用程序时。yarn客户机状态在accepted状态下停止,并且从不更改为running。我使用的是centos 7 hadoop集群,它有1个主节点和2个从节点
我用浮动ip(我们外部关联)登录openstack这个ip和我们在系统中进行ifconfig得到的ip地址不同。
以下是日志:

18/01/21 16:34:19 INFO yarn.Client: Uploading resource file:/usr/local/spark/examples/jars/spark-examples_2.11-2.0.1.jar -> hdfs://192.168.198.10:8020/user/cloud-user/.sparkStaging/application_1516548465362_0014/spark-examples_2.11-2.0.1.jar
    18/01/21 16:34:19 INFO yarn.Client: Uploading resource file:/tmp/spark-f37b5cec-a81f-46c3-9b5e-6ce7854c6dd4/__spark_conf__2008488553335511154.zip -> hdfs://192.168.198.10:8020/user/cloud-user/.sparkStaging/application_1516548465362_0014/__spark_conf__.zip
    18/01/21 16:34:19 INFO spark.SecurityManager: Changing view acls to: cloud-user
    18/01/21 16:34:19 INFO spark.SecurityManager: Changing modify acls to: cloud-user
    18/01/21 16:34:19 INFO spark.SecurityManager: Changing view acls groups to: 
    18/01/21 16:34:19 INFO spark.SecurityManager: Changing modify acls groups to: 
    18/01/21 16:34:19 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(cloud-user); groups with view permissions: Set(); users  with modify permissions: Set(cloud-user); groups with modify permissions: Set()
    18/01/21 16:34:19 INFO yarn.Client: Submitting application application_1516548465362_0014 to ResourceManager
    18/01/21 16:34:19 INFO impl.YarnClientImpl: Submitted application application_1516548465362_0014
    18/01/21 16:34:20 INFO yarn.Client: Application report for application_1516548465362_0014 (state: ACCEPTED)
    18/01/21 16:34:20 INFO yarn.Client: 
                client token: N/A
                diagnostics: N/A
                ApplicationMaster host: N/A
                ApplicationMaster RPC port: -1
                queue: default
                start time: 1516552459599
                tracking URL: http://master.abc.com:8088/proxy/application_1516548465362_0014/
                user: cloud-user

    18/01/21 16:34:21 INFO yarn.Client: Application report for application_1516548465362_0014 (state: ACCEPTED)
    18/01/21 16:34:22 INFO yarn.Client: Application report for application_1516548465362_0014 (state: ACCEPTED)
    18/01/21 16:34:23 INFO yarn.Client: Application report for application_1516548465362_0014 (state: ACCEPTED)
    18/01/21 16:34:24 INFO yarn.Client: Application report for application_1516548465362_0014 (state: ACCEPTED)
    18/01/21 16:34:25 INFO yarn.Client: Application report for application_1516548465362_0014 (state: ACCEPTED)
    18/01/21 16:34:26 INFO yarn.Client: Application report for application_1516548465362_0014 (state: ACCEPTED)
    18/01/21 16:34:27 yarn.Client: Application report for application_1516548465362_0014 (state: ACCEPTED)

尝试了所有人们建议的选项,但没有任何效果。我看到节点有足够的空间,但不确定为什么这不起作用。感谢您的帮助。谢谢

np8igboo

np8igboo1#

未解析的数据节点注册:无法解析主机名(ip=192.168.198.11,主机名=192.168.198.11)
我不认为主机名应该是ip,但你需要更新 /etc/hosts 在每台机器上告诉它从机和主机的位置,或者您需要静态IP或使用dns服务器解析网络上浮动的机器的地址

相关问题