spark cluster-yarn“容器退出,退出代码为非零13错误文件:prelaunch.err“

dba5bblo  于 2021-05-18  发布在  Spark
关注(0)|答案(0)|浏览(2046)

当我用“cluster”部署模式和“yarn”master执行spark submit时,出现以下错误。
我正在使用hadoop3.1.1。我可以提供yarn-site.xml和其他详细信息,但它们大多带有默认值。

2020-10-29 21:04:05 INFO  Client:54 - Submitting application application_1603994856896_0008 to ResourceManager
2020-10-29 21:04:05 INFO  YarnClientImpl:273 - Submitted application application_1603994856896_0008
2020-10-29 21:04:06 INFO  Client:54 - Application report for application_1603994856896_0008 (state: ACCEPTED)
2020-10-29 21:04:06 INFO  Client:54 -
         client token: N/A
         diagnostics: AM container is launched, waiting for AM container to Register with RM
         ApplicationMaster host: N/A
         ApplicationMaster RPC port: -1
         queue: default
         start time: 1604005445796
         final status: UNDEFINED
         tracking URL: http://XXX.XXX.XXX.XXX:8088/proxy/application_1603994856896_0008/
         user: centos
2020-10-29 21:04:07 INFO  Client:54 - Application report for application_1603994856896_0008 (state: ACCEPTED)
2020-10-29 21:04:08 INFO  Client:54 - Application report for application_1603994856896_0008 (state: ACCEPTED)
2020-10-29 21:04:09 INFO  Client:54 - Application report for application_1603994856896_0008 (state: ACCEPTED)
2020-10-29 21:04:10 INFO  Client:54 - Application report for application_1603994856896_0008 (state: ACCEPTED)
2020-10-29 21:04:11 INFO  Client:54 - Application report for application_1603994856896_0008 (state: ACCEPTED)
2020-10-29 21:04:12 INFO  Client:54 - Application report for application_1603994856896_0008 (state: ACCEPTED)
2020-10-29 21:04:13 INFO  Client:54 - Application report for application_1603994856896_0008 (state: ACCEPTED)
2020-10-29 21:04:14 INFO  Client:54 - Application report for application_1603994856896_0008 (state: FAILED)
2020-10-29 21:04:14 INFO  Client:54 -
         client token: N/A
         diagnostics: Application application_1603994856896_0008 failed 2 times due to AM Container for appattempt_1603994856896_0008_000002 exited with  exitCode: 13
Failing this attempt.Diagnostics: [2020-10-29 21:04:13.567]Exception from container-launch.
Container id: container_1603994856896_0008_02_000001
Exit code: 13

[2020-10-29 21:04:13.568]Container exited with a non-zero exit code 13. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
log4j:WARN No such property [target] in org.apache.log4j.DailyRollingFileAppender.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/hadoop-centos/nm-local-dir/usercache/centos/filecache/213/__spark_libs__1746573117963196214.zip/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/XXX/hadoop-3.1.1/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题