hadoop失败容器

col17t5w  于 2021-05-27  发布在  Hadoop
关注(0)|答案(0)|浏览(214)

我在ubuntu上使用hadoop,为了安装它,我遵循以下指南:

https://intellitech.pro/fr/tutoriel-installation-hadoop-single-node/
https://tecadmin.net/setup-hadoop-on-ubuntu/

我已经创建了一个项目,我已经创建了一个jar,并在hadoop文件系统上上传了一些文件,但是当我启动jar文件时,出现了这个错误(在 http://bigpc:8088/cluster/app/application_1608722278919_0001 执行后):

Application application_1608722278919_0001 failed 2 times due to AM Container for appattempt_1608722278919_0001_000002 exited with exitCode: 1
Failing this attempt.Diagnostics: [2020-12-23 12:22:55.663]Exception from container-launch.
Container id: container_1608722278919_0001_02_000001
Exit code: 1
[2020-12-23 12:22:55.667]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/hadoop-biguser/nm-local-dir/usercache/biguser/appcache/application_1608722278919_0001/filecache/11/job.jar/job.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
[2020-12-23 12:22:55.667]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/hadoop-biguser/nm-local-dir/usercache/biguser/appcache/application_1608722278919_0001/filecache/11/job.jar/job.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
For more detailed output, check the application tracking page: http://bigpc:8088/cluster/app/application_1608722278919_0001 Then click on links to logs of each attempt.
. Failing the application.

在终点站我有:

2020-12-23 12:22:31,824 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2020-12-23 12:22:33,561 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
2020-12-23 12:22:34,527 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/biguser/.staging/job_1608722278919_0001
2020-12-23 12:22:34,920 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2020-12-23 12:22:39,814 INFO input.FileInputFormat: Total input files to process : 2
2020-12-23 12:22:39,930 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2020-12-23 12:22:40,003 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2020-12-23 12:22:40,048 INFO mapreduce.JobSubmitter: number of splits:2
2020-12-23 12:22:40,658 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2020-12-23 12:22:40,711 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1608722278919_0001
2020-12-23 12:22:40,712 INFO mapreduce.JobSubmitter: Executing with tokens: []
2020-12-23 12:22:41,066 INFO conf.Configuration: resource-types.xml not found
2020-12-23 12:22:41,067 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2020-12-23 12:22:41,634 INFO impl.YarnClientImpl: Submitted application application_1608722278919_0001
2020-12-23 12:22:41,720 INFO mapreduce.Job: The url to track the job: http://bigpc:8088/proxy/application_1608722278919_0001/
2020-12-23 12:22:41,722 INFO mapreduce.Job: Running job: job_1608722278919_0001
2020-12-23 12:22:55,972 INFO mapreduce.Job: Job job_1608722278919_0001 running in uber mode : false
2020-12-23 12:22:55,973 INFO mapreduce.Job:  map 0% reduce 0%
2020-12-23 12:22:55,993 INFO mapreduce.Job: Job job_1608722278919_0001 failed with state FAILED due to: Application application_1608722278919_0001 failed 2 times due to AM Container for appattempt_1608722278919_0001_000002 exited with  exitCode: 1
Failing this attempt.Diagnostics: [2020-12-23 12:22:55.663]Exception from container-launch.
Container id: container_1608722278919_0001_02_000001
Exit code: 1

[2020-12-23 12:22:55.667]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/hadoop-biguser/nm-local-dir/usercache/biguser/appcache/application_1608722278919_0001/filecache/11/job.jar/job.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

[2020-12-23 12:22:55.667]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/hadoop-biguser/nm-local-dir/usercache/biguser/appcache/application_1608722278919_0001/filecache/11/job.jar/job.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

For more detailed output, check the application tracking page: http://bigpc:8088/cluster/app/application_1608722278919_0001 Then click on links to logs of each attempt.
. Failing the application.
2020-12-23 12:22:56,047 INFO mapreduce.Job: Counters: 0

我对这个问题一无所知。

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题