mapreduce作业从不进入运行状态

fxnxkyjh  于 2021-05-29  发布在  Hadoop
关注(0)|答案(1)|浏览(477)

我有一个小jar文件,这是正确的,因为我在其他计算机上测试了它,它与hadoop一起工作。
现在我已经在我的电脑上安装了hadoop,当我提交一个作业时,它永远不会通过accept状态。
在浏览器中,我可以看到作业已被接受,但从未执行。这是截图。

我看到控制台里有个警告:

WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.

完整日志包括:

C:\Users\afraz\Desktop\MapReduceData>hadoop jar outs.jar 1902 spo
2019-05-01 22:27:40,842 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
2019-05-01 22:27:41,882 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2019-05-01 22:27:41,925 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/afraz/.staging/job_1556742397967_0001
2019-05-01 22:27:42,890 INFO input.FileInputFormat: Total input files to process : 1
2019-05-01 22:27:43,048 INFO mapreduce.JobSubmitter: number of splits:1
2019-05-01 22:27:43,250 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1556742397967_0001
2019-05-01 22:27:43,254 INFO mapreduce.JobSubmitter: Executing with tokens: []
2019-05-01 22:27:43,543 INFO conf.Configuration: resource-types.xml not found
2019-05-01 22:27:43,544 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2019-05-01 22:27:44,093 INFO impl.YarnClientImpl: Submitted application application_1556742397967_0001
2019-05-01 22:27:44,155 INFO mapreduce.Job: The url to track the job: http://LAPTOP-PN52M98R:8088/proxy/application_1556742397967_0001/
2019-05-01 22:27:44,157 INFO mapreduce.Job: Running job: job_1556742397967_0001

任何帮助都会很好。

egdjgwm8

egdjgwm81#

似乎您没有活动的节点管理器

Memory Total: 0B   VCores Total: 0
Unhealthy Nodes: 1

您的作业已被resourcemanager接受,但只有在有可用资源启动作业时才能运行
我建议在您的机器上查找nodemanager日志文件,然后查看是否有任何提到的异常

相关问题