无法在hadoop上运行python mrjob代码

5f0d552i  于 2021-05-27  发布在  Hadoop
关注(0)|答案(0)|浏览(233)

我正在尝试运行一个mapreduce代码,它是使用mrjob用python编写的。我正在使用以下命令来执行此操作。
python p1.py-r hadoop--hadoop流jar hadoop-streaming-2.10.0.jar u.data
执行此命令后,我得到以下错误。

Found 2 unexpected arguments on the command line [hdfs:///user/HP/tmp/mrjob/p1.HP.20200221.155103.439394/files/wd/p1.py#p1.py, hdfs:///user/HP/tmp/mrjob/p1.HP.20200221.155103.439394/files/wd/setup-wrapper.sh#setup-wrapper.sh]
  Try -help for more information
  Streaming Command Failed!
Attempting to fetch counters from logs...
Can't fetch history log; missing job ID
No counters found
Scanning logs for probable cause of failure...
Can't fetch history log; missing job ID
Can't fetch task logs; missing application I

我不知道是什么两个意想不到的论点,使这个错误。命令的格式正确吗?

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题