在hadoop流媒体中，reducer不会启动

5lwkijsr 于 2021-06-03 发布在 Hadoop

关注(0)|答案(1)|浏览(305)

我不确定发生了什么，但我写了一个简单的Map器和缩减器脚本。
我正在一个小的数据集（比如几行长）上测试它。
因为某些原因，减速机还没有启动。。Map器一次又一次地执行？

12/11/20 09:21:18 INFO streaming.StreamJob:  map 0%  reduce 0%
12/11/20 09:22:05 INFO streaming.StreamJob:  map 50%  reduce 0%
12/11/20 09:22:10 INFO streaming.StreamJob:  map 100%  reduce 0%
12/11/20 09:32:05 INFO streaming.StreamJob:  map 50%  reduce 0%
12/11/20 09:32:11 INFO streaming.StreamJob:  map 0%  reduce 0%
12/11/20 09:32:20 INFO streaming.StreamJob:  map 50%  reduce 0%
12/11/20 09:32:31 INFO streaming.StreamJob:  map 100%  reduce 0%
12/11/20 09:42:20 INFO streaming.StreamJob:  map 50%  reduce 0%
12/11/20 09:42:31 INFO streaming.StreamJob:  map 0%  reduce 0%
12/11/20 09:42:32 INFO streaming.StreamJob:  map 50%  reduce 0%
12/11/20 09:42:50 INFO streaming.StreamJob:  map 100%  reduce 0%

如果你还需要密码，请告诉我。有什么线索表明我错在哪里吗？谢谢

hadoop hadoop-streaming

来源：https://stackoverflow.com/questions/13477903/reducer-just-wont-start-in-hadoop-streaming