hadoop编译-在dfs文件中

pgpifvop 于 2021-06-03 发布在 Hadoop

关注(0)|答案(1)|浏览(290)

我想用以下命令编译hadoop示例，但出现了一个错误：

$ mkdir wordcount_classes
$ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d wordcount_classes WordCount.java
$ jar -cvf /usr/joe/wordcount.jar -C wordcount_classes/ .

Assuming that:

    /usr/joe/wordcount/input - input directory in HDFS
    /usr/joe/wordcount/output - output directory in HDFS

Sample text-files as input:

$ bin/hadoop dfs -ls /usr/joe/wordcount/input/
/usr/joe/wordcount/input/file01
/usr/joe/wordcount/input/file02

$ bin/hadoop dfs -cat /usr/joe/wordcount/input/file01
Hello World Bye World

$ bin/hadoop dfs -cat /usr/joe/wordcount/input/file02
Hello Hadoop Goodbye Hadoop

Java hadoop Jar compiler-errors

来源：https://stackoverflow.com/questions/33566005/hadoop-compilation-in-the-dfs-file

1条答案

按热度按时间

ymzxtsji1#

/usr/joe 是本地的，正如您在执行 ls 命令在第一行。第二个命令需要hdfs位置的输入和输出，但是 /usr/joe hdfs上不存在。您需要将数据移动到hdfs上，然后执行命令。例如：


# This creates a folder "wordcount/input" in your HDFS home directory

hdfs dfs -mkdir -p wordcount/input
hdfs dfs -put /usr/joe/wordcount/input/* wordcount/input

赞(0）回复(0）举报 2021-06-03

我来回答

hadoop编译-在dfs文件中

1条答案

相关问题

热门标签

最新问答