运行hadoop wordcount作业时出错

eqfvzcg8  于 2021-05-29  发布在  Hadoop
关注(0)|答案(2)|浏览(450)

我对使用hadoop还很陌生,目前我正尝试在ubuntu桌面上的单节点集群上运行wordcount。我尝试按照以下指南运行hadoop作业:
http://javabeginnerstutorial.com/hadoop/your-first-hadoop-map-reduce-job/
目前我被困在第三步,当我试图 mvn clean install ,这是我收到的错误。我使用的是与步骤3中链接的pom.xml文件完全相同的pom.xml文件。我是否应该编辑pom.xml文件中的某些内容以成功编译?或者链接可能不起作用?任何帮助都会很好。谢谢。

hduser@venus:~/development/Hadoop_projects/word_count$ mvn clean install
[INFO] Scanning for projects...
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for com.impetus.code:hadoop-examples:jar:1.0
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ line 38, column 12
[WARNING] 
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING] 
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING] 
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building hadoop-examples 1.0
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-examples ---
[INFO] 
[INFO] --- maven-resources-plugin:2.3:resources (default-resources) @ hadoop-examples ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory /home/hduser/development/Hadoop_projects/word_count/src/main/resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.0.2:compile (default-compile) @ hadoop-examples ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.3:testResources (default-testResources) @ hadoop-examples ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory /home/hduser/development/Hadoop_projects/word_count/src/test/resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.0.2:testCompile (default-testCompile) @ hadoop-examples ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.10:test (default-test) @ hadoop-examples ---
[INFO] No tests to run.
[INFO] Surefire report directory: /home/hduser/development/Hadoop_projects/word_count/target/surefire-reports

-------------------------------------------------------
 T E S T S
-------------------------------------------------------

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 0.874s
[INFO] Finished at: Wed Jul 15 00:34:04 PDT 2015
[INFO] Final Memory: 7M/240M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project hadoop-examples: Error creating properties files for forking; nested exception is java.io.IOException: No such file or directory -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
nxowjjhe

nxowjjhe1#

试着从这里得到pom和maven的依赖关系http://mvnrepository.com/artifact/org.apache.hadoop/hadoop-mapreduce-client-core 在添加此pom文件之前,请尝试检查hadoop版本。

sqyvllje

sqyvllje2#

使用-dskiptests运行maven命令

相关问题