hadoop hdfs distcp-无法初始化集群

neskvpey  于 2021-05-27  发布在  Hadoop
关注(0)|答案(0)|浏览(272)

我正在使用hadoopdistcp2.7.5javaapi构建hdfs备份实用程序。在此处输入链接说明
但是通过在env中调用我的jar(包括类路径中的hadoop jar)

java -classpath  "/usr/local/flytxt/hadoop/conf:/usr/local/HBackup/conf:/usr/local/HBackup/lib/*:/usr/local/HBackup/hadoop-distcp-2.7.5.jar" -Djava.library.path="/usr/local/HBackup/lib/native"  -jar hdfs-br-0.0.1-SNAPSHOT.jar

代码没有说明:

20/12/15 21:01:35 INFO tools.DistCp: srcPaths=[/usr]
20/12/15 21:01:35 INFO tools.DistCp: destPath=file:/home/hadoop/usr-back
With failures, global counters are inaccurate; consider running with -i
Copy failed: java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.
        at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:120)
        at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:82)
        at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:75)
        at org.apache.hadoop.mapred.JobClient.init(JobClient.java:475)
        at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:454)
        at org.apache.hadoop.tools.DistCp.setup(DistCp.java:1015)
        at org.apache.hadoop.tools.DistCp.copy(DistCp.java:666)
        at org.apache.hadoop.tools.DistCp.run(DistCp.java:881)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
        at org.apache.hadoop.tools.DistCp.main(DistCp.java:908)
        at com.flytxt.hdfsbr.Backup.backup(Backup.java:129)
        at com.flytxt.hdfsbr.Backup.command_executor(Backup.java:325)
        at com.flytxt.hdfsbr.Backup.main(Backup.java:395)

这就是我调用distcp main的方式。如果需要,我还将分享我的hadoop conf xmls:

String[] argv= {"-Dmapreduce.framework.name=local" , "file:///home/hadoop/usr-back/" };
DistCp.main(argv);

ps:我已经看了这里的输入链接描述。答案是半生不熟的,对我没用。期待你的帮助!

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题