hadoop mapreduce classnotfound异常,尽管它在hadoop\u类路径中

798qvoo8  于 2021-07-13  发布在  Hadoop
关注(0)|答案(0)|浏览(207)

当我尝试运行mapreduce作业时,出现以下异常
2021-03-20 11:56:30171 info[main]org.apache.hadoop.service.abstractservice:服务org.apache.hadoop.mapreduce.v2.app.mrappmaster在初始化状态下失败;原因:org.apache.hadoop.yarn.exceptions.yarnruntimeexception:java.lang.runtimeexception:java.lang.classnotfoundexception:class org.apache.orc.mapreduce.orcouputformat找不到org.apache.hadoop.yarn.exceptions.yarnruntimeexception:java.lang.runtimeexception:java.lang.classnotfoundexception:class org.apache.orc.mapreduce.orcouputformat在org.apache.hadoop.mapreduce.v2.app.mrappmaster$2.call(mrappmaster)中找不到。java:541)在org.apache.hadoop.mapreduce.v2.app.mrappmaster$2.call(mrappmaster。java:521)在org.apache.hadoop.mapreduce.v2.app.mrappmaster.callwithjobclassloader(mrappmaster。java:1695)在org.apache.hadoop.mapreduce.v2.app.mrappmaster.createoutputcommitter(mrappmaster。java:521)在org.apache.hadoop.mapreduce.v2.app.mrappmaster.serviceinit(mrappmaster。java:307)在org.apache.hadoop.service.abstractservice.init(abstractservice。java:163)在org.apache.hadoop.mapreduce.v2.app.mrappmaster$5.run(mrappmaster。java:1653)在javax.security.auth.subject.doas(主题)中的java.security.accesscontroller.doprivileged(本机方法)。java:422)在org.apache.hadoop.security.usergroupinformation.doas(usergroupinformation。java:1844)在org.apache.hadoop.mapreduce.v2.app.mrappmaster.initandstartapmaster(mrappmaster。java:1650)在org.apache.hadoop.mapreduce.v2.app.mrappmaster.main(mrappmaster.com)。java:1583)原因:java.lang.runtimeexception:java.lang.classnotfoundexception:class org.apache.orc.mapreduce.orcoutputformat未在org.apache.hadoop.conf.configuration.getclass(configuration)中找到。java:2369)在org.apache.hadoop.mapreduce.task.jobcontextimpl.getoutputformatclass(jobcontextimpl。java:223)在org.apache.hadoop.mapreduce.v2.app.mrappmaster$2.call(mrappmaster。java:538) ... 11更多原因:java.lang.classnotfoundexception:在org.apache.hadoop.conf.configuration.getclassbyname(配置)中找不到类org.apache.orc.mapreduce.orcoutputformat。java:2273)在org.apache.hadoop.conf.configuration.getclass(configuration。java:2367) ... 13个以上
在运行mapreduce之前,我使用命令

export HADOOP_CLASSPATH=/usr/lib/hadoop/*:/tmp/vg/libs/*:$(hbase classpath)

/tmp/vg/libs包含jar,它包含org.apache.orc.mapreduce.orcouputformat类
有什么问题?

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题