运行配置单元时出错:org.apache.hadoop.hive.ql.metadata.hiveexception:java.lang.runtimeexception配置单元错误等

uwopmtnx  于 2021-05-31  发布在  Hadoop
关注(0)|答案(1)|浏览(318)

我的。巴什尔
运行配置单元时出错:org.apache.hadoop.hive.ql.metadata.hiveexception:java.lang.runtimeexception配置单元错误等

java

export JAVA_HOME=/usr/lib/jvm/java-8-oracle 

export PATH=$PATH:$JAVA_HOME/bin

hadoop软件

export HADOOP_HOME=/usr/local/hadoop 
export HADOOP_MAPRED_HOME=$HADOOP_HOME 
export HADOOP_COMMON_HOME=$HADOOP_HOME 
export HADOOP_HDFS_HOME=$HADOOP_HOME 
export YARN_HOME=$HADOOP_HOME 
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=/usr/local/hadoop/lib/native"
export HADOOP_INSTALL=$HADOOP_HOME
export PATH=$PATH:$HADOOP_HOME/bin
export PATH=$PATH:$HADOOP_HOME/sbin

行家

export MAHOUT_HOME=/usr/local/mahout

# HBase

export HBASE_HOME=/usr/local/hbase
export PATH=$PATH:$HBASE_HOME/bin

Hive

export HIVE_HOME=/home/yash/hive/apache-hive-2.1.0-bin
export PATH=$PATH:$HIVE_HOME/bin

 My hive-site.xml:

<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
  <name>javax.jdo.option.ConnectionURL</name>
  <value>jdbc:mysql://localhost/metastore?createDatabaseIfNotExist=true</value>
</property>
<property>
  <name>javax.jdo.option.ConnectionDriverName</name>
  <value>com.mysql.jdbc.Driver</value>
</property>
<property>
  <name>javax.jdo.option.ConnectionUserName</name>
  <value>root</value>
</property>
<property>
  <name>javax.jdo.option.ConnectionPassword</name>
  <value>root</value>
</property>
<property>
  <name>datanucleus.autoCreateSchema</name>
  <value>true</value>
</property>
<property>
  <name>datanucleus.fixedDatastore</name>
  <value>true</value>
</property>
<property>
 <name>datanucleus.autoCreateTables</name>
 <value>True</value>
 </property>
<property>
    <name>hive.querylog.location</name>
    <value>/home/yash/hive/apache-hive-2.1.0-bin/iotmp</value>
    <description>Location of Hive run time structured log file</description>
  </property>
  <property>
    <name>hive.exec.local.scratchdir</name>
    <value>/home/yash/hive/apache-hive-2.1.0-bin/iotmp</value>
    <description>Local scratch space for Hive jobs</description>
  </property>
  <property>
    <name>hive.downloaded.resources.dir</name>
    <value>/home/yash/hive/apache-hive-2.1.0-bin/iotmp</value>
    <description>Temporary local directory for added resources in the        remote file system.</description>
  </property>
</configuration>
 <i>ERROR<i>

    SLF4J: Class path contains multiple SLF4J bindings.
    SLF4J: Found binding in [jar:file:/home/yash/hive/apache-hive-2.1.0-bin/lib/log4j-slf4j-impl-2.4.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
    SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]

    Logging initialized using configuration in jar:file:/home/yash/hive/apache-hive-2.1.0-bin/lib/hive-common-2.1.0.jar!/hive-log4j2.properties

异步:线程“main”java.lang.runtimeexception:org.apache.hadoop.hive.ql.metadata.hiveexception:java.lang.runtimeexception:无法示例化org.apache.hadoop.hive.ql.metadata.sessionhivemetastoreclient的org.apache.hadoop.hive.ql.session.sessionstate.start(sessionstate)。java:578)在org.apache.hadoop.hive.ql.session.sessionstate.beginstart(sessionstate。java:518)在org.apache.hadoop.hive.cli.clidriver.run(clidriver。java:705)位于org.apache.hadoop.hive.cli.clidriver.main(clidriver。java:641)位于sun.reflect.nativemethodaccessorimpl.invoke0(本机方法)sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl。java:62)在sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl。java:43)在java.lang.reflect.method.invoke(方法。java:498)在org.apache.hadoop.util.runjar.run(runjar。java:239)在org.apache.hadoop.util.runjar.main(runjar。java:153)原因:org.apache.hadoop.hive.ql.metadata.hiveexception:java.lang.runtimeexception:无法示例化org.apache.hadoop.hive.ql.metadata.sessionhivemetastoreclient位于org.apache.hadoop.hive.ql.metadata.hive.RegisteralFunctionsOnce(hive)。java:226)在org.apache.hadoop.hive.ql.metadata.hive。java:366)在org.apache.hadoop.hive.ql.metadata.hive.create(配置单元。java:310)在org.apache.hadoop.hive.ql.metadata.hive.getinternal(hive。java:290)在org.apache.hadoop.hive.ql.metadata.hive.get(hive。java:266)在org.apache.hadoop.hive.ql.session.sessionstate.start(sessionstate。java:545) ... 9其他原因:java.lang.runtimeexception:无法示例化org.apache.hadoop.hive.ql.metadata.sessionhivemetastoreclient的org.apache.hadoop.hive.metastore.metastoreutils.newinstance(metastoreutils)。java:1627)在org.apache.hadoop.hive.metastore.retryingmetastoreclient.(retryingmetastoreclient。java:80)在org.apache.hadoop.hive.metastore.retryingmetastoreclient.getproxy(retryingmetastoreclient。java:130)位于org.apache.hadoop.hive.metastore.retryingmetastoreclient.getproxy(retryingmetastoreclient。java:101)位于org.apache.hadoop.hive.ql.metadata.hive.createmetastoreclient(配置单元)。java:3317)在org.apache.hadoop.hive.ql.metadata.hive.getmsc(hive。java:3356) 在org.apache.hadoop.hive.ql.metadata.hive.getmsc(hive。java:3336)在org.apache.hadoop.hive.ql.metadata.hive.getallfunctions(hive。java:3590)在org.apache.hadoop.hive.ql.metadata.hive.reloadfunctions(hive。java:236)在org.apache.hadoop.hive.ql.metadata.hive.RegisteralFunctionsOnce(hive。java:221) ... 14其他原因:sun.reflect.nativeconstructoraccessorimpl.newinstance0(本机方法)的java.lang.reflect.invocationtargetexception at sun.reflect.nativeconstructoraccessorimpl.newinstance0(本机方法)at sun.reflect.nativeconstructoraccessorimpl.newinstance(nativeconstructoraccessorimpl)。java:62)在sun.reflect.delegatingconstructoraccessorimpl.newinstance(delegatingconstructoraccessorimpl。java:45)在java.lang.reflect.constructor.newinstance(构造函数。java:423)位于org.apache.hadoop.hive.metastore.metastoreutils.newinstance(metastoreutils。java:1625) ... 23更多原因:java.lang.illegalargumentexception:无法识别的hadoop主要版本号:3.0.1,位于org.apache.hadoop.hive.shimmes.shimloader.getmajorversion(shimloader)。java:169)在org.apache.hadoop.hive.shimmes.shimloader.loadshimmes(shimloader。java:136)在org.apache.hadoop.hive.shimmers.shimloader.gethadoopshimmers(shimloader。java:95)在org.apache.hadoop.hive.metastore.objectstore.getdatasourceprops(objectstore。java:402)在org.apache.hadoop.hive.metastore.objectstore.setconf(objectstore。java:275)位于org.apache.hadoop.util.reflectionutils.setconf(reflectionutils。java:77)位于org.apache.hadoop.util.reflectionutils.newinstance(reflectionutils。java:137)在org.apache.hadoop.hive.metastore.rawstoreproxy.(rawstoreproxy。java:58)位于org.apache.hadoop.hive.metastore.rawstoreproxy.getproxy(rawstoreproxy)。java:67)在org.apache.hadoop.hive.metastore.hivemetastore$hmshandler.newrawstore(hivemetastore)。java:581)在org.apache.hadoop.hive.metastore.hivemetastore$hmshandler.getms(hivemetastore。java:546)在org.apache.hadoop.hive.metastore.hivemetastore$hmshandler.createdefaultdb(hivemetastore)。java:608)位于org.apache.hadoop.hive.metastore.hivemetastore$hmshandler.init(hivemetastore)。java:398)在org.apache.hadoop.hive.metastore.retryinghmshandler。java:78)在org.apache.hadoop.hive.metastore.retryinghmshandler.getproxy(retryinghmshandler。java:84)位于org.apache.hadoop.hive.metastore.hivemetastore.newretryinghmshandler(hivemetastore)。java:6396)在org.apache.hadoop.hive.metastore.hivemetastoreclient.(hivemetastoreclient。java:236)在org.apache.hadoop.hive.ql.metadata.sessionhivemetastoreclient.(sessionhivemetastoreclient。java:70) ... 28个以上

hyrbngr7

hyrbngr71#

你的错误始于 Caused by ... Unrecognized Hadoop major version number: 3.0.1 ...
我认为mahout还不支持hadoop3.x;您似乎还在使用Hive2.x,它也不支持Hadoop3
至少使用最新的hadoop2.7或2.8

相关问题