aws emr设置hadoop类路径

egmofgnx  于 2021-05-27  发布在  Hadoop
关注(0)|答案(0)|浏览(268)

我在向hadoop类路径添加jar库时遇到问题。我正在使用emr label 5.31.0,并将avro-1.10.0.jar下载到/home/hadoop/lib中。我还按照说明将库附加到hadoop类路径,但没有一个有效https://docs.aws.amazon.com/emr/latest/releaseguide/emr-3x-customizeappconfig.html


# !/bin/bash

export HADOOP_USER_CLASSPATH_FIRST=true; 
echo "HADOOP_CLASSPATH=/path/to/my.jar" >> /home/hadoop/conf/hadoop-user-env.sh
[ 
      { 
         "Classification":"hadoop-env",
         "Properties":{ 

         },
         "Configurations":[ 
            { 
               "Classification":"export",
               "Properties":{ 
                  "HADOOP_USER_CLASSPATH_FIRST":"true",
                  "HADOOP_CLASSPATH":"/path/to/my.jar"
               }
            }
         ]
      }
   ]

问题是什么?

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题