oozie 4.0.1生成错误

jei2mxaa 于 2021-05-30 发布在 Hadoop

关注(0)|答案(2)|浏览(429)

我试图使用命令在hadoop2.4.1和centos6.5上构建oozie4.0.1

bin/mkdistro.sh -P hadoop-2 -DskipTests

此时生成失败

[INFO] Apache Oozie Main .................................. SUCCESS [  0.688 s]
[INFO] Apache Oozie Client ................................ SUCCESS [ 24.719 s]
[INFO] Apache Oozie Hadoop 1.1.1.oozie-4.0.1 .............. SUCCESS [  0.431 s]
[INFO] Apache Oozie Hadoop Distcp 1.1.1.oozie-4.0.1 ....... SUCCESS [  0.035 s]
[INFO] Apache Oozie Hadoop 1.1.1.oozie-4.0.1 Test ......... SUCCESS [  0.065 s]
[INFO] Apache Oozie Hadoop 2.3.0.oozie-4.0.1 .............. SUCCESS [  1.626 s]
[INFO] Apache Oozie Hadoop 2.3.0.oozie-4.0.1 Test ......... SUCCESS [  0.098 s]
[INFO] Apache Oozie Hadoop Distcp 2.3.0.oozie-4.0.1 ....... SUCCESS [  0.038 s]
[INFO] Apache Oozie Hadoop 0.23.5.oozie-4.0.1 ............. SUCCESS [  1.176 s]
[INFO] Apache Oozie Hadoop 0.23.5.oozie-4.0.1 Test ........ SUCCESS [  0.087 s]
[INFO] Apache Oozie Hadoop Distcp 0.23.5.oozie-4.0.1 ...... SUCCESS [  0.028 s]
[INFO] Apache Oozie Hadoop Libs ........................... SUCCESS [  1.493 s]
[INFO] Apache Oozie Hbase 0.94.2.oozie-4.0.1 .............. SUCCESS [  0.148 s]
[INFO] Apache Oozie Hbase Libs ............................ SUCCESS [  0.319 s]
[INFO] Apache Oozie HCatalog 0.5.0.oozie-4.0.1 ............ FAILURE [  0.127 s]
[INFO] Apache Oozie HCatalog Libs ......................... SKIPPED
[INFO] Apache Oozie Share Lib Oozie ....................... SKIPPED
[INFO] Apache Oozie Share Lib HCatalog .................... SKIPPED
[INFO] Apache Oozie Core .................................. SKIPPED
[INFO] Apache Oozie Docs .................................. SKIPPED
[INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
[INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
[INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
[INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
[INFO] Apache Oozie Share Lib Distcp ...................... SKIPPED
[INFO] Apache Oozie WebApp ................................ SKIPPED
[INFO] Apache Oozie Examples .............................. SKIPPED
[INFO] Apache Oozie Share Lib ............................. SKIPPED
[INFO] Apache Oozie Tools ................................. SKIPPED
[INFO] Apache Oozie MiniOozie ............................. SKIPPED
[INFO] Apache Oozie Distro ................................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 31.826 s
[INFO] Finished at: 2015-01-02T21:17:00+05:30
[INFO] Final Memory: 40M/358M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project oozie-hcatalog: Could not resolve dependencies for project org.apache.oozie:oozie-hcatalog:jar:0.5.0.oozie-4.0.1: Failed to collect dependencies at org.apache.hcatalog:hcatalog-server-extensions:jar:0.5.0-incubating -> org.apache.hcatalog:hcatalog-core:jar:0.5.0-incubating -> org.apache.hive:hive-metastore:jar:0.10.0 -> org.datanucleus:datanucleus-enhancer:jar:2.0.3 -> asm:asm:jar:[3.0, 4.0): No versions available for asm:asm:jar:[3.0, 4.0) within specified range -> [Help 1]

我尝试的存储库链接如下：

<url>https://repository.cloudera.com/cloudera/ext-release-local/</url>      
<url>http://121.241.113.72:8080/archiva/repository/internal/</url>
<url>http://maven.icm.edu.pl/artifactory/repo</url> 
<url>https://github.com/CeON/oozie-maven-plugin</url>
<url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
<url>http://repository.jboss.org/nexus/content/groups/public-jboss/</url>
<url>http://repo1.maven.org/maven2/</url>

但所有这些都导致了相同的错误，发行版创建过程仅在特定点失败。对于hadoop2.4.1，我还更改了必需的pom条目。

cd hadooplibs
File hadoop-2/pom.xml : change hadoop-client & hadoop-auth dependency version to 2.4.1
File hadoop-distcp-2/pom.xml: change hadoop-distcp version to 2.4.1
File hadoop-test-2/pom.xml: change hadoop-minicluster version to 2.4.1

在主oozie pom文件中

<profile>
            <id>hadoop-2</id>
            <activation>
                <activeByDefault>false</activeByDefault>
            </activation>
            <properties>
               <hadoop.version>2.4.1</hadoop.version>
               <hadoop.auth.version>2.4.1</hadoop.auth.version>
               <pig.classifier>h2</pig.classifier>
               <sqoop.classifier>hadoop200</sqoop.classifier>
            </properties>
        </profile>

请告诉我一个方法来安装这个oozie 4.0.1与hadoop2.4.1任何帮助将不胜感激。

hadoop Maven oozie apache hcatalog

来源：https://stackoverflow.com/questions/27740762/oozie-4-0-1-build-error-while-using-hadoop-2-4-1

2条答案

按热度按时间

ejk8hzay1#

请按照下面的链接来构建oozie 4.1.0。
http://gauravkohli.com/2014/08/26/apache-oozie-installation-on-hadoop-2-4-1/
它工作得很好。我使用的是hadoop2.6.0版本

赞(0）回复(0）举报 2021-05-30

monwx1rj2#

我将oozie-4.0.1与hadoop2.3.0结合使用
我也犯了类似的错误。

...
    [INFO] Apache Oozie Hbase 0.94.2.oozie-4.0.1 .............. SUCCESS [  0.172 s]
    [INFO] Apache Oozie Hbase Libs ............................ SUCCESS [  0.530 s]
    [INFO] Apache Oozie HCatalog 0.5.0.oozie-4.0.1 ............ FAILURE [  0.436 s]
    [INFO] Apache Oozie HCatalog 0.6.0.oozie-4.0.1 ............ SKIPPED
    [INFO] Apache Oozie HCatalog Libs ......................... SKIPPED
    [INFO] Apache Oozie Share Lib Oozie ....................... SKIPPED
    [INFO] Apache Oozie Share Lib HCatalog .................... SKIPPED
    [INFO] Apache Oozie Core .................................. SKIPPED
    [INFO] Apache Oozie Docs .................................. SKIPPED
    [INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
    [INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
    [INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
    [INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
    [INFO] Apache Oozie Share Lib Distcp ...................... SKIPPED
    [INFO] Apache Oozie WebApp ................................ SKIPPED
    [INFO] Apache Oozie Examples .............................. SKIPPED
    [INFO] Apache Oozie Share Lib ............................. SKIPPED
    [INFO] Apache Oozie Tools ................................. SKIPPED
    [INFO] Apache Oozie MiniOozie ............................. SKIPPED
    [INFO] Apache Oozie Distro ................................ SKIPPED
    [INFO] ------------------------------------------------------------------------
    [INFO] BUILD FAILURE
    [INFO] ------------------------------------------------------------------------
    [INFO] Total time: 32.522 s
    [INFO] Finished at: 2015-11-11T12:58:10-05:00
    [INFO] Final Memory: 44M/643M
    [INFO] ------------------------------------------------------------------------
    [ERROR] Failed to execute goal on project oozie-hcatalog: Could not resolve dependencies for project org.apache.oozie:oozie-hcatalog:jar:0.5.0.oozie-4.0.1: Failed to coll
    ect dependencies at org.apache.hcatalog:hcatalog-server-extensions:jar:0.5.0-incubating -> org.apache.hcatalog:hcatalog-core:jar:0.5.0-incubating -> org.apache.hive:hive-
    builtins:jar:0.10.0 -> org.apache.hive:hive-exec:jar:0.10.0 -> org.apache.hive:hive-metastore:jar:0.10.0 -> javax.jdo:jdo2-api:jar:2.3-ec: Failed to read artifact descrip
    tor for javax.jdo:jdo2-api:jar:2.3-ec: Could not transfer artifact javax.jdo:jdo2-api:pom:2.3-ec from/to Codehaus repository (http://repository.codehaus.org/): repository
    .codehaus.org: Unknown host repository.codehaus.org -> [Help 1]

我完全可以通过从basepom.xml中删除codehause.org存储库来修复它，因为“所有codehaus服务现在都已终止”http://www.codehaus.org/
从pom.xml中删除以下行

<repository>
      <id>Codehaus repository</id> 
      <url>http://repository.codehaus.org/</url> 
      <snapshots> <enabled>false</enabled> </snapshots>
 </repository>

赞(0）回复(0）举报 2021-05-30

我来回答

oozie 4.0.1生成错误

2条答案

相关问题

热门标签

最新问答