Oozie Build Fail: Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:3.1.0:single

£可爱£侵袭症+ 提交于 2021-01-29 22:06:26

问题


I'm trying to install the Oozie 5.2.0 with java version "1.8.0_221" and maven version 3.6.3. After I unzip the Oozie file I put the following command:

bin/mkdistro.sh assembly:single -P hadoop-2,uber -Dmaven.test.skip=true -Dhadoop.version=2.7.4 -Dhive.version=2.1.1 -e

But, I got the following response and failed:

[INFO] Reactor Summary for Apache Oozie Main 5.2.0:
[INFO] 
[INFO] Apache Oozie Main .................................. SUCCESS [ 34.428 s]
[INFO] Apache Oozie Fluent Job ............................ SUCCESS [  1.432 s]
[INFO] Apache Oozie Fluent Job API ........................ SUCCESS [03:57 min]
[INFO] Apache Oozie Client ................................ SUCCESS [ 54.766 s]
[INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [ 54.476 s]
[INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [01:54 min]
[INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [  1.077 s]
[INFO] Apache Oozie Core .................................. SUCCESS [01:17 min]
[INFO] Apache Oozie Share Lib Streaming ................... SUCCESS [  3.926 s]
[INFO] Apache Oozie Share Lib Pig ......................... SUCCESS [ 20.455 s]
[INFO] Apache Oozie Share Lib Git ......................... SUCCESS [ 27.174 s]
[INFO] Apache Oozie Share Lib Hive ........................ SUCCESS [ 16.983 s]
[INFO] Apache Oozie Share Lib Hive 2 ...................... SUCCESS [  5.118 s]
[INFO] Apache Oozie Share Lib Sqoop ....................... SUCCESS [  2.575 s]
[INFO] Apache Oozie Examples .............................. SUCCESS [ 28.794 s]
[INFO] Apache Oozie Share Lib Spark ....................... SUCCESS [ 46.099 s]
[INFO] Apache Oozie Share Lib ............................. SUCCESS [ 50.426 s]
[INFO] Apache Oozie Docs .................................. SUCCESS [  5.787 s]
[INFO] Apache Oozie WebApp ................................ SUCCESS [  6.922 s]
[INFO] Apache Oozie Tools ................................. SUCCESS [  1.853 s]
[INFO] Apache Oozie MiniOozie ............................. SUCCESS [  1.952 s]
[INFO] Apache Oozie Fluent Job Client ..................... SUCCESS [  1.992 s]
[INFO] Apache Oozie Server ................................ SUCCESS [  7.648 s]
[INFO] Apache Oozie Distro ................................ FAILURE [  1.837 s]
[INFO] Apache Oozie ZooKeeper Security Tests .............. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  13:46 min
[INFO] Finished at: 2020-01-28T06:13:54+09:00
[INFO] ------------------------------------------------------------------------
[WARNING] The requested profile "hadoop-2" could not be activated because it does not exist.
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:3.1.0:single (default-cli) on project oozie-distro: Failed to create assembly: Error adding file to archive: /Users/a1101256/Downloads/oozie-5.2.0/distro/./../core/target/oozie-core-5.2.0-tests.jar -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:3.1.0:single (default-cli) on project oozie-distro: Failed to create assembly: Error adding file to archive: /Users/a1101256/Downloads/oozie-5.2.0/distro/./../core/target/oozie-core-5.2.0-tests.jar
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:215)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:956)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:288)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:192)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
Caused by: org.apache.maven.plugin.MojoExecutionException: Failed to create assembly: Error adding file to archive: /Users/a1101256/Downloads/oozie-5.2.0/distro/./../core/target/oozie-core-5.2.0-tests.jar
    at org.apache.maven.plugins.assembly.mojos.AbstractAssemblyMojo.execute (AbstractAssemblyMojo.java:532)
    at org.apache.maven.plugins.assembly.mojos.SingleAssemblyMojo.execute (SingleAssemblyMojo.java:61)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:137)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:210)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:956)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:288)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:192)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
Caused by: org.apache.maven.plugins.assembly.archive.ArchiveCreationException: Error adding file to archive: /Users/a1101256/Downloads/oozie-5.2.0/distro/./../core/target/oozie-core-5.2.0-tests.jar
    at org.apache.maven.plugins.assembly.archive.phase.FileItemAssemblyPhase.execute (FileItemAssemblyPhase.java:131)
    at org.apache.maven.plugins.assembly.archive.DefaultAssemblyArchiver.createArchive (DefaultAssemblyArchiver.java:181)
    at org.apache.maven.plugins.assembly.mojos.AbstractAssemblyMojo.execute (AbstractAssemblyMojo.java:478)
    at org.apache.maven.plugins.assembly.mojos.SingleAssemblyMojo.execute (SingleAssemblyMojo.java:61)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:137)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:210)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:956)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:288)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:192)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
Caused by: java.nio.file.NoSuchFileException: /Users/a1101256/Downloads/oozie-5.2.0/distro/./../core/target/oozie-core-5.2.0-tests.jar
    at sun.nio.fs.UnixException.translateToIOException (UnixException.java:86)
    at sun.nio.fs.UnixException.rethrowAsIOException (UnixException.java:102)
    at sun.nio.fs.UnixException.rethrowAsIOException (UnixException.java:107)
    at sun.nio.fs.UnixFileAttributeViews$Posix.readAttributes (UnixFileAttributeViews.java:218)
    at sun.nio.fs.UnixFileAttributeViews$Unix.readAttributes (UnixFileAttributeViews.java:345)
    at sun.nio.fs.AbstractFileSystemProvider.readAttributes (AbstractFileSystemProvider.java:92)
    at java.nio.file.Files.readAttributes (Files.java:1964)
    at org.codehaus.plexus.components.io.attributes.FileAttributes.<init> (FileAttributes.java:67)
    at org.codehaus.plexus.components.io.attributes.PlexusIoResourceAttributeUtils.getFileAttributesByPath (PlexusIoResourceAttributeUtils.java:203)
    at org.codehaus.plexus.components.io.attributes.PlexusIoResourceAttributeUtils.getFileAttributes (PlexusIoResourceAttributeUtils.java:165)
    at org.codehaus.plexus.components.io.resources.ResourceFactory.createResource (ResourceFactory.java:40)
    at org.apache.maven.plugins.assembly.archive.phase.FileItemAssemblyPhase.execute (FileItemAssemblyPhase.java:120)
    at org.apache.maven.plugins.assembly.archive.DefaultAssemblyArchiver.createArchive (DefaultAssemblyArchiver.java:181)
    at org.apache.maven.plugins.assembly.mojos.AbstractAssemblyMojo.execute (AbstractAssemblyMojo.java:478)
    at org.apache.maven.plugins.assembly.mojos.SingleAssemblyMojo.execute (SingleAssemblyMojo.java:61)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:137)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:210)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:956)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:288)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:192)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
[ERROR] 
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <args> -rf :oozie-distro

ERROR, Oozie distro creation failed

I have changed Maven version but it didn't work. I spent a whole night to make it work but other versions are also frustrating with so many errors(I did not think that it'll take that much time to just install a package). Any idea?


回答1:


I finally avoid the error by disabling test jar on distro.xml of oozie. So, the Dockerfile like

FROM bde2020/hadoop-base:2.0.0-hadoop2.7.4-java8

ENV MAVEN_VERSION 3.6.3
ENV OOZIE_VERSION 5.2.0

ARG PKG_HOME=/opt
ARG OOZIE_BUILD_HOME=$PKG_HOME/oozie-release-$OOZIE_VERSION
ARG MAVEN_URL=http://xenia.sote.hu/ftp/mirrors/www.apache.org/maven/maven-3/$MAVEN_VERSION/binaries/apache-maven-$MAVEN_VERSION-bin.tar.gz
ARG OOZIE_URL=https://github.com/apache/oozie/archive/release-$OOZIE_VERSION.tar.gz

ENV OOZIE_HOME $PKG_HOME/oozie-$OOZIE_VERSION
ENV PATH $PATH:$OOZIE_HOME/bin

RUN apt-get install -y --no-install-recommends \
    unzip

RUN set -x \
    && curl -fSL "$MAVEN_URL" -o /tmp/maven.tar.gz \
    && curl -fSL "$OOZIE_URL" -o /tmp/oozie.tar.gz \
    && tar -xvf /tmp/maven.tar.gz -C $PKG_HOME/ \
    && tar -xvf /tmp/oozie.tar.gz -C $PKG_HOME/ \
    && rm /tmp/*.tar.gz

COPY oozie/distro.xml $OOZIE_BUILD_HOME/src/main/assemblies/distro.xml

RUN export PATH=/opt/apache-maven-$MAVEN_VERSION/bin:$PATH \
    && cd $OOZIE_BUILD_HOME \
    && bin/mkdistro.sh assembly:single -P uber -Dmaven.test.skip=true -DskipTests -Dhadoop.version="2.7.4" -Dhive.version="2.1.1" \
    && mv $OOZIE_BUILD_HOME/distro/target/oozie-$OOZIE_VERSION-distro.tar.gz $PKG_HOME/ && cd $PKG_HOME && tar xfv oozie-$OOZIE_VERSION-distro.tar.gz && rm oozie-$OOZIE_VERSION-distro.tar.gz \
    && rm -fR $OOZIE_BUILD_HOME \
    && rm -fR $PKG_HOME/apache-maven-$MAVEN_VERSION \
    && rm -fR ~/.m2

RUN mkdir -p /var/log/oozie \
    && mkdir -p /var/lib/oozie/data \
    && ln -s /var/log/oozie $OOZIE_HOME/log \
    && ln -s /var/lib/oozie/data $OOZIE_HOME/data

RUN mkdir $OOZIE_HOME/libext \
    && curl http://archive.cloudera.com/gplextras/misc/ext-2.2.zip -o $OOZIE_HOME/libext/ext-2.2.zip

RUN cp /etc/hadoop/core-site.xml $OOZIE_HOME/conf/hadoop-conf/core-site.xml

COPY oozie/entrypoint.sh /usr/local/bin/
RUN chmod +x /usr/local/bin/entrypoint.sh

EXPOSE 11000 11001

ENTRYPOINT ["entrypoint.sh"]

And, I comment out Oozie core test jar part of distro.xml

        <!-- Oozie core test jar -->
<!--        <file>-->
<!--            <source>${basedir}/../core/target/oozie-core-${project.version}-tests.jar</source>-->
<!--            <outputDirectory>/oozie-core</outputDirectory>-->
<!--        </file>-->
        <!-- Oozie Documentation -->


来源:https://stackoverflow.com/questions/59940474/oozie-build-fail-failed-to-execute-goal-org-apache-maven-pluginsmaven-assembly

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!