git - Compilation Error when building Giraph -
i trying build giraph. have following: java version "1.7.0_25", apache maven 3.0.4, hadoop 1.0.4. following instruction in page: https://cwiki.apache.org/confluence/display/giraph/quick+start+guide
when run: mvn compile , following error:
[info] scanning projects... [info] ------------------------------------------------------------------------ [info] reactor build order: [info] [info] apache giraph parent [info] apache giraph core [info] apache giraph examples [info] apache giraph accumulo i/o [info] apache giraph hbase i/o [info] apache giraph hcatalog i/o [info] apache giraph hive i/o [info] apache giraph rexster i/o [info] [info] ------------------------------------------------------------------------ [info] building apache giraph parent 1.1.0-snapshot [info] ------------------------------------------------------------------------ [info] [info] --- mavanagaiata:0.5.0:branch (git-commit) @ giraph-parent --- [info] [info] --- mavanagaiata:0.5.0:commit (git-commit) @ giraph-parent --- [info] [info] ------------------------------------------------------------------------ [info] building apache giraph core 1.1.0-snapshot [info] ------------------------------------------------------------------------ [info] [info] --- mavanagaiata:0.5.0:branch (git-commit) @ giraph-core --- [info] [info] --- mavanagaiata:0.5.0:commit (git-commit) @ giraph-core --- [info] [info] --- maven-enforcer-plugin:1.0.1:enforce (enforce-maven) @ giraph-core --- [info] [info] --- munge-maven-plugin:1.0:munge (munge) @ giraph-core --- [info] [info] --- maven-resources-plugin:2.3:resources (default-resources) @ giraph-core --- [info] using 'utf-8' encoding copy filtered resources. [info] copying 1 resource [info] [info] --- maven-compiler-plugin:3.0:compile (default-compile) @ giraph-core --- [info] changes detected - recompiling module! [info] compiling 532 source files /home/tom/giraph/giraph-core/target/munged/classes [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/utils/unsafebytearrayinputstream.java:[34,32] sun.misc.unsafe internal proprietary api , may removed in future release [warning] /home/tom/giraph/giraph- core/target/munged/main/org/apache/giraph/utils/unsafebytearrayinputstream.java:[37,29] sun.misc.unsafe internal proprietary api , may removed in future release [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/utils/unsafebytearrayinputstream.java:[39,25] sun.misc.unsafe internal proprietary api , may removed in future release [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/utils/unsafebytearrayoutputstream.java:[33,29] sun.misc.unsafe internal proprietary api , may removed in future release [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/utils/unsafebytearrayoutputstream.java:[35,25] sun.misc.unsafe internal proprietary api , may removed in future release [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/utils/unsafebytearrayoutputstream.java:[66,32] sun.misc.unsafe internal proprietary api , may removed in future release [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/master/bspservicemaster.java: input files use or override deprecated api. [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/master/bspservicemaster.java: recompile -xlint:deprecation details. [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/metrics/giraphmetricsregistry.java: input files use unchecked or unsafe operations. [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/metrics/giraphmetricsregistry.java: recompile -xlint:unchecked details. [info] [info] --- maven-assembly-plugin:2.4:single (build-fat-jar) @ giraph-core --- [info] building jar: /home/tom/giraph/giraph-core/target/giraph-1.1.0-snapshot-for-hadoop-0.20.203.0-jar-with-dependencies.jar [info] [info] --- maven-antrun-plugin:1.6:run (default) @ giraph-core --- [info] executing tasks main: [java] java.lang.noclassdeffounderror: org/apache/hadoop/io/writable [java] @ org.apache.tools.ant.taskdefs.executejava.execute(executejava.java:194) [java] @ org.apache.tools.ant.taskdefs.java.run(java.java:771) [java] @ org.apache.tools.ant.taskdefs.java.executejava(java.java:221) [java] @ org.apache.tools.ant.taskdefs.java.executejava(java.java:135) [java] @ org.apache.tools.ant.taskdefs.java.execute(java.java:108) [java] @ org.apache.tools.ant.unknownelement.execute(unknownelement.java:291) [java] @ sun.reflect.nativemethodaccessorimpl.invoke0(native method) [java] @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:57) [java] @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43) [java] @ java.lang.reflect.method.invoke(method.java:606) [java] @ org.apache.tools.ant.dispatch.dispatchutils.execute(dispatchutils.java:106) [java] @ org.apache.tools.ant.task.perform(task.java:348) [java] @ org.apache.tools.ant.target.execute(target.java:390) [java] @ org.apache.tools.ant.target.performtasks(target.java:411) [java] @ org.apache.tools.ant.project.executesortedtargets(project.java:1397) [java] @ org.apache.tools.ant.project.executetarget(project.java:1366) [java] @ org.apache.maven.plugin.antrun.antrunmojo.execute(antrunmojo.java:270) [java] @ org.apache.maven.plugin.defaultbuildpluginmanager.executemojo(defaultbuildpluginmanager.java:101) [java] @ org.apache.maven.lifecycle.internal.mojoexecutor.execute(mojoexecutor.java:209) [java] @ org.apache.maven.lifecycle.internal.mojoexecutor.execute(mojoexecutor.java:153) [java] @ org.apache.maven.lifecycle.internal.mojoexecutor.execute(mojoexecutor.java:145) [java] @ org.apache.maven.lifecycle.internal.lifecyclemodulebuilder.buildproject(lifecyclemodulebuilder.java:84) [java] @ org.apache.maven.lifecycle.internal.lifecyclemodulebuilder.buildproject(lifecyclemodulebuilder.java:59) [java] @ org.apache.maven.lifecycle.internal.lifecyclestarter.singlethreadedbuild(lifecyclestarter.java:183) [java] @ org.apache.maven.lifecycle.internal.lifecyclestarter.execute(lifecyclestarter.java:161) [java] @ org.apache.maven.defaultmaven.doexecute(defaultmaven.java:320) [java] @ org.apache.maven.defaultmaven.execute(defaultmaven.java:156) [java] @ org.apache.maven.cli.mavencli.execute(mavencli.java:537) [java] @ org.apache.maven.cli.mavencli.domain(mavencli.java:196) [java] @ org.apache.maven.cli.mavencli.main(mavencli.java:141) [java] @ sun.reflect.nativemethodaccessorimpl.invoke0(native method) [java] @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:57) [java] @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43) [java] @ java.lang.reflect.method.invoke(method.java:606) [java] @ org.codehaus.plexus.classworlds.launcher.launcher.launchenhanced(launcher.java:290) [java] @ org.codehaus.plexus.classworlds.launcher.launcher.launch(launcher.java:230) [java] @ org.codehaus.plexus.classworlds.launcher.launcher.mainwithexitcode(launcher.java:409) [java] @ org.codehaus.plexus.classworlds.launcher.launcher.main(launcher.java:352) [java] caused by: java.lang.noclassdeffounderror: org/apache/hadoop/io/writable [java] @ java.lang.classloader.defineclass1(native method) [java] @ java.lang.classloader.defineclass(classloader.java:792) [java] @ org.apache.tools.ant.antclassloader.defineclassfromdata(antclassloader.java:1124) [java] @ org.apache.tools.ant.antclassloader.getclassfromstream(antclassloader.java:1295) [java] @ org.apache.tools.ant.antclassloader.findclassincomponents(antclassloader.java:1351) [java] @ org.apache.tools.ant.antclassloader.findclass(antclassloader.java:1311) [java] @ org.apache.tools.ant.antclassloader.loadclass(antclassloader.java:1070) [java] @ java.lang.classloader.loadclass(classloader.java:357) [java] @ java.lang.classloader.defineclass1(native method) [java] @ java.lang.classloader.defineclass(classloader.java:792) [java] @ org.apache.tools.ant.antclassloader.defineclassfromdata(antclassloader.java:1124) [java] @ org.apache.tools.ant.antclassloader.getclassfromstream(antclassloader.java:1295) [java] @ org.apache.tools.ant.antclassloader.findclassincomponents(antclassloader.java:1351) [java] @ org.apache.tools.ant.antclassloader.findclass(antclassloader.java:1311) [java] @ org.apache.tools.ant.antclassloader.loadclass(antclassloader.java:1070) [java] @ java.lang.classloader.loadclass(classloader.java:357) [java] @ java.lang.classloader.defineclass1(native method) [java] @ java.lang.classloader.defineclass(classloader.java:792) [java] @ org.apache.tools.ant.antclassloader.defineclassfromdata(antclassloader.java:1124) [java] @ org.apache.tools.ant.antclassloader.getclassfromstream(antclassloader.java:1295) [java] @ org.apache.tools.ant.antclassloader.findclassincomponents(antclassloader.java:1351) [java] @ org.apache.tools.ant.antclassloader.findclass(antclassloader.java:1311) [java] @ org.apache.tools.ant.antclassloader.loadclass(antclassloader.java:1070) [java] @ java.lang.classloader.loadclass(classloader.java:357) [java] @ org.apache.giraph.conf.giraphconstants.<clinit>(giraphconstants.java:129) [java] @ org.apache.giraph.conf.alloptions.main(alloptions.java:153) [java] @ sun.reflect.nativemethodaccessorimpl.invoke0(native method) [java] @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:57) [java] @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43) [java] @ java.lang.reflect.method.invoke(method.java:606) [java] @ org.apache.tools.ant.taskdefs.executejava.run(executejava.java:217) [java] @ org.apache.tools.ant.taskdefs.executejava.execute(executejava.java:152) [java] ... 37 more [java] caused by: java.lang.classnotfoundexception: org.apache.hadoop.io.writable [java] @ org.apache.tools.ant.antclassloader.findclassincomponents(antclassloader.java:1361) [java] @ org.apache.tools.ant.antclassloader.findclass(antclassloader.java:1311) [java] @ org.apache.tools.ant.antclassloader.loadclass(antclassloader.java:1070) [java] @ java.lang.classloader.loadclass(classloader.java:357) [java] ... 69 more [java] java result: -1 [info] executed tasks [info] [info] ------------------------------------------------------------------------ [info] building apache giraph examples 1.1.0-snapshot [info] ------------------------------------------------------------------------ [info] ------------------------------------------------------------------------ [info] reactor summary: [info] [info] apache giraph parent .............................. success [1.604s] [info] apache giraph core ................................ success [38.503s] [info] apache giraph examples ............................ failure [0.095s] [info] apache giraph accumulo i/o ........................ skipped [info] apache giraph hbase i/o ........................... skipped [info] apache giraph hcatalog i/o ........................ skipped [info] apache giraph hive i/o ............................ skipped [info] apache giraph rexster i/o ......................... skipped [info] ------------------------------------------------------------------------ [info] build failure [info] ------------------------------------------------------------------------ [info] total time: 41.175s [info] finished at: tue aug 06 11:02:24 pdt 2013 [info] final memory: 46m/439m [info] ------------------------------------------------------------------------ [error] failed execute goal on project giraph-examples: not resolve dependencies project org.apache.giraph:giraph-examples:jar:1.1.0-snapshot: failure find org.apache.giraph:giraph-core:jar:tests:1.1.0-snapshot in http://repo1.maven.org/maven2 cached in local repository, resolution not reattempted until update interval of central has elapsed or updates forced -> [help 1] [error] [error] see full stack trace of errors, re-run maven -e switch. [error] re-run maven using -x switch enable full debug logging. [error] [error] more information errors , possible solutions, please read following articles: [error] [help 1] http://cwiki.apache.org/confluence/display/maven/dependencyresolutionexception [error] [error] after correcting problems, can resume build command [error] mvn <goals> -rf :giraph-examples i tried run mvn –phadoop_non_secure compile, following error:
[info] scanning projects... [info] ------------------------------------------------------------------------ [info] reactor build order: [info] [info] apache giraph parent [info] apache giraph core [info] apache giraph examples [info] apache giraph accumulo i/o [info] apache giraph hbase i/o [info] apache giraph hcatalog i/o [info] [info] ------------------------------------------------------------------------ [info] building apache giraph parent 1.1.0-snapshot [info] ------------------------------------------------------------------------ [info] [info] --- mavanagaiata:0.5.0:branch (git-commit) @ giraph-parent --- [info] [info] --- mavanagaiata:0.5.0:commit (git-commit) @ giraph-parent --- [info] [info] ------------------------------------------------------------------------ [info] building apache giraph core 1.1.0-snapshot [info] ------------------------------------------------------------------------ [info] [info] --- mavanagaiata:0.5.0:branch (git-commit) @ giraph-core --- [info] [info] --- mavanagaiata:0.5.0:commit (git-commit) @ giraph-core --- [info] [info] --- maven-enforcer-plugin:1.0.1:enforce (enforce-maven) @ giraph-core --- [info] [info] --- munge-maven-plugin:1.0:munge (munge) @ giraph-core --- [info] [info] --- maven-resources-plugin:2.3:resources (default-resources) @ giraph-core --- [info] using 'utf-8' encoding copy filtered resources. [info] copying 1 resource [info] [info] --- maven-compiler-plugin:3.0:compile (default-compile) @ giraph-core --- [info] changes detected - recompiling module! [info] compiling 525 source files /home/tom/giraph/giraph-core/target/munged/classes [info] ------------------------------------------------------------- [warning] compilation warning : [info] ------------------------------------------------------------- [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/utils/unsafebytearrayinputstream.java:[34,32] sun.misc.unsafe internal proprietary api , may removed in future release [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/utils/unsafebytearrayinputstream.java:[37,29] sun.misc.unsafe internal proprietary api , may removed in future release [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/utils/unsafebytearrayinputstream.java:[39,25] sun.misc.unsafe internal proprietary api , may removed in future release [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/utils/unsafebytearrayoutputstream.java:[33,29] sun.misc.unsafe internal proprietary api , may removed in future release [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/utils/unsafebytearrayoutputstream.java:[35,25] sun.misc.unsafe internal proprietary api , may removed in future release [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/utils/unsafebytearrayoutputstream.java:[66,32] sun.misc.unsafe internal proprietary api , may removed in future release [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/master/bspservicemaster.java: /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/master/bspservicemaster.java uses or overrides deprecated api. [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/master/bspservicemaster.java: recompile -xlint:deprecation details. [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/metrics/giraphmetricsregistry.java: input files use unchecked or unsafe operations. [warning] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/metrics/giraphmetricsregistry.java: recompile -xlint:unchecked details. [info] 10 warnings [info] ------------------------------------------------------------- [info] ------------------------------------------------------------- [error] compilation error : [info] ------------------------------------------------------------- [error] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/io/formats/graphvizoutputformat.java:[30,35] cannot find symbol symbol: class jobstatus location: package org.apache.hadoop.mapreduce [error] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/io/formats/graphvizoutputformat.java:[187,68] package jobstatus not exist [error] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/io/formats/graphvizoutputformat.java:[187,5] method not override or implement method supertype [error] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/io/formats/graphvizoutputformat.java:[204,15] cannot find symbol symbol: method commitjob(org.apache.hadoop.mapreduce.jobcontext) location: variable delegate of type org.apache.hadoop.mapreduce.outputcommitter [error] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/io/formats/graphvizoutputformat.java:[202,5] method not override or implement method supertype [info] 5 errors [info] ------------------------------------------------------------- [info] ------------------------------------------------------------------------ [info] reactor summary: [info] [info] apache giraph parent .............................. success [1.637s] [info] apache giraph core ................................ failure [12.114s] [info] apache giraph examples ............................ skipped [info] apache giraph accumulo i/o ........................ skipped [info] apache giraph hbase i/o ........................... skipped [info] apache giraph hcatalog i/o ........................ skipped [info] ------------------------------------------------------------------------ [info] build failure [info] ------------------------------------------------------------------------ [info] total time: 14.567s [info] finished at: tue aug 06 11:06:34 pdt 2013 [info] final memory: 28m/409m [info] ------------------------------------------------------------------------ [error] failed execute goal org.apache.maven.plugins:maven-compiler-plugin:3.0:compile (default-compile) on project giraph-core: compilation failure: compilation failure: [error] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/io/formats/graphvizoutputformat.java:[30,35] cannot find symbol [error] symbol: class jobstatus [error] location: package org.apache.hadoop.mapreduce [error] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/io/formats/graphvizoutputformat.java:[187,68] package jobstatus not exist [error] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/io/formats/graphvizoutputformat.java:[187,5] method not override or implement method supertype [error] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/io/formats/graphvizoutputformat.java:[204,15] cannot find symbol [error] symbol: method commitjob(org.apache.hadoop.mapreduce.jobcontext) [error] location: variable delegate of type org.apache.hadoop.mapreduce.outputcommitter [error] /home/tom/giraph/giraph-core/target/munged/main/org/apache/giraph/io/formats/graphvizoutputformat.java:[202,5] method not override or implement method supertype [error] -> [help 1] [error] [error] see full stack trace of errors, re-run maven -e switch. [error] re-run maven using -x switch enable full debug logging. [error] [error] more information errors , possible solutions, please read following articles: [error] [help 1] http://cwiki.apache.org/confluence/display/maven/mojofailureexception [error] [error] after correcting problems, can resume build command [error] mvn <goals> -rf :giraph-core i have tried online source repository still getting same error. can please me resolve issue?
what should add path , classpath?
i guess trying build giraph-1.1.0-snapshot, not yet released. it's git snapshot, may fail anywhere. suggest use giraph 1.0.0, far more stable.
Comments
Post a Comment