Hadoop nightly build failure

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Hadoop nightly build failure

Hadoop Dev mailing list

init:
    [mkdir] Created dir: /tmp/hadoop-nightly/build
    [mkdir] Created dir: /tmp/hadoop-nightly/build/classes
    [mkdir] Created dir: /tmp/hadoop-nightly/build/src
    [mkdir] Created dir: /tmp/hadoop-nightly/build/webapps/task/WEB-INF
    [mkdir] Created dir: /tmp/hadoop-nightly/build/webapps/job/WEB-INF
    [mkdir] Created dir: /tmp/hadoop-nightly/build/webapps/dfs/WEB-INF
    [mkdir] Created dir: /tmp/hadoop-nightly/build/webapps/datanode/WEB-INF
    [mkdir] Created dir: /tmp/hadoop-nightly/build/examples
    [mkdir] Created dir: /tmp/hadoop-nightly/build/test
    [mkdir] Created dir: /tmp/hadoop-nightly/build/test/classes
    [mkdir] Created dir: /tmp/hadoop-nightly/build/test/testjar
     [copy] Copying 6 files to /tmp/hadoop-nightly/build/webapps
     [copy] Copying 5 files to /tmp/hadoop-nightly/conf
     [copy] Copying /tmp/hadoop-nightly/conf/slaves.template to /tmp/hadoop-nightly/conf/slaves
     [copy] Copying /tmp/hadoop-nightly/conf/hadoop-site.xml.template to /tmp/hadoop-nightly/conf/hadoop-site.xml
     [copy] Copying /tmp/hadoop-nightly/conf/mapred-default.xml.template to /tmp/hadoop-nightly/conf/mapred-default.xml
     [copy] Copying /tmp/hadoop-nightly/conf/masters.template to /tmp/hadoop-nightly/conf/masters
     [copy] Copying /tmp/hadoop-nightly/conf/hadoop-env.sh.template to /tmp/hadoop-nightly/conf/hadoop-env.sh
     [copy] Copying 1 file to /tmp/hadoop-nightly/src/contrib
     [copy] Copying /tmp/hadoop-nightly/src/contrib/ec2/bin/hadoop-ec2-env.sh.template to /tmp/hadoop-nightly/src/contrib/ec2/bin/hadoop-ec2-env.sh
     [exec] src/saveVersion.sh: svn: not found
     [exec] src/saveVersion.sh: svn: not found
     [exec] src/saveVersion.sh: whoami: not found

record-parser:

compile-rcc-compiler:
    [javac] Compiling 25 source files to /tmp/hadoop-nightly/build/classes
    [javac] Note: /tmp/hadoop-nightly/src/java/org/apache/hadoop/record/compiler/generated/Rcc.java uses unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.

compile-core-classes:
    [javac] Compiling 275 source files to /tmp/hadoop-nightly/build/classes
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.

compile-core-native:

compile-core:

compile-examples:
    [javac] Compiling 6 source files to /tmp/hadoop-nightly/build/examples
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.

generate-test-records:

compile-core-test:
    [javac] Compiling 5 source files to /tmp/hadoop-nightly/build/test/classes
    [javac] Note: /tmp/hadoop-nightly/build/test/src/org/apache/hadoop/record/test/RecRecord1.java uses unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.
    [javac] Compiling 74 source files to /tmp/hadoop-nightly/build/test/classes
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.
    [javac] Compiling 3 source files to /tmp/hadoop-nightly/build/test/testjar
      [jar] Building jar: /tmp/hadoop-nightly/build/test/testjar/testjob.jar
      [jar] Building jar: /tmp/hadoop-nightly/build/hadoop-nightly-test.jar
    [mkdir] Created dir: /tmp/hadoop-nightly/build/test/cache
     [copy] Copying 1 file to /tmp/hadoop-nightly/build/test/cache
     [copy] Copying 1 file to /tmp/hadoop-nightly/build/test/cache
     [copy] Copying 1 file to /tmp/hadoop-nightly/build/test/cache

test-core:
    [mkdir] Created dir: /tmp/hadoop-nightly/build/test/data
    [mkdir] Created dir: /tmp/hadoop-nightly/build/test/logs
    [junit] Running org.apache.hadoop.conf.TestConfiguration
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.567 sec
    [junit] Running org.apache.hadoop.dfs.TestCheckpoint
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 101.886 sec
    [junit] Test org.apache.hadoop.dfs.TestCheckpoint FAILED
    [junit] Running org.apache.hadoop.dfs.TestDFSMkdirs
    [junit] Data node crashed:
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 101.314 sec
    [junit] java.lang.NullPointerException
    [junit] at org.apache.hadoop.ipc.Client$Connection.sendParam(Client.java:306)
    [junit] at org.apache.hadoop.ipc.Client.call(Client.java:457)
    [junit] at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:164)
    [junit] at org.apache.hadoop.dfs.$Proxy0.getProtocolVersion(Unknown Source)
    [junit] at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:248)
    [junit] at org.apache.hadoop.ipc.RPC.waitForProxy(RPC.java:227)
    [junit] at org.apache.hadoop.dfs.DataNode.<init>(DataNode.java:254)
    [junit] at org.apache.hadoop.dfs.DataNode.<init>(DataNode.java:197)
    [junit] at org.apache.hadoop.dfs.MiniDFSCluster$DataNodeRunner.run(MiniDFSCluster.java:124)
    [junit] at java.lang.Thread.run(Thread.java:595)
    [junit] Test org.apache.hadoop.dfs.TestDFSMkdirs FAILED
    [junit] Running org.apache.hadoop.dfs.TestDFSShell
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 101.318 sec
    [junit] Test org.apache.hadoop.dfs.TestDFSShell FAILED
    [junit] Running org.apache.hadoop.dfs.TestDFSShellGenericOptions
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 101.321 sec
    [junit] Test org.apache.hadoop.dfs.TestDFSShellGenericOptions FAILED
    [junit] Running org.apache.hadoop.dfs.TestDecommission
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 101.324 sec
    [junit] Test org.apache.hadoop.dfs.TestDecommission FAILED
    [junit] Running org.apache.hadoop.dfs.TestFileCorruption
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 101.326 sec
    [junit] Test org.apache.hadoop.dfs.TestFileCorruption FAILED
    [junit] Running org.apache.hadoop.dfs.TestFsck
    [junit] Tests run: 2, Failures: 0, Errors: 2, Time elapsed: 202.274 sec
    [junit] Test org.apache.hadoop.dfs.TestFsck FAILED
    [junit] Running org.apache.hadoop.dfs.TestLocalDFS
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 101.379 sec
    [junit] Test org.apache.hadoop.dfs.TestLocalDFS FAILED
    [junit] Running org.apache.hadoop.dfs.TestPread
    [junit] Tests run: 2, Failures: 0, Errors: 1, Time elapsed: 101.737 sec
    [junit] Test org.apache.hadoop.dfs.TestPread FAILED
    [junit] Running org.apache.hadoop.dfs.TestReplication
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 101.427 sec
    [junit] Test org.apache.hadoop.dfs.TestReplication FAILED
    [junit] Running org.apache.hadoop.dfs.TestReplicationPolicy
    [junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 0.051 sec
    [junit] Running org.apache.hadoop.dfs.TestRestartDFS
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 101.171 sec
    [junit] Test org.apache.hadoop.dfs.TestRestartDFS FAILED
    [junit] Running org.apache.hadoop.dfs.TestSeekBug
    [junit] Tests run: 2, Failures: 0, Errors: 1, Time elapsed: 101.905 sec
    [junit] Test org.apache.hadoop.dfs.TestSeekBug FAILED
    [junit] Running org.apache.hadoop.dfs.TestSmallBlock
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 101.494 sec
    [junit] Test org.apache.hadoop.dfs.TestSmallBlock FAILED
    [junit] Running org.apache.hadoop.fs.TestCopyFiles
    [junit] Tests run: 4, Failures: 0, Errors: 3, Time elapsed: 305.553 sec
    [junit] Test org.apache.hadoop.fs.TestCopyFiles FAILED
    [junit] Running org.apache.hadoop.fs.TestDFSIO
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 7.457 sec
    [junit] Running org.apache.hadoop.fs.TestFileSystem
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.213 sec
    [junit] Running org.apache.hadoop.fs.TestGlobPaths
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 101.429 sec
    [junit] Test org.apache.hadoop.fs.TestGlobPaths FAILED
    [junit] Running org.apache.hadoop.fs.TestLocalFileSystem
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.417 sec
    [junit] Running org.apache.hadoop.fs.TestPath
    [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 0.027 sec
    [junit] Running org.apache.hadoop.fs.s3.TestINode
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.011 sec
    [junit] Running org.apache.hadoop.fs.s3.TestInMemoryS3FileSystem
    [junit] Tests run: 22, Failures: 0, Errors: 0, Time elapsed: 1.047 sec
    [junit] Running org.apache.hadoop.io.TestArrayFile
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 3.873 sec
    [junit] Running org.apache.hadoop.io.TestBytesWritable
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.015 sec
    [junit] Running org.apache.hadoop.io.TestMD5Hash
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.292 sec
    [junit] Running org.apache.hadoop.io.TestSequenceFile
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 18.66 sec
    [junit] Running org.apache.hadoop.io.TestSetFile
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 4.323 sec
    [junit] Running org.apache.hadoop.io.TestText
    [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 0.893 sec
    [junit] Running org.apache.hadoop.io.TestTextNonUTF8
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.019 sec
    [junit] Running org.apache.hadoop.io.TestUTF8
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.27 sec
    [junit] Running org.apache.hadoop.io.TestVersionedWritable
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.031 sec
    [junit] Running org.apache.hadoop.io.TestWritable
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.012 sec
    [junit] Running org.apache.hadoop.io.compress.TestCodec
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.7 sec
    [junit] Running org.apache.hadoop.io.compress.TestCodecFactory
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.395 sec
    [junit] Running org.apache.hadoop.ipc.TestIPC
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.646 sec
    [junit] Running org.apache.hadoop.ipc.TestRPC
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.162 sec
    [junit] Running org.apache.hadoop.mapred.TestEmptyJobWithDFS
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 101.127 sec
    [junit] Test org.apache.hadoop.mapred.TestEmptyJobWithDFS FAILED
    [junit] Running org.apache.hadoop.mapred.TestMapRed
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 20.343 sec
    [junit] Running org.apache.hadoop.mapred.TestMiniMRBringup
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.868 sec
    [junit] Running org.apache.hadoop.mapred.TestMiniMRClasspath
    [junit] Tests run: 2, Failures: 0, Errors: 2, Time elapsed: 202.179 sec
    [junit] Test org.apache.hadoop.mapred.TestMiniMRClasspath FAILED
    [junit] Running org.apache.hadoop.mapred.TestMiniMRDFSCaching
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 102.047 sec
    [junit] Test org.apache.hadoop.mapred.TestMiniMRDFSCaching FAILED
    [junit] Running org.apache.hadoop.mapred.TestMiniMRLocalFS
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 98.853 sec
    [junit] Running org.apache.hadoop.mapred.TestMiniMRWithDFS
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 102.387 sec
    [junit] Test org.apache.hadoop.mapred.TestMiniMRWithDFS FAILED
    [junit] Running org.apache.hadoop.mapred.TestSequenceFileInputFilter
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 12.885 sec
    [junit] Running org.apache.hadoop.mapred.TestSequenceFileInputFormat
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 8.764 sec
    [junit] Running org.apache.hadoop.mapred.TestTextInputFormat
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 6.675 sec
    [junit] Running org.apache.hadoop.mapred.jobcontrol.TestJobControl
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 98.304 sec
    [junit] Running org.apache.hadoop.net.TestNetworkTopology
    [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.027 sec
    [junit] Running org.apache.hadoop.record.test.TestMapRed
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 4.651 sec
    [junit] Running org.apache.hadoop.record.test.TestRecordIO
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.355 sec
    [junit] Running org.apache.hadoop.record.test.TestWritable
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 4.365 sec

BUILD FAILED
/tmp/hadoop-nightly/build.xml:452: Tests failed!

Total time: 44 minutes 54 seconds


Reply | Threaded
Open this post in threaded view
|

Re: Hadoop nightly build failure

Andrzej Białecki-2
[hidden email] wrote:
> init:
>     [mkdir] Created dir: /tmp/hadoop-nightly/build
>  


Does anyone know the reason for these failures? Since this code is still
basically the same as in 0.11.2 release, I'm somewhat reluctant to
upgrade my application to that release fearing that it would suffer from
the same issues ...

--
Best regards,
Andrzej Bialecki     <><
 ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com


Reply | Threaded
Open this post in threaded view
|

Re: Hadoop nightly build failure

Doug Cutting
Andrzej Bialecki wrote:
> [hidden email] wrote:
>> init:
>>     [mkdir] Created dir: /tmp/hadoop-nightly/build
>
> Does anyone know the reason for these failures? Since this code is still
> basically the same as in 0.11.2 release, I'm somewhat reluctant to
> upgrade my application to that release fearing that it would suffer from
> the same issues ...

Unit tests have been unreliable for a while now.  They fail in different
tests, usually due to timeouts.

Also, trunk has diverged from 0.11.2.

I think 0.11.2 is stable in real use, that these problems are confined
to unit tests.

Doug