Build failed in Hudson: Nutch-Nightly #123

classic Classic list List threaded Threaded
11 messages Options
Reply | Threaded
Open this post in threaded view
|

Build failed in Hudson: Nutch-Nightly #123

hudson-6
See http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/123/changes

------------------------------------------
[...truncated 5950 lines...]

init-plugin:

deps-jar:

compile:
     [echo] Compiling plugin: lib-regex-filter

jar:

init:

init-plugin:

deps-jar:

compile:
     [echo] Compiling plugin: lib-regex-filter

compile-test:

compile:
     [echo] Compiling plugin: urlfilter-automaton
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.585 sec
Overriding previous definition of reference to plugin.deps

init:
Overriding previous definition of reference to plugin.deps

init-plugin:

deps-jar:

init:

init-plugin:

deps-jar:

compile:
     [echo] Compiling plugin: lib-regex-filter

jar:

init:

init-plugin:

deps-jar:

compile:
     [echo] Compiling plugin: lib-regex-filter

compile-test:

compile:
     [echo] Compiling plugin: urlfilter-regex

compile-test:

compile-test:
    [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlfilter-automaton/test 
    [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlfilter-regex/test 

jar:

deps-test:

init:

init-plugin:

deps-jar:

compile:
     [echo] Compiling plugin: lib-regex-filter

jar:

jar:

deps-test:

deps-test:

deploy:

init:

copy-generated-lib:

deploy:

init-plugin:

deps-jar:

compile:
     [echo] Compiling plugin: lib-regex-filter
Overriding previous definition of reference to plugin.deps

jar:

copy-generated-lib:

deps-test:

deploy:

test:
     [echo] Testing plugin: urlfilter-automaton
    [junit] Running org.apache.nutch.urlfilter.automaton.TestAutomatonURLFilter

copy-generated-lib:

deploy:
Overriding previous definition of reference to plugin.deps

copy-generated-lib:

test:
     [echo] Testing plugin: urlfilter-regex
    [junit] Running org.apache.nutch.urlfilter.regex.TestRegexURLFilter
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.812 sec

init:

init-plugin:

deps-jar:

compile:
     [echo] Compiling plugin: urlfilter-suffix

compile-test:
    [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlfilter-suffix/test 

jar:

deps-test:

deploy:

copy-generated-lib:

test:
     [echo] Testing plugin: urlfilter-suffix
    [junit] Running org.apache.nutch.urlfilter.suffix.TestSuffixURLFilter
    [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.174 sec

init:

init-plugin:

deps-jar:

compile:
     [echo] Compiling plugin: urlnormalizer-basic

compile-test:
    [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlnormalizer-basic/test 

jar:

deps-test:

deploy:

copy-generated-lib:

test:
     [echo] Testing plugin: urlnormalizer-basic
    [junit] Running org.apache.nutch.net.urlnormalizer.basic.TestBasicURLNormalizer
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.024 sec

init:

init-plugin:

deps-jar:

compile:
     [echo] Compiling plugin: urlnormalizer-pass

compile-test:
    [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlnormalizer-pass/test 

jar:

deps-test:

deploy:

copy-generated-lib:

test:
     [echo] Testing plugin: urlnormalizer-pass
    [junit] Running org.apache.nutch.net.urlnormalizer.pass.TestPassURLNormalizer
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.15 sec

init:

init-plugin:

deps-jar:

compile:
     [echo] Compiling plugin: urlnormalizer-regex

compile-test:
    [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlnormalizer-regex/test 
    [javac] Note: http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/src/plugin/urlnormalizer-regex/src/test/org/apache/nutch/net/urlnormalizer/regex/TestRegexURLNormalizer.java  uses unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.

jar:

deps-test:

init:

init-plugin:

compile:

jar:

deps-test:

deploy:

copy-generated-lib:

deploy:

copy-generated-lib:

test:
     [echo] Testing plugin: urlnormalizer-regex
    [junit] Running org.apache.nutch.net.urlnormalizer.regex.TestRegexURLNormalizer
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.016 sec
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 7.454 sec

BUILD FAILED
http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build.xml :302: The following error occurred while executing this line:
http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/src/plugin/build.xml :98: The following error occurred while executing this line:
http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/src/plugin/build-plugin.xml :200: Tests failed!

Total time: 4 minutes 23 seconds
Publishing Javadoc
Recording test results

Reply | Threaded
Open this post in threaded view
|

Re: Build failed in Hudson: Nutch-Nightly #123

Doğacan Güney-3
On 6/20/07, [hidden email]
<[hidden email]> wrote:

> See http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/123/changes
>
> ------------------------------------------
> [...truncated 5950 lines...]
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: lib-regex-filter
>
> jar:
>
> init:
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: lib-regex-filter
>
> compile-test:
>
> compile:
>      [echo] Compiling plugin: urlfilter-automaton
>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.585 sec
> Overriding previous definition of reference to plugin.deps
>
> init:
> Overriding previous definition of reference to plugin.deps
>
> init-plugin:
>
> deps-jar:
>
> init:
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: lib-regex-filter
>
> jar:
>
> init:
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: lib-regex-filter
>
> compile-test:
>
> compile:
>      [echo] Compiling plugin: urlfilter-regex
>
> compile-test:
>
> compile-test:
>     [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlfilter-automaton/test
>     [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlfilter-regex/test
>
> jar:
>
> deps-test:
>
> init:
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: lib-regex-filter
>
> jar:
>
> jar:
>
> deps-test:
>
> deps-test:
>
> deploy:
>
> init:
>
> copy-generated-lib:
>
> deploy:
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: lib-regex-filter
> Overriding previous definition of reference to plugin.deps
>
> jar:
>
> copy-generated-lib:
>
> deps-test:
>
> deploy:
>
> test:
>      [echo] Testing plugin: urlfilter-automaton
>     [junit] Running org.apache.nutch.urlfilter.automaton.TestAutomatonURLFilter
>
> copy-generated-lib:
>
> deploy:
> Overriding previous definition of reference to plugin.deps
>
> copy-generated-lib:
>
> test:
>      [echo] Testing plugin: urlfilter-regex
>     [junit] Running org.apache.nutch.urlfilter.regex.TestRegexURLFilter
>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.812 sec
>
> init:
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: urlfilter-suffix
>
> compile-test:
>     [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlfilter-suffix/test
>
> jar:
>
> deps-test:
>
> deploy:
>
> copy-generated-lib:
>
> test:
>      [echo] Testing plugin: urlfilter-suffix
>     [junit] Running org.apache.nutch.urlfilter.suffix.TestSuffixURLFilter
>     [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.174 sec
>
> init:
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: urlnormalizer-basic
>
> compile-test:
>     [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlnormalizer-basic/test
>
> jar:
>
> deps-test:
>
> deploy:
>
> copy-generated-lib:
>
> test:
>      [echo] Testing plugin: urlnormalizer-basic
>     [junit] Running org.apache.nutch.net.urlnormalizer.basic.TestBasicURLNormalizer
>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.024 sec
>
> init:
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: urlnormalizer-pass
>
> compile-test:
>     [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlnormalizer-pass/test
>
> jar:
>
> deps-test:
>
> deploy:
>
> copy-generated-lib:
>
> test:
>      [echo] Testing plugin: urlnormalizer-pass
>     [junit] Running org.apache.nutch.net.urlnormalizer.pass.TestPassURLNormalizer
>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.15 sec
>
> init:
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: urlnormalizer-regex
>
> compile-test:
>     [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlnormalizer-regex/test
>     [javac] Note: http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/src/plugin/urlnormalizer-regex/src/test/org/apache/nutch/net/urlnormalizer/regex/TestRegexURLNormalizer.java  uses unchecked or unsafe operations.
>     [javac] Note: Recompile with -Xlint:unchecked for details.
>
> jar:
>
> deps-test:
>
> init:
>
> init-plugin:
>
> compile:
>
> jar:
>
> deps-test:
>
> deploy:
>
> copy-generated-lib:
>
> deploy:
>
> copy-generated-lib:
>
> test:
>      [echo] Testing plugin: urlnormalizer-regex
>     [junit] Running org.apache.nutch.net.urlnormalizer.regex.TestRegexURLNormalizer
>     [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.016 sec
>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 7.454 sec
>
> BUILD FAILED
> http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build.xml :302: The following error occurred while executing this line:
> http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/src/plugin/build.xml :98: The following error occurred while executing this line:
> http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/src/plugin/build-plugin.xml :200: Tests failed!
>
> Total time: 4 minutes 23 seconds
> Publishing Javadoc
> Recording test results
>
>

This is rather strange. Here is part of the console output:

test:
     [echo] Testing plugin: parse-swf
    [junit] Running org.apache.nutch.parse.swf.TestSWFParser
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.315 sec
    [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 5.387 sec

init:
    [junit] Test org.apache.nutch.parse.feed.TestFeedParser FAILED


SWFParser fails one of the unit tests but the report says that
FeedParser has failed even though it has actually passed its test:

test:
     [echo] Testing plugin: feed
    [junit] Running org.apache.nutch.parse.feed.TestFeedParser
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.304 sec


--
Doğacan Güney
Reply | Threaded
Open this post in threaded view
|

Re: Build failed in Hudson: Nutch-Nightly #123

Doğacan Güney-3
On 6/20/07, Doğacan Güney <[hidden email]> wrote:

>
> This is rather strange. Here is part of the console output:
>
> test:
>      [echo] Testing plugin: parse-swf
>     [junit] Running org.apache.nutch.parse.swf.TestSWFParser
>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.315 sec
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 5.387 sec
>
> init:
>     [junit] Test org.apache.nutch.parse.feed.TestFeedParser FAILED
>
>
> SWFParser fails one of the unit tests but the report says that
> FeedParser has failed even though it has actually passed its test:
>
> test:
>      [echo] Testing plugin: feed
>     [junit] Running org.apache.nutch.parse.feed.TestFeedParser
>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.304 sec
>
>

(ant test forks processes to test code, that's why we are seeing test
outputs out of order.)

Anyway, it is not TestSWFParser but TestFeedParser that fails. I am
trying to understand why it fails. Chris, can you lend me a hand here?

--
Doğacan Güney
Reply | Threaded
Open this post in threaded view
|

Re: Build failed in Hudson: Nutch-Nightly #123

chrismattmann
Doğacan,

 This is strange indeed. I noticed this during my testing of parse-feed,
however, thought it was an anomaly. I got this same strange cryptic unit
test error message, and then after some frustration figuring it out, I did
ant clean, then ant compile-core test, and miraculously the error seemed to
go away. Also, if you go into $NUTCH/src/plugin/feed/ and run ant clean test
(of course after running ant compile-core from the top-level $NUTCH dir),
the unit tests seem to pass?

[XXX:src/plugin/feed] mattmann% pwd
/Users/mattmann/src/nutch/src/plugin/feed
[XXX:src/plugin/feed] mattmann% ant clean test
Searching for build.xml ...
Buildfile: /Users/mattmann/src/nutch/src/plugin/feed/build.xml

clean:
   [delete] Deleting directory /Users/mattmann/src/nutch/build/feed
   [delete] Deleting directory /Users/mattmann/src/nutch/build/plugins/feed

init:
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/classes
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test/data
     [copy] Copying 1 file to /Users/mattmann/src/nutch/build/feed/test/data

init-plugin:

deps-jar:

compile:
     [echo] Compiling plugin: feed
    [javac] Compiling 2 source files to
/Users/mattmann/src/nutch/build/feed/classes

compile-test:
    [javac] Compiling 1 source file to
/Users/mattmann/src/nutch/build/feed/test

jar:
      [jar] Building jar: /Users/mattmann/src/nutch/build/feed/feed.jar

deps-test:

init:

init-plugin:

compile:

jar:

deps-test:

deploy:

copy-generated-lib:

init:

init-plugin:

deps-jar:

compile:
     [echo] Compiling plugin: protocol-file

jar:

deps-test:

deploy:

copy-generated-lib:

deploy:
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/plugins/feed
     [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed

copy-generated-lib:
     [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed
     [copy] Copying 2 files to /Users/mattmann/src/nutch/build/plugins/feed

test:
     [echo] Testing plugin: feed
    [junit] Running org.apache.nutch.parse.feed.TestFeedParser
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.663 sec

BUILD SUCCESSFUL
Total time: 3 seconds
[XXX:src/plugin/feed] mattmann%

Any ideas?

Cheers,
  Chris




On 6/20/07 6:04 AM, "Doğacan Güney" <[hidden email]> wrote:

> On 6/20/07, Doğacan Güney <[hidden email]> wrote:
>
> This is rather
> strange. Here is part of the console output:
>
> test:
>      [echo] Testing
> plugin: parse-swf
>     [junit] Running
> org.apache.nutch.parse.swf.TestSWFParser
>     [junit] Tests run: 1, Failures:
> 0, Errors: 0, Time elapsed: 2.315 sec
>     [junit] Tests run: 1, Failures: 1,
> Errors: 0, Time elapsed: 5.387 sec
>
> init:
>     [junit] Test
> org.apache.nutch.parse.feed.TestFeedParser FAILED
>
>
> SWFParser fails one of
> the unit tests but the report says that
> FeedParser has failed even though it
> has actually passed its test:
>
> test:
>      [echo] Testing plugin: feed
>
> [junit] Running org.apache.nutch.parse.feed.TestFeedParser
>     [junit] Tests
> run: 1, Failures: 0, Errors: 0, Time elapsed: 1.304 sec
>
>

(ant test forks
> processes to test code, that's why we are seeing test
outputs out of
> order.)

Anyway, it is not TestSWFParser but TestFeedParser that fails. I
> am
trying to understand why it fails. Chris, can you lend me a hand here?

--
>
Doğacan Güney


______________________________________________
Chris A. Mattmann
[hidden email]
Key Staff Member
Modeling and Data Management Systems Section (387)
Data Management Systems and Technologies Group

_________________________________________________
Jet Propulsion Laboratory            Pasadena, CA
Office: 171-266B                        Mailstop:  171-246
_______________________________________________________

Disclaimer:  The opinions presented within are my own and do not reflect
those of either NASA, JPL, or the California Institute of Technology.


Reply | Threaded
Open this post in threaded view
|

Re: Build failed in Hudson: Nutch-Nightly #123

Dennis Kubes-2
Is this the same java 6 error that was popping up a while back?  For
some reason with java 6 the XML is being parsed differently in the SWF
parser and therefore unit tests looking for exact strings were failing.
  Could this be happening in the feed parser as well?

Dennis Kubes

Chris Mattmann wrote:

> Doğacan,
>
>  This is strange indeed. I noticed this during my testing of parse-feed,
> however, thought it was an anomaly. I got this same strange cryptic unit
> test error message, and then after some frustration figuring it out, I did
> ant clean, then ant compile-core test, and miraculously the error seemed to
> go away. Also, if you go into $NUTCH/src/plugin/feed/ and run ant clean test
> (of course after running ant compile-core from the top-level $NUTCH dir),
> the unit tests seem to pass?
>
> [XXX:src/plugin/feed] mattmann% pwd
> /Users/mattmann/src/nutch/src/plugin/feed
> [XXX:src/plugin/feed] mattmann% ant clean test
> Searching for build.xml ...
> Buildfile: /Users/mattmann/src/nutch/src/plugin/feed/build.xml
>
> clean:
>    [delete] Deleting directory /Users/mattmann/src/nutch/build/feed
>    [delete] Deleting directory /Users/mattmann/src/nutch/build/plugins/feed
>
> init:
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/classes
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test/data
>      [copy] Copying 1 file to /Users/mattmann/src/nutch/build/feed/test/data
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: feed
>     [javac] Compiling 2 source files to
> /Users/mattmann/src/nutch/build/feed/classes
>
> compile-test:
>     [javac] Compiling 1 source file to
> /Users/mattmann/src/nutch/build/feed/test
>
> jar:
>       [jar] Building jar: /Users/mattmann/src/nutch/build/feed/feed.jar
>
> deps-test:
>
> init:
>
> init-plugin:
>
> compile:
>
> jar:
>
> deps-test:
>
> deploy:
>
> copy-generated-lib:
>
> init:
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: protocol-file
>
> jar:
>
> deps-test:
>
> deploy:
>
> copy-generated-lib:
>
> deploy:
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/plugins/feed
>      [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed
>
> copy-generated-lib:
>      [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed
>      [copy] Copying 2 files to /Users/mattmann/src/nutch/build/plugins/feed
>
> test:
>      [echo] Testing plugin: feed
>     [junit] Running org.apache.nutch.parse.feed.TestFeedParser
>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.663 sec
>
> BUILD SUCCESSFUL
> Total time: 3 seconds
> [XXX:src/plugin/feed] mattmann%
>
> Any ideas?
>
> Cheers,
>   Chris
>
>
>
>
> On 6/20/07 6:04 AM, "Doğacan Güney" <[hidden email]> wrote:
>
>> On 6/20/07, Doğacan Güney <[hidden email]> wrote:
>>
>> This is rather
>> strange. Here is part of the console output:
>>
>> test:
>>      [echo] Testing
>> plugin: parse-swf
>>     [junit] Running
>> org.apache.nutch.parse.swf.TestSWFParser
>>     [junit] Tests run: 1, Failures:
>> 0, Errors: 0, Time elapsed: 2.315 sec
>>     [junit] Tests run: 1, Failures: 1,
>> Errors: 0, Time elapsed: 5.387 sec
>>
>> init:
>>     [junit] Test
>> org.apache.nutch.parse.feed.TestFeedParser FAILED
>>
>>
>> SWFParser fails one of
>> the unit tests but the report says that
>> FeedParser has failed even though it
>> has actually passed its test:
>>
>> test:
>>      [echo] Testing plugin: feed
>>
>> [junit] Running org.apache.nutch.parse.feed.TestFeedParser
>>     [junit] Tests
>> run: 1, Failures: 0, Errors: 0, Time elapsed: 1.304 sec
>>
>>
>
> (ant test forks
>> processes to test code, that's why we are seeing test
> outputs out of
>> order.)
>
> Anyway, it is not TestSWFParser but TestFeedParser that fails. I
>> am
> trying to understand why it fails. Chris, can you lend me a hand here?
>
> --
> Doğacan Güney
>
>
> ______________________________________________
> Chris A. Mattmann
> [hidden email]
> Key Staff Member
> Modeling and Data Management Systems Section (387)
> Data Management Systems and Technologies Group
>
> _________________________________________________
> Jet Propulsion Laboratory            Pasadena, CA
> Office: 171-266B                        Mailstop:  171-246
> _______________________________________________________
>
> Disclaimer:  The opinions presented within are my own and do not reflect
> those of either NASA, JPL, or the California Institute of Technology.
>
>
Reply | Threaded
Open this post in threaded view
|

Re: Build failed in Hudson: Nutch-Nightly #123

Doğacan Güney-3
In reply to this post by chrismattmann
On 6/20/07, Chris Mattmann <[hidden email]> wrote:

> Doğacan,
>
>  This is strange indeed. I noticed this during my testing of parse-feed,
> however, thought it was an anomaly. I got this same strange cryptic unit
> test error message, and then after some frustration figuring it out, I did
> ant clean, then ant compile-core test, and miraculously the error seemed to
> go away. Also, if you go into $NUTCH/src/plugin/feed/ and run ant clean test
> (of course after running ant compile-core from the top-level $NUTCH dir),
> the unit tests seem to pass?
>
> [XXX:src/plugin/feed] mattmann% pwd
> /Users/mattmann/src/nutch/src/plugin/feed
> [XXX:src/plugin/feed] mattmann% ant clean test
> Searching for build.xml ...
> Buildfile: /Users/mattmann/src/nutch/src/plugin/feed/build.xml
>
> clean:
>    [delete] Deleting directory /Users/mattmann/src/nutch/build/feed
>    [delete] Deleting directory /Users/mattmann/src/nutch/build/plugins/feed
>
> init:
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/classes
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test/data
>      [copy] Copying 1 file to /Users/mattmann/src/nutch/build/feed/test/data
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: feed
>     [javac] Compiling 2 source files to
> /Users/mattmann/src/nutch/build/feed/classes
>
> compile-test:
>     [javac] Compiling 1 source file to
> /Users/mattmann/src/nutch/build/feed/test
>
> jar:
>       [jar] Building jar: /Users/mattmann/src/nutch/build/feed/feed.jar
>
> deps-test:
>
> init:
>
> init-plugin:
>
> compile:
>
> jar:
>
> deps-test:
>
> deploy:
>
> copy-generated-lib:
>
> init:
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: protocol-file
>
> jar:
>
> deps-test:
>
> deploy:
>
> copy-generated-lib:
>
> deploy:
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/plugins/feed
>      [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed
>
> copy-generated-lib:
>      [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed
>      [copy] Copying 2 files to /Users/mattmann/src/nutch/build/plugins/feed
>
> test:
>      [echo] Testing plugin: feed
>     [junit] Running org.apache.nutch.parse.feed.TestFeedParser
>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.663 sec
>
> BUILD SUCCESSFUL
> Total time: 3 seconds
> [XXX:src/plugin/feed] mattmann%
>
> Any ideas?

It never passes for me (not even when I do it in src/plugin/feed). If
you check the output, parseResult only contains a single entry which
is rsstest.rss.

I think what causes this bug is (surprise, surprise) PrefixURLFilter.
We don't have a template for prefix-urlfilter.txt in conf, so it
doesn't get properly initialized and (I can't figure out why but)
randomly filters out stuff.

When I put a sample prefix-urlfilter.txt(*) under conf, all tests seem to pass.

(*) As your friendly neighborhood Nutch developer, I even put up a
sample file at:

http://www.ceng.metu.edu.tr/~e1345172/prefix-urlfilter.txt

>
> Cheers,
>   Chris
>
>
>
>
> On 6/20/07 6:04 AM, "Doğacan Güney" <[hidden email]> wrote:
>
> > On 6/20/07, Doğacan Güney <[hidden email]> wrote:
> >
> > This is rather
> > strange. Here is part of the console output:
> >
> > test:
> >      [echo] Testing
> > plugin: parse-swf
> >     [junit] Running
> > org.apache.nutch.parse.swf.TestSWFParser
> >     [junit] Tests run: 1, Failures:
> > 0, Errors: 0, Time elapsed: 2.315 sec
> >     [junit] Tests run: 1, Failures: 1,
> > Errors: 0, Time elapsed: 5.387 sec
> >
> > init:
> >     [junit] Test
> > org.apache.nutch.parse.feed.TestFeedParser FAILED
> >
> >
> > SWFParser fails one of
> > the unit tests but the report says that
> > FeedParser has failed even though it
> > has actually passed its test:
> >
> > test:
> >      [echo] Testing plugin: feed
> >
> > [junit] Running org.apache.nutch.parse.feed.TestFeedParser
> >     [junit] Tests
> > run: 1, Failures: 0, Errors: 0, Time elapsed: 1.304 sec
> >
> >
>
> (ant test forks
> > processes to test code, that's why we are seeing test
> outputs out of
> > order.)
>
> Anyway, it is not TestSWFParser but TestFeedParser that fails. I
> > am
> trying to understand why it fails. Chris, can you lend me a hand here?
>
> --
> >
> Doğacan Güney
>
>
> ______________________________________________
> Chris A. Mattmann
> [hidden email]
> Key Staff Member
> Modeling and Data Management Systems Section (387)
> Data Management Systems and Technologies Group
>
> _________________________________________________
> Jet Propulsion Laboratory            Pasadena, CA
> Office: 171-266B                        Mailstop:  171-246
> _______________________________________________________
>
> Disclaimer:  The opinions presented within are my own and do not reflect
> those of either NASA, JPL, or the California Institute of Technology.
>
>
>


--
Doğacan Güney
Reply | Threaded
Open this post in threaded view
|

Re: Build failed in Hudson: Nutch-Nightly #123

Doğacan Güney-3
In reply to this post by Dennis Kubes-2
On 6/20/07, Dennis Kubes <[hidden email]> wrote:
> Is this the same java 6 error that was popping up a while back?  For
> some reason with java 6 the XML is being parsed differently in the SWF
> parser and therefore unit tests looking for exact strings were failing.
>   Could this be happening in the feed parser as well?

I ran into some other issues with Java 6 ("backward compatibility",
right...), so I actually switched my Java back to 5, at least for this
computer.

>
> Dennis Kubes
>
> Chris Mattmann wrote:
> > Doğacan,
> >
> >  This is strange indeed. I noticed this during my testing of parse-feed,
> > however, thought it was an anomaly. I got this same strange cryptic unit
> > test error message, and then after some frustration figuring it out, I did
> > ant clean, then ant compile-core test, and miraculously the error seemed to
> > go away. Also, if you go into $NUTCH/src/plugin/feed/ and run ant clean test
> > (of course after running ant compile-core from the top-level $NUTCH dir),
> > the unit tests seem to pass?
> >
> > [XXX:src/plugin/feed] mattmann% pwd
> > /Users/mattmann/src/nutch/src/plugin/feed
> > [XXX:src/plugin/feed] mattmann% ant clean test
> > Searching for build.xml ...
> > Buildfile: /Users/mattmann/src/nutch/src/plugin/feed/build.xml
> >
> > clean:
> >    [delete] Deleting directory /Users/mattmann/src/nutch/build/feed
> >    [delete] Deleting directory /Users/mattmann/src/nutch/build/plugins/feed
> >
> > init:
> >     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed
> >     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/classes
> >     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test
> >     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test/data
> >      [copy] Copying 1 file to /Users/mattmann/src/nutch/build/feed/test/data
> >
> > init-plugin:
> >
> > deps-jar:
> >
> > compile:
> >      [echo] Compiling plugin: feed
> >     [javac] Compiling 2 source files to
> > /Users/mattmann/src/nutch/build/feed/classes
> >
> > compile-test:
> >     [javac] Compiling 1 source file to
> > /Users/mattmann/src/nutch/build/feed/test
> >
> > jar:
> >       [jar] Building jar: /Users/mattmann/src/nutch/build/feed/feed.jar
> >
> > deps-test:
> >
> > init:
> >
> > init-plugin:
> >
> > compile:
> >
> > jar:
> >
> > deps-test:
> >
> > deploy:
> >
> > copy-generated-lib:
> >
> > init:
> >
> > init-plugin:
> >
> > deps-jar:
> >
> > compile:
> >      [echo] Compiling plugin: protocol-file
> >
> > jar:
> >
> > deps-test:
> >
> > deploy:
> >
> > copy-generated-lib:
> >
> > deploy:
> >     [mkdir] Created dir: /Users/mattmann/src/nutch/build/plugins/feed
> >      [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed
> >
> > copy-generated-lib:
> >      [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed
> >      [copy] Copying 2 files to /Users/mattmann/src/nutch/build/plugins/feed
> >
> > test:
> >      [echo] Testing plugin: feed
> >     [junit] Running org.apache.nutch.parse.feed.TestFeedParser
> >     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.663 sec
> >
> > BUILD SUCCESSFUL
> > Total time: 3 seconds
> > [XXX:src/plugin/feed] mattmann%
> >
> > Any ideas?
> >
> > Cheers,
> >   Chris
> >
> >
> >
> >
> > On 6/20/07 6:04 AM, "Doğacan Güney" <[hidden email]> wrote:
> >
> >> On 6/20/07, Doğacan Güney <[hidden email]> wrote:
> >>
> >> This is rather
> >> strange. Here is part of the console output:
> >>
> >> test:
> >>      [echo] Testing
> >> plugin: parse-swf
> >>     [junit] Running
> >> org.apache.nutch.parse.swf.TestSWFParser
> >>     [junit] Tests run: 1, Failures:
> >> 0, Errors: 0, Time elapsed: 2.315 sec
> >>     [junit] Tests run: 1, Failures: 1,
> >> Errors: 0, Time elapsed: 5.387 sec
> >>
> >> init:
> >>     [junit] Test
> >> org.apache.nutch.parse.feed.TestFeedParser FAILED
> >>
> >>
> >> SWFParser fails one of
> >> the unit tests but the report says that
> >> FeedParser has failed even though it
> >> has actually passed its test:
> >>
> >> test:
> >>      [echo] Testing plugin: feed
> >>
> >> [junit] Running org.apache.nutch.parse.feed.TestFeedParser
> >>     [junit] Tests
> >> run: 1, Failures: 0, Errors: 0, Time elapsed: 1.304 sec
> >>
> >>
> >
> > (ant test forks
> >> processes to test code, that's why we are seeing test
> > outputs out of
> >> order.)
> >
> > Anyway, it is not TestSWFParser but TestFeedParser that fails. I
> >> am
> > trying to understand why it fails. Chris, can you lend me a hand here?
> >
> > --
> > Doğacan Güney
> >
> >
> > ______________________________________________
> > Chris A. Mattmann
> > [hidden email]
> > Key Staff Member
> > Modeling and Data Management Systems Section (387)
> > Data Management Systems and Technologies Group
> >
> > _________________________________________________
> > Jet Propulsion Laboratory            Pasadena, CA
> > Office: 171-266B                        Mailstop:  171-246
> > _______________________________________________________
> >
> > Disclaimer:  The opinions presented within are my own and do not reflect
> > those of either NASA, JPL, or the California Institute of Technology.
> >
> >
>


--
Doğacan Güney
Reply | Threaded
Open this post in threaded view
|

Re: Build failed in Hudson: Nutch-Nightly #123

chrismattmann
In reply to this post by Doğacan Güney-3
On 6/20/07 7:17 AM, "Doğacan Güney" <[hidden email]> wrote:

> It never passes for me (not even when I do it in src/plugin/feed). If
you
> check the output, parseResult only contains a single entry which
is
> rsstest.rss.

Okay, please tell me I'm  not crazy here. I'm on Mac OS X 10.4, Java
version:

# java -version
java version "1.5.0_07"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_07-164)
Java HotSpot(TM) Client VM (build 1.5.0_07-87, mixed mode, sharing)

I did a fresh checkout of the Nutch trunk. Then, from that dir, I run:

# ant compile-core
# cd src/plugin/feed
# ant clean test

All tests pass? Here is a log:

[XXX:~/src/nutch] mattmann% ant compile-core
Searching for build.xml ...
Buildfile: /Users/mattmann/src/nutch/build.xml

init:
    [mkdir] Created dir: /Users/mattmann/src/nutch/build
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/classes
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/test
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/test/classes
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/hadoop
    [unjar] Expanding: /Users/mattmann/src/nutch/lib/hadoop-0.12.2-core.jar
into /Users/mattmann/src/nutch/build/hadoop
    [untar] Expanding: /Users/mattmann/src/nutch/build/hadoop/bin.tgz into
/Users/mattmann/src/nutch/bin
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/webapps
    [unjar] Expanding: /Users/mattmann/src/nutch/lib/hadoop-0.12.2-core.jar
into /Users/mattmann/src/nutch/build

compile-core:
    [javac] Compiling 172 source files to
/Users/mattmann/src/nutch/build/classes
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.

BUILD SUCCESSFUL
Total time: 3 seconds
[XXX:~/src/nutch] mattmann% cd src/plugin/feed
[XXX:src/plugin/feed] mattmann% ant clean test
Searching for build.xml ...
Buildfile: /Users/mattmann/src/nutch/src/plugin/feed/build.xml
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test/data
     [copy] Copying 1 file to /Users/mattmann/src/nutch/build/feed/test/data

clean:
   [delete] Deleting directory /Users/mattmann/src/nutch/build/feed

init:
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/classes
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test/data
     [copy] Copying 1 file to /Users/mattmann/src/nutch/build/feed/test/data

init-plugin:

deps-jar:

compile:
     [echo] Compiling plugin: feed
    [javac] Compiling 2 source files to
/Users/mattmann/src/nutch/build/feed/classes

compile-test:
    [javac] Compiling 1 source file to
/Users/mattmann/src/nutch/build/feed/test

jar:
      [jar] Building jar: /Users/mattmann/src/nutch/build/feed/feed.jar

deps-test:

init:
    [mkdir] Created dir:
/Users/mattmann/src/nutch/build/nutch-extensionpoints
    [mkdir] Created dir:
/Users/mattmann/src/nutch/build/nutch-extensionpoints/classes
    [mkdir] Created dir:
/Users/mattmann/src/nutch/build/nutch-extensionpoints/test

init-plugin:

compile:

jar:
      [jar] Building MANIFEST-only jar:
/Users/mattmann/src/nutch/build/nutch-extensionpoints/nutch-extensionpoints.
jar

deps-test:

deploy:
    [mkdir] Created dir:
/Users/mattmann/src/nutch/build/plugins/nutch-extensionpoints
     [copy] Copying 1 file to
/Users/mattmann/src/nutch/build/plugins/nutch-extensionpoints

copy-generated-lib:
     [copy] Copying 1 file to
/Users/mattmann/src/nutch/build/plugins/nutch-extensionpoints

init:
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/protocol-file
    [mkdir] Created dir:
/Users/mattmann/src/nutch/build/protocol-file/classes
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/protocol-file/test

init-plugin:

deps-jar:

compile:
     [echo] Compiling plugin: protocol-file
    [javac] Compiling 4 source files to
/Users/mattmann/src/nutch/build/protocol-file/classes

jar:
      [jar] Building jar:
/Users/mattmann/src/nutch/build/protocol-file/protocol-file.jar

deps-test:

deploy:
    [mkdir] Created dir:
/Users/mattmann/src/nutch/build/plugins/protocol-file
     [copy] Copying 1 file to
/Users/mattmann/src/nutch/build/plugins/protocol-file

copy-generated-lib:
     [copy] Copying 1 file to
/Users/mattmann/src/nutch/build/plugins/protocol-file

deploy:
    [mkdir] Created dir: /Users/mattmann/src/nutch/build/plugins/feed
     [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed

copy-generated-lib:
     [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed
     [copy] Copying 2 files to /Users/mattmann/src/nutch/build/plugins/feed

test:
     [echo] Testing plugin: feed
    [junit] Running org.apache.nutch.parse.feed.TestFeedParser
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.635 sec

BUILD SUCCESSFUL
Total time: 3 seconds
[XXX:src/plugin/feed] mattmann%

Why is mine passing, and yours not? Or, have I been working too hard lately,
and is all this a hallucination? :)

Cheers,
  Chris

______________________________________________
Chris A. Mattmann
[hidden email]
Key Staff Member
Modeling and Data Management Systems Section (387)
Data Management Systems and Technologies Group

_________________________________________________
Jet Propulsion Laboratory            Pasadena, CA
Office: 171-266B                        Mailstop:  171-246
_______________________________________________________

Disclaimer:  The opinions presented within are my own and do not reflect
those of either NASA, JPL, or the California Institute of Technology.


Reply | Threaded
Open this post in threaded view
|

Re: Build failed in Hudson: Nutch-Nightly #123

Doğacan Güney-3
On 6/20/07, Chris Mattmann <[hidden email]> wrote:

> On 6/20/07 7:17 AM, "Doğacan Güney" <[hidden email]> wrote:
>
> > It never passes for me (not even when I do it in src/plugin/feed). If
> you
> > check the output, parseResult only contains a single entry which
> is
> > rsstest.rss.
>
> Okay, please tell me I'm  not crazy here. I'm on Mac OS X 10.4, Java
> version:
>
> # java -version
> java version "1.5.0_07"
> Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_07-164)
> Java HotSpot(TM) Client VM (build 1.5.0_07-87, mixed mode, sharing)
>
> I did a fresh checkout of the Nutch trunk. Then, from that dir, I run:
>
> # ant compile-core
> # cd src/plugin/feed
> # ant clean test
>
> All tests pass? Here is a log:
>
> [XXX:~/src/nutch] mattmann% ant compile-core
> Searching for build.xml ...
> Buildfile: /Users/mattmann/src/nutch/build.xml
>
> init:
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/classes
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/test
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/test/classes
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/hadoop
>     [unjar] Expanding: /Users/mattmann/src/nutch/lib/hadoop-0.12.2-core.jar
> into /Users/mattmann/src/nutch/build/hadoop
>     [untar] Expanding: /Users/mattmann/src/nutch/build/hadoop/bin.tgz into
> /Users/mattmann/src/nutch/bin
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/webapps
>     [unjar] Expanding: /Users/mattmann/src/nutch/lib/hadoop-0.12.2-core.jar
> into /Users/mattmann/src/nutch/build
>
> compile-core:
>     [javac] Compiling 172 source files to
> /Users/mattmann/src/nutch/build/classes
>     [javac] Note: Some input files use or override a deprecated API.
>     [javac] Note: Recompile with -Xlint:deprecation for details.
>     [javac] Note: Some input files use unchecked or unsafe operations.
>     [javac] Note: Recompile with -Xlint:unchecked for details.
>
> BUILD SUCCESSFUL
> Total time: 3 seconds
> [XXX:~/src/nutch] mattmann% cd src/plugin/feed
> [XXX:src/plugin/feed] mattmann% ant clean test
> Searching for build.xml ...
> Buildfile: /Users/mattmann/src/nutch/src/plugin/feed/build.xml
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test/data
>      [copy] Copying 1 file to /Users/mattmann/src/nutch/build/feed/test/data
>
> clean:
>    [delete] Deleting directory /Users/mattmann/src/nutch/build/feed
>
> init:
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/classes
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test/data
>      [copy] Copying 1 file to /Users/mattmann/src/nutch/build/feed/test/data
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: feed
>     [javac] Compiling 2 source files to
> /Users/mattmann/src/nutch/build/feed/classes
>
> compile-test:
>     [javac] Compiling 1 source file to
> /Users/mattmann/src/nutch/build/feed/test
>
> jar:
>       [jar] Building jar: /Users/mattmann/src/nutch/build/feed/feed.jar
>
> deps-test:
>
> init:
>     [mkdir] Created dir:
> /Users/mattmann/src/nutch/build/nutch-extensionpoints
>     [mkdir] Created dir:
> /Users/mattmann/src/nutch/build/nutch-extensionpoints/classes
>     [mkdir] Created dir:
> /Users/mattmann/src/nutch/build/nutch-extensionpoints/test
>
> init-plugin:
>
> compile:
>
> jar:
>       [jar] Building MANIFEST-only jar:
> /Users/mattmann/src/nutch/build/nutch-extensionpoints/nutch-extensionpoints.
> jar
>
> deps-test:
>
> deploy:
>     [mkdir] Created dir:
> /Users/mattmann/src/nutch/build/plugins/nutch-extensionpoints
>      [copy] Copying 1 file to
> /Users/mattmann/src/nutch/build/plugins/nutch-extensionpoints
>
> copy-generated-lib:
>      [copy] Copying 1 file to
> /Users/mattmann/src/nutch/build/plugins/nutch-extensionpoints
>
> init:
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/protocol-file
>     [mkdir] Created dir:
> /Users/mattmann/src/nutch/build/protocol-file/classes
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/protocol-file/test
>
> init-plugin:
>
> deps-jar:
>
> compile:
>      [echo] Compiling plugin: protocol-file
>     [javac] Compiling 4 source files to
> /Users/mattmann/src/nutch/build/protocol-file/classes
>
> jar:
>       [jar] Building jar:
> /Users/mattmann/src/nutch/build/protocol-file/protocol-file.jar
>
> deps-test:
>
> deploy:
>     [mkdir] Created dir:
> /Users/mattmann/src/nutch/build/plugins/protocol-file
>      [copy] Copying 1 file to
> /Users/mattmann/src/nutch/build/plugins/protocol-file
>
> copy-generated-lib:
>      [copy] Copying 1 file to
> /Users/mattmann/src/nutch/build/plugins/protocol-file
>
> deploy:
>     [mkdir] Created dir: /Users/mattmann/src/nutch/build/plugins/feed
>      [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed
>
> copy-generated-lib:
>      [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed
>      [copy] Copying 2 files to /Users/mattmann/src/nutch/build/plugins/feed
>
> test:
>      [echo] Testing plugin: feed
>     [junit] Running org.apache.nutch.parse.feed.TestFeedParser
>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.635 sec
>
> BUILD SUCCESSFUL
> Total time: 3 seconds
> [XXX:src/plugin/feed] mattmann%
>
> Why is mine passing, and yours not? Or, have I been working too hard lately,
> and is all this a hallucination? :)

Since you are doing compile-core, no plugins get compiled (say,
urlfilter-prefix), then when  you do a ant test in feed only
protocol-file gets compiled. So, no urlfilter-prefix, no problem :). I
have to say that I am certain that I am not sure of what I just said.

Can you retry with just 'ant' instead of 'ant compile-core'?

>
> Cheers,
>   Chris
>
> ______________________________________________
> Chris A. Mattmann
> [hidden email]
> Key Staff Member
> Modeling and Data Management Systems Section (387)
> Data Management Systems and Technologies Group
>
> _________________________________________________
> Jet Propulsion Laboratory            Pasadena, CA
> Office: 171-266B                        Mailstop:  171-246
> _______________________________________________________
>
> Disclaimer:  The opinions presented within are my own and do not reflect
> those of either NASA, JPL, or the California Institute of Technology.
>
>
>


--
Doğacan Güney
Reply | Threaded
Open this post in threaded view
|

Re: Build failed in Hudson: Nutch-Nightly #123

chrismattmann
On 6/20/07 8:17 AM, "Doğacan Güney" <[hidden email]> wrote:

> Since you are doing compile-core, no plugins get compiled
> (say,
urlfilter-prefix), then when  you do a ant test in feed
> only
protocol-file gets compiled. So, no urlfilter-prefix, no problem :).
> I
have to say that I am certain that I am not sure of what I just said.

Can
> you retry with just 'ant' instead of 'ant compile-core'?

Heh, yep, that replicated the issue. Okay, so I agree with you with regards
to the fix that you suggested, however the larger issue here is one of
annoyance. Why should I have to have a version of the urlfilter-prefix
plugin compiled for this issue to manifest itself? Plugin development is
supposed to be independent, i.e., while developing the feed plugin I
shouldn't need to care about how others have developed the urlfilter plugin,
etc., or whether or not there is an appropriate test file there to use in
unit testing.

I have 2 suggestions:

1. We should make the urlfilter-prefix use more of a sensible default for
its filters (e.g., a default filter perhaps) that takes effect when the
plugin cannot find the specified .txt file.

2. We should think about this more general issue and come up with a way that
plugin development in Nutch supports the use case that I was trying, which I
find to be highly representative of what many other folks using Nutch are
doing as well (i.e., why should I have to do a full rebuild/test of other
plugins when I'm simply working on a single one?

For my part in the interim, I will ensure that next time before I commit a
plugin I make sure that it passes with the full ant clean compile-core test
cycle. Doğacan, thanks for your help in tracking this down. Could you please
commit an example test urlfilter file to make the unit test pass since you
are going to make that change to use lib-xml anyways? Let me know okay,
thanks!

Cheers,
  Chris



Reply | Threaded
Open this post in threaded view
|

Re: Build failed in Hudson: Nutch-Nightly #123

Nigel Daley
In reply to this post by Doğacan Güney-3

On Jun 20, 2007, at 12:07 AM, Doğacan Güney wrote:

> On 6/20/07, [hidden email]
> <[hidden email]> wrote:
>> See http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ 
>> 123/changes
>>
>> ------------------------------------------
>> [...truncated 5950 lines...]
>>
>> init-plugin:
>>
>> deps-jar:
>>
>> compile:
>>      [echo] Compiling plugin: lib-regex-filter
>>
>> jar:
>>
>> init:
>>
>> init-plugin:
>>
>> deps-jar:
>>
>> compile:
>>      [echo] Compiling plugin: lib-regex-filter
>>
>> compile-test:
>>
>> compile:
>>      [echo] Compiling plugin: urlfilter-automaton
>>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed:  
>> 1.585 sec
>> Overriding previous definition of reference to plugin.deps
>>
>> init:
>> Overriding previous definition of reference to plugin.deps
>>
>> init-plugin:
>>
>> deps-jar:
>>
>> init:
>>
>> init-plugin:
>>
>> deps-jar:
>>
>> compile:
>>      [echo] Compiling plugin: lib-regex-filter
>>
>> jar:
>>
>> init:
>>
>> init-plugin:
>>
>> deps-jar:
>>
>> compile:
>>      [echo] Compiling plugin: lib-regex-filter
>>
>> compile-test:
>>
>> compile:
>>      [echo] Compiling plugin: urlfilter-regex
>>
>> compile-test:
>>
>> compile-test:
>>     [javac] Compiling 1 source file to http://
>> lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/
>> build/urlfilter-automaton/test
>>     [javac] Compiling 1 source file to http://
>> lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/
>> build/urlfilter-regex/test
>>
>> jar:
>>
>> deps-test:
>>
>> init:
>>
>> init-plugin:
>>
>> deps-jar:
>>
>> compile:
>>      [echo] Compiling plugin: lib-regex-filter
>>
>> jar:
>>
>> jar:
>>
>> deps-test:
>>
>> deps-test:
>>
>> deploy:
>>
>> init:
>>
>> copy-generated-lib:
>>
>> deploy:
>>
>> init-plugin:
>>
>> deps-jar:
>>
>> compile:
>>      [echo] Compiling plugin: lib-regex-filter
>> Overriding previous definition of reference to plugin.deps
>>
>> jar:
>>
>> copy-generated-lib:
>>
>> deps-test:
>>
>> deploy:
>>
>> test:
>>      [echo] Testing plugin: urlfilter-automaton
>>     [junit] Running  
>> org.apache.nutch.urlfilter.automaton.TestAutomatonURLFilter
>>
>> copy-generated-lib:
>>
>> deploy:
>> Overriding previous definition of reference to plugin.deps
>>
>> copy-generated-lib:
>>
>> test:
>>      [echo] Testing plugin: urlfilter-regex
>>     [junit] Running  
>> org.apache.nutch.urlfilter.regex.TestRegexURLFilter
>>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed:  
>> 2.812 sec
>>
>> init:
>>
>> init-plugin:
>>
>> deps-jar:
>>
>> compile:
>>      [echo] Compiling plugin: urlfilter-suffix
>>
>> compile-test:
>>     [javac] Compiling 1 source file to http://
>> lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/
>> build/urlfilter-suffix/test
>>
>> jar:
>>
>> deps-test:
>>
>> deploy:
>>
>> copy-generated-lib:
>>
>> test:
>>      [echo] Testing plugin: urlfilter-suffix
>>     [junit] Running  
>> org.apache.nutch.urlfilter.suffix.TestSuffixURLFilter
>>     [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed:  
>> 0.174 sec
>>
>> init:
>>
>> init-plugin:
>>
>> deps-jar:
>>
>> compile:
>>      [echo] Compiling plugin: urlnormalizer-basic
>>
>> compile-test:
>>     [javac] Compiling 1 source file to http://
>> lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/
>> build/urlnormalizer-basic/test
>>
>> jar:
>>
>> deps-test:
>>
>> deploy:
>>
>> copy-generated-lib:
>>
>> test:
>>      [echo] Testing plugin: urlnormalizer-basic
>>     [junit] Running  
>> org.apache.nutch.net.urlnormalizer.basic.TestBasicURLNormalizer
>>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed:  
>> 0.024 sec
>>
>> init:
>>
>> init-plugin:
>>
>> deps-jar:
>>
>> compile:
>>      [echo] Compiling plugin: urlnormalizer-pass
>>
>> compile-test:
>>     [javac] Compiling 1 source file to http://
>> lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/
>> build/urlnormalizer-pass/test
>>
>> jar:
>>
>> deps-test:
>>
>> deploy:
>>
>> copy-generated-lib:
>>
>> test:
>>      [echo] Testing plugin: urlnormalizer-pass
>>     [junit] Running  
>> org.apache.nutch.net.urlnormalizer.pass.TestPassURLNormalizer
>>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed:  
>> 0.15 sec
>>
>> init:
>>
>> init-plugin:
>>
>> deps-jar:
>>
>> compile:
>>      [echo] Compiling plugin: urlnormalizer-regex
>>
>> compile-test:
>>     [javac] Compiling 1 source file to http://
>> lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/
>> build/urlnormalizer-regex/test
>>     [javac] Note: http://lucene.zones.apache.org:8080/hudson/job/ 
>> Nutch-Nightly/ws/trunk/src/plugin/urlnormalizer-regex/src/test/org/
>> apache/nutch/net/urlnormalizer/regex/TestRegexURLNormalizer.java  
>> uses unchecked or unsafe operations.
>>     [javac] Note: Recompile with -Xlint:unchecked for details.
>>
>> jar:
>>
>> deps-test:
>>
>> init:
>>
>> init-plugin:
>>
>> compile:
>>
>> jar:
>>
>> deps-test:
>>
>> deploy:
>>
>> copy-generated-lib:
>>
>> deploy:
>>
>> copy-generated-lib:
>>
>> test:
>>      [echo] Testing plugin: urlnormalizer-regex
>>     [junit] Running  
>> org.apache.nutch.net.urlnormalizer.regex.TestRegexURLNormalizer
>>     [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed:  
>> 0.016 sec
>>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed:  
>> 7.454 sec
>>
>> BUILD FAILED
>> http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/ 
>> trunk/build.xml :302: The following error occurred while executing  
>> this line:
>> http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/ 
>> trunk/src/plugin/build.xml :98: The following error occurred while  
>> executing this line:
>> http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/ 
>> trunk/src/plugin/build-plugin.xml :200: Tests failed!
>>
>> Total time: 4 minutes 23 seconds
>> Publishing Javadoc
>> Recording test results
>>
>>
>
> This is rather strange. Here is part of the console output:
>
> test:
>     [echo] Testing plugin: parse-swf
>    [junit] Running org.apache.nutch.parse.swf.TestSWFParser
>    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed:  
> 2.315 sec
>    [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed:  
> 5.387 sec
>
> init:
>    [junit] Test org.apache.nutch.parse.feed.TestFeedParser FAILED
>
>
> SWFParser fails one of the unit tests but the report says that
> FeedParser has failed even though it has actually passed its test:
>
> test:
>     [echo] Testing plugin: feed
>    [junit] Running org.apache.nutch.parse.feed.TestFeedParser
>    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed:  
> 1.304 sec
>
>
> --
> Doğacan Güney

So ant knows that this test failed which is why the build fails.

Hudson then gathers the xml test output files and produces the test  
report.  Either this test isn't generating xml or the xml output is  
not in the place that Hudson was told about (trunk/build/test/*.xml).

Let me know if you need me to
  a) configure a new ant option/target so the test generates xml
  b) a new path added to the place Hudson looks for test xml files.

Cheers,
Nige