Nutch 500 Error

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

Nutch 500 Error

Paul Stewart-5
Hi there...

I was having a number of problems with my install, mainly because I'm
not used to Tomcat and/or Nutch etc...

Anyways, I am running Fedora 4 and was told that the packages are bad
idea to use so uninstalled all of my java/tomcat rpm's and installed new
binaries today from the source sites (Sun Java / Apache Tomcat)

Things are looking better I think but when I try to run a search I get
this:

HTTP Status 500 -

------------------------------------------------------------------------
--------

type Exception report

message

description The server encountered an internal error () that prevented
it from fulfilling this request.

exception

org.apache.jasper.JasperException
       
org.apache.jasper.servlet.JspServletWrapper.handleJspException(JspServle
tWrapper.java:510)
       
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.ja
va:393)
       
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
       
org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
        javax.servlet.http.HttpServlet.service(HttpServlet.java:802)


root cause

java.lang.NullPointerException
        org.apache.nutch.searcher.NutchBean.init(NutchBean.java:96)
        org.apache.nutch.searcher.NutchBean.<init>(NutchBean.java:82)
        org.apache.nutch.searcher.NutchBean.<init>(NutchBean.java:72)
        org.apache.nutch.searcher.NutchBean.get(NutchBean.java:64)
        org.apache.jsp.search_jsp._jspService(search_jsp.java:112)
       
org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
        javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
       
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.ja
va:332)
       
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
       
org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
        javax.servlet.http.HttpServlet.service(HttpServlet.java:802)


The search page comes up fine.... I figure this must be something simple
I hope... I read on the Nutch site about utf-8 and added it to the
configuration of my Tomcat5 server... Any other ideas?

Thanks again,

Paul
Reply | Threaded
Open this post in threaded view
|

Re: Nutch 500 Error

Thomas Delnoij-3
My guess is you have to override the searcher.dir property in
nutch-site.xml and have it point to your crawl dir.

Rgrds, Thomas



On 4/5/06, Paul Stewart <[hidden email]> wrote:

> Hi there...
>
> I was having a number of problems with my install, mainly because I'm
> not used to Tomcat and/or Nutch etc...
>
> Anyways, I am running Fedora 4 and was told that the packages are bad
> idea to use so uninstalled all of my java/tomcat rpm's and installed new
> binaries today from the source sites (Sun Java / Apache Tomcat)
>
> Things are looking better I think but when I try to run a search I get
> this:
>
> HTTP Status 500 -
>
> ------------------------------------------------------------------------
> --------
>
> type Exception report
>
> message
>
> description The server encountered an internal error () that prevented
> it from fulfilling this request.
>
> exception
>
> org.apache.jasper.JasperException
>
> org.apache.jasper.servlet.JspServletWrapper.handleJspException(JspServle
> tWrapper.java:510)
>
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.ja
> va:393)
>
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
>
> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>         javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
>
> root cause
>
> java.lang.NullPointerException
>         org.apache.nutch.searcher.NutchBean.init(NutchBean.java:96)
>         org.apache.nutch.searcher.NutchBean.<init>(NutchBean.java:82)
>         org.apache.nutch.searcher.NutchBean.<init>(NutchBean.java:72)
>         org.apache.nutch.searcher.NutchBean.get(NutchBean.java:64)
>         org.apache.jsp.search_jsp._jspService(search_jsp.java:112)
>
> org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>         javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.ja
> va:332)
>
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
>
> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>         javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
>
> The search page comes up fine.... I figure this must be something simple
> I hope... I read on the Nutch site about utf-8 and added it to the
> configuration of my Tomcat5 server... Any other ideas?
>
> Thanks again,
>
> Paul
>
Reply | Threaded
Open this post in threaded view
|

RE: Nutch 500 Error

Paul Stewart-5
In reply to this post by Paul Stewart-5
Thanks.. Tried that ... Same error....

HTTP Status 500 -

------------------------------------------------------------------------
--------

type Exception report

message

description The server encountered an internal error () that prevented
it from fulfilling this request.

exception

org.apache.jasper.JasperException
       
org.apache.jasper.servlet.JspServletWrapper.handleJspException(JspServle
tWrapper.java:510)
       
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.ja
va:393)
       
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
       
org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
        javax.servlet.http.HttpServlet.service(HttpServlet.java:802)


root cause

java.lang.NullPointerException
        org.apache.nutch.searcher.NutchBean.init(NutchBean.java:96)
        org.apache.nutch.searcher.NutchBean.<init>(NutchBean.java:82)
        org.apache.nutch.searcher.NutchBean.<init>(NutchBean.java:72)
        org.apache.nutch.searcher.NutchBean.get(NutchBean.java:64)
        org.apache.jsp.search_jsp._jspService(search_jsp.java:112)
       
org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
        javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
       
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.ja
va:332)
       
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
       
org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
        javax.servlet.http.HttpServlet.service(HttpServlet.java:802)

-----Original Message-----
From: TDLN [mailto:[hidden email]]
Sent: Thursday, April 06, 2006 3:30 AM
To: [hidden email]
Subject: Re: Nutch 500 Error

My guess is you have to override the searcher.dir property in
nutch-site.xml and have it point to your crawl dir.

Rgrds, Thomas



Reply | Threaded
Open this post in threaded view
|

Re: Nutch 500 Error

Thomas Delnoij-3
What version are you on? If you trace the NullPointerException back to
the code, the NutchBean.init method is where it expects to find the
index and segments, so either they're missing (did you follow the
tutorial and merge your segment indexes?) or it is looking in the
wrong place. That's what I think.

Rgrds, Thomas



On 4/6/06, Paul Stewart <[hidden email]> wrote:

> Thanks.. Tried that ... Same error....
>
> HTTP Status 500 -
>
> ------------------------------------------------------------------------
> --------
>
> type Exception report
>
> message
>
> description The server encountered an internal error () that prevented
> it from fulfilling this request.
>
> exception
>
> org.apache.jasper.JasperException
>
> org.apache.jasper.servlet.JspServletWrapper.handleJspException(JspServle
> tWrapper.java:510)
>
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.ja
> va:393)
>
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
>
> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>         javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
>
> root cause
>
> java.lang.NullPointerException
>         org.apache.nutch.searcher.NutchBean.init(NutchBean.java:96)
>         org.apache.nutch.searcher.NutchBean.<init>(NutchBean.java:82)
>         org.apache.nutch.searcher.NutchBean.<init>(NutchBean.java:72)
>         org.apache.nutch.searcher.NutchBean.get(NutchBean.java:64)
>         org.apache.jsp.search_jsp._jspService(search_jsp.java:112)
>
> org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>         javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.ja
> va:332)
>
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
>
> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>         javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
> -----Original Message-----
> From: TDLN [mailto:[hidden email]]
> Sent: Thursday, April 06, 2006 3:30 AM
> To: [hidden email]
> Subject: Re: Nutch 500 Error
>
> My guess is you have to override the searcher.dir property in
> nutch-site.xml and have it point to your crawl dir.
>
> Rgrds, Thomas
>
>
>
>
Reply | Threaded
Open this post in threaded view
|

RE: Nutch 500 Error

Paul Stewart-5
In reply to this post by Paul Stewart-5
Thanks for the reply... I apologize as I'm very new to the Java
world...:)

I am running the following:

Fedora Core 4
Apache Tomcat 5.5.16 (binary download from Tomcat site installed to
/usr/local/tomcat5)
jre1.5.0_06 (binary download from Sun site to /usr/java/jre1.5.0_06)

Weird though - when I try to do a java -v I get this now:

[root@spider jre1.5.0_06]# export JAVA_HOME=/usr/java/jre1.5.0_06/
[root@spider jre1.5.0_06]# /usr/java/jre1.5.0_06/bin/java -v
Unrecognized option: -v
Could not create the Java virtual machine.

Is this my actual problem possibly?  Or is this the wrong Java version
to be running?  When I downloaded 1.4.x tomcat told me it didn't support
anything but 1.5.x

Thanks again for your patience...
Paul


-----Original Message-----
From: TDLN [mailto:[hidden email]]
Sent: Thursday, April 06, 2006 7:16 AM
To: [hidden email]
Subject: Re: Nutch 500 Error

What version are you on? If you trace the NullPointerException back to
the code, the NutchBean.init method is where it expects to find the
index and segments, so either they're missing (did you follow the
tutorial and merge your segment indexes?) or it is looking in the wrong
place. That's what I think.

Rgrds, Thomas



On 4/6/06, Paul Stewart <[hidden email]> wrote:

> Thanks.. Tried that ... Same error....
>
> HTTP Status 500 -
>
> ----------------------------------------------------------------------
> --
> --------
>
> type Exception report
>
> message
>
> description The server encountered an internal error () that prevented

> it from fulfilling this request.
>
> exception
>
> org.apache.jasper.JasperException
>
> org.apache.jasper.servlet.JspServletWrapper.handleJspException(JspServ
> le
> tWrapper.java:510)
>
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.
> ja
> va:393)
>
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:31
> 4)
>
> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>         javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
>
> root cause
>
> java.lang.NullPointerException
>         org.apache.nutch.searcher.NutchBean.init(NutchBean.java:96)
>         org.apache.nutch.searcher.NutchBean.<init>(NutchBean.java:82)
>         org.apache.nutch.searcher.NutchBean.<init>(NutchBean.java:72)
>         org.apache.nutch.searcher.NutchBean.get(NutchBean.java:64)
>         org.apache.jsp.search_jsp._jspService(search_jsp.java:112)
>
> org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>         javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.
> ja
> va:332)
>
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:31
> 4)
>
> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>         javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
> -----Original Message-----
> From: TDLN [mailto:[hidden email]]
> Sent: Thursday, April 06, 2006 3:30 AM
> To: [hidden email]
> Subject: Re: Nutch 500 Error
>
> My guess is you have to override the searcher.dir property in
> nutch-site.xml and have it point to your crawl dir.
>
> Rgrds, Thomas
>
>
>
>
Reply | Threaded
Open this post in threaded view
|

RE: Nutch 500 Error

sudhendra seshachala
It should be java -versionI think.

Paul Stewart <[hidden email]> wrote:  Thanks for the reply... I apologize as I'm very new to the Java
world...:)

I am running the following:

Fedora Core 4
Apache Tomcat 5.5.16 (binary download from Tomcat site installed to
/usr/local/tomcat5)
jre1.5.0_06 (binary download from Sun site to /usr/java/jre1.5.0_06)

Weird though - when I try to do a java -v I get this now:

[root@spider jre1.5.0_06]# export JAVA_HOME=/usr/java/jre1.5.0_06/
[root@spider jre1.5.0_06]# /usr/java/jre1.5.0_06/bin/java -v
Unrecognized option: -v
Could not create the Java virtual machine.

Is this my actual problem possibly? Or is this the wrong Java version
to be running? When I downloaded 1.4.x tomcat told me it didn't support
anything but 1.5.x

Thanks again for your patience...
Paul


-----Original Message-----
From: TDLN [mailto:[hidden email]]
Sent: Thursday, April 06, 2006 7:16 AM
To: [hidden email]
Subject: Re: Nutch 500 Error

What version are you on? If you trace the NullPointerException back to
the code, the NutchBean.init method is where it expects to find the
index and segments, so either they're missing (did you follow the
tutorial and merge your segment indexes?) or it is looking in the wrong
place. That's what I think.

Rgrds, Thomas



On 4/6/06, Paul Stewart
wrote:

> Thanks.. Tried that ... Same error....
>
> HTTP Status 500 -
>
> ----------------------------------------------------------------------
> --
> --------
>
> type Exception report
>
> message
>
> description The server encountered an internal error () that prevented

> it from fulfilling this request.
>
> exception
>
> org.apache.jasper.JasperException
>
> org.apache.jasper.servlet.JspServletWrapper.handleJspException(JspServ
> le
> tWrapper.java:510)
>
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.
> ja
> va:393)
>
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:31
> 4)
>
> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
>
> root cause
>
> java.lang.NullPointerException
> org.apache.nutch.searcher.NutchBean.init(NutchBean.java:96)
> org.apache.nutch.searcher.NutchBean.(NutchBean.java:82)
> org.apache.nutch.searcher.NutchBean.(NutchBean.java:72)
> org.apache.nutch.searcher.NutchBean.get(NutchBean.java:64)
> org.apache.jsp.search_jsp._jspService(search_jsp.java:112)
>
> org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.
> ja
> va:332)
>
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:31
> 4)
>
> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
> -----Original Message-----
> From: TDLN [mailto:[hidden email]]
> Sent: Thursday, April 06, 2006 3:30 AM
> To: [hidden email]
> Subject: Re: Nutch 500 Error
>
> My guess is you have to override the searcher.dir property in
> nutch-site.xml and have it point to your crawl dir.
>
> Rgrds, Thomas
>
>
>
>



  Sudhi Seshachala
  http://sudhilogs.blogspot.com/
   


                       
---------------------------------
Yahoo! Messenger with Voice. PC-to-Phone calls for ridiculously low rates.
Reply | Threaded
Open this post in threaded view
|

RE: Nutch 500 Error

Paul Stewart-5
In reply to this post by Paul Stewart-5
Thanks.... I was doing the java command wrong...

Back to my original problem - I re-ran throught the entire tutorial to
ensure I was doing it right and it seems proper.... How do I tell Nutch
where to look specifically in the code for the segments and indexes in
case it is in the wrong place?

All the best,
Paul
 

-----Original Message-----
From: sudhendra seshachala [mailto:[hidden email]]
Sent: Thursday, April 06, 2006 12:02 PM
To: [hidden email]
Subject: RE: Nutch 500 Error

It should be java -versionI think.

Paul Stewart <[hidden email]> wrote:  Thanks for the reply...
I apologize as I'm very new to the Java
world...:)

I am running the following:

Fedora Core 4
Apache Tomcat 5.5.16 (binary download from Tomcat site installed to
/usr/local/tomcat5)
jre1.5.0_06 (binary download from Sun site to /usr/java/jre1.5.0_06)

Weird though - when I try to do a java -v I get this now:

[root@spider jre1.5.0_06]# export JAVA_HOME=/usr/java/jre1.5.0_06/
[root@spider jre1.5.0_06]# /usr/java/jre1.5.0_06/bin/java -v
Unrecognized option: -v Could not create the Java virtual machine.

Is this my actual problem possibly? Or is this the wrong Java version to
be running? When I downloaded 1.4.x tomcat told me it didn't support
anything but 1.5.x

Thanks again for your patience...
Paul


-----Original Message-----
From: TDLN [mailto:[hidden email]]
Sent: Thursday, April 06, 2006 7:16 AM
To: [hidden email]
Subject: Re: Nutch 500 Error

What version are you on? If you trace the NullPointerException back to
the code, the NutchBean.init method is where it expects to find the
index and segments, so either they're missing (did you follow the
tutorial and merge your segment indexes?) or it is looking in the wrong
place. That's what I think.

Rgrds, Thomas



On 4/6/06, Paul Stewart
wrote:

> Thanks.. Tried that ... Same error....
>
> HTTP Status 500 -
>
> ----------------------------------------------------------------------
> --
> --------
>
> type Exception report
>
> message
>
> description The server encountered an internal error () that prevented

> it from fulfilling this request.
>
> exception
>
> org.apache.jasper.JasperException
>
> org.apache.jasper.servlet.JspServletWrapper.handleJspException(JspServ
> le
> tWrapper.java:510)
>
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.
> ja
> va:393)
>
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:31
> 4)
>
> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
>
> root cause
>
> java.lang.NullPointerException
> org.apache.nutch.searcher.NutchBean.init(NutchBean.java:96)
> org.apache.nutch.searcher.NutchBean.(NutchBean.java:82)
> org.apache.nutch.searcher.NutchBean.(NutchBean.java:72)
> org.apache.nutch.searcher.NutchBean.get(NutchBean.java:64)
> org.apache.jsp.search_jsp._jspService(search_jsp.java:112)
>
> org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.
> ja
> va:332)
>
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:31
> 4)
>
> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
> -----Original Message-----
> From: TDLN [mailto:[hidden email]]
> Sent: Thursday, April 06, 2006 3:30 AM
> To: [hidden email]
> Subject: Re: Nutch 500 Error
>
> My guess is you have to override the searcher.dir property in
> nutch-site.xml and have it point to your crawl dir.
>
> Rgrds, Thomas
>
>
>
>



  Sudhi Seshachala
  http://sudhilogs.blogspot.com/
   


                       
---------------------------------
Yahoo! Messenger with Voice. PC-to-Phone calls for ridiculously low
rates.
Reply | Threaded
Open this post in threaded view
|

RE: Nutch 500 Error

sudhendra seshachala
check the nutch-default.xml
there should be a property searcher.dir
Provide the path for the index folder.
Better still copy the property node and paste it in nutch-site.xml
provide the path for the index folder.
For ex:
If the index folder is stored as
home/nutch/crawl
    - crawldb
    - segments
    - index
    - indexes

point searcher.dir to home/nutch/crawl.
Hope this helps.

Thanks
Sudhi

Paul Stewart <[hidden email]> wrote: Thanks.... I was doing the java command wrong...

Back to my original problem - I re-ran throught the entire tutorial to
ensure I was doing it right and it seems proper.... How do I tell Nutch
where to look specifically in the code for the segments and indexes in
case it is in the wrong place?

All the best,
Paul
 

-----Original Message-----
From: sudhendra seshachala [mailto:[hidden email]]
Sent: Thursday, April 06, 2006 12:02 PM
To: [hidden email]
Subject: RE: Nutch 500 Error

It should be java -versionI think.

Paul Stewart
 wrote:  Thanks for the reply...
I apologize as I'm very new to the Java
world...:)

I am running the following:

Fedora Core 4
Apache Tomcat 5.5.16 (binary download from Tomcat site installed to
/usr/local/tomcat5)
jre1.5.0_06 (binary download from Sun site to /usr/java/jre1.5.0_06)

Weird though - when I try to do a java -v I get this now:

[root@spider jre1.5.0_06]# export JAVA_HOME=/usr/java/jre1.5.0_06/
[root@spider jre1.5.0_06]# /usr/java/jre1.5.0_06/bin/java -v
Unrecognized option: -v Could not create the Java virtual machine.

Is this my actual problem possibly? Or is this the wrong Java version to
be running? When I downloaded 1.4.x tomcat told me it didn't support
anything but 1.5.x

Thanks again for your patience...
Paul


-----Original Message-----
From: TDLN [mailto:[hidden email]]
Sent: Thursday, April 06, 2006 7:16 AM
To: [hidden email]
Subject: Re: Nutch 500 Error

What version are you on? If you trace the NullPointerException back to
the code, the NutchBean.init method is where it expects to find the
index and segments, so either they're missing (did you follow the
tutorial and merge your segment indexes?) or it is looking in the wrong
place. That's what I think.

Rgrds, Thomas



On 4/6/06, Paul Stewart
wrote:

> Thanks.. Tried that ... Same error....
>
> HTTP Status 500 -
>
> ----------------------------------------------------------------------
> --
> --------
>
> type Exception report
>
> message
>
> description The server encountered an internal error () that prevented

> it from fulfilling this request.
>
> exception
>
> org.apache.jasper.JasperException
>
> org.apache.jasper.servlet.JspServletWrapper.handleJspException(JspServ
> le
> tWrapper.java:510)
>
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.
> ja
> va:393)
>
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:31
> 4)
>
> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
>
> root cause
>
> java.lang.NullPointerException
> org.apache.nutch.searcher.NutchBean.init(NutchBean.java:96)
> org.apache.nutch.searcher.NutchBean.(NutchBean.java:82)
> org.apache.nutch.searcher.NutchBean.(NutchBean.java:72)
> org.apache.nutch.searcher.NutchBean.get(NutchBean.java:64)
> org.apache.jsp.search_jsp._jspService(search_jsp.java:112)
>
> org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.
> ja
> va:332)
>
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:31
> 4)
>
> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>
> -----Original Message-----
> From: TDLN [mailto:[hidden email]]
> Sent: Thursday, April 06, 2006 3:30 AM
> To: [hidden email]
> Subject: Re: Nutch 500 Error
>
> My guess is you have to override the searcher.dir property in
> nutch-site.xml and have it point to your crawl dir.
>
> Rgrds, Thomas
>
>
>
>



  Sudhi Seshachala
  http://sudhilogs.blogspot.com/
   


   
---------------------------------
Yahoo! Messenger with Voice. PC-to-Phone calls for ridiculously low
rates.




  Sudhi Seshachala
  http://sudhilogs.blogspot.com/
   


               
---------------------------------
Love cheap thrills? Enjoy PC-to-Phone  calls to 30+ countries for just 2ยข/min with Yahoo! Messenger with Voice.
Reply | Threaded
Open this post in threaded view
|

RE: Nutch 500 Error

Paul Stewart-5
In reply to this post by Paul Stewart-5
I may have found my problem but not sure....

Here's my /usr/local/nutch directory:

drwxr-xr-x   2 root root     4096 Apr  2 13:06 bin
-rw-rw-r--   1 root root    15567 Mar 31 13:40 build.xml
-rw-rw-r--   1 root root    19814 Mar 31 13:40 CHANGES.txt
drwxr-xr-x   2 root root     4096 Apr 12 08:47 conf
drwxr-xr-x   2 root root     4096 Apr  8 17:22 crawl
drwxr-xr-x   3 root root     4096 Apr  8 17:29 db
-rw-rw-r--   1 root root     1845 Mar 31 13:40 default.properties
drwxr-xr-x  19 root root     4096 Mar 31 13:40 docs
drwxr-xr-x   2 root root     4096 Apr  2 11:15 lib
-rw-rw-r--   1 root root      615 Mar 31 13:40 LICENSE.txt
-rw-rw-r--   1 root root   755034 Mar 31 13:40 nutch-0.7.2.jar
-rw-rw-r--   1 root root 15806453 Mar 31 13:40 nutch-0.7.2.war
drwxr-xr-x  26 root root     4096 Mar 31 13:40 plugins
-rw-rw-r--   1 root root      403 Mar 31 13:40 README.txt
drwxr-xr-x   4 root root     4096 Apr  8 17:28 segments
drwxr-xr-x  11 root root     4096 Mar 31 13:40 src
-rw-r--r--   1 root root       65 Apr  8 17:28 urls

My crawl directory is empty

My db directory is this:

[root@spider db]# ls -l
total 4
-rw-r--r--  1 root root    0 Apr  8 17:29 dbreadlock
-rw-r--r--  1 root root    0 Apr  8 17:29 dbwritelock
drwxr-xr-x  6 root root 4096 Apr  8 17:29 webdb

Inside webdb is this:

drwxr-xr-x  2 root root 4096 Apr  8 17:29 linksByMD5
drwxr-xr-x  2 root root 4096 Apr  8 17:29 linksByURL
drwxr-xr-x  2 root root 4096 Apr  8 17:29 pagesByMD5
drwxr-xr-x  2 root root 4096 Apr  8 17:29 pagesByURL
-rw-r--r--  1 root root   17 Apr  8 17:29 stats

Back in my /usr/local/nutch/segments directory I have:

drwxr-xr-x  8 root root 4096 Apr  8 17:30 20060408172630
drwxr-xr-x  8 root root 4096 Apr  8 17:30 20060408172823

So something must be wrong then if I use /usr/local/nutch as my
searcher.dir right?  Even though I'm sure I followed the tutorial I'm
obviously missing something...?

Thanks again.

Paul
 

-----Original Message-----
From: sudhendra seshachala [mailto:[hidden email]]
Sent: Tuesday, April 11, 2006 10:45 PM
To: [hidden email]
Subject: RE: Nutch 500 Error

check the nutch-default.xml
there should be a property searcher.dir
Provide the path for the index folder.
Better still copy the property node and paste it in nutch-site.xml
provide the path for the index folder.
For ex:
If the index folder is stored as
home/nutch/crawl
    - crawldb
    - segments
    - index
    - indexes

point searcher.dir to home/nutch/crawl.
Hope this helps.

Thanks
Sudhi

Paul Stewart <[hidden email]> wrote: Thanks.... I was doing
the java command wrong...

Back to my original problem - I re-ran throught the entire tutorial to
ensure I was doing it right and it seems proper.... How do I tell Nutch
where to look specifically in the code for the segments and indexes in
case it is in the wrong place?

All the best,
Paul