Created: (SOLR-178) add simple servlet displaying last N severe/warning logs

classic Classic list List threaded Threaded
10 messages Options
Reply | Threaded
Open this post in threaded view
|

Created: (SOLR-178) add simple servlet displaying last N severe/warning logs

Sebastian Nagel (Jira)
add simple servlet displaying last N severe/warning logs
--------------------------------------------------------

                 Key: SOLR-178
                 URL: https://issues.apache.org/jira/browse/SOLR-178
             Project: Solr
          Issue Type: Wish
          Components: web gui
            Reporter: Hoss Man


From a discussion of masked errors when parsing hte schema/solrconfig...

http://www.nabble.com/merely-a-suggestion%3A-schema.xml-validator-or-better-schema-validation-logging-tf3331929.html


i've been thinking a Servlet that didn't depend on any special Solr code
(so it will work even if SolrCore isn't initialized) but registeres a log
handler and records the last N messages from Solr above a certain level
would be handy to refer people to when they are having issues and aren't
overly comfortable with log files.




--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

Commented: (SOLR-178) add simple servlet displaying last N severe/warning logs

Sebastian Nagel (Jira)

    [ https://issues.apache.org/jira/browse/SOLR-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12477722 ]

Yonik Seeley commented on SOLR-178:
-----------------------------------

Although this would help, sometimes people don't think to check log files, and they will also often forget to check this (or not know about it).
If we could also surface this on the admin pages (maybe even on the front page), it would help.  Not sure how feasible that would be though.

> add simple servlet displaying last N severe/warning logs
> --------------------------------------------------------
>
>                 Key: SOLR-178
>                 URL: https://issues.apache.org/jira/browse/SOLR-178
>             Project: Solr
>          Issue Type: Wish
>          Components: web gui
>            Reporter: Hoss Man
>
> From a discussion of masked errors when parsing hte schema/solrconfig...
> http://www.nabble.com/merely-a-suggestion%3A-schema.xml-validator-or-better-schema-validation-logging-tf3331929.html
> i've been thinking a Servlet that didn't depend on any special Solr code
> (so it will work even if SolrCore isn't initialized) but registeres a log
> handler and records the last N messages from Solr above a certain level
> would be handy to refer people to when they are having issues and aren't
> overly comfortable with log files.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

Commented: (SOLR-178) add simple servlet displaying last N severe/warning logs

Sebastian Nagel (Jira)
In reply to this post by Sebastian Nagel (Jira)

    [ https://issues.apache.org/jira/browse/SOLR-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12477725 ]

Ryan McKinley commented on SOLR-178:
------------------------------------

I recently wrote a similar servlet for a site i had to debug behind a firewall (i could not look at the logs).  It was a log4j appender that saved that last bunch of lines in memory and an AJAX interface that refreshed every couple seconds.  

If we go this route, i'd like to see a custom RequestHandler that accumulates the last N lines and spits the results back with the standard wt=json/xml etc.  This handler should have an interface to dynamically change the log level and number of lines saved.  Flare and other solr front ends may do something nice with this info.

Without getting out of hand, we could have the /admin landing page include an iframe that refreshes every couple seconds.

> add simple servlet displaying last N severe/warning logs
> --------------------------------------------------------
>
>                 Key: SOLR-178
>                 URL: https://issues.apache.org/jira/browse/SOLR-178
>             Project: Solr
>          Issue Type: Wish
>          Components: web gui
>            Reporter: Hoss Man
>
> From a discussion of masked errors when parsing hte schema/solrconfig...
> http://www.nabble.com/merely-a-suggestion%3A-schema.xml-validator-or-better-schema-validation-logging-tf3331929.html
> i've been thinking a Servlet that didn't depend on any special Solr code
> (so it will work even if SolrCore isn't initialized) but registeres a log
> handler and records the last N messages from Solr above a certain level
> would be handy to refer people to when they are having issues and aren't
> overly comfortable with log files.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

Commented: (SOLR-178) add simple servlet displaying last N severe/warning logs

Sebastian Nagel (Jira)
In reply to this post by Sebastian Nagel (Jira)

    [ https://issues.apache.org/jira/browse/SOLR-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12477729 ]

Hoss Man commented on SOLR-178:
-------------------------------

1) i agree, we should link to this from the admin page - i just want it to be fully functional without any other solr specific code loading (so it will work even if SolrCore doesn't init properly)

2) my main concern is that we have a uniform URL we can tell novice users to look at to get SERIOUS errors from solr -- they may not understand which log file the solr messages are getting sent to (or may have logging turned off completely)

3) it really shouldn't be a RequestHandler, because then it requires SolrCore to parse the solrconfig.xml properly ... we could have a RequestHandler that does something similar.

4) the log level is already configurable from the admin pages ... i'm not a big fan of that functionality actually, since (unless i'm mistaken) it affects the entire JVM -- not just hte solr webapp.



> add simple servlet displaying last N severe/warning logs
> --------------------------------------------------------
>
>                 Key: SOLR-178
>                 URL: https://issues.apache.org/jira/browse/SOLR-178
>             Project: Solr
>          Issue Type: Wish
>          Components: web gui
>            Reporter: Hoss Man
>
> From a discussion of masked errors when parsing hte schema/solrconfig...
> http://www.nabble.com/merely-a-suggestion%3A-schema.xml-validator-or-better-schema-validation-logging-tf3331929.html
> i've been thinking a Servlet that didn't depend on any special Solr code
> (so it will work even if SolrCore isn't initialized) but registeres a log
> handler and records the last N messages from Solr above a certain level
> would be handy to refer people to when they are having issues and aren't
> overly comfortable with log files.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

Commented: (SOLR-178) add simple servlet displaying last N severe/warning logs

Sebastian Nagel (Jira)
In reply to this post by Sebastian Nagel (Jira)

    [ https://issues.apache.org/jira/browse/SOLR-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12477730 ]

Yonik Seeley commented on SOLR-178:
-----------------------------------

> the log level is already configurable from the admin pages

I thought that had never worked.  Just tried it out on solr/example, doesn't seem to work for me.

> add simple servlet displaying last N severe/warning logs
> --------------------------------------------------------
>
>                 Key: SOLR-178
>                 URL: https://issues.apache.org/jira/browse/SOLR-178
>             Project: Solr
>          Issue Type: Wish
>          Components: web gui
>            Reporter: Hoss Man
>
> From a discussion of masked errors when parsing hte schema/solrconfig...
> http://www.nabble.com/merely-a-suggestion%3A-schema.xml-validator-or-better-schema-validation-logging-tf3331929.html
> i've been thinking a Servlet that didn't depend on any special Solr code
> (so it will work even if SolrCore isn't initialized) but registeres a log
> handler and records the last N messages from Solr above a certain level
> would be handy to refer people to when they are having issues and aren't
> overly comfortable with log files.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

Re: Commented: (SOLR-178) add simple servlet displaying last N severe/warning logs

Chris Hostetter-3
: Yonik Seeley commented on SOLR-178:
: -----------------------------------
:
: > the log level is already configurable from the admin pages
:
: I thought that had never worked.  Just tried it out on solr/example,
: doesn't seem to work for me.

really? ... that's weird, it's always worked fine for me ... i just tried
it with the jetty example and it seemd to work fine:
   1) turned logging off complete
   2) triggered errors (which were totally silent in the jetty log
   3) turned it back on to ALL
   4) saw everything getting logged including requests at INFO
   5) set it to WARNING
   6) saw exceptions geting loged from malformed queries, but not INFO on
request.



-Hoss

Reply | Threaded
Open this post in threaded view
|

Re: Commented: (SOLR-178) add simple servlet displaying last N severe/warning logs

Yonik Seeley-2
On 3/4/07, Chris Hostetter <[hidden email]> wrote:

> : Yonik Seeley commented on SOLR-178:
> : -----------------------------------
> :
> : > the log level is already configurable from the admin pages
> :
> : I thought that had never worked.  Just tried it out on solr/example,
> : doesn't seem to work for me.
>
> really? ... that's weird, it's always worked fine for me ... i just tried
> it with the jetty example and it seemd to work fine:

I tested by turning it to "ALL" but I still never saw anything above "INFO".
I just tried turning down the logging instead of up, and it does seem to work.

-Yonik
Reply | Threaded
Open this post in threaded view
|

Re: Commented: (SOLR-178) add simple servlet displaying last N severe/warning logs

Chris Hostetter-3

: I tested by turning it to "ALL" but I still never saw anything above "INFO".

i don't think we use CONFIG, or any of the FINE level's very much in
the Solr code base .. so that's not that surpising.



-Hoss

Reply | Threaded
Open this post in threaded view
|

Re: Commented: (SOLR-178) add simple servlet displaying last N severe/warning logs

Yonik Seeley-2
On 3/4/07, Chris Hostetter <[hidden email]> wrote:
>
> : I tested by turning it to "ALL" but I still never saw anything above "INFO".
>
> i don't think we use CONFIG, or any of the FINE level's very much in
> the Solr code base .. so that's not that surpising.

I tried queries and updates though, and I saw nothing above INFO.
I should have seen something like
        log.finest("SolrCore.update(add)");

-Yonik
Reply | Threaded
Open this post in threaded view
|

Re: Commented: (SOLR-178) add simple servlet displaying last N severe/warning logs

Chris Hostetter-3

: I tried queries and updates though, and I saw nothing above INFO.
: I should have seen something like
:         log.finest("SolrCore.update(add)");

hmmm... yeah, not sure about that ... there's a lot of layers to
java.util.logging that i've never fully apreciated ... i bet it has to do
with the default Level of the COnsoleHandler ... all the GUI does is
change the log level for the Logger, the Handlers are seperate.

(looking at the ConsolHandler javadocs is does mention the default level
of what it will publish is INFO so i think thta is it)

personally i think that's not so bad ... mucking with the Logger is one
thing ... trying to find all possble Handlers for our log messages and
change them too is too much.


-Hoss