autowarmcount how to check if cache has been warmed up

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

autowarmcount how to check if cache has been warmed up

sunnyShiny06
Hi,

Is it possible to have autowarmcount=500 with warmupTime=2751 and size=5, where can I check up if the cache is full or not cuz really there it looks empty still??? and commitment is done.
solr1.4

thanks for your help,
sunny

name: queryResultCache  
class: org.apache.solr.search.FastLRUCache  
version: 1.0  
description: Concurrent LRU Cache(maxSize=14774644, initialSize=14774644, minSize=13297179, acceptableSize=14035911, cleanupThread=false, autowarmCount=500, regenerator=org.apache.solr.search.SolrIndexSearcher$3@6e4eeaaf)  
stats: lookups : 0
hits : 0
hitratio : 0.00
inserts : 0
evictions : 0
size : 5
warmupTime : 2751
cumulative_lookups : 0
cumulative_hits : 0
cumulative_hitratio : 0.00
cumulative_inserts : 0
cumulative_evictions : 0
Reply | Threaded
Open this post in threaded view
|

Re: autowarmcount how to check if cache has been warmed up

Shalin Shekhar Mangar
On Tue, Apr 21, 2009 at 7:24 PM, sunnyfr <[hidden email]> wrote:

>
> Is it possible to have autowarmcount=500 with warmupTime=2751 and size=5,
> where can I check up if the cache is full or not cuz really there it looks
> empty still??? and commitment is done.
> solr1.4


This means that Solr ran 5 queries on a new index in 2751 milliseconds.

--
Regards,
Shalin Shekhar Mangar.
Reply | Threaded
Open this post in threaded view
|

Re: autowarmcount how to check if cache has been warmed up

sunnyShiny06
thanks Shalin,

How come just 5 if my autowarmCount=500 ?
Reply | Threaded
Open this post in threaded view
|

Re: autowarmcount how to check if cache has been warmed up

Shalin Shekhar Mangar
On Wed, Apr 22, 2009 at 2:05 PM, sunnyfr <[hidden email]> wrote:

>
> thanks Shalin,
>
> How come just 5 if my autowarmCount=500 ?
>

Maybe the cache did not have more than 5 items before the commit?

Actually, the cumulative_inserts=0 so I think Solr was just started up?

--
Regards,
Shalin Shekhar Mangar.
Reply | Threaded
Open this post in threaded view
|

Re: autowarmcount how to check if cache has been warmed up

sunnyShiny06
yes but let me check again ... but the delta-import was lidle and I think warmup was done is the log .. i will check it again now and let you know.


Shalin Shekhar Mangar wrote
On Wed, Apr 22, 2009 at 2:05 PM, sunnyfr <johanna.34@gmail.com> wrote:

>
> thanks Shalin,
>
> How come just 5 if my autowarmCount=500 ?
>

Maybe the cache did not have more than 5 items before the commit?

Actually, the cumulative_inserts=0 so I think Solr was just started up?

--
Regards,
Shalin Shekhar Mangar.
Reply | Threaded
Open this post in threaded view
|

Re: autowarmcount how to check if cache has been warmed up

sunnyShiny06
In reply to this post by sunnyShiny06
still the same ?

Seems done :
lookups : 0
hits : 0
hitratio : 0.00
inserts : 0
evictions : 0
size : 5
warmupTime : 20973
cumulative_lookups : 0
cumulative_hits : 0
cumulative_hitratio : 0.00
cumulative_inserts : 0
cumulative_evictions : 0


Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming Searcher@48b6c333 main from Searcher@79e79d96 main ^IfieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for Searcher@48b6c333 main ^IfieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming Searcher@48b6c333 main from Searcher@79e79d96 main ^IfilterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for Searcher@48b6c333 main ^IfilterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming Searcher@48b6c333 main from Searcher@79e79d96 main ^IqueryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=5,warmupTime=3055,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for Searcher@48b6c333 main ^IqueryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=5,warmupTime=20973,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM org.apache.solr.core.QuerySenderListener newSearcher INFO: QuerySenderListener sending requests to Searcher@48b6c333 main
Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM org.apache.solr.core.SolrCore execute INFO: [video] webapp=null path=null params={start=0&q=solr&rows=100} hits=164 status=0 QTime=0
Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM org.apache.solr.core.SolrCore execute INFO: [video] webapp=null path=null params={start=0&q=rocks&rows=100} hits=167581 status=0 QTime=51
Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM org.apache.solr.core.SolrCore execute INFO: [video] webapp=null path=null params={sort=id+desc&q=anything} hits=8419 status=0 QTime=50
Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM org.apache.solr.core.QuerySenderListener newSearcher INFO: QuerySenderListener done.
Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM org.apache.solr.core.SolrCore registerSearcher INFO: [video] Registered new searcher Searcher@48b6c333 main
Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM org.apache.solr.search.SolrIndexSearcher close INFO: Closing Searcher@79e79d96 main ^IfieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} ^IfilterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} ^IqueryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=5,warmupTime=3055,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM org.apache.solr.handler.dataimport.SolrWriter readIndexerProperties INFO: Read dataimport.properties
Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM org.apache.solr.handler.dataimport.SolrWriter persist INFO: Wrote last indexed time to dataimport.properties
Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM org.apache.solr.handler.dataimport.DocBuilder execute INFO: Time taken = 0:9:49.967
Apr 22 11:10:49 search-01 jsvc.exec[31908]: Apr 22, 2009 11:10:49 AM org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr path=/dataimport params={} status=0 QTime=0
Apr 22 11:15:02 search-01 /USR/SBIN/CRON[27736]: (root) CMD ([ -x /usr/lib/sysstat/sa1 ] && { [ -r "$DEFAULT" ] && . "$DEFAULT" ; [ "$ENABLED" = "true" ] && exec /usr/lib/sysstat/sa1 $SA1_OPTIONS 1 1 ; })
Apr 22 11:
Reply | Threaded
Open this post in threaded view
|

Re: autowarmcount how to check if cache has been warmed up

sunnyShiny06
It looks like it doesnt warm up, no?


sunnyfr wrote
still the same ?

Seems done :
lookups : 0
hits : 0
hitratio : 0.00
inserts : 0
evictions : 0
size : 5
warmupTime : 20973
cumulative_lookups : 0
cumulative_hits : 0
cumulative_hitratio : 0.00
cumulative_inserts : 0
cumulative_evictions : 0


Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming Searcher@48b6c333 main from Searcher@79e79d96 main ^IfieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for Searcher@48b6c333 main ^IfieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming Searcher@48b6c333 main from Searcher@79e79d96 main ^IfilterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for Searcher@48b6c333 main ^IfilterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming Searcher@48b6c333 main from Searcher@79e79d96 main ^IqueryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=5,warmupTime=3055,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for Searcher@48b6c333 main ^IqueryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=5,warmupTime=20973,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM org.apache.solr.core.QuerySenderListener newSearcher INFO: QuerySenderListener sending requests to Searcher@48b6c333 main
Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM org.apache.solr.core.SolrCore execute INFO: [video] webapp=null path=null params={start=0&q=solr&rows=100} hits=164 status=0 QTime=0
Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM org.apache.solr.core.SolrCore execute INFO: [video] webapp=null path=null params={start=0&q=rocks&rows=100} hits=167581 status=0 QTime=51
Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM org.apache.solr.core.SolrCore execute INFO: [video] webapp=null path=null params={sort=id+desc&q=anything} hits=8419 status=0 QTime=50
Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM org.apache.solr.core.QuerySenderListener newSearcher INFO: QuerySenderListener done.
Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM org.apache.solr.core.SolrCore registerSearcher INFO: [video] Registered new searcher Searcher@48b6c333 main
Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM org.apache.solr.search.SolrIndexSearcher close INFO: Closing Searcher@79e79d96 main ^IfieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} ^IfilterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} ^IqueryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=5,warmupTime=3055,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM org.apache.solr.handler.dataimport.SolrWriter readIndexerProperties INFO: Read dataimport.properties
Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM org.apache.solr.handler.dataimport.SolrWriter persist INFO: Wrote last indexed time to dataimport.properties
Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM org.apache.solr.handler.dataimport.DocBuilder execute INFO: Time taken = 0:9:49.967
Apr 22 11:10:49 search-01 jsvc.exec[31908]: Apr 22, 2009 11:10:49 AM org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr path=/dataimport params={} status=0 QTime=0
Apr 22 11:15:02 search-01 /USR/SBIN/CRON[27736]: (root) CMD ([ -x /usr/lib/sysstat/sa1 ] && { [ -r "$DEFAULT" ] && . "$DEFAULT" ; [ "$ENABLED" = "true" ] && exec /usr/lib/sysstat/sa1 $SA1_OPTIONS 1 1 ; })
Apr 22 11:
Reply | Threaded
Open this post in threaded view
|

Re: autowarmcount how to check if cache has been warmed up

Shalin Shekhar Mangar
In reply to this post by sunnyShiny06
OK, lets try this:

1. Before a commit, check the stats page, see if the size is more than 5
2. Then call commit, and verify that the size is more than 5

If the original size was > 5, then you should have size > 5 after
autowarming too.

On Wed, Apr 22, 2009 at 2:57 PM, sunnyfr <[hidden email]> wrote:

>
> still the same ?
>
> Seems done :
> lookups : 0
> hits : 0
> hitratio : 0.00
> inserts : 0
> evictions : 0
> size : 5
> warmupTime : 20973
> cumulative_lookups : 0
> cumulative_hits : 0
> cumulative_hitratio : 0.00
> cumulative_inserts : 0
> cumulative_evictions : 0
>
>
> Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM
> org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming
> Searcher@48b6c333 main from Searcher@79e79d96 main
>
> ^IfieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM
> org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for
> Searcher@48b6c333 main
>
> ^IfieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM
> org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming
> Searcher@48b6c333 main from Searcher@79e79d96 main
>
> ^IfilterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM
> org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for
> Searcher@48b6c333 main
>
> ^IfilterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM
> org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming
> Searcher@48b6c333 main from Searcher@79e79d96 main
>
> ^IqueryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=5,warmupTime=3055,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM
> org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for
> Searcher@48b6c333 main
>
> ^IqueryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=5,warmupTime=20973,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM
> org.apache.solr.core.QuerySenderListener newSearcher INFO:
> QuerySenderListener sending requests to Searcher@48b6c333 main
> Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM
> org.apache.solr.core.SolrCore execute INFO: [video] webapp=null path=null
> params={start=0&q=solr&rows=100} hits=164 status=0 QTime=0
> Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM
> org.apache.solr.core.SolrCore execute INFO: [video] webapp=null path=null
> params={start=0&q=rocks&rows=100} hits=167581 status=0 QTime=51
> Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM
> org.apache.solr.core.SolrCore execute INFO: [video] webapp=null path=null
> params={sort=id+desc&q=anything} hits=8419 status=0 QTime=50
> Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM
> org.apache.solr.core.QuerySenderListener newSearcher INFO:
> QuerySenderListener done.
> Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM
> org.apache.solr.core.SolrCore registerSearcher INFO: [video] Registered new
> searcher Searcher@48b6c333 main
> Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM
> org.apache.solr.search.SolrIndexSearcher close INFO: Closing
> Searcher@79e79d96 main
>
> ^IfieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
>
> ^IfilterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
>
> ^IqueryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=5,warmupTime=3055,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM
> org.apache.solr.handler.dataimport.SolrWriter readIndexerProperties INFO:
> Read dataimport.properties
> Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM
> org.apache.solr.handler.dataimport.SolrWriter persist INFO: Wrote last
> indexed time to dataimport.properties
> Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM
> org.apache.solr.handler.dataimport.DocBuilder execute INFO: Time taken =
> 0:9:49.967
> Apr 22 11:10:49 search-01 jsvc.exec[31908]: Apr 22, 2009 11:10:49 AM
> org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
> path=/dataimport params={} status=0 QTime=0
> Apr 22 11:15:02 search-01 /USR/SBIN/CRON[27736]: (root) CMD ([ -x
> /usr/lib/sysstat/sa1 ] && { [ -r "$DEFAULT" ] && . "$DEFAULT" ; [
> "$ENABLED"
> = "true" ] && exec /usr/lib/sysstat/sa1 $SA1_OPTIONS 1 1 ; })
> Apr 22 11:
> --
> View this message in context:
> http://www.nabble.com/autowarmcount-how-to-check-if-cache-has-been-warmed-up-tp23156612p23172792.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>


--
Regards,
Shalin Shekhar Mangar.
Reply | Threaded
Open this post in threaded view
|

Re: autowarmcount how to check if cache has been warmed up

sunnyShiny06
Ok I've an error :


Apr 24 09:28:41 search-01 jsvc.exec[8033]: :907) ^Iat java.lang.Thread.run(Thread.java:619)
Apr 24 09:29:20 search-01 jsvc.exec[8033]: Apr 24, 2009 9:29:20 AM org.apache.solr.common.SolrException log SEVERE: Error during auto-warming of key:org.apache.solr.search.QueryResultKey@cb278b97:java.lang.OutOfMemoryError: Java heap space ^Iat org.apache.lucene.search.FieldCacheImpl$10.createValue(FieldCacheImpl.java:410) ^Iat org.apache.lucene.search.FieldCacheImpl$Cache.get(FieldCacheImpl.java:71) ^Iat org.apache.lucene.search.FieldCacheImpl.getStringIndex(FieldCacheImpl.java:359) ^Iat org.apache.solr.search.function.ReverseOrdFieldSource.getValues(ReverseOrdFieldSource.java:55) ^Iat org.apache.solr.search.function.ReciprocalFloatFunction.getValues(ReciprocalFloatFunction.java:56) ^Iat org.apache.solr.search.function.FunctionQuery$AllScorer.<init>(FunctionQuery.java:105) ^Iat org.apache.solr.search.function.FunctionQuery$FunctionWeight.scorer(FunctionQuery.java:81) ^Iat org.apache.lucene.search.BooleanQuery$BooleanWeight.scorer(BooleanQuery.java:231) ^Iat org.apache.lucene.search.IndexSearcher.doSearch(IndexSearc
Apr 24 09:29:20 search-01 jsvc.exec[8033]: ndexSearcher.search(IndexSearcher.java:250) ^Iat org.apache.lucene.search.Searcher.search(Searcher.java:126) ^Iat org.apache.lucene.search.Searcher.search(Searcher.java:105) ^Iat org.apache.solr.search.SolrIndexSearcher.getDocListNC(SolrIndexSearcher.java:1072) ^Iat org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:928) ^Iat org.apache.solr.search.SolrIndexSearcher.access$000(SolrIndexSearcher.java:59) ^Iat org.apache.solr.search.SolrIndexSearcher$3.regenerateItem(SolrIndexSearcher.java:336) ^Iat org.apache.solr.search.FastLRUCache.warm(FastLRUCache.java:150) ^Iat org.apache.solr.search.SolrIndexSearcher.warm(SolrIndexSearcher.java:1646) ^Iat org.apache.solr.core.SolrCore$3.call(SolrCore.java:1147) ^Iat java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) ^Iat java.util.concurrent.FutureTask.run(FutureTask.java:138) ^Iat java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885) ^Iat java.util.concurrent.Threa
Apr 24 09:29:20 search-01 jsvc.exec[8033]: :907) ^Iat java.lang.Thread.run(Thread.java:619)
Apr 24 09:30:00 search-01 jsvc.exec[8033]: Apr 24, 2009 9:30:00 AM org.apache.solr.common.SolrException log SEVERE: Error during auto-warming of key:org.apache.solr.search.QueryResultKey@2b729b52:java.lang.OutOfMemoryError: Java heap space
Apr 24 09:30:10 search-01 jsvc.exec[8033]: Apr 24, 2009 9:30:10 AM org.apache.solr.update.DirectUpdateHandler2 commit INFO: start commit(optimize=false,waitFlush=false,waitSearcher=true)
Apr 24 09:30:10 search-01 jsvc.exec[8033]: Apr 24, 2009 9:30:10 AM org.apache.solr.core.SolrCore getSearcher INFO: [video] PERFORMANCE WARNING: Overlapping onDeckSearchers=2
Apr 24 09:30:10 search-01 jsvc.exec[8033]: Apr 24, 2009 9:30:10 AM org.apache.solr.search.SolrIndexSearcher <init> INFO: Opening Searcher@21df6b4f main
Apr 24 09:30:11 search-01 jsvc.exec[8033]: Apr 24, 2009 9:30:11 AM org.apache.solr.update.DirectUpdateHandler2 commit INFO: end_commit_flush



Shalin Shekhar Mangar wrote
OK, lets try this:

1. Before a commit, check the stats page, see if the size is more than 5
2. Then call commit, and verify that the size is more than 5

If the original size was > 5, then you should have size > 5 after
autowarming too.

On Wed, Apr 22, 2009 at 2:57 PM, sunnyfr <johanna.34@gmail.com> wrote:

>
> still the same ?
>
> Seems done :
> lookups : 0
> hits : 0
> hitratio : 0.00
> inserts : 0
> evictions : 0
> size : 5
> warmupTime : 20973
> cumulative_lookups : 0
> cumulative_hits : 0
> cumulative_hitratio : 0.00
> cumulative_inserts : 0
> cumulative_evictions : 0
>
>
> Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM
> org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming
> Searcher@48b6c333 main from Searcher@79e79d96 main
>
> ^IfieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM
> org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for
> Searcher@48b6c333 main
>
> ^IfieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM
> org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming
> Searcher@48b6c333 main from Searcher@79e79d96 main
>
> ^IfilterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM
> org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for
> Searcher@48b6c333 main
>
> ^IfilterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:29 AM
> org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming
> Searcher@48b6c333 main from Searcher@79e79d96 main
>
> ^IqueryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=5,warmupTime=3055,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM
> org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for
> Searcher@48b6c333 main
>
> ^IqueryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=5,warmupTime=20973,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM
> org.apache.solr.core.QuerySenderListener newSearcher INFO:
> QuerySenderListener sending requests to Searcher@48b6c333 main
> Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM
> org.apache.solr.core.SolrCore execute INFO: [video] webapp=null path=null
> params={start=0&q=solr&rows=100} hits=164 status=0 QTime=0
> Apr 22 11:09:50 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:50 AM
> org.apache.solr.core.SolrCore execute INFO: [video] webapp=null path=null
> params={start=0&q=rocks&rows=100} hits=167581 status=0 QTime=51
> Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM
> org.apache.solr.core.SolrCore execute INFO: [video] webapp=null path=null
> params={sort=id+desc&q=anything} hits=8419 status=0 QTime=50
> Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM
> org.apache.solr.core.QuerySenderListener newSearcher INFO:
> QuerySenderListener done.
> Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM
> org.apache.solr.core.SolrCore registerSearcher INFO: [video] Registered new
> searcher Searcher@48b6c333 main
> Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM
> org.apache.solr.search.SolrIndexSearcher close INFO: Closing
> Searcher@79e79d96 main
>
> ^IfieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
>
> ^IfilterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
>
> ^IqueryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=5,warmupTime=3055,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM
> org.apache.solr.handler.dataimport.SolrWriter readIndexerProperties INFO:
> Read dataimport.properties
> Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM
> org.apache.solr.handler.dataimport.SolrWriter persist INFO: Wrote last
> indexed time to dataimport.properties
> Apr 22 11:09:51 search-01 jsvc.exec[31908]: Apr 22, 2009 11:09:51 AM
> org.apache.solr.handler.dataimport.DocBuilder execute INFO: Time taken =
> 0:9:49.967
> Apr 22 11:10:49 search-01 jsvc.exec[31908]: Apr 22, 2009 11:10:49 AM
> org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
> path=/dataimport params={} status=0 QTime=0
> Apr 22 11:15:02 search-01 /USR/SBIN/CRON[27736]: (root) CMD ([ -x
> /usr/lib/sysstat/sa1 ] && { [ -r "$DEFAULT" ] && . "$DEFAULT" ; [
> "$ENABLED"
> = "true" ] && exec /usr/lib/sysstat/sa1 $SA1_OPTIONS 1 1 ; })
> Apr 22 11:
> --
> View this message in context:
> http://www.nabble.com/autowarmcount-how-to-check-if-cache-has-been-warmed-up-tp23156612p23172792.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>


--
Regards,
Shalin Shekhar Mangar.