distributed grouping by date

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

distributed grouping by date

Tomáš Hampl
Hi,

i have error while running grouping query by date in collection with 5
shards. When i try same query on collection with only one shard everything
works.

*query:*

/solr/search_cz/select?q=*:*&group=true&group.field=odjezd

*part of schema.xml*

<fieldType name="date" class="solr.DatePointField" omitNorms="true"
positionIncrementGap="0"/>

...

<field name="odjezd" type="date" indexed="true" stored="true"/>

*collection create *

/solr/admin/collections\?action\=CREATE\&autoAddReplicas\=true\&collection.configName\=search_cz\&maxShardsPerNode\=5\&name\=search_cz\&numShards\=5\&replicationFactor\=1\&router.field\=routing_key\&
router.name\=compositeId\&rule\=shard:\*,replica:\<2,node:\*


*stacktrace:*

org.apache.solr.common.SolrException: Invalid Date String:'Wed Nov 21
12:45:00 UTC 2018'
        at org.apache.solr.util.DateMathParser.parseMath(DateMathParser.java:247)
        at org.apache.solr.util.DateMathParser.parseMath(DateMathParser.java:226)
        at org.apache.solr.schema.DatePointField.toNativeType(DatePointField.java:113)
        at org.apache.solr.schema.DatePointField.readableToIndexed(DatePointField.java:184)
        at org.apache.solr.search.grouping.distributed.command.GroupConverter.fromMutable(GroupConverter.java:57)
        at org.apache.solr.search.grouping.distributed.command.SearchGroupsFieldCommand.result(SearchGroupsFieldCommand.java:128)
        at org.apache.solr.search.grouping.distributed.shardresultserializer.SearchGroupsResultTransformer.transform(SearchGroupsResultTransformer.java:55)
        at org.apache.solr.search.grouping.distributed.shardresultserializer.SearchGroupsResultTransformer.transform(SearchGroupsResultTransformer.java:37)
        at org.apache.solr.search.grouping.CommandHandler.processResult(CommandHandler.java:208)
        at org.apache.solr.handler.component.QueryComponent.doProcessGroupedDistributedSearchFirstPhase(QueryComponent.java:1282)
        at org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:360)
        at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:298)
        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
        at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:709)
        at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:515)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:377)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:323)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146)
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:219)
        at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:531)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
        at java.base/java.lang.Thread.run(Thread.java:844)


Thanks four your help

--
Tomáš Hampl
Mob.: +420774850702
E-Mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

Re: distributed grouping by date

Erick Erickson
Looks like: https://issues.apache.org/jira/browse/SOLR-11086
On Tue, Nov 6, 2018 at 8:19 AM Tomáš Hampl <[hidden email]> wrote:

>
> Hi,
>
> i have error while running grouping query by date in collection with 5
> shards. When i try same query on collection with only one shard everything
> works.
>
> *query:*
>
> /solr/search_cz/select?q=*:*&group=true&group.field=odjezd
>
> *part of schema.xml*
>
> <fieldType name="date" class="solr.DatePointField" omitNorms="true"
> positionIncrementGap="0"/>
>
> ...
>
> <field name="odjezd" type="date" indexed="true" stored="true"/>
>
> *collection create *
>
> /solr/admin/collections\?action\=CREATE\&autoAddReplicas\=true\&collection.configName\=search_cz\&maxShardsPerNode\=5\&name\=search_cz\&numShards\=5\&replicationFactor\=1\&router.field\=routing_key\&
> router.name\=compositeId\&rule\=shard:\*,replica:\<2,node:\*
>
>
> *stacktrace:*
>
> org.apache.solr.common.SolrException: Invalid Date String:'Wed Nov 21
> 12:45:00 UTC 2018'
>         at org.apache.solr.util.DateMathParser.parseMath(DateMathParser.java:247)
>         at org.apache.solr.util.DateMathParser.parseMath(DateMathParser.java:226)
>         at org.apache.solr.schema.DatePointField.toNativeType(DatePointField.java:113)
>         at org.apache.solr.schema.DatePointField.readableToIndexed(DatePointField.java:184)
>         at org.apache.solr.search.grouping.distributed.command.GroupConverter.fromMutable(GroupConverter.java:57)
>         at org.apache.solr.search.grouping.distributed.command.SearchGroupsFieldCommand.result(SearchGroupsFieldCommand.java:128)
>         at org.apache.solr.search.grouping.distributed.shardresultserializer.SearchGroupsResultTransformer.transform(SearchGroupsResultTransformer.java:55)
>         at org.apache.solr.search.grouping.distributed.shardresultserializer.SearchGroupsResultTransformer.transform(SearchGroupsResultTransformer.java:37)
>         at org.apache.solr.search.grouping.CommandHandler.processResult(CommandHandler.java:208)
>         at org.apache.solr.handler.component.QueryComponent.doProcessGroupedDistributedSearchFirstPhase(QueryComponent.java:1282)
>         at org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:360)
>         at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:298)
>         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
>         at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:709)
>         at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:515)
>         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:377)
>         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:323)
>         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634)
>         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
>         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146)
>         at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
>         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
>         at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)
>         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
>         at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
>         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
>         at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
>         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
>         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
>         at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
>         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
>         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
>         at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:219)
>         at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126)
>         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
>         at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
>         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
>         at org.eclipse.jetty.server.Server.handle(Server.java:531)
>         at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
>         at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
>         at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
>         at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
>         at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
>         at java.base/java.lang.Thread.run(Thread.java:844)
>
>
> Thanks four your help
>
> --
> Tomáš Hampl
> Mob.: +420774850702
> E-Mail: [hidden email]