[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster

JIRA jira@apache.org

    [ https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16749848#comment-16749848 ]

Andrzej Bialecki  commented on SOLR-13155:
------------------------------------------

This patch implements a tool for getting the current suggestions / diagnostics and/or testing the current cluster against the supplied autoscaling configuration.

The tool is integrated into the SolrCLI suite, and hooked up to the {{bin/solr autoscaling}} script.

One notable addition is a method in {{RedactionUtils}} for replacing collection names and node names / IPs in the output data. You can see it in action when you invoke the tool with the {{-r}} option:

{code}
...
{
  "liveNodes":[
    "N_1_solr",
    "N_0_solr"],
  "violations":[
    {
      "collection":"COLL_0",
      "node":"N_1_solr",
      "tagKey":"N_1_solr",
      "violation":{
        "replica":{
          "NRT":2,
          "count":2},
        "delta":1.0},
      "clause":{
        "replica":"<2",
        "shard":"#ANY",
        "node":"#ANY",
        "collection":"COLL_0"},
      "violatingReplicas":[
        {"core_node7":{
            "core":"COLL_0_shard2_replica_n3",
            "shard":"shard2",
            "collection":"COLL_0",
            "node_name":"N_1_solr",
            "type":"NRT",
            "leader":"true",
            "base_url":"http://N_1/solr",
            "state":"active",
            "force_set_state":"false",
            "INDEX.sizeInGB":6.426125764846802E-8}},
        {"core_node6":{
            "core":"COLL_0_shard1_replica_n2",
            "shard":"shard1",
            "collection":"COLL_0",
            "node_name":"N_1_solr",
            "type":"NRT",
            "leader":"true",
            "base_url":"http://N_1/solr",
            "state":"active",
            "force_set_state":"false",
            "INDEX.sizeInGB":6.426125764846802E-8}}]},
...
{code}

TODO: hook up the tool to the Windows scripts. My {{COMMAND.COM}}-fu is nearly nonexistent ;)

> CLI tool for testing autoscaling suggestions against a live cluster
> -------------------------------------------------------------------
>
>                 Key: SOLR-13155
>                 URL: https://issues.apache.org/jira/browse/SOLR-13155
>             Project: Solr
>          Issue Type: Improvement
>      Security Level: Public(Default Security Level. Issues are Public)
>          Components: AutoScaling
>            Reporter: Andrzej Bialecki
>            Assignee: Andrzej Bialecki
>            Priority: Major
>             Fix For: 8.0, master (9.0)
>
>         Attachments: SOLR-13155.patch
>
>
> Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions endpoints. In some situations it would be very helpful to be able to run "what if" scenarios using data about nodes and replicas taken from a production cluster but with a different autoscaling policy than the one that is deployed, without also worrying that the calculations would negatively impact a production cluster's Overseer leader.
> All necessary classes (including the Policy engine) are self-contained in the SolrJ component, so it's just a matter of packaging and writing a CLI tool + a wrapper script.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]