[jira] Created: (SOLR-1912) Replication handler should offer more useful status messages, especially during fsync/commit/etc.

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

[jira] Created: (SOLR-1912) Replication handler should offer more useful status messages, especially during fsync/commit/etc.

JIRA jira@apache.org
Replication handler should offer more useful status messages, especially during fsync/commit/etc.
-------------------------------------------------------------------------------------------------

                 Key: SOLR-1912
                 URL: https://issues.apache.org/jira/browse/SOLR-1912
             Project: Solr
          Issue Type: Improvement
          Components: replication (java)
    Affects Versions: 1.4
            Reporter: Chris Harris
         Attachments: SOLR-1912.patch

If you go to the replication admin page (<a href="http://server:port/solr/core/admin/replication/index.jsp">http://server:port/solr/core/admin/replication/index.jsp) while replication is in progress, then you'll see a "Current Replication Status" section, which indicates how far along the replication download is, both overall and for the current file. It's great to see this status info. However, the replication admin page becomes misleading once the last file has been downloaded. In particular, after all downloads are complete Solr 1.4 continues to display things like this:

{quote}
Downloading File: _wv_1.del, Downloaded: 44 bytes / 44 bytes [100.0%]
{quote}

until all the index copying, fsync-ing, committing, and so on are complete. It gives the disconcerting impression that data transfer between master and slaves has mysteriously stalled right at the end of a 44 byte download. In case this is weird, let me mention that after a full replication I did just now, Solr spent quite a while in SnapPuller.terminateAndWaitFsyncService(), somewhere between many seconds and maybe 5 minutes.

I propose that the admin page should offer more useful status messages while fsync/etc. are going on. I offer an initial patch that does this. SnapPuller is modified to always offer a human readable indication of the "current operation", and this is displayed on the replication page. We also stop showing progress indication for the "current file", except when there actually is a file currently being downloaded.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (SOLR-1912) Replication handler should offer more useful status messages, especially during fsync/commit/etc.

JIRA jira@apache.org

     [ https://issues.apache.org/jira/browse/SOLR-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris Harris updated SOLR-1912:
-------------------------------

    Attachment: SOLR-1912.patch

> Replication handler should offer more useful status messages, especially during fsync/commit/etc.
> -------------------------------------------------------------------------------------------------
>
>                 Key: SOLR-1912
>                 URL: https://issues.apache.org/jira/browse/SOLR-1912
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication (java)
>    Affects Versions: 1.4
>            Reporter: Chris Harris
>         Attachments: SOLR-1912.patch
>
>
> If you go to the replication admin page (<a href="http://server:port/solr/core/admin/replication/index.jsp">http://server:port/solr/core/admin/replication/index.jsp) while replication is in progress, then you'll see a "Current Replication Status" section, which indicates how far along the replication download is, both overall and for the current file. It's great to see this status info. However, the replication admin page becomes misleading once the last file has been downloaded. In particular, after all downloads are complete Solr 1.4 continues to display things like this:
> {quote}
> Downloading File: _wv_1.del, Downloaded: 44 bytes / 44 bytes [100.0%]
> {quote}
> until all the index copying, fsync-ing, committing, and so on are complete. It gives the disconcerting impression that data transfer between master and slaves has mysteriously stalled right at the end of a 44 byte download. In case this is weird, let me mention that after a full replication I did just now, Solr spent quite a while in SnapPuller.terminateAndWaitFsyncService(), somewhere between many seconds and maybe 5 minutes.
> I propose that the admin page should offer more useful status messages while fsync/etc. are going on. I offer an initial patch that does this. SnapPuller is modified to always offer a human readable indication of the "current operation", and this is displayed on the replication page. We also stop showing progress indication for the "current file", except when there actually is a file currently being downloaded.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]