[jira] Created: (LUCENE-1171) Make DocumentsWriter more robust on hitting OOM

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

[jira] Created: (LUCENE-1171) Make DocumentsWriter more robust on hitting OOM

JIRA jira@apache.org
Make DocumentsWriter more robust on hitting OOM
-----------------------------------------------

                 Key: LUCENE-1171
                 URL: https://issues.apache.org/jira/browse/LUCENE-1171
             Project: Lucene - Java
          Issue Type: Bug
          Components: Index
    Affects Versions: 2.3
            Reporter: Michael McCandless
            Assignee: Michael McCandless
            Priority: Minor
             Fix For: 2.4


I've been stress testing DocumentsWriter by indexing wikipedia, but not
giving enough memory to the JVM, in varying heap sizes to tickle the
different interesting cases.  Sometimes DocumentsWriter can deadlock;
other times it will hit a subsequent NPE or AIOOBE or assertion
failure.

I've fixed all the cases I've found, and added some more asserts.  Now
it just produces plain OOM exceptions.  All changes are contained to
DocumentsWriter.java.

All tests pass.  I plan to commit in a day or two!

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (LUCENE-1171) Make DocumentsWriter more robust on hitting OOM

JIRA jira@apache.org

     [ https://issues.apache.org/jira/browse/LUCENE-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless updated LUCENE-1171:
---------------------------------------

    Attachment: LUCENE-1171.patch

Attached patch.

> Make DocumentsWriter more robust on hitting OOM
> -----------------------------------------------
>
>                 Key: LUCENE-1171
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1171
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: 2.3
>            Reporter: Michael McCandless
>            Assignee: Michael McCandless
>            Priority: Minor
>             Fix For: 2.4
>
>         Attachments: LUCENE-1171.patch
>
>
> I've been stress testing DocumentsWriter by indexing wikipedia, but not
> giving enough memory to the JVM, in varying heap sizes to tickle the
> different interesting cases.  Sometimes DocumentsWriter can deadlock;
> other times it will hit a subsequent NPE or AIOOBE or assertion
> failure.
> I've fixed all the cases I've found, and added some more asserts.  Now
> it just produces plain OOM exceptions.  All changes are contained to
> DocumentsWriter.java.
> All tests pass.  I plan to commit in a day or two!

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[jira] Resolved: (LUCENE-1171) Make DocumentsWriter more robust on hitting OOM

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

     [ https://issues.apache.org/jira/browse/LUCENE-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless resolved LUCENE-1171.
----------------------------------------

    Resolution: Fixed

> Make DocumentsWriter more robust on hitting OOM
> -----------------------------------------------
>
>                 Key: LUCENE-1171
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1171
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: 2.3
>            Reporter: Michael McCandless
>            Assignee: Michael McCandless
>            Priority: Minor
>             Fix For: 2.4
>
>         Attachments: LUCENE-1171.patch
>
>
> I've been stress testing DocumentsWriter by indexing wikipedia, but not
> giving enough memory to the JVM, in varying heap sizes to tickle the
> different interesting cases.  Sometimes DocumentsWriter can deadlock;
> other times it will hit a subsequent NPE or AIOOBE or assertion
> failure.
> I've fixed all the cases I've found, and added some more asserts.  Now
> it just produces plain OOM exceptions.  All changes are contained to
> DocumentsWriter.java.
> All tests pass.  I plan to commit in a day or two!

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]