[jira] [Commented] (TIKA-307) Better handling of partial/truncated input data to parsers

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (TIKA-307) Better handling of partial/truncated input data to parsers

Sebastian Nagel (Jira)

    [ https://issues.apache.org/jira/browse/TIKA-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17169373#comment-17169373 ]

wiwi commented on TIKA-307:
---------------------------

It is still an issue, check parsing results of `zip.data` TIKA-455. Closing xthml output cleanly is fixed inĀ [https://github.com/apache/tika/pull/335]

> Better handling of partial/truncated input data to parsers
> ----------------------------------------------------------
>
>                 Key: TIKA-307
>                 URL: https://issues.apache.org/jira/browse/TIKA-307
>             Project: Tika
>          Issue Type: Improvement
>          Components: parser
>    Affects Versions: 0.4
>            Reporter: Kenneth William Krugler
>            Priority: Major
>
> Some parsers (e.g. ZipParser) can hang if they prematurely reach the end of the input stream.
> As a way of avoiding this issue, Jukka had suggested the following approach on the list:
> The input stream could be wrapped into a decorator that throws a tagged IOException when the given size limit has been reached. This assumes that all parsers will correctly propagate up an IOException (at the very least).
> Smarter parsers could cleanly close the emitted XHTML stream, potentially adding a metadata entry that signifies that the extracted text has been truncated.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)