[jira] [Resolved] (HADOOP-14000) S3guard metadata stores to support millions of entries

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Resolved] (HADOOP-14000) S3guard metadata stores to support millions of entries

Steve Loughran (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-14000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steve Loughran resolved HADOOP-14000.
-------------------------------------
    Resolution: Won't Fix

> S3guard metadata stores to support millions of entries
> ------------------------------------------------------
>
>                 Key: HADOOP-14000
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14000
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.0.0-beta1
>            Reporter: Steve Loughran
>            Priority: Major
>
> S3 repos can have millions of child entries
> Currently {{DirListingMetaData}} can't and {{MetadataStore.listChildren(Path path)}} won't be able to handle directories that big, for listing, deleting or naming.
> We will need a paged response from the listing operation, something which can be iterated over.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]