[jira] [Resolved] (HADOOP-17281) Implement FileSystem.listStatusIterator() in S3AFileSystem

Previous Topic Next Topic
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

[jira] [Resolved] (HADOOP-17281) Implement FileSystem.listStatusIterator() in S3AFileSystem

Nicholas DiPiazza (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-17281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steve Loughran resolved HADOOP-17281.
    Fix Version/s: 3.3.1
       Resolution: Fixed

merged into 3.1+; looking forward to this. The HADOOP-16380 stats code will need to be wired up to this; I'm not doing it *yet* as a I don't want to rebase everything there

> Implement FileSystem.listStatusIterator() in S3AFileSystem
> ----------------------------------------------------------
>                 Key: HADOOP-17281
>                 URL: https://issues.apache.org/jira/browse/HADOOP-17281
>             Project: Hadoop Common
>          Issue Type: Task
>          Components: fs/s3
>    Affects Versions: 3.3.0
>            Reporter: Mukund Thakur
>            Assignee: Mukund Thakur
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 3.3.1
>          Time Spent: 2h 50m
>  Remaining Estimate: 0h
> Currently S3AFileSystem only implements listStatus() api which returns an array. Once we implement the listStatusIterator(), clients can benefit from the async listing done recently 
> https://issues.apache.org/jira/browse/HADOOP-17074  by performing some tasks on files while iterating them.
> CC [~stevel]

This message was sent by Atlassian Jira

To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]