[jira] Created: (HADOOP-1504) terminate-hadoop-cluster may be overzealous

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

[jira] Created: (HADOOP-1504) terminate-hadoop-cluster may be overzealous

Tim Allison (Jira)
terminate-hadoop-cluster may be overzealous
-------------------------------------------

                 Key: HADOOP-1504
                 URL: https://issues.apache.org/jira/browse/HADOOP-1504
             Project: Hadoop
          Issue Type: Bug
          Components: fs
            Reporter: Doug Cutting


If folks are using EC2 for things besides Hadoop, then the terminate-hadoop-cluster script (in src/contrib/s3/bin) will kill all instances, not just Hadoop instances.  This could cause loss of work.

http://developer.amazonwebservices.com/connect/thread.jspa?threadID=15699

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1504) terminate-hadoop-cluster may be overzealous

Tim Allison (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Doug Cutting updated HADOOP-1504:
---------------------------------

    Component/s:     (was: fs)
                 contrib/s3
       Priority: Blocker  (was: Major)

> terminate-hadoop-cluster may be overzealous
> -------------------------------------------
>
>                 Key: HADOOP-1504
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1504
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/s3
>            Reporter: Doug Cutting
>            Priority: Blocker
>
> If folks are using EC2 for things besides Hadoop, then the terminate-hadoop-cluster script (in src/contrib/s3/bin) will kill all instances, not just Hadoop instances.  This could cause loss of work.
> http://developer.amazonwebservices.com/connect/thread.jspa?threadID=15699

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Assigned: (HADOOP-1504) terminate-hadoop-cluster may be overzealous

Tim Allison (Jira)
In reply to this post by Tim Allison (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White reassigned HADOOP-1504:
---------------------------------

    Assignee: Tom White

> terminate-hadoop-cluster may be overzealous
> -------------------------------------------
>
>                 Key: HADOOP-1504
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1504
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/s3
>            Reporter: Doug Cutting
>            Assignee: Tom White
>            Priority: Blocker
>
> If folks are using EC2 for things besides Hadoop, then the terminate-hadoop-cluster script (in src/contrib/s3/bin) will kill all instances, not just Hadoop instances.  This could cause loss of work.
> http://developer.amazonwebservices.com/connect/thread.jspa?threadID=15699

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1504) terminate-hadoop-cluster may be overzealous

Tim Allison (Jira)
In reply to this post by Tim Allison (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated HADOOP-1504:
------------------------------

        Fix Version/s: 0.14.0
    Affects Version/s: 0.13.0
               Status: Patch Available  (was: Open)

> terminate-hadoop-cluster may be overzealous
> -------------------------------------------
>
>                 Key: HADOOP-1504
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1504
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/s3
>    Affects Versions: 0.13.0
>            Reporter: Doug Cutting
>            Assignee: Tom White
>            Priority: Blocker
>             Fix For: 0.14.0
>
>         Attachments: HADOOP-1504.patch
>
>
> If folks are using EC2 for things besides Hadoop, then the terminate-hadoop-cluster script (in src/contrib/s3/bin) will kill all instances, not just Hadoop instances.  This could cause loss of work.
> http://developer.amazonwebservices.com/connect/thread.jspa?threadID=15699

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1504) terminate-hadoop-cluster may be overzealous

Tim Allison (Jira)
In reply to this post by Tim Allison (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated HADOOP-1504:
------------------------------

    Attachment: HADOOP-1504.patch

This patch fixes this serious bug by doing two things:

1. Restricting the instances that are to be terminated to the version of the Hadoop AMI specified in the config file.
2. Listing the instances that will be terminated and prompting the user for agreement to proceed.

I have also updated the wiki to draw attention to this bug.

> terminate-hadoop-cluster may be overzealous
> -------------------------------------------
>
>                 Key: HADOOP-1504
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1504
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/s3
>    Affects Versions: 0.13.0
>            Reporter: Doug Cutting
>            Assignee: Tom White
>            Priority: Blocker
>             Fix For: 0.14.0
>
>         Attachments: HADOOP-1504.patch
>
>
> If folks are using EC2 for things besides Hadoop, then the terminate-hadoop-cluster script (in src/contrib/s3/bin) will kill all instances, not just Hadoop instances.  This could cause loss of work.
> http://developer.amazonwebservices.com/connect/thread.jspa?threadID=15699

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (HADOOP-1504) terminate-hadoop-cluster may be overzealous

Tim Allison (Jira)
In reply to this post by Tim Allison (Jira)

    [ https://issues.apache.org/jira/browse/HADOOP-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12506304 ]

Hadoop QA commented on HADOOP-1504:
-----------------------------------

+1

http://issues.apache.org/jira/secure/attachment/12360138/HADOOP-1504.patch applied and successfully tested against trunk revision r548794.

Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/303/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/303/console

> terminate-hadoop-cluster may be overzealous
> -------------------------------------------
>
>                 Key: HADOOP-1504
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1504
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/s3
>    Affects Versions: 0.13.0
>            Reporter: Doug Cutting
>            Assignee: Tom White
>            Priority: Blocker
>             Fix For: 0.14.0
>
>         Attachments: HADOOP-1504.patch
>
>
> If folks are using EC2 for things besides Hadoop, then the terminate-hadoop-cluster script (in src/contrib/s3/bin) will kill all instances, not just Hadoop instances.  This could cause loss of work.
> http://developer.amazonwebservices.com/connect/thread.jspa?threadID=15699

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1504) terminate-hadoop-cluster may be overzealous

Tim Allison (Jira)
In reply to this post by Tim Allison (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Doug Cutting updated HADOOP-1504:
---------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

I just committed this.  Thanks, Tom!

> terminate-hadoop-cluster may be overzealous
> -------------------------------------------
>
>                 Key: HADOOP-1504
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1504
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/s3
>    Affects Versions: 0.13.0
>            Reporter: Doug Cutting
>            Assignee: Tom White
>            Priority: Blocker
>             Fix For: 0.14.0
>
>         Attachments: HADOOP-1504.patch
>
>
> If folks are using EC2 for things besides Hadoop, then the terminate-hadoop-cluster script (in src/contrib/s3/bin) will kill all instances, not just Hadoop instances.  This could cause loss of work.
> http://developer.amazonwebservices.com/connect/thread.jspa?threadID=15699

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (HADOOP-1504) terminate-hadoop-cluster may be overzealous

Tim Allison (Jira)
In reply to this post by Tim Allison (Jira)

    [ https://issues.apache.org/jira/browse/HADOOP-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12506869 ]

Hudson commented on HADOOP-1504:
--------------------------------

Integrated in Hadoop-Nightly #131 (See [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/131/])

> terminate-hadoop-cluster may be overzealous
> -------------------------------------------
>
>                 Key: HADOOP-1504
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1504
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/s3
>    Affects Versions: 0.13.0
>            Reporter: Doug Cutting
>            Assignee: Tom White
>            Priority: Blocker
>             Fix For: 0.14.0
>
>         Attachments: HADOOP-1504.patch
>
>
> If folks are using EC2 for things besides Hadoop, then the terminate-hadoop-cluster script (in src/contrib/s3/bin) will kill all instances, not just Hadoop instances.  This could cause loss of work.
> http://developer.amazonwebservices.com/connect/thread.jspa?threadID=15699

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.