[jira] Created: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

classic Classic list List threaded Threaded
14 messages Options
Reply | Threaded
Open this post in threaded view
|

[jira] Created: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

Markus Jelsma (Jira)
Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf
-----------------------------------------------------------------------------------------

                 Key: HADOOP-1455
                 URL: https://issues.apache.org/jira/browse/HADOOP-1455
             Project: Hadoop
          Issue Type: Improvement
          Components: pipes
    Affects Versions: 0.13.0
            Reporter: Christian Kunz




--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

Markus Jelsma (Jira)

    [ https://issues.apache.org/jira/browse/HADOOP-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500906 ]

Runping Qi commented on HADOOP-1455:
------------------------------------

Streaming has this feature.
This may be a good time to examine the commonalities between the two and unify them.



> Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1455
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1455
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: pipes
>    Affects Versions: 0.13.0
>            Reporter: Christian Kunz
>


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

Markus Jelsma (Jira)
In reply to this post by Markus Jelsma (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das updated HADOOP-1455:
--------------------------------

    Status: Patch Available  (was: Open)

> Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1455
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1455
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: pipes
>    Affects Versions: 0.13.0
>            Reporter: Christian Kunz
>            Assignee: Devaraj Das
>         Attachments: 1455.patch
>
>


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Assigned: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

Markus Jelsma (Jira)
In reply to this post by Markus Jelsma (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das reassigned HADOOP-1455:
-----------------------------------

    Assignee: Devaraj Das

> Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1455
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1455
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: pipes
>    Affects Versions: 0.13.0
>            Reporter: Christian Kunz
>            Assignee: Devaraj Das
>         Attachments: 1455.patch
>
>


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

Markus Jelsma (Jira)
In reply to this post by Markus Jelsma (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das updated HADOOP-1455:
--------------------------------

    Attachment: 1455.patch

Attached is a simple patch that adds the passed key=values in the jobconf.

> Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1455
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1455
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: pipes
>    Affects Versions: 0.13.0
>            Reporter: Christian Kunz
>         Attachments: 1455.patch
>
>


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

Markus Jelsma (Jira)
In reply to this post by Markus Jelsma (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das updated HADOOP-1455:
--------------------------------

    Fix Version/s: 0.14.0

> Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1455
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1455
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: pipes
>    Affects Versions: 0.13.0
>            Reporter: Christian Kunz
>            Assignee: Devaraj Das
>             Fix For: 0.14.0
>
>         Attachments: 1455.patch
>
>


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

Markus Jelsma (Jira)
In reply to this post by Markus Jelsma (Jira)

    [ https://issues.apache.org/jira/browse/HADOOP-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12506126 ]

Hadoop QA commented on HADOOP-1455:
-----------------------------------

-1, build or testing failed

2 attempts failed to build and test the latest attachment http://issues.apache.org/jira/secure/attachment/12360098/1455.patch against trunk revision r548523.

Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/297/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/297/console

Please note that this message is automatically generated and may represent a problem with the automation system and not the patch.

> Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1455
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1455
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: pipes
>    Affects Versions: 0.13.0
>            Reporter: Christian Kunz
>            Assignee: Devaraj Das
>             Fix For: 0.14.0
>
>         Attachments: 1455.patch
>
>


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

Markus Jelsma (Jira)
In reply to this post by Markus Jelsma (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das updated HADOOP-1455:
--------------------------------

    Status: Open  (was: Patch Available)

> Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1455
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1455
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: pipes
>    Affects Versions: 0.13.0
>            Reporter: Christian Kunz
>            Assignee: Devaraj Das
>             Fix For: 0.14.0
>
>         Attachments: 1455.patch
>
>


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

Markus Jelsma (Jira)
In reply to this post by Markus Jelsma (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das updated HADOOP-1455:
--------------------------------

    Status: Patch Available  (was: Open)

Submitting the patch again so that it can be tested again in the build system (with the fixed hadoop trunk HADOOP-1503)

> Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1455
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1455
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: pipes
>    Affects Versions: 0.13.0
>            Reporter: Christian Kunz
>            Assignee: Devaraj Das
>             Fix For: 0.14.0
>
>         Attachments: 1455.patch
>
>


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

Markus Jelsma (Jira)
In reply to this post by Markus Jelsma (Jira)

    [ https://issues.apache.org/jira/browse/HADOOP-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12506263 ]

Hadoop QA commented on HADOOP-1455:
-----------------------------------

-1, build or testing failed

2 attempts failed to build and test the latest attachment http://issues.apache.org/jira/secure/attachment/12360098/1455.patch against trunk revision r548794.

Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/300/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/300/console

Please note that this message is automatically generated and may represent a problem with the automation system and not the patch.

> Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1455
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1455
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: pipes
>    Affects Versions: 0.13.0
>            Reporter: Christian Kunz
>            Assignee: Devaraj Das
>             Fix For: 0.14.0
>
>         Attachments: 1455.patch
>
>


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

Markus Jelsma (Jira)
In reply to this post by Markus Jelsma (Jira)

    [ https://issues.apache.org/jira/browse/HADOOP-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12506396 ]

Devaraj Das commented on HADOOP-1455:
-------------------------------------

Not sure why the build/test is failing on hudson (and the test errors are in unrelated tests). I checked out a fresh trunk and the tests ran fine with this patch.

> Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1455
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1455
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: pipes
>    Affects Versions: 0.13.0
>            Reporter: Christian Kunz
>            Assignee: Devaraj Das
>             Fix For: 0.14.0
>
>         Attachments: 1455.patch
>
>


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

Markus Jelsma (Jira)
In reply to this post by Markus Jelsma (Jira)

    [ https://issues.apache.org/jira/browse/HADOOP-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12506407 ]

Hadoop QA commented on HADOOP-1455:
-----------------------------------

+1

http://issues.apache.org/jira/secure/attachment/12360098/1455.patch applied and successfully tested against trunk revision r548794.

Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/311/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/311/console

> Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1455
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1455
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: pipes
>    Affects Versions: 0.13.0
>            Reporter: Christian Kunz
>            Assignee: Devaraj Das
>             Fix For: 0.14.0
>
>         Attachments: 1455.patch
>
>


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

Markus Jelsma (Jira)
In reply to this post by Markus Jelsma (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Doug Cutting updated HADOOP-1455:
---------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

I just committed this.  Thanks, Devaraj!

> Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1455
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1455
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: pipes
>    Affects Versions: 0.13.0
>            Reporter: Christian Kunz
>            Assignee: Devaraj Das
>             Fix For: 0.14.0
>
>         Attachments: 1455.patch
>
>


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

Markus Jelsma (Jira)
In reply to this post by Markus Jelsma (Jira)

    [ https://issues.apache.org/jira/browse/HADOOP-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12506876 ]

Hudson commented on HADOOP-1455:
--------------------------------

Integrated in Hadoop-Nightly #131 (See [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/131/])

> Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf
> -----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1455
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1455
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: pipes
>    Affects Versions: 0.13.0
>            Reporter: Christian Kunz
>            Assignee: Devaraj Das
>             Fix For: 0.14.0
>
>         Attachments: 1455.patch
>
>


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.