Created: (HADOOP-1028) Servers should log startup and shutdown messages

classic Classic list List threaded Threaded
17 messages Options
Reply | Threaded
Open this post in threaded view
|

Created: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)
Servers should log startup and shutdown messages
------------------------------------------------

                 Key: HADOOP-1028
                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
             Project: Hadoop
          Issue Type: Improvement
          Components: mapred
    Affects Versions: 0.11.2
            Reporter: Nigel Daley


JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-1028:
-------------------------------------------

    Attachment: 1028_20070622.patch

Added a starting message for JobTracker, TaskTracker, NameNode, SecondaryNameNode and DataNode.  We cannot have shutdown messages in general since the daemons can be killed by the OS.

> Servers should log startup and shutdown messages
> ------------------------------------------------
>
>                 Key: HADOOP-1028
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>         Attachments: 1028_20070622.patch
>
>
> JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

Re: [jira] Updated: (HADOOP-1028) Servers should log startup and shutdown messages

Nigel Daley
Can we make this message easier to see in the log?  Something like

<emptyline>
================================================================
Starting <server> on <host> with args=<blah blah>


On Jun 22, 2007, at 4:30 PM, Tsz Wo (Nicholas), SZE (JIRA) wrote:

>
>      [ https://issues.apache.org/jira/browse/HADOOP-1028?
> page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
>
> Tsz Wo (Nicholas), SZE updated HADOOP-1028:
> -------------------------------------------
>
>     Attachment: 1028_20070622.patch
>
> Added a starting message for JobTracker, TaskTracker, NameNode,  
> SecondaryNameNode and DataNode.  We cannot have shutdown messages  
> in general since the daemons can be killed by the OS.
>
>> Servers should log startup and shutdown messages
>> ------------------------------------------------
>>
>>                 Key: HADOOP-1028
>>                 URL: https://issues.apache.org/jira/browse/ 
>> HADOOP-1028
>>             Project: Hadoop
>>          Issue Type: Improvement
>>          Components: mapred
>>    Affects Versions: 0.11.2
>>            Reporter: Nigel Daley
>>         Attachments: 1028_20070622.patch
>>
>>
>> JobTracker, TaskTracker, NameNode, and DataNode should log when  
>> they startup and when they shutdown.
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)
In reply to this post by Radim Rehurek (Jira)

    [ https://issues.apache.org/jira/browse/HADOOP-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12507546 ]

dhruba borthakur commented on HADOOP-1028:
------------------------------------------

In DataNode.java, we already have a line     LOG.info("Starting DataNode in: "+data); Can this be removed now?



> Servers should log startup and shutdown messages
> ------------------------------------------------
>
>                 Key: HADOOP-1028
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>         Attachments: 1028_20070622.patch
>
>
> JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Assigned: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)
In reply to this post by Radim Rehurek (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

dhruba borthakur reassigned HADOOP-1028:
----------------------------------------

    Assignee: Tsz Wo (Nicholas), SZE

> Servers should log startup and shutdown messages
> ------------------------------------------------
>
>                 Key: HADOOP-1028
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: 1028_20070622.patch
>
>
> JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)
In reply to this post by Radim Rehurek (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-1028:
-------------------------------------------

    Attachment:     (was: 1028_20070622.patch)

> Servers should log startup and shutdown messages
> ------------------------------------------------
>
>                 Key: HADOOP-1028
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>            Assignee: Tsz Wo (Nicholas), SZE
>
> JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)
In reply to this post by Radim Rehurek (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-1028:
-------------------------------------------

    Attachment: 1028_20070622b.patch

- Regarding the message in DataNode, someone may want to see the value of data, so I re-wrote the message.

- Changed the starting message to multi-line for better readability, e.g.
2007-06-22 18:43:18,359 INFO org.apache.hadoop.dfs.NameNode:
/****************************************************************
  Starting NameNode
    host = some-host-name/123.123.123.123
    args = []
****************************************************************/


> Servers should log startup and shutdown messages
> ------------------------------------------------
>
>                 Key: HADOOP-1028
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: 1028_20070622b.patch
>
>
> JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)
In reply to this post by Radim Rehurek (Jira)

    [ https://issues.apache.org/jira/browse/HADOOP-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12507588 ]

Tom White commented on HADOOP-1028:
-----------------------------------

We can have shutdown messages for clean shutdowns by adding a shutdown hook: [http://java.sun.com/j2se/1.5.0/docs/api/java/lang/Runtime.html#addShutdownHook(java.lang.Thread)]. The stop scripts use the kill command, but that should still cause any shutdown hooks to run. There are cases when shutdown hooks are not run, but since this change is informational only, that should be OK. There's a useful table of kill signals and whether they cause any shutdown hooks to run here: http://weblogs.java.net/blog/km/archive/2007/02/kill_and_kill_9_1.html.

> Servers should log startup and shutdown messages
> ------------------------------------------------
>
>                 Key: HADOOP-1028
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: 1028_20070622b.patch
>
>
> JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)
In reply to this post by Radim Rehurek (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-1028:
-------------------------------------------

    Attachment:     (was: 1028_20070622b.patch)

> Servers should log startup and shutdown messages
> ------------------------------------------------
>
>                 Key: HADOOP-1028
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>            Assignee: Tsz Wo (Nicholas), SZE
>
> JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)
In reply to this post by Radim Rehurek (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-1028:
-------------------------------------------

    Attachment: 1028_20070625.patch

- added shutdown message

- used keyword STARTUP_MSG and SHUTDOWN_MSG so that we can grep the messages

> Servers should log startup and shutdown messages
> ------------------------------------------------
>
>                 Key: HADOOP-1028
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: 1028_20070625.patch
>
>
> JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)
In reply to this post by Radim Rehurek (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-1028:
-------------------------------------------

    Attachment:     (was: 1028_20070625.patch)

> Servers should log startup and shutdown messages
> ------------------------------------------------
>
>                 Key: HADOOP-1028
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>            Assignee: Tsz Wo (Nicholas), SZE
>
> JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)
In reply to this post by Radim Rehurek (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-1028:
-------------------------------------------

    Attachment: 1028_20070625b.patch

add javadoc

> Servers should log startup and shutdown messages
> ------------------------------------------------
>
>                 Key: HADOOP-1028
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: 1028_20070625b.patch
>
>
> JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)
In reply to this post by Radim Rehurek (Jira)

    [ https://issues.apache.org/jira/browse/HADOOP-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12508069 ]

dhruba borthakur commented on HADOOP-1028:
------------------------------------------

Code looks good. There seems to be two indentation problem in StringUtils.toStartupShutdownString(). Otherwise looks good.

> Servers should log startup and shutdown messages
> ------------------------------------------------
>
>                 Key: HADOOP-1028
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: 1028_20070625b.patch
>
>
> JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)
In reply to this post by Radim Rehurek (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-1028:
-------------------------------------------

    Status: Patch Available  (was: Open)

The indentation is correct.  It is looking funny in the windows editor because the words are wrapped around.

> Servers should log startup and shutdown messages
> ------------------------------------------------
>
>                 Key: HADOOP-1028
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: 1028_20070625b.patch
>
>
> JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)
In reply to this post by Radim Rehurek (Jira)

    [ https://issues.apache.org/jira/browse/HADOOP-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12508297 ]

Hadoop QA commented on HADOOP-1028:
-----------------------------------

+1

http://issues.apache.org/jira/secure/attachment/12360519/1028_20070625b.patch applied and successfully tested against trunk revision r550635.

Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/335/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/335/console

> Servers should log startup and shutdown messages
> ------------------------------------------------
>
>                 Key: HADOOP-1028
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: 1028_20070625b.patch
>
>
> JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)
In reply to this post by Radim Rehurek (Jira)

     [ https://issues.apache.org/jira/browse/HADOOP-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Doug Cutting updated HADOOP-1028:
---------------------------------

       Resolution: Fixed
    Fix Version/s: 0.14.0
           Status: Resolved  (was: Patch Available)

I just committed this.  Thanks, Tsz Wo!

> Servers should log startup and shutdown messages
> ------------------------------------------------
>
>                 Key: HADOOP-1028
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.14.0
>
>         Attachments: 1028_20070625b.patch
>
>
> JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (HADOOP-1028) Servers should log startup and shutdown messages

Radim Rehurek (Jira)
In reply to this post by Radim Rehurek (Jira)

    [ https://issues.apache.org/jira/browse/HADOOP-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12508511 ]

Hudson commented on HADOOP-1028:
--------------------------------

Integrated in Hadoop-Nightly #137 (See [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/137/])

> Servers should log startup and shutdown messages
> ------------------------------------------------
>
>                 Key: HADOOP-1028
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1028
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.14.0
>
>         Attachments: 1028_20070625b.patch
>
>
> JobTracker, TaskTracker, NameNode, and DataNode should log when they startup and when they shutdown.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.