Lucene › Hadoop Lucene › Hadoop lucene-dev

Hadoop Source Code

Classic

List

Threaded

8 messages Options

salma khalil

Hadoop Source Code

Hi,

I am a new Hadoop developer. I want to implement an algorithm which enhances the
Hadoop performance in Heterogeneous environments. I tried to build and run many
versions for the Hadoop source code but the only one that I have succeeded to
build and run is hadoop-205.

I want to know if this version is suitable to edit on it, or there is a better
version I should use in my implementation.

Thanks,
Salma

Ravi Prakash-4

Re: Hadoop Source Code

Hi Salma,

0.20.205 is a little old now. branch-1.x is the last stable release.

Although 0.23 is "alpha", Yahoo has been deploying it to pretty big clusters and the community is stabilizing MRv2 on this branch.

branch-2 is where a lot of innovative development is happening. It too is "alpha" but if I were you, I would probably choose this branch. Its builds are monitored actively and should be stable to run.

trunk contains the latest and greatest new features / bug-fixes etc., but in my experience is very unstable and might have trouble building / running.

HTH
Ravi

________________________________
From: Salma Saber <[hidden email]>
To: [hidden email]
Sent: Saturday, October 20, 2012 3:47 PM
Subject: Hadoop Source Code

Hi,

I am a new Hadoop developer. I want to implement an algorithm which enhances the
Hadoop performance in Heterogeneous environments. I tried to build and run many
versions for the Hadoop source code but the only one that I have succeeded to
build and run is hadoop-205.

I want to know if this version is suitable to edit on it, or there is a better
version I should use in my implementation.

Thanks,
Salma

Samaneh Shokuhi

Re: Hadoop Source Code

Hi Salma,
I have a question about your development enviroment.Did you use eclipse?
I am going to use branch-1 to do some experiments on that.The thing is i
want to import the source code into eclipse and modify and build it
.Seems the source code inside src pachage in branch-1 is not mavenized .
So how did you build your project ? Did you do that from eclipse or command
line?

Samaneh

On Mon, Oct 22, 2012 at 6:51 AM, Ravi Prakash <[hidden email]> wrote:

> Hi Salma,
>
> 0.20.205 is a little old now. branch-1.x is the last stable release.
>
> Although 0.23 is "alpha", Yahoo has been deploying it to pretty big
> clusters and the community is stabilizing MRv2 on this branch.
>
> branch-2 is where a lot of innovative development is happening. It too is
> "alpha" but if I were you, I would probably choose this branch. Its builds
> are monitored actively and should be stable to run.
>
> trunk contains the latest and greatest new features / bug-fixes etc., but
> in my experience is very unstable and might have trouble building / running.
>
> HTH
> Ravi
>
>
>
>
>
> ________________________________
> From: Salma Saber <[hidden email]>
> To: [hidden email]
> Sent: Saturday, October 20, 2012 3:47 PM
> Subject: Hadoop Source Code
>
>
>
> Hi,
>
> I am a new Hadoop developer. I want to implement an algorithm which
> enhances the
> Hadoop performance in Heterogeneous environments. I tried to build and run
> many
> versions for the Hadoop source code but the only one that I have succeeded
> to
> build and run is hadoop-205.
>
> I want to know if this version is suitable to edit on it, or there is a
> better
> version I should use in my implementation.
>
> Thanks,
> Salma
>

Ravi Prakash-4

Re: Hadoop Source Code

Running "ant eclipse" should produce the eclipse project files you need to import it into eclipse

________________________________
From: Samaneh Shokuhi <[hidden email]>
To: [hidden email]; Ravi Prakash <[hidden email]>
Sent: Monday, October 22, 2012 6:41 AM
Subject: Re: Hadoop Source Code

Hi Salma,
I have a question about your development enviroment.Did you use eclipse?
I am going to use branch-1 to do some experiments on that.The thing is i
want to import the source code into eclipse and modify and build it
.Seems the source code inside src pachage in branch-1 is not mavenized .
So how did you build your project ? Did you do that from eclipse or command
line?

Samaneh

On Mon, Oct 22, 2012 at 6:51 AM, Ravi Prakash <[hidden email]> wrote:

salma khalil

Re: Hadoop Source Code

In reply to this post by Samaneh Shokuhi

Thanks Ravi I will try to build the branch-2 as you suggested to me.

salma khalil

Re: Hadoop Source Code

In reply to this post by Samaneh Shokuhi

Hi Samaneh,

I followed this video to build and run the Hadoop Source Code:

http://vimeo.com/4193623

Best Regards,
Salma

Mohammad Mustaqeem

Hadoop Source Code

In reply to this post by salma khalil

I am also working in same direction.
As I am new, First of all, I want to know that what have you done to enhance the
hadoop performance in heterogeneous environment.
I have an strategy for that.
What I really need is how to modify the Hadoop source code?? and how to compile
the source code.
As I am very new to this field, I want step by step instructions.

Please, help me. It is for my thesis.
Hope you will reply as soon as possible.

Robert Evans

Re: Hadoop Source Code

Look at

http://wiki.apache.org/hadoop/HowToContribute

It gives step by step instructions.

--Bobby

On 3/18/13 6:43 AM, "Mustaqeem" <[hidden email]> wrote:

>I am also working in same direction.
>As I am new, First of all, I want to know that what have you done to
>enhance the
>hadoop performance in heterogeneous environment.
>I have an strategy for that.
>What I really need is how to modify the Hadoop source code?? and how to
>compile
>the source code.
>As I am very new to this field, I want step by step instructions.
>
>Please, help me. It is for my thesis.
>Hope you will reply as soon as possible.
>