Windows Native Launching?

classic Classic list List threaded Threaded
10 messages Options
Reply | Threaded
Open this post in threaded view
|

Windows Native Launching?

Jim R. Wilson
Dear Nutch User Community,

Does anyone have a nutch.bat file to use in the bin directory?  I find it
bemusing that Java (cross-platform) was chosen as the development language,
but the launcher is written in Bash.

I'd even be happy with a nutch.rb - I'd rather install Ruby than Cygwin.
Thanks in advance.

-- Jim R. Wilson
Reply | Threaded
Open this post in threaded view
|

Re: Windows Native Launching?

Tomi N/A
On 9/11/06, Jim Wilson <[hidden email]> wrote:
> Dear Nutch User Community,
>
> Does anyone have a nutch.bat file to use in the bin directory?  I find it
> bemusing that Java (cross-platform) was chosen as the development language,
> but the launcher is written in Bash.

As much as I hate to say it, but you're right, it doesn't make any
sense to hobble such a great body of platform independent code with a
couple of short bit vital *n*x-only scripts. ...even if we are talking
about windows.
Would it make sense to go java all the way and use groovy or
beanshell? My knowledge of these projects is rather superficial, but
someone else might know more...

t.n.a.
Reply | Threaded
Open this post in threaded view
|

Re: Windows Native Launching?

Andrzej Białecki-2
Tomi NA wrote:

> On 9/11/06, Jim Wilson <[hidden email]> wrote:
>> Dear Nutch User Community,
>>
>> Does anyone have a nutch.bat file to use in the bin directory?  I
>> find it
>> bemusing that Java (cross-platform) was chosen as the development
>> language,
>> but the launcher is written in Bash.
>
> As much as I hate to say it, but you're right, it doesn't make any
> sense to hobble such a great body of platform independent code with a
> couple of short bit vital *n*x-only scripts. ...even if we are talking
> about windows.
> Would it make sense to go java all the way and use groovy or
> beanshell? My knowledge of these projects is rather superficial, but
> someone else might know more...

Originally Cygwin was needed to ensure the presence of some of the Unix
utilities, such as df(1), which get the info from OS that Java cannot
get; and of course to run the shell scripts.

Recently the dependency on POSIX-compatible df(1) has been removed. And
scripts can be rewritten in Java - although unless you use another type
of launcher (again, based on scripts!) there is no way to build
single-argument applications in Java; so, you always have to type more
than you would when starting a native application.

Anyway, I believe it should be possible now to get rid of Cygwin
dependency. If it's a high priority for you, please submit a patch.

--
Best regards,
Andrzej Bialecki     <><
 ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com


Reply | Threaded
Open this post in threaded view
|

Re: Windows Native Launching?

Uroš Gruber-2
Andrzej Bialecki wrote:

> Tomi NA wrote:
>> On 9/11/06, Jim Wilson <[hidden email]> wrote:
>>> Dear Nutch User Community,
>>>
>>> Does anyone have a nutch.bat file to use in the bin directory?  I
>>> find it
>>> bemusing that Java (cross-platform) was chosen as the development
>>> language,
>>> but the launcher is written in Bash.
>>
>> As much as I hate to say it, but you're right, it doesn't make any
>> sense to hobble such a great body of platform independent code with a
>> couple of short bit vital *n*x-only scripts. ...even if we are talking
>> about windows.
>> Would it make sense to go java all the way and use groovy or
>> beanshell? My knowledge of these projects is rather superficial, but
>> someone else might know more...
>
> Originally Cygwin was needed to ensure the presence of some of the
> Unix utilities, such as df(1), which get the info from OS that Java
> cannot get; and of course to run the shell scripts.
>
> Recently the dependency on POSIX-compatible df(1) has been removed.
> And scripts can be rewritten in Java - although unless you use another
> type of launcher (again, based on scripts!) there is no way to build
> single-argument applications in Java; so, you always have to type more
> than you would when starting a native application.
>
> Anyway, I believe it should be possible now to get rid of Cygwin
> dependency. If it's a high priority for you, please submit a patch.
>
I have nutch.bat but it's not complete yet. Also I'm going on vacation
tomorrow for two weeks. If it's not to late I can check later then and
submit a patch.

regards

Uros

Reply | Threaded
Open this post in threaded view
|

Re: Windows Native Launching?

Bipin Parmar
In reply to this post by Jim R. Wilson
Hi Jim,

I have attached nutch.bat per your email. Please make
sure that you set the env variable NUTCH_HOME
appropriately in the bat file.

I am sure that you are aware of the other env
variables NUTCH_LOG_DIR/NUTCH_LOGFILE and their use.

Thanks,

Bipin

--- Jim Wilson <[hidden email]> wrote:

> Dear Nutch User Community,
>
> Does anyone have a nutch.bat file to use in the bin
> directory?  I find it
> bemusing that Java (cross-platform) was chosen as
> the development language,
> but the launcher is written in Bash.
>
> I'd even be happy with a nutch.rb - I'd rather
> install Ruby than Cygwin.
> Thanks in advance.
>
> -- Jim R. Wilson
>
Reply | Threaded
Open this post in threaded view
|

Re: Windows Native Launching?

Jim R. Wilson
Thanks Bipin - but I think Gmail filtered your attachemtn from me :(

Could you resend the content of the bat, and I'll just copy to a file?
Thanks in advance.  I appreciate you taking the time to respond.

-- Jim


On 9/11/06, Bipin Parmar <[hidden email]> wrote:

>
> Hi Jim,
>
> I have attached nutch.bat per your email. Please make
> sure that you set the env variable NUTCH_HOME
> appropriately in the bat file.
>
> I am sure that you are aware of the other env
> variables NUTCH_LOG_DIR/NUTCH_LOGFILE and their use.
>
> Thanks,
>
> Bipin
>
> --- Jim Wilson <[hidden email]> wrote:
>
> > Dear Nutch User Community,
> >
> > Does anyone have a nutch.bat file to use in the bin
> > directory?  I find it
> > bemusing that Java (cross-platform) was chosen as
> > the development language,
> > but the launcher is written in Bash.
> >
> > I'd even be happy with a nutch.rb - I'd rather
> > install Ruby than Cygwin.
> > Thanks in advance.
> >
> > -- Jim R. Wilson
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Windows Native Launching?

Jim R. Wilson
In reply to this post by Andrzej Białecki-2
Thanks for the update.  The reason I suggested a .bat file is to mirror the
behavior of Apache Ant - which has an ant.bat as well as an SH launcher
called just "ant".

It may be more complicated than it's worth however to just make a DOS batch
script - DOS is weak compared to *nix shells.  The right solution may be to
make a mostly-complete native Java launcher, then stripped down "nutch" and
"nutch.bat" files for the bin directory.

Another open-source Java-based search utility I've been using lately is
OpenGrok [http://www.opensolaris.org/os/project/opengrok/].  The OpenGrok
indexer doesn't even have a launcher - just a JAR, so a native Java lanucher
could be just fine ... as long as the entire Classpath doesn't have to be
fed to it on the command line.

-- Jim

On 9/11/06, Andrzej Bialecki <[hidden email]> wrote:

>
> Tomi NA wrote:
> > On 9/11/06, Jim Wilson <[hidden email]> wrote:
> >> Dear Nutch User Community,
> >>
> >> Does anyone have a nutch.bat file to use in the bin directory?  I
> >> find it
> >> bemusing that Java (cross-platform) was chosen as the development
> >> language,
> >> but the launcher is written in Bash.
> >
> > As much as I hate to say it, but you're right, it doesn't make any
> > sense to hobble such a great body of platform independent code with a
> > couple of short bit vital *n*x-only scripts. ...even if we are talking
> > about windows.
> > Would it make sense to go java all the way and use groovy or
> > beanshell? My knowledge of these projects is rather superficial, but
> > someone else might know more...
>
> Originally Cygwin was needed to ensure the presence of some of the Unix
> utilities, such as df(1), which get the info from OS that Java cannot
> get; and of course to run the shell scripts.
>
> Recently the dependency on POSIX-compatible df(1) has been removed. And
> scripts can be rewritten in Java - although unless you use another type
> of launcher (again, based on scripts!) there is no way to build
> single-argument applications in Java; so, you always have to type more
> than you would when starting a native application.
>
> Anyway, I believe it should be possible now to get rid of Cygwin
> dependency. If it's a high priority for you, please submit a patch.
>
> --
> Best regards,
> Andrzej Bialecki     <><
> ___. ___ ___ ___ _ _   __________________________________
> [__ || __|__/|__||\/|  Information Retrieval, Semantic Web
> ___|||__||  \|  ||  |  Embedded Unix, System Integration
> http://www.sigram.com  Contact: info at sigram dot com
>
>
>
Reply | Threaded
Open this post in threaded view
|

Re: Windows Native Launching?

Ben Ogle
Would you be interested in a python script? I ported the nutch shell script last week and it is working well. I also have a python recrawl script if anyone is interested.

Ben

Jim Wilson-4 wrote
Thanks for the update.  The reason I suggested a .bat file is to mirror the
behavior of Apache Ant - which has an ant.bat as well as an SH launcher
called just "ant".

It may be more complicated than it's worth however to just make a DOS batch
script - DOS is weak compared to *nix shells.  The right solution may be to
make a mostly-complete native Java launcher, then stripped down "nutch" and
"nutch.bat" files for the bin directory.

Another open-source Java-based search utility I've been using lately is
OpenGrok [http://www.opensolaris.org/os/project/opengrok/].  The OpenGrok
indexer doesn't even have a launcher - just a JAR, so a native Java lanucher
could be just fine ... as long as the entire Classpath doesn't have to be
fed to it on the command line.

-- Jim

On 9/11/06, Andrzej Bialecki <ab@getopt.org> wrote:
>
> Tomi NA wrote:
> > On 9/11/06, Jim Wilson <wilson.jim.r@gmail.com> wrote:
> >> Dear Nutch User Community,
> >>
> >> Does anyone have a nutch.bat file to use in the bin directory?  I
> >> find it
> >> bemusing that Java (cross-platform) was chosen as the development
> >> language,
> >> but the launcher is written in Bash.
> >
> > As much as I hate to say it, but you're right, it doesn't make any
> > sense to hobble such a great body of platform independent code with a
> > couple of short bit vital *n*x-only scripts. ...even if we are talking
> > about windows.
> > Would it make sense to go java all the way and use groovy or
> > beanshell? My knowledge of these projects is rather superficial, but
> > someone else might know more...
>
> Originally Cygwin was needed to ensure the presence of some of the Unix
> utilities, such as df(1), which get the info from OS that Java cannot
> get; and of course to run the shell scripts.
>
> Recently the dependency on POSIX-compatible df(1) has been removed. And
> scripts can be rewritten in Java - although unless you use another type
> of launcher (again, based on scripts!) there is no way to build
> single-argument applications in Java; so, you always have to type more
> than you would when starting a native application.
>
> Anyway, I believe it should be possible now to get rid of Cygwin
> dependency. If it's a high priority for you, please submit a patch.
>
> --
> Best regards,
> Andrzej Bialecki     <><
> ___. ___ ___ ___ _ _   __________________________________
> [__ || __|__/|__||\/|  Information Retrieval, Semantic Web
> ___|||__||  \|  ||  |  Embedded Unix, System Integration
> http://www.sigram.com  Contact: info at sigram dot com
>
>
>
Reply | Threaded
Open this post in threaded view
|

Re: Windows Native Launching?

Jim R. Wilson
I think you should post them out on the wiki - that way people could find
them when they search.

-- Jim

On 9/11/06, Ben Ogle <[hidden email]> wrote:

>
>
> Would you be interested in a python script? I ported the nutch shell
> script
> last week and it is working well. I also have a python recrawl script if
> anyone is interested.
>
> Ben
>
>
> Jim Wilson-4 wrote:
> >
> > Thanks for the update.  The reason I suggested a .bat file is to mirror
> > the
> > behavior of Apache Ant - which has an ant.bat as well as an SH launcher
> > called just "ant".
> >
> > It may be more complicated than it's worth however to just make a DOS
> > batch
> > script - DOS is weak compared to *nix shells.  The right solution may be
> > to
> > make a mostly-complete native Java launcher, then stripped down "nutch"
> > and
> > "nutch.bat" files for the bin directory.
> >
> > Another open-source Java-based search utility I've been using lately is
> > OpenGrok [http://www.opensolaris.org/os/project/opengrok/].  The
> OpenGrok
> > indexer doesn't even have a launcher - just a JAR, so a native Java
> > lanucher
> > could be just fine ... as long as the entire Classpath doesn't have to
> be
> > fed to it on the command line.
> >
> > -- Jim
> >
> > On 9/11/06, Andrzej Bialecki <[hidden email]> wrote:
> >>
> >> Tomi NA wrote:
> >> > On 9/11/06, Jim Wilson <[hidden email]> wrote:
> >> >> Dear Nutch User Community,
> >> >>
> >> >> Does anyone have a nutch.bat file to use in the bin directory?  I
> >> >> find it
> >> >> bemusing that Java (cross-platform) was chosen as the development
> >> >> language,
> >> >> but the launcher is written in Bash.
> >> >
> >> > As much as I hate to say it, but you're right, it doesn't make any
> >> > sense to hobble such a great body of platform independent code with a
> >> > couple of short bit vital *n*x-only scripts. ...even if we are
> talking
> >> > about windows.
> >> > Would it make sense to go java all the way and use groovy or
> >> > beanshell? My knowledge of these projects is rather superficial, but
> >> > someone else might know more...
> >>
> >> Originally Cygwin was needed to ensure the presence of some of the Unix
> >> utilities, such as df(1), which get the info from OS that Java cannot
> >> get; and of course to run the shell scripts.
> >>
> >> Recently the dependency on POSIX-compatible df(1) has been removed. And
> >> scripts can be rewritten in Java - although unless you use another type
> >> of launcher (again, based on scripts!) there is no way to build
> >> single-argument applications in Java; so, you always have to type more
> >> than you would when starting a native application.
> >>
> >> Anyway, I believe it should be possible now to get rid of Cygwin
> >> dependency. If it's a high priority for you, please submit a patch.
> >>
> >> --
> >> Best regards,
> >> Andrzej Bialecki     <><
> >> ___. ___ ___ ___ _ _   __________________________________
> >> [__ || __|__/|__||\/|  Information Retrieval, Semantic Web
> >> ___|||__||  \|  ||  |  Embedded Unix, System Integration
> >> http://www.sigram.com  Contact: info at sigram dot com
> >>
> >>
> >>
> >
> >
>
> --
> View this message in context:
> http://www.nabble.com/Windows-Native-Launching--tf2249664.html#a6256245
> Sent from the Nutch - User forum at Nabble.com.
>
>
Reply | Threaded
Open this post in threaded view
|

Re: Windows Native Launching?

Ben Ogle
http://wiki.apache.org/nutch/CrossPlatformNutchScripts 

Now everyone can add their own or make mine better.

I want to use the recrawl script more before I post it...

Ben

Jim Wilson-4 wrote
I think you should post them out on the wiki - that way people could find
them when they search.

-- Jim

On 9/11/06, Ben Ogle <ogle.ben@gmail.com> wrote:
>
>
> Would you be interested in a python script? I ported the nutch shell
> script
> last week and it is working well. I also have a python recrawl script if
> anyone is interested.
>
> Ben
>
>
> Jim Wilson-4 wrote:
> >
> > Thanks for the update.  The reason I suggested a .bat file is to mirror
> > the
> > behavior of Apache Ant - which has an ant.bat as well as an SH launcher
> > called just "ant".
> >
> > It may be more complicated than it's worth however to just make a DOS
> > batch
> > script - DOS is weak compared to *nix shells.  The right solution may be
> > to
> > make a mostly-complete native Java launcher, then stripped down "nutch"
> > and
> > "nutch.bat" files for the bin directory.
> >
> > Another open-source Java-based search utility I've been using lately is
> > OpenGrok [http://www.opensolaris.org/os/project/opengrok/].  The
> OpenGrok
> > indexer doesn't even have a launcher - just a JAR, so a native Java
> > lanucher
> > could be just fine ... as long as the entire Classpath doesn't have to
> be
> > fed to it on the command line.
> >
> > -- Jim
> >
> > On 9/11/06, Andrzej Bialecki <ab@getopt.org> wrote:
> >>
> >> Tomi NA wrote:
> >> > On 9/11/06, Jim Wilson <wilson.jim.r@gmail.com> wrote:
> >> >> Dear Nutch User Community,
> >> >>
> >> >> Does anyone have a nutch.bat file to use in the bin directory?  I
> >> >> find it
> >> >> bemusing that Java (cross-platform) was chosen as the development
> >> >> language,
> >> >> but the launcher is written in Bash.
> >> >
> >> > As much as I hate to say it, but you're right, it doesn't make any
> >> > sense to hobble such a great body of platform independent code with a
> >> > couple of short bit vital *n*x-only scripts. ...even if we are
> talking
> >> > about windows.
> >> > Would it make sense to go java all the way and use groovy or
> >> > beanshell? My knowledge of these projects is rather superficial, but
> >> > someone else might know more...
> >>
> >> Originally Cygwin was needed to ensure the presence of some of the Unix
> >> utilities, such as df(1), which get the info from OS that Java cannot
> >> get; and of course to run the shell scripts.
> >>
> >> Recently the dependency on POSIX-compatible df(1) has been removed. And
> >> scripts can be rewritten in Java - although unless you use another type
> >> of launcher (again, based on scripts!) there is no way to build
> >> single-argument applications in Java; so, you always have to type more
> >> than you would when starting a native application.
> >>
> >> Anyway, I believe it should be possible now to get rid of Cygwin
> >> dependency. If it's a high priority for you, please submit a patch.
> >>
> >> --
> >> Best regards,
> >> Andrzej Bialecki     <><
> >> ___. ___ ___ ___ _ _   __________________________________
> >> [__ || __|__/|__||\/|  Information Retrieval, Semantic Web
> >> ___|||__||  \|  ||  |  Embedded Unix, System Integration
> >> http://www.sigram.com  Contact: info at sigram dot com
> >>
> >>
> >>
> >
> >
>
> --
> View this message in context:
> http://www.nabble.com/Windows-Native-Launching--tf2249664.html#a6256245
> Sent from the Nutch - User forum at Nabble.com.
>
>