Indexing Lotus Notes database using API

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

Indexing Lotus Notes database using API

Tobias Berg
Hi,

I'm in the need to index some databases in Lotus Notes format.
Unfortunatley, they cannot be web-enabled so I can't use a crawler such as
Nutch.

Before starting to write my own code, have anyone indexed Lotus Notes
databases using the Notes API before? Maybe using Apache ManifoldCF
framework or a custom DataImportHandler?

I've tried both Google and searched the mailing list but haven't found any
information.

Best regards,
Tobias Berg
Reply | Threaded
Open this post in threaded view
|

Re: Indexing Lotus Notes database using API

Jan Høydahl / Cominvent
Hi,

You should be able to index Notes databases through JDBC, either with DIH or ManifoldCF. Have not tried myself though.

--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com
Solr Training - www.solrtraining.com

On 5. sep. 2011, at 12:28, Tobias Berg wrote:

> Hi,
>
> I'm in the need to index some databases in Lotus Notes format.
> Unfortunatley, they cannot be web-enabled so I can't use a crawler such as
> Nutch.
>
> Before starting to write my own code, have anyone indexed Lotus Notes
> databases using the Notes API before? Maybe using Apache ManifoldCF
> framework or a custom DataImportHandler?
>
> I've tried both Google and searched the mailing list but haven't found any
> information.
>
> Best regards,
> Tobias Berg

Reply | Threaded
Open this post in threaded view
|

Re: Indexing Lotus Notes database using API

Oleg Tikhonov
In reply to this post by Tobias Berg
Hi Tobias,

I've been using ManifoldFC in context of FileNet P8 but not in the context
of your use case.

I think that you should use Notes API because it has very specific IBM
tailored format.

If you will find some open source project that can "extract" Lotus Notes DB,
please share the information.

BR,

Oleg

On Mon, Sep 5, 2011 at 1:28 PM, Tobias Berg <[hidden email]> wrote:

> Hi,
>
> I'm in the need to index some databases in Lotus Notes format.
> Unfortunatley, they cannot be web-enabled so I can't use a crawler such as
> Nutch.
>
> Before starting to write my own code, have anyone indexed Lotus Notes
> databases using the Notes API before? Maybe using Apache ManifoldCF
> framework or a custom DataImportHandler?
>
> I've tried both Google and searched the mailing list but haven't found any
> information.
>
> Best regards,
> Tobias Berg
>
Reply | Threaded
Open this post in threaded view
|

Re: Indexing Lotus Notes database using API

Tobias Berg
In reply to this post by Jan Høydahl / Cominvent
Thanks Jan,

I will look into using the JDBC driver.

/Tobias

2011/9/5 Jan Høydahl <[hidden email]>

> Hi,
>
> You should be able to index Notes databases through JDBC, either with DIH
> or ManifoldCF. Have not tried myself though.
>
> --
> Jan Høydahl, search solution architect
> Cominvent AS - www.cominvent.com
> Solr Training - www.solrtraining.com
>
> On 5. sep. 2011, at 12:28, Tobias Berg wrote:
>
> > Hi,
> >
> > I'm in the need to index some databases in Lotus Notes format.
> > Unfortunatley, they cannot be web-enabled so I can't use a crawler such
> as
> > Nutch.
> >
> > Before starting to write my own code, have anyone indexed Lotus Notes
> > databases using the Notes API before? Maybe using Apache ManifoldCF
> > framework or a custom DataImportHandler?
> >
> > I've tried both Google and searched the mailing list but haven't found
> any
> > information.
> >
> > Best regards,
> > Tobias Berg
>
>
Reply | Threaded
Open this post in threaded view
|

Re: Indexing Lotus Notes database using API

Tobias Berg
Hi again,

After reading a bit more, IBM no longer supports the JDBC driver for Lotus
Notes. Instead the Notes.jar API is recommended. So I'll go with that, as
Oleg suggested.

2011/9/6 Tobias Berg <[hidden email]>

> Thanks Jan,
>
> I will look into using the JDBC driver.
>
> /Tobias
>
>
> 2011/9/5 Jan Høydahl <[hidden email]>
>
>> Hi,
>>
>> You should be able to index Notes databases through JDBC, either with DIH
>> or ManifoldCF. Have not tried myself though.
>>
>> --
>> Jan Høydahl, search solution architect
>> Cominvent AS - www.cominvent.com
>> Solr Training - www.solrtraining.com
>>
>> On 5. sep. 2011, at 12:28, Tobias Berg wrote:
>>
>> > Hi,
>> >
>> > I'm in the need to index some databases in Lotus Notes format.
>> > Unfortunatley, they cannot be web-enabled so I can't use a crawler such
>> as
>> > Nutch.
>> >
>> > Before starting to write my own code, have anyone indexed Lotus Notes
>> > databases using the Notes API before? Maybe using Apache ManifoldCF
>> > framework or a custom DataImportHandler?
>> >
>> > I've tried both Google and searched the mailing list but haven't found
>> any
>> > information.
>> >
>> > Best regards,
>> > Tobias Berg
>>
>>
>
Reply | Threaded
Open this post in threaded view
|

Re: Indexing Lotus Notes database using API

Alexandre Rafalovitch
I was looking at doing something similar a little while ago and I
would not actually go with entry-by-entry extraction code.

There is a semi-secret way to export the whole Lotus Notes database
into an XML format. It can then be processed to extract and import
whatever information you want, much more than you can usefully get
through API.

We use it for a different purpose and it takes about 20 minutes to
dump an 80000 documents Lotus Notes database and a simple
post-processing then is another 10 minutes or so.

Please contact me directly if you are interested and I will share the
code to get this started.

Regards,
   Alex.
P.s. On a related note, I had once an idea of a project where this XML
dump could be used to - pretty much - automatically give any Lotus
Notes database a real SOLR-based search. The built-in Lotus Notes
search is just such a disaster whether version 6 or version 8.5
variation.

Personal blog: http://blog.outerthoughts.com/
LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch
- I think age is a very high price to pay for maturity (Tom Stoppard)




On Fri, Sep 9, 2011 at 1:48 AM, Tobias Berg <[hidden email]> wrote:

> Hi again,
>
> After reading a bit more, IBM no longer supports the JDBC driver for Lotus
> Notes. Instead the Notes.jar API is recommended. So I'll go with that, as
> Oleg suggested.
>
> 2011/9/6 Tobias Berg <[hidden email]>
>
>> Thanks Jan,
>>
>> I will look into using the JDBC driver.
>>
>> /Tobias
>>
>>
>> 2011/9/5 Jan Høydahl <[hidden email]>
>>
>>> Hi,
>>>
>>> You should be able to index Notes databases through JDBC, either with DIH
>>> or ManifoldCF. Have not tried myself though.
>>>
>>> --
>>> Jan Høydahl, search solution architect
>>> Cominvent AS - www.cominvent.com
>>> Solr Training - www.solrtraining.com
>>>
>>> On 5. sep. 2011, at 12:28, Tobias Berg wrote:
>>>
>>> > Hi,
>>> >
>>> > I'm in the need to index some databases in Lotus Notes format.
>>> > Unfortunatley, they cannot be web-enabled so I can't use a crawler such
>>> as
>>> > Nutch.
>>> >
>>> > Before starting to write my own code, have anyone indexed Lotus Notes
>>> > databases using the Notes API before? Maybe using Apache ManifoldCF
>>> > framework or a custom DataImportHandler?
>>> >
>>> > I've tried both Google and searched the mailing list but haven't found
>>> any
>>> > information.
>>> >
>>> > Best regards,
>>> > Tobias Berg
>>>
>>>
>>
>