compile error with SOLR 69 MoreLikeThis patch

classic Classic list List threaded Threaded
23 messages Options
12
Reply | Threaded
Open this post in threaded view
|

compile error with SOLR 69 MoreLikeThis patch

Andrew Nagy-2
I downloaded and patched my solr source with the latest solr69 patch and
whenever I run ant I get an error:

[javac]
/office/src/apache-solr-nightly/src/java/org/apache/solr/handler/MoreLikeThisHandler.java:145:
cannot find symbol
[javac] symbol  : variable DEFAULT_MIN_DOC_FREQ
[javac] location: class org.apache.lucene.search.similar.MoreLikeThis
[javac]       mlt.setMinDocFreq(        
params.getInt(MoreLikeThisParams.MIN_DOC_FREQ,          
MoreLikeThis.DEFAULT_MIN_DOC_FREQ));
[javac]                                                                                                    
^


Did I miss something, or maybe I have a non-compatible version of SOLR?

Thanks
Andrew
Reply | Threaded
Open this post in threaded view
|

Re: compile error with SOLR 69 MoreLikeThis patch

Brian Whitman
Change it to DEFALT or change the spelling error in the Lucene version.

On May 16, 2007, at 12:13 PM, Andrew Nagy wrote:

> I downloaded and patched my solr source with the latest solr69  
> patch and whenever I run ant I get an error:
>
> [javac] /office/src/apache-solr-nightly/src/java/org/apache/solr/
> handler/MoreLikeThisHandler.java:145: cannot find symbol
> [javac] symbol  : variable DEFAULT_MIN_DOC_FREQ
> [javac] location: class org.apache.lucene.search.similar.MoreLikeThis
> [javac]       mlt.setMinDocFreq(        params.getInt
> (MoreLikeThisParams.MIN_DOC_FREQ,          
> MoreLikeThis.DEFAULT_MIN_DOC_FREQ));
> [javac]                                                                
>                                       ^
>
>
> Did I miss something, or maybe I have a non-compatible version of  
> SOLR?
>
> Thanks
> Andrew

--
http://variogr.am/
[hidden email]



Reply | Threaded
Open this post in threaded view
|

RE: compile error with SOLR 69 MoreLikeThis patch

Andrew Nagy-2
That did the trick.  However, now I am trying to apply the patch to a fresh copy of solr on another server.  Whenever I do so, I get the following error from the patch command:

patching file src/java/org/apache/solr/request/StandardRequestHandler.java
Hunk #1 succeeded at 23 with fuzz 2 (offset -1 lines).
Hunk #2 FAILED at 31.
Hunk #3 succeeded at 146 with fuzz 2 (offset 13 lines).
1 out of 3 hunks FAILED -- saving rejects to file src/java/org/apache/solr/request/StandardRequestHandler.java.rej
(Stripping trailing CRs from patch.)
patching file src/java/org/apache/solr/handler/MoreLikeThisHandler.java
(Stripping trailing CRs from patch.)
patching file src/java/org/apache/solr/util/MoreLikeThisParams.java
(Stripping trailing CRs from patch.)
patching file example/solr/conf/solrconfig.xml
Hunk #1 FAILED at 385.
1 out of 1 hunk FAILED -- saving rejects to file example/solr/conf/solrconfig.xml.rej


Any ideas on how to get passed this?

Andrew
________________________________________
From: Brian Whitman [[hidden email]]
Sent: Wednesday, May 16, 2007 11:14 AM
To: solr-user
Subject: Re: compile error with SOLR 69 MoreLikeThis patch

Change it to DEFALT or change the spelling error in the Lucene version.

On May 16, 2007, at 12:13 PM, Andrew Nagy wrote:

> I downloaded and patched my solr source with the latest solr69
> patch and whenever I run ant I get an error:
>
> [javac] /office/src/apache-solr-nightly/src/java/org/apache/solr/
> handler/MoreLikeThisHandler.java:145: cannot find symbol
> [javac] symbol  : variable DEFAULT_MIN_DOC_FREQ
> [javac] location: class org.apache.lucene.search.similar.MoreLikeThis
> [javac]       mlt.setMinDocFreq(        params.getInt
> (MoreLikeThisParams.MIN_DOC_FREQ,
> MoreLikeThis.DEFAULT_MIN_DOC_FREQ));
> [javac]
>                                       ^
>
>
> Did I miss something, or maybe I have a non-compatible version of
> SOLR?
>
> Thanks
> Andrew

--
http://variogr.am/
[hidden email]




Reply | Threaded
Open this post in threaded view
|

Re: compile error with SOLR 69 MoreLikeThis patch

Brian Whitman


On May 24, 2007, at 10:29 AM, Andrew Nagy wrote:

> That did the trick.  However, now I am trying to apply the patch to  
> a fresh copy of solr on another server.  Whenever I do so, I get  
> the following error from the patch command:
>

I just patched trunk two days ago with the latest (posted three days  
ago) SOLR-69 patch, cleanly. Are you sure you are trying to patch the  
trunk version?


Reply | Threaded
Open this post in threaded view
|

RE: compile error with SOLR 69 MoreLikeThis patch

Andrew Nagy-2
That's the problem, as I suspected.  I was using a fresh copy of the 1.1.0.  I want to use the MLT feature in my production environment, but I guess I will have to roll out the trunk version to my production server.

Thanks!
________________________________________
From: Brian Whitman [[hidden email]]
Sent: Thursday, May 24, 2007 10:36 AM
To: [hidden email]
Subject: Re: compile error with SOLR 69 MoreLikeThis patch

On May 24, 2007, at 10:29 AM, Andrew Nagy wrote:

> That did the trick.  However, now I am trying to apply the patch to
> a fresh copy of solr on another server.  Whenever I do so, I get
> the following error from the patch command:
>

I just patched trunk two days ago with the latest (posted three days
ago) SOLR-69 patch, cleanly. Are you sure you are trying to patch the
trunk version?


Reply | Threaded
Open this post in threaded view
|

RE: compile error with SOLR 69 MoreLikeThis patch

Chris Hostetter-3

: That's the problem, as I suspected.  I was using a fresh copy of the
: 1.1.0.  I want to use the MLT feature in my production environment, but
: I guess I will have to roll out the trunk version to my production
: server.

if your goal is to use the MoreLikeThisHanler then you don't need the
entire trun .. it should work fine with Solr 1.1.0 ... the
mlt functionality added to StandardRequestHandler might be a bit more
challenging, but it should still be possible to retrofit the newer
StandardRequestHandler into the 1.1.0 release if you wnated to.

(Not that i dont' think the trunk is stable, i'm just saying there are
ways to get it working without completley upgrading)



-Hoss

Reply | Threaded
Open this post in threaded view
|

RE: compile error with SOLR 69 MoreLikeThis patch

Andrew Nagy-2
Chris, thanks for the tip.  I think I am okay with pushing the trunk to my production server.  As we say around here, if you want to be on the bleeding edge, you have to be okay with bleeding every once in a while :)

Thanks again
Andrew
________________________________________
From: Chris Hostetter [[hidden email]]
Sent: Thursday, May 24, 2007 2:18 PM
To: [hidden email]
Subject: RE: compile error with SOLR 69 MoreLikeThis patch

: That's the problem, as I suspected.  I was using a fresh copy of the
: 1.1.0.  I want to use the MLT feature in my production environment, but
: I guess I will have to roll out the trunk version to my production
: server.

if your goal is to use the MoreLikeThisHanler then you don't need the
entire trun .. it should work fine with Solr 1.1.0 ... the
mlt functionality added to StandardRequestHandler might be a bit more
challenging, but it should still be possible to retrofit the newer
StandardRequestHandler into the 1.1.0 release if you wnated to.

(Not that i dont' think the trunk is stable, i'm just saying there are
ways to get it working without completley upgrading)



-Hoss

Reply | Threaded
Open this post in threaded view
|

RE: compile error with SOLR 69 MoreLikeThis patch

Andrew Nagy-2
In reply to this post by Chris Hostetter-3
While I am on this topic, I think it might be nice to have a nightly build for downloading or is their something like that in place, now?
________________________________________
From: Chris Hostetter [[hidden email]]
Sent: Thursday, May 24, 2007 2:18 PM
To: [hidden email]
Subject: RE: compile error with SOLR 69 MoreLikeThis patch

: That's the problem, as I suspected.  I was using a fresh copy of the
: 1.1.0.  I want to use the MLT feature in my production environment, but
: I guess I will have to roll out the trunk version to my production
: server.

if your goal is to use the MoreLikeThisHanler then you don't need the
entire trun .. it should work fine with Solr 1.1.0 ... the
mlt functionality added to StandardRequestHandler might be a bit more
challenging, but it should still be possible to retrofit the newer
StandardRequestHandler into the 1.1.0 release if you wnated to.

(Not that i dont' think the trunk is stable, i'm just saying there are
ways to get it working without completley upgrading)



-Hoss

Reply | Threaded
Open this post in threaded view
|

Re: compile error with SOLR 69 MoreLikeThis patch

Brian Whitman
Nightly builds are here:

http://people.apache.org/builds/lucene/solr/nightly/

Won't have SOLR-69 in them though.


On May 24, 2007, at 2:28 PM, Andrew Nagy wrote:

> While I am on this topic, I think it might be nice to have a  
> nightly build for downloading or is their something like that in  
> place, now?
> ________________________________________
> From: Chris Hostetter [[hidden email]]
> Sent: Thursday, May 24, 2007 2:18 PM
> To: [hidden email]
> Subject: RE: compile error with SOLR 69 MoreLikeThis patch
>
> : That's the problem, as I suspected.  I was using a fresh copy of the
> : 1.1.0.  I want to use the MLT feature in my production  
> environment, but
> : I guess I will have to roll out the trunk version to my production
> : server.
>
> if your goal is to use the MoreLikeThisHanler then you don't need the
> entire trun .. it should work fine with Solr 1.1.0 ... the
> mlt functionality added to StandardRequestHandler might be a bit more
> challenging, but it should still be possible to retrofit the newer
> StandardRequestHandler into the 1.1.0 release if you wnated to.
>
> (Not that i dont' think the trunk is stable, i'm just saying there are
> ways to get it working without completley upgrading)
>
>
>
> -Hoss
>

--
http://variogr.am/
[hidden email]



Reply | Threaded
Open this post in threaded view
|

Re: compile error with SOLR 69 MoreLikeThis patch

Erik Hatcher
In reply to this post by Andrew Nagy-2
Andrew,

Nightlies are available here: <http://people.apache.org/builds/lucene/ 
solr/nightly/> (a link exists on the wiki main page, for future  
reference).

        Erik


On May 24, 2007, at 2:28 PM, Andrew Nagy wrote:

> While I am on this topic, I think it might be nice to have a  
> nightly build for downloading or is their something like that in  
> place, now?
> ________________________________________
> From: Chris Hostetter [[hidden email]]
> Sent: Thursday, May 24, 2007 2:18 PM
> To: [hidden email]
> Subject: RE: compile error with SOLR 69 MoreLikeThis patch
>
> : That's the problem, as I suspected.  I was using a fresh copy of the
> : 1.1.0.  I want to use the MLT feature in my production  
> environment, but
> : I guess I will have to roll out the trunk version to my production
> : server.
>
> if your goal is to use the MoreLikeThisHanler then you don't need the
> entire trun .. it should work fine with Solr 1.1.0 ... the
> mlt functionality added to StandardRequestHandler might be a bit more
> challenging, but it should still be possible to retrofit the newer
> StandardRequestHandler into the 1.1.0 release if you wnated to.
>
> (Not that i dont' think the trunk is stable, i'm just saying there are
> ways to get it working without completley upgrading)
>
>
>
> -Hoss

Reply | Threaded
Open this post in threaded view
|

RE: compile error with SOLR 69 MoreLikeThis patch

Andrew Nagy-2
duh++

Also, Where should I put the jar file for the patch?
________________________________________
From: Erik Hatcher [[hidden email]]
Sent: Thursday, May 24, 2007 2:37 PM
To: [hidden email]
Subject: Re: compile error with SOLR 69 MoreLikeThis patch

Andrew,

Nightlies are available here: <http://people.apache.org/builds/lucene/
solr/nightly/> (a link exists on the wiki main page, for future
reference).

        Erik


On May 24, 2007, at 2:28 PM, Andrew Nagy wrote:

> While I am on this topic, I think it might be nice to have a
> nightly build for downloading or is their something like that in
> place, now?
> ________________________________________
> From: Chris Hostetter [[hidden email]]
> Sent: Thursday, May 24, 2007 2:18 PM
> To: [hidden email]
> Subject: RE: compile error with SOLR 69 MoreLikeThis patch
>
> : That's the problem, as I suspected.  I was using a fresh copy of the
> : 1.1.0.  I want to use the MLT feature in my production
> environment, but
> : I guess I will have to roll out the trunk version to my production
> : server.
>
> if your goal is to use the MoreLikeThisHanler then you don't need the
> entire trun .. it should work fine with Solr 1.1.0 ... the
> mlt functionality added to StandardRequestHandler might be a bit more
> challenging, but it should still be possible to retrofit the newer
> StandardRequestHandler into the 1.1.0 release if you wnated to.
>
> (Not that i dont' think the trunk is stable, i'm just saying there are
> ways to get it working without completley upgrading)
>
>
>
> -Hoss

Reply | Threaded
Open this post in threaded view
|

Re: compile error with SOLR 69 MoreLikeThis patch

Ryan McKinley
in /lib  next to the other .jar files


Andrew Nagy wrote:

> duh++
>
> Also, Where should I put the jar file for the patch?
> ________________________________________
> From: Erik Hatcher [[hidden email]]
> Sent: Thursday, May 24, 2007 2:37 PM
> To: [hidden email]
> Subject: Re: compile error with SOLR 69 MoreLikeThis patch
>
> Andrew,
>
> Nightlies are available here: <http://people.apache.org/builds/lucene/
> solr/nightly/> (a link exists on the wiki main page, for future
> reference).
>
>         Erik
>
>
> On May 24, 2007, at 2:28 PM, Andrew Nagy wrote:
>
>> While I am on this topic, I think it might be nice to have a
>> nightly build for downloading or is their something like that in
>> place, now?
>> ________________________________________
>> From: Chris Hostetter [[hidden email]]
>> Sent: Thursday, May 24, 2007 2:18 PM
>> To: [hidden email]
>> Subject: RE: compile error with SOLR 69 MoreLikeThis patch
>>
>> : That's the problem, as I suspected.  I was using a fresh copy of the
>> : 1.1.0.  I want to use the MLT feature in my production
>> environment, but
>> : I guess I will have to roll out the trunk version to my production
>> : server.
>>
>> if your goal is to use the MoreLikeThisHanler then you don't need the
>> entire trun .. it should work fine with Solr 1.1.0 ... the
>> mlt functionality added to StandardRequestHandler might be a bit more
>> challenging, but it should still be possible to retrofit the newer
>> StandardRequestHandler into the 1.1.0 release if you wnated to.
>>
>> (Not that i dont' think the trunk is stable, i'm just saying there are
>> ways to get it working without completley upgrading)
>>
>>
>>
>> -Hoss
>
>

Reply | Threaded
Open this post in threaded view
|

add and delete docs at same time

Patrick Givisiez
In reply to this post by Andrew Nagy-2

can I add and delete docs at same post?

Some thing like this:

myDocs.xml
=====================================
<add>
<doc><field name="mainId">4</field></doc>
<doc><field name="mainId">5</field></doc>
<doc><field name="mainId">6</field></doc>
</add>
<delete><id>1</id></delete>
<delete><id>2</id></delete>
<delete><id>3</id></delete>
=====================================

Thanks!



Reply | Threaded
Open this post in threaded view
|

Re: add and delete docs at same time

Ryan McKinley
currently no.

Right now you even need a new request for each delete...


Patrick Givisiez wrote:

>
> can I add and delete docs at same post?
>
> Some thing like this:
>
> myDocs.xml
> =====================================
> <add>
> <doc><field name="mainId">4</field></doc>
> <doc><field name="mainId">5</field></doc>
> <doc><field name="mainId">6</field></doc>
> </add>
> <delete><id>1</id></delete>
> <delete><id>2</id></delete>
> <delete><id>3</id></delete>
> =====================================
>
> Thanks!
>
>
>
>

Reply | Threaded
Open this post in threaded view
|

Re: add and delete docs at same time

Erik Hatcher

On May 24, 2007, at 3:47 PM, Ryan McKinley wrote:

> currently no.
>
> Right now you even need a new request for each delete...

Unless you used delete-by-query with the id's OR'd....

        <delete><query>id:1 OR id:2 OR id:3</query</delete>


> Patrick Givisiez wrote:
>> can I add and delete docs at same post?
>> Some thing like this:
>> myDocs.xml
>> =====================================
>> <add>
>> <doc><field name="mainId">4</field></doc>
>> <doc><field name="mainId">5</field></doc>
>> <doc><field name="mainId">6</field></doc>
>> </add>
>> <delete><id>1</id></delete>
>> <delete><id>2</id></delete>
>> <delete><id>3</id></delete>

One point about that example is that it is not well-formed XML.  At  
the very least if we were to support multiple operations it'd be  
wrapped to make it well-formed.

        Erik

Reply | Threaded
Open this post in threaded view
|

Re[2]: add and delete docs at same time

Jack L
In reply to this post by Ryan McKinley
Oh, is that the case? One document per request for delete?
I'm about to implement delete. Just want to confirm.

--
Best regards,
Jack

Thursday, May 24, 2007, 12:47:21 PM, you wrote:

> currently no.

> Right now you even need a new request for each delete...


> Patrick Givisiez wrote:
>>
>> can I add and delete docs at same post?
>>
>> Some thing like this:
>>
>> myDocs.xml
>> =====================================
>> <add>
>> <doc><field name="mainId">4</field></doc>
>> <doc><field name="mainId">5</field></doc>
>> <doc><field name="mainId">6</field></doc>
>> </add>
>> <delete><id>1</id></delete>
>> <delete><id>2</id></delete>
>> <delete><id>3</id></delete>
>> =====================================
>>
>> Thanks!
>>
>>
>>
>>

Reply | Threaded
Open this post in threaded view
|

Re: Re[2]: add and delete docs at same time

Thierry Collogne
We always do a full delete before indexing, this is because for us that is
the only way to be sure that there are no documents in the index that don't
exist anymore.

So delete all, than add all.

To use the delete all, we did the following. We added a field called
dummyDelete. This field always contains the value delete.
Like this
                <field name="dummyDelete">delete</field>

Then to delete all documents we do a request containing:

                 <delete><query>dummyDelete:delete</query></delete>

That way all documents are deleted where the field dummyDelete contains
delete => all the documents

Hope this is clear. I am not sure if this is a good solution, but it does
work. :)

Greet,

Thierry

On 25/05/07, Jack L <[hidden email]> wrote:

>
> Oh, is that the case? One document per request for delete?
> I'm about to implement delete. Just want to confirm.
>
> --
> Best regards,
> Jack
>
> Thursday, May 24, 2007, 12:47:21 PM, you wrote:
>
> > currently no.
>
> > Right now you even need a new request for each delete...
>
>
> > Patrick Givisiez wrote:
> >>
> >> can I add and delete docs at same post?
> >>
> >> Some thing like this:
> >>
> >> myDocs.xml
> >> =====================================
> >> <add>
> >> <doc><field name="mainId">4</field></doc>
> >> <doc><field name="mainId">5</field></doc>
> >> <doc><field name="mainId">6</field></doc>
> >> </add>
> >> <delete><id>1</id></delete>
> >> <delete><id>2</id></delete>
> >> <delete><id>3</id></delete>
> >> =====================================
> >>
> >> Thanks!
> >>
> >>
> >>
> >>
>
>
Reply | Threaded
Open this post in threaded view
|

AW: Re[2]: add and delete docs at same time

Burkamp, Christian
Thierry,

If you always start from scratch you could even reset the index completely (i.e. delete the index directory). Solr will create a new index automatically at startup.
If you don't like to delete the files another approach would be to use a query that returns all documents. You do not need a dummy field for this. The range query [* TO *] returns all documents. (In newer versions of solr you can use *:* which is executing a bit faster.

-- Christian

-----Urspr√ľngliche Nachricht-----
Von: Thierry Collogne [mailto:[hidden email]]
Gesendet: Freitag, 25. Mai 2007 10:30
An: [hidden email]; Jack L
Betreff: Re: Re[2]: add and delete docs at same time

We always do a full delete before indexing, this is because for us that is the only way to be sure that there are no documents in the index that don't exist anymore.

So delete all, than add all.

To use the delete all, we did the following. We added a field called dummyDelete. This field always contains the value delete.
Like this
                <field name="dummyDelete">delete</field>

Then to delete all documents we do a request containing:

                 <delete><query>dummyDelete:delete</query></delete>

That way all documents are deleted where the field dummyDelete contains delete => all the documents

Hope this is clear. I am not sure if this is a good solution, but it does work. :)

Greet,

Thierry

On 25/05/07, Jack L <[hidden email]> wrote:

>
> Oh, is that the case? One document per request for delete?
> I'm about to implement delete. Just want to confirm.
>
> --
> Best regards,
> Jack
>
> Thursday, May 24, 2007, 12:47:21 PM, you wrote:
>
> > currently no.
>
> > Right now you even need a new request for each delete...
>
>
> > Patrick Givisiez wrote:
> >>
> >> can I add and delete docs at same post?
> >>
> >> Some thing like this:
> >>
> >> myDocs.xml
> >> =====================================
> >> <add>
> >> <doc><field name="mainId">4</field></doc> <doc><field
> >> name="mainId">5</field></doc> <doc><field
> >> name="mainId">6</field></doc> </add> <delete><id>1</id></delete>
> >> <delete><id>2</id></delete> <delete><id>3</id></delete>
> >> =====================================
> >>
> >> Thanks!
> >>
> >>
> >>
> >>
>
>

Reply | Threaded
Open this post in threaded view
|

Re: AW: Re[2]: add and delete docs at same time

Erik Hatcher
Just to be clear, [* TO *] does not necessarily return all  
documents.  It returns all documents that have a value in the  
specified (or default) field.  Be careful with that!   *:*, however,  
does match all documents.

        Erik


On May 25, 2007, at 5:49 AM, Burkamp, Christian wrote:

> Thierry,
>
> If you always start from scratch you could even reset the index  
> completely (i.e. delete the index directory). Solr will create a  
> new index automatically at startup.
> If you don't like to delete the files another approach would be to  
> use a query that returns all documents. You do not need a dummy  
> field for this. The range query [* TO *] returns all documents. (In  
> newer versions of solr you can use *:* which is executing a bit  
> faster.
>
> -- Christian
>
> -----Urspr√ľngliche Nachricht-----
> Von: Thierry Collogne [mailto:[hidden email]]
> Gesendet: Freitag, 25. Mai 2007 10:30
> An: [hidden email]; Jack L
> Betreff: Re: Re[2]: add and delete docs at same time
>
> We always do a full delete before indexing, this is because for us  
> that is the only way to be sure that there are no documents in the  
> index that don't exist anymore.
>
> So delete all, than add all.
>
> To use the delete all, we did the following. We added a field  
> called dummyDelete. This field always contains the value delete.
> Like this
>                 <field name="dummyDelete">delete</field>
>
> Then to delete all documents we do a request containing:
>
>                  <delete><query>dummyDelete:delete</query></delete>
>
> That way all documents are deleted where the field dummyDelete  
> contains delete => all the documents
>
> Hope this is clear. I am not sure if this is a good solution, but  
> it does work. :)
>
> Greet,
>
> Thierry
>
> On 25/05/07, Jack L <[hidden email]> wrote:
>>
>> Oh, is that the case? One document per request for delete?
>> I'm about to implement delete. Just want to confirm.
>>
>> --
>> Best regards,
>> Jack
>>
>> Thursday, May 24, 2007, 12:47:21 PM, you wrote:
>>
>>> currently no.
>>
>>> Right now you even need a new request for each delete...
>>
>>
>>> Patrick Givisiez wrote:
>>>>
>>>> can I add and delete docs at same post?
>>>>
>>>> Some thing like this:
>>>>
>>>> myDocs.xml
>>>> =====================================
>>>> <add>
>>>> <doc><field name="mainId">4</field></doc> <doc><field
>>>> name="mainId">5</field></doc> <doc><field
>>>> name="mainId">6</field></doc> </add> <delete><id>1</id></delete>
>>>> <delete><id>2</id></delete> <delete><id>3</id></delete>
>>>> =====================================
>>>>
>>>> Thanks!
>>>>
>>>>
>>>>
>>>>
>>
>>

Reply | Threaded
Open this post in threaded view
|

Re: AW: Re[2]: add and delete docs at same time

Mike Klaas
In reply to this post by Burkamp, Christian

On 25-May-07, at 2:49 AM, Burkamp, Christian wrote:

> Thierry,
>
> If you always start from scratch you could even reset the index  
> completely (i.e. delete the index directory). Solr will create a  
> new index automatically at startup.

This will also make indexing and optimizing much faster for any non-
trivial size index.

-Mike
12