Lucene › Solr › Solr - User

Experience with large merge factors

Classic

List

Threaded

11 messages Options

Tom Burton-West-2 Experience with large merge factors – Hi all, At some point we will need to re-build an index that totals about 3 terabytes in size (split over 12 shards). At our current indexing ...

Nguyen, Vincent (CDC/OD/OADS) (CTR) Thank you once again Betsy! Vincent Vu Nguyen Division of Science Quality and Translation Office of the Associate Director for Science Cente...

Nguyen, Vincent (CDC/OD/OADS) (CTR) Nguyen, Vincent (CDC/OD/OADS) (CTR) would like to recall the message, "Experience with large merge factors".

Michael McCandless-2 4 weeks is a depressingly long time to re-index! Do you use multiple threads for indexing? Large RAM buffer size is also good, but I think pe...

Lance Norskog-2 You could do periodic small optimizes. The optimize command now includes 'maxSegments' which limits the target number of segments. It is possi...

Tom Burton-West-2 RE: Experience with large merge factors – Hi Mike, >.Do you use multiple threads for indexing? Large RAM buffer size is >>also good, but I think perf peaks out mabye around 5...

Otis Gospodnetic-2 Re: Experience with large merge factors – Hi Tom, > >.Do you use multiple threads for indexing? Large RAM buffer size is > >>also good, but I think perf peaks out ma...

Thijs On 7-10-2010 5:36, Otis Gospodnetic wrote: > Hi Tom, > > >>> .Do you use multiple threads for indexing? Large RAM buff...

Michael McCandless-2 Re: Experience with large merge factors – On Wed, Oct 6, 2010 at 9:57 PM, Burton-West, Tom <tburtonw@...> wrote: > Hi Mike, > >>.Do you use multiple threads for indexi...

Jan Høydahl / Cominvent Vote for or implement :) this issue: https://issues.apache.org/jira/browse/SOLR-1565 StreamingUpdateSolrServer should support RequestWriter API ...