BinFileDataSource DIH size issue

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

BinFileDataSource DIH size issue

wclarke
So I have a huge directory that I need to index and breaking it down to smaller pieces isn't really an option (unless I can make solr run recursively run through a text file list of folders or something similar).  I am using a DIH that is using BinFileDataSource, FileListEntityProcessor, and TikaEntityProcessor to run this and it definitely works on smaller batches.  Anyone know a work around??

TIA