Scope-based crawling and indexing

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

Scope-based crawling and indexing

Hi all:

Can I make nutch to crawl and create separate indices based on scope , where scope is determined from the querystring?

For example:

Let's assume that I'm having URL like:



lCrpId=0 is one scope

lCorpid=1 is another

and for all urls with lCrpId=0 we want one index and for those with lCrpId=1 we want another

Vikas Kumar