db.score.injected

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

db.score.injected

Jeff Ritchie
Developers...

Is the configuration property <db.score.injected> still used?

If so in which source file is it used?

I can't seem to find where it is used in the source anywhere.

Line 70 org.apache.nutch.crawl.Injector.java
     if (url != null) {                          // if it passes
        value.set(url);                           // collect it
->        output.collect(value, new
CrawlDatum(CrawlDatum.STATUS_DB_UNFETCHED,
                                             interval));
      }

Should that be:
-> output.collect(value, new CrawlDatum(CrawlDatum.STATUS_DB_UNFETCHED,
                                             
interval,jobConf.getFloat("db.score.injected",1.0f)));



Jeff
Reply | Threaded
Open this post in threaded view
|

Re: db.score.injected

Andrzej Białecki-2
Jeff Ritchie wrote:

> Developers...
>
> Is the configuration property <db.score.injected> still used?
> If so in which source file is it used?
> I can't seem to find where it is used in the source anywhere.
>
> Line 70 org.apache.nutch.crawl.Injector.java
>     if (url != null) {                          // if it passes
>        value.set(url);                           // collect it
> ->        output.collect(value, new
> CrawlDatum(CrawlDatum.STATUS_DB_UNFETCHED,
>                                             interval));
>      }
>
> Should that be:
> -> output.collect(value, new CrawlDatum(CrawlDatum.STATUS_DB_UNFETCHED,
>                                            
> interval,jobConf.getFloat("db.score.injected",1.0f)));
>

Yes, that's correct. This will be fixed together with the adaptive
refetch patches.

--
Best regards,
Andrzej Bialecki     <><
 ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com


Reply | Threaded
Open this post in threaded view
|

Re: db.score.injected

Jeff Ritchie
Thanks Andrzej.

Jeff

Andrzej Bialecki wrote:

> Jeff Ritchie wrote:
>> Developers...
>>
>> Is the configuration property <db.score.injected> still used?
>> If so in which source file is it used?
>> I can't seem to find where it is used in the source anywhere.
>>
>> Line 70 org.apache.nutch.crawl.Injector.java
>>     if (url != null) {                          // if it passes
>>        value.set(url);                           // collect it
>> ->        output.collect(value, new
>> CrawlDatum(CrawlDatum.STATUS_DB_UNFETCHED,
>>                                             interval));
>>      }
>>
>> Should that be:
>> -> output.collect(value, new CrawlDatum(CrawlDatum.STATUS_DB_UNFETCHED,
>>                                            
>> interval,jobConf.getFloat("db.score.injected",1.0f)));
>>
>
> Yes, that's correct. This will be fixed together with the adaptive
> refetch patches.
>