question about page fetch

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

question about page fetch

beansproud
hi, everyone
  I'm crawling a lot of urls, and I just need to fetch the head of the page, without the body.
  Is there someone know how to do this ?
Reply | Threaded
Open this post in threaded view
|

Re: question about page fetch

Dennis Kubes-2
There isn't a way to do that currently.  You may be able to change the
httpclient plugin to suit your needs.

Dennis

beansproud wrote:
> hi, everyone
>   I'm crawling a lot of urls, and I just need to fetch the head of the page,
> without the body.
>   Is there someone know how to do this ?