A distributed crawler component based on scrapy_redis which can specify the expiration time of fingerprints in dupefilter.

## Project description

The author of this package has not provided a project description

## Project details

Uploaded source