with the selected classifier
Scrapy extension to save items to a sql database
A middleware of http proxy for Scrapy
A daemon for scheduling Scrapy spiders
A Scrapy GUI
A middleware to change proxy rotated for Scrapy
Scrapy project for feeds into INSPIRE-HEP (http://inspirehep.net).
A high-level Web Crawling and Web Scraping framework
Crawlera middleware for Scrapy
Scrapy middleware which allows to crawl only new content
Scrapy Middleware that allows a Scrapy Spider to filter requests.
Scrapy extension to write scraped items using MongoEngine documents
Scrapy item parsing tools.
Scrapy stats collector for prometheus
Spidermon is a framework to build monitors for Scrapy spiders.
Webshare middleware for Scrapy
A collection of Scrapy extensions and other utilities
Scrapy entrypoint for Scrapinghub job runner
Scrapy Middleware to set a random User-Agent for every Request.