with the selected classifier
Scrapy entrypoint for Scrapinghub job runner
Scrapy extension to save items to a sql database
A Scrapy GUI
A customized version of Scrapy
Scrapy Middleware to set a random User-Agent for every Request.
A daemon for scheduling Scrapy spiders
Scrapy extenstion to control spiders using JSON-RPC By Allen
spider-feeder is a library to help loading inputs to scrapy spiders.
A library to use Puppeteer-managed browser in Scrapy spiders
persist item to the database table
Scrapy state between job runs
Pipeline to Download PDF or Save page as PDF for scrapy item
An RSS Exporter for Scrapy
A Scrapy middleware for scraping Wayback Machine snapshots from archive.org.
A middleware to cache http response for Scrapy
A middleware of http proxy for Scrapy
A middleware to change proxy rotated for Scrapy