132 projects with the selected classifier
Scrapy entrypoint for Scrapinghub job runner
Scrapy extension to save items to a sql database
A Scrapy GUI
A library to use Puppeteer-managed browser in Scrapy spiders
persist item to the database table
JavaScript support for Scrapy using Splash
Pipeline to Download PDF or Save page as PDF for scrapy item
An RSS Exporter for Scrapy
Scrapy middleware with requests support as an alternative to Twisted calls.
A high-level Web Crawling and Web Scraping framework
Scrapy project for feeds into INSPIRE-HEP (http://inspirehep.net).
Scrapy cache storage using plyvel
一个web监控scrapy的工具
A middleware of http proxy for Scrapy
A daemon for scheduling Scrapy spiders
A customized version of Scrapy
Scrapy Middleware to set a random User-Agent for every Request.
Scrapy extenstion to control spiders using JSON-RPC By Allen
spider-feeder is a library to help loading inputs to scrapy spiders.
Supported by