Skip to main content
This is a pre-production deployment of Warehouse. Changes made here affect the production instance of PyPI (
Help us improve Python packaging - Donate today!
Avatar for ScrapyPlugins from


  Joined on Feb 3, 2016

9 Projects


Last released on Aug 16, 2017

Scrapy extension to store info in storage service


Last released on Mar 29, 2017

JavaScript support for Scrapy using Splash


Last released on Feb 9, 2017

Scrapy middleware to ignore previously crawled pages


Last released on Jan 20, 2017

Scrapy schema validation pipeline and Item builder using JSON Schema


Last released on Aug 4, 2016

Scrapy extension to sync `.scrapy` folder to an S3 bucket


Last released on Jul 18, 2016

Scrapy spider middleware to split an item into multiple items on a multi-valued key


Last released on Jul 18, 2016

Scrapy spider middleware to use Scrapinghub's Hub Crawl Frontier as a backend for URLs


Last released on Jun 30, 2016

Scrapy spider middleware to clean up query parameters in request URLs


Last released on Jun 30, 2016

Scrapy middleware to add extra "magic" fields to items

Supported By

Elastic Elastic Search Pingdom Pingdom Monitoring Dyn Dyn DNS Sentry Sentry Error Logging CloudAMQP CloudAMQP RabbitMQ Heroku Heroku PaaS Kabu Creative Kabu Creative UX & Design Fastly Fastly CDN DigiCert DigiCert EV Certificate Google Google Cloud Servers DreamHost DreamHost Log Hosting