This is a pre-production deployment of Warehouse, however changes made here WILL affect the production instance of PyPI.
ScrapyPlugins

ScrapyPlugins

Joined on Feb 3, 2016

Projects

scrapy-deltafetch

Last released on Dec 7, 2016

Scrapy middleware to ignore previously crawled pages

scrapy-dotpersistence

Last released on Aug 4, 2016

Scrapy extension to sync `.scrapy` folder to an S3 bucket

scrapy-hcf

Last released on Jul 18, 2016

Scrapy spider middleware to use Scrapinghub's Hub Crawl Frontier as a backend for URLs

scrapy-magicfields

Last released on Jun 30, 2016

Scrapy middleware to add extra "magic" fields to items

scrapy-pagestorage

Last released on Apr 27, 2016

Scrapy extension to store info in storage service

scrapy-querycleaner

Last released on Jun 30, 2016

Scrapy spider middleware to clean up query parameters in request URLs

scrapy-splash

Last released on May 16, 2016

JavaScript support for Scrapy using Splash

scrapy-splitvariants

Last released on Jul 18, 2016

Scrapy spider middleware to split an item into multiple items on a multi-valued key

Supported By

WebFaction WebFaction Technical Writing Elastic Elastic Search Pingdom Pingdom Monitoring Dyn Dyn DNS HPE HPE Development Sentry Sentry Error Logging CloudAMQP CloudAMQP RabbitMQ Heroku Heroku PaaS Kabu Creative Kabu Creative UX & Design Fastly Fastly CDN DigiCert DigiCert EV Certificate Rackspace Rackspace Cloud Servers DreamHost DreamHost Log Hosting