scrapinghub-entrypoint-scrapy 0.12.1 Feb 5, 2021

Scrapy entrypoint for Scrapinghub job runner

scrapy-sqlitem 0.1.2 Aug 15, 2015

Scrapy extension to save items to a sql database

scrapybox 0.1 Mar 28, 2016

A Scrapy GUI

Scrapx 2.4.1 Feb 15, 2021

A customized version of Scrapy

scrapy-random-useragent 0.2 Jun 11, 2016

Scrapy Middleware to set a random User-Agent for every Request.

scrapy-do-heroku 0.4.1 Apr 28, 2020

A daemon for scheduling Scrapy spiders

scrapy-jsonrpc-api 1.0.0 Jan 17, 2021

Scrapy extenstion to control spiders using JSON-RPC By Allen

spider-feeder 0.3.0 Jan 13, 2020

spider-feeder is a library to help loading inputs to scrapy spiders.

scrapy-puppeteer-client 0.0.5 Nov 23, 2020

A library to use Puppeteer-managed browser in Scrapy spiders

scrapy-db-pipeline 1.1 Dec 9, 2019

persist item to the database table

scrapyjs 0.2 Mar 25, 2016

JavaScript support for Scrapy using Splash

scrapy-state 0.0.1 Jul 2, 2020

Scrapy state between job runs

scrapy-save-as-pdf 0.2.1 Jan 26, 2021

Pipeline to Download PDF or Save page as PDF for scrapy item

scrapy-rss-exporter 0.2 Jan 11, 2020

An RSS Exporter for Scrapy

scrapy-wayback-machine 1.0.3 Mar 31, 2021

A Scrapy middleware for scraping Wayback Machine snapshots from archive.org.

scrapy-httpcache 0.0.5 May 9, 2018

A middleware to cache http response for Scrapy

Scrapy-Httpproxy 0.0.5 Aug 1, 2018

A middleware of http proxy for Scrapy

scrapy-do 0.5.0 Dec 24, 2020

A daemon for scheduling Scrapy spiders

scrapy-sqspipeline 1.0.0 Mar 28, 2020

scrapy-rotated-proxy 0.1.5 Aug 23, 2018

A middleware to change proxy rotated for Scrapy