Daniel Graña

Scrapy

Last released on Aug 4, 2020

A high-level Web Crawling and Web Scraping framework

shub

Last released on Jul 15, 2020

Scrapinghub Command Line Client

splash

Last released on Jun 16, 2020

A javascript rendered with a HTTP API

dateparser

Last released on Jun 12, 2020

Date parsing library designed to parse dates from HTML pages

w3lib

Last released on May 13, 2020

Library of web-related functions

scrapy-crawlera

Last released on Apr 1, 2020

Crawlera middleware for Scrapy

scrapinghub

Last released on Mar 13, 2020

Client interface for Scrapinghub API

scrapely

Last released on Nov 28, 2019

A pure-python HTML screen-scraping library

slybot

Last released on Jun 18, 2019

Slybot crawler

scrapyd

Last released on Jun 17, 2019

A service for running Scrapy spiders, with an HTTP API

queuelib

Last released on Mar 12, 2018

Collection of persistent (disk-based) queues

webstruct

Last released on Dec 29, 2017

A library for creating statistical NER systems that work on HTML data

hubstorage

Last released on Dec 5, 2016

Client interface for Scrapinghub HubStorage

scrapylib

Last released on Nov 14, 2016

Scrapy helper functions and processors

adblockparser

Last released on Oct 17, 2016

Parser for Adblock Plus rules

scrapy-dotpersistence

Last released on Aug 4, 2016

Scrapy extension to sync `.scrapy` folder to an S3 bucket

scrapyjs

Last released on Mar 25, 2016

JavaScript support for Scrapy using Splash

flatson

Last released on Sep 25, 2015

Tool to flatten stream of JSON-like objects, configured via schema

crawl-frontier

Last released on Jun 26, 2015

A flexible frontier for web crawlers