Daniel Graña

Scrapy

Last released Jul 2, 2025

A high-level Web Crawling and Web Scraping framework

dateparser

Last released Jun 26, 2025

Date parsing library designed to parse dates from HTML pages

queuelib

Last released Mar 31, 2025

Collection of persistent (disk-based) and non-persistent (memory-based) queues

w3lib

Last released Jan 27, 2025

Library of web-related functions

scrapinghub

Last released Dec 16, 2024

Client interface for Scrapinghub API

scrapyd

Last released Oct 2, 2024

A service for running Scrapy spiders, with an HTTP API

shub

Last released Feb 8, 2024

Scrapinghub Command Line Client

scrapy-crawlera

Last released Dec 1, 2020

Crawlera middleware for Scrapy

splash

Last released Jun 16, 2020

A javascript rendered with a HTTP API

scrapely

Last released Nov 28, 2019

A pure-python HTML screen-scraping library

slybot

Last released Jun 18, 2019

Slybot crawler

webstruct

Last released Dec 29, 2017

A library for creating statistical NER systems that work on HTML data

hubstorage

Last released Dec 5, 2016

Client interface for Scrapinghub HubStorage

scrapylib

Last released Nov 14, 2016

Scrapy helper functions and processors

adblockparser

Last released Oct 17, 2016

Parser for Adblock Plus rules

scrapy-dotpersistence

Last released Aug 4, 2016

Scrapy extension to sync `.scrapy` folder to an S3 bucket

scrapyjs

Last released Mar 25, 2016

JavaScript support for Scrapy using Splash

flatson

Last released Sep 25, 2015

Tool to flatten stream of JSON-like objects, configured via schema

crawl-frontier

Last released Jun 26, 2015

A flexible frontier for web crawlers