Skip to main content
Avatar for Daniel Graña from gravatar.com

Daniel Graña

Username    dangra

19 projects

queuelib

Last released

Collection of persistent (disk-based) and non-persistent (memory-based) queues

Scrapy

Last released

A high-level Web Crawling and Web Scraping framework

shub

Last released

Scrapinghub Command Line Client

scrapy-crawlera

Last released

Crawlera middleware for Scrapy

dateparser

Last released

Date parsing library designed to parse dates from HTML pages

splash

Last released

A javascript rendered with a HTTP API

w3lib

Last released

Library of web-related functions

scrapinghub

Last released

Client interface for Scrapinghub API

scrapely

Last released

A pure-python HTML screen-scraping library

slybot

Last released

Slybot crawler

scrapyd

Last released

A service for running Scrapy spiders, with an HTTP API

webstruct

Last released

A library for creating statistical NER systems that work on HTML data

hubstorage

Last released

Client interface for Scrapinghub HubStorage

scrapylib

Last released

Scrapy helper functions and processors

adblockparser

Last released

Parser for Adblock Plus rules

scrapy-dotpersistence

Last released

Scrapy extension to sync `.scrapy` folder to an S3 bucket

scrapyjs

Last released

JavaScript support for Scrapy using Splash

flatson

Last released

Tool to flatten stream of JSON-like objects, configured via schema

crawl-frontier

Last released

A flexible frontier for web crawlers

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page