Skip to main content

A micro-framework to crawl the web pages with crawlers configs. It can use MongoDB, Elasticsearch and Solr databases to cache and save the extracted data.

Project description

The author of this package has not provided a project description

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

web-crawler-plus-0.9.14.tar.gz (11.1 kB view details)

Uploaded Source

File details

Details for the file web-crawler-plus-0.9.14.tar.gz.

File metadata

File hashes

Hashes for web-crawler-plus-0.9.14.tar.gz
Algorithm Hash digest
SHA256 a09b346dc28775d6682917ee788630d146945a00a9c5f2e5eb6f9b7be1cd1e53
MD5 1d93041e947a0a42ca6b8c13014391a7
BLAKE2b-256 c23c5ca17d3a593f64572c5e286de0597a550cfce3bbe332ea5d603e8faf5705

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page