Skip to main content

Crawler to extract data from various json api or html endpoints

Project description

aio_api_crawler

https://img.shields.io/pypi/v/aio_api_crawler.svg https://img.shields.io/travis/pawnhearts/aio_api_crawler.svg Documentation Status

Crawler to extract data from various json api or html endpoints

  • Free software: BSD license

Features

  • API to parse JSON and HTML endpoints

  • Sinks to save parsed data into various databases or mq

  • Worker class to run it

See examples.

History

0.1.0 (2020-10-31)

  • First release on PyPI.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aio_api_crawler-0.1.3.tar.gz (13.7 kB view details)

Uploaded Source

File details

Details for the file aio_api_crawler-0.1.3.tar.gz.

File metadata

  • Download URL: aio_api_crawler-0.1.3.tar.gz
  • Upload date:
  • Size: 13.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.14.0 pkginfo/1.6.1 requests/2.24.0 setuptools/47.1.0 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.8.6

File hashes

Hashes for aio_api_crawler-0.1.3.tar.gz
Algorithm Hash digest
SHA256 c42ac339f06badcec1a2519d733b051fe5d66487018798e7d6420194de824655
MD5 c306056f9156d58a0267211f79259c21
BLAKE2b-256 aa0e390b4ce43d6e38e7f458cd90e5004fd27e90bad628f9a10fc5188ed350c6

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page