Skip to main content

Helper functions for web scraping

Project description

Helper functions for web scraping

  • Free software: GNU GENERAL PUBLIC LICENSE

Installation

pip install scraper-helper

You can also install the in-development version with:

pip install https://github.com/eupendra/scraper-helper/archive/master.zip

Documentation

https://scraper-helper.readthedocs.io/

Development

To run all the tests run:

tox

Note, to combine the coverage data from all the tox environments run:

Windows

set PYTEST_ADDOPTS=--cov-append
tox

Other

PYTEST_ADDOPTS=--cov-append tox

Changelog

0.0.8 (2021-04-19)

  • added new function run_spider to run spider quickly

  • Skipped 0.0.7

0.0.6 (2021-02-20)

  • added new function headers which returns usual browser headers

0.0.5 (2021-01-21)

  • bug fixes

0.0.4 (2021-01-21)

  • Minor Enhancements and bug fixes

0.0.2 (2021-01-15)

  • First release on PyPI.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scraper-helper-0.0.8.tar.gz (32.8 kB view details)

Uploaded Source

Built Distribution

scraper_helper-0.0.8-py2.py3-none-any.whl (19.6 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file scraper-helper-0.0.8.tar.gz.

File metadata

  • Download URL: scraper-helper-0.0.8.tar.gz
  • Upload date:
  • Size: 32.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.8

File hashes

Hashes for scraper-helper-0.0.8.tar.gz
Algorithm Hash digest
SHA256 23432b718f8aa823f03672013c72c0b30bcd99a8c10da993109b847d57fc8538
MD5 80860ce028a70dc2b2ceb333241ecd38
BLAKE2b-256 4e718b3a4a46e1134769fca5cce0e8447703e968354b88456f93b2df7a517099

See more details on using hashes here.

File details

Details for the file scraper_helper-0.0.8-py2.py3-none-any.whl.

File metadata

  • Download URL: scraper_helper-0.0.8-py2.py3-none-any.whl
  • Upload date:
  • Size: 19.6 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.8

File hashes

Hashes for scraper_helper-0.0.8-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 76b8b8e749a232272d7f4a961ce2059b2455ed6550ede4fa1bdbb29e423781b7
MD5 a5e39f80febc5281c4368ef3e67e7c1e
BLAKE2b-256 23d7234766fa56ef69f01dcf2b0111a404bd48f158e4ef0561a54d0a60f20f7d

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page