Skip to main content

Collection of python tools to re-use common code across scrapers

Project description

zimscraperlib

Build Status CodeFactor License: GPL v3 PyPI version shields.io codecov

Collection of python code to re-use across python-based scrapers

Usage

  • This library is meant to be installed via PyPI (zimscraperlib).
  • Make sure to reference it using a version code as the API is subject to frequent changes.
  • API should remains the same only within the same minor version.

Example usage:

zimscraperlib>=1.1,<1.2

Users

Non-exhaustive list of scrapers using it (check status when updating API):

releasing

  • Update your dependencies: pip install -U setuptools wheel twine
  • Make sure CHANGELOG.md is up-to-date
  • Bump version on src/zimscraperlib/VERSION
  • Build packages python ./setup.py sdist bdist_wheel
  • Upload to PyPI twine upload dist/zimscraperlib-2.0.0*.
  • Commit your Changelog + version bump changes
  • Tag version on git git tag -a v2.0.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for zimscraperlib, version 1.0.2
Filename, size File type Python version Upload date Hashes
Filename, size zimscraperlib-1.0.2-py3-none-any.whl (33.6 kB) File type Wheel Python version py3 Upload date Hashes View hashes
Filename, size zimscraperlib-1.0.2.tar.gz (28.9 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page