Skip to main content

Collection of python tools to re-use common code across scrapers

Project description


Build Status CodeFactor License: GPL v3 PyPI version codecov

Collection of python code to re-use across python-based scrapers


  • This library is meant to be installed via PyPI (zimscraperlib).
  • Make sure to reference it using a version code as the API is subject to frequent changes.
  • API should remains the same only within the same minor version.

Example usage:



Non-exhaustive list of scrapers using it (check status when updating API):


  • Update your dependencies: pip install -U setuptools wheel twine
  • Make sure is up-to-date
  • Bump version on src/zimscraperlib/VERSION
  • Build packages python ./ sdist bdist_wheel
  • Upload to PyPI twine upload dist/zimscraperlib-2.0.0*.
  • Commit your Changelog + version bump changes
  • Tag version on git git tag -a v2.0.0

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for zimscraperlib, version 1.0.2
Filename, size File type Python version Upload date Hashes
Filename, size zimscraperlib-1.0.2-py3-none-any.whl (33.6 kB) File type Wheel Python version py3 Upload date Hashes View hashes
Filename, size zimscraperlib-1.0.2.tar.gz (28.9 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page