Skip to main content

Zyte's Page Object pattern for web scraping

Project description

PyPI Version Supported Python Versions Tox Ubuntu Tox Windows Coverage report Documentation Status

web-poet is a Python 3.8+ implementation of the page object pattern for web scraping. It enables writing portable, reusable web parsing code.

See the documentation.

Developing

Setup your local Python environment via:

  1. pip install -r requirements-dev.txt

  2. pre-commit install

Now everytime you perform a git commit, these tools will run against the staged files:

  • black

  • isort

  • flake8

You can also directly invoke pre-commit run –all-files or tox -e linters to run them without performing a commit.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

web-poet-0.16.0.tar.gz (67.6 kB view details)

Uploaded Source

Built Distribution

web_poet-0.16.0-py3-none-any.whl (45.8 kB view details)

Uploaded Python 3

File details

Details for the file web-poet-0.16.0.tar.gz.

File metadata

  • Download URL: web-poet-0.16.0.tar.gz
  • Upload date:
  • Size: 67.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.12.1

File hashes

Hashes for web-poet-0.16.0.tar.gz
Algorithm Hash digest
SHA256 ae5c5bf2ab1e97467f83751fcb11bb95618b80132ef1c0f25b5a34810d7f271f
MD5 34cf9954c11e8d14c4830c993f6adf46
BLAKE2b-256 f13e597ad52e4e239e993f4173eb7995ed7308149caadfffdeb9f023611588a2

See more details on using hashes here.

Provenance

File details

Details for the file web_poet-0.16.0-py3-none-any.whl.

File metadata

  • Download URL: web_poet-0.16.0-py3-none-any.whl
  • Upload date:
  • Size: 45.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.12.1

File hashes

Hashes for web_poet-0.16.0-py3-none-any.whl
Algorithm Hash digest
SHA256 29f0cb3a43344003a8d1f898b36e462452d2a6fdc4e77289b607cd428e2def45
MD5 6d8df904a94197588d013e427df080f8
BLAKE2b-256 f8132f5b7c34de2a37fce2f6acbaf7ac5a07eaa1cc976251656cde9102d6d91a

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page