Skip to main content

Pomp

Pomp is a screen scraping and web crawling framework. Pomp is inspired by and similar to Scrapy, but has a simpler implementation that lacks the hard Twisted dependency.

Features:

  • Pure python

  • Only one dependency for Python 2.x - concurrent.futures (backport of package for Python 2.x)

  • Supports one file applications; Pomps doesn’t force a specific project layout or other restrictions.

  • Pomp is a meta framework like Paste: you may use it to create your own scraping framework.

  • Extensible networking: you may use any sync or async method.

  • No parsing libraries in the core; use you preferred approach.

  • Pomp instances may be distributed and are designed to work with an external queue.

Pomp makes no attempt to accomodate:

  • redirects

  • proxies

  • caching

  • database integration

  • cookies

  • authentication

  • etc.

If you want proxies, redirects, or similar, you may use the excellent requests library as the Pomp downloader.

Pomp examples

Pomp docs

Continuous integration status by drone.io:

Latest CI test codecov

PyPI status:

Latest PyPI version Number of PyPI downloads Have wheel License

Docs status:

Documentation Status

Pomp is written and maintained by Evgeniy Tatarkin and is licensed under the BSD license.

Metadata

Release files for pomp 0.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pomp 0.2.1
File Size Uploaded Provenance
pomp-0.2.1.tar.gz 17.5 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for pomp 0.2.1
File Interpreter ABI Platform
pomp-0.2.1-py2.py3-none-any.whl Python 3, Python 2 none any Details

Total release size: 35.6 kB

Release files / pomp-0.2.1.tar.gz

Download URL pomp-0.2.1.tar.gz
Size 17.5 kB
Tags Source
SHA-256 checksum
How to use checksums
344fa4fd040e1b33d6acb43a6d120da160c937c2be872ab73fbed9bfba6556db
BLAKE2b-256 checksum
How to use checksums
3c2905e1ff26705c56012977bd350b43c6eec52828539c77d9b9f5c1fa74b3e8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release files / pomp-0.2.1-py2.py3-none-any.whl

Download URL pomp-0.2.1-py2.py3-none-any.whl
Size 18.1 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
c102fa2ac533ba10481999aa5b9ee09bbe7ba60061f88929a27d0191f0b32c3b
BLAKE2b-256 checksum
How to use checksums
8f7d3879625b7b20922497feadf2f40681c98d9008ed4eef83dbf556640e94d4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Security for pomp 0.2.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page