Skip to main content

A professional Scrapy integration for seamlessly routing requests through AskPablos Proxy API with support for headless browser rendering and rotating IP addresses

Project description

AskPablos Scrapy API

PyPI Version Supported Python Versions

A professional Scrapy integration for seamlessly routing requests through AskPablos Proxy API with support for headless browser rendering and rotating IP addresses.

Documentation

Full documentation is available at: https://askpablos-scrapy-api.readthedocs.io/en/latest/index.html

Key Features

  • 🔄 Selective Proxying: Only routes requests with askpablos_api_map in their meta
  • 🌐 Headless Browser Support: Render JavaScript-heavy pages
  • 🔄 Rotating Proxies: Access to a pool of rotating IP addresses
  • 🧠 JavaScript Strategies: Three modes for different scraping scenarios
  • 📸 Screenshot Capture: Take screenshots
  • 🔒 Secure Authentication: HMAC-SHA256 request signing
  • 🔁 Automatic Retries: Configurable retry logic
  • ⚠️ Comprehensive Error Handling: Detailed logging and error reporting

Quick Installation

pip install askpablos-scrapy-api

License

MIT License - See LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

askpablos_scrapy_api-0.4.0.tar.gz (10.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

askpablos_scrapy_api-0.4.0-py3-none-any.whl (12.6 kB view details)

Uploaded Python 3

File details

Details for the file askpablos_scrapy_api-0.4.0.tar.gz.

File metadata

  • Download URL: askpablos_scrapy_api-0.4.0.tar.gz
  • Upload date:
  • Size: 10.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for askpablos_scrapy_api-0.4.0.tar.gz
Algorithm Hash digest
SHA256 c88d7b041ef1d4444610b764f217a1b447d6f7ce3ccb381f66386fc9b0fd01fb
MD5 2a9d781b2f2e77ea893b0a488ea7ba03
BLAKE2b-256 fe0fbd87e2df99d542457d43f8ad4bfb9ccd552dc8cdd20bdc5bafc625eb85b0

See more details on using hashes here.

File details

Details for the file askpablos_scrapy_api-0.4.0-py3-none-any.whl.

File metadata

File hashes

Hashes for askpablos_scrapy_api-0.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 9e35ce4acc6ff1a4997a239b9cb3b947239e6c46f86601f479f56ea8661c5ad4
MD5 9cdde607c4fdc6391174fbb7ccf1510a
BLAKE2b-256 ced9e23e77fab1e3aad6be32e1d9eb7e31b68f43315eb4c1f8507515796715f6

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page