Skip to main content

A professional Scrapy integration for seamlessly routing requests through AskPablos Proxy API with support for headless browser rendering and rotating IP addresses

Project description

AskPablos Scrapy API

PyPI Version Supported Python Versions

A professional Scrapy integration for seamlessly routing requests through AskPablos Proxy API with support for headless browser rendering and rotating IP addresses.

Documentation

Full documentation is available at: https://askpablos-scrapy-api.readthedocs.io/en/latest/index.html

Key Features

  • 🔄 Selective Proxying: Only routes requests with askpablos_api_map in their meta
  • 🌐 Headless Browser Support: Render JavaScript-heavy pages
  • 🔄 Rotating Proxies: Access to a pool of rotating IP addresses
  • 🔒 Secure Authentication: HMAC-SHA256 request signing
  • 🔁 Automatic Retries: With exponential backoff
  • ⚠️ Comprehensive Error Handling: Detailed logging and error reporting
  • 🛡️ Rate Limiting: Built-in request rate limiting to avoid overloading the API

Quick Installation

pip install askpablos-scrapy-api

License

MIT License - See LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

askpablos_scrapy_api-0.2.2.tar.gz (8.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

askpablos_scrapy_api-0.2.2-py3-none-any.whl (10.3 kB view details)

Uploaded Python 3

File details

Details for the file askpablos_scrapy_api-0.2.2.tar.gz.

File metadata

  • Download URL: askpablos_scrapy_api-0.2.2.tar.gz
  • Upload date:
  • Size: 8.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.3

File hashes

Hashes for askpablos_scrapy_api-0.2.2.tar.gz
Algorithm Hash digest
SHA256 4d8c0de293c3f0d60f1ef629e5d8e1ee461fc4261658faefe0421cdf1452cad7
MD5 de6720062d4de9381958fe3b6c008913
BLAKE2b-256 3c52144d979f68e00f63385ac5113177a3c30c35246c1c7682ce6f98052a2872

See more details on using hashes here.

File details

Details for the file askpablos_scrapy_api-0.2.2-py3-none-any.whl.

File metadata

File hashes

Hashes for askpablos_scrapy_api-0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 17d1e198c754019173d27fc97c36c07c426bbf7b332aaef981938860fe1d818e
MD5 2d0a41f2cfb5debbffa583bb35709251
BLAKE2b-256 692c8e93a6eea63b9b09304d050b64995e6de9511e21108be812de211656c9fe

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page