Skip to main content

AskPablos Scrapy API

PyPI Version Supported Python Versions

A professional Scrapy integration for seamlessly routing requests through AskPablos Proxy API with support for headless browser rendering and rotating IP addresses.

Documentation

Full documentation is available at: https://askpablos-scrapy-api.readthedocs.io/en/latest/index.html

Key Features

  • 🔄 Selective Proxying: Only routes requests with askpablos_api_map in their meta
  • 🌐 Headless Browser Support: Render JavaScript-heavy pages
  • 🔄 Rotating Proxies: Access to a pool of rotating IP addresses
  • 🧠 JavaScript Strategies: Three modes for different scraping scenarios
  • 📸 Screenshot Capture: Take screenshots
  • 🎯 SPA Operations: Advanced browser operations for interacting with Single Page Applications (wait for elements, click actions, etc.)
  • 📮 POST Request Support: Seamlessly handle both GET and POST requests with automatic body inclusion
  • 🔒 Secure Authentication: HMAC-SHA256 request signing
  • 🔁 Automatic Retries: Configurable retry logic
  • ⚠️ Comprehensive Error Handling: Detailed logging and error reporting

Quick Installation

pip install askpablos-scrapy-api

License

MIT License - See LICENSE file for details.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

askpablos_scrapy_api-0.5.2.tar.gz (12.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

askpablos_scrapy_api-0.5.2-py3-none-any.whl (15.2 kB view details)

Uploaded Python 3

File details

Details for the file askpablos_scrapy_api-0.5.2.tar.gz.

File metadata

  • Download URL: askpablos_scrapy_api-0.5.2.tar.gz
  • Upload date:
  • Size: 12.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.3

File hashes

Hashes for askpablos_scrapy_api-0.5.2.tar.gz
Algorithm Hash digest
SHA256 a71a59857c3dec2fb4ba53262a88eab82b82bd0cb433d3638742694848788c43
MD5 98c88c520e262925c782b05853ba7767
BLAKE2b-256 acac8cb1908fa9269a5ad90a5d8ebab435ccab46633be97b41ebab474ba10022

See more details on using hashes here.

File details

Details for the file askpablos_scrapy_api-0.5.2-py3-none-any.whl.

File metadata

File hashes

Hashes for askpablos_scrapy_api-0.5.2-py3-none-any.whl
Algorithm Hash digest
SHA256 a85f9dcaffe3b51804c58ac79874df835782f9f1b90fbfdfb460e8b8fed5d7b3
MD5 24e77cb5a5ffefbfb316d0c4488f3f08
BLAKE2b-256 39b6c81c8f8c39e647d94a703b230f07c7c803f57e99a31b8cc4901c5c6bd306

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page