Skip to main content

AskPablos Scrapy API

PyPI Version Supported Python Versions

A professional Scrapy integration for seamlessly routing requests through AskPablos Proxy API with support for headless browser rendering and rotating IP addresses.

Documentation

Full documentation is available at: https://askpablos-scrapy-api.readthedocs.io/en/latest/index.html

Key Features

  • 🔄 Selective Proxying: Only routes requests with askpablos_api_map in their meta
  • 🌐 Headless Browser Support: Render JavaScript-heavy pages
  • 🔄 Rotating Proxies: Access to a pool of rotating IP addresses
  • 🧠 JavaScript Strategies: Three modes for different scraping scenarios
  • 📸 Screenshot Capture: Take screenshots
  • 🎯 SPA Operations: Advanced browser operations for interacting with Single Page Applications (wait for elements, click actions, etc.)
  • 📮 POST Request Support: Seamlessly handle both GET and POST requests with automatic body inclusion
  • 🔒 Secure Authentication: HMAC-SHA256 request signing
  • 🔁 Automatic Retries: Configurable retry logic
  • ⚠️ Comprehensive Error Handling: Detailed logging and error reporting

Quick Installation

pip install askpablos-scrapy-api

License

MIT License - See LICENSE file for details.

Metadata

Release files for askpablos-scrapy-api 0.5.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for askpablos-scrapy-api 0.5.2
File Size Uploaded
askpablos_scrapy_api-0.5.2.tar.gz 12.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for askpablos-scrapy-api 0.5.2
File Interpreter ABI Platform
askpablos_scrapy_api-0.5.2-py3-none-any.whl Python 3 none any Details

Total release size: 28.0 kB

Release files / askpablos_scrapy_api-0.5.2.tar.gz

Download URL askpablos_scrapy_api-0.5.2.tar.gz
Size 12.8 kB
Tags Source
SHA-256 checksum
How to use checksums
a71a59857c3dec2fb4ba53262a88eab82b82bd0cb433d3638742694848788c43
BLAKE2b-256 checksum
How to use checksums
acac8cb1908fa9269a5ad90a5d8ebab435ccab46633be97b41ebab474ba10022
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.14.3

Release files / askpablos_scrapy_api-0.5.2-py3-none-any.whl

Download URL askpablos_scrapy_api-0.5.2-py3-none-any.whl
Size 15.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
a85f9dcaffe3b51804c58ac79874df835782f9f1b90fbfdfb460e8b8fed5d7b3
BLAKE2b-256 checksum
How to use checksums
39b6c81c8f8c39e647d94a703b230f07c7c803f57e99a31b8cc4901c5c6bd306
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.14.3
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page