askpablos-scrapy-api 0.4.9

A professional Scrapy integration for seamlessly routing requests through AskPablos Proxy API with support for headless browser rendering and rotating IP addresses

AskPablos Scrapy API

A professional Scrapy integration for seamlessly routing requests through AskPablos Proxy API with support for headless browser rendering and rotating IP addresses.

Documentation

Full documentation is available at: https://askpablos-scrapy-api.readthedocs.io/en/latest/index.html

Key Features

• 🔄 Selective Proxying: Only routes requests with askpablos_api_map in their meta
• 🌐 Headless Browser Support: Render JavaScript-heavy pages
• 🔄 Rotating Proxies: Access to a pool of rotating IP addresses
• 🧠 JavaScript Strategies: Three modes for different scraping scenarios
• 📸 Screenshot Capture: Take screenshots
• 🎯 SPA Operations: Advanced browser operations for interacting with Single Page Applications (wait for elements, click actions, etc.)
• 📮 POST Request Support: Seamlessly handle both GET and POST requests with automatic body inclusion
• 🔒 Secure Authentication: HMAC-SHA256 request signing
• 🔁 Automatic Retries: Configurable retry logic
• ⚠️ Comprehensive Error Handling: Detailed logging and error reporting

Quick Installation

pip install askpablos-scrapy-api

License

MIT License - See LICENSE file for details.