A package for advanced Scrapy functionality and utilities.
Project description
Scraid
scraid is a Python library that provides advanced utilities for Scrapy, including an advanced features and utilities.
Installation
You can install scraid from PyPI:
pip install scraid
Usage
Here's a basic example of how to use the AdvancedRequest class:
from scraid.advanced_request import advancedRequest
request = AdvancedRequest('http://example.com')
print(request.headers['User-Agent']) # prints the random User-Agent
License
Contributing
Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.
TODO
- Add more scrapy most common utilities (middlewares, pipelines, etc.)
- Add more advanced request features
- Add more documentation
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file scraid-0.1.tar.gz.
File metadata
- Download URL: scraid-0.1.tar.gz
- Upload date:
- Size: 2.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
004c450c0ed06a053add603fe71a39375b510160801a7de5b2658b9930efc3b5
|
|
| MD5 |
66e1f000d1ac80b3dbdbb42f3c1ba22e
|
|
| BLAKE2b-256 |
c46cae5784983f18f34f99340a54739d871c8f6365a089631208711bfdb2eb4a
|
File details
Details for the file scraid-0.1-py2.py3-none-any.whl.
File metadata
- Download URL: scraid-0.1-py2.py3-none-any.whl
- Upload date:
- Size: 2.7 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
02bb40b1881ab6fcf281e1397395767860acc5ccb0d5261526992b87735524ba
|
|
| MD5 |
41ecfbbf2ecdb7267bcce3fcf1507af7
|
|
| BLAKE2b-256 |
4718928eee3e0b715f6b210d3905e719d110cadc992cbb63318da750799544c1
|