This project has been archived by its maintainers, and is no longer receiving any updates.
Cruel is a Python web-request library that allows you to extract detailed information from any webpage or site.
Features
- Inbuilt beautiful soup instance
- ScraperAPI powered; so you don't have to worry about IP blocking
Installation
You can install the cruel using pip:
pip install cruel
Usage
Below are examples of how to use the cruel to extract data from Fiverr gig pages and user profiles.
Scrape Example
from cruel import session
session.set_scraper_api_key("XYZ-SCRAPER_API_KEY")
response = session.get("https://www.fiverr.com/username/your-gig-slug") # your fiverr url should be here
print(response.soup) # gives you beautiful soup instance
# You can use `response.soup` to further extract your information.
Get your ScraperAPI key here.
Project Structure
The cruel is organized into several modules to enhance code readability and maintainability:
cruel__init__.py: For exportingsession
cruel.utilsreq.py: Extending requests for Fiverr scrapingscrape_utils.py: Utilities for scraping
License
Contributing
New pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.
Author
Check more of my projects.
1 maintainer
Metadata
1 maintainer
Release files for cruel 0.0.12
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| cruel-0.0.12.tar.gz | 15.3 kB | Without provenance | Details |
Release files / cruel-0.0.12.tar.gz
| Download URL | cruel-0.0.12.tar.gz |
|---|---|
| Size | 15.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
89776657e795b2620fcc0a8791204e51fe56ef9b1764742ea7ee06b5c067f191
|
|
BLAKE2b-256 checksum How to use checksums |
d49d0289449c1434f9789f506e791c982dd32f799b6700d29e699ca6d47e1187
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.12.2
|
Security for cruel 0.0.12
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
