A simple web scraping helper package
Project description
pyscrapper
A simple Python package for crawling and structure validation.
get_structure.pyvalidate_get_structure.pycrawl.pyvalidate_crawl.py
Installation
pip install -e .
get_structure.py --out output/topic_structure.json
init(config, url)
validate_get_structure.py --out output/topic_structure.json
init()
crawl.py --url https://topic.com --out output
init(config)
validate_crawl.py --out output
init()
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
cccscrapper-0.1.1.tar.gz
(17.5 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file cccscrapper-0.1.1.tar.gz.
File metadata
- Download URL: cccscrapper-0.1.1.tar.gz
- Upload date:
- Size: 17.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6aa202fb2f7d2fc987640c63613f41e4ae5e591a448c12330a876e8498ef1275
|
|
| MD5 |
67ebfa476f5e8e24fa14d20a13f4a056
|
|
| BLAKE2b-256 |
ea7d0abf11ea393b9a5c4173ad7d89cffce4068bcf18de71d1bb021f51e38bb8
|
File details
Details for the file cccscrapper-0.1.1-py3-none-any.whl.
File metadata
- Download URL: cccscrapper-0.1.1-py3-none-any.whl
- Upload date:
- Size: 19.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8779559d9255ad736282c76c96199887f7855b08a75fd300f4734ba52842c9d8
|
|
| MD5 |
8d97f95c952ca33d84299c3da83604f4
|
|
| BLAKE2b-256 |
c1271d9197bef7877aea41ed4128e6d585f0dd96daa4193879b8e9dc49c63158
|