Skip to main content

A simple web scraping helper package

Project description

pyscrapper

A simple Python package for crawling and structure validation.

  • get_structure.py
  • validate_get_structure.py
  • crawl.py
  • validate_crawl.py

Installation

pip install -e .

get_structure.py --out output/topic_structure.json
init(config, url)
 
validate_get_structure.py --out output/topic_structure.json
init()
 
crawl.py --url https://topic.com --out output
init(config)
 
validate_crawl.py --out output
init()

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cccscrapper-0.1.1.tar.gz (17.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

cccscrapper-0.1.1-py3-none-any.whl (19.7 kB view details)

Uploaded Python 3

File details

Details for the file cccscrapper-0.1.1.tar.gz.

File metadata

  • Download URL: cccscrapper-0.1.1.tar.gz
  • Upload date:
  • Size: 17.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.5

File hashes

Hashes for cccscrapper-0.1.1.tar.gz
Algorithm Hash digest
SHA256 6aa202fb2f7d2fc987640c63613f41e4ae5e591a448c12330a876e8498ef1275
MD5 67ebfa476f5e8e24fa14d20a13f4a056
BLAKE2b-256 ea7d0abf11ea393b9a5c4173ad7d89cffce4068bcf18de71d1bb021f51e38bb8

See more details on using hashes here.

File details

Details for the file cccscrapper-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: cccscrapper-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 19.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.5

File hashes

Hashes for cccscrapper-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 8779559d9255ad736282c76c96199887f7855b08a75fd300f4734ba52842c9d8
MD5 8d97f95c952ca33d84299c3da83604f4
BLAKE2b-256 c1271d9197bef7877aea41ed4128e6d585f0dd96daa4193879b8e9dc49c63158

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page