This package helps you to crawl any site by setting your own config
Project description
Dall Crawler Package
This is a crawler.
from dallCrawler import Crawler
crawler = Crawler(url="https://example.com/{}/v2/{}")
# url can be set by setUrl(url) method
# type is optional
crawler.crawl("41257", "1", type='json')
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dallCrawler-0.0.9.tar.gz
(2.9 kB
view hashes)
Built Distribution
Close
Hashes for dallCrawler-0.0.9-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a3f0e238c9e04d07a2d4a010257aa6ed28326f5049b851bd2af087039b95f4ce |
|
MD5 | 26a8d31e05570841c34ce90ba5479976 |
|
BLAKE2b-256 | d0d3e5f416649d9e0c5162d404c17cdf2b81e1ad5e77bb8c2ab0be28e820b220 |