A simple website scrapper with sequential files in it.
Project description
sequentialdw
Package to help myself scrapping website files automatically with only one functions:
seqdownload(base_url, start_index, end_index, custom_iterator, file_extension, output_folder, mode)
## MODE 1 for replacing duplicate filename, MODE 2 for ignoring the duplicate filaname
Usage
pip install sequentialdw
Then import the package as example:
import sequentialdw
seqdownload("https://example.com/scripts/python", 0, 100, "", "py", "output", 1)
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
sequentialdw-2.1.tar.gz
(2.3 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file sequentialdw-2.1.tar.gz.
File metadata
- Download URL: sequentialdw-2.1.tar.gz
- Upload date:
- Size: 2.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.11.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c03f09ad1c68a7827dda89e6337a3d1e9e61db7a03805396503cf06f3ddea0d9
|
|
| MD5 |
af2a8f2f003d0c61a5674b74bcf5ff71
|
|
| BLAKE2b-256 |
3c92735a4794e7893d9414647fd7fa233433163bf5beabcb8d1c4ddab3240ee8
|
File details
Details for the file sequentialdw-2.1-py3-none-any.whl.
File metadata
- Download URL: sequentialdw-2.1-py3-none-any.whl
- Upload date:
- Size: 3.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.11.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7d33f63a3e4f8f4fca29f196dc5b4a26d7730d57976ca217fc76f3043234c5a9
|
|
| MD5 |
ca01fb265fdcb24b3ad8e802764360d8
|
|
| BLAKE2b-256 |
8af6ebcece5424d11d6639b4be206b4c448992bd20b4b270f0bdc44f2123be1a
|