A simple website scrapper with sequential files in it.
Project description
sequentialdw
Package to help myself scrapping website files automatically with only one functions:
seqdownload(base_url, start_index, end_index, custom_iterator, file_extension, output_folder, mode)
## MODE 1 for replacing duplicate filename, MODE 2 for ignoring the duplicate filaname
Usage
pip install sequentialdw
Then import the package as example:
from sequentialdw import seqdownload
seqdownload("https://example.com/scripts/python", 0, 100, "", "py", "output", 1)
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
sequentialdw-3.0.tar.gz
(2.6 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file sequentialdw-3.0.tar.gz.
File metadata
- Download URL: sequentialdw-3.0.tar.gz
- Upload date:
- Size: 2.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.11.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a844cfafdda9c3ed4aae12e354b58bcc65a011b497bd6c5d9bb4423d8a27d7e1
|
|
| MD5 |
b9f7f1bd4c74bcb3a1a14d5465b4b84e
|
|
| BLAKE2b-256 |
b57be678ba6e92c9ae8bb4e079d4f45480974eced86c8682ad86084668d5d561
|
File details
Details for the file sequentialdw-3.0-py3-none-any.whl.
File metadata
- Download URL: sequentialdw-3.0-py3-none-any.whl
- Upload date:
- Size: 3.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.11.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
933787561d9b385eb5ae333d0d8dad9733840070c2686ba024542eab8e1d2326
|
|
| MD5 |
58a3ecb8f33806c79ee14c2978f989fa
|
|
| BLAKE2b-256 |
89ac8750ce3976b36a31c846179308994bf4aa32f2b4b47e98bc7aaa6a05ae02
|