Skip to main content

A simple website scrapper with sequential files in it.

Project description

sequentialdw

Package to help myself scrapping website files automatically with only one functions:

seqdownload(base_url, start_index, end_index, custom_iterator, file_extension, output_folder, mode)
## MODE 1 for replacing duplicate filename, MODE 2 for ignoring the duplicate filaname

Usage

pip install sequentialdw

Then import the package as example:

from sequentialdw import seqdownload

seqdownload("https://example.com/scripts/python", 0, 100, "", "py", "output", 1)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sequentialdw-2.6.tar.gz (2.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sequentialdw-2.6-py3-none-any.whl (2.9 kB view details)

Uploaded Python 3

File details

Details for the file sequentialdw-2.6.tar.gz.

File metadata

  • Download URL: sequentialdw-2.6.tar.gz
  • Upload date:
  • Size: 2.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.11.3

File hashes

Hashes for sequentialdw-2.6.tar.gz
Algorithm Hash digest
SHA256 2a626041df635b143312cebbef6fd400f601caa4792741ab7713d85d2a25a99c
MD5 ff008c0e5d75d7b15ab11aa30ab9ce06
BLAKE2b-256 8458fde0b856046c1729b6b128f1a8cbdd8d1695ee03ccf4d607b35d5b3c0793

See more details on using hashes here.

File details

Details for the file sequentialdw-2.6-py3-none-any.whl.

File metadata

  • Download URL: sequentialdw-2.6-py3-none-any.whl
  • Upload date:
  • Size: 2.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.11.3

File hashes

Hashes for sequentialdw-2.6-py3-none-any.whl
Algorithm Hash digest
SHA256 272b035136eb2eac01b183c664bf1a69c9f93bd3b58bfcdb848cb256cd5e7637
MD5 eea86849804244089efe73358dcbef8e
BLAKE2b-256 e33775138e5ec888e11726e654b83f6f516e9270841ae256e486b7d48a11086a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page