StreamShatter
Ever wondered where all the internet bandwidth you get from speedtest websites goes when you're actually trying to download something? Or does your WiFi constantly cut out and ruin your in-progress downloads? Well, either way, here's a tool that may or may not help!
Originally a very basic script for reliably downloading files from servers with inconsistent connections, this project has been revisited and modernised to use https://github.com/jawah/niquests to greatly improve multiplexing performance, for those who still have use for such a tool.
StreamShatter takes advantage of the Range HTTP header to dynamically allocate multiple chunks, by starting with one streaming request and gradually bisecting it while bandwidth permits, all without restarting the download. This allows for single, large file downloads from hosts that, whether intentionally or unintentionally, have degraded throughputs. The individual chunks also serve as checkpoints for if/when connections are broken.
Installation
Usage
usage: streamshatter [-h] [-V] [-H HEADERS] [-l CONCURRENT_LIMIT] [-sl SIZE_LIMIT] [-t TIMEOUT] [-s | --ssl | --no-ssl]
[-d | --debug | --no-debug] [-lp | --log-progress | --no-log-progress]
url [filename]
Multiplexed chunked file downloader
positional arguments:
url Target URL
filename Output filename; use "-" for stdout pipe
options:
-h, --help show this help message and exit
-V, --version show program's version number and exit
-H, --headers HEADERS
HTTP headers, interpreted as JSON
-l, -cl, --concurrent-limit CONCURRENT_LIMIT
Limits the amount of concurrent requests; defaults to 64
-sl, --size-limit SIZE_LIMIT
Limits the amount of data to download; defaults to 1099511627776
-t, --timeout TIMEOUT
Limits the amount of time allowed for the initial request to succeed
-s, --ssl, --no-ssl Enforces SSL verification; defaults to TRUE
-d, --debug, --no-debug
Terminates immediately upon non-timeout errors, and writes the response data for errored chunks; defaults to
FALSE
-lp, --log-progress, --no-log-progress
Continually updates a progress bar in the standard output; defaults to TRUE
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file streamshatter-1.2.3.tar.gz.
File metadata
- Download URL: streamshatter-1.2.3.tar.gz
- Upload date:
- Size: 11.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.14.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
309dcefa99e9d5bbf687dd4e93729cf4d06d72377fd510f8c9f83a40f0f25046
|
|
| MD5 |
31f3461fbefa5ca717ebbe0db879bc21
|
|
| BLAKE2b-256 |
5f94070315fc1f7e61cbb728b906a0f7a54833cb304a186da2ffdba398396d3c
|
File details
Details for the file streamshatter-1.2.3-py3-none-any.whl.
File metadata
- Download URL: streamshatter-1.2.3-py3-none-any.whl
- Upload date:
- Size: 12.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.14.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
132a9fd6f5eb1ccdb3a24e5573141bfd9f334844af179ca374dfd0400732f0d3
|
|
| MD5 |
ea3e1927bbbd154bcdb724f4fb080c84
|
|
| BLAKE2b-256 |
80da8e6fcc5fa54a780acf44cbeaa5806b5b18fb9d7e03aeba3869a371043eba
|
