Downloaders
Python package to handle the download of multiple types of files.
How do I install this package?
As usual, just download it using pip:
pip install downloaders
Usage examples
from downloaders import BaseDownloader
downloader = BaseDownloader()
urls = [...]
downloader.download(urls)
Troubleshooting
MacOS multiprocessing nightmare fuel
Cupertino has a gift for us: somehow, under certain specific astral configurations on MacOS (which I have yet to fully understand), multiprocessing will crash with the following error:
The process has forked and you cannot use this CoreFoundation functionality safely. You MUST exec().
Break on __THE_PROCESS_HAS_FORKED_AND_YOU_CANNOT_USE_THIS_COREFOUNDATION_FUNCTIONALITY___YOU_MUST_EXEC__() to debug.
Apparently, this can be easily fixed by changing the way multiprocessing spawns processes:
import platform, multiprocessing
if platform.system() == "Darwin":
multiprocessing.set_start_method('spawn')
The aforementioned solution was proposed on this StackOverflow question.
1 maintainer
Metadata
1 maintainer
Release files for downloaders 1.0.22
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| downloaders-1.0.22.tar.gz | 11.7 kB | Details |
Release files / downloaders-1.0.22.tar.gz
| Download URL | downloaders-1.0.22.tar.gz |
|---|---|
| Size | 11.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
5bc676d0221a009fcad18257e058dbf50d04aa2337e57b215d25de36c14e6ec3
|
|
BLAKE2b-256 checksum How to use checksums |
d6bc49aaa2ab42600420a8ed2d79682f3eca176d4a947478126007f9795f6b55
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.9 tqdm/4.63.1 importlib-metadata/4.11.3 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.7.9
|
