Python package to handle the download of multiple types of files.
How do I install this package?
As usual, just download it using pip:
pip install downloadersUsage examples
from downloaders import BaseDownloader
downloader = BaseDownloader()
urls = [...]
downloader.download(urls)Troubleshooting
MacOS multiprocessing nightmare fuel
Cupertino has a gift for us: somehow multiprocessing on MacOS in some specific astral configurations that I have yet to fully understand, it will crash with the following error:
The process has forked and you cannot use this CoreFoundation functionality safely. You MUST exec().
Break on __THE_PROCESS_HAS_FORKED_AND_YOU_CANNOT_USE_THIS_COREFOUNDATION_FUNCTIONALITY___YOU_MUST_EXEC__() to debug.Apparently, this can be easily fixed by changing the way multiprocessing spawns processes, that is:
import platform, multiprocessing
if platform.system() == "Darwin":
multiprocessing.set_start_method('spawn')The aforementioned solution was proposed on this StackOverflow question.
1 maintainer
Metadata
1 maintainer
Release files for downloaders 1.0.19
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| downloaders-1.0.19.tar.gz | 10.6 kB | Details |
Release files / downloaders-1.0.19.tar.gz
| Download URL | downloaders-1.0.19.tar.gz |
|---|---|
| Size | 10.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
d777d3ac5bfb7a79889bff2c79f2caba869bc062fadb028422a163a4b3cbe1a0
|
|
BLAKE2b-256 checksum How to use checksums |
5d532f3f86b1fe2e8761d5ab83fc0c24696bd653162c6ad38e0ddc0063ac8a21
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.9 tqdm/4.63.1 importlib-metadata/4.11.3 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.7.9
|
