downloaders

Python package to handle the download of multiple types of files.

How do I install this package?

As usual, just download it using pip:

pip install downloaders

Usage examples

from downloaders import BaseDownloader

downloader = BaseDownloader()
urls = [...]
downloader.download(urls)

Troubleshooting

MacOS multiprocessing nightmare fuel

Cupertino has a gift for us: somehow multiprocessing on MacOS in some specific astral configurations that I have yet to fully understand, it will crash with the following error:

The process has forked and you cannot use this CoreFoundation functionality safely. You MUST exec().
Break on __THE_PROCESS_HAS_FORKED_AND_YOU_CANNOT_USE_THIS_COREFOUNDATION_FUNCTIONALITY___YOU_MUST_EXEC__() to debug.

Apparently, this can be easily fixed by changing the way multiprocessing spawns processes, that is:

import platform, multiprocessing

if platform.system() == "Darwin":
    multiprocessing.set_start_method('spawn')

The aforementioned solution was proposed on this StackOverflow question.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

downloaders-1.0.19.tar.gz (10.6 kB view details)

Uploaded Oct 25, 2023 Source

File details

Details for the file downloaders-1.0.19.tar.gz.

File metadata

Download URL: downloaders-1.0.19.tar.gz
Upload date: Oct 25, 2023
Size: 10.6 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.9 tqdm/4.63.1 importlib-metadata/4.11.3 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.7.9

File hashes

Hashes for downloaders-1.0.19.tar.gz
Algorithm	Hash digest
SHA256	`d777d3ac5bfb7a79889bff2c79f2caba869bc062fadb028422a163a4b3cbe1a0`
MD5	`c5fc5acb34c076891ddb90c425804ba5`
BLAKE2b-256	`5d532f3f86b1fe2e8761d5ab83fc0c24696bd653162c6ad38e0ddc0063ac8a21`