This project can be used to mirror the pypi index using the new warehouse api.
Project description
pypi-downloader
Description
This project can be used to mirror the pypi index using the new warehouse API.
This project consists of two scripts:
- a multithreaded version of the main script, pypi-downloader-mt.py, as command: pypi-downloader
- a helper script to get the current list of packages from the pypi index site currently located at: https://pypi.org/, as command: pypi-packages
Config file
If a config file is specified as a command line parameter, the config file uses the YAML format.
The config file consists of four sections:
- logging - Specifies a logging.dictConfig dictionary
- threads - Number of threads to use
- packages - List of packages to download, if no packages are specified, all packages are downloaded from the pypi index site
- blacklist - List of packages to not download
Note: For logging, this module uses the root logger only. Note: Values specified in the config file (threads and packages) can be overridden by values specified on the command line.
Config file examples
Default configuration
logging: version: 1 formatters: simple: format: '[%(levelname)s]: %(message)s' handlers: console1: class: logging.StreamHandler level: ERROR formatter: simple stream: ext://sys.stderr console2: class: logging.StreamHandler level: DEBUG formatter: simple stream: ext://sys.stdout root: level: INFO stream: ext://sys.stdout handlers: [console1, console2] threads: 1 packages: blacklist:
Default configuration with packages and blacklist specified and non default thread count
logging: version: 1 formatters: simple: format: '[%(levelname)s]: %(message)s' handlers: console1: class: logging.StreamHandler level: ERROR formatter: simple stream: ext://sys.stderr console2: class: logging.StreamHandler level: DEBUG formatter: simple stream: ext://sys.stdout root: level: INFO stream: ext://sys.stdout handlers: [console1, console2] threads: 5 packages: - tox - mypy blacklist: - pyyaml
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Filename, size | File type | Python version | Upload date | Hashes |
---|---|---|---|---|
Filename, size pypi_downloader-2.0.4-py3-none-any.whl (9.7 kB) | File type Wheel | Python version py3 | Upload date | Hashes View |
Filename, size pypi-downloader-2.0.4.tar.gz (9.0 kB) | File type Source | Python version None | Upload date | Hashes View |
Close
Hashes for pypi_downloader-2.0.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ee3ee1ad4b5783f07a0dde7d4f8389ac02bce44047ca81ff87d9c2ce487a6a90 |
|
MD5 | f7c1e90f647fac281d193c3e8a36423e |
|
BLAKE2-256 | 59ea431cc1222d8e2d10b2c34a10f286589e57bd849603a198acc8e91f4f5d8d |