pkg-deploy

Modern Python Package Deployment Tool

What is it

pkg-deploy is a comprehensive Python package deployment tool that streamlines the process of building, versioning, and publishing Python packages to PyPI and private repositories. It supports both standard and Cython builds, automatic version management, and seamless Git integration.

Features

• Automatic Version Management: Support for semantic versioning with patch, minor, major, alpha, beta, and release candidate bumps
• Flexible Build System: Standard Python builds and optimized Cython compilation
• Code Minification: Optionally shrink the code before Cython compilation
• Source Leak Check: Cython wheels are rejected before upload if any .py or intermediate C source slipped in
• Multiple Repository Support: Deploy to PyPI, private Nexus repositories, and custom package indexes
• Git Integration: Automatic tagging and commit management
• Environment Detection: Native support for both pip and uv virtual environments
• Dry Run Mode: Build the wheel without publishing it, bumping the version, or touching Git
• Interactive Authentication: Secure credential input with API token support
• Automatic Cleanup: Clean removal of build artifacts after deployment

Installation

From PyPI

pip install pkg-deploy

Quick Start

Basic Usage

After installing pkg-deploy , navigate to your project directory (the folder containing your pyproject.toml ) and use the pkg-deploy command directly. Example project structure:

my-package/
├── src/
│   └── my_package/
│       ├── __init__.py
│       └── main.py
├── pyproject.toml
└── README.md

Running the Deployment

Use the pkg-deploy command with your desired arguments:

# Deploy with patch version bump to PyPI
pkg-deploy --repository-name pypi --version-type patch

# Deploy to private repository with minor version bump
pkg-deploy --repository-url https://nexus.example.com/repository/pypi-internal/ \
           --username admin --password secret --version-type minor

# Dry run to test configuration
pkg-deploy --repository-name pypi --version-type patch --dry-run

Configuration

pyproject.toml

pyproject.toml is required. pkg-deploy refuses to start without one, and it must declare [project].name and [project].version — the version is read from and written back to this file only, so a setup.py cannot stand in for it.

Ensure your pyproject.toml includes the required project metadata:

[build-system]
requires = ["setuptools>=70"]
build-backend = "setuptools.build_meta"

[project]
name = "your-package-name"
version = "1.0.0"
description = "Your package description"
requires-python = ">=3.10"
authors = [
    { name = "Your Name", email = "your.email@example.com" },
]
readme = "README.md"
dependencies = [
    "dependency1",
    "dependency2",
]

[tool.setuptools]
package-dir = {"" = "src"}
zip-safe = false

[tool.setuptools.packages.find]
where = ["src"]

# Optional: Version bump configuration, other wise will only bump version in pyproject.toml
[[tool.bumpversion.file]]
filename = "src/your_package/__init__.py"
search = '__version__ = "{current_version}"'
replace = '__version__ = "{new_version}"'

Package Directory Resolution

pkg-deploy automatically resolves the package directory using the following priority:

1. Explicit --package-dir: If specified via command line, this path is used directly
2. pyproject.toml Configuration: Automatically parsed from setuptools configuration:
   • tool.setuptools.packages.find.where - source directory location
   • tool.setuptools.package-dir - package directory mapping
3. Default Fallback: Uses project_dir/package_name based on the project name

Example configurations in pyproject.toml:

# Standard src layout
[tool.setuptools]
package-dir = {"" = "src"}

[tool.setuptools.packages.find]
where = ["src"]

# Custom package location
[tool.setuptools]
package-dir = {"my_package" = "custom/path"}

⚠️ Important: When package directory is configured in multiple places within pyproject.toml (such as both tool.setuptools.packages.find.where and tool.setuptools.package-dir), all configurations must point to the same directory. If they differ, pkg-deploy will raise a ValueError with the message "Package directory from toml are not the same".

.pypirc Configuration

For repository authentication, create a .pypirc file in your user home directory:

• Unix/macOS: ~/.pypirc
• Windows: C:\Users\username\.pypirc

[distutils]
index-servers =
    pypi
    private-repo

[pypi]
repository = https://upload.pypi.org/legacy/
username = __token__
password = pypi-your-api-token-here

[private-repo]
repository = https://nexus.example.com/repository/pypi-internal/
username = your-username
password = your-password

Usage Examples

Version Management

# Patch version bump (1.0.0 -> 1.0.1)
pkg-deploy --repository-name pypi --version-type patch

# Minor version bump (1.0.1 -> 1.1.0)
pkg-deploy --repository-name pypi --version-type minor

# Major version bump (1.1.0 -> 2.0.0)
pkg-deploy --repository-name pypi --version-type major

# Use specific version
pkg-deploy --repository-name pypi --new-version 2.1.0

# Pre-release versions
pkg-deploy --repository-name pypi --version-type alpha  # 1.0.0a1
pkg-deploy --repository-name pypi --version-type beta   # 1.0.0b1
pkg-deploy --repository-name pypi --version-type rc     # 1.0.0rc1

Cython Builds

# Build with Cython optimization
pkg-deploy --repository-name pypi --version-type patch --cython

# Cython build for private repository
pkg-deploy --repository-url https://nexus.example.com/repository/pypi-internal/ \
           --username user_name --password secret --cython

# Cython build with code minification
pkg-deploy --repository-name pypi --version-type patch --cython --minify

How setup.py is handled

A Cython build needs a setup.py. pkg-deploy decides what to do based on what it finds in the project directory:

pkg-deploy also rewrites [build-system] in pyproject.toml for the duration of the build (adding setuptools/Cython to requires and forcing build-backend to setuptools.build_meta), then restores it afterwards. Any version bump you asked for survives the restore; only the injected build-system entries are removed.

The Cython version actually used comes from your [build-system].requires. If you want a specific one, pin it there — the setup_requires line in the generated setup.py is a legacy field and does not control it.

Cross-Platform Multiple Version Builds with cibuildwheel

pkg-deploy supports cibuildwheel for building wheels across multiple Python versions and platforms as specified in your pyproject.toml configuration.

Benefits

• Cython Integration: Build wheels for all specified versions in one run
• Multi-Platform Support: Automatically builds wheels for Linux, macOS, and Windows
• Multiple Python Versions: Builds for all Python versions specified in configuration
• Binary Compatibility: Creates optimized binary wheels with proper platform tags

Requirements

• Docker (Linux only): Docker must be installed and running when building on Linux systems
• cibuildwheel: Automatically installed as a build dependency
• Sufficient disk space: Cross-platform builds require more storage

Configuration

Add cibuildwheel configuration to your pyproject.toml (Optional):

[tool.cibuildwheel]
# Specify which Python versions to build for
build = "cp38-* cp39-* cp310-* cp311-* cp312-* cp313-*"
before-build = "pip install Cython"

[tool.cibuildwheel.linux]
# Use manylinux images for better compatibility
before-all = "yum install -y gcc || apt-get update && apt-get install -y gcc"

[tool.cibuildwheel.macos]
# Ensure Cython is available for macOS builds
before-build = "pip install Cython"

[tool.cibuildwheel.windows]
# Ensure Cython is available for Windows builds
before-build = "pip install Cython"

Usage Examples

# Cross-platform Cython build with cibuildwheel
pkg-deploy --repository-name pypi --version-type patch --cython --cibuildwheel

# Deploy to private repository with cross-platform builds
pkg-deploy --repository-url https://nexus.example.com/repository/pypi-internal/ \
           --username admin --password secret --cython --cibuildwheel

# Dry run to test cross-platform build configuration
pkg-deploy --repository-name pypi --cython --cibuildwheel --dry-run

Limitations

• Build Time: Cross-platform builds take significantly longer than single-platform builds
• Docker Dependency: Linux builds require Docker to be installed and running
• Resource Usage: Requires more CPU, memory, and disk space during build process
• Platform Restrictions: Some platform-specific dependencies may not be available across all targets

Advanced Options

# Custom project directory
pkg-deploy --project-dir /path/to/project --repository-name pypi

# Custom package directory
pkg-deploy --package-dir /path/to/package --repository-name pypi

# Publish without recording the release in Git (version bump is reverted)
pkg-deploy --repository-name pypi --new-version 1.2.3 --discard-version-bump

# Verbose logging
pkg-deploy --repository-name pypi --verbose

# Dry run with verbose output
pkg-deploy --repository-name pypi --dry-run --verbose

Command Line Interface

Arguments

• --project-dir: Project directory (default: current directory)
• --package-dir: Package directory path (default: auto-resolved from pyproject.toml or project name)
• --version-type, -vt: Version bump type: patch, minor, major, alpha, beta, or rc
• --new-version, -v: Specify exact version number (overrides version-type). Must match MAJOR.MINOR.PATCH with an optional aN / bN / rcN suffix — 1.2, 1.2.3.post1 and 1.2.3dev1 are rejected
• --cython, -c: Enable Cython compilation for performance
• --minify, -m: Minify the code before compilation to reduce its size. Must be used together with --cython
• --cibuildwheel: Use cibuildwheel for cross-platform wheel building (requires Docker on Linux)
• --repository-name, -rn: Repository name from .pypirc configuration (e.g., 'pypi', 'testpypi')
• --repository-url, -ru: Repository upload URL (prompts for username/password if not in .pypirc)
• --username, -u: Authentication username (optional if configured in .pypirc)
• --password, -p: Authentication password/token (optional if configured in .pypirc)
• --discard-version-bump: Leave the repository untouched — no bump commit, no tag, no push, and the version bump written to pyproject.toml is reverted after a successful upload. The published version is then recorded nowhere in the repo, so the next deploy resolves to that same version again and the upload clashes; pair it with --new-version
• --skip-git-status-check: Skip Git status validation before deployment
• --dry-run: Build the wheel and log what would be uploaded, without publishing it, bumping the version, or touching Git. The build itself really runs, so dist/ and build/ are created and then cleaned up
• --verbose, -V: Enable detailed logging output

Environment Support

UV Virtual Environments

pkg-deploy detects a uv-managed environment by looking for a uv = ... marker in the pyvenv.cfg of the active interpreter. When it finds one it builds with uv build --wheel (installing uv first if it is missing); otherwise it falls back to python -m build --wheel. Passing --cibuildwheel overrides both and runs cibuildwheel instead.

Either way the build runs in an isolated environment that installs your [build-system].requires fresh, so that is where build-time pins such as Cython>=3.2 take effect. Note that uv caches resolutions — run uv cache clean if you need to be certain you picked up the newest matching release.

Security Considerations

API Tokens (Recommended)

For PyPI, use API tokens instead of passwords:

1. Generate token at https://pypi.org/manage/account/token/
2. Use __token__ as username
3. Use the generated token as password

Credential Storage

• Store credentials in .pypirc for reusability
• Leave --username / --password off the command line and let pkg-deploy prompt for them instead — the prompt uses getpass, so nothing is echoed or kept in your shell history

Troubleshooting

Common Issues

Git Repository Not Clean

Error: Git repo is NOT clean

Solution: Commit or stash your changes before deployment, or use --skip-git-status-check.

Missing Dependencies

Error: Missing required packages: build, twine

Solution: Install the missing packages. build, twine, toml and tomlkit are always required; --cython additionally requires Cython.

Cython Build Conflicts

Error: Cannot build Cython code: setup.py already exists

Solution: Back up the existing setup.py, add a cythonize call to it so pkg-deploy uses it as-is, or migrate its configuration to pyproject.toml. See How setup.py is handled.

Source Leak Detected

ValueError: Source leak detected in built wheel(s) - refusing to upload.

Solution: The listed files should have been compiled but were not. Check that every directory holding those modules has an __init__.py.

Contradictory Package Directory

ValueError: Package directory from toml are not the same: ['src', 'lib']

Solution: Make tool.setuptools.packages.find.where and tool.setuptools.package-dir point at the same directory, or pass --package-dir to override both.

Build Failures

ValueError: Cython build failed,
stdout: ...
stderr: ...

Solution: pkg-deploy reports the underlying build tool's output verbatim — read the stderr section first. For --cibuildwheel on Linux, check that Docker is installed and running, verify your [tool.cibuildwheel] configuration, and make sure there is enough disk space. pkg-deploy itself does not check for Docker, so a missing daemon surfaces as a cibuildwheel error inside this output.

Authentication Failures

Error: 403 Forbidden

Solution: Verify credentials, or use API tokens for PyPI. Omitting --username / --password makes pkg-deploy prompt for them interactively.

Debug Mode

Enable verbose logging for detailed troubleshooting:

pkg-deploy --repository-name pypi --verbose --dry-run

pkg-deploy - Streamlining Python package deployment since 2025.