Skip to main content

A package to dynamically inject requirements into a virtual environment.

Project description

Requirement Manager

This project provides a RequirementManager (requires is an alias) class to manage Python package requirements using virtual environments. It can be used as a decorator or context manager to ensure specific packages are installed and available during the execution of a function or code block.

Features

  • Automatically creates and manages virtual environments.
  • Checks if the required packages are already installed.
  • Installs packages if they are not already available.
  • Supports ephemeral virtual environments that are deleted after use.
  • Can be used as a decorator or context manager.

Installation

pip install pydepinject

To use the uv backend for faster environment and package management, ensure uv is installed separately. You can find installation instructions at https://github.com/astral-sh/uv.

Usage

Decorator

To use the requires as a decorator, simply decorate your function with the required packages:

from pydepinject import requires


@requires("requests", "numpy")
def my_function():
    import requests
    import numpy as np

    print(requests.__version__)
    print(np.__version__)


my_function()

Context Manager

You can also use the requires as a context manager:

from pydepinject import requires


with requires("requests", "numpy"):
    import requests
    import numpy as np

    print(requests.__version__)
    print(np.__version__)

Virtual Environment with specific name

The requires can create a virtual environment with a specific name:

@requires("requests", venv_name="myenv")
def my_function():
    import requests

    print(requests.__version__)


with requires("pylint", "requests", venv_name="myenv"):
    import pylint

    print(pylint.__version__)
    import requests  # This is also available here because it was installed in the same virtual environment

    print(requests.__version__)


# The virtual environment name can also be set as PYDEPINJECT_VENV_NAME environment variable
import os

os.environ["PYDEPINJECT_VENV_NAME"] = "myenv"


@requires("requests")
def my_function():
    import requests

    print(requests.__version__)


with requires("pylint", "requests"):
    import pylint

    print(pylint.__version__)
    import requests  # This is also available here because it was installed in the same virtual environment

    print(requests.__version__)

Reusable Virtual Environments

The requires can create named virtual environments and reuse them across multiple functions or code blocks:

@requires("requests", venv_name="myenv", ephemeral=False)
def my_function():
    import requests

    print(requests.__version__)


with requires("pylint", "requests", venv_name="myenv", ephemeral=False):
    import pylint

    print(pylint.__version__)
    import requests  # This is also available here because it was installed in the same virtual environment

    print(requests.__version__)

Managing Virtual Environments

The requires can automatically delete ephemeral virtual environments after use. This is useful when you want to ensure that the virtual environment is clean and does not persist after the function or code block completes:

@requires("requests", venv_name="myenv", ephemeral=True)
def my_function():
    import requests

    print(requests.__version__)


my_function()

Forcing Virtual Environment Recreation

If you need to ensure a completely clean environment, you can force its recreation using the recreate=True parameter. This will delete and rebuild the virtual environment even if it already exists.

from pydepinject import requires


# This will delete the "my-clean-env" venv if it exists and create it from scratch
@requires("requests", venv_name="my-clean-env", recreate=True)
def my_function():
    import requests

    print(requests.__version__)


my_function()

Logging

This library uses Python's standard logging but does not configure handlers or levels by default. Configure logging in your application to see debug output:

import logging

logging.basicConfig(level=logging.INFO)  # or DEBUG for verbose output
logging.getLogger("pydepinject").setLevel(logging.DEBUG)

You can also integrate with your application's logging setup (structlog, rich logging, etc.) by attaching handlers as you normally would.

Backend selection

By default, backends are tried in priority order "uv|venv". If uv is installed on your system, it will be preferred for faster environment creation and installs; otherwise the standard library venv backend is used.

You can control backend selection:

  • Environment variable: set PYDEPINJECT_VENV_BACKEND, e.g. PYDEPINJECT_VENV_BACKEND=venv or PYDEPINJECT_VENV_BACKEND=uv|venv.
  • API param: pass venv_backend="uv", "venv", or a pipe-separated list like "uv|venv" to requires/RequirementManager.

On Windows, paths (Scripts, Lib/site-packages) are handled automatically.

Advanced options

Additional installer arguments

You can forward extra arguments to the underlying installer (pip or uv pip) via install_args. This is useful for custom indexes, constraints files, proxies, etc.

from pydepinject import requires


@requires(
    "requests",
    install_args=(
        "--index-url",
        "https://pypi.myorg/simple",
        "--upgrade-strategy",
        "eager",
    ),
    venv_backend="venv",
)
def my_function():
    import requests

    print(requests.__version__)

These arguments are appended to the installer command.

Virtual environment identity

For unnamed environments, a unique directory is generated based on a stable identity key. This key is derived from:

  • The set of requirements, which are normalized, canonicalized (e.g., PyYAML becomes pyyaml), and sorted alphabetically to ensure a consistent order.
  • The active Python version tag (e.g., py3.11).
  • The selected backend (uv or venv).
  • A short hash of the current Python interpreter's path to distinguish between different Python installations.

This process guarantees that identical dependency sets produce the same virtual environment, while any change in requirements, Python version, or backend results in a new, distinct environment. Named environments (created using the venv_name parameter) are not affected by this hashing mechanism.

Venv metadata

After successful installs, a metadata file .pydepinject-{timestamp}.json is written into the venv directory. It records:

  • pydepinject version, backend, Python version, interpreter path
  • Target platform, requested packages, forwarded install args
  • An ISO 8601 timestamp (UTC)

There might be multiple metadata files if the venv is reused across different runs with different requirements or install args. Each file is timestamped to avoid collisions.

This helps with debugging and reproducibility.

Configuration with Environment Variables

pydepinject can be configured using the following environment variables:

  • PYDEPINJECT_VENV_ROOT: Specifies the root directory where virtual environments are stored. If not set, a default temporary directory is used.
  • PYDEPINJECT_VENV_NAME: Sets a default name for the virtual environment, which can be useful for creating persistent, reusable environments across different runs.
  • PYDEPINJECT_VENV_BACKEND: Defines the virtual environment backend to use. Supported values are uv and venv. uv is preferred for its speed.

These variables provide a convenient way to standardize behavior in CI/CD pipelines or development environments.

Unit Tests

Unit tests are provided to verify the functionality of the requires. The tests use pytest and cover various scenarios including decorator usage, context manager usage, ephemeral environments, and more.

Running Tests

To run the unit tests, ensure you have pytest installed, and then execute the following command:

pytest

License

This project is licensed under the MIT License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pydepinject-0.0.4.dev0.tar.gz (27.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pydepinject-0.0.4.dev0-py3-none-any.whl (10.8 kB view details)

Uploaded Python 3

File details

Details for the file pydepinject-0.0.4.dev0.tar.gz.

File metadata

  • Download URL: pydepinject-0.0.4.dev0.tar.gz
  • Upload date:
  • Size: 27.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.11

File hashes

Hashes for pydepinject-0.0.4.dev0.tar.gz
Algorithm Hash digest
SHA256 bd915abe1af22760a79fc16afcaa8145b53e1dac8bf43bfd2f3dff34186c8e82
MD5 92c71a3030716e42a34aee950d424033
BLAKE2b-256 396d86018343cbb15ab4e7fc322727f454edeeec8075a5ef77325ab9b16b1555

See more details on using hashes here.

File details

Details for the file pydepinject-0.0.4.dev0-py3-none-any.whl.

File metadata

File hashes

Hashes for pydepinject-0.0.4.dev0-py3-none-any.whl
Algorithm Hash digest
SHA256 615554ec234dccd7a85a44085433e2ce77ce1c3cbfe34053b99609c1ad66d1b5
MD5 fbe74c849da64210a334bd1c3bdebff3
BLAKE2b-256 e1a51616744268ee3d09580f2502963711f8c7b73020c6441937fc7bc084a0c6

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page