Skip to main content

A PDM plugin to resolve/install/uninstall project dependencies with Conda

Project description

pdm-conda

A PDM plugin to resolve/install/uninstall project dependencies with Conda.

Configuration

Config item Description Default value Possible values Environment variable
conda.runner Conda runner executable conda conda, mamba, micromamba PDM_CONDA_RUNNER
conda.solver Solver to use for Conda resolution conda conda, libmamba PDM_CONDA_SOLVER
conda.channels Conda channels to use, order will be enforced []
conda.as-default-manager Use Conda to install all possible requirements False PDM_CONDA_AS_DEFAULT_MANAGER
conda.batched-commands Execute batched install and remove Conda commands, when True the command is executed only at the end False PDM_CONDA_BATCHED_COMMANDS
conda.excludes Array of dependencies to exclude from Conda resolution []
conda.auto-excludes If cannot find package with Conda, add it to excludes list False PDM_CONDA_AUTO_EXCLUDES
conda.installation-method Installation method to use when installing dependencies with Conda hard-link hard-link, copy PDM_CONDA_INSTALLATION_METHOD
conda.dependencies Array of dependencies to install with Conda, analogue to project.dependencies []
conda.optional-dependencies Groups of optional dependencies to install with Conda, analogue to project.optional-dependencies {}
conda.dev-dependencies Groups of development dependencies to install with Conda, analogue to tool.pdm.dev-dependencies {}
conda.pypi-mapping.download-dir PyPI-Conda mapping download directory $HOME/.pdm-conda/ PDM_CONDA_PYPI_MAPPING_DIR
conda.pypi-mapping.url PyPI-Conda mapping url https://github.com/regro/cf-graph-countyfair/raw/master/mappings/pypi/grayskull_pypi_mapping.yaml PDM_CONDA_PYPI_MAPPING_URL

All configuration items use prefix pdm.tool, this is a viable configuration:

[tool.pdm.conda]
runner = "micromamba"
channels = ["conda-forge/noarch", "conda-forge", "anaconda"]
dependencies = ["pdm"]
as-default-manager = true
auto-excludes = true
solver = "libmamba"
excludes = ["pytest-cov"] # don't install with conda even if it's a dependency from other packages
installation-method = "copy"
batched-commands = true

[tool.pdm.conda.pypi-mapping]
download-dir = "/tmp"
url = "https://url/to/mapping.yaml"

[tool.pdm.conda.optional-dependencies]
extra = ["anaconda:ffmpeg"] # non python dependency, obtained from anaconda channel

[tool.pdm.conda.dev-dependencies]
dev = ["pytest"]

Usage

This plugin adds capabilities to the default PDM commands.

Working commands

The following commands were tested and work:

  • pdm init:
    • To list/use Conda managed python you must specify the Conda runner with -cr or --runner.
    • You also can specify a default Conda channel with -c or --channel.
  • pdm lock
  • pdm install
  • pdm add:
    • To add a Conda managed package --conda flag can be used multiple times followed a package (analogue to --editable).
    • You can specify per package Conda channel using conda notation channel::package.
    • You also can specify a default Conda channel with -c or --channel.
    • With flag -r or --runner you can specify the Conda runner to use.
    • With flag -ce or --conda-excludes you can add PyPi packages to the excluded from Conda resolution.
    • With flag --conda-as-default-manager you can set conda.as-default-manager to True.
  • pdm remove
  • pdm update
  • pdm list
  • pdm info
  • pdm venv:
    • create:
      • To list/use Conda managed python you must specify the Conda runner with -w or --with.
      • You can completely override the Conda environment name with -cn or --conda-name, the resulting environment won't follow PDM environment naming conventions.
    • list

How it works

Using conda/libmamba solver

PDM invokes Conda solver to resolve conda packages each time a PDM candidate makes a change in the last Conda resolution.

If only Conda packages are used (i.e. setting conda.as-default-manager to true and no conda.excludes) then Conda solver is invoked only once.

Settings overridden

In order to use Conda to install packages some settings were overriden:

  • python.use_venv if conda settings detected in pyproject.toml this setting is set to True.
  • python.in_project if conda settings detected in pyproject.toml and this setting was not previously set then is set to False.
  • python.use_pyenv if conda settings detected in pyproject.toml this setting is set to False.
  • venv.backend if conda settings detected in pyproject.toml this setting is set to conda.runner.
  • venv.location if conda settings detected in pyproject.toml, VIRTUAL_ENV or CONDA_PREFIX environment variables are set and this setting was not previously set then is set to the value of the environment variable.
  • install.parallel if some Conda managed packages are to be uninstalled or updated this option is disabled momentarily.

Some environment variables were overridden too:

  • PDM_IGNORE_ACTIVE_VENV if conda settings detected in pyproject.toml and VIRTUAL_ENV or CONDA_PREFIX environment variables are set then this variable is set to False.

Lock strategy

  • Lock strategy no_cross_platform for pdm lock is always forced as Conda doesn't produce cross-platform locks.
  • Lock strategy static_urls for Conda managed packages is always forced, independently of the lock strategy used for PyPi packages.
  • Lock strategy direct_minimal_versions for Conda managed packages will partially work as Conda doesn't have an option to force this mode on a resolution.

Development

For development docker-compose files exist in deploy directory, helper script deploy/docker-compose.sh can be used for executing docker.

For running dev environment:

bash deploy/docker-compose.sh -d up

And for productive environment:

bash deploy/docker-compose.sh up

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pdm_conda-0.17.2.tar.gz (41.1 kB view hashes)

Uploaded Source

Built Distribution

pdm_conda-0.17.2-py3-none-any.whl (52.6 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page