Skip to main content

Local LXC/Incus container management for chatmail relay development and testing

Project description

cmlxc -- local chatmail container management and testing

Manage local Incus containers for chatmail relay development and testing.

cmlxc spins up lightweight LXC containers, deploys chatmail relay services into them via cmdeploy or madmail, and runs integration tests -- all without touching the host system.

Architecture

cmlxc manages four kinds of containers, each with a distinct role:

    cmlxc init / deploy-* / test-*
        |
        v
   +-----------------+   +------------------------+   +--------------------+
   | ns-localchat    |   | builder-localchat      |   | relay containers   |
   | (PowerDNS)      |   | (repos, venvs, builds) |   | (cm0, mad1, ...)   |
   +-----------------+   +------------------------+   +--------------------+
           ^                        |                           ^
           |      DNS zones         |        SSH / SCP          |
           +------------------------+---------------------------+

Base image (localchat-base) -- A Debian 12 image with SSH and Python pre-installed. All other containers are launched from this image (or from a cached relay image).

DNS container (ns-localchat) -- Runs PowerDNS authoritative + recursor. Provides .localchat DNS resolution so containers can reach each other by name.

Builder container (builder-localchat) -- The central workhorse. Holds repository checkouts (/root/relay, /root/madmail), Python virtualenvs for cmdeploy and mini-tests, and the compiled maddy binary. All deployment and test operations are executed inside the builder -- the host only needs cmlxc itself.

Relay containers (e.g. cm0-localchat, mad1-localchat) -- Ephemeral containers that receive a deployed chatmail service. Each relay is locked to a single deployment driver (cmdeploy or madmail); switching requires destroying and re-creating the container.

Deployment drivers

Drivers live in driver_cmdeploy.py and driver_madmail.py. Each driver has an init_builder() function (called during cmlxc init) and a deploy() function (called during cmlxc deploy-*).

  • cmdeploy -- Runs cmdeploy run from the builder container over SSH into the relay. Generates DNS zones, loads them into PowerDNS, and verifies records. After the first successful deploy the relay image is cached as localchat-relay so subsequent containers start pre-populated.

  • madmail -- Builds the maddy Go binary on first deploy (the triggered make is idempotent on reruns), then pushes it via SCP and runs madmail install --simple --ip <IP>. No DNS entries are needed.

Prerequisites

Incus installed and configured on the host. Usually only being part of the "incus" group is necessary, as containers can run with user privileges.

Installation

With pip:

python -m venv venv
source venv/bin/activate
pip install .

Or with uv:

uv venv venv
source venv/bin/activate
uv pip install .

Usage

Initialize the environment (base image, DNS container, builder container). At least one of --cmdeploy or --madmail is required:

cmlxc init --cmdeploy @main
cmlxc init --madmail @main
cmlxc init --cmdeploy @main --madmail @main

The SOURCE argument controls where the code comes from:

Form Meaning
@ref Clone default remote at branch/tag ref
/path or ./path Sync from a local checkout
URL@ref Clone a custom remote at ref

Examples with local checkouts or feature branches:

cmlxc init --cmdeploy ../relay --madmail @lmtp-rework
cmlxc init --cmdeploy @fix-dovecot

Running init again wipes and re-clones the repositories in the builder.

Deploy chatmail relays (creates containers if needed, then deploys):

cmlxc deploy-cmdeploy cm0 cm1
cmlxc deploy-madmail mad1
cmlxc deploy-madmail --ipv4-only mad1

Run integration tests inside the builder:

cmlxc test-mini cm0
cmlxc test-mini cm0 cm1          # cross-relay tests
cmlxc test-cmdeploy cm0 cm1

SSH into a deployed relay:

ssh -F ~/.config/cmlxc/ssh-config cm0

Lifecycle commands:

cmlxc status                # show all containers
cmlxc start cm0             # restart a stopped relay
cmlxc stop cm0 cm1          # stop relays
cmlxc destroy cm0           # stop + delete
cmlxc destroy --all         # destroy relays, keep DNS/builder
cmlxc destroy --reset       # full teardown, requires re-init

Increase verbosity with -v or -vv:

cmlxc deploy-cmdeploy -vv cm1

Shell Completion

cmlxc supports Bash tab-completion for subcommands, options, and container names.

Enable for the current session:

eval "$(register-python-argcomplete cmlxc)"

Enable permanently:

activate-global-python-argcomplete --user

Releasing

Versions are derived from git tags via setuptools-git-versioning. The changelog is generated with git-cliff using the cliff.toml config in the repo root.

Steps

  1. Preview unreleased changes:

    git cliff --unreleased
    
  2. Tag the release (the tag name becomes the version):

    git tag v0.1.0
    
  3. Generate the full changelog:

    git cliff -o CHANGELOG.md
    
  4. Amend the tag commit to include the changelog:

    git add CHANGELOG.md
    git commit --amend --no-edit
    git tag -f v0.1.0
    
  5. Push tag and branch:

    git push origin main --tags
    

The release.yml GitHub workflow triggers on pushed v* tags, builds the sdist + wheel, and publishes to PyPI via trusted publishing (OIDC).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cmlxc-0.6.6.tar.gz (33.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

cmlxc-0.6.6-py3-none-any.whl (32.9 kB view details)

Uploaded Python 3

File details

Details for the file cmlxc-0.6.6.tar.gz.

File metadata

  • Download URL: cmlxc-0.6.6.tar.gz
  • Upload date:
  • Size: 33.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for cmlxc-0.6.6.tar.gz
Algorithm Hash digest
SHA256 f757b39c0d969058177f505871226ffde48cfbe5e3ca37b86b7a9555a7e82eb3
MD5 dca24a8f4e843055e1649a4f10bae94d
BLAKE2b-256 2da1fcc00e9de5c25fab105836477d53a0fbb2eef926b8abdfe2b9d45a54817e

See more details on using hashes here.

Provenance

The following attestation bundles were made for cmlxc-0.6.6.tar.gz:

Publisher: release.yml on chatmail/cmlxc

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file cmlxc-0.6.6-py3-none-any.whl.

File metadata

  • Download URL: cmlxc-0.6.6-py3-none-any.whl
  • Upload date:
  • Size: 32.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for cmlxc-0.6.6-py3-none-any.whl
Algorithm Hash digest
SHA256 313b24ecc5c2033a5734a02d08320c14323b9a1a51f27b28d91ce823083c6850
MD5 cddbc65e51c82275dd040e7f2f781e3b
BLAKE2b-256 bf17cca40bbb4607e0d098c1a260bb5e8427c01a1453675be22c0c3eb30d2c0f

See more details on using hashes here.

Provenance

The following attestation bundles were made for cmlxc-0.6.6-py3-none-any.whl:

Publisher: release.yml on chatmail/cmlxc

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page