Skip to main content

Multiple Processes in a Single Container

Project description

Monofy: Multi-Process Docker Containers

This Python script is designed to manage multiple processes within a single Docker container, ensuring they are started, monitored, and terminated together.

This approach is useful when the processes are tightly integrated and need to operate in unison.

TL;DR

In your Docker file, include:

RUN pip install monofy

CMD ["monofy", "child-command-1", "--param-for-1", "|||", "child-command-2", "--param-for-2"]

Rationale

Running multiple processes in a single Docker container is often discouraged. However, when processes are closely connected and need to work together, this approach can simplify deployment and maintenance.

This script provides a Python-based solution to manage such processes efficiently within a single container, without adding unnecessary complexity. Read more about why this is a great idea

Features

  • Unified Process Management: Starts and manages multiple processes as children of a single parent process.

  • Connected fates: If one child process exits, terminate all others.

  • Signal Handling: Forwards relevant signals (e.g., SIGINT, SIGTERM) to all child processes.

  • Unified Output: Consolidates the output (stdout, stderr) of all child processes.

  • Graceful Shutdown: Ensure the parent process waits for all children to exit before shutting down.

  • Variable Substition: Substitute variables from the command line because Docker can't be bothered to do so itself

Installation

To use this script, clone the repository or install via your preferred method:

pip install monofy

Usage

You can use this script to start and manage multiple processes in a Docker container.

The commands for the processes and their own arguments should be passed as arguments should be passed as arguments to monofy, separated by the literal string |||.

You can also provide "pre commands", one or more commands to run before the parallel processes are started, usually to perform setup tasks like checking the environment. Such pre-commands should be separated by &&.

Examples

Launch two commands in parallel, with connected fates (death of one kills the other):

monofy child-command-1 --param-for-1 '|||' child-command-2 --param-for-2

(Note the single quotes around the operators, which ensure they are not parsed by your shell, but are instead passed on to monofy)

Launch some "pre commands" before launching two commands in parallel:

monofy pre-command-1 --foo=bar '&&' child-command-1 param-for-that '|||' child-command-2 -v

Example Dockerfile

Here’s how you might use this script in a Dockerfile:

FROM [..]

RUN pip install monofy

CMD ["monofy", "check-install", "--deploy", "&&", "web-server", "0.0.0.0:8000", "|||", "background-process", "-v"]

It's possible to pass-in a different combination of commands to start on the invocation of docker run:

docker run -it my-image monofy check-install --deploy '&&' web-server 0.0.0.0:1234 '|||' background-process -vvvv

Usage outside Docker

This package was written with (the limitations of) Docker in mind, but it can also be used in other contexts. One thing I found useful is to use it to start multiple development-related processes in a single line. The property that the death of one process takes down the others is very useful in reducing confusion if only a part of your set of tools goes down.

Alternatives

Use a process manager, like:

However, these tools are often more complex and require additional configuration. They also come with the subtle drawback that it is not possible to change the command to execute when running docker run (because they read config files to determine which commands to start, rather than taking that info from the command-line).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

monofy-1.1.1.tar.gz (9.4 kB view details)

Uploaded Source

Built Distribution

monofy-1.1.1-py3-none-any.whl (8.9 kB view details)

Uploaded Python 3

File details

Details for the file monofy-1.1.1.tar.gz.

File metadata

  • Download URL: monofy-1.1.1.tar.gz
  • Upload date:
  • Size: 9.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.12

File hashes

Hashes for monofy-1.1.1.tar.gz
Algorithm Hash digest
SHA256 a1e6494244d31ce8490711825b71ae3e049557017b531527a996afbffa2bc104
MD5 07b5d412ad919738c6f7167773a90a92
BLAKE2b-256 841b763548ac11a76e8f6220d5af998642047ed4366f38eefbb30d5154d42cfd

See more details on using hashes here.

File details

Details for the file monofy-1.1.1-py3-none-any.whl.

File metadata

  • Download URL: monofy-1.1.1-py3-none-any.whl
  • Upload date:
  • Size: 8.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.12

File hashes

Hashes for monofy-1.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 3415680ce542e88284d3cf775961d9e3cab8acd1f004d285d7ae72c2dee57793
MD5 765f8d2ba04c0e616957ee5f1cb0d194
BLAKE2b-256 0462bc659022598a5c33b58f9b04f3c006a06243b49044e919e64f7a21f0e128

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page