Skip to main content

Async-native orchestration framework — pre-0.1.0 and under active development.

Project description

minions

Async-native orchestration framework for running many long-lived “minions” (workers) on a single machine, with persistence and structured workflows.

Status: Pre-alpha (0.0.x). APIs are experimental and may change without notice.


What is this?

minions is an opinionated orchestration framework for:

  • running multiple long-lived async workers (“minions”)
  • wiring them into structured workflows / pipelines
  • managing shared resources with explicit lifecycles
  • persisting state (like via SQLite/aiosqlite) so workflows can resume after restarts

It’s aimed at things like:

  • trading / bot fleets
  • data collection loops
  • background automation agents
  • single-node orchestrated “systems” that don’t warrant full Kubernetes-style infra

The core ideas:

  • Pipelines – long-lived event emitters that produce work items
  • Minions – long-running async workers that listen to pipelines and spawn workflows
  • Workflows – per-event units of work that run to completion using shared resources
  • Resources – shared dependencies with startup/shutdown semantics
  • Persistence – minimal, pragmatic state so the system can recover and resume

Project status

This project is under active development and still in the pre-0.1.0 design/implementation phase:

  • APIs and naming are still being refined
  • Tests and docs are evolving
  • Breaking changes are expected between 0.0.x versions

If you’re here early, treat the codebase as a workbench, not a stable library.


Installation

The package name is reserved on PyPI, but the project is not ready for general use.

If you still want to experiment at your own risk:

pip install minions

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

minions-0.0.2.tar.gz (57.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

minions-0.0.2-py3-none-any.whl (86.8 kB view details)

Uploaded Python 3

File details

Details for the file minions-0.0.2.tar.gz.

File metadata

  • Download URL: minions-0.0.2.tar.gz
  • Upload date:
  • Size: 57.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.1

File hashes

Hashes for minions-0.0.2.tar.gz
Algorithm Hash digest
SHA256 b84733e127238c48a3257598c3b80bd2f75d458adec99a6d8b1a4009644a7cd6
MD5 a8d516da3223e36f2c56a62d1e90d1f8
BLAKE2b-256 b6475a80a3ffcf1a95feef4ae7dcab8059baedbc707856f21055fc091b416546

See more details on using hashes here.

File details

Details for the file minions-0.0.2-py3-none-any.whl.

File metadata

  • Download URL: minions-0.0.2-py3-none-any.whl
  • Upload date:
  • Size: 86.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.1

File hashes

Hashes for minions-0.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 65f0a1810b9ab474159dd55c2085d4dd27ea265e2c09600bb8eb44c2fe769741
MD5 f8cc01ee1ad9eec897b9ed0696ef8151
BLAKE2b-256 823f5ee1b1ab24ca5747030758e3a776a8e2854d2b06ea7da68648db35ac0d9e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page