Skip to main content

AgeOS MVP CLI, sandbox, local model scheduler, and Python integrations.

Project description

AgeOS MVP

AgeOS is a Linux-first local agent runtime for sandboxed agents, local LLM routing, GPU/RAM-aware scheduling, and Python integration shims.

Install From Source

./scripts/install-deps.sh
./scripts/build.sh
ageos --help

./scripts/build.sh performs a system-wide source install: native binaries go under /usr/local, the managed Python runtime goes under /opt/ageos, and global launchers are linked into /usr/local/bin. This avoids Ubuntu's system Python pip restrictions while still making ageos available on PATH for every shell. The MVP expects llama-server on PATH for the default local backend. vLLM is optional and installed with:

sudo /opt/ageos/bin/python -m pip install ".[vllm]"

Commands

ageos poc --speciality default-instruct
ageos prompt --speciality code-review --structure example.json --text "Review this diff"
ageos run --binary ./agent.py --niceness 10
ageos ps
ageos queue --watch
ageos dashboard

--niceness is an AgeOS resource priority only. It controls GPU admission, RAM/VRAM budgets, model eviction, and memory-pressure behavior. It does not call Linux nice, setpriority, or ionice.

Examples

Run the basic Python shim agent through the AgeOS sandbox:

ageos run --binary ./examples/basic_agent.py --speciality default-instruct --memory 16G

The agent prints its AgeOS environment, calls the OpenAI-style Python shim, and prints the local model response.

RAM States

AgeOS tracks three memory pressure states:

  • available: jobs admit normally; niceness controls tie-breaks and preload order.
  • low: lower niceness agents receive RAM/VRAM first; background jobs wait.
  • no_ram: low-priority work is queued or rejected; only highest-priority jobs can run after idle models are freed.

Sandbox

ageos run is Linux-only. The native sandbox uses namespaces, read-only mounts, dropped capabilities, no-new-privs, seccomp when available, Landlock hook points, and cgroups v2. Agents do not receive direct GPU device access and must request inference through AgeOS.

For local development on non-Linux platforms only:

ageos run --binary ./agent.py --unsafe-no-sandbox

Python Shims

from ageos.integrations.openai_shim import AgeosOpenAI

client = AgeosOpenAI(speciality="code-review", niceness=5)
response = client.chat.completions.create(
    model="ignored",
    messages=[{"role": "user", "content": "hello"}],
)
print(response.choices[0].message.content)

Packaging Targets

  • Snap Store: ageos and optional ageos-vllm
  • APT/PPA: ageos, ageos-vllm
  • PyPI: ageos

Release automation lives in .github/workflows/release.yml. Push a v* tag to build Python, Debian, and Snap artifacts, attach them to a GitHub Release, and publish to configured stores. TestPyPI publishing requires the TEST_PYPI_API_TOKEN repository secret. PyPI publishing requires the PYPI_API_TOKEN repository secret. Snap Store publishing requires the SNAPCRAFT_STORE_CREDENTIALS repository secret and currently releases the devel snap to the edge channel.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ageos-0.1.0.tar.gz (21.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ageos-0.1.0-py3-none-any.whl (29.4 kB view details)

Uploaded Python 3

File details

Details for the file ageos-0.1.0.tar.gz.

File metadata

  • Download URL: ageos-0.1.0.tar.gz
  • Upload date:
  • Size: 21.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for ageos-0.1.0.tar.gz
Algorithm Hash digest
SHA256 1d44a1b2355aea505e0f76ad50e7d7fbd7b1a98cdff784e750363acedcf674b0
MD5 3255ec03f2956d54b5fde033fe39acc9
BLAKE2b-256 f73207f78ab4aae5fe788aa37869bb6c53bd655c50cec967e02bf17001ee54a7

See more details on using hashes here.

File details

Details for the file ageos-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: ageos-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 29.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for ageos-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 cf1c9b60423b3fd4d98f1ba71c3bb8a472d91991e5bf90c99b1a92e7161aa6a0
MD5 fe29a9674a93935ffd1a0bb1821bf162
BLAKE2b-256 94b289eaabd190e89c7087e118fcfad6a1fe90bc177899616d24c937b9107646

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page