Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Amesa Inference

A lightweight inference package for running Amesa agents using ONNX models without Ray or PyTorch dependencies.

Overview

composabl_inference provides a standalone inference engine for running trained Amesa agents. It uses ONNX Runtime for model inference, making it suitable for deployment scenarios where you want to avoid heavy dependencies like Ray and PyTorch.

Features

  • ONNX-based inference: Uses ONNX Runtime for efficient model inference
  • No Ray or PyTorch dependencies: Lightweight package suitable for production deployment
  • Network management: Supports both local and remote objects (agents, perceptors, controllers)
  • Compatible API: Similar interface to Trainer.package() for easy migration

Installation

pip install amesa-inference

Usage

Basic Inference

from composabl_inference import InferenceEngine
from composabl_core import Agent

# Create inference engine (only license needed for license validation)
engine = InferenceEngine(license="your-license-key")

# Load agent
agent = Agent.load("path/to/agent")
await engine.load_agent(agent)

# Package agent for inference (similar to Trainer.package())
await engine.package()

# Run inference
observation = {...}  # Your observation from the simulator
action = engine.execute(observation)

With Remote Objects

The inference engine supports remote agents, perceptors, and controllers, just like the Trainer:

from composabl_inference import InferenceEngine

# Optional: provide custom config for NetworkMgr (e.g., for remote targets)
config = {
    "target": {
        "local": {
            "address": "localhost:1337",
        },
    },
}

engine = InferenceEngine(license="your-license-key", config=config)
await engine.load_agent("path/to/agent")
await engine.package()

# The agent processor will automatically handle remote objects
action = engine.execute(observation)

Cleanup

# Clean up resources
await engine.close()

Architecture

Components

  1. InferenceEngine: Main entry point for inference operations
  2. NetworkMgr: Manages network connections (non-Ray version)
  3. ONNXInferenceEngine: Handles ONNX model loading and inference
  4. ONNXAgentProcessor: Processes agents using ONNX models instead of PyTorch

Differences from Trainer

  • Uses ONNX Runtime instead of PyTorch for model inference
  • NetworkMgr is not a Ray actor (runs in the same process)
  • No Ray initialization required
  • Lighter weight, suitable for production deployment

Requirements

  • Python >= 3.10
  • composabl-core
  • composabl-api
  • onnxruntime
  • numpy

License

Proprietary and confidential - Copyright (C) Amesa, Inc

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

amesa_inference_dev-0.38.0.dev16-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

amesa_inference_dev-0.38.0.dev16-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

amesa_inference_dev-0.38.0.dev16-cp311-cp311-macosx_11_0_arm64.whl (437.3 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

amesa_inference_dev-0.38.0.dev16-cp311-cp311-macosx_10_9_x86_64.whl (440.0 kB view details)

Uploaded CPython 3.11macOS 10.9+ x86-64

amesa_inference_dev-0.38.0.dev16-cp311-cp311-macosx_10_9_universal2.whl (875.5 kB view details)

Uploaded CPython 3.11macOS 10.9+ universal2 (ARM64, x86-64)

amesa_inference_dev-0.38.0.dev16-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

amesa_inference_dev-0.38.0.dev16-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

amesa_inference_dev-0.38.0.dev16-cp310-cp310-macosx_11_0_arm64.whl (442.4 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

amesa_inference_dev-0.38.0.dev16-cp310-cp310-macosx_10_9_x86_64.whl (444.9 kB view details)

Uploaded CPython 3.10macOS 10.9+ x86-64

amesa_inference_dev-0.38.0.dev16-cp310-cp310-macosx_10_9_universal2.whl (885.6 kB view details)

Uploaded CPython 3.10macOS 10.9+ universal2 (ARM64, x86-64)

File details

Details for the file amesa_inference_dev-0.38.0.dev16-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev16-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 b9016959d7ab3d0a6df29f8cd6bb911e69b53d625912c2779572bd59de0268af
MD5 2a21190356381d2b223135ff48a2e66b
BLAKE2b-256 122e84c2c9d26ea666bff5cf2a7fb10172639deb54b704e6f363d85520f6a459

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev16-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev16-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev16-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 06f3b06508cdeb11cc05f1009a7258f5a516829efbf67dbb585d46a39532b3c9
MD5 23c8a65d81ad346eb621dfd6bb3cd88e
BLAKE2b-256 e9a7a0f188799625445605c1608bdcee79b422da8c7ea8203d98ae82a61544ce

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev16-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev16-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev16-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 e09382fcac19358b31477150b11e63b55f7addf97571f3c772880c3a2148e4dc
MD5 914b9c0a45a2c26c65b9b64bb42e5137
BLAKE2b-256 a64f5deecc158a26fce532e39c1c84c0d17fe30e5cb6892ca817c44f2954713b

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev16-cp311-cp311-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev16-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev16-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 fb27addd169918f3961d0a8beec95a8a9d8adb0e056be4f39bd0a8adbc790d36
MD5 0c7b6cca56a023a6a39850701271d3e1
BLAKE2b-256 131abd94a1a2f1a5ccdfdbecb41528c622a21eafd08776f539e6a16cae9bbdf3

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev16-cp311-cp311-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev16-cp311-cp311-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev16-cp311-cp311-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 ca72a20fb9d68a3cd2e09d0599f4f23ab0a50e595fa22d446be55421aca0fce1
MD5 0579ddadf63318dfcf10a86aca859381
BLAKE2b-256 a949ea265de590f6a0d70e8288c65cf039dbf2e9a90b85079b8f778f8b491b48

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev16-cp311-cp311-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev16-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev16-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 b1ec335b71fa3b74f1576a4134f18c419689d26066d4bb3fd765ee0a78cb1697
MD5 12cc93751b3fe5d3f96a8fbd6c2cca48
BLAKE2b-256 d4464301362a3d971348840c1ef2a593b7a43c4ed1c2c9e7591ca136ad2ab97a

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev16-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev16-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev16-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 5eb97bf115a8d62b33df2a187463be230ab71e989dfa0baf89c501b8d22100d6
MD5 a02c34d3baef2a2956ba3e5b46347770
BLAKE2b-256 ffe2f928e30f51aa3800054b52de0932787a4ea9a67ba404de82ebbb8067debe

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev16-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev16-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev16-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 d3ebfc350b5eb23398a96e9aacc26b10f153a0b9ea9fe8036c921c1c1a0cc553
MD5 9481f1b2f6ed278e57455da410d6f08e
BLAKE2b-256 8cad41437cb2c2dc1a6862f40bd4090e1c91bdd370c8d0d4e69ce8ff0883cda2

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev16-cp310-cp310-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev16-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev16-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 37877bcc4daee65a42ac755030b1995d89c2430001053a9ff4dffb1a64f9bf0e
MD5 13e051c5c9b95025476a354edada9c87
BLAKE2b-256 2d2228c3e224c2b8bf77ee6f1d89ee2df91656ee96db8a409bb065bd22b87d54

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev16-cp310-cp310-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev16-cp310-cp310-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev16-cp310-cp310-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 2c5190c86f619b0e0e0dc6e30d7cc0b4d80742360e6e8b2345edf7ae26683a23
MD5 d4d281c84128ff041a20499f0d35803a
BLAKE2b-256 ec17b2616214d104c8afe41e11fbe831552a286cb3cc4ac527f09149c19c67f8

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev16-cp310-cp310-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.38.0.dev16 This release

10 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page