Skip to main content

Amesa Inference

A lightweight inference package for running Amesa agents using ONNX models without Ray or PyTorch dependencies.

Overview

composabl_inference provides a standalone inference engine for running trained Amesa agents. It uses ONNX Runtime for model inference, making it suitable for deployment scenarios where you want to avoid heavy dependencies like Ray and PyTorch.

Features

  • ONNX-based inference: Uses ONNX Runtime for efficient model inference
  • No Ray or PyTorch dependencies: Lightweight package suitable for production deployment
  • Network management: Supports both local and remote objects (agents, perceptors, controllers)
  • Compatible API: Similar interface to Trainer.package() for easy migration

Installation

pip install amesa-inference

Usage

Basic Inference

from composabl_inference import InferenceEngine
from composabl_core import Agent

# Create inference engine (only license needed for license validation)
engine = InferenceEngine(license="your-license-key")

# Load agent
agent = Agent.load("path/to/agent")
await engine.load_agent(agent)

# Package agent for inference (similar to Trainer.package())
await engine.package()

# Run inference
observation = {...}  # Your observation from the simulator
action = engine.execute(observation)

With Remote Objects

The inference engine supports remote agents, perceptors, and controllers, just like the Trainer:

from composabl_inference import InferenceEngine

# Optional: provide custom config for NetworkMgr (e.g., for remote targets)
config = {
    "target": {
        "local": {
            "address": "localhost:1337",
        },
    },
}

engine = InferenceEngine(license="your-license-key", config=config)
await engine.load_agent("path/to/agent")
await engine.package()

# The agent processor will automatically handle remote objects
action = engine.execute(observation)

Cleanup

# Clean up resources
await engine.close()

Architecture

Components

  1. InferenceEngine: Main entry point for inference operations
  2. NetworkMgr: Manages network connections (non-Ray version)
  3. ONNXInferenceEngine: Handles ONNX model loading and inference
  4. ONNXAgentProcessor: Processes agents using ONNX models instead of PyTorch

Differences from Trainer

  • Uses ONNX Runtime instead of PyTorch for model inference
  • NetworkMgr is not a Ray actor (runs in the same process)
  • No Ray initialization required
  • Lighter weight, suitable for production deployment

Requirements

  • Python >= 3.10
  • composabl-core
  • composabl-api
  • onnxruntime
  • numpy

License

Proprietary and confidential - Copyright (C) Amesa, Inc

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

amesa_inference-0.36.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

amesa_inference-0.36.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

amesa_inference-0.36.0-cp311-cp311-macosx_11_0_arm64.whl (420.8 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

amesa_inference-0.36.0-cp311-cp311-macosx_10_9_x86_64.whl (421.0 kB view details)

Uploaded CPython 3.11macOS 10.9+ x86-64

amesa_inference-0.36.0-cp311-cp311-macosx_10_9_universal2.whl (839.9 kB view details)

Uploaded CPython 3.11macOS 10.9+ universal2 (ARM64, x86-64)

amesa_inference-0.36.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

amesa_inference-0.36.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.5 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

amesa_inference-0.36.0-cp310-cp310-macosx_11_0_arm64.whl (423.0 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

amesa_inference-0.36.0-cp310-cp310-macosx_10_9_x86_64.whl (423.6 kB view details)

Uploaded CPython 3.10macOS 10.9+ x86-64

amesa_inference-0.36.0-cp310-cp310-macosx_10_9_universal2.whl (845.0 kB view details)

Uploaded CPython 3.10macOS 10.9+ universal2 (ARM64, x86-64)

File details

Details for the file amesa_inference-0.36.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 6ef60c3aa85fa81f3a7a9a428c62bdc58be7d49d6d486d8e9110d56f6f5c7213
MD5 3a24d007f23bc3fc57f4e356686873b3
BLAKE2b-256 f967258b80fea231696fda727ba1121f28e782c888e6c4ffd94ab010d591df38

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 b20e443bee86b245370e61fc02cc8236ecab5d71cac8f830988d41ffa9f068da
MD5 afb37d2b5b38f5c21ad9163ba6b9dd38
BLAKE2b-256 010534b618120976151a00ebb375b53f428cd6ba50c63457e045c6cf4123e541

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.0-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.0-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 3e988c7d3473216afa7ae4721b4d7346290d4e7ff9a6bcff4a9ffd2bd8058c12
MD5 0451d9d918ba8cae709ea8f7e81d383f
BLAKE2b-256 ca85e521df1b8a3c7aff176f7e6ef86710f79a3deb845e89533bed7e585a3121

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.0-cp311-cp311-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.0-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.0-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 b68e67cda9186dbd35cb222933ac040510c7968c94a4fb6b30f7941144dda27d
MD5 ec4af33da2740b2cc7b62dd063b40b39
BLAKE2b-256 21efca31c47a9f625ad1a2f9cf9333c1fd3f5dd2fa15f8f94486f1a83efd431a

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.0-cp311-cp311-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.0-cp311-cp311-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.0-cp311-cp311-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 8a65e04daea332a45e95cd96baeb1c5e70d1878b5725c72ac86d0942eeb844b2
MD5 076e7811e758486f4d5a9a2d3e326a22
BLAKE2b-256 e04d279135dc20337d7395f32f14ff2003f047df4f821cbd65a361608b476860

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.0-cp311-cp311-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 622642c29717a5bbf5c370969d2998dd920402cc692a9829332b09b6a03153d4
MD5 7b19ccf8945cd5475119d358b2f87443
BLAKE2b-256 a2a96d65c066efc2886fe387e8bdfa3065db3d9e5d691fff8c51362c9593f944

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 55d0c4a70cfdb04c4ef0459484b35aba83141da8aadc4a5bf8c9e0a0b7f2dac1
MD5 de5d16837fe3637d62fb1e20c45b0639
BLAKE2b-256 2b0bb284ebee7fd2bfa86bbc04056d2ab58c2b6c112f5a2dbbb63c9e6eec739f

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.0-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.0-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 b4986c13b705dfef11d06da529c7f39a700e73d6e84aed9dfd639510c838259c
MD5 84839557e5fa024466dc7fbc8c676c77
BLAKE2b-256 01c180f4ccd30d8380ab55bda525e74fa9156d917bab168d51ac6c6727c3d891

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.0-cp310-cp310-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.0-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.0-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 19ee6f1507e27124d30dcb3a127c0163d35a7810450fcb4e3eb618680368f39a
MD5 e227dfaa1a40da1c34c5038c476c30e9
BLAKE2b-256 20888e9a8b7aa2a9117d602590b58a8246180caecd62bbecb77b2341498b6541

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.0-cp310-cp310-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.0-cp310-cp310-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.0-cp310-cp310-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 1ea2c5f7c225fc081fb79d5738620b0ca22cb23ec7dd9800ae70eada53fe9ddc
MD5 31ae784e902359a1f82d20128137c227
BLAKE2b-256 7d041b3d306dce48201080316f753332919dc97892357f33bce05e908c1c6095

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.0-cp310-cp310-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.37.1

10 files

0.37.0

10 files

0.36.1

10 files

This release

0.36.0 This release

10 files

0.35.2

10 files

0.35.1

10 files

0.35.0

10 files

0.34.1

10 files

0.34.0

10 files

0.33.2

10 files

0.33.1

10 files

0.33.0

10 files

0.31.0

10 files

0.30.0

10 files

0.29.1

10 files

0.29.0

10 files

0.28.0

10 files

0.27.0

10 files

0.26.0

10 files

0.25.0

10 files

0.24.0

10 files

0.22.0

10 files

0.21.0

10 files

0.20.0

10 files

0.19.7

10 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page