Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Amesa Inference

A lightweight inference package for running Amesa agents using ONNX models without Ray or PyTorch dependencies.

Overview

composabl_inference provides a standalone inference engine for running trained Amesa agents. It uses ONNX Runtime for model inference, making it suitable for deployment scenarios where you want to avoid heavy dependencies like Ray and PyTorch.

Features

  • ONNX-based inference: Uses ONNX Runtime for efficient model inference
  • No Ray or PyTorch dependencies: Lightweight package suitable for production deployment
  • Network management: Supports both local and remote objects (agents, perceptors, controllers)
  • Compatible API: Similar interface to Trainer.package() for easy migration

Installation

pip install amesa-inference

Usage

Basic Inference

from composabl_inference import InferenceEngine
from composabl_core import Agent

# Create inference engine (only license needed for license validation)
engine = InferenceEngine(license="your-license-key")

# Load agent
agent = Agent.load("path/to/agent")
await engine.load_agent(agent)

# Package agent for inference (similar to Trainer.package())
await engine.package()

# Run inference
observation = {...}  # Your observation from the simulator
action = engine.execute(observation)

With Remote Objects

The inference engine supports remote agents, perceptors, and controllers, just like the Trainer:

from composabl_inference import InferenceEngine

# Optional: provide custom config for NetworkMgr (e.g., for remote targets)
config = {
    "target": {
        "local": {
            "address": "localhost:1337",
        },
    },
}

engine = InferenceEngine(license="your-license-key", config=config)
await engine.load_agent("path/to/agent")
await engine.package()

# The agent processor will automatically handle remote objects
action = engine.execute(observation)

Cleanup

# Clean up resources
await engine.close()

Architecture

Components

  1. InferenceEngine: Main entry point for inference operations
  2. NetworkMgr: Manages network connections (non-Ray version)
  3. ONNXInferenceEngine: Handles ONNX model loading and inference
  4. ONNXAgentProcessor: Processes agents using ONNX models instead of PyTorch

Differences from Trainer

  • Uses ONNX Runtime instead of PyTorch for model inference
  • NetworkMgr is not a Ray actor (runs in the same process)
  • No Ray initialization required
  • Lighter weight, suitable for production deployment

Requirements

  • Python >= 3.10
  • composabl-core
  • composabl-api
  • onnxruntime
  • numpy

License

Proprietary and confidential - Copyright (C) Amesa, Inc

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

amesa_inference_dev-0.38.0.dev14-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

amesa_inference_dev-0.38.0.dev14-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

amesa_inference_dev-0.38.0.dev14-cp311-cp311-macosx_11_0_arm64.whl (437.3 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

amesa_inference_dev-0.38.0.dev14-cp311-cp311-macosx_10_9_x86_64.whl (440.0 kB view details)

Uploaded CPython 3.11macOS 10.9+ x86-64

amesa_inference_dev-0.38.0.dev14-cp311-cp311-macosx_10_9_universal2.whl (875.5 kB view details)

Uploaded CPython 3.11macOS 10.9+ universal2 (ARM64, x86-64)

amesa_inference_dev-0.38.0.dev14-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

amesa_inference_dev-0.38.0.dev14-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

amesa_inference_dev-0.38.0.dev14-cp310-cp310-macosx_11_0_arm64.whl (442.4 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

amesa_inference_dev-0.38.0.dev14-cp310-cp310-macosx_10_9_x86_64.whl (444.9 kB view details)

Uploaded CPython 3.10macOS 10.9+ x86-64

amesa_inference_dev-0.38.0.dev14-cp310-cp310-macosx_10_9_universal2.whl (885.6 kB view details)

Uploaded CPython 3.10macOS 10.9+ universal2 (ARM64, x86-64)

File details

Details for the file amesa_inference_dev-0.38.0.dev14-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev14-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 e83073ba7deae7efafa16db02c21fbc7d83c4eece971191c8ba24933610bd096
MD5 53fbaaeb9eb217c54f4cd9fac9c23d76
BLAKE2b-256 8d553c1186bf07a6f3b2e57d4721bbbd58e1a94a0cef35dffe9bcb96bfc193ad

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev14-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev14-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev14-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 5044effbb1b44f5f7bb2789c9a617ff9de00af5cd22f1240010b23902fa059ef
MD5 99851a3d6f7836aed9a1ef109ba1de11
BLAKE2b-256 660a0b829f84cdb8714eb6ddc1c52c19305f1c4a1f0bc9e96135ff9acf33d5b7

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev14-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev14-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev14-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 3390d8eb0bd2ade488565f140b3aaef8009578fd5ffd9112209ba4769c64d90d
MD5 380cea67464527d4f55a014faa6848a7
BLAKE2b-256 105e66a8c33e66aefd601b9ddb126c10a7ac4425ec40d770f010a29e84f905b6

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev14-cp311-cp311-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev14-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev14-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 9712bbf99e67e96e7df5544e0ecf3d5e8f35efc25b9630fe952374db153efc31
MD5 12687cf00e6223b11c8a567d422f77bb
BLAKE2b-256 14e09b67840315aa100cecb8f06b917b5a203c4f4cbd55c9a6d2741805ddabdb

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev14-cp311-cp311-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev14-cp311-cp311-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev14-cp311-cp311-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 3fa12212681e189a91fabefa8dc996c0da018d91ae712528aeae4e485d7299dd
MD5 999792def1e8d8a7d581e552d5f1b48f
BLAKE2b-256 ccdbaaa4277e0234ee2989f91ab77c622b9910d925d2cd31923eb4b8d049c879

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev14-cp311-cp311-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev14-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev14-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 23039eea2deeba83e0692d7ac6a3b850241ab26f503d774328dd0ea2aea27cae
MD5 2dcffe1ad6f6535900f1ed68a5c9c185
BLAKE2b-256 6fd052745502f6d16bd76039dbd0b4ec81219c32c4f87cea34bc630de10f0a17

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev14-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev14-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev14-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 54d5e713b6585e75e752ffad6ec20b561ad944e77bd310e297b589e473611318
MD5 788c8dd24881f72afc68d994572f09d8
BLAKE2b-256 c78e2a687127338eff5b8b1960931d39b924e12ca34aab65bc4ba761ca0c478e

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev14-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev14-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev14-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 60d9160d856d6b50b523b850e55135a626eb83d73b5cd4ac0b62137354429059
MD5 1f147ed89cefd7e762c038bc80694586
BLAKE2b-256 be3fadd363d047759cf605d0fd6fd2ab0b5dae88a6ea0ec624f85ec17b52c8bd

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev14-cp310-cp310-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev14-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev14-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 5fbab05322490cd7c750f2415c8d06000637a4239c16921e51f217cbc099951e
MD5 b5cebd8c3fcfe073bd0c0c69f5959607
BLAKE2b-256 b64708d78b7c89ce42559b28286a4455e2cce1f91f3c9e5f28b9382de715679d

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev14-cp310-cp310-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev14-cp310-cp310-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev14-cp310-cp310-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 c61a35de909751f7acd26da9f760aeedade300829557f38cd366f74434bad3f0
MD5 68039ada5edbd963f419c48596a5bd3b
BLAKE2b-256 9c7ec35ae69d2e5925aac5739372f219cdd1aa75f1fd9dfd9f8e5f26e84ff571

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev14-cp310-cp310-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.38.0.dev14 This release

10 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page