Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Amesa Inference

A lightweight inference package for running Amesa agents using ONNX models without Ray or PyTorch dependencies.

Overview

composabl_inference provides a standalone inference engine for running trained Amesa agents. It uses ONNX Runtime for model inference, making it suitable for deployment scenarios where you want to avoid heavy dependencies like Ray and PyTorch.

Features

  • ONNX-based inference: Uses ONNX Runtime for efficient model inference
  • No Ray or PyTorch dependencies: Lightweight package suitable for production deployment
  • Network management: Supports both local and remote objects (agents, perceptors, controllers)
  • Compatible API: Similar interface to Trainer.package() for easy migration

Installation

pip install amesa-inference

Usage

Basic Inference

from composabl_inference import InferenceEngine
from composabl_core import Agent

# Create inference engine (only license needed for license validation)
engine = InferenceEngine(license="your-license-key")

# Load agent
agent = Agent.load("path/to/agent")
await engine.load_agent(agent)

# Package agent for inference (similar to Trainer.package())
await engine.package()

# Run inference
observation = {...}  # Your observation from the simulator
action = engine.execute(observation)

With Remote Objects

The inference engine supports remote agents, perceptors, and controllers, just like the Trainer:

from composabl_inference import InferenceEngine

# Optional: provide custom config for NetworkMgr (e.g., for remote targets)
config = {
    "target": {
        "local": {
            "address": "localhost:1337",
        },
    },
}

engine = InferenceEngine(license="your-license-key", config=config)
await engine.load_agent("path/to/agent")
await engine.package()

# The agent processor will automatically handle remote objects
action = engine.execute(observation)

Cleanup

# Clean up resources
await engine.close()

Architecture

Components

  1. InferenceEngine: Main entry point for inference operations
  2. NetworkMgr: Manages network connections (non-Ray version)
  3. ONNXInferenceEngine: Handles ONNX model loading and inference
  4. ONNXAgentProcessor: Processes agents using ONNX models instead of PyTorch

Differences from Trainer

  • Uses ONNX Runtime instead of PyTorch for model inference
  • NetworkMgr is not a Ray actor (runs in the same process)
  • No Ray initialization required
  • Lighter weight, suitable for production deployment

Requirements

  • Python >= 3.10
  • composabl-core
  • composabl-api
  • onnxruntime
  • numpy

License

Proprietary and confidential - Copyright (C) Amesa, Inc

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

amesa_inference_dev-0.38.1.dev2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

amesa_inference_dev-0.38.1.dev2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

amesa_inference_dev-0.38.1.dev2-cp311-cp311-macosx_11_0_arm64.whl (437.3 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

amesa_inference_dev-0.38.1.dev2-cp311-cp311-macosx_10_9_x86_64.whl (440.0 kB view details)

Uploaded CPython 3.11macOS 10.9+ x86-64

amesa_inference_dev-0.38.1.dev2-cp311-cp311-macosx_10_9_universal2.whl (875.5 kB view details)

Uploaded CPython 3.11macOS 10.9+ universal2 (ARM64, x86-64)

amesa_inference_dev-0.38.1.dev2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

amesa_inference_dev-0.38.1.dev2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

amesa_inference_dev-0.38.1.dev2-cp310-cp310-macosx_11_0_arm64.whl (442.4 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

amesa_inference_dev-0.38.1.dev2-cp310-cp310-macosx_10_9_x86_64.whl (444.9 kB view details)

Uploaded CPython 3.10macOS 10.9+ x86-64

amesa_inference_dev-0.38.1.dev2-cp310-cp310-macosx_10_9_universal2.whl (885.6 kB view details)

Uploaded CPython 3.10macOS 10.9+ universal2 (ARM64, x86-64)

File details

Details for the file amesa_inference_dev-0.38.1.dev2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 2c6407b5dd609e5e5975bf4cd3dcb8f54610ed5874e6ed84a1d60c8122740d0c
MD5 ee36bc879bdbf78a5543a0a463a5b3c6
BLAKE2b-256 712ecb1a29e966125972d5547b2936e1de99ef3911ade16684f3eb96b79b8a72

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 cc34735d5b249f3702e02c60cea54d1546a5d0e32cdee22e1f5590ab4ac16ad2
MD5 648e47ea3a82d3c9ceab6ff79434ff97
BLAKE2b-256 6e2e448f06dda8403af2149a7e0db5d879392ec0fc263f3fbdc070a6f2a59e2a

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev2-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev2-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 ad2336543426af1214a911fa20c0c72bacc76dcba3dee1e30c01d9b38064f02f
MD5 2f0492c82376e4c469d2a5d038a335ea
BLAKE2b-256 5a6edb24715fe2d0c9d70dee7d51365fd6d99c2d1faddb689d465040e25aa88c

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev2-cp311-cp311-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev2-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev2-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 f22f1002d1f8d80acf79061334517b6e79c214bec735aac3d445fd473d8b1782
MD5 c8fe5de2ae6ab56cc940e3557382b6ea
BLAKE2b-256 6be501abe6a2668bf82cd664a789e8b7b8548ee84576a087694b65a6a4822fde

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev2-cp311-cp311-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev2-cp311-cp311-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev2-cp311-cp311-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 d31d72701adfdb34e1a2c85b5f32b00dd8f9b6568598c0ce70e5057ddb1fce3b
MD5 2d4d2e196469f063b9170321264c1dd6
BLAKE2b-256 21e12a7321e20e991024ddcc43558ad22a2f49532350419528c15a231fb63fe9

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev2-cp311-cp311-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 1c1184aa80a95475f6861279962d984796ba524776cf9608f99a46664bb1953d
MD5 590d2bdada7d457eea4c5483827c01ce
BLAKE2b-256 8dc9749a17af9c1bacf86150506de227873726ce084e5c80742e7cd891dfc0be

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 f379e0eb229dc7f1b24a7e81fa94a3bb419b5ebc856c7652fc6bb917996afe61
MD5 323c42e2752f836201d2890a64b958d6
BLAKE2b-256 1b280b92193cc186d078809be260f952bc3baf387b394c0859fb64feecdb642d

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev2-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev2-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 2d711b0188f79d1ee4c1528990bfbca5258b6a9e653bd4c1d4b5d4c276a6753b
MD5 8cf57cea9aa6a8df92964f331d198d89
BLAKE2b-256 922eaa5409fe316af7def7375d8589994d24f69e0613f9a1065c47cdfca5118d

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev2-cp310-cp310-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev2-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev2-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 4a44dd9ea72d2588418cfba1082d1f3ed34e166abc45a8a33977ce86c8a9adc5
MD5 80ba1b6fcc8e4e94edec7f5f33f6c1ba
BLAKE2b-256 244c1d47343a7dc14033b5f3b0ebf74b81b95072b8953adc75b34187b80760bd

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev2-cp310-cp310-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev2-cp310-cp310-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev2-cp310-cp310-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 e1da1d71d600a65dc5915f6c4ac2f90ce878f30d3c80984da6a4242b50b31c15
MD5 458dad219df18f1823e0220c583ff868
BLAKE2b-256 129bc0d9258c0e2f4fc5881245eb8f02b8b078240df08b4cd16e6a3724f8f0a9

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev2-cp310-cp310-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.38.1.dev2 This release

10 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page