Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Amesa Inference

A lightweight inference package for running Amesa agents using ONNX models without Ray or PyTorch dependencies.

Overview

composabl_inference provides a standalone inference engine for running trained Amesa agents. It uses ONNX Runtime for model inference, making it suitable for deployment scenarios where you want to avoid heavy dependencies like Ray and PyTorch.

Features

  • ONNX-based inference: Uses ONNX Runtime for efficient model inference
  • No Ray or PyTorch dependencies: Lightweight package suitable for production deployment
  • Network management: Supports both local and remote objects (agents, perceptors, controllers)
  • Compatible API: Similar interface to Trainer.package() for easy migration

Installation

pip install amesa-inference

Usage

Basic Inference

from composabl_inference import InferenceEngine
from composabl_core import Agent

# Create inference engine (only license needed for license validation)
engine = InferenceEngine(license="your-license-key")

# Load agent
agent = Agent.load("path/to/agent")
await engine.load_agent(agent)

# Package agent for inference (similar to Trainer.package())
await engine.package()

# Run inference
observation = {...}  # Your observation from the simulator
action = engine.execute(observation)

With Remote Objects

The inference engine supports remote agents, perceptors, and controllers, just like the Trainer:

from composabl_inference import InferenceEngine

# Optional: provide custom config for NetworkMgr (e.g., for remote targets)
config = {
    "target": {
        "local": {
            "address": "localhost:1337",
        },
    },
}

engine = InferenceEngine(license="your-license-key", config=config)
await engine.load_agent("path/to/agent")
await engine.package()

# The agent processor will automatically handle remote objects
action = engine.execute(observation)

Cleanup

# Clean up resources
await engine.close()

Architecture

Components

  1. InferenceEngine: Main entry point for inference operations
  2. NetworkMgr: Manages network connections (non-Ray version)
  3. ONNXInferenceEngine: Handles ONNX model loading and inference
  4. ONNXAgentProcessor: Processes agents using ONNX models instead of PyTorch

Differences from Trainer

  • Uses ONNX Runtime instead of PyTorch for model inference
  • NetworkMgr is not a Ray actor (runs in the same process)
  • No Ray initialization required
  • Lighter weight, suitable for production deployment

Requirements

  • Python >= 3.10
  • composabl-core
  • composabl-api
  • onnxruntime
  • numpy

License

Proprietary and confidential - Copyright (C) Amesa, Inc

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

amesa_inference_dev-0.38.0.dev15-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

amesa_inference_dev-0.38.0.dev15-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

amesa_inference_dev-0.38.0.dev15-cp311-cp311-macosx_11_0_arm64.whl (437.3 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

amesa_inference_dev-0.38.0.dev15-cp311-cp311-macosx_10_9_x86_64.whl (440.0 kB view details)

Uploaded CPython 3.11macOS 10.9+ x86-64

amesa_inference_dev-0.38.0.dev15-cp311-cp311-macosx_10_9_universal2.whl (875.6 kB view details)

Uploaded CPython 3.11macOS 10.9+ universal2 (ARM64, x86-64)

amesa_inference_dev-0.38.0.dev15-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

amesa_inference_dev-0.38.0.dev15-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

amesa_inference_dev-0.38.0.dev15-cp310-cp310-macosx_11_0_arm64.whl (442.4 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

amesa_inference_dev-0.38.0.dev15-cp310-cp310-macosx_10_9_x86_64.whl (444.9 kB view details)

Uploaded CPython 3.10macOS 10.9+ x86-64

amesa_inference_dev-0.38.0.dev15-cp310-cp310-macosx_10_9_universal2.whl (885.6 kB view details)

Uploaded CPython 3.10macOS 10.9+ universal2 (ARM64, x86-64)

File details

Details for the file amesa_inference_dev-0.38.0.dev15-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev15-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 0d0bf78e65f4f38db661a356038c3877b852c0a64f6cad82fa645f5c7620cf73
MD5 23f06d3dabd3cdb4bd21ae3ea0fc968c
BLAKE2b-256 e5b3b324d16b688451e72b68b7d38a6e4d8c61d80f52d59c82c17925a438ed88

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev15-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev15-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev15-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 20fbe2426697986e88ea39df39ad3472a0796441087e5d338b4a168af51737c1
MD5 78f59dd497e689ff4ac7accff03eb2ab
BLAKE2b-256 e881d96208f5995ae1506d505501cf511795541a9d817d679ca1a59c9214eba2

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev15-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev15-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev15-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 c1f8812619b31165c97223264bb3239c2d1b0ecaac2efd8e0676f8bb97c1a435
MD5 b3eb66e358c40ebc4a813eb71447a254
BLAKE2b-256 fb9d9514ecaef8c69c1c95820fc7a179432f4d4eed0eb4c9543b85c38ec512f1

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev15-cp311-cp311-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev15-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev15-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 8da0fc8fdfa1913ebc7d7dac91994a71c02837af6f956582bb73b22f700fc60d
MD5 cfe7ea42568a4daa12b96b0f05ba7ab0
BLAKE2b-256 21c0329bd917f7873732205209cf124d86065b865ce89a8fd2e0a67eec006d77

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev15-cp311-cp311-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev15-cp311-cp311-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev15-cp311-cp311-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 2c5430208448eb0cc79693010c887afae81359f35df74227a1b5fab9b52f8a17
MD5 ac633a563f0adb25f36d535ea1bf900f
BLAKE2b-256 ce96d191b312145c155cd35b7ee008b0fd54b6ac3a5c069ec209d650ac58e73e

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev15-cp311-cp311-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev15-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev15-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 fc5f092d46d2cec2095fe1862d45853f6841e76e3be8176c9c8e31b30842fac4
MD5 9e2828dde162b686c6156861ca8ffd28
BLAKE2b-256 776fcfabf09d9735cbfe60216455d8a5150cebba38a5a64a7482cd5beb58414f

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev15-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev15-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev15-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 fa746bdc54ed28a8b6b792a42cc8a16189c0b45e622d6948fe004a5450f3661b
MD5 c15b037282f77c22dfe33b06340f2bf5
BLAKE2b-256 66747e175977ebae6812a9b8a4282c35043ece201e1da7159467b89dd488c575

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev15-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev15-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev15-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 451110987224488e381c786ffa4ff9599ba0ad5ff80711f388c4b5ba175511a5
MD5 6e6cc7fc15186064fca952c9c2827ef2
BLAKE2b-256 5a2a9bfbc028df67e9a655821c5a2f07b4a9276f667b1295cf4da98a5f2728f7

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev15-cp310-cp310-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev15-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev15-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 e335d5e915a0d08151d2333eab6bc508107f9d25f1f9a275d3822a2446c5aaec
MD5 140136b7aca91468391a7698d1de4fab
BLAKE2b-256 548e3b85891c4cedffde4736ada2875c0811c295864036daf452363a4edd66e3

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev15-cp310-cp310-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev15-cp310-cp310-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev15-cp310-cp310-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 3b51a9cf53566383d0ab20f575e361d54c9def8020c30c980ed3a9c29a1a2f1a
MD5 ba0f4a33fbc144f60bdd1e9ee299fefa
BLAKE2b-256 f1833a87e3d6bda22b938a2cd602471d05947c7a99ebad7bc4c3f94d27b63ee0

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev15-cp310-cp310-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.38.0.dev15 This release

10 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page