Skip to main content

Amesa Inference

A lightweight inference package for running Amesa agents using ONNX models without Ray or PyTorch dependencies.

Overview

composabl_inference provides a standalone inference engine for running trained Amesa agents. It uses ONNX Runtime for model inference, making it suitable for deployment scenarios where you want to avoid heavy dependencies like Ray and PyTorch.

Features

  • ONNX-based inference: Uses ONNX Runtime for efficient model inference
  • No Ray or PyTorch dependencies: Lightweight package suitable for production deployment
  • Network management: Supports both local and remote objects (agents, perceptors, controllers)
  • Compatible API: Similar interface to Trainer.package() for easy migration

Installation

pip install amesa-inference

Usage

Basic Inference

from composabl_inference import InferenceEngine
from composabl_core import Agent

# Create inference engine (only license needed for license validation)
engine = InferenceEngine(license="your-license-key")

# Load agent
agent = Agent.load("path/to/agent")
await engine.load_agent(agent)

# Package agent for inference (similar to Trainer.package())
await engine.package()

# Run inference
observation = {...}  # Your observation from the simulator
action = engine.execute(observation)

With Remote Objects

The inference engine supports remote agents, perceptors, and controllers, just like the Trainer:

from composabl_inference import InferenceEngine

# Optional: provide custom config for NetworkMgr (e.g., for remote targets)
config = {
    "target": {
        "local": {
            "address": "localhost:1337",
        },
    },
}

engine = InferenceEngine(license="your-license-key", config=config)
await engine.load_agent("path/to/agent")
await engine.package()

# The agent processor will automatically handle remote objects
action = engine.execute(observation)

Cleanup

# Clean up resources
await engine.close()

Architecture

Components

  1. InferenceEngine: Main entry point for inference operations
  2. NetworkMgr: Manages network connections (non-Ray version)
  3. ONNXInferenceEngine: Handles ONNX model loading and inference
  4. ONNXAgentProcessor: Processes agents using ONNX models instead of PyTorch

Differences from Trainer

  • Uses ONNX Runtime instead of PyTorch for model inference
  • NetworkMgr is not a Ray actor (runs in the same process)
  • No Ray initialization required
  • Lighter weight, suitable for production deployment

Requirements

  • Python >= 3.10
  • composabl-core
  • composabl-api
  • onnxruntime
  • numpy

License

Proprietary and confidential - Copyright (C) Amesa, Inc

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

amesa_inference-0.37.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

amesa_inference-0.37.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

amesa_inference-0.37.0-cp311-cp311-macosx_11_0_arm64.whl (420.8 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

amesa_inference-0.37.0-cp311-cp311-macosx_10_9_x86_64.whl (421.0 kB view details)

Uploaded CPython 3.11macOS 10.9+ x86-64

amesa_inference-0.37.0-cp311-cp311-macosx_10_9_universal2.whl (839.9 kB view details)

Uploaded CPython 3.11macOS 10.9+ universal2 (ARM64, x86-64)

amesa_inference-0.37.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

amesa_inference-0.37.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.5 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

amesa_inference-0.37.0-cp310-cp310-macosx_11_0_arm64.whl (423.0 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

amesa_inference-0.37.0-cp310-cp310-macosx_10_9_x86_64.whl (423.6 kB view details)

Uploaded CPython 3.10macOS 10.9+ x86-64

amesa_inference-0.37.0-cp310-cp310-macosx_10_9_universal2.whl (845.0 kB view details)

Uploaded CPython 3.10macOS 10.9+ universal2 (ARM64, x86-64)

File details

Details for the file amesa_inference-0.37.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 b7fd24111abb53cdbc1b32a2fac05e4cfe9180aa7c498ee5bd92c6e6714c5cec
MD5 a046f320f10d756374443795f368c79c
BLAKE2b-256 65c9b5487c1f93c07554059bb2629e428dc4d96cd35beea590b3c75fc5a5e412

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 643122c900c79e19349fdee29eb3db39f436f3f4390633350353026280f05fb6
MD5 263536f9502bd767a984ca11234122fc
BLAKE2b-256 7d691dcf9bf5d0c3fe16eece0cce0d938bcc16718f41565687992f17ab5a41b8

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.0-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.0-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 1b54dd6a71d73bfd161ef178ced4c561e5b2cdf55769fe6ccbf09a1928e1f59d
MD5 d2fbfe67048df578461bc7512a5434b8
BLAKE2b-256 6ea21ef421af0ab169d8186b9b79a50f10ecece670d4439449a6044d64eece84

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.0-cp311-cp311-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.0-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.0-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 d3e0215f890eef6fac6350bc2a210a00aeab7d94037ebad90f3b28bf5e4077d8
MD5 6c02088c42183e0d385c2a72ef0557ba
BLAKE2b-256 564e3b9989de94afe566ce32d4fe9106c3394540a28772897e5e7a609b78294b

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.0-cp311-cp311-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.0-cp311-cp311-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.0-cp311-cp311-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 07b6f7596089e8161b68a1910ed6703bc7ff75e6097f36d3a39a1f3994d71f67
MD5 900b7a26d495e1f647c4563fa091f5c6
BLAKE2b-256 fbfd4a158b0699fce091bea19579b306bf8ffc5053959f460f71206b69076907

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.0-cp311-cp311-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 12a829e928d37fc8e03ecf1f94a8b6ac3dbb83f5e3364ba27bb01314dde27188
MD5 c33869d48adfb82da4af0f0161d85deb
BLAKE2b-256 a36611b8663474c4788292db94f73aa0b52d7fa4434e7f3466827d419745429e

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 73f31926a3aa773f7e53a1d1b5265526a5e06c632787e8abcec31343e759a5fa
MD5 1563c6889e1977099a14c6e585a69e02
BLAKE2b-256 5c6b92f81d9deb3029fc1da186b74d84d1d9d50e1e945b80b3474076c7651b73

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.0-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.0-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 abb27194730ed1d5463accf313fe4f68a79774fd29c6895e149859be08323e72
MD5 69e6ae8a12f19a37765a1dd8a951f360
BLAKE2b-256 d2286dee6261496409f4f20abb993f4f96def0678ed65931b932517e3be68b20

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.0-cp310-cp310-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.0-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.0-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 034651b76df0d41a54c69f9715efd3948f2ef2e29c8ae198cbdb2935fbbe8b98
MD5 140f0ab7b41714707f0bba72cb699c10
BLAKE2b-256 f96d2d631c9a71ed699e50aee4a515279a9e4a1bf10591fa3d631f862679a3f6

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.0-cp310-cp310-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.0-cp310-cp310-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.0-cp310-cp310-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 44d765c6565c07a08c721bf226cf894c5f810c3937a750ca06e9203db5b7c193
MD5 1da52972bfac9abd447c79a17c82d655
BLAKE2b-256 aef2da0f0386c13e70a7662ae782ca9ed6c6f324746b822dc9ff41f967a82a30

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.0-cp310-cp310-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.37.1

10 files

This release

0.37.0 This release

10 files

0.36.1

10 files

0.36.0

10 files

0.35.2

10 files

0.35.1

10 files

0.35.0

10 files

0.34.1

10 files

0.34.0

10 files

0.33.2

10 files

0.33.1

10 files

0.33.0

10 files

0.31.0

10 files

0.30.0

10 files

0.29.1

10 files

0.29.0

10 files

0.28.0

10 files

0.27.0

10 files

0.26.0

10 files

0.25.0

10 files

0.24.0

10 files

0.22.0

10 files

0.21.0

10 files

0.20.0

10 files

0.19.7

10 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page