Skip to main content

Amesa Inference

A lightweight inference package for running Amesa agents using ONNX models without Ray or PyTorch dependencies.

Overview

composabl_inference provides a standalone inference engine for running trained Amesa agents. It uses ONNX Runtime for model inference, making it suitable for deployment scenarios where you want to avoid heavy dependencies like Ray and PyTorch.

Features

  • ONNX-based inference: Uses ONNX Runtime for efficient model inference
  • No Ray or PyTorch dependencies: Lightweight package suitable for production deployment
  • Network management: Supports both local and remote objects (agents, perceptors, controllers)
  • Compatible API: Similar interface to Trainer.package() for easy migration

Installation

pip install amesa-inference

Usage

Basic Inference

from composabl_inference import InferenceEngine
from composabl_core import Agent

# Create inference engine (only license needed for license validation)
engine = InferenceEngine(license="your-license-key")

# Load agent
agent = Agent.load("path/to/agent")
await engine.load_agent(agent)

# Package agent for inference (similar to Trainer.package())
await engine.package()

# Run inference
observation = {...}  # Your observation from the simulator
action = engine.execute(observation)

With Remote Objects

The inference engine supports remote agents, perceptors, and controllers, just like the Trainer:

from composabl_inference import InferenceEngine

# Optional: provide custom config for NetworkMgr (e.g., for remote targets)
config = {
    "target": {
        "local": {
            "address": "localhost:1337",
        },
    },
}

engine = InferenceEngine(license="your-license-key", config=config)
await engine.load_agent("path/to/agent")
await engine.package()

# The agent processor will automatically handle remote objects
action = engine.execute(observation)

Cleanup

# Clean up resources
await engine.close()

Architecture

Components

  1. InferenceEngine: Main entry point for inference operations
  2. NetworkMgr: Manages network connections (non-Ray version)
  3. ONNXInferenceEngine: Handles ONNX model loading and inference
  4. ONNXAgentProcessor: Processes agents using ONNX models instead of PyTorch

Differences from Trainer

  • Uses ONNX Runtime instead of PyTorch for model inference
  • NetworkMgr is not a Ray actor (runs in the same process)
  • No Ray initialization required
  • Lighter weight, suitable for production deployment

Requirements

  • Python >= 3.10
  • composabl-core
  • composabl-api
  • onnxruntime
  • numpy

License

Proprietary and confidential - Copyright (C) Amesa, Inc

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

amesa_inference-0.34.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

amesa_inference-0.34.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

amesa_inference-0.34.0-cp311-cp311-macosx_11_0_arm64.whl (418.9 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

amesa_inference-0.34.0-cp311-cp311-macosx_10_9_x86_64.whl (418.9 kB view details)

Uploaded CPython 3.11macOS 10.9+ x86-64

amesa_inference-0.34.0-cp311-cp311-macosx_10_9_universal2.whl (835.7 kB view details)

Uploaded CPython 3.11macOS 10.9+ universal2 (ARM64, x86-64)

amesa_inference-0.34.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

amesa_inference-0.34.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.5 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

amesa_inference-0.34.0-cp310-cp310-macosx_11_0_arm64.whl (421.1 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

amesa_inference-0.34.0-cp310-cp310-macosx_10_9_x86_64.whl (421.6 kB view details)

Uploaded CPython 3.10macOS 10.9+ x86-64

amesa_inference-0.34.0-cp310-cp310-macosx_10_9_universal2.whl (840.7 kB view details)

Uploaded CPython 3.10macOS 10.9+ universal2 (ARM64, x86-64)

File details

Details for the file amesa_inference-0.34.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 2d09a58f38ee537cbfa0b77fd1d95ddc3cf225c502fb133d3c79cad6ce335865
MD5 f338b7a685bb9a239a0d2ce7c885762b
BLAKE2b-256 62d2bc34e1b5f222242dd72d9944a823af226fbda175e1f86f153b9e1937d480

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 f016c11d54ee31ed66db9eba6214f9013d00eb4a2b3c96a9eca21b96fe257ec5
MD5 2db6cf164fcdb31d651d994da07d2612
BLAKE2b-256 a02593a1e759132f8bd4465a4ca4428fffa33aa8c02bb7b9000420f3e10a4c33

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.0-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.0-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 7f52e6640281888f3945c654026e6efc7aa877ab2c1029ac81cd02c0208dceef
MD5 15f8da15cc3aec3e263950c88a4ddbe4
BLAKE2b-256 ae020cd91db69ffa3fbe95f1c9b7cb76605c76891e27eed414182f1b59257325

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.0-cp311-cp311-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.0-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.0-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 5b9893aeaa0a9514534203e5df1a910bc80005d1ec2dfadcf654c4fb405d5c25
MD5 54d8539cda27923b7d413a52e0d48068
BLAKE2b-256 730aa9152a8fba36ba8ee62be87dd456e48669ca95f16d11e645b4925772f03b

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.0-cp311-cp311-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.0-cp311-cp311-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.0-cp311-cp311-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 e26258a98f0f42e3c4e32dc913d790b9e7c73630d2ea0e611495b99fd1b1e5d2
MD5 bb6a32283f493296e72f8247a74ecf49
BLAKE2b-256 f914483a5923e5e4114d5b0d193c6f49b38af13297fcba8e97e8161178a0ee4c

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.0-cp311-cp311-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 487c3b7a5b2c39fdd6b44509c248f677cb3cec49b0afe4a9bfb746ff790cb1b7
MD5 7d3d17d794e227d9173ea7a649a5afe4
BLAKE2b-256 f082b5cd0f4d677f23e999605205eaf48e56f4c07e0295eb4da536d4177bd4bf

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 351fe14c2251f803b074e5b75e7a4dcbdd9fef257ea768d90ca8815aa65fb8db
MD5 a941faccea1608c504adbc7e14e10f51
BLAKE2b-256 2e978f22a686935fb8db356fca8af4a3af261832c8fb8e82fac6ebf37c9bfbb6

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.0-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.0-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 132a5f8b70a74d7ffe5c487bba5ac94d4e9009adf34dc4a90db5b86f2b4c9f1a
MD5 70978fb8eba419e6730954c7fc001d6b
BLAKE2b-256 eb357eba62d8ed62c37369673899d73d4bb8591841b70d321c92317f75850983

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.0-cp310-cp310-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.0-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.0-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 c5da63eaf7b160912028da1d961183544aac9fe7bc4d454e4ac73881d83581d6
MD5 05e14efc3ea97ab924b424529e8d0e0b
BLAKE2b-256 4014f455d08869bdf3cf14d96461797a0f616bf68c69dd3578068ce4db157f19

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.0-cp310-cp310-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.0-cp310-cp310-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.0-cp310-cp310-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 412ff69292223b2954671a5fe1058445a9869e443c4fcef9eee6b0139cd909a1
MD5 57831e4e391fbf129ac984ae24248c45
BLAKE2b-256 0e241948ce7c27123962793fb149ce307b82bdbd8828fdca5bcdb8cc9f551bcd

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.0-cp310-cp310-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.37.1

10 files

0.37.0

10 files

0.36.1

10 files

0.36.0

10 files

0.35.2

10 files

0.35.1

10 files

0.35.0

10 files

0.34.1

10 files

This release

0.34.0 This release

10 files

0.33.2

10 files

0.33.1

10 files

0.33.0

10 files

0.31.0

10 files

0.30.0

10 files

0.29.1

10 files

0.29.0

10 files

0.28.0

10 files

0.27.0

10 files

0.26.0

10 files

0.25.0

10 files

0.24.0

10 files

0.22.0

10 files

0.21.0

10 files

0.20.0

10 files

0.19.7

10 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page