Skip to main content

Amesa Inference

A lightweight inference package for running Amesa agents using ONNX models without Ray or PyTorch dependencies.

Overview

composabl_inference provides a standalone inference engine for running trained Amesa agents. It uses ONNX Runtime for model inference, making it suitable for deployment scenarios where you want to avoid heavy dependencies like Ray and PyTorch.

Features

  • ONNX-based inference: Uses ONNX Runtime for efficient model inference
  • No Ray or PyTorch dependencies: Lightweight package suitable for production deployment
  • Network management: Supports both local and remote objects (agents, perceptors, controllers)
  • Compatible API: Similar interface to Trainer.package() for easy migration

Installation

pip install amesa-inference

Usage

Basic Inference

from composabl_inference import InferenceEngine
from composabl_core import Agent

# Create inference engine (only license needed for license validation)
engine = InferenceEngine(license="your-license-key")

# Load agent
agent = Agent.load("path/to/agent")
await engine.load_agent(agent)

# Package agent for inference (similar to Trainer.package())
await engine.package()

# Run inference
observation = {...}  # Your observation from the simulator
action = engine.execute(observation)

With Remote Objects

The inference engine supports remote agents, perceptors, and controllers, just like the Trainer:

from composabl_inference import InferenceEngine

# Optional: provide custom config for NetworkMgr (e.g., for remote targets)
config = {
    "target": {
        "local": {
            "address": "localhost:1337",
        },
    },
}

engine = InferenceEngine(license="your-license-key", config=config)
await engine.load_agent("path/to/agent")
await engine.package()

# The agent processor will automatically handle remote objects
action = engine.execute(observation)

Cleanup

# Clean up resources
await engine.close()

Architecture

Components

  1. InferenceEngine: Main entry point for inference operations
  2. NetworkMgr: Manages network connections (non-Ray version)
  3. ONNXInferenceEngine: Handles ONNX model loading and inference
  4. ONNXAgentProcessor: Processes agents using ONNX models instead of PyTorch

Differences from Trainer

  • Uses ONNX Runtime instead of PyTorch for model inference
  • NetworkMgr is not a Ray actor (runs in the same process)
  • No Ray initialization required
  • Lighter weight, suitable for production deployment

Requirements

  • Python >= 3.10
  • composabl-core
  • composabl-api
  • onnxruntime
  • numpy

License

Proprietary and confidential - Copyright (C) Amesa, Inc

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

amesa_inference-0.37.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

amesa_inference-0.37.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

amesa_inference-0.37.1-cp311-cp311-macosx_11_0_arm64.whl (437.2 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

amesa_inference-0.37.1-cp311-cp311-macosx_10_9_x86_64.whl (439.9 kB view details)

Uploaded CPython 3.11macOS 10.9+ x86-64

amesa_inference-0.37.1-cp311-cp311-macosx_10_9_universal2.whl (875.4 kB view details)

Uploaded CPython 3.11macOS 10.9+ universal2 (ARM64, x86-64)

amesa_inference-0.37.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

amesa_inference-0.37.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

amesa_inference-0.37.1-cp310-cp310-macosx_11_0_arm64.whl (442.3 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

amesa_inference-0.37.1-cp310-cp310-macosx_10_9_x86_64.whl (444.8 kB view details)

Uploaded CPython 3.10macOS 10.9+ x86-64

amesa_inference-0.37.1-cp310-cp310-macosx_10_9_universal2.whl (885.4 kB view details)

Uploaded CPython 3.10macOS 10.9+ universal2 (ARM64, x86-64)

File details

Details for the file amesa_inference-0.37.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 99ac09ac44c45e4f6a95e3362cefd082290322351af00dee798d0cb229455c68
MD5 a925847ae0721b7c13b55a42743f9e4f
BLAKE2b-256 ed85bcd7252a6c74acb2cf191e6c85d48c882773de62f90bb57c271b8c45579c

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 01ded8a65c1865807cc5c53352bda750ec3ff2110e59e229f20ee6d26b432afc
MD5 b76ec9ab59697a1c4426b4cd23781b7a
BLAKE2b-256 35375c4dbf1080a766bca025f63f4a3c82b927d55dd25a6ec453134a7c75351e

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.1-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.1-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 e8cb21d603aaf1c1b775bceb136863d40aaa3137384bd41b9ad8675b4755a069
MD5 15067369e880fcb7a41cc068b2683eac
BLAKE2b-256 90298e6ed69ed9789d4db8bac564a7dc73e720eb48272ff0d20b2711e8474c8c

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.1-cp311-cp311-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.1-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.1-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 d3da415427210f3ce0bba711eec1f926373df154edea142533069d6603d4e92d
MD5 e559d19d9afef2abc52fa716044c36e6
BLAKE2b-256 6172b831f731830cdc68a5acb54724739d96f9a02ec72bb9a81f8cf958abdf9c

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.1-cp311-cp311-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.1-cp311-cp311-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.1-cp311-cp311-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 332bf682df4df41d9933c3867dacb756a3f167ad4ad6640d49ac8f4a277ed9a4
MD5 02d999bc0ec3bd9dcb32b743a1b071d7
BLAKE2b-256 aacce057cf567baba556c9afee845329e315747bb4b34cb06e1a46f87c9c28d8

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.1-cp311-cp311-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 a624dbd1b4326b49af5a682176cfa993ec7e55764317e3ea4dd37f9498309559
MD5 f5d626ee217cd5a5cfffde96e2d9748e
BLAKE2b-256 45fc044e988916b2279dc48b1d08ede1755025696bbac1ba64c5b60c3da48eff

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 879a21ff4d1dc4dbead508c71b6a318b740153fc64ed080a6e64afb192123e78
MD5 d5119264e3f21632db2a5d8b094534a7
BLAKE2b-256 4b768ec46864d3572273e60f18deb1a4b603e1be6590514bd1ee71f7eb34dbcb

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.1-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.1-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 08d46a67ed38ced98b113bd8a7b006b591ea125a137de6ea5cdcdaefd261abff
MD5 00b48e525982583731dd64d473306274
BLAKE2b-256 ebbc643a194005154ca41317237884226b919b06b0ad557d8628ddaef1a2d744

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.1-cp310-cp310-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.1-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.1-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 1d31359ef0f9257d425389aeb4f827a9418846fdea3df2ea30fe4a36fb0bf371
MD5 87e5c2dc17affae84c16a19cca0cc4d2
BLAKE2b-256 2c38c2a0465abcc912880cb73998b79cbe5017b80764b547a182c0e19f57fefc

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.1-cp310-cp310-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.37.1-cp310-cp310-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference-0.37.1-cp310-cp310-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 2f61e18ae4e467f738ead3adb9f2e8c10fc3dfc4e8382bdf00b4e237f67b151b
MD5 7509fbf49fc0301936f89d9f8dc0d376
BLAKE2b-256 bd1e0e91f2495bc8155d7637a9b1f0f03422e432d1a28c7d0576d10cf3e2c16f

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.37.1-cp310-cp310-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.37.1 This release

10 files

0.37.0

10 files

0.36.1

10 files

0.36.0

10 files

0.35.2

10 files

0.35.1

10 files

0.35.0

10 files

0.34.1

10 files

0.34.0

10 files

0.33.2

10 files

0.33.1

10 files

0.33.0

10 files

0.31.0

10 files

0.30.0

10 files

0.29.1

10 files

0.29.0

10 files

0.28.0

10 files

0.27.0

10 files

0.26.0

10 files

0.25.0

10 files

0.24.0

10 files

0.22.0

10 files

0.21.0

10 files

0.20.0

10 files

0.19.7

10 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page