Skip to main content

Amesa Inference

A lightweight inference package for running Amesa agents using ONNX models without Ray or PyTorch dependencies.

Overview

composabl_inference provides a standalone inference engine for running trained Amesa agents. It uses ONNX Runtime for model inference, making it suitable for deployment scenarios where you want to avoid heavy dependencies like Ray and PyTorch.

Features

  • ONNX-based inference: Uses ONNX Runtime for efficient model inference
  • No Ray or PyTorch dependencies: Lightweight package suitable for production deployment
  • Network management: Supports both local and remote objects (agents, perceptors, controllers)
  • Compatible API: Similar interface to Trainer.package() for easy migration

Installation

pip install amesa-inference

Usage

Basic Inference

from composabl_inference import InferenceEngine
from composabl_core import Agent

# Create inference engine (only license needed for license validation)
engine = InferenceEngine(license="your-license-key")

# Load agent
agent = Agent.load("path/to/agent")
await engine.load_agent(agent)

# Package agent for inference (similar to Trainer.package())
await engine.package()

# Run inference
observation = {...}  # Your observation from the simulator
action = engine.execute(observation)

With Remote Objects

The inference engine supports remote agents, perceptors, and controllers, just like the Trainer:

from composabl_inference import InferenceEngine

# Optional: provide custom config for NetworkMgr (e.g., for remote targets)
config = {
    "target": {
        "local": {
            "address": "localhost:1337",
        },
    },
}

engine = InferenceEngine(license="your-license-key", config=config)
await engine.load_agent("path/to/agent")
await engine.package()

# The agent processor will automatically handle remote objects
action = engine.execute(observation)

Cleanup

# Clean up resources
await engine.close()

Architecture

Components

  1. InferenceEngine: Main entry point for inference operations
  2. NetworkMgr: Manages network connections (non-Ray version)
  3. ONNXInferenceEngine: Handles ONNX model loading and inference
  4. ONNXAgentProcessor: Processes agents using ONNX models instead of PyTorch

Differences from Trainer

  • Uses ONNX Runtime instead of PyTorch for model inference
  • NetworkMgr is not a Ray actor (runs in the same process)
  • No Ray initialization required
  • Lighter weight, suitable for production deployment

Requirements

  • Python >= 3.10
  • composabl-core
  • composabl-api
  • onnxruntime
  • numpy

License

Proprietary and confidential - Copyright (C) Amesa, Inc

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

amesa_inference-0.34.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

amesa_inference-0.34.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

amesa_inference-0.34.1-cp311-cp311-macosx_11_0_arm64.whl (418.9 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

amesa_inference-0.34.1-cp311-cp311-macosx_10_9_x86_64.whl (418.9 kB view details)

Uploaded CPython 3.11macOS 10.9+ x86-64

amesa_inference-0.34.1-cp311-cp311-macosx_10_9_universal2.whl (835.7 kB view details)

Uploaded CPython 3.11macOS 10.9+ universal2 (ARM64, x86-64)

amesa_inference-0.34.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

amesa_inference-0.34.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.5 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

amesa_inference-0.34.1-cp310-cp310-macosx_11_0_arm64.whl (416.8 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

amesa_inference-0.34.1-cp310-cp310-macosx_10_9_x86_64.whl (422.3 kB view details)

Uploaded CPython 3.10macOS 10.9+ x86-64

amesa_inference-0.34.1-cp310-cp310-macosx_10_9_universal2.whl (837.1 kB view details)

Uploaded CPython 3.10macOS 10.9+ universal2 (ARM64, x86-64)

File details

Details for the file amesa_inference-0.34.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 860512b91926a7c1ce22849cddfe0291b48eb4cb665036c60d6149bc3467bc95
MD5 d6d73a19b41c7a689d37e0dd5cdf725a
BLAKE2b-256 7fcc037cfa96608db60faf2e08db8970106c3a8bba239da0d5407fcd700376c1

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 75f68579bc7b50855d823387643f1c2f675dd6746e76d28a38a3b1496b98926b
MD5 a58e1ff6d7e15299673994c3d4733773
BLAKE2b-256 8193390df133f17edf20d3e5634c65d82541a5ee8476134401bcf3f90b3a1dc3

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.1-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.1-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 0ce9d60abb257e1e9c972229b6905b6f1187edd729e490e243834ce23e00a49b
MD5 7af1e3e1348ec25512ce3ebd56fa694b
BLAKE2b-256 17eed695e703736c4bd22b7310a39585f37a3d779d07bf342ab096854b6bb69e

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.1-cp311-cp311-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.1-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.1-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 f3e0d14a94112a4114dad3fc4c6f37ffbc4a62cd0fedaf4bdc820343c5c0c889
MD5 cb28a57550d9d75b11b13dc7b318f46f
BLAKE2b-256 88d883d4665d4caf79c59ba60fd1846cb6f91595ffb9f8d7de95416fc12a659b

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.1-cp311-cp311-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.1-cp311-cp311-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.1-cp311-cp311-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 2baa6dd4bda8b9bbb8f6de83857661ab0105bc8acc463941391b92ba28df8876
MD5 460096f474f3441e9bc2ce58485c8f6f
BLAKE2b-256 4c4a83cdfde99c729b0531f17c9c143edcbc05ec96c3de10c6f800237cc95dd2

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.1-cp311-cp311-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 47a88798094d8eb39a949eed45849c167cb4f7526273fb0a9f6a1a0750b1ea61
MD5 fb9b2995ea86b5d63f7ff434e0c51a03
BLAKE2b-256 f7bbbb78634dbdbe96f2df7f2e8b17d8e979ed7d740623a8d338c1f77e86cb25

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 3a2cb510ca0217098dbcd5a0dd7d4639b51be4a71f542108383e3194681b772a
MD5 ff4cb5e4aa802f3c662e8cfa0e16b7e5
BLAKE2b-256 f3af1db8127f05a08b17aa1f16ddaa90348579e3d5c8448c569ddb6a76835864

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.1-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.1-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 7d2389a00bbcf3b7b084aecb1e58386224c05a718a2f88dc8db43adfbc33ef4b
MD5 5bc6ce60400566f60f4506247f40edf9
BLAKE2b-256 5bff2607bb002a683a2f6a6590195bdc1de09bff812ce95f58e7ada53ef040c9

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.1-cp310-cp310-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.1-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.1-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 e7710b9e218fa2d10fc229a16585b46aa71601ec9aa70a1cefed77da099769e2
MD5 3bbab8f8b633325879b89291147d23da
BLAKE2b-256 e4adf1387fcfb009e66ed5d359b9983c68065efa2853e0199bef8e69ddecdc35

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.1-cp310-cp310-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.34.1-cp310-cp310-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference-0.34.1-cp310-cp310-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 492f4fea845ad02790b3094f7b6277f332fdd1a43ef084ab39abca6cdcdf049d
MD5 a8adc64987e78e50b71e7626c84f65c7
BLAKE2b-256 737f25764149e95b11488ba3639c96c4c0ff6a7bba4a8414e1249191370df771

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.34.1-cp310-cp310-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.37.1

10 files

0.37.0

10 files

0.36.1

10 files

0.36.0

10 files

0.35.2

10 files

0.35.1

10 files

0.35.0

10 files

This release

0.34.1 This release

10 files

0.34.0

10 files

0.33.2

10 files

0.33.1

10 files

0.33.0

10 files

0.31.0

10 files

0.30.0

10 files

0.29.1

10 files

0.29.0

10 files

0.28.0

10 files

0.27.0

10 files

0.26.0

10 files

0.25.0

10 files

0.24.0

10 files

0.22.0

10 files

0.21.0

10 files

0.20.0

10 files

0.19.7

10 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page