Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Amesa Inference

A lightweight inference package for running Amesa agents using ONNX models without Ray or PyTorch dependencies.

Overview

composabl_inference provides a standalone inference engine for running trained Amesa agents. It uses ONNX Runtime for model inference, making it suitable for deployment scenarios where you want to avoid heavy dependencies like Ray and PyTorch.

Features

  • ONNX-based inference: Uses ONNX Runtime for efficient model inference
  • No Ray or PyTorch dependencies: Lightweight package suitable for production deployment
  • Network management: Supports both local and remote objects (agents, perceptors, controllers)
  • Compatible API: Similar interface to Trainer.package() for easy migration

Installation

pip install amesa-inference

Usage

Basic Inference

from composabl_inference import InferenceEngine
from composabl_core import Agent

# Create inference engine (only license needed for license validation)
engine = InferenceEngine(license="your-license-key")

# Load agent
agent = Agent.load("path/to/agent")
await engine.load_agent(agent)

# Package agent for inference (similar to Trainer.package())
await engine.package()

# Run inference
observation = {...}  # Your observation from the simulator
action = engine.execute(observation)

With Remote Objects

The inference engine supports remote agents, perceptors, and controllers, just like the Trainer:

from composabl_inference import InferenceEngine

# Optional: provide custom config for NetworkMgr (e.g., for remote targets)
config = {
    "target": {
        "local": {
            "address": "localhost:1337",
        },
    },
}

engine = InferenceEngine(license="your-license-key", config=config)
await engine.load_agent("path/to/agent")
await engine.package()

# The agent processor will automatically handle remote objects
action = engine.execute(observation)

Cleanup

# Clean up resources
await engine.close()

Architecture

Components

  1. InferenceEngine: Main entry point for inference operations
  2. NetworkMgr: Manages network connections (non-Ray version)
  3. ONNXInferenceEngine: Handles ONNX model loading and inference
  4. ONNXAgentProcessor: Processes agents using ONNX models instead of PyTorch

Differences from Trainer

  • Uses ONNX Runtime instead of PyTorch for model inference
  • NetworkMgr is not a Ray actor (runs in the same process)
  • No Ray initialization required
  • Lighter weight, suitable for production deployment

Requirements

  • Python >= 3.10
  • composabl-core
  • composabl-api
  • onnxruntime
  • numpy

License

Proprietary and confidential - Copyright (C) Amesa, Inc

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

amesa_inference_dev-0.38.1.dev1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

amesa_inference_dev-0.38.1.dev1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

amesa_inference_dev-0.38.1.dev1-cp311-cp311-macosx_11_0_arm64.whl (437.3 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

amesa_inference_dev-0.38.1.dev1-cp311-cp311-macosx_10_9_x86_64.whl (440.0 kB view details)

Uploaded CPython 3.11macOS 10.9+ x86-64

amesa_inference_dev-0.38.1.dev1-cp311-cp311-macosx_10_9_universal2.whl (875.5 kB view details)

Uploaded CPython 3.11macOS 10.9+ universal2 (ARM64, x86-64)

amesa_inference_dev-0.38.1.dev1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

amesa_inference_dev-0.38.1.dev1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

amesa_inference_dev-0.38.1.dev1-cp310-cp310-macosx_11_0_arm64.whl (442.4 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

amesa_inference_dev-0.38.1.dev1-cp310-cp310-macosx_10_9_x86_64.whl (444.9 kB view details)

Uploaded CPython 3.10macOS 10.9+ x86-64

amesa_inference_dev-0.38.1.dev1-cp310-cp310-macosx_10_9_universal2.whl (885.6 kB view details)

Uploaded CPython 3.10macOS 10.9+ universal2 (ARM64, x86-64)

File details

Details for the file amesa_inference_dev-0.38.1.dev1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 6c665840541f44c0e5d590174bb438a811547e4c4ec9a27049d70ea03330423a
MD5 8430c308f319e62370ad777e47284ab7
BLAKE2b-256 b1faefe27c441d7dcf4f95567612e2640c54172120a696c9c2379b4c101b68ef

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 af1f076147cba6b86043bb7696b2d5a06c374e042ef0fff1ab602d45870d6b4a
MD5 8979d12c9cbb54709891ec4123e29bed
BLAKE2b-256 4c88da282a69559736e552a4f26869fdd7ee6496754a1e5b1420385ce8861747

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev1-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev1-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 144a582f75291a760484486e9eb10fb31160a5e66898a9bbcab7e35b0a76c9d4
MD5 0ca33a3ab9c5ce102514a2a7e75b0610
BLAKE2b-256 fdd2f233fb8fa9898af98198c684df4e1a79d8e01757369c23f6fbb9de6f6a48

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev1-cp311-cp311-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev1-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev1-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 64f2a6f13411d1ff34fb51302070b909e370fce8fe7b20d553380b8490dc2de1
MD5 a9cbcacc16a15eb1b91c136e904017bb
BLAKE2b-256 330d1f43d2d52e89b271e1ea07d3606faa57d013276153e52ac98eb65566dbea

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev1-cp311-cp311-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev1-cp311-cp311-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev1-cp311-cp311-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 5b7738932d4de1a14a62bf1376e438b61491d1f4a6015a9f66d6ce010f5372f6
MD5 cf1eea4f8b8f7d1fb1319e5ab0e51e82
BLAKE2b-256 b2730fd886ffa5e6ffc8c668cb20f8f3a5431d58c8a489d9ecada9c05a8a5dc3

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev1-cp311-cp311-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 9db41ff74b3ab50a4abd4e85c40da481c6b2ec2a6fe5d6eb93d134322544c11d
MD5 4cff7471a5562c4028c219256bfc0a38
BLAKE2b-256 cb2b8c937c09a00b80b22b6941a8988773c09f8c32d7844c7d3b9bea318e4cb5

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 3b91fe58e8d055c7bb677e353e151db2488fa418875819a49e3f14ba0a4e28c1
MD5 c75837cba74b9f6612f051e4f0c3a944
BLAKE2b-256 c7c017aac5b297a75a88e18c0f7c373a233f61808413878a8737c6163675d155

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev1-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev1-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 38c64bb387b5ac1667774f2084185161c9cb1ae52ea6fa8172a676ba04da7920
MD5 4148f8fcb99153f4a37f063b24ccd38a
BLAKE2b-256 79559f6dc742019595196f869f0229ca2997fcbdd9c9542efe00bd91ccda7084

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev1-cp310-cp310-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev1-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev1-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 ad9cb1f1962373c5eb66d28b94938be0f501b7da20d874d8275724e99dd6c253
MD5 d64ee67cbbcdde676a8fb72ce6788c5d
BLAKE2b-256 d2e5c187f8e2d20954c3f71e556eb506f500518192a49454c098561d253cb218

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev1-cp310-cp310-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.1.dev1-cp310-cp310-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.1.dev1-cp310-cp310-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 057162175941e84fc16dbc4acdd87b6a6c8b8c522e7186f99b3f09c0d536987f
MD5 0c958cc9ac4ebbdfc66bd77d293f2da0
BLAKE2b-256 4b2ed98ff7cb5ce139210ffef399e0e8e6ad3e2a5af79eb2f378411b81f6d90c

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.1.dev1-cp310-cp310-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.38.1.dev1 This release

10 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page