Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Amesa Inference

A lightweight inference package for running Amesa agents using ONNX models without Ray or PyTorch dependencies.

Overview

composabl_inference provides a standalone inference engine for running trained Amesa agents. It uses ONNX Runtime for model inference, making it suitable for deployment scenarios where you want to avoid heavy dependencies like Ray and PyTorch.

Features

  • ONNX-based inference: Uses ONNX Runtime for efficient model inference
  • No Ray or PyTorch dependencies: Lightweight package suitable for production deployment
  • Network management: Supports both local and remote objects (agents, perceptors, controllers)
  • Compatible API: Similar interface to Trainer.package() for easy migration

Installation

pip install amesa-inference

Usage

Basic Inference

from composabl_inference import InferenceEngine
from composabl_core import Agent

# Create inference engine (only license needed for license validation)
engine = InferenceEngine(license="your-license-key")

# Load agent
agent = Agent.load("path/to/agent")
await engine.load_agent(agent)

# Package agent for inference (similar to Trainer.package())
await engine.package()

# Run inference
observation = {...}  # Your observation from the simulator
action = engine.execute(observation)

With Remote Objects

The inference engine supports remote agents, perceptors, and controllers, just like the Trainer:

from composabl_inference import InferenceEngine

# Optional: provide custom config for NetworkMgr (e.g., for remote targets)
config = {
    "target": {
        "local": {
            "address": "localhost:1337",
        },
    },
}

engine = InferenceEngine(license="your-license-key", config=config)
await engine.load_agent("path/to/agent")
await engine.package()

# The agent processor will automatically handle remote objects
action = engine.execute(observation)

Cleanup

# Clean up resources
await engine.close()

Architecture

Components

  1. InferenceEngine: Main entry point for inference operations
  2. NetworkMgr: Manages network connections (non-Ray version)
  3. ONNXInferenceEngine: Handles ONNX model loading and inference
  4. ONNXAgentProcessor: Processes agents using ONNX models instead of PyTorch

Differences from Trainer

  • Uses ONNX Runtime instead of PyTorch for model inference
  • NetworkMgr is not a Ray actor (runs in the same process)
  • No Ray initialization required
  • Lighter weight, suitable for production deployment

Requirements

  • Python >= 3.10
  • composabl-core
  • composabl-api
  • onnxruntime
  • numpy

License

Proprietary and confidential - Copyright (C) Amesa, Inc

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

amesa_inference_dev-0.38.0.dev18-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

amesa_inference_dev-0.38.0.dev18-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

amesa_inference_dev-0.38.0.dev18-cp311-cp311-macosx_11_0_arm64.whl (437.3 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

amesa_inference_dev-0.38.0.dev18-cp311-cp311-macosx_10_9_x86_64.whl (440.0 kB view details)

Uploaded CPython 3.11macOS 10.9+ x86-64

amesa_inference_dev-0.38.0.dev18-cp311-cp311-macosx_10_9_universal2.whl (875.6 kB view details)

Uploaded CPython 3.11macOS 10.9+ universal2 (ARM64, x86-64)

amesa_inference_dev-0.38.0.dev18-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

amesa_inference_dev-0.38.0.dev18-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

amesa_inference_dev-0.38.0.dev18-cp310-cp310-macosx_11_0_arm64.whl (442.4 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

amesa_inference_dev-0.38.0.dev18-cp310-cp310-macosx_10_9_x86_64.whl (444.9 kB view details)

Uploaded CPython 3.10macOS 10.9+ x86-64

amesa_inference_dev-0.38.0.dev18-cp310-cp310-macosx_10_9_universal2.whl (885.6 kB view details)

Uploaded CPython 3.10macOS 10.9+ universal2 (ARM64, x86-64)

File details

Details for the file amesa_inference_dev-0.38.0.dev18-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev18-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 86707b7922fb5d707e21afb91655119733223c137fe8a2c6db555b7f59a5fdcb
MD5 96af55d867e6b6edf4f44626dbd3f1ad
BLAKE2b-256 e3da9f771392ea2201e009f3653ebd0eb9b4525abe1d4eb5d828fa8fa7fcc001

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev18-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev18-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev18-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 5c1b824a27cb917aa8febef439a6979b6956b96943625835f12bd5be96d38ca6
MD5 8c3476a5f954426d684253679e0cfa49
BLAKE2b-256 9db8c40d323a3da7185765a868e8f7d9b543b2ffda473b63f93f4be37f42e2b0

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev18-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev18-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev18-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 84762a8a75c42bf920ba4c15e2b22cb4e5a36b62f362028f76e556462dd3353e
MD5 d8cfba346e941aff679ee226c634c778
BLAKE2b-256 355c49a3dfcd935051a9602bf5aafd822d6b348d1eff8ca7479f8cbbe7713f19

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev18-cp311-cp311-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev18-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev18-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 d0d5268a2ce3e269c086987df9d1ae4d1b04debe9d456fb98d4948f9d0007ada
MD5 2ba0778d1bc9328ece4c2f589347e1a5
BLAKE2b-256 1e272321c16d4aa3c6173b078c936dd35ebf4fd6723a7ebcb9c0114e5068a9de

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev18-cp311-cp311-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev18-cp311-cp311-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev18-cp311-cp311-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 0f637c67d22cac8c4cb8631a463d15214c021e2f4a95216fe4b684fba51f28b4
MD5 58b8b22f074a82bee0a42bae85174583
BLAKE2b-256 811f80fa4e5e93e5918189aabcd42e5a11773db8dbbd834215168a10db4d14c7

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev18-cp311-cp311-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev18-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev18-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 82a4101167a4e51384d6d09f1774ab8c02885138288daf7eb492ce9a0ceb9f4d
MD5 238366b7129d844e1eb451854a94a883
BLAKE2b-256 f55af57034a165c4840bec72b44997211ed2ba75cc92116f171b2c559c92df16

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev18-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev18-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev18-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 439d3891bccda47b41fc602bf7e02d08e6e3f7fcc4bbd62d6531e140577ffb02
MD5 2ec8ebcb029a6245c4a67f3faaee4547
BLAKE2b-256 b23a2ca074b88b12cd91b1295fb972a87d8c78f91a714b897875ceb6f4033c81

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev18-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev18-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev18-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 083c17339fc3e880274188c11ee8c06f1e85c2cde7831269f9acd64f04d50f89
MD5 c61128bb2ced65b4ae964f2f4f924a4d
BLAKE2b-256 57114af8b16feb2af945ed25f1b89bd3dd9099f47298ee86bcc4db1914312a65

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev18-cp310-cp310-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev18-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev18-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 d618ac716a29253a1c798ab67475c5254abf9a7894f5d4301485fc3e07207379
MD5 f38868eb14a8457d9ab09b11e365b30d
BLAKE2b-256 470daf449312a0afd78e6c10cc90e6bdf3b2ad8f6413696fafddce5700bf05d0

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev18-cp310-cp310-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference_dev-0.38.0.dev18-cp310-cp310-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference_dev-0.38.0.dev18-cp310-cp310-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 544fd43f8dfca14a131ab2a37b9e0b8db920f6c53c5946175d3f946027129e91
MD5 3d6fd656ecd4be6abbbcba7750d89770
BLAKE2b-256 11c51c72afd9d790c7d6542c717e0e0badb4d6ff9d2b1c52875f8e8d7cc708c2

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference_dev-0.38.0.dev18-cp310-cp310-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package-dev.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.38.0.dev18 This release

10 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page