Skip to main content

Amesa Inference

A lightweight inference package for running Amesa agents using ONNX models without Ray or PyTorch dependencies.

Overview

composabl_inference provides a standalone inference engine for running trained Amesa agents. It uses ONNX Runtime for model inference, making it suitable for deployment scenarios where you want to avoid heavy dependencies like Ray and PyTorch.

Features

  • ONNX-based inference: Uses ONNX Runtime for efficient model inference
  • No Ray or PyTorch dependencies: Lightweight package suitable for production deployment
  • Network management: Supports both local and remote objects (agents, perceptors, controllers)
  • Compatible API: Similar interface to Trainer.package() for easy migration

Installation

pip install amesa-inference

Usage

Basic Inference

from composabl_inference import InferenceEngine
from composabl_core import Agent

# Create inference engine (only license needed for license validation)
engine = InferenceEngine(license="your-license-key")

# Load agent
agent = Agent.load("path/to/agent")
await engine.load_agent(agent)

# Package agent for inference (similar to Trainer.package())
await engine.package()

# Run inference
observation = {...}  # Your observation from the simulator
action = engine.execute(observation)

With Remote Objects

The inference engine supports remote agents, perceptors, and controllers, just like the Trainer:

from composabl_inference import InferenceEngine

# Optional: provide custom config for NetworkMgr (e.g., for remote targets)
config = {
    "target": {
        "local": {
            "address": "localhost:1337",
        },
    },
}

engine = InferenceEngine(license="your-license-key", config=config)
await engine.load_agent("path/to/agent")
await engine.package()

# The agent processor will automatically handle remote objects
action = engine.execute(observation)

Cleanup

# Clean up resources
await engine.close()

Architecture

Components

  1. InferenceEngine: Main entry point for inference operations
  2. NetworkMgr: Manages network connections (non-Ray version)
  3. ONNXInferenceEngine: Handles ONNX model loading and inference
  4. ONNXAgentProcessor: Processes agents using ONNX models instead of PyTorch

Differences from Trainer

  • Uses ONNX Runtime instead of PyTorch for model inference
  • NetworkMgr is not a Ray actor (runs in the same process)
  • No Ray initialization required
  • Lighter weight, suitable for production deployment

Requirements

  • Python >= 3.10
  • composabl-core
  • composabl-api
  • onnxruntime
  • numpy

License

Proprietary and confidential - Copyright (C) Amesa, Inc

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

amesa_inference-0.36.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

amesa_inference-0.36.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

amesa_inference-0.36.1-cp311-cp311-macosx_11_0_arm64.whl (420.8 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

amesa_inference-0.36.1-cp311-cp311-macosx_10_9_x86_64.whl (421.0 kB view details)

Uploaded CPython 3.11macOS 10.9+ x86-64

amesa_inference-0.36.1-cp311-cp311-macosx_10_9_universal2.whl (839.9 kB view details)

Uploaded CPython 3.11macOS 10.9+ universal2 (ARM64, x86-64)

amesa_inference-0.36.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

amesa_inference-0.36.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.5 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

amesa_inference-0.36.1-cp310-cp310-macosx_11_0_arm64.whl (423.0 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

amesa_inference-0.36.1-cp310-cp310-macosx_10_9_x86_64.whl (423.6 kB view details)

Uploaded CPython 3.10macOS 10.9+ x86-64

amesa_inference-0.36.1-cp310-cp310-macosx_10_9_universal2.whl (845.0 kB view details)

Uploaded CPython 3.10macOS 10.9+ universal2 (ARM64, x86-64)

File details

Details for the file amesa_inference-0.36.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 bce84be47f17deea6a918da57c700a109f007ee8ba1185e61a247f393110778a
MD5 1e828efbd794c5e82e7cbca813738238
BLAKE2b-256 c05b50f41223834686ebdda57541aef5d83f6e886ee2f9ec1dd8bb6e2af302b7

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 44aa1e454c0fa84fa9a2d55d5b3be43e5d6abd8a487dc6ad40c95c1d8075330b
MD5 bb3f9bfff650946197e972e5700aa6ca
BLAKE2b-256 85ba8646debd7d7c53fefb481b13a1ea17c6c203f10d1d439518e43e80cb8e36

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.1-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.1-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 aabd3f29372c77552e2be91ab9fb3e03891a07aae338256fed731116a183d4e4
MD5 8972b6b206c85e83c1bfdbf6d67875ef
BLAKE2b-256 b12c86a7523c5d7835af7272ccfb34bbb7dde70f0a9601b682653e4ad9c952e5

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.1-cp311-cp311-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.1-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.1-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 07e1a04bac933057cb140248f623df7442732d144e8e54fd82cf0a67049fd2ae
MD5 c7c2309cf4fabba2d2d45dbda690310c
BLAKE2b-256 0a368ccfbfa12eb050a8b1ee10d263ab06762ef2412aadc742fcef0910657a5c

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.1-cp311-cp311-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.1-cp311-cp311-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.1-cp311-cp311-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 0dc9e70d1e90ea52421f8cfd630b54dfb1aedc76303b23549a9874e2fe46cf6a
MD5 4f0f7aa510588d27f8ece6c2807d21d9
BLAKE2b-256 d17d1037e74d909320f7f78f3aecdaa252798d9e4339bd887b48bdf90c9eb51d

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.1-cp311-cp311-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 998d0a72ec28b26f37966520d35c1efd4e65d3867ac2c92fe9a0af79c2139553
MD5 af9389029c559a9f0d3ce278a5d8e9aa
BLAKE2b-256 6f7e2cef1f403363e40f4737ad82cbc9adaa87cb992bd67fa6bf1634ef4c3704

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 252eacc740253a7ff2876c5ae462856582408889ccfeb73537c7dc84e559e410
MD5 615e1934578abcfaea3ab6e43384f367
BLAKE2b-256 99cdf9470331569c25561f2a8c48b1576da0796797d6218d944c3771a5644741

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.1-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.1-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 4e9662f04d26f77613a0fc801389926bbb8645fac4b0e60950bade89817f4b76
MD5 a71cbb24adf94d0c9a865e881439cf19
BLAKE2b-256 9a49fc652c5b0b1d699050c44ee0f8d19908bc1110bcc50e8ba754c31a4592cc

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.1-cp310-cp310-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.1-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.1-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 79fbc8dcf41fa54f3c14a216cc6f77f40a5e128a37ae8db3901e3b4520d6fada
MD5 a85dbc7340ff994191e39fd5c3edb82c
BLAKE2b-256 646a1be35b73cfd410d756b47bfe8bcca2dff56e4f9e65f882a365c09495c697

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.1-cp310-cp310-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.36.1-cp310-cp310-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference-0.36.1-cp310-cp310-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 fe75b80f63c8d71a4e76ac27ed5303a095333f7e7163bb3d6601e531670c9020
MD5 1c772f7eeb6fa24b72ea48e574455783
BLAKE2b-256 b33d0080d595fef358e9f1bfa00e7cd261cdb79a4d365675eef6e26c5d9ad237

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.36.1-cp310-cp310-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.37.1

10 files

0.37.0

10 files

This release

0.36.1 This release

10 files

0.36.0

10 files

0.35.2

10 files

0.35.1

10 files

0.35.0

10 files

0.34.1

10 files

0.34.0

10 files

0.33.2

10 files

0.33.1

10 files

0.33.0

10 files

0.31.0

10 files

0.30.0

10 files

0.29.1

10 files

0.29.0

10 files

0.28.0

10 files

0.27.0

10 files

0.26.0

10 files

0.25.0

10 files

0.24.0

10 files

0.22.0

10 files

0.21.0

10 files

0.20.0

10 files

0.19.7

10 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page