Skip to main content

Amesa Inference

A lightweight inference package for running Amesa agents using ONNX models without Ray or PyTorch dependencies.

Overview

composabl_inference provides a standalone inference engine for running trained Amesa agents. It uses ONNX Runtime for model inference, making it suitable for deployment scenarios where you want to avoid heavy dependencies like Ray and PyTorch.

Features

  • ONNX-based inference: Uses ONNX Runtime for efficient model inference
  • No Ray or PyTorch dependencies: Lightweight package suitable for production deployment
  • Network management: Supports both local and remote objects (agents, perceptors, controllers)
  • Compatible API: Similar interface to Trainer.package() for easy migration

Installation

pip install amesa-inference

Usage

Basic Inference

from composabl_inference import InferenceEngine
from composabl_core import Agent

# Create inference engine (only license needed for license validation)
engine = InferenceEngine(license="your-license-key")

# Load agent
agent = Agent.load("path/to/agent")
await engine.load_agent(agent)

# Package agent for inference (similar to Trainer.package())
await engine.package()

# Run inference
observation = {...}  # Your observation from the simulator
action = engine.execute(observation)

With Remote Objects

The inference engine supports remote agents, perceptors, and controllers, just like the Trainer:

from composabl_inference import InferenceEngine

# Optional: provide custom config for NetworkMgr (e.g., for remote targets)
config = {
    "target": {
        "local": {
            "address": "localhost:1337",
        },
    },
}

engine = InferenceEngine(license="your-license-key", config=config)
await engine.load_agent("path/to/agent")
await engine.package()

# The agent processor will automatically handle remote objects
action = engine.execute(observation)

Cleanup

# Clean up resources
await engine.close()

Architecture

Components

  1. InferenceEngine: Main entry point for inference operations
  2. NetworkMgr: Manages network connections (non-Ray version)
  3. ONNXInferenceEngine: Handles ONNX model loading and inference
  4. ONNXAgentProcessor: Processes agents using ONNX models instead of PyTorch

Differences from Trainer

  • Uses ONNX Runtime instead of PyTorch for model inference
  • NetworkMgr is not a Ray actor (runs in the same process)
  • No Ray initialization required
  • Lighter weight, suitable for production deployment

Requirements

  • Python >= 3.10
  • composabl-core
  • composabl-api
  • onnxruntime
  • numpy

License

Proprietary and confidential - Copyright (C) Amesa, Inc

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

amesa_inference-0.35.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

amesa_inference-0.35.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

amesa_inference-0.35.1-cp311-cp311-macosx_11_0_arm64.whl (418.9 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

amesa_inference-0.35.1-cp311-cp311-macosx_10_9_x86_64.whl (418.9 kB view details)

Uploaded CPython 3.11macOS 10.9+ x86-64

amesa_inference-0.35.1-cp311-cp311-macosx_10_9_universal2.whl (835.7 kB view details)

Uploaded CPython 3.11macOS 10.9+ universal2 (ARM64, x86-64)

amesa_inference-0.35.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

amesa_inference-0.35.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.5 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

amesa_inference-0.35.1-cp310-cp310-macosx_11_0_arm64.whl (421.1 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

amesa_inference-0.35.1-cp310-cp310-macosx_10_9_x86_64.whl (421.6 kB view details)

Uploaded CPython 3.10macOS 10.9+ x86-64

amesa_inference-0.35.1-cp310-cp310-macosx_10_9_universal2.whl (840.7 kB view details)

Uploaded CPython 3.10macOS 10.9+ universal2 (ARM64, x86-64)

File details

Details for the file amesa_inference-0.35.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.35.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 1695889190fa5d6c46ad4f2e567346fef90de7785afd84faeca7d7b6d3268644
MD5 5ddb59582b61069241a94b74c2439490
BLAKE2b-256 7653e7ec9b1a31ed59e221169688a97ebda4d09877816a8fd5c0a9b91f15aa2f

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.35.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.35.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.35.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 4f3323c132bc379855da67a6f1f3e7002beadaed66e130a8ee57d2dd3bf50e15
MD5 a00f7aac5a732970ee49dacb59dd8274
BLAKE2b-256 7193862690d7b865e35ed9deec20c530c5f4264234f689993de7d65ae1adc8e0

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.35.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.35.1-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.35.1-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 b16b0da3e5a8bb9fe67a4c17d9e5d708ab60c2bee61c1e433530072f3a7e03c6
MD5 63470e2a9dfe13a6c3740eda9d51d9ec
BLAKE2b-256 41bf9e2bfa4baf7bf68a99e90fc58965c7fd2b20e5f1f906ecdb79048598bfbf

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.35.1-cp311-cp311-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.35.1-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.35.1-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 faad29e8fdfc41813bc2e712fbe4f10ee2ccb2e51e722fc515c08ec8a1467cc9
MD5 e56feb59ba8f3b2ccc99f22c490b4dde
BLAKE2b-256 483df5b8b2bbb6327e4aef9bcd9591f173ce8f092defc8eed5315c80c5c31e37

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.35.1-cp311-cp311-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.35.1-cp311-cp311-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference-0.35.1-cp311-cp311-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 6a5fc3bab553e5152c1b6d5534a96090ec91e9c72b9d9249a103801505d7527b
MD5 80b95a491bec4f4edd8f03fdc44031de
BLAKE2b-256 f7aae6225d1d2e1abd709a7120b73ec45e33ef29e7806d23720e92656a02603a

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.35.1-cp311-cp311-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.35.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.35.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 45155db2c15445926854bd203f623b0c74cdb479cd5e0c43332ef88e55ae51cd
MD5 6d154301749f461aff4b20014a426b59
BLAKE2b-256 c9d26fb3f6267982ad444c5f2a5ffd7783bbee1fbe395fb4c70b8f8659d0bc5c

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.35.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.35.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.35.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 b14a2d46d4e1843391e6178d988da7eff9b25966fb79fea1cc76034b6529d8ce
MD5 1db8921127f0309e613046136033c335
BLAKE2b-256 c146a4dee16a4fb3bf90ab08fec3ef33db1c9736ad92cf4761be915354827cf3

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.35.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.35.1-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.35.1-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 7d8e5901ece7ff6ef2fc142f7b9f36dab43558bf2459f1e5d52410870ea46393
MD5 76af6686ce6fd16011ae474fbbc1b36e
BLAKE2b-256 756d75cec3d4142cccad4bfd63aa3cb725c13d3852a2bc48e84beec73cc4a68c

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.35.1-cp310-cp310-macosx_11_0_arm64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.35.1-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for amesa_inference-0.35.1-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 21eacf9d82049a0f0bffccf50371d0392aba9005df513c8c9a200df4d763f186
MD5 c49a30298f9bcc99a4f394885dbb7e10
BLAKE2b-256 6aca21b40d3e1599b4c9cb1f1e070f5b4f221194acd4664af26f810fb11881d6

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.35.1-cp310-cp310-macosx_10_9_x86_64.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amesa_inference-0.35.1-cp310-cp310-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for amesa_inference-0.35.1-cp310-cp310-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 a36e9a2c726a88155fb74f7510f9231c9c155ec51505e85bc8635b88d18fafc7
MD5 a62bb68fcf44826affceccf3ac30c8a3
BLAKE2b-256 cb3e229d40167991233d9d3eae3df384286892d059f874ac52719a811e44fe4f

See more details on using hashes here.

Provenance

The following attestation bundles were made for amesa_inference-0.35.1-cp310-cp310-macosx_10_9_universal2.whl:

Publisher: build-and-publish-package.yaml on Composabl/sdk.composabl.ai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.37.1

10 files

0.37.0

10 files

0.36.1

10 files

0.36.0

10 files

0.35.2

10 files

This release

0.35.1 This release

10 files

0.35.0

10 files

0.34.1

10 files

0.34.0

10 files

0.33.2

10 files

0.33.1

10 files

0.33.0

10 files

0.31.0

10 files

0.30.0

10 files

0.29.1

10 files

0.29.0

10 files

0.28.0

10 files

0.27.0

10 files

0.26.0

10 files

0.25.0

10 files

0.24.0

10 files

0.22.0

10 files

0.21.0

10 files

0.20.0

10 files

0.19.7

10 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page