Skip to main content
Drop a star to support AimOS ⭐ Join AimOS discord community

Open-source modular observability for AI Systems.

Easily log, connect and observe any parts of your AI Systems from experiments to production to prompts to AI system monitoring.


Discord Server Twitter Follow Medium

Platform Support PyPI - Python Version PyPI Package License PyPI Downloads Issues



SEAMLESSLY INTEGRATES WITH:


AimStack offers enterprise support that's beyond core AimOS. Contact via hello@aimstack.io e-mail.


About • Demos • Default logging apps • Quick Start • Examples • Community • Blog •


ℹ️ About

AimOS is an open-source operating system for logs. With AimOS you can build, run and combine any kind of logging applications - experiment tracking, production monitoring, AI System (LLM-based) monitoring, usage monitoring etc.

The Logging applications are typically a combination of these components:

  • The types and relationships of the data being logged
  • The observability UI over the data logged
  • Automations over the data logged

AimOS comes installed with a number of default logging apps:

  • Base App - a basic generic log exploration and the logging primitives
  • AI Experiment Tracking App - log and explore your machine learning experiments. Includes integrations with the majority of leading ML frameworks.
  • AI Systems Tracing and Debugging Apps - a combination of variety of apps that log from langchain to llamaindex traces all in one place.

Apart from running the logging apps, AimOS comes with explorers and reports.

  • Explorers are advanced logs comparison tools for specific kind of logs - they allow to compare 1000s of sessions of metrics, images, text, audio and other types of data.
  • Reports are embedded knowledge-base that operate with the apps and explorers seamlessly to enable capture the knowledge built on top of the logged data from the observations through AimOS apps and explorers.

With the rise of AI Systems and the challenges it brings forward, logging apps are going to be a crucial part of the software.

Our mission is to democratize developer tools for building AI.


Base App

A general observability over anything logged with AimOS.

Visualize all the logs ever logged with AimOS for the given project 🗺️
Base types to log common artifacts such as Images, Audio objects, Figures, Metrics
High-level overview of the logs, the types logged and the respective sessions/ containers
Deep-dive into each type of the log

Experiment Tracking App

Log Metadata Across Your ML Pipeline 💾 Visualize & Compare Metadata via UI 📊
  • ML experiments and any metadata tracking
  • Integration with popular ML frameworks
  • Easy migration from other experiment trackers
  • Metadata visualization via AimOS Explorers
  • Grouping and aggregation
  • Querying using Python expressions
Run ML Trainings Effectively ⚡ Organize Your Experiments 🗂️
  • System info and resource usage tracking
  • Real-time alerting on training progress (upcoming)
  • Detailed run information for easy debugging
  • Centralized dashboard for holistic view

AI Systems Tracing Apps

Log Inputs, Outputs and Actions of Executions 🤖 Visualize & Compare Executions Steps via UI 🔍
  • Track all the prompts, generations of LLMs
  • Track all the inputs, outputs of tools
  • Capture chains metadata
  • Deep dive into single execution steps
  • Compare executions side-by-side

🎬 Demos

Check out live AimOS demos NOW to see it in action.

Tracing LangChain-based chatbot executions

View Demo  |  View Code

Tracing LlamaIndex query executions

View Demo  |  View Code

Tracking PyTorch-based CNN trainings

View Demo  |  View Code

🌍 Default logging apps

AimOS comes pre-installed with a wide variety of apps. Here is the full list:

App Name Description Category Docs Source
base Base AimOS app for general observability over anything logged with AimOS. Includes base types to log common artifacts, such as Image, Audio object, Figure, Metric. Base docs source
docs Use this AimOS app to access AimOS docs. Docs - source
langchain_debugger Debugger for LangChain that logs LLMs prompts and generations, tools inputs/outputs, and chains metadata. AI Systems Tracing docs source
llamaindex_observer Debugger and observer for LlamaIndex. Logs metadata like retrieval nodes, queries and responses, embeddings chunks, etc. AI Systems Tracing docs source
experiment_tracker App for tracking and exploring ML experiments. Integrations with various ML libraries, including Acme, CatBoost, fastai, Hugging Face Transformers, Keras, Keras Tuner, LightGBM, MXNet, Optuna, PaddlePaddle, PyTorch Ignite, SDB3, and XGBoost. Experiment Tracking docs source

🏁 Quick start

Follow the steps below to get started with AimOS.

1. Install AimOS on your training environment

pip3 install aimos

2. Integrate AimOS with your code

from aimstack.base import Run, Metric

# Initialize a new run
run = Run()

# Log run parameters
run["hparams"] = {
    "learning_rate": 0.001,
    "batch_size": 32,
}

# Init a metric
metric = Metric(run, name='loss', context={'subset': 'training'})

for i in range(1000):
      metric.track(i, epoch=1)

3. Start AimOS server

aimos server

4. Start AimOS UI

aimos ui

👥 Community

AimOS README badge

Add AimOS badge to your README, if you've enjoyed using AimOS in your work:

AimOS

[![AimOS](https://img.shields.io/badge/powered%20by-AimOS-%231473E6)](https://github.com/aimhubio/aimos)

Contributing to AimOS

Considering contibuting to AimOS? To get started, please take a moment to read the CONTRIBUTING.md guide.

Join AimOS contributors by submitting your first pull request. Happy coding! 😊

Made with contrib.rocks.

More questions?

  1. Open a feature request or report a bug
  2. Join Discord community server

Metadata

Release files for aimos 1.0.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for aimos 1.0.0
File Size Uploaded
aimos-1.0.0.tar.gz 1.6 MB Details

Built distributions (wheels)

Table of built distributions (wheels) for aimos 1.0.0
File
aimos-1.0.0-cp311-cp311-manylinux_2_24_x86_64.whl CPython 3.11 CPython 3.11 Linux glibc 2.24+ x86-64 Details
aimos-1.0.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.11 CPython 3.11 Linux glibc 2.17+ x86-64 Details
aimos-1.0.0-cp311-cp311-macosx_11_0_arm64.whl CPython 3.11 CPython 3.11 macOS 11.0+ ARM64 Details
aimos-1.0.0-cp311-cp311-macosx_10_14_x86_64.whl CPython 3.11 CPython 3.11 macOS 10.14+ x86-64 Details
aimos-1.0.0-cp310-cp310-manylinux_2_24_x86_64.whl CPython 3.10 CPython 3.10 Linux glibc 2.24+ x86-64 Details
aimos-1.0.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.10 CPython 3.10 Linux glibc 2.17+ x86-64 Details
aimos-1.0.0-cp310-cp310-macosx_11_0_arm64.whl CPython 3.10 CPython 3.10 macOS 11.0+ ARM64 Details
aimos-1.0.0-cp310-cp310-macosx_10_14_x86_64.whl CPython 3.10 CPython 3.10 macOS 10.14+ x86-64 Details
aimos-1.0.0-cp39-cp39-manylinux_2_24_x86_64.whl CPython 3.9 CPython 3.9 Linux glibc 2.24+ x86-64 Details
aimos-1.0.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.9 CPython 3.9 Linux glibc 2.17+ x86-64 Details
aimos-1.0.0-cp39-cp39-macosx_11_0_arm64.whl CPython 3.9 CPython 3.9 macOS 11.0+ ARM64 Details
aimos-1.0.0-cp39-cp39-macosx_10_14_x86_64.whl CPython 3.9 CPython 3.9 macOS 10.14+ x86-64 Details
aimos-1.0.0-cp38-cp38-manylinux_2_24_x86_64.whl CPython 3.8 CPython 3.8 Linux glibc 2.24+ x86-64 Details
aimos-1.0.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.8 CPython 3.8 Linux glibc 2.17+ x86-64 Details
aimos-1.0.0-cp38-cp38-macosx_11_0_arm64.whl CPython 3.8 CPython 3.8 macOS 11.0+ ARM64 Details
aimos-1.0.0-cp38-cp38-macosx_10_14_x86_64.whl CPython 3.8 CPython 3.8 macOS 10.14+ x86-64 Details
aimos-1.0.0-cp37-cp37m-manylinux_2_24_x86_64.whl CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.24+ x86-64 Details
aimos-1.0.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ x86-64 Details
aimos-1.0.0-cp37-cp37m-macosx_10_14_x86_64.whl CPython 3.7 CPython 3.7 pymalloc macOS 10.14+ x86-64 Details

Total release size: 87.2 MB

Release files / aimos-1.0.0.tar.gz

Download URL aimos-1.0.0.tar.gz
Size 1.6 MB
Tags Source
SHA-256 checksum
How to use checksums
6204a2eccc557740d7c6262ace8415324daa0186032925573f3925ae685dc566
BLAKE2b-256 checksum
How to use checksums
5532103714c8c2309b00a8272b862f56e0eed3fae3d362bda31f6077570a9a3e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.0 CPython/3.10.4

Release files / aimos-1.0.0-cp311-cp311-manylinux_2_24_x86_64.whl

Download URL aimos-1.0.0-cp311-cp311-manylinux_2_24_x86_64.whl
Size 5.8 MB
Tags CPython 3.11 Linux glibc 2.24+ x86-64
SHA-256 checksum
How to use checksums
3a855265c550e023cdae6d5c0a7f579e6d7611485c7fe52afa9bc7f229127c23
BLAKE2b-256 checksum
How to use checksums
f5cfe81aa1f6b565e31857b80a1b18cf3550ab06e8cf34537003171d41951ac0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Release files / aimos-1.0.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL aimos-1.0.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 7.3 MB
Tags CPython 3.11 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums
16dab3d0ee90871b98c0353ad0e4e405db26306139df2e171cfd470af79e9334
BLAKE2b-256 checksum
How to use checksums
873eaa403432346124fb164a7b078484c409f9393073bea82111d735576989b7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Release files / aimos-1.0.0-cp311-cp311-macosx_11_0_arm64.whl

Download URL aimos-1.0.0-cp311-cp311-macosx_11_0_arm64.whl
Size 2.4 MB
Tags CPython 3.11 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
56cfd978e57e531725b62e297310551322cadb940bc7e7abcea891d64aebdcda
BLAKE2b-256 checksum
How to use checksums
fb7701b6e798acf2f161d86461ba74cb1af81dfd35c5ac923c0e02c9de9b059b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.11.0

Release files / aimos-1.0.0-cp311-cp311-macosx_10_14_x86_64.whl

Download URL aimos-1.0.0-cp311-cp311-macosx_10_14_x86_64.whl
Size 2.5 MB
Tags CPython 3.11 macOS 10.14+ x86-64
SHA-256 checksum
How to use checksums
ec234f1da969e989a17b6023abacad5e66181d8166b7b1fa7cfebc752eea5a48
BLAKE2b-256 checksum
How to use checksums
1d7e07fa9ea7fcfaf3393fb42309b5352a31d45a5c8df7ea8c7b5ad4228366c4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.11.0

Release files / aimos-1.0.0-cp310-cp310-manylinux_2_24_x86_64.whl

Download URL aimos-1.0.0-cp310-cp310-manylinux_2_24_x86_64.whl
Size 5.7 MB
Tags CPython 3.10 Linux glibc 2.24+ x86-64
SHA-256 checksum
How to use checksums
79a6877acfd8b20f70fb8daf730c351f9f95eaffb6c78edd3764c866225fbc7b
BLAKE2b-256 checksum
How to use checksums
28cea9284fdc2205452dbf18a06aec600fe3bf68917b18d597d03087f2fec5a0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Release files / aimos-1.0.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL aimos-1.0.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 6.8 MB
Tags CPython 3.10 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums
163f9ebe88bd7d2032b36072d113a4cd6a475020e00a76bed2844e1220414bd1
BLAKE2b-256 checksum
How to use checksums
e2eb59993264e7bf7e1ae6d0fde4bd1d98e73d3b78f654e09e73aa35648f456e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Release files / aimos-1.0.0-cp310-cp310-macosx_11_0_arm64.whl

Download URL aimos-1.0.0-cp310-cp310-macosx_11_0_arm64.whl
Size 2.5 MB
Tags CPython 3.10 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
9a4e97be6405f0512d0a207a194146d0225419917f23ee3e15c13bf22d6e130d
BLAKE2b-256 checksum
How to use checksums
14b0cb631a113faa77b8953fbbca633ccd8ecaa7302633bd0cc36516da19a363
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.0 CPython/3.10.4

Release files / aimos-1.0.0-cp310-cp310-macosx_10_14_x86_64.whl

Download URL aimos-1.0.0-cp310-cp310-macosx_10_14_x86_64.whl
Size 2.6 MB
Tags CPython 3.10 macOS 10.14+ x86-64
SHA-256 checksum
How to use checksums
a3c2b7246b16ee0d7d8ebdd8858cf619eda25d587514d710a215a4fd78fbb4bc
BLAKE2b-256 checksum
How to use checksums
4b20ce42bcf9c9785de726e46b61708bfbd8798b74e289cb79bc9f44102a829d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.0 CPython/3.10.4

Release files / aimos-1.0.0-cp39-cp39-manylinux_2_24_x86_64.whl

Download URL aimos-1.0.0-cp39-cp39-manylinux_2_24_x86_64.whl
Size 5.7 MB
Tags CPython 3.9 Linux glibc 2.24+ x86-64
SHA-256 checksum
How to use checksums
50e4928ee7d7529ad06b50bc91d8f8a94a96639b9eeaa8ad661bbc3e75e2d709
BLAKE2b-256 checksum
How to use checksums
5f7ac73a28497c529ed35209de20f90bdcd1fb8a8c5c1f1e4a99bf300f42fb53
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Release files / aimos-1.0.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL aimos-1.0.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 6.9 MB
Tags CPython 3.9 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums
3b99558a96030faed008acc7e7567d4b6488c720a87603ff578073e712598efa
BLAKE2b-256 checksum
How to use checksums
872eded57e9868d5b3a986bb287436e1da7590e31e31d64be436c1dd3b2d3948
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Release files / aimos-1.0.0-cp39-cp39-macosx_11_0_arm64.whl

Download URL aimos-1.0.0-cp39-cp39-macosx_11_0_arm64.whl
Size 2.4 MB
Tags CPython 3.9 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
029d61f7a2af2d693620806d27f868ecb77c66ba829ac5fa648afeb560192f0d
BLAKE2b-256 checksum
How to use checksums
6ced2e817be0ddeaae2059e48b56539c4cffb0e2b94d92946b8993e1de619c15
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.0 CPython/3.9.12

Release files / aimos-1.0.0-cp39-cp39-macosx_10_14_x86_64.whl

Download URL aimos-1.0.0-cp39-cp39-macosx_10_14_x86_64.whl
Size 2.5 MB
Tags CPython 3.9 macOS 10.14+ x86-64
SHA-256 checksum
How to use checksums
cb0dc189b4d8849c6d83754149f5fb527eb72b322c94532470aadcb4eebcf950
BLAKE2b-256 checksum
How to use checksums
2ce94f5bcd76d8413cdc82b5da7e53a11a672ab736a65c033b6d920903780433
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.0 CPython/3.9.12

Release files / aimos-1.0.0-cp38-cp38-manylinux_2_24_x86_64.whl

Download URL aimos-1.0.0-cp38-cp38-manylinux_2_24_x86_64.whl
Size 5.9 MB
Tags CPython 3.8 Linux glibc 2.24+ x86-64
SHA-256 checksum
How to use checksums
8aa89db27acc37b93a2d72887b1a71d3c4f911668efd2b316bcf40dcb6b57134
BLAKE2b-256 checksum
How to use checksums
250e15597ed5742b4c15abd5b3b43359fe8ab3d18035ddd7975c7f9189fac8c9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Release files / aimos-1.0.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL aimos-1.0.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 6.9 MB
Tags CPython 3.8 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums
3b7c5f84df74fa61d010f15eba69eba25d32ecba4d87d5ee8b120b997e0ea7ac
BLAKE2b-256 checksum
How to use checksums
7749ded750c48e69ce170af554c102aa1a005e568c6be9e62004aea6d9db5cb4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Release files / aimos-1.0.0-cp38-cp38-macosx_11_0_arm64.whl

Download URL aimos-1.0.0-cp38-cp38-macosx_11_0_arm64.whl
Size 2.5 MB
Tags CPython 3.8 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
eafc23e0d2c4725d9039ea0c850a6ebb80c4734982aca2f391ccda0e9989e7a2
BLAKE2b-256 checksum
How to use checksums
686cebdd2bebf27a5b18e030f97c07fa57420b6b9ed7fc98ec8ffe0b62078e68
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.0 CPython/3.8.13

Release files / aimos-1.0.0-cp38-cp38-macosx_10_14_x86_64.whl

Download URL aimos-1.0.0-cp38-cp38-macosx_10_14_x86_64.whl
Size 2.6 MB
Tags CPython 3.8 macOS 10.14+ x86-64
SHA-256 checksum
How to use checksums
dabe5341246503519d9a1f8b20b26bf85cbe8eff5562ca11b6c3cfbfee6384aa
BLAKE2b-256 checksum
How to use checksums
3b8f50504860c96937e87d8eafb5901c59d6b72b9ede9fb4cb3012fd85dc1da4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.0 CPython/3.8.13

Release files / aimos-1.0.0-cp37-cp37m-manylinux_2_24_x86_64.whl

Download URL aimos-1.0.0-cp37-cp37m-manylinux_2_24_x86_64.whl
Size 5.6 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.24+ x86-64
SHA-256 checksum
How to use checksums
d6a57e207037e169af4bcb416a37de273eabc4d72f7bcd9d0a770576fa3f52b2
BLAKE2b-256 checksum
How to use checksums
cbcb7809dcf462930192113aca74e55b881160e64c8d1d5447e5ee2fd7ffc278
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Release files / aimos-1.0.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL aimos-1.0.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 6.5 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums
60e84cb5009943477945af3bc728548dd177b7e150cabd151c56e95456810885
BLAKE2b-256 checksum
How to use checksums
bb30c609c811676356607aa5449c0a195c6268a20af8149bfc3560ff5c86a7a7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Release files / aimos-1.0.0-cp37-cp37m-macosx_10_14_x86_64.whl

Download URL aimos-1.0.0-cp37-cp37m-macosx_10_14_x86_64.whl
Size 2.5 MB
Tags CPython 3.7 CPython 3.7 pymalloc macOS 10.14+ x86-64
SHA-256 checksum
How to use checksums
9384b9df151166b4fde22937b1c779b3aee9bb34a7ac2092b6873b389b520ded
BLAKE2b-256 checksum
How to use checksums
32055f6a1015770fc6e426f82cee3b004177712815bf55b35b01d5c0776f37cd
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.0 CPython/3.7.13

Release history Release notifications | RSS feed

This release

1.0.0 This release

20 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page