Skip to main content

AIBooster - Performance intelligence and observability tools for AI workloads

Project description

AIBooster

PyPI version Python License

AIBooster is a performance engineering platform for AI workloads.

Overview

AIBooster is an integrated platform that provides performance intelligence and performance observability for AI/ML workloads, consisting of the following components:

  • Performance Intelligence (PI): Performance optimization framework
  • Performance Observability (PO): Dashboards and agents for performance monitoring

Key Features

  • Auto performance tuning
    • Framework-friendly design supporting MMEngine, DeepSpeed, and Megatron-LM
    • Kubernetes support
  • Inference optimization
    • Automatic model conversion for deep learning compilers (TensorRT, etc.)
  • NCCL analysis tools
    • Communication pattern analyzer
    • Benchmark for PyTorch distributed training

Installation

pip install aibooster

Documentation

For detailed usage and API reference, please visit the official documentation.

Examples

For usage examples, please see aibooster-examples.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

aibooster-0.5.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (495.6 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ x86-64

aibooster-0.5.0-cp312-cp312-manylinux2014_aarch64.manylinux_2_17_aarch64.whl (555.4 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ ARM64

aibooster-0.5.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (513.8 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

aibooster-0.5.0-cp311-cp311-manylinux2014_aarch64.manylinux_2_17_aarch64.whl (573.5 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

aibooster-0.5.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (452.7 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

aibooster-0.5.0-cp310-cp310-manylinux2014_aarch64.manylinux_2_17_aarch64.whl (512.9 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

aibooster-0.5.0-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (457.9 kB view details)

Uploaded CPython 3.9manylinux: glibc 2.17+ x86-64

aibooster-0.5.0-cp39-cp39-manylinux2014_aarch64.manylinux_2_17_aarch64.whl (513.0 kB view details)

Uploaded CPython 3.9manylinux: glibc 2.17+ ARM64

aibooster-0.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (456.4 kB view details)

Uploaded CPython 3.8manylinux: glibc 2.17+ x86-64

aibooster-0.5.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (510.6 kB view details)

Uploaded CPython 3.8manylinux: glibc 2.17+ ARM64

File details

Details for the file aibooster-0.5.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for aibooster-0.5.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 3a5b1bda4ceca21215a6a044ba35656f7f7a77b5663b4c72cd5f970a2e6269ec
MD5 87163dae44b3ad7e4e0c9732145efeff
BLAKE2b-256 f46494367a1e01b133f5107eb2e5bb1c1821004005100df7b87a5c4f464daa08

See more details on using hashes here.

File details

Details for the file aibooster-0.5.0-cp312-cp312-manylinux2014_aarch64.manylinux_2_17_aarch64.whl.

File metadata

File hashes

Hashes for aibooster-0.5.0-cp312-cp312-manylinux2014_aarch64.manylinux_2_17_aarch64.whl
Algorithm Hash digest
SHA256 9c7110c9ba02157a00f13e4dbd079c38f054f7ba7b174a99d588d154c738fa3c
MD5 a6baa65cc0b377816ddb4cf88e2d0044
BLAKE2b-256 4a1ccadf1ffcde1c2f5cd9e314782c6226a2e29a51eea5173d00bf2be2e7c3a5

See more details on using hashes here.

File details

Details for the file aibooster-0.5.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for aibooster-0.5.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 888b45fabed2f946a4ce113dd93dc36ab2407d92b97997f944a3d43aceaa7acf
MD5 63f7cab40571dc3ac770e207690b84ff
BLAKE2b-256 a4a8c1ace0ef7aee21df79b0ea2c7c460288f0109309edabe4c0e6c7a2a71d17

See more details on using hashes here.

File details

Details for the file aibooster-0.5.0-cp311-cp311-manylinux2014_aarch64.manylinux_2_17_aarch64.whl.

File metadata

File hashes

Hashes for aibooster-0.5.0-cp311-cp311-manylinux2014_aarch64.manylinux_2_17_aarch64.whl
Algorithm Hash digest
SHA256 edceb3ca658f2bd2b00063720887c5cd5f36f23a69f9a15a3cad770fefc45788
MD5 528a6889f49b6aec79ea82f548257727
BLAKE2b-256 30370667e353740fed41303659ce2b521056bac4f53c5c11c6088a1e0cfabebe

See more details on using hashes here.

File details

Details for the file aibooster-0.5.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for aibooster-0.5.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 6211fcda48a386fb57fea8549ecc471591fa34bcfb468ba33be5f04d0c4c06df
MD5 2b164d6465002e02cd63eecd63b273e1
BLAKE2b-256 4c4abce90bc3017d4193f23ab623bc207018f90b2c10f63e3c0b17084e6d7254

See more details on using hashes here.

File details

Details for the file aibooster-0.5.0-cp310-cp310-manylinux2014_aarch64.manylinux_2_17_aarch64.whl.

File metadata

File hashes

Hashes for aibooster-0.5.0-cp310-cp310-manylinux2014_aarch64.manylinux_2_17_aarch64.whl
Algorithm Hash digest
SHA256 8237b6bea3db3d5de82c22b0160a2a692ea81c1c449302ec402ae7e5c0769691
MD5 590129c1ca37fc87b334868d72e2bc5d
BLAKE2b-256 d27be5dfbbe79223d6a0e4ccb835b82f66ca620db8fc81341057ce52c665ad9b

See more details on using hashes here.

File details

Details for the file aibooster-0.5.0-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for aibooster-0.5.0-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 c19f3b0a2e64dd32e804d3816a816d3c54f8f86cd718d4b958cea2a2a679cb0a
MD5 c5aabd0aab835ffb2e6a7ff7b31d2c1d
BLAKE2b-256 e806de42d2b4dff9e32a3058f17ace3c23697adf8e4fba9ac0ba4049c3710c30

See more details on using hashes here.

File details

Details for the file aibooster-0.5.0-cp39-cp39-manylinux2014_aarch64.manylinux_2_17_aarch64.whl.

File metadata

File hashes

Hashes for aibooster-0.5.0-cp39-cp39-manylinux2014_aarch64.manylinux_2_17_aarch64.whl
Algorithm Hash digest
SHA256 157731e4c8c6cf583794127bd6159253fbf6b6b62ee561c53ef98b4c08b58a22
MD5 2d9318507f399b100e80f71f4b46f96c
BLAKE2b-256 7d985bfc2fc32ac803ef3f466febef83c75df03c10869aa82b1a02511ebe16f9

See more details on using hashes here.

File details

Details for the file aibooster-0.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for aibooster-0.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 2725e7799cdae816eee60ef6cd38d0f0c13f022df96053e1202c9a142a5e9f2c
MD5 077023d54dca1d65215725139f73e83f
BLAKE2b-256 296739c2d5ba724f1ba3570be2340694a9d891587c22ced6419400e2cac50536

See more details on using hashes here.

File details

Details for the file aibooster-0.5.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for aibooster-0.5.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 8e616b47fcda8bcdd2ec4ea2b750378b958b74e3df4348a9b9da2c6aa987c49e
MD5 592c0b1004e0c97ee1f1c16c4b1d5dcd
BLAKE2b-256 ce770d4bf93dd77a20a70062aae5538cc04803f0d42d74c3469ea4aee04904b4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page