Skip to main content

AIBooster - Performance intelligence and observability tools for AI workloads

Project description

AIBooster

PyPI version Python License

AIBooster is a performance engineering platform for AI workloads.

Overview

AIBooster is an integrated platform that provides performance intelligence and performance observability for AI/ML workloads, consisting of the following components:

  • Performance Intelligence (PI): Performance optimization framework
  • Performance Observability (PO): Dashboards and agents for performance monitoring

Key Features

  • Auto performance tuning
    • Framework-friendly design supporting MMEngine, DeepSpeed, and Megatron-LM
    • Kubernetes support
  • Inference optimization
    • Automatic model conversion for deep learning compilers (TensorRT, etc.)
  • NCCL analysis tools
    • Communication pattern analyzer
    • Benchmark for PyTorch distributed training

Installation

pip install aibooster

Documentation

For detailed usage and API reference, please visit the official documentation.

Examples

For usage examples, please see aibooster-examples.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

aibooster-0.3.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (474.6 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ x86-64

aibooster-0.3.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (487.2 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

aibooster-0.3.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (439.8 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

aibooster-0.3.0-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (443.4 kB view details)

Uploaded CPython 3.9manylinux: glibc 2.17+ x86-64

aibooster-0.3.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442.4 kB view details)

Uploaded CPython 3.8manylinux: glibc 2.17+ x86-64

aibooster-0.3.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (496.8 kB view details)

Uploaded CPython 3.8manylinux: glibc 2.17+ ARM64

File details

Details for the file aibooster-0.3.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for aibooster-0.3.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 24f10b73a2c2edf1a1e8ff72db701d91f0e492bf23544bd98a434133238249f4
MD5 56a1a8ac055669a1740f87f9b79c8c8e
BLAKE2b-256 c0644374ffcb17b6000ea2a88dd80dc7dbd61d7561411bfa00bbaca2862e6944

See more details on using hashes here.

File details

Details for the file aibooster-0.3.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for aibooster-0.3.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 2bb605495b391da323a1a2def43da497c8196ed7ea7055cae0c875e76a447d65
MD5 ae465af6aeba123dd8f81ba0bc387442
BLAKE2b-256 dca1287c7cc097c606e1b4dd922e746d2c35e41370fb413d76598a4efd6ca270

See more details on using hashes here.

File details

Details for the file aibooster-0.3.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for aibooster-0.3.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 f131d9a20a9c8bc4ad53af3df304a4142e996568007a7fe74ee276102491abca
MD5 bd73b84fa4899fbbb1ceae7513995f4b
BLAKE2b-256 247e48e7a9062011c3448c01643e502b1fbe6ec049aecd0cc46aa37346c422ce

See more details on using hashes here.

File details

Details for the file aibooster-0.3.0-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for aibooster-0.3.0-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 d8dc7ffac22c6618790a68b768e2337b5e85602ef44009287b3aea293572fcf6
MD5 843adb5a479f853aaf27c085edd95c0f
BLAKE2b-256 63049470db4c5f74ba6288d5a461b6b06ca4aa7ec3816a0679e709917e8cd963

See more details on using hashes here.

File details

Details for the file aibooster-0.3.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for aibooster-0.3.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 2d761ae254dac81292a16d7141639cf393d172f3324e00e2bbd1aa7adb70cf00
MD5 1b5509bb7e24de430a14ca8b7553bda8
BLAKE2b-256 fddb8d1457ad173df5e6900ff267d560f91bae04f9b2c30cba71f1264e2b9506

See more details on using hashes here.

File details

Details for the file aibooster-0.3.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for aibooster-0.3.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 718c91ebbba3882e2cdca351dd9202d642d92f825d3a5b312d5d3fdd1af31bf4
MD5 e5cc28b815395e04391b52b7b17614f8
BLAKE2b-256 0225b32d1e986f3fa500bdf5737623a950a2fa270fd8e1098edf81dc4bcf0607

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page