Skip to main content

Automation scripts for running ML applications using MLC interface

Project description

MLPerf Automations and Scripts

License Downloads CM Script Automation Test MLPerf Inference ABTF POC Test

Welcome to the MLPerf Automations and Scripts repository! This repository provides tools, automations, and scripts to facilitate running MLPerf benchmarks, with a primary focus on MLPerf Inference benchmarks.

The automations build upon and extend the powerful Collective Mind (CM) script automations to streamline benchmarking and workflow processes.


🚀 Key Features

  • Automated Benchmarking – Simplifies running MLPerf Inference benchmarks with minimal manual intervention.
  • Modular and Extensible – Easily extend the scripts to support additional benchmarks and configurations.
  • Seamless Integration – Compatible with Docker, cloud environments, and local machines.
  • Collective Mind (CM) Integration – Utilizes the CM framework to enhance reproducibility and automation.

🧰 Collective Mind (CM) Automations

The Collective Mind (CM) framework is a Python-based package offering both CLI and API support for creating and managing automations. CM automations enhance ML workflows by simplifying complex tasks such as Docker container management and caching.

Core Automations

  • Script Automation – Automates script execution across different environments.
  • Cache Management – Manages reusable cached results to accelerate workflow processes.

Learn more about CM in the CM4MLOps documentation.


🤝 Contributing

We welcome contributions from the community! To contribute:

  1. Submit pull requests (PRs) to the dev branch.
  2. Review our CONTRIBUTORS.md for guidelines and best practices.
  3. Explore more about MLPerf Inference automation in the official MLPerf Inference Documentation.

Your contributions help drive the project forward!


📰 News

Stay tuned for upcoming updates and announcements.


📄 License

This project is licensed under the Apache 2.0 License.


💡 Acknowledgments and Funding

This project is made possible through the generous support of:

We appreciate their contributions and sponsorship!


Thank you for your interest and support in MLPerf Automations and Scripts!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mlperf-0.0.1.tar.gz (8.9 kB view details)

Uploaded Source

File details

Details for the file mlperf-0.0.1.tar.gz.

File metadata

  • Download URL: mlperf-0.0.1.tar.gz
  • Upload date:
  • Size: 8.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for mlperf-0.0.1.tar.gz
Algorithm Hash digest
SHA256 7bde6e09fecc887f90dce68b4f5c69af191e03ef6d6514db7b4743fbeac9febc
MD5 7fc9031f9e9aedf0e222ba35a54ca3d4
BLAKE2b-256 705d9a999c80082b44d5efdd09611bb5b227bbe277a8d8fd584ae1d0aa63c0e2

See more details on using hashes here.

Provenance

The following attestation bundles were made for mlperf-0.0.1.tar.gz:

Publisher: build_wheel.yml on mlcommons/mlperf-automations

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page