Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

MLPerf® Automations and Scripts

License Downloads MLC script automation features test MLPerf® Inference ABTF POC Test

Welcome to the MLPerf® Automations and Scripts repository! This repository is your go-to resource for tools, automations, and scripts designed to streamline the execution of MLPerf® benchmarks—with a strong emphasis on MLPerf® Inference benchmarks.

Starting January 2025, MLPerf® automation scripts is powered by MLCFlow automation interface. This new and simplified framework replaces the previous Collective Mind (CM), providing a more robust, efficient, and self-contained solution for benchmarking workflows, making MLPerf® automations independent of any external projects.


🚀 Key Features

  • Automated Benchmarking – Simplifies running MLPerf® Inference benchmarks with minimal manual intervention.
  • Modular and Extensible – Easily extend the scripts to support additional benchmarks and configurations.
  • Seamless Integration – Compatible with Docker, cloud environments, and local machines.

🧰 MLCFlow (MLC) Automations

Building upon the robust foundation of its predecessor, the Collective Mind (CM) framework, MLCFlow elevates machine learning workflows by simplifying complex tasks such as Docker container management and caching. Written in Python, the mlcflow package offers a versatile interface, supporting both a user-friendly command-line interface (CLI) and a flexible API for effortless automation script management.

At its core, MLCFlow relies on a single powerful automation, the Script, which is extended by two actions: CacheAction and DockerAction. Together, these components provide streamlined functionality to optimize and enhance your ML workflow automation experience.


🤝 Contributing

We welcome contributions from the community! To contribute:

  1. Submit pull requests (PRs) to the dev branch.
  2. See here for guidelines and best practices on contribution.
  3. Explore more about MLPerf® Inference automation in the official MLPerf® Inference Documentation.

Your contributions help drive the project forward!


💬 Join the Discussion

Connect with us on the MLCommons® Benchmark Infra Discord channel to engage in discussions about MLCFlow and MLPerf® Automations. We’d love to hear your thoughts, questions, and ideas!


📰 Stay Updated

Keep track of the latest development progress and tasks on our MLPerf® Automations Development Board.
Stay tuned for exciting updates and announcements!


📄 License

This project is licensed under the Apache 2.0 License.


💡 Acknowledgments and Funding

This project is made possible through the generous support of:

We appreciate their contributions and sponsorship!


Thank you for your interest and support in MLPerf® Automations and Scripts!

Metadata

Release files for mlc-scripts 1.2.0a8

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for mlc-scripts 1.2.0a8
File Size Uploaded Provenance Actions
mlc_scripts-1.2.0a8.tar.gz 2.3 MB With provenance Details for mlc_scripts-1.2.0a8.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for mlc-scripts 1.2.0a8
File Interpreter ABI Platform Actions
mlc_scripts-1.2.0a8-py3-none-any.whl Python 3 none any Details for mlc_scripts-1.2.0a8-py3-none-any.whl

Total release size: 4.9 MB

Release files / mlc_scripts-1.2.0a8.tar.gz

Download URL mlc_scripts-1.2.0a8.tar.gz
Size 2.3 MB
Tags Source
SHA-256 checksum
How to use checksums
e842a63d80a757a9f39f465e6cf3183928bbf3cf2963e0dc37b12cd6f8a1f4eb
BLAKE2b-256 checksum
How to use checksums
f89d4358e509130aec24ad0bb13a660ecba967712fcf571cf3993686935400c7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 9, 2026.

Transparency log

Release files / mlc_scripts-1.2.0a8-py3-none-any.whl

Download URL mlc_scripts-1.2.0a8-py3-none-any.whl
Size 2.6 MB
Tags Python 3
SHA-256 checksum
How to use checksums
492021b0dddbe69ec4793a3628cd28246db9fc1185564761ac4005f4238691a7
BLAKE2b-256 checksum
How to use checksums
7b6280ae12e09711f04b5f153cecb1bfd104aab309bf053c966e0eb838b83cf2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 9, 2026.

Transparency log

Security for mlc-scripts 1.2.0a8

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for mlc_scripts-1.2.0a8.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 9, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page