cmind
Project description
Collective Mind toolkit (CM aka CK2)
We have developed the Collective Mind unification framework (CM aka CK2) to make existing DevOps and MLOps more portable, interoperable, deterministic, reusable and reproducible with minimal or no changes to existing projects!
CM transforms existing projects into an open database of intelligent components (IC) that simply wrap existing user scripts and artifacts to provide a common API and extensible meta descriptions with dependencies on other IC and platforms.
Such evolutionary approach helps to avoid vendor lock-in on specific workflow frameworks and platforms while simplifying and automating the development and deployment of complex applications across rapidly evolving software and hardware stacks from the cloud to the edge.
The CM toolkit is the 2nd generation of the Collective Knowledge framework (CK) that was successfully validated in academia and industry in the past years to enable collaborative and reproducible development, opitmization and deployment of Pareto-efficient ML Systems in terms of accuracy, latency, throughput, energy, size and costs across continuously changing software, hardware, user environments, settings, models and data.
License
Apache 2.0
Documentation
Tutorials
Community meetings
News
-
2022 May 20: Brainstorming session for CM-powered "intelligent components" in Seattle, WA.
-
2022 April 20: MLCommons virutal community meeting.
-
2022 April 3: We presented our approach to bridge the growing gap between ML Systems research and production at the HPCA'22 workshop on benchmarking deep learning systems.
-
2022 March: We presented our concept to enable collaborative and reproducible ML Systems R&D at the SIAM'22 workshop on "Research Challenges and Opportunities within Software Productivity, Sustainability, and Reproducibility"
-
2022 March: we've released the first prototype of the Collective Mind toolkit (aka CK2) based on your feedback and our practical experience reproducing 150+ ML and Systems papers and validating them in the real world.
Development
CM core (database)
We use GitHub tickets to improve and enhance the CM core that manages shared projects as a collective database of reusable artifacts and automations. Please don't hesitate to share your ideas and report encountered issues!
CM-based projects
Automating development, optimization and deployment of efficient ML Systems
CM provides a common playground and a common language to help researchers and engineers discuss and learn how to make benchmarking, optimization, co-design and deployment of complex ML Systems more deterministic, portable and reproducible across continusly changing software and hardware stacks.
- CM repositories to bridge the gap between MLOps and DevOps:
Related resources
Acknowledgments
We thank the users and partners of the original CK framework, OctoML, MLCommons and all our colleagues for their valuable feedback and support!
Contacts
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
