Skip to main content

Contributors Forks Stargazers Issues MIT License


Logo

Impetus

An awesome tool/library benchmark LLM performance on all kinds of hardware!
Explore the docs »

View Demo · Report Bug · Request Feature

Table of Contents
  1. About The Project
  2. Getting Started
  3. Usage
  4. Roadmap
  5. Contributing
  6. License
  7. Contact
  8. Acknowledgments

About The Project

Impetus Screen Shot

(back to top)

Getting Started

Installation

Installation with pip is simple as follows:

pip install impetus

Usage

Impetus Help

For more examples, please refer to the Documentation

Developing locally

This project use poetry for dependency management, and is required for running impetus locally.

  1. Clone the repo
    git clone https://github.com/dhmnr/impetus.git
    
  2. Install Dependencies
    poetry install
    
  3. Run the command as follows
    poetry shell run impetus --help
    

(back to top)

Roadmap

  • Support Quantization
  • Multiple GPU support with accelerate
  • GPU/CPU usage information
  • Flops/MFU information
  • Detailed breakdown, | self-attention | FFN | lm_head
  • Support BERT and VLMs and others
  • Support different backends

Minor Fixes

  • Support different datasets

See the open issues for a full list of proposed features (and known issues).

(back to top)

Contributing

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement". Don't forget to give the project a star! Thanks again!

  1. Fork the Project
  2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
  3. Commit your Changes (git commit -m 'Add some AmazingFeature')
  4. Push to the Branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

Top contributors:

contrib.rocks image

(back to top)

License

Distributed under the MIT License. See LICENSE.txt for more information.

(back to top)

Contact

Project Link: https://github.com/dhmnr/impetus

(back to top)

Acknowledgments

Use this space to list resources you find helpful and would like to give credit to. I've included a few of my favorites to kick things off!

(back to top)

Release files for impetus 0.1.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for impetus 0.1.1
File Size Uploaded
impetus-0.1.1.tar.gz 10.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for impetus 0.1.1
File Interpreter ABI Platform
impetus-0.1.1-py3-none-any.whl Python 3 none any Details

Total release size: 20.7 kB

Release files / impetus-0.1.1.tar.gz

Download URL impetus-0.1.1.tar.gz
Size 10.4 kB
Tags Source
SHA-256 checksum
How to use checksums
4d5dddf13223ec3c2088f10b7084f0150b0f98130f8e977ba02ddce4ab8e14ea
BLAKE2b-256 checksum
How to use checksums
010e7b226172f298327545b2a32ea07beaad4a2ecaa1fe0c973ac038e8a3c879
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.8.3 CPython/3.10.12 Linux/5.15.0-100-generic

Release files / impetus-0.1.1-py3-none-any.whl

Download URL impetus-0.1.1-py3-none-any.whl
Size 10.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
955379b3fa99adf0cff2c58f290c5ea8684b4eb3c71476ab1d9040e83409108d
BLAKE2b-256 checksum
How to use checksums
e4f25a369551fe2d91261b9c7d051fd601ce87f3e1fda2b3514eecc89bb46719
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.8.3 CPython/3.10.12 Linux/5.15.0-100-generic

Release history Release notifications | RSS feed

This release

0.1.1 This release

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page