openmav 0.0.5

Model Activation Visualizer

+===========================================================================+
|          _____                    _____                    _____          |
|         /\    \                  /\    \                  /\    \         |
|        /::\____\                /::\    \                /::\____\        |
|       /::::|   |               /::::\    \              /:::/    /        |
|      /:::::|   |              /::::::\    \            /:::/    /         |
|     /::::::|   |             /:::/\:::\    \          /:::/    /          |
|    /:::/|::|   |            /:::/__\:::\    \        /:::/____/           |
|   /:::/ |::|   |           /::::\   \:::\    \       |::|    |            |
|  /:::/  |::|___|______    /::::::\   \:::\    \      |::|    |     _____  |
| /:::/   |::::::::\    \  /:::/\:::\   \:::\    \     |::|    |    /\    \ |
|/:::/    |:::::::::\____\/:::/  \:::\   \:::\____\    |::|    |   /::\____\|
|\::/    / ~~~~~/:::/    /\::/    \:::\  /:::/    /    |::|    |  /:::/    /|
| \/____/      /:::/    /  \/____/ \:::\/:::/    /     |::|    | /:::/    / |
|             /:::/    /            \::::::/    /      |::|____|/:::/    /  |
|            /:::/    /              \::::/    /       |:::::::::::/    /   |
|           /:::/    /               /:::/    /        \::::::::::/____/    |
|          /:::/    /               /:::/    /          ~~~~~~~~~~          |
|         /:::/    /               /:::/    /                               |
|        /:::/    /               /:::/    /                                |
|        \::/    /                \::/    /                                 |
|         \/____/                  \/____/                                  |
+===========================================================================+

Model Activations Visualiser

Getting started

If uv is installed:

uv run --with openmav mav

or

uv run --with git+https://github.com/attentionmech/mav mav --model gpt2 --prompt "hello mello"

Without uv:

1. Set up and activate a virtual environment

2. Install the package:

   pip install openmav
   

   or

   pip install git+https://github.com/attentionmech/mav
   

3. Run:

   mav --model gpt2 --prompt "hello mello"
   

Locally from scratch

1. git clone https://github.com/attentionmech/mav
2. cd mav
3. Set up and activate a virtual environment
4. Install the package:

   pip install .
   

5. Run:

   mav --model gpt2 --prompt "hello mello"
   

You can replace gpt2 with other Hugging Face models for example:

• meta-llama/Llama-3.2-1B
• HuggingFaceTB/SmolLM-135M
• gpt2-medium
• gpt2-large

Demos

• interactive mode
• limit chars
• sample with temperature

Note: explore it using the command line help as well, since many sampling params are exposed.

Contributing

IMP NOTE: The design is not good for scaling it right now to multiple backends, and stuff which i am planning.. so your pull requests will have to wait for sometime