aimat 0.1.6

AIMAT: AI Music Artist Toolkit - Simplified AI Music workflows.

AI Music Artist Toolkit (AIMAT)

⚠️ AIMAT is currently under active development.
Features and setup steps may change frequently. Expect some instability!

A modular framework for experimenting with AI in music

The AI Music Artist Toolkit (AIMAT) is an environment designed to make working with AI in music easier and more practical for artists, musicians, and creative technologists. By bringing different generative models into a single, reusable workflow, AIMAT lowers some of the technical barriers that might otherwise make these tools difficult to access or experiment with.

AIMAT is also about preserving, repurposing, and combining interesting AI music projects, keeping them in one place where they can be explored in a practical, creative setting. It’s designed to help artists experiment with AI-generated sound, explore different parameters, and find new possibilities they might not have discovered otherwise.

Currently, AIMAT supports:

• Musika — Deep learning model for generating high-quality audio.
• Basic Pitch — Automatic Music Transcription (audio-to-MIDI).
• MIDI-DDSP — Audio generation model for synthesizing realistic instrument sounds from MIDI.

It integrates seamlessly with Max/MSP, PD, Max for Live, and other OSC-enabled applications, making AI-generated music easy to incorporate into your creative workflows.

---

🚀 Features

• ✔️ Modular and Expandable – Easily add and switch between different AI models.
• ✔️ OSC Integration – Trigger AI music generation via Max/MSP or any OSC-compatible software.
• ✔️ Docker-based – Simplifies setup and isolates environments.
• ✔️ Interactive CLI – Easy-to-use commands for managing AIMAT.
• ✔️ Cross-Platform – Works seamlessly on Windows, macOS, and Linux.

---

📥 Installation & Setup

1️⃣ Prerequisites

• 🔹 Docker – Install Docker Desktop
• 🔹 Miniconda – Install Miniconda for managing Python dependencies

---

2️⃣ Setting Up AIMAT

Once you have Docker and Conda installed, follow these steps:

🐍 Create a dedicated Conda environment:

conda create -n aimat python=3.10
conda activate aimat

✅ Install AIMAT via pip:

pip install aimat

3️⃣ Quick Start

Start AIMAT with a single command (listener runs in the background by default):

aimat start

• Starts Docker containers with your AI models.
• Launches the OSC listener in the background, ready to receive messages.

📌 Attached Listener Mode (Optional)

If you prefer to run the OSC listener in attached mode (foreground with continuous feedback), use:

aimat start --attached-listener

Use Ctrl+C to exit this mode.

To stop AIMAT (either mode):

aimat stop

---

🛠️ What Happens During Setup?

✅ Checks for Docker & Conda – Ensures all dependencies are installed.
✅ Configures Docker Environment – Automatically downloads and sets up AI music models.
✅ Starts OSC Listener – Listens for incoming OSC messages to trigger music generation.

---

🎵 OSC Usage Examples

Use OSC messages from Max/MSP, Pure Data, or any OSC-compatible software to trigger AIMAT's AI models.

The AIMAT OSC listener expects messages on port 5005 at your computer's local IP address.

OSC Message Syntax

Send OSC messages in the following format:

/trigger_model <model_type> [additional_parameters]

• <model_type>: The AI model you're triggering (musika, midi_ddsp, or basic_pitch).
• [additional_parameters]: Specific parameters for each model (examples below).

Examples:

🔊 Musika (Audio Generation)

Generate audio with Musika:

/trigger_model musika 0.8 10 techno

• 0.8: Truncation (randomness, higher = more random).
• 10: Duration (seconds).
• techno: Model preset (techno or misc).

🎻 MIDI-DDSP (Instrument Synthesis)

Synthesize realistic sounds from MIDI:

/trigger_model midi_ddsp your-midi-file.mid violin

• your-midi-file.mid: MIDI file (must be in input folder).
• violin: Instrument (violin, viola, oboe, horn, tuba, bassoon, saxophone, trumpet, flute, clarinet, cello, guitar, bass, double bass).

🎹 Basic Pitch (Audio-to-MIDI Conversion)

Convert audio into MIDI:

/trigger_model basic_pitch path/to/audio-file.wav

• path/to/audio-file.wav: Audio file path to convert.

---

🎛️ Simple AIMAT Musika generation (MAX/MSP example):

---

Ensure your input files (audio or MIDI) are correctly placed in AIMAT's designated input directories.

📂 Output Directories

Generated files are stored by default in your home directory under:

• Musika: ~/aimat/musika/output
• MIDI-DDSP: ~/aimat/midi_ddsp/output
• Basic Pitch: ~/aimat/basic_pitch/output

⚠️ Troubleshooting

• Listener or Docker Issues: Restart with:

aimat restart

• Missing Generated Files: Check container logs:

docker logs <container-name>

• Listener Logs: View detailed listener activity:

aimat logs

🔜 Future Plans

• 🟢 GUI interface for easier model management and monitoring.
• 🟢 Integration of additional AI music models.
• 🟢 Expanded OSC command customization.

📜 License

MIT License © Eric Browne