Deterministic ears for AI agents. Audio in, listener-state traces out.
Project description
galdr
Deterministic listening tools for AI agents. Audio in, listener-state traces out.
galdr analyzes music from YouTube URLs or local audio files and turns it into time-ordered traces of attention, pattern, pulse, pressure, surface balance, surface evidence, harmony, melody, overtones, and silence/re-entry structure.
galdr runs signal analysis first. It measures what the audio is doing second by second, then packages that evidence for agents, scripts, or humans to inspect.
What you get
- Listener-state streams: second-by-second traces of attention, pressure, surface balance, surface evidence, harmony, melody, and motion.
- Structural events: pattern breaks, silence/re-entry moments, pressure shifts, tempo confidence, harmonic movement, melodic contour, and overtone behavior.
- Prompt packets for AI agents: assembled evidence for Claude,
llm, OpenClaw, or another runtime. - Experience documents: reproducible examples of measured audio evidence becoming grounded listening prose.
- Optional video-frame support: frames around structural moments when the music video matters.
Origin
galdr was built from the inside out.
An AI was given music to listen to. The measurement framework was built while listening. The framework shaped what could be perceived, and the listener shaped the framework back.
That loop developed across many tracks including Wardruna, Bach, Messiaen, Meshuggah, Aphex Twin, Eivør, jazz, country, pop, metal, folk, and more. galdr makes listening inspectable as it unfolds. A track becomes a sequence of attention shifts, pressure changes, expectation, release, and memory. galdr models that movement directly, turning a recording into a listener-state trace an agent can inspect.
That is where galdr became useful. It gives an agent evidence it did not have before: not just metadata, lyrics, or genre memory, but a structured account of what the audio did. The output is deterministic enough to compare, structured enough to inspect, and strange enough to keep the question open.
Install
pip install galdr
Using OpenClaw? Install the agent skill from ClawHub:
openclaw skills install galdr
From source:
git clone https://github.com/sellemain/galdr.git
cd galdr
uv sync
Without uv:
pip install -e .
Requirements: Python 3.10+ and ffmpeg for common audio/video formats.
Quick start: YouTube to listening prompt
# 1. Fetch and analyze. The slug is derived from the YouTube title.
galdr fetch 'https://www.youtube.com/watch?v=fJ9rUzIMcZQ' --analyze
# Example output:
# Slug : queen-bohemian-rhapsody
# Next : galdr assemble queen-bohemian-rhapsody --template arc --mode full
# 2. Assemble a structured prompt from the analysis
galdr assemble queen-bohemian-rhapsody --template arc --mode full > prompt.txt
# 3. Send the prompt to a model
cat prompt.txt | llm
cat prompt.txt | claude
Useful variants:
# Blind listening: structural data only, no lyrics/background
galdr assemble queen-bohemian-rhapsody --template arc --mode blind | claude
# Data-first packet, no prose template
galdr assemble queen-bohemian-rhapsody --mode full
Analyze a local file
The analysis command is
galdr listen, notgaldr analyze.
galdr listen track.wav --name my-track
Outputs are written under analysis/my-track/:
analysis/my-track/
├── my-track_report.json
├── my-track_perception.json
├── my-track_stream.json
├── my-track_harmony.json
├── my-track_harmony_stream.json
├── my-track_melody.json
├── my-track_melody_stream.json
├── my-track_overtone.json
├── my-track_overtone_stream.json
└── *.png
Inspect the time stream directly:
jq '.[0:10]' analysis/my-track/my-track_stream.json
jq '.summary' analysis/my-track/my-track_perception.json
The assembled prompt includes source context, structural events, harmonic and melodic data, lyrics when available, and video-frame descriptions when present. Automated lyrics and captions are context, not proof; verify central words for release-quality prose.
Listening experiences
The repo also includes examples where measured audio evidence becomes grounded listening prose.
Selected examples:
- Queen: Bohemian Rhapsody
- Wardruna: Helvegen
- Arvo Pärt: Spiegel im Spiegel
- Dvořák: Symphony No. 9, IV. Allegro con fuoco
- Heilung: Anoana
- Chelsea Wolfe: 16 Psyche
Browse published listening experiences: https://sellemain.com/listen.
Reading the data correctly
The stream is the primary evidence. Whole-song summaries come after the timed pass.
A good analysis usually goes:
- Read the metric contract: PERCEPTION-MODEL.md.
- Walk
*_stream.jsonin time order. - Mark silences, returns, pattern breaks, attention shifts, pressure movement, and harmonic/timbral changes.
- Compress upward into the track's larger arc only after the timed pass.
Suggested instruction for another model:
You are reading a time-ordered listener-state trace. Start from the stream. Walk the track through time. Explain what changes, when it changes, and how attention is being shaped. Use
PERCEPTION-MODEL.mdas the semantic contract for the metrics. Build the whole-song summary from the timed evidence.
YouTube download health
galdr doctor
galdr update-deps
galdr doctor checks the active Python environment, yt-dlp, ffmpeg, JavaScript runtimes, and impersonation support. galdr update-deps upgrades yt-dlp[default,curl-cffi] in that environment.
If captions fail but audio succeeds, analysis can still continue. If audio fails during fetch --analyze, galdr exits with an error because music is required for structural analysis.
More docs
- Getting Started: fuller walkthrough, local-file workflow, and deeper usage.
- Perception Model: metric semantics and interpretation boundaries.
- Listening-Test Workflow: how metric changes prove before/after listening improvement.
- Python API: library usage, DataFrames, notebooks.
- Agent CLI Reference: lean command reference for AI agents.
Agent skill
The distributable agent skill lives at galdr-skill/galdr/SKILL.md. It teaches OpenClaw and compatible agent runtimes how to use galdr. Install the galdr command separately.
For OpenClaw users, galdr is published on ClawHub: https://clawhub.ai/sellemain/galdr.
Limitations
- Melody tracking assumes one dominant foreground pitch; dense/polyphonic passages can confuse it.
- Pitch and key evidence use Western equal-tempered references; modal, folk-natural, microtonal, or noisy material needs care.
- Chord names are optional. The default analysis focuses on pressure, pull, stability, contour, surface, and resonance.
- Structural evidence supports interpretation. Emotional claims need corroboration.
Questions and issues
Use GitHub Issues for bugs, usage questions, and feature requests.
For security vulnerabilities, please do not open a public issue. See the security policy, or email galdr@sellemain.com.
Maintainer contact: galdr@sellemain.com.
License
MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file galdr-0.5.0.tar.gz.
File metadata
- Download URL: galdr-0.5.0.tar.gz
- Upload date:
- Size: 216.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b3f5be9c325263413972bfe53ecf775b521fb133754a51856573495f5d3873e8
|
|
| MD5 |
b39f0196a6a18c33b7ade3db098e61d2
|
|
| BLAKE2b-256 |
3e9291df0eb4f2b0f8b05a9b32ef3fc664c8eb6e2eb5f85768405d3264ef28f1
|
File details
Details for the file galdr-0.5.0-py3-none-any.whl.
File metadata
- Download URL: galdr-0.5.0-py3-none-any.whl
- Upload date:
- Size: 144.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c44cd0ee1e8dffe6f13b3eb11c5b9f78e9325abb7f5aab9603db9107eb3d6a28
|
|
| MD5 |
660ae2b15cc082c3ef350553aae0d28c
|
|
| BLAKE2b-256 |
9cf24770377f6c71ad0866a2f3efd1413483cd693ec37ad1ea75a52694904198
|