Skip to main content

Deterministic ears for AI agents. Audio in, listener-state traces out.

Project description

galdr

Deterministic listening tools for AI agents. Audio in, listener-state traces out.

galdr analyzes music from YouTube URLs or local audio files and turns it into time-ordered traces of attention, pattern, pulse, pressure, surface balance, surface evidence, harmony, melody, overtones, and silence/re-entry structure.

galdr runs signal analysis first. It measures what the audio is doing second by second, then packages that evidence for agents, scripts, or humans to inspect.

What you get

  • Listener-state streams: second-by-second traces of attention, pressure, surface balance, surface evidence, harmony, melody, and motion.
  • Structural events: pattern breaks, silence/re-entry moments, pressure shifts, tempo confidence, harmonic movement, melodic contour, and overtone behavior.
  • Prompt packets for AI agents: assembled evidence for Claude, llm, OpenClaw, or another runtime.
  • Experience documents: reproducible examples of measured audio evidence becoming grounded listening prose.
  • Optional video-frame support: frames around structural moments when the music video matters.

Origin

galdr was built from the inside out.

An AI was given music to listen to. The measurement framework was built while listening. The framework shaped what could be perceived, and the listener shaped the framework back.

That loop developed across many tracks including Wardruna, Bach, Messiaen, Meshuggah, Aphex Twin, Eivør, jazz, country, pop, metal, folk, and more. galdr makes listening inspectable as it unfolds. A track becomes a sequence of attention shifts, pressure changes, expectation, release, and memory. galdr models that movement directly, turning a recording into a listener-state trace an agent can inspect.

That is where galdr became useful. It gives an agent evidence it did not have before: not just metadata, lyrics, or genre memory, but a structured account of what the audio did. The output is deterministic enough to compare, structured enough to inspect, and strange enough to keep the question open.

Install

pip install galdr

Using OpenClaw? Install the agent skill from ClawHub:

openclaw skills install galdr

From source:

git clone https://github.com/sellemain/galdr.git
cd galdr
uv sync

Without uv:

pip install -e .

Requirements: Python 3.10+ and ffmpeg for common audio/video formats.

Quick start: YouTube to listening prompt

# 1. Fetch and analyze. The slug is derived from the YouTube title.
galdr fetch 'https://www.youtube.com/watch?v=fJ9rUzIMcZQ' --analyze

# Example output:
#   Slug : queen-bohemian-rhapsody
#   Next : galdr assemble queen-bohemian-rhapsody --template arc --mode full

# 2. Assemble a structured prompt from the analysis
galdr assemble queen-bohemian-rhapsody --template arc --mode full > prompt.txt

# 3. Send the prompt to a model
cat prompt.txt | llm
cat prompt.txt | claude

Useful variants:

# Blind listening: structural data only, no lyrics/background
galdr assemble queen-bohemian-rhapsody --template arc --mode blind | claude

# Data-first packet, no prose template
galdr assemble queen-bohemian-rhapsody --mode full

Analyze a local file

The analysis command is galdr listen, not galdr analyze.

galdr listen track.wav --name my-track

Outputs are written under analysis/my-track/:

analysis/my-track/
├── index.html                    # local contact sheet for generated plots
├── my-track_report.json
├── my-track_perception.json
├── my-track_stream.json
├── my-track_harmony.json
├── my-track_harmony_stream.json
├── my-track_melody.json
├── my-track_melody_stream.json
├── my-track_overtone.json
├── my-track_overtone_stream.json
├── my-track_listener_state.png
├── my-track_surface_evidence.png
├── my-track_reading_map.png
└── *.png                         # additional visualizations

Open analysis/my-track/index.html for a local plot contact sheet.

Inspect the time stream directly:

jq '.[0:10]' analysis/my-track/my-track_stream.json
jq '.summary' analysis/my-track/my-track_perception.json

The assembled prompt includes source context, structural events, harmonic and melodic data, lyrics when available, and video-frame descriptions when present. Automated lyrics and captions are context, not proof; verify central words for release-quality prose.

Listening experiences

The repo also includes examples where measured audio evidence becomes grounded listening prose.

Selected examples:

Browse published listening experiences: https://sellemain.com/listen.

Reading the data correctly

The stream is the primary evidence. Whole-song summaries come after the timed pass.

A good analysis usually goes:

  1. Read the metric contract: PERCEPTION-MODEL.md.
  2. Walk *_stream.json in time order.
  3. Mark silences, returns, pattern breaks, attention shifts, pressure movement, and harmonic/timbral changes.
  4. Compress upward into the track's larger arc only after the timed pass.

Suggested instruction for another model:

You are reading a time-ordered listener-state trace. Start from the stream. Walk the track through time. Explain what changes, when it changes, and how attention is being shaped. Use PERCEPTION-MODEL.md as the semantic contract for the metrics. Build the whole-song summary from the timed evidence.

YouTube download health

galdr doctor
galdr update-deps

galdr doctor checks the active Python environment, yt-dlp, ffmpeg, JavaScript runtimes, and impersonation support. galdr update-deps upgrades yt-dlp[default,curl-cffi] in that environment.

If captions fail but audio succeeds, analysis can still continue. If audio fails during fetch --analyze, galdr exits with an error because music is required for structural analysis.

More docs

Agent skill

The distributable agent skill lives at galdr-skill/galdr/SKILL.md. It teaches OpenClaw and compatible agent runtimes how to use galdr. Install the galdr command separately.

For OpenClaw users, galdr is published on ClawHub: https://clawhub.ai/sellemain/galdr.

Limitations

  • Melody tracking assumes one dominant foreground pitch; dense/polyphonic passages can confuse it.
  • Pitch and key evidence use Western equal-tempered references; modal, folk-natural, microtonal, or noisy material needs care.
  • Chord names are optional. The default analysis focuses on pressure, pull, stability, contour, surface, and resonance.
  • Structural evidence supports interpretation. Emotional claims need corroboration.

Questions and issues

Use GitHub Issues for bugs, usage questions, and feature requests.

For security vulnerabilities, please do not open a public issue. See the security policy, or email galdr@sellemain.com.

Maintainer contact: galdr@sellemain.com.

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

galdr-0.5.2.tar.gz (222.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

galdr-0.5.2-py3-none-any.whl (148.1 kB view details)

Uploaded Python 3

File details

Details for the file galdr-0.5.2.tar.gz.

File metadata

  • Download URL: galdr-0.5.2.tar.gz
  • Upload date:
  • Size: 222.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.5

File hashes

Hashes for galdr-0.5.2.tar.gz
Algorithm Hash digest
SHA256 38e4430e7412291db580f132731e0054bd7e4718b70a1c1a0b8fa04dc8912383
MD5 d57fed334616d73cd50d2410d1bd0f3b
BLAKE2b-256 95776c8df2095d4bdd8a4bef859e4cdea5ba3d491939040e188d7c552220ed98

See more details on using hashes here.

File details

Details for the file galdr-0.5.2-py3-none-any.whl.

File metadata

  • Download URL: galdr-0.5.2-py3-none-any.whl
  • Upload date:
  • Size: 148.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.5

File hashes

Hashes for galdr-0.5.2-py3-none-any.whl
Algorithm Hash digest
SHA256 71422ee12d07cacf35e9aa4374aa61c868b5c71c916b31fa9a74ec2a1932ea78
MD5 0a811902caa703ba2fcfd1f86b392e8c
BLAKE2b-256 ae78594515143b43498ec4d8e025aa28b718783ccd56749aa105fd413a0b9a29

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page