harmonization-env 1.0

Harmonization environment implementation via reinforcement learning

Music Harmonization Package

A Reinforcement Learning package to generate musical harmonies, starting from a general sequence of notes in the scale of C major. Outputs musical harmonies, MIDI files, and mp4 videos.

Prerequisites

• ffmpeg must be installed on your system.
  • Download ffmpeg

Examples

Here are a few example outputs generated by the package. The top line is the melody, given as input. The other notes played are generated. In this case a simple C major scale. The following videos are two different outputs generated by the agent.

https://github.com/user-attachments/assets/e7a52a7e-48b0-4076-8552-e5e392ad850d

https://github.com/user-attachments/assets/9b4d98df-2e92-45ec-9ef5-695c0d947d09

Installation

Install this package via pyPI:

pip install harmonization-env

https://pypi.org/project/harmonization-env/

Basic Usage

Here's a complete example showing the main features:

import torch
from harmonization_env import *

path_to_params = "..."
env = HarmonizationEnv(device = 'cpu')

net = NetM.load_from_checkpoint(path_to_params, device = 'cpu')

# Create a melody sequence
# Notes are represented as MIDI numbers (60 = middle C)
melody = torch.tensor([64, 64, 65, 65, 
                       67, 69, 69, 62,
                       67, 67, 68, 71,
                       69, 71, 72, 65,
                       64, 64, 62, 62,
                       60, 60, 60, 60,
                       60], dtype = torch.int32)

melody += 12


# get output
chords, reward = agent.get(
    melody = melody,
)

run = chords[0, :]


v = Voicer(melody, run)
voices = v.get()

player = MIDIGenerator(tempo = 80) 

# get and play midi output
player.generate(voices, filenames = 'test0.mid')
player.play(filename = 'test0.mid')

# Create visualization video
# Download soundfont from https://member.keymusician.com/Member/FluidR3_GM/index.html
vg = VideoGenerator('test0.mid', soundfont_path='FluidR3_GM.sf2')
vg.get_video(output_filename='output.mp4')