Skip to main content

Omniscient Mozart, being able to transcribe everything in the music.

Project description


build docs PyPI version PyPI - License PyPI - Downloads Docker Pulls

Omnizart is a Python library that aims for democratizing automatic music transcription. Given polyphonic music, it is able to transcribe pitched instruments, vocal melody, chords, drum events, and beat. This is powered by the research outcomes from Music and Culture Technology (MCT) Lab.

Transcribe your favorite songs now in Colab! Open In Colab

Quick start

Visit the complete document for detailed guidance.


# Install omnizart
pip install omnizart

# Download the checkpoints
omnizart download-checkpoints

# Transcribe your songs
omnizart drum transcribe <path/to/audio.wav>
omnizart chord transcribe <path/to/audio.wav>
omnizart music transcribe <path/to/audio.wav>


docker pull mctlab/omnizart:latest
docker run -it mctlab/omnizart:latest bash

Supported applications

Application Transcription Training Evaluation Description
music :heavy_check_mark: :heavy_check_mark: Transcribe musical notes of pitched instruments.
drum :heavy_check_mark: :interrobang: Transcribe events of percussive instruments.
vocal :heavy_check_mark: :heavy_check_mark: Transcribe note-level vocal melody.
vocal-contour :heavy_check_mark: :heavy_check_mark: Transcribe frame-level vocal melody (F0).
chord :heavy_check_mark: :heavy_check_mark: Transcribe chord progressions.
beat :heavy_check_mark: :heavy_check_mark: Transcribe beat position.

NOTES The current implementation for the drum model has unknown bugs, preventing loss convergence when training from scratch. Fortunately, you can still enjoy drum transcription with the provided checkpoints.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for omnizart, version 0.4.1
Filename, size File type Python version Upload date Hashes
Filename, size omnizart-0.4.1-py3-none-any.whl (3.6 MB) File type Wheel Python version py3 Upload date Hashes View
Filename, size omnizart-0.4.1.tar.gz (3.5 MB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page