Skip to main content

Omniscient Mozart, being able to transcribe everything in the music.

Project description

OMNIZART

build docs PyPI version PyPI - License PyPI - Downloads Docker Pulls

Omnizart is a Python library that aims for democratizing automatic music transcription. Given polyphonic music, it is able to transcribe pitched instruments, vocal melody, chords, drum events, and beat. This is powered by the research outcomes from Music and Culture Technology (MCT) Lab.

Transcribe your favorite songs now in Colab! Open In Colab

Quick start

Visit the complete document for detailed guidance.

Pip

# Install omnizart
pip install omnizart

# Download the checkpoints
omnizart download-checkpoints

# Transcribe your songs
omnizart drum transcribe <path/to/audio.wav>
omnizart chord transcribe <path/to/audio.wav>
omnizart music transcribe <path/to/audio.wav>

Docker

docker pull mctlab/omnizart:latest
docker run -it mctlab/omnizart:latest bash

Supported applications

Application Transcription Training Evaluation Description
music :heavy_check_mark: :heavy_check_mark: Transcribe musical notes of pitched instruments.
drum :heavy_check_mark: :interrobang: Transcribe events of percussive instruments.
vocal :heavy_check_mark: :heavy_check_mark: Transcribe note-level vocal melody.
vocal-contour :heavy_check_mark: :heavy_check_mark: Transcribe frame-level vocal melody (F0).
chord :heavy_check_mark: :heavy_check_mark: Transcribe chord progressions.
beat :heavy_check_mark: :heavy_check_mark: Transcribe beat position.

NOTES The current implementation for the drum model has unknown bugs, preventing loss convergence when training from scratch. Fortunately, you can still enjoy drum transcription with the provided checkpoints.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

omnizart-0.4.1.tar.gz (3.5 MB view details)

Uploaded Source

Built Distribution

omnizart-0.4.1-py3-none-any.whl (3.6 MB view details)

Uploaded Python 3

File details

Details for the file omnizart-0.4.1.tar.gz.

File metadata

  • Download URL: omnizart-0.4.1.tar.gz
  • Upload date:
  • Size: 3.5 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.6 CPython/3.7.10 Linux/5.4.0-1047-azure

File hashes

Hashes for omnizart-0.4.1.tar.gz
Algorithm Hash digest
SHA256 75efee6d131720d1311c29111857bdfb416b91ddf02f368abecef730b4b1f0b9
MD5 abc75318b665879788acae836df988da
BLAKE2b-256 8dd100f8d41077053d2e73c7d95719dcfb13d9067c9a72315cc5ac5456b65d08

See more details on using hashes here.

File details

Details for the file omnizart-0.4.1-py3-none-any.whl.

File metadata

  • Download URL: omnizart-0.4.1-py3-none-any.whl
  • Upload date:
  • Size: 3.6 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.6 CPython/3.7.10 Linux/5.4.0-1047-azure

File hashes

Hashes for omnizart-0.4.1-py3-none-any.whl
Algorithm Hash digest
SHA256 62a24d7fa2e29ab246955fa7247d6cd3ffdbbcd056d7ba6669e0029b5f751e35
MD5 b9b7d6a8d4bd5fb7efb6a3a0f4a1e89a
BLAKE2b-256 6581e4f4234eccaebed378f056d43c7a7c3a0a2cb4cc97413c48c5f80f41e739

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page