Nendo MusicGen plugin: A state-of-the-art controllable text-to-music model (by Meta Research)
Project description
Nendo Plugin Musicgen
MusicGen: A state-of-the-art controllable text-to-music model (by Meta Research)
Features
- Generate conditional and unconditional music
- Generate outpaintings from a prompt and a
NendoTrack
- Use a
NendoTrack
as melody conditioning to generate music - Use custom finetuned musicgen models
Requirements
Since we depend on audiocraft
, please make sure that you fulfill their requirements.
You need Pytorch 2.0.0 or higher, which can be installed via
pip install "torch>=2.0"
Note: On Mac OSX, the instructions for installing pytorch differ. Please refer to the pytorch installation instructions. For all other problems please refer to the audiocraft repository.
Due to a dependency conflict with pydantic
, this plugin requires the manual installation of okio's music
fork:
pip install git+https://github.com/okio-ai/audiocraft
Installation
- Install Nendo
pip install nendo-plugin-musicgen
Usage
Take a look at a basic usage example below. For more detailed information, please refer to the documentation.
For more advanced examples, check out the examples folder. or try it in colab:
from nendo import Nendo, NendoConfig
nd = Nendo(config=NendoConfig(plugins=["nendo_plugin_musicgen"]))
# load track
track = nd.library.add_track(file_path='/path/to/track.mp3')
# run musicgen with custom model
generated_collection = nd.plugins.musicgen(
track=track,
n_samples=5,
prompt="janelle monae, rnb, funky, fast, futuristic",
bpm=116,
key="C",
scale="Major",
duration=30,
conditioning_length=10
)
generated_collection[0].play()
Contributing
Visit our docs to learn all about how to contribute to Nendo: Contributing
License
Nendo: MIT License
AudioCraft: MIT License
Pretrained models: The weights are released under the CC-BY-NC 4.0 license
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for nendo_plugin_musicgen-0.1.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6ad0d0a9701b851f83f4cbb078916045f98b0cc4317c3d9e85e752acba6faaa5 |
|
MD5 | 18d2952d19db712bf77bbd42fdb76bea |
|
BLAKE2b-256 | a8991657722107c20f285a38eada7059288d4475dfc0d07c394137358cc32886 |
Hashes for nendo_plugin_musicgen-0.1.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7e53feda35ab883dfb9836318e624fd4cac94775e4023482533cf52018f0d7b8 |
|
MD5 | 6539b40df1fe368a7843d2dd1cfc451e |
|
BLAKE2b-256 | 535dec1d22592f2f817cbf65f8c5c8ad9c949dedd6c53c27ed12232405b477b0 |