Simultaneous Speech-to-Speech Translation Without Aligned Data.
Project description
Hibiki-Zero
Hibiki-Zero is a real-time and multilingual speech translation model. It translates from French, Spanish, Portuguese and German to English: accurately, with low latency, high audio quality, and voice transfer.
https://github.com/user-attachments/assets/d533ec45-8d5e-4e41-886a-0b2d198be6f3
🤗 Hugging Face Model Card | ⚙️ Tech report | 📄 Paper | 🎧 More samples
Requirements
Hibiki-Zero is a 3B-parameter model and requires an NVIDIA GPU to run: 8 GB VRAM should work, 12 GB is safe.
Run the server
Hibiki-Zero comes with a server you can run to interact with Hibiki in real time. To run it, just use:
uv run hibiki-zero serve [--gradio-tunnel]
Then go to the URL displayed to try out Hibiki-Zero.
The --gradio-tunnel flag will forward the server to a public URL that you can access from anywhere.
Run inference
If you'd like to run Hibiki-Zero on existing audio files, run:
uv run hibiki-zero generate [--file /path/to/my/audio.wav --file /path/to/another/audio.mp3]
Batch inference is supported, meaning you can run the model on multiple audio files at the same time.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file hibiki_zero-0.0.3.tar.gz.
File metadata
- Download URL: hibiki_zero-0.0.3.tar.gz
- Upload date:
- Size: 7.2 MB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
967a4019d8adf7379f67974b695033fa938e78f93eef9812fb90dc1205584652
|
|
| MD5 |
8e458da2d6a7fbfa47ca9267b24e1e6b
|
|
| BLAKE2b-256 |
8b656633f9f8905ae77be64f5bc49dcd065a0f1c21818ca23017913659b0c023
|
Provenance
The following attestation bundles were made for hibiki_zero-0.0.3.tar.gz:
Publisher:
publish-package.yml on kyutai-labs/hibiki-zero
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
hibiki_zero-0.0.3.tar.gz -
Subject digest:
967a4019d8adf7379f67974b695033fa938e78f93eef9812fb90dc1205584652 - Sigstore transparency entry: 944535932
- Sigstore integration time:
-
Permalink:
kyutai-labs/hibiki-zero@0905c902e0e61a97af2e563b2ece1a6381e53368 -
Branch / Tag:
refs/tags/v0.0.3 - Owner: https://github.com/kyutai-labs
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-package.yml@0905c902e0e61a97af2e563b2ece1a6381e53368 -
Trigger Event:
release
-
Statement type:
File details
Details for the file hibiki_zero-0.0.3-py3-none-any.whl.
File metadata
- Download URL: hibiki_zero-0.0.3-py3-none-any.whl
- Upload date:
- Size: 3.6 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c63234791052c83f715ba51434f0922469b0e71add7c9f6239d9bd9e73430d76
|
|
| MD5 |
bf1f3b8d4bf3ce6d1585f0bbef14aa48
|
|
| BLAKE2b-256 |
d5107693b2b86e0975d21777ef58ea9455298077c67c9964e7ca925b336bfeda
|
Provenance
The following attestation bundles were made for hibiki_zero-0.0.3-py3-none-any.whl:
Publisher:
publish-package.yml on kyutai-labs/hibiki-zero
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
hibiki_zero-0.0.3-py3-none-any.whl -
Subject digest:
c63234791052c83f715ba51434f0922469b0e71add7c9f6239d9bd9e73430d76 - Sigstore transparency entry: 944535945
- Sigstore integration time:
-
Permalink:
kyutai-labs/hibiki-zero@0905c902e0e61a97af2e563b2ece1a6381e53368 -
Branch / Tag:
refs/tags/v0.0.3 - Owner: https://github.com/kyutai-labs
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-package.yml@0905c902e0e61a97af2e563b2ece1a6381e53368 -
Trigger Event:
release
-
Statement type:
