Skip to main content

ANE optimised adaptation of Whisper for optimised inference

Project description

This project is an attempt to re-define certain architectures to be optimised to run on the ANE. More specifically, it aims to adopt this Apple's ml-ane-transformers codebase to the Whisper architecture. I've been working with the commit hash d18e9ea (there have been some changes to return signatures of internal functions -- that may not impact us, but I haven't tested that yet)


Install

pip install git+https://github.com/openai/whisper/.git@d18e9ea5dd2ca57c697e8e55f9e654f06ede25d0
pip install git+https://github.com/apple/ml-ane-transformers
pip install whisper_ane

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

whisper_ane-0.1.0.tar.gz (1.7 kB view hashes)

Uploaded Source

Built Distribution

whisper_ane-0.1.0-py3-none-any.whl (1.6 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page