Making transformers production ready
Project description
ofen
Work In Progress
This project is currently under active development. Features and documentation may be incomplete or subject to change.
About
Ofen is a toolkit aimed at making transformer models production-ready. API included (in the future).
Usage
from ofen.models import TextEncoder, CrossEncoder
encoder = TextEncoder.from_pretrained("mixedbread-ai/mxbai-embed-large-v1")
cross_encoder = CrossEncoder.from_pretrained("mixedbread-ai/mxbai-rerank-large-v1")
from ofen.models.onnx import ORTTextEncoder, ORTCrossEncoder
encoder = ORTTextEncoder.from_pretrained("mixedbread-ai/mxbai-embed-large-v1")
cross_encoder = ORTCrossEncoder.from_pretrained("mixedbread-ai/mxbai-rerank-large-v1")
encoder.encode("Hello world")
cross_encoder.rerank("Python", ["print('Hello world')"])
Contributing
As this project is in its early stages, contributions are welcome. Please check the issues page for current tasks or suggest improvements.
License
[To be determined]
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ofen-0.0.1.tar.gz
(52.8 kB
view details)
Built Distribution
ofen-0.0.1-py3-none-any.whl
(73.8 kB
view details)
File details
Details for the file ofen-0.0.1.tar.gz.
File metadata
- Download URL: ofen-0.0.1.tar.gz
- Upload date:
- Size: 52.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.11.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 4208a667e8241d8f85ae5e39aa0b1407093b3097028ad76c467dacbf378cfd17 |
|
| MD5 | 36cf65c021c3ecfc0e347078185b422c |
|
| BLAKE2b-256 | 878fb86492b351a75f63bb6835c8c5bdb41b1ed936bebb6387b65f812de83a0c |
File details
Details for the file ofen-0.0.1-py3-none-any.whl.
File metadata
- Download URL: ofen-0.0.1-py3-none-any.whl
- Upload date:
- Size: 73.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.11.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5bbba285dc34dbc015371c0b0cb08ae495907174a6cd29d863a698595d3b06f7 |
|
| MD5 | b29c11b9ac6af0d4889ef0dffc421492 |
|
| BLAKE2b-256 | 50a5080fcbc273edf4b32d88e08c1d567200aaff26944274903567ecba7bf842 |
