Python component of using Briton
Project description
Briton
The python side of Briton. Briton server is written in C++ for high performance and provides a grpc endpoint for interaction. A major function of this python libarary is to provide easier interaction with the Briton Server. e.g. there's logic to startup the Briton server and ensure it's healthy. It also provides adapters for using Briton from Truss. For certain features, such as draft model based speculative decoding, a subtantial chunk of the implementation is in this library.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
briton-0.3.0a1.tar.gz
(30.6 kB
view details)
Built Distribution
briton-0.3.0a1-py3-none-any.whl
(36.8 kB
view details)
File details
Details for the file briton-0.3.0a1.tar.gz.
File metadata
- Download URL: briton-0.3.0a1.tar.gz
- Upload date:
- Size: 30.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.4 CPython/3.9.20 Linux/6.5.0-1025-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 51142a5cb078440e5d6508f0278307fcd9341c22d7ae07335f077eb21d5d027d |
|
| MD5 | fd5a08c69760a92b81ea6b12fc04158f |
|
| BLAKE2b-256 | c0dfcc8b05704a5a9281221479eebd60c4b45a98cb4fab1f72998db3fa2815aa |
File details
Details for the file briton-0.3.0a1-py3-none-any.whl.
File metadata
- Download URL: briton-0.3.0a1-py3-none-any.whl
- Upload date:
- Size: 36.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.4 CPython/3.9.20 Linux/6.5.0-1025-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 8fad3d6f855105d606e75d7cccde4bf7b58374c6d4935df9a29a57670e5c2c35 |
|
| MD5 | f4deae975741ea8931e65b9ad310a42d |
|
| BLAKE2b-256 | 588c316ab7b347356083d46ff1effafb1f7b5cfbf4acf9485cf10c2baaddb780 |
