llm-abstraction
Async LLM backend abstraction with shared Retry-After handling.
Only Mistral chat completions are implemented right now, but the package is structured around a generic async backend interface.
from llm_abstraction import MistralBackend
backend = MistralBackend(api_key="...")
response = await backend.chat(
[
{"role": "user", "content": "Hello"},
],
)
print(response.content)
embeddings = await backend.embed(["Hello"])
print(embeddings.embeddings[0])
Build
python -m venv .venv
source .venv/bin/activate
pip install -e ".[dev]"
pytest
ruff check .
mypy
pyright
python -m build
twine check dist/*
Publish
TestPyPI:
twine upload --repository testpypi dist/*
PyPI:
twine upload dist/*
After publishing, downstream projects can depend on:
llm-abstraction>=0.1.0
1 maintainer
Metadata
1 maintainer
Release files for llm-abstraction 0.3.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| llm_abstraction-0.3.0.tar.gz | 7.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| llm_abstraction-0.3.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 14.5 kB
Release files / llm_abstraction-0.3.0.tar.gz
| Download URL | llm_abstraction-0.3.0.tar.gz |
|---|---|
| Size | 7.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
87ffc38b97e5ae310e9f6533f9601209aa3ebeee1e906742acba2f0ed70b1f1e
|
|
BLAKE2b-256 checksum How to use checksums |
f5916ad5cb92f8a03ef61b10552001e50434f7900e1cf04e02cea6634c6cf3c6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.13.1
|
Release files / llm_abstraction-0.3.0-py3-none-any.whl
| Download URL | llm_abstraction-0.3.0-py3-none-any.whl |
|---|---|
| Size | 7.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
e4711cf07692e13e3c2d76c2cf518be25a6fda8ade2e957b697b84c6e9f879c5
|
|
BLAKE2b-256 checksum How to use checksums |
73311b95b82efc86e3b4a7bda9d2dd9a50c67fbcc62563b8b112351a3ff17f6a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.13.1
|
