The web framework for building LLM microservices.
Lanarky is a python (3.9+) web framework for developers who want to build microservices using LLMs. Here are some of its key features:
- LLM-first: Unlike other web frameworks, lanarky is built specifically for LLM developers. It's unopinionated in terms of how you build your microservices and guarantees zero vendor lock-in with any LLM tooling frameworks or cloud providers
- Fast & Modern: Built on top of FastAPI, lanarky offers all the FastAPI features you know and love. If you are new to FastAPI, visit fastapi.tiangolo.com to learn more
- Streaming: Streaming is essential for many real-time LLM applications, like chatbots. Lanarky has got you covered with built-in streaming support over HTTP and WebSockets.
- Open-source: Lanarky is open-source and free to use. Forever.
To learn more about lanarky and get started, you can find the full documentation on lanarky.ajndkr.com
Installation
The library is available on PyPI and can be installed via pip:
pip install lanarky
Contributing
Contributions are more than welcome! If you have an idea for a new feature or want to help improve lanarky, please create an issue or submit a pull request on GitHub.
See CONTRIBUTING.md for more information.
License
The library is released under the MIT License.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file lanarky-0.8.1.tar.gz.
File metadata
- Download URL: lanarky-0.8.1.tar.gz
- Upload date:
- Size: 14.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.7.1 CPython/3.9.18 Linux/6.2.0-1016-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
acce9845aceeb27a999eb770d380e13cf319db84154d91f8fe4d185e889caea2
|
|
| MD5 |
b7970f65e0a850644fab4a17a5d8101f
|
|
| BLAKE2b-256 |
30c3b1ee8c1a45a96a64f44266501172e0b84e28a1a0cdc01a79833d7c0b148b
|
File details
Details for the file lanarky-0.8.1-py3-none-any.whl.
File metadata
- Download URL: lanarky-0.8.1-py3-none-any.whl
- Upload date:
- Size: 22.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.7.1 CPython/3.9.18 Linux/6.2.0-1016-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
5650618f3dd77aeab238b194f57afd69763bc1fbcd617543f7bb7cfc781a9f00
|
|
| MD5 |
dfc420a84d3ac8d9aa82c228d3d45f41
|
|
| BLAKE2b-256 |
37e6a50ce3e8b7149d11d4ffd183489052df7edea869d37243677d94de8aaaf6
|
