sunholo-py
(draft release)
pip install sunholo
A python library to enable LLMOps within cloud environments
llmops provides utilities to help manage LLM operations on Google Cloud Platform at first, but it is hoped that making it open source will help it support other clouds in the future. A lot of the functionality is not Google Cloud Platform specific, so still may be helpful.
It is derived from the Edmonbrain project, the original blog post you can read here: https://code.markedmondson.me/running-llms-on-gcp/ and owes a lot to Langchain ( https://github.com/langchain-ai/langchain )
The package includes:
agents/- functions for working with agents, including easy flask apps, parsing chat history and dispatching requests to different agent endpointsarchive- functions to record all Q&A activity to BigQuery via PubSubbots/- functions for special cases regrding frontend bots such as Web Apps, Discord and Slackchunker/- functions to slice up documents for sending into vector storescomponents/- functions to help configure which LLM, prompt, vectorstore or document reteriver you will use based on a yaml config filedatabase/- database setup functions and SQL to run on those sources such as Supabaseembedder/- functions to send chunks into embedding vector storespubsub/- use of PubSub for a message queue between componentsqna/- utilities for running agents such as retry strats and parsing of output/inputstreaming/- creation of streaming responses from LLM botssummarise/- creation of summaries of large documentsutils/- reading configuration files, Google Cloud Platform metadata
Copyright [2023] [Sunholo ApS]
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
1 maintainer
Release files for sunholo 0.1.3.20231115065325
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| sunholo-0.1.3.20231115065325.tar.gz | 37.8 kB | Details |
Release files / sunholo-0.1.3.20231115065325.tar.gz
| Download URL | sunholo-0.1.3.20231115065325.tar.gz |
|---|---|
| Size | 37.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9741614e00f3f3c5774b0ff4fd97c62a451f78ebbbe15f40321f9eedcf43e43e
|
|
BLAKE2b-256 checksum How to use checksums |
0cd34b87d6352aa5d14a58254e7068043b08329759a870e131e45edd49271ad6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.9.18
|
