Core Neon LLM service
Project description
NeonAI Core LLM
Core module for Neon LLM's
Request Format
API requests should include history
, a list of tuples of strings, and the current
query
Example Request:
{ "history": [["user", "hello"], ["llm", "hi"]], "query": "how are you?" }
Response Format
Responses will be returned as dictionaries. Responses should contain the following:
response
- String LLM response to the query
Connection Configuration
When running this as a docker container, the XDG_CONFIG_HOME
envvar is set to /config
.
A configuration file at /config/neon/diana.yaml
is required and should look like:
MQ:
port: <MQ Port>
server: <MQ Hostname or IP>
users:
<LLM MQ service_name>:
user: <MQ user>
password: <MQ user's password>
LLM_<LLM NAME uppercase>:
num_parallel_processes: <integer > 0>
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
neon-llm-core-0.1.0.tar.gz
(5.9 kB
view hashes)
Built Distribution
Close
Hashes for neon_llm_core-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9fb00413e321910784ea405a30a32e103a242b345579993523b678d978757754 |
|
MD5 | a0726bdbd94ae790394c8cd5e8eae7ae |
|
BLAKE2b-256 | 614658d2296142139f014a7ddd7b43303611b0fab96cd0d2c38ca7d966268b29 |