Core Neon LLM service
Project description
NeonAI Core LLM
Core module for Neon LLM's
Request Format
API requests should include history
, a list of tuples of strings, and the current
query
Example Request:
{ "history": [["user", "hello"], ["llm", "hi"]], "query": "how are you?" }
Response Format
Responses will be returned as dictionaries. Responses should contain the following:
response
- String LLM response to the query
Connection Configuration
When running this as a docker container, the XDG_CONFIG_HOME
envvar is set to /config
.
A configuration file at /config/neon/diana.yaml
is required and should look like:
MQ:
port: <MQ Port>
server: <MQ Hostname or IP>
users:
<LLM MQ service_name>:
user: <MQ user>
password: <MQ user's password>
LLM_<LLM NAME uppercase>:
num_parallel_processes: <integer > 0>
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
neon-llm-core-0.0.5.tar.gz
(5.8 kB
view hashes)
Built Distribution
Close
Hashes for neon_llm_core-0.0.5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0dfac97b9547cb44c5fecb76bfb11469ccccc8071e3fbe2b62b1f92eaa6b2bb8 |
|
MD5 | 6f835e4b495f7beb17e221d1354e927f |
|
BLAKE2b-256 | c82c007a611f393667b4248ac0c19846ba01ad0754cc7c91e8013d2f5070bcdc |