NeonAI Core LLM
Core module for Neon LLM's
Request Format
API requests should include history, a list of tuples of strings, and the current
query
Example Request:
{ "history": [["user", "hello"], ["llm", "hi"]], "query": "how are you?" }
Response Format
Responses will be returned as dictionaries. Responses should contain the following:
response- String LLM response to the query
Connection Configuration
When running this as a docker container, the XDG_CONFIG_HOME envvar is set to /config.
A configuration file at /config/neon/diana.yaml is required and should look like:
MQ:
port: <MQ Port>
server: <MQ Hostname or IP>
users:
<LLM MQ service_name>:
user: <MQ user>
password: <MQ user's password>
LLM_<LLM NAME uppercase>:
num_parallel_processes: <integer > 0>
Enabling Chatbot personas
An LLM may be configured to connect to a /chatbots vhost and participate in
discussions as described in the chatbots project.
One LLM may define multiple personas to participate as:
llm_bots:
<LLM Name>:
- name: Assistant
description: You are a personal assistant who responds in 40 words or less
- name: Author
description: You are an author and expert in literary history
- name: Student
description: You are a graduate student working in the field of artificial intelligence
enabled: False
LLM Nameis defined in the propertyNeonLLMMQConnector.name
2 maintainers
Metadata
2 maintainers
Release files for neon-llm-core 0.2.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| neon-llm-core-0.2.0.tar.gz | 19.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| neon_llm_core-0.2.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 59.6 kB
Release files / neon-llm-core-0.2.0.tar.gz
| Download URL | neon-llm-core-0.2.0.tar.gz |
|---|---|
| Size | 19.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
e59c2e64f32ece21807a00a7ad4df340127eefb85425d8e1a18ffd0afe964574
|
|
BLAKE2b-256 checksum How to use checksums |
60a1a4795322a9e8f9467beb2ba3d6132afd2562d27a4816afc1d46e5e0359ca
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.12.9
|
Release files / neon_llm_core-0.2.0-py3-none-any.whl
| Download URL | neon_llm_core-0.2.0-py3-none-any.whl |
|---|---|
| Size | 39.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
edc82624817fb1ac76ce335511f443a6642e617e77f7920bce668a8601d3ef2d
|
|
BLAKE2b-256 checksum How to use checksums |
13e1736ce0a454398aab14e0bb2ca6e19d1fbaa139f88befb7557d0a8c6fb809
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.12.9
|
