No project description provided
Project description
Imitater
Create a .env file in the root directory:
.
├── src
└── .env
# imitater
CHAT_MODEL=path_to_chat_model
EMBED_MODEL=path_to_bge_model
EMBED_BATCH_SIZE=16
ENABLE_ATTN_BIAS=0
# tests
OPENAI_BASE_URL=http://192.168.0.1:8000/v1
OPENAI_API_KEY=0
Launch Server
python src/launch.py
Test Server
python tests/test_openai.py
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
imitater-0.1.0.tar.gz
(11.6 kB
view hashes)
Built Distribution
imitater-0.1.0-py3-none-any.whl
(11.6 kB
view hashes)
