eary-start-llama

用 py-cli + json 管理本机 llama.cpp 模型服务：一份清单 + 一个交互界面，把 llama serve 的启动、停止、日志变成顺手操作。

它不参与推理，只是 llama serve 之上的一层编排。

安装

需要 Python >= 3.13、uv，以及带 serve 的 llama 命令。

pip install eary-start-llama

安装后提供两个等价命令：esl（短）与 eary-start-llama（完整），下文用 esl。

在源码目录里开发则改用 uv sync，并把下文的 esl 换成 uv run esl。

esl            # 无参数 → 进入交互界面

交互界面

也可以直接用子命令（适合脚本）：

esl list
esl start bge-m3
esl stop --all
esl log bge-m3 -f

可用命令：list status start stop log add rm init，详见 esl -h。

声明要管哪些模型，写在项目根 models.json（完整示例见 example.model.json）：

{
  "models": {
    "bge-m3": {
      "source": "ggml-org/bge-m3-Q8_0-GGUF:Q8_0",
      "args": "--embeddings",
      "port": 9931
    }
  }
}

首次运行会自动从 llama -cl 导入已有缓存模型。

运行状态与日志放在 ~/.local/state/eary-start-llama/，不写进项目
清单查找顺序：$ESL_CONFIG > 项目根 models.json > ~/.config/eary-start-llama/models.json

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution for eary-start-llama 0.1.1
File	Size	Uploaded
eary_start_llama-0.1.1.tar.gz	14.8 kB	Oct 15, 2026	Details

Table of built distributions (wheels) for eary-start-llama 0.1.1
File	Interpreter	ABI	Platform	Reset
eary_start_llama-0.1.1-py3-none-any.whl 19.5 kB Oct 15, 2026	Python 3	none	any	Details

Total release size: 34.4 kB

Download URL	eary_start_llama-0.1.1.tar.gz
Size	14.8 kB
Tags	Source
SHA-256 checksum How to use checksums	`ec972ea264cc67bd25127f99d1045b69446c44190a4d3fd7c80c797534e22f17`
BLAKE2b-256 checksum How to use checksums	`842f8b23b1162ec8775fd616b7dda9af84c4f2278ef25e4de3d8770c6b69a5c3`
Upload date	Oct 15, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`uv/0.12.23 {"installer":{"name":"uv","version":"0.12.23","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"26.04","id":"resolute","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}`

Download URL	eary_start_llama-0.1.1-py3-none-any.whl
Size	19.5 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`b69875f33af234f8f37eb3ac7379b5a527df30ed9b7502ea44d1cf102e3e9ccb`
BLAKE2b-256 checksum How to use checksums	`361eb4e334892399bc34a9dcf61ab629f8b3962df7ff7b2d3198203ac453bd21`
Upload date	Oct 15, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`uv/0.12.23 {"installer":{"name":"uv","version":"0.12.23","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"26.04","id":"resolute","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}`