eary-start-llama

用 py-cli + json 管理本机 llama.cpp 模型服务：一份清单 + 一个交互界面，把 llama serve 的启动、停止、日志变成顺手操作。

它不参与推理，只是 llama serve 之上的一层编排。

安装

需要 Python >= 3.13、uv，以及带 serve 的 llama 命令。

pip install eary-start-llama

安装后提供两个等价命令：esl（短）与 eary-start-llama（完整），下文用 esl。

在源码目录里开发则改用 uv sync，并把下文的 esl 换成 uv run esl。

esl            # 无参数 → 进入交互界面

交互界面

也可以直接用子命令（适合脚本）：

esl list
esl start bge-m3
esl stop --all
esl log bge-m3 -f

可用命令：list status start stop log add rm init，详见 esl -h。

声明要管哪些模型，写在项目根 models.json（完整示例见 example.model.json）：

{
  "models": {
    "bge-m3": {
      "source": "ggml-org/bge-m3-Q8_0-GGUF:Q8_0",
      "args": "--embeddings",
      "port": 9931
    }
  }
}

首次运行会自动从 llama -cl 导入已有缓存模型。

运行状态与日志放在 ~/.local/state/eary-start-llama/，不写进项目
清单查找顺序：$ESL_CONFIG > 项目根 models.json > ~/.config/eary-start-llama/models.json

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution for eary-start-llama 0.1.0
File	Size	Uploaded
eary_start_llama-0.1.0.tar.gz	14.8 kB	Oct 15, 2026	Details

Table of built distributions (wheels) for eary-start-llama 0.1.0
File	Interpreter	ABI	Platform	Reset
eary_start_llama-0.1.0-py3-none-any.whl 19.5 kB Oct 15, 2026	Python 3	none	any	Details

Total release size: 34.3 kB

Download URL	eary_start_llama-0.1.0.tar.gz
Size	14.8 kB
Tags	Source
SHA-256 checksum How to use checksums	`49508e4b23bd5dda7ca6a2f9a9149b34a6c98d6c4bfcc8c8387c03e91e8d9d72`
BLAKE2b-256 checksum How to use checksums	`5808b7f2570861da5449e6d067b60d32dae7c78a3f19a183b9b6ecb2185d8068`
Upload date	Oct 15, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`uv/0.12.23 {"installer":{"name":"uv","version":"0.12.23","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"26.04","id":"resolute","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}`

Download URL	eary_start_llama-0.1.0-py3-none-any.whl
Size	19.5 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`15e375e26c14ca1f163702d4a3689bc356e739a4b2940af8e40e790481664624`
BLAKE2b-256 checksum How to use checksums	`fd49c6d6d3a66780ebff059fdedf7bb792fadedad13ef3def8494973a5fabf2b`
Upload date	Oct 15, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`uv/0.12.23 {"installer":{"name":"uv","version":"0.12.23","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"26.04","id":"resolute","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}`