qwen38-flash-next
在本地一键运行 Qwen3.8-Flash-Next（125B MoE，6B 激活）UD-IQ1_S 量化版。
执行后自动完成：查找或安装 llama.cpp 运行时（qwen4exp 架构需要未合入的 PR #27742 构建）→ 查找或下载模型（默认走 hf-mirror.com，国内网络友好）→ 启动本地服务 → 进入交互式对话。已存在的模型和运行时会被直接复用，不重复下载/编译。
安装
pip install qwen38-flash-next # PyPI
# 或本地源码
uv tool install ./qwen38-flash-next # 推荐，隔离环境
使用
qwen38-flash # 交互式对话
qwen38-flash --say "你好" # 单发一句（脚本/测试用）
qwen38-flash --download-only # 只下载模型
首次运行需要约 74GB 磁盘与下载时间；48GB 内存机器默认 -ngl 0 纯 CPU 运行（Metal 会因超大嵌入层 OOM）。
交互命令：/exit 退出，/clear 清空上下文，/save 文件 保存对话。
常用选项
| 参数 / 环境变量 | 说明 |
|---|---|
--model PATH / QWEN38_MODEL |
指向模型首分片 ...00001-of-00003.gguf，跳过查找与下载 |
--server-bin PATH / QWEN38_LLAMA_SERVER |
指定支持 qwen4exp 的 llama-server 二进制 |
--port 8080 / --ctx 8192 / --ngl 0 |
服务端口 / 上下文 / GPU 层数 |
HF_ENDPOINT |
模型下载源，默认 https://hf-mirror.com |
模型与运行时路径在首次就绪后写入 ~/.qwen38-flash/config.json，后续启动直接复用。
查找顺序（逐级复用）
模型：--model/环境变量 → 配置文件 → 常见位置（HF 缓存、ModelScope 缓存、~/models、本仓库工作区）→ 自动下载。
运行时：--server-bin/环境变量 → 配置文件 → PATH 中的 llama-server（会校验能否加载模型）→ 自动克隆 PR #27742 源码编译（需 git + cmake + Xcode CLT）。
1 maintainer
Release files for qwen38-flash-next 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| qwen38_flash_next-0.1.0.tar.gz | 9.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| qwen38_flash_next-0.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 20.1 kB
Release files / qwen38_flash_next-0.1.0.tar.gz
| Download URL | qwen38_flash_next-0.1.0.tar.gz |
|---|---|
| Size | 9.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
8b23327b508fe1eeffdacbcee911d29610483523ca9bafbb8a982c7b657f0928
|
|
BLAKE2b-256 checksum How to use checksums |
aa5d7c5876cb243117e20574d7ded6b34338d685d7f7f4df2491a9e6165c19f5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.5 {"installer":{"name":"uv","version":"0.12.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Release files / qwen38_flash_next-0.1.0-py3-none-any.whl
| Download URL | qwen38_flash_next-0.1.0-py3-none-any.whl |
|---|---|
| Size | 10.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
efcf26f3729e304529e8731b9b9a72300216c872c0af64ecdaa0c3f77b46c5cb
|
|
BLAKE2b-256 checksum How to use checksums |
e4387a45e4bfaa1c57643601efc78283a67b7e3c1e0f800d49743041b7b90573
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.5 {"installer":{"name":"uv","version":"0.12.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
