qwen38-flash-next
在本地一键运行 Qwen3.8-Flash-Next(125B MoE,6B 激活)UD-IQ1_S 量化版。
执行后自动完成:查找或安装 llama.cpp 运行时(qwen4exp 架构需要未合入的 PR #27742 构建)→ 查找或下载模型(默认走 hf-mirror.com,国内网络友好)→ 启动本地服务 → 进入交互式对话。已存在的模型和运行时会被直接复用,不重复下载/编译。
安装
pip install qwen38-flash-next # PyPI
# 或本地源码
uv tool install ./qwen38-flash-next # 推荐,隔离环境
使用
qwen38-flash # 交互式对话
qwen38-flash --say "你好" # 单发一句(脚本/测试用)
qwen38-flash --download-only # 只下载模型
qwen38-flash --ms # 从 ModelScope 下载(hf-mirror 不通时用)
首次运行需要约 74GB 磁盘与下载时间;48GB 内存机器默认 -ngl 0 纯 CPU 运行(Metal 会因超大嵌入层 OOM)。
交互命令:/exit 退出,/clear 清空上下文,/save 文件 保存对话。
常用选项
| 参数 / 环境变量 | 说明 |
|---|---|
--model PATH / QWEN38_MODEL |
指向模型首分片 ...00001-of-00003.gguf,跳过查找与下载 |
--server-bin PATH / QWEN38_LLAMA_SERVER |
指定支持 qwen4exp 的 llama-server 二进制 |
--port 8080 / --ctx 8192 / --ngl 0 |
服务端口 / 上下文 / GPU 层数 |
HF_ENDPOINT |
模型下载源,默认 https://hf-mirror.com |
模型与运行时路径在首次就绪后写入 ~/.qwen38-flash/config.json,后续启动直接复用。
查找顺序(逐级复用)
模型:--model/环境变量 → 配置文件 → 常见位置(HF 缓存、ModelScope 缓存、~/models、本仓库工作区)→ 自动下载。
运行时:--server-bin/环境变量 → 配置文件 → PATH 中的 llama-server(会校验能否加载模型)→ 自动克隆 PR #27742 源码编译(需 git + cmake + Xcode CLT)。
Metadata
Release files for qwen38-flash-next 0.1.6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| qwen38_flash_next-0.1.6.tar.gz | 12.2 kB | Without provenance | Details for qwen38_flash_next-0.1.6.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| qwen38_flash_next-0.1.6-py3-none-any.whl | Python 3 | none | any | Details for qwen38_flash_next-0.1.6-py3-none-any.whl |
Total release size: 27.0 kB
Release files / qwen38_flash_next-0.1.6.tar.gz
| Download URL | qwen38_flash_next-0.1.6.tar.gz |
|---|---|
| Size | 12.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
dcfb52cb7e2f17f3cd9f5752299622e39183a793d5b4cad07f6dd6a884c8e3e1
|
|
BLAKE2b-256 checksum How to use checksums |
7043734e82d348ea73555c35ba0183b49df101455b1bf3f33b198b653ef7d93f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.5 {"installer":{"name":"uv","version":"0.12.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Release files / qwen38_flash_next-0.1.6-py3-none-any.whl
| Download URL | qwen38_flash_next-0.1.6-py3-none-any.whl |
|---|---|
| Size | 14.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
b54e909c12ee85e395dd085c7c049c020640be2a08ee2de9e4854cc3beddfe2b
|
|
BLAKE2b-256 checksum How to use checksums |
86bf47d55fc6e0db0c2311e2988e7c58b3b40a7bfe110bfd4e6adf65db2aed6d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.5 {"installer":{"name":"uv","version":"0.12.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Security for qwen38-flash-next 0.1.6
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.