用来构建大模型环境的工具
Project description
diz
目前开源的大模型项目普遍来说都有如下问题:
- 安装环境复杂,需要安装大量依赖包,而且依赖包版本之间有冲突,导致安装失败
- 模型往往存放在 huggeface 上,下载速度慢,且不符合国情,使用 git lfs 也不方便
本项目重点解决上述 2 个问题,提供一个简单的模型下载和使用的框架,方便大家快速使用。 总结一句话来说就是:目标就是干出一个大模型的 homebrew。
安装
pip install diz
系统依赖:
- tmux
- git
- git lfs
使用
diz setup
根据提示输入你要安装的目录和模型的 url 当前支持的模型有:
也可以一句话安装:
diz setup --path /root/autodl-tmp/chatglm2 --pkg https://gist.githubusercontent.com/mjason/a616dcb8f9fd09fb2c7fb18ff3bb6279/raw/bb530a7d4101edf8aa474883d1f54a6aef58bc44/chatglm2-6b.yml
diz install ChatGLM2-6B --path /root/autodl-tmp/chatglm2
即可完成安装,安装完成后会自动进入虚拟环境,可以直接使用。
- diz shell 进入虚拟环境
- diz shell --mode o 退出虚拟环境,环境进入后台
- diz shell --mode k 退出虚拟环境,环境进入后台,且 kill 掉原来的进程
## 路线图
- [x] 提供 install 命令,统一安装源
- [x] 提供 venv 指令,快速进入对应的虚拟环境
- [ ] 提供 generate 命令,根据生成本地模型调用代码
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
diz-0.0.13.tar.gz
(6.5 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
diz-0.0.13-py3-none-any.whl
(7.7 kB
view details)
File details
Details for the file diz-0.0.13.tar.gz.
File metadata
- Download URL: diz-0.0.13.tar.gz
- Upload date:
- Size: 6.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
af2a8e6a4ffa6780cc7814d9811ba790167932b25d2b795ec7ac46f28af3b3f5
|
|
| MD5 |
a2796c807a84fac796cd93fb2354d97b
|
|
| BLAKE2b-256 |
d6be3804a645887d6ef1930e97c94326f43061089a0c98148707e5f1d280163d
|
File details
Details for the file diz-0.0.13-py3-none-any.whl.
File metadata
- Download URL: diz-0.0.13-py3-none-any.whl
- Upload date:
- Size: 7.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1b0d358308748b4681c61fe6e7a3644a76ebf258ec4a914d6c505d2163e854bf
|
|
| MD5 |
3bdd377ebe4231b33debe6c13f03ca76
|
|
| BLAKE2b-256 |
d7bd9b8e93eed9f5a555bfe18e89fc7f5325188d69092f08d0c420490ac56127
|