用来构建大模型环境的工具
Project description
diz
目前开源的大模型项目普遍来说都有如下问题:
- 安装环境复杂,需要安装大量依赖包,而且依赖包版本之间有冲突,导致安装失败
- 模型往往存放在 huggeface 上,下载速度慢,且不符合国情,使用 git lfs 也不方便
本项目重点解决上述 2 个问题,提供一个简单的模型下载和使用的框架,方便大家快速使用。 总结一句话来说就是:目标就是干出一个大模型的 homebrew。
安装
pip install diz
系统依赖:
- tmux
- git
- git lfs
使用
diz setup
根据提示输入你要安装的目录和模型的 url 当前支持的模型有:
也可以一句话安装:
diz setup --path /root/autodl-tmp/chatglm2 --pkg https://gist.githubusercontent.com/mjason/a616dcb8f9fd09fb2c7fb18ff3bb6279/raw/bb530a7d4101edf8aa474883d1f54a6aef58bc44/chatglm2-6b.yml
diz install ChatGLM2-6B --path /root/autodl-tmp/chatglm2
即可完成安装,安装完成后会自动进入虚拟环境,可以直接使用。
- diz shell 进入虚拟环境
- diz shell --mode o 退出虚拟环境,环境进入后台
- diz shell --mode k 退出虚拟环境,环境进入后台,且 kill 掉原来的进程
## 路线图
- [x] 提供 install 命令,统一安装源
- [x] 提供 venv 指令,快速进入对应的虚拟环境
- [ ] 提供 generate 命令,根据生成本地模型调用代码
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
diz-0.0.12.tar.gz
(6.5 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
diz-0.0.12-py3-none-any.whl
(7.6 kB
view details)
File details
Details for the file diz-0.0.12.tar.gz.
File metadata
- Download URL: diz-0.0.12.tar.gz
- Upload date:
- Size: 6.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3c0866cca6f519da568462edbd7893b05f157bf1d67cd7aeea17b52e676e41c9
|
|
| MD5 |
a6c2bf72f6c70a4d9644982204196c77
|
|
| BLAKE2b-256 |
cc4b72446f50fc1caa65bed0136ed418075d1df650f44ca467252af1334c1a44
|
File details
Details for the file diz-0.0.12-py3-none-any.whl.
File metadata
- Download URL: diz-0.0.12-py3-none-any.whl
- Upload date:
- Size: 7.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ec7042771852cd4299850412bf7e56b9680084c46b45f39e090ec2e6e964dddd
|
|
| MD5 |
14823739c1cbd9a5c812a17aa11eaebb
|
|
| BLAKE2b-256 |
ab969b6fee23f4c58f370664b65ceafff60bca1af230d6f635a16c3530b12fa8
|