Skip to main content

用来构建大模型环境的工具

Project description

diz

目前开源的大模型项目普遍来说都有如下问题:

  1. 安装环境复杂,需要安装大量依赖包,而且依赖包版本之间有冲突,导致安装失败
  2. 模型往往存放在 huggeface 上,下载速度慢,且不符合国情,使用 git lfs 也不方便

本项目重点解决上述 2 个问题,提供一个简单的模型下载和使用的框架,方便大家快速使用。 总结一句话来说就是:目标就是干出一个大模型的 homebrew。

安装

pip install diz

系统依赖:

  1. tmux
  2. git
  3. git lfs

使用

diz setup

根据提示输入你要安装的目录和模型的 url 当前支持的模型有:

也可以一句话安装:

diz setup --path /root/autodl-tmp/chatglm2 --pkg https://gist.githubusercontent.com/mjason/a616dcb8f9fd09fb2c7fb18ff3bb6279/raw/bb530a7d4101edf8aa474883d1f54a6aef58bc44/chatglm2-6b.yml
diz install ChatGLM2-6B --path /root/autodl-tmp/chatglm2

即可完成安装,安装完成后会自动进入虚拟环境,可以直接使用。

  • diz shell 进入虚拟环境
  • diz shell --mode o 退出虚拟环境,环境进入后台
  • diz shell --mode k 退出虚拟环境,环境进入后台,且 kill 掉原来的进程
## 路线图
- [x] 提供 install 命令,统一安装源
- [x] 提供 venv 指令,快速进入对应的虚拟环境
- [ ] 提供 generate 命令,根据生成本地模型调用代码

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

diz-0.0.11.tar.gz (6.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

diz-0.0.11-py3-none-any.whl (7.6 kB view details)

Uploaded Python 3

File details

Details for the file diz-0.0.11.tar.gz.

File metadata

  • Download URL: diz-0.0.11.tar.gz
  • Upload date:
  • Size: 6.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.4

File hashes

Hashes for diz-0.0.11.tar.gz
Algorithm Hash digest
SHA256 57e4d803bfc947a879b95dd8edb4c51497bef1be6b3b0e040684accefeedc782
MD5 0539a5ad6c58e7bd8f80f7f7b8144445
BLAKE2b-256 fa4c70116343a4474ea287c664753d1d4249ff903a319af45a25c872f1ca9609

See more details on using hashes here.

File details

Details for the file diz-0.0.11-py3-none-any.whl.

File metadata

  • Download URL: diz-0.0.11-py3-none-any.whl
  • Upload date:
  • Size: 7.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.4

File hashes

Hashes for diz-0.0.11-py3-none-any.whl
Algorithm Hash digest
SHA256 45b6462905758c0b36a3e9756bf1b2332eddc62c9a687fe827a37949286a01d3
MD5 e01665f89ec0290dc5732981dab63c19
BLAKE2b-256 25550dbf2c9ccdc679bd3a97331c1de70addc84a52090d4d13d880f9bc51fa54

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page