Skip to main content

用来构建大模型环境的工具

Project description

diz

目前开源的大模型项目普遍来说都有如下问题:

  1. 安装环境复杂,需要安装大量依赖包,而且依赖包版本之间有冲突,导致安装失败
  2. 模型往往存放在 huggeface 上,下载速度慢,且不符合国情,使用 git lfs 也不方便

本项目重点解决上述 2 个问题,提供一个简单的模型下载和使用的框架,方便大家快速使用。 总结一句话来说就是:目标就是干出一个大模型的 homebrew。

安装

pip install diz

系统依赖:

  1. tmux
  2. git
  3. git lfs

使用

diz setup

根据提示输入你要安装的目录和模型的 url 当前支持的模型有:

也可以一句话安装:

diz setup --path /root/autodl-tmp/chatglm2 --pkg https://gist.githubusercontent.com/mjason/a616dcb8f9fd09fb2c7fb18ff3bb6279/raw/bb530a7d4101edf8aa474883d1f54a6aef58bc44/chatglm2-6b.yml
diz install ChatGLM2-6B --path /root/autodl-tmp/chatglm2

即可完成安装,安装完成后会自动进入虚拟环境,可以直接使用。

  • diz shell 进入虚拟环境
  • diz shell --mode o 退出虚拟环境,环境进入后台
  • diz shell --mode k 退出虚拟环境,环境进入后台,且 kill 掉原来的进程
## 路线图
- [x] 提供 install 命令,统一安装源
- [x] 提供 venv 指令,快速进入对应的虚拟环境
- [ ] 提供 generate 命令,根据生成本地模型调用代码

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

diz-0.0.13.tar.gz (6.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

diz-0.0.13-py3-none-any.whl (7.7 kB view details)

Uploaded Python 3

File details

Details for the file diz-0.0.13.tar.gz.

File metadata

  • Download URL: diz-0.0.13.tar.gz
  • Upload date:
  • Size: 6.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.4

File hashes

Hashes for diz-0.0.13.tar.gz
Algorithm Hash digest
SHA256 af2a8e6a4ffa6780cc7814d9811ba790167932b25d2b795ec7ac46f28af3b3f5
MD5 a2796c807a84fac796cd93fb2354d97b
BLAKE2b-256 d6be3804a645887d6ef1930e97c94326f43061089a0c98148707e5f1d280163d

See more details on using hashes here.

File details

Details for the file diz-0.0.13-py3-none-any.whl.

File metadata

  • Download URL: diz-0.0.13-py3-none-any.whl
  • Upload date:
  • Size: 7.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.4

File hashes

Hashes for diz-0.0.13-py3-none-any.whl
Algorithm Hash digest
SHA256 1b0d358308748b4681c61fe6e7a3644a76ebf258ec4a914d6c505d2163e854bf
MD5 3bdd377ebe4231b33debe6c13f03ca76
BLAKE2b-256 d7bd9b8e93eed9f5a555bfe18e89fc7f5325188d69092f08d0c420490ac56127

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page