工具包,包含 Redis 安装、基于 Redis 的GPU 任务队列管理等功能
Project description
安装
pip install xspike
安装 Redis
在终端中输入以下命令后,根据提示安装 Redis 并启动 Redis 数据维护服务:
xspike
GPU 自动选择、排队
import xspike as x
queuer = x.GPUQueuer()
# Start the queuer
queuer.start()
# Your code here
# Stop the queuer
queuer.close()
批量启动实验
将实验启动命令放在项目目录下的 exp_plans/exp_demo/xxx.sh 文件中,每条命令之间用换行分割,示例如下:
CUDA_VISIBLE_DEVICES=0 python run.py \
'lr=5e-2' \
'max_epochs=1' \
'lora_rank=512' \
'lora_alpha=1024'
CUDA_VISIBLE_DEVICES=0 python run.py \
'lr=5e-3' \
'max_epochs=1' \
'lora_rank=1024' \
'lora_alpha=2018'
# 其他实验命令......
并在项目目录下运行以下命令:
xx
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
xspike-0.1.5.tar.gz
(11.2 kB
view details)
File details
Details for the file xspike-0.1.5.tar.gz.
File metadata
- Download URL: xspike-0.1.5.tar.gz
- Upload date:
- Size: 11.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.9.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7d8da332951eefe55b6e1871014bd3ed7ac5b294d0995e69c90907bafe233d86
|
|
| MD5 |
fbe2b1a0f0a813b449ac352badcc07b6
|
|
| BLAKE2b-256 |
9bdc1fc16e609fd8cf72886ec81c1679b19d107e4c4f614d58f8e1e64c1a2ed7
|