Skip to main content

工具包,包含 Redis 安装、基于 Redis 的GPU 任务队列管理等功能

Project description

安装

pip install xspike

安装 Redis

在终端中输入以下命令后,根据提示安装 Redis 并启动 Redis 数据维护服务:

xspike

GPU 自动选择、排队

import xspike as x

queuer = x.GPUQueuer()

# Start the queuer
queuer.start()

# Your code here

# Stop the queuer
queuer.close()

批量启动实验

将实验启动命令放在项目目录下的 exp_plans/exp_demo/xxx.sh 文件中,每条命令之间用换行分割,示例如下:

CUDA_VISIBLE_DEVICES=0 python run.py \
    'lr=5e-2' \
    'max_epochs=1' \
    'lora_rank=512' \
    'lora_alpha=1024' 

CUDA_VISIBLE_DEVICES=0 python run.py \
    'lr=5e-3' \
    'max_epochs=1' \
    'lora_rank=1024' \
    'lora_alpha=2018' 

# 其他实验命令......

并在项目目录下运行以下命令:

xx

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

xspike-0.1.4.tar.gz (11.1 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page