Skip to main content

工具包,包含 Redis 安装、基于 Redis 的GPU 任务队列管理等功能

Project description

安装

pip install xspike

安装 Redis

在终端中输入以下命令后,根据提示安装 Redis 并启动 Redis 数据维护服务:

xspike

GPU 自动选择、排队

import xspike as x

queuer = x.GPUQueuer()

# Start the queuer
queuer.start()

# Your code here

# Stop the queuer
queuer.close()

批量启动实验

将实验启动命令放在项目目录下的 exp_plans/exp_demo/xxx.sh 文件中,每条命令之间用换行分割,示例如下:

CUDA_VISIBLE_DEVICES=0 python run.py \
    'lr=5e-2' \
    'max_epochs=1' \
    'lora_rank=512' \
    'lora_alpha=1024' 

CUDA_VISIBLE_DEVICES=0 python run.py \
    'lr=5e-3' \
    'max_epochs=1' \
    'lora_rank=1024' \
    'lora_alpha=2018' 

# 其他实验命令......

并在项目目录下运行以下命令:

xx

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

xspike-0.1.6.tar.gz (11.2 kB view details)

Uploaded Source

File details

Details for the file xspike-0.1.6.tar.gz.

File metadata

  • Download URL: xspike-0.1.6.tar.gz
  • Upload date:
  • Size: 11.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.9.13

File hashes

Hashes for xspike-0.1.6.tar.gz
Algorithm Hash digest
SHA256 d0d819c6b1b1325d13b1912be733cf9b604664cc349711b0a4d10be69f81da03
MD5 0e33e13eef5cbc922c0d098925e06250
BLAKE2b-256 31f0b9034e1c6938568d71e815802799aa5fb324044af4f279298e02354849a4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page