Skip to main content

工具包,包含 Redis 安装、基于 Redis 的GPU 任务队列管理等功能

Project description

安装

pip install xspike

安装 Redis

在终端中输入以下命令后,根据提示安装 Redis 并启动 Redis 数据维护服务:

xspike

GPU 自动选择、排队

import xspike as x

queuer = x.GPUQueuer()

# Start the queuer
queuer.start()

# Your code here

# Stop the queuer
queuer.close()

批量启动实验

将实验启动命令放在项目目录下的 exp_plans/exp_demo/xxx.sh 文件中,每条命令之间用换行分割,示例如下:

CUDA_VISIBLE_DEVICES=0 python run.py \
    'lr=5e-2' \
    'max_epochs=1' \
    'lora_rank=512' \
    'lora_alpha=1024' 

CUDA_VISIBLE_DEVICES=0 python run.py \
    'lr=5e-3' \
    'max_epochs=1' \
    'lora_rank=1024' \
    'lora_alpha=2018' 

# 其他实验命令......

并在项目目录下运行以下命令:

xx

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

xspike-0.2.5.tar.gz (14.1 kB view details)

Uploaded Source

File details

Details for the file xspike-0.2.5.tar.gz.

File metadata

  • Download URL: xspike-0.2.5.tar.gz
  • Upload date:
  • Size: 14.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.9.13

File hashes

Hashes for xspike-0.2.5.tar.gz
Algorithm Hash digest
SHA256 27dcfbd8d86df797216acff27ac5db2a45e689d97840b02073b75d14c481e02a
MD5 64591e500e581ca3599bff75da620e5c
BLAKE2b-256 f7616d13fbe5a5a5cd53c2b9f8b56dcb417457f05bf84d6cbde1e422e6855b94

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page