Skip to main content

工具包,包含 Redis 安装、基于 Redis 的GPU 任务队列管理等功能

Project description

安装

pip install xspike

安装 Redis

在终端中输入以下命令后,根据提示安装 Redis 并启动 Redis 数据维护服务:

xspike

GPU 自动选择、排队

import xspike as x

queuer = x.GPUQueuer()

# Start the queuer
queuer.start()

# Your code here

# Stop the queuer
queuer.close()

批量启动实验

将实验启动命令放在项目目录下的 exp_plans/exp_demo/xxx.sh 文件中,每条命令之间用换行分割,示例如下:

CUDA_VISIBLE_DEVICES=0 python run.py \
    'lr=5e-2' \
    'max_epochs=1' \
    'lora_rank=512' \
    'lora_alpha=1024' 

CUDA_VISIBLE_DEVICES=0 python run.py \
    'lr=5e-3' \
    'max_epochs=1' \
    'lora_rank=1024' \
    'lora_alpha=2018' 

# 其他实验命令......

并在项目目录下运行以下命令:

xx

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

xspike-0.1.7.tar.gz (11.7 kB view details)

Uploaded Source

File details

Details for the file xspike-0.1.7.tar.gz.

File metadata

  • Download URL: xspike-0.1.7.tar.gz
  • Upload date:
  • Size: 11.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.9.13

File hashes

Hashes for xspike-0.1.7.tar.gz
Algorithm Hash digest
SHA256 671eae985b1b0def1993db07106e725872ef4b1527c306edfdb6ae2410d79ed5
MD5 5332cc67ef9dc473abb6114af4e05232
BLAKE2b-256 71a71eaa06c8c7ca0ce30d4e74992c1c8728c12937c8b8b07e55f3f5946af1ae

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page