Skip to main content

工具包,包含 Redis 安装、基于 Redis 的GPU 任务队列管理等功能

Project description

安装

pip install xspike

安装 Redis

在终端中输入以下命令后,根据提示安装 Redis 并启动 Redis 数据维护服务:

xspike

GPU 自动选择、排队

import xspike as x

queuer = x.GPUQueuer()

# Start the queuer
queuer.start()

# Your code here

# Stop the queuer
queuer.close()

批量启动实验

将实验启动命令放在项目目录下的 exp_plans/exp_demo/xxx.sh 文件中,每条命令之间用换行分割,示例如下:

CUDA_VISIBLE_DEVICES=0 python run.py \
    'lr=5e-2' \
    'max_epochs=1' \
    'lora_rank=512' \
    'lora_alpha=1024' 

CUDA_VISIBLE_DEVICES=0 python run.py \
    'lr=5e-3' \
    'max_epochs=1' \
    'lora_rank=1024' \
    'lora_alpha=2018' 

# 其他实验命令......

并在项目目录下运行以下命令:

xx

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

xspike-0.1.8.tar.gz (11.8 kB view details)

Uploaded Source

File details

Details for the file xspike-0.1.8.tar.gz.

File metadata

  • Download URL: xspike-0.1.8.tar.gz
  • Upload date:
  • Size: 11.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.9.13

File hashes

Hashes for xspike-0.1.8.tar.gz
Algorithm Hash digest
SHA256 22d0ec6f71241aba06d9b816a2fbc543ffde38581edd5c5a264af83a06fe1227
MD5 a657759247868ede953dcc4eee9f8a84
BLAKE2b-256 5fb9ba0af1a4ddb89ef2199d9bb552bca648390a63dffc2fd5b05777bd252a30

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page