Skip to main content

CLI and Python library to upload, download, and manage file transfers to/from H100 via Relay Server

Project description

DL CLI

Python library and CLI to upload, download, and manage file transfers to/from H100 via Relay Server.

Installation

# Full install (library + CLI)
pip install dl-cli[cli]

# Library only (no typer/rich)
pip install dl-cli

CLI Usage

# Configure
dl init
dl config --server-url http://your-server:8000 --transfer-url http://your-server:8001

# List remote files
dl ls /data/models -l

# Download
dl download /data/models/checkpoint.pt -o ./checkpoint.pt
dl download /data/models/checkpoint.pt --chunked       # large files
dl download /data/models/checkpoint.pt --resume <id>   # resume failed transfer

# Upload
dl upload ./model.pt /data/models/model.pt
dl upload-multi ./file1.pt ./file2.pt -d /data/models/

# Transfer management
dl transfers list
dl transfers status <transfer-id>
dl transfers cancel <transfer-id>

# Health check
dl health

Library Usage

from dl_cli import FileServiceClient, TransferServiceClient

# List files
fc = FileServiceClient()
entries = fc.list_directory("/data/models")

# Stream download
for resp, chunk in fc.download_stream("/data/models/file.pt"):
    ...

# Chunked upload via transfer service
tc = TransferServiceClient()
transfer = tc.init_upload("model.pt", "/data/models/model.pt", file_size=1024000)
tc.upload_chunk(transfer["transfer_id"], 0, data)
tc.commit_upload(transfer["transfer_id"])

Project Structure

dl_cli/
├── deployment/
│   ├── Dockerfile
│   └── deploy.sh
├── src/
│   └── dl_cli/
│       ├── __init__.py
│       ├── main.py
│       ├── client.py
│       ├── config.py
│       └── commands/
├── pyproject.toml
├── requirements.txt
└── README.md

Build & Publish

pip install build twine
python -m build
twine upload dist/*

Docker

./deployment/deploy.sh build
./deployment/deploy.sh rerun
docker run --rm dl-cli --help

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dl_cli_aiteam-1.0.0.tar.gz (11.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dl_cli_aiteam-1.0.0-py3-none-any.whl (14.3 kB view details)

Uploaded Python 3

File details

Details for the file dl_cli_aiteam-1.0.0.tar.gz.

File metadata

  • Download URL: dl_cli_aiteam-1.0.0.tar.gz
  • Upload date:
  • Size: 11.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for dl_cli_aiteam-1.0.0.tar.gz
Algorithm Hash digest
SHA256 a2a94a5828490ac17b65c98fbc0028e38707db423be67a1067d2e994072d82c8
MD5 7d7c933ec150737e772fad0b286858fe
BLAKE2b-256 7a8d22956797ccf10a94d47eaeb3c8f15f60eee444112515faf864c4f35e6fdb

See more details on using hashes here.

File details

Details for the file dl_cli_aiteam-1.0.0-py3-none-any.whl.

File metadata

  • Download URL: dl_cli_aiteam-1.0.0-py3-none-any.whl
  • Upload date:
  • Size: 14.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for dl_cli_aiteam-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 9055ce215c7ab2b48abaaf1f04ccbb1fe7906e90ee13af98b6ab92b593f781da
MD5 2e273ad5f51a88975a74f0a11340462c
BLAKE2b-256 09a5047479ce427540799531d46ca9e52af0b83350c16b380762677a4e726409

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page