Skip to main content

CLI and Python library to upload, download, and manage file transfers to/from H100 via Relay Server

Project description

DL CLI

Python library and CLI to upload, download, and manage file transfers to/from H100 via Relay Server.

Installation

# Full install (library + CLI)
pip install dl-cli[cli]

# Library only (no typer/rich)
pip install dl-cli

CLI Usage

# Configure
dl init
dl config --server-url http://your-server:8000 --transfer-url http://your-server:8001

# List remote files
dl ls /data/models -l

# Download
dl download /data/models/checkpoint.pt -o ./checkpoint.pt
dl download /data/models/checkpoint.pt --chunked       # large files
dl download /data/models/checkpoint.pt --resume <id>   # resume failed transfer

# Upload
dl upload ./model.pt /data/models/model.pt
dl upload-multi ./file1.pt ./file2.pt -d /data/models/

# Transfer management
dl transfers list
dl transfers status <transfer-id>
dl transfers cancel <transfer-id>

# Health check
dl health

Library Usage

from dl_cli import FileServiceClient, TransferServiceClient

# List files
fc = FileServiceClient()
entries = fc.list_directory("/data/models")

# Stream download
for resp, chunk in fc.download_stream("/data/models/file.pt"):
    ...

# Chunked upload via transfer service
tc = TransferServiceClient()
transfer = tc.init_upload("model.pt", "/data/models/model.pt", file_size=1024000)
tc.upload_chunk(transfer["transfer_id"], 0, data)
tc.commit_upload(transfer["transfer_id"])

Project Structure

dl_cli/
├── deployment/
│   ├── Dockerfile
│   └── deploy.sh
├── src/
│   └── dl_cli/
│       ├── __init__.py
│       ├── main.py
│       ├── client.py
│       ├── config.py
│       └── commands/
├── pyproject.toml
├── requirements.txt
└── README.md

Build & Publish

pip install build twine
python -m build
twine upload dist/*

Docker

./deployment/deploy.sh build
./deployment/deploy.sh rerun
docker run --rm dl-cli --help

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dl_cli_aiteam-1.0.1.tar.gz (11.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dl_cli_aiteam-1.0.1-py3-none-any.whl (14.2 kB view details)

Uploaded Python 3

File details

Details for the file dl_cli_aiteam-1.0.1.tar.gz.

File metadata

  • Download URL: dl_cli_aiteam-1.0.1.tar.gz
  • Upload date:
  • Size: 11.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for dl_cli_aiteam-1.0.1.tar.gz
Algorithm Hash digest
SHA256 fa913634355feb90fee896579e991a379e2114bf2f04d33e69d30e663f5951a2
MD5 c228f57a1ae83991c9f339e314d900cc
BLAKE2b-256 325d7cd0fb2bf0a4f493f30764cdd643f22b47bd2f1d78a6ede5f63251801bd6

See more details on using hashes here.

File details

Details for the file dl_cli_aiteam-1.0.1-py3-none-any.whl.

File metadata

  • Download URL: dl_cli_aiteam-1.0.1-py3-none-any.whl
  • Upload date:
  • Size: 14.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for dl_cli_aiteam-1.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 5f0f97fc0056002342ccbfb7d0345c20b4a268ade50920632f7f64af9b165a76
MD5 0810ed9d65ec8d88f04a50b1931de626
BLAKE2b-256 dabc0f3dc357a9ec5b762f1d34a12b2167083804e82eaf5d7a21d55b83c86af0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page