Python SDK for Torq distributed GPU job queue (coming soon)
Project description
Torq Client SDK
Python SDK for submitting jobs to Torq distributed GPU queue.
Status: Coming Soon
Overview
Simple SDK to submit LLM inference jobs to Torq and retrieve results.
Features (planned)
- Async/sync job submission
- Batch job support
- Priority queuing
- Result polling and callbacks
- Automatic retries
Quick Start
from torq_client import TorqClient
client = TorqClient("https://torq.muid.io")
job = client.submit(model="llama3", prompt="Hello!")
result = job.wait()
Installation
pip install torq-client-sdk
Links
- Main site: https://torq.muid.io
- Documentation: https://torq.muid.io/docs
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
torq_client_sdk-0.0.1.tar.gz
(1.2 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file torq_client_sdk-0.0.1.tar.gz.
File metadata
- Download URL: torq_client_sdk-0.0.1.tar.gz
- Upload date:
- Size: 1.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0db4199fc2dff3f2c76d54838aabfd2d9aa968e0042e95af66400d8de0e8788f
|
|
| MD5 |
22c64ed02ef169b8538151ea179025ce
|
|
| BLAKE2b-256 |
967ad575643276bfc58592a38de2958c1e70f6b817e287cf3970fc9fb1e4583f
|
File details
Details for the file torq_client_sdk-0.0.1-py3-none-any.whl.
File metadata
- Download URL: torq_client_sdk-0.0.1-py3-none-any.whl
- Upload date:
- Size: 1.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
15b80b82de33f880cacf630e74e30d32a80f377c1dc6e1569ac61ca6a52b690d
|
|
| MD5 |
f71378940a0d3a8b95602ebf3d8ded65
|
|
| BLAKE2b-256 |
31fd11188d57d57404e2744392ecb126e582ebcb244b125e78ff34f435ac930d
|
