Skip to main content

Keys & Caches CLI (DEV)

Project description

Keys & Caches

Keys & Caches Banner

Welcome to Keys & Caches — the fastest way to run PyTorch models on cloud GPUs with automatic profiling and performance insights.


📚 Documentation Overview

This documentation will help you get started with Keys & Caches and make the most of its powerful features for GPU-accelerated machine learning.


What is Keys & Caches?

Keys & Caches is a command-line tool that makes it effortless to run PyTorch models on high-performance cloud GPUs. With just one command, you can:

  • 🚀 Submit jobs to cloud GPUs — Access A100, H100, and L4 GPUs instantly
  • 📊 Get automatic profiling — Detailed performance traces for every model forward pass
  • 🔍 Debug performance bottlenecks — Chrome trace format for visual analysis
  • Stream real-time logs — Watch your training progress live
  • 💰 Pay only for what you use — No idle time charges

Key Features

🎯 One-Command Deployment

cd examples
python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt

# Run any PyTorch script on cloud GPUs
kandc run python basic_models/simple_cnn.py

# Or capture locally with profiling
kandc capture python basic_models/simple_cnn.py

📈 Automatic Model Profiling

from kandc import capture_model_class

@capture_model_class(model_name="MyModel")
class MyModel(nn.Module):
    # Your model automatically gets profiled!

🎓 Students & Educators

  • Email us at founders@herdora.com for free credits!
  • Access high-end GPUs for coursework and research
  • Learn about model optimization with built-in profiling tools
  • Focus on ML concepts, not DevOps complexity

🚀 Startups & Small Teams

  • Get enterprise-grade GPU access without upfront costs
  • Scale compute resources based on actual needs
  • Streamline ML workflows from development to production

Ready to Get Started?

👉 Jump to the Getting Started Guide to install Keys & Caches and run your first GPU job in under 5 minutes!

📦 Publishing to PyPI

🚀 Publish Stable Release (kandc)

  1. Bump the version in pyproject.toml (e.g., 0.0.4).

  2. Run the following commands:

    rm -rf dist build *.egg-info
    python -m pip install --upgrade build twine
    python -m build
    export TWINE_USERNAME=__token__
    twine upload dist/*
    

🧪 Publish Dev Release (kandc-dev)

  1. Bump the dev version in pyproject.dev.toml (e.g., 0.0.4.dev1).

  2. Run the following commands:

    rm -rf dist build *.egg-info
    cp pyproject.dev.toml pyproject.toml
    python -m pip install --upgrade build twine
    python -m build
    export TWINE_USERNAME=__token__
    twine upload dist/*
    git checkout -- pyproject.toml   # Restore the original pyproject.toml after publishing (undo the cp above)
    

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kandc_dev-0.0.8.dev0.tar.gz (32.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

kandc_dev-0.0.8.dev0-py3-none-any.whl (33.0 kB view details)

Uploaded Python 3

File details

Details for the file kandc_dev-0.0.8.dev0.tar.gz.

File metadata

  • Download URL: kandc_dev-0.0.8.dev0.tar.gz
  • Upload date:
  • Size: 32.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.11

File hashes

Hashes for kandc_dev-0.0.8.dev0.tar.gz
Algorithm Hash digest
SHA256 128719c339637a6a9d8956c79ee40cd0388f45be03c6484727550eb6f3f3a1cf
MD5 bb21aac4a66e22067f5b9d6665cdef5f
BLAKE2b-256 f6ca21948f05f155ce370d8773f7be4031797e946f9606e6e7943d56011b0c07

See more details on using hashes here.

File details

Details for the file kandc_dev-0.0.8.dev0-py3-none-any.whl.

File metadata

  • Download URL: kandc_dev-0.0.8.dev0-py3-none-any.whl
  • Upload date:
  • Size: 33.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.11

File hashes

Hashes for kandc_dev-0.0.8.dev0-py3-none-any.whl
Algorithm Hash digest
SHA256 c90ccd4195b4554725b850875cff88b462d66240f9fc9d366256e024cf82f869
MD5 2b4889955da6fdee71d46f068886fd08
BLAKE2b-256 8aa1c47718a0a53ff610dec13a53e17ca43cd08a528bc169550b1a654f8d3384

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page