VaultLayer
Your long GPU training run finishes, no matter what kills it. VaultLayer checkpoints your job to object storage, watches the machine, and when it dies, resumes from the last good checkpoint on fresh capacity.
pip install -U vaultlayer
vl init
vl run train.py
Job submitted
Training on vast_ai
Training output:
...
Training completed successfully.
What It Does
VaultLayer sits between your training script and the GPUs. It:
- Checkpoints on a schedule — saves model and optimizer state to Cloudflare R2 on a timer you can tune, plus an emergency save when the provider sends a termination notice
- Detects a dead or dying machine — watches for lost heartbeats and provider termination notices, and fences the old instance so it can't overwrite the new one
- Resumes on fresh capacity — provisions a replacement on the same provider or a different one and resumes from the last good checkpoint
- Bills from one prepaid account — provider cost plus a flat platform fee, across the providers below
No checkpoint code to write. Hugging Face Trainer scripts work as they are; for a
plain PyTorch or JAX training loop, vl run proposes a small checkpoint
integration, shows you the diff, and asks before changing anything. No YAML configs.
Commands
# Training
vl run train.py
vl ps
vl logs <job-id> --follow
vl stop <job-id>
# Dataset storage (no S3 required)
vl sync ./data --dataset-id my-dataset
vl run --data r2://my-dataset train.py
vl datasets
Supported Providers
| Provider | Status |
|---|---|
| Vast.ai | Available |
| RunPod | Available |
| Lambda Labs | Available |
| AWS (Spot and On-Demand) | Available |
| Nebius (EU), Voltage Park, Hyperstack | In testing |
| GCP, CoreWeave, Crusoe, Azure | Not yet available |
Generally available for single-GPU jobs today; multi-GPU is in limited testing.
Model Size Support
| Model Size | Method | Checkpoint Size | Status |
|---|---|---|---|
| 1B | QLoRA | small | Validated smoke path |
| 3B | QLoRA | small | Validated matrix path |
| 7B | QLoRA | medium | Validated matrix path |
| 72B | QLoRA | large | Validated: a 28 GPU-hour single-GPU run completed |
| Full fine-tune / multi-GPU | varies | varies | Future work |
SLA
VaultLayer tracks job completion, checkpoint persistence, and resume behavior. Public SLA numbers are not committed during beta.
Dataset Storage (No S3 Required)
VaultLayer's Neutral Zone (Cloudflare R2) is a first-class storage provider. Users with no AWS or cloud storage account can upload training data directly and train from it on any provider.
# Upload from your laptop / on-prem server
vl sync ./training-data --dataset-id my-dataset
# Train — data is unpacked to $VAULTLAYER_LOCAL_DATA (./data beside your script)
vl run --data r2://my-dataset train.py
# See what you're storing and the monthly cost
vl datasets
Pricing:
| Action | Cost |
|---|---|
| Upload (local → R2) | Free |
| Storage | $0.020 / GB / month ($0.0195 — 30% markup over Cloudflare R2 base rate) |
| Read (R2 → training node) | $0.00 (zero egress within Cloudflare network) |
| S3 mirror (one-time) | AWS egress charge (~$0.09/GB, first 100 GB/month free) |
Storage quotas by plan:
| Plan | Storage limit |
|---|---|
| Free | 10 GB |
| Pro | 500 GB |
| Enterprise | Unlimited |
Datasets are soft-deleted with vl datasets --delete <id> — billing stops immediately,
R2 objects are purged within 24 hours.
Getting Started
pip install -U vaultlayer
vl init
vl run train.py
License
Private — © 2026 VaultLayer
Metadata
Release files for vaultlayer 0.1.84
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| vaultlayer-0.1.84.tar.gz | 3.3 MB | With provenance | Details for vaultlayer-0.1.84.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| vaultlayer-0.1.84-py3-none-any.whl | Python 3 | none | any | Details for vaultlayer-0.1.84-py3-none-any.whl |
Total release size: 5.1 MB
Release files / vaultlayer-0.1.84.tar.gz
| Download URL | vaultlayer-0.1.84.tar.gz |
|---|---|
| Size | 3.3 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
a2f0372a2eeafc16dd49606a3cce0a5d628efa685c9aa12ce889d65a317bf5e6
|
|
BLAKE2b-256 checksum How to use checksums |
d24d4b0e9178b181d0435fc55f7ba0c6b1e93fa109c0895f3d15735509a53627
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 27, 2026.
Transparency logRelease files / vaultlayer-0.1.84-py3-none-any.whl
| Download URL | vaultlayer-0.1.84-py3-none-any.whl |
|---|---|
| Size | 1.8 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
eb815f644fdef344e2aaafd4750130e466da7c09992ecbcbc317eb6982bf497c
|
|
BLAKE2b-256 checksum How to use checksums |
554217baeb411a17ef67fef809ac0f7a381d50683d21e36457d39d0d36d86588
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 27, 2026.
Transparency logSecurity for vaultlayer 0.1.84
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
Full provenance
Both files in this release have been uploaded with provenance metadata.
Attestation for vaultlayer-0.1.84.tar.gz
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 27, 2026.
Transparency logA note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.