Skip to main content

safetensors-dataset

safetensors-dataset is a very simple and tiny package adding support to efficiently load and store Pytorch datasets in the safetensors file format:

import torch
from safetensors_dataset import SafetensorsDataset

dataset = SafetensorsDataset.from_dict({
    "x": torch.randn(8, 12, 3),
    "y": torch.randint(12, (8,))
})
dataset.save_to_file("test.safetensors")

Metadata

Release files for safetensors-dataset 0.0.11

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for safetensors-dataset 0.0.11
File Size Uploaded
safetensors_dataset-0.0.11.tar.gz 22.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for safetensors-dataset 0.0.11
File Interpreter ABI Platform
safetensors_dataset-0.0.11-py3-none-any.whl Python 3 none any Details

Total release size: 45.6 kB

Release files / safetensors_dataset-0.0.11.tar.gz

Download URL safetensors_dataset-0.0.11.tar.gz
Size 22.1 kB
Tags Source
SHA-256 checksum
How to use checksums
144ca2ade05db97a12faa551ea3664abb33c53d0c5a49b5a2eb98fd0e16881e7
BLAKE2b-256 checksum
How to use checksums
662de3dc49b441d3ba6b35506c541454c4d2252da0ec74c9f2dc7fe04b880d87
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.11.13

Release files / safetensors_dataset-0.0.11-py3-none-any.whl

Download URL safetensors_dataset-0.0.11-py3-none-any.whl
Size 23.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
1c0c59474dc9e8ae88f0ec606dd113fdb87c1ba82bef9abeea3c971bf8b72c39
BLAKE2b-256 checksum
How to use checksums
55d89bea9317643cc6ac2852960d8c4ebbd7c8c377604b09360e58725661e8c8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.11.13
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page