A simple but handy Python library to save PyTorch datasets in safetensors format.
Project description
safetensors-dataset
safetensors-dataset
is a very simple and tiny package adding support to efficiently load and store Pytorch datasets in the safetensors file format:
import torch
from safetensors_dataset import SafetensorsDataset
dataset = SafetensorsDataset.from_dict({
"x": torch.randn(8, 12, 3),
"y": torch.randint(12, (8,))
})
dataset.save_to_file("test.safetensors")
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for safetensors_dataset-0.0.4rc1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | f7b156f4551c43e870bfe1bd4cdb189d5f11cd3034103b32eb6b19c06d42c69e |
|
MD5 | 47752d5d6898de189e80d38dbf3cf8c7 |
|
BLAKE2b-256 | a83b1b5e1cbd31d0f53e733a6d003568c8223db057d92995d28b9060291d6656 |
Close
Hashes for safetensors_dataset-0.0.4rc1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 73d22021fc3769bc3c5042c78dbc9944f512da6e5d6a1b92afd3cdcb5061e562 |
|
MD5 | 546a97c211d6f06f7a1a61d3a52f9859 |
|
BLAKE2b-256 | 0477a06dac8d3ec273d3640690c38f0f3488f7609ce5a9e7624a193b43fff13f |