A simple but handy Python library to save PyTorch datasets in safetensors format.
Project description
safetensors-dataset
safetensors-dataset
is a very simple and tiny package adding support to efficiently load and store Pytorch datasets in the safetensors file format:
import torch
from safetensors_dataset import SafetensorsDataset
dataset = SafetensorsDataset.from_dict({
"x": torch.randn(8, 12, 3),
"y": torch.randint(12, (8,))
})
dataset.save_to_file("test.safetensors")
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for safetensors_dataset-0.0.5rc4.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9ae5d41b61d3df569d71080be8444f5c56beb0a4fc74019c193aab48901189e5 |
|
MD5 | 8c1786466f5d05cd2721b6eb1247e867 |
|
BLAKE2b-256 | eeabdc105c654ee87af42c9a55332ffe015ac5122da366b31541bdde11dcbb6a |
Close
Hashes for safetensors_dataset-0.0.5rc4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 86531d11ae3f3b746f01e706683a479020d4a3c6c07b294f3380493a99942a80 |
|
MD5 | 08fad4d53632acf61d0858b920bb71d4 |
|
BLAKE2b-256 | fc93bda23ccced742fb15385ea0d2cf0b753c4ad9300af0c3bc502a575727282 |