A simple but handy Python library to save PyTorch datasets in safetensors format.
Project description
safetensors-dataset
safetensors-dataset
is a very simple and tiny package adding support to efficiently load and store Pytorch datasets in the safetensors file format:
import torch
from safetensors_dataset import SafetensorsDataset
dataset = SafetensorsDataset.from_dict({
"x": torch.randn(8, 12, 3),
"y": torch.randint(12, (8,))
})
dataset.save_to_file("test.safetensors")
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for safetensors_dataset-0.0.5rc1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2580cd0d961a2af07ac6c7040de116c502cb9a1895d6ee53816c7ddab5298b8c |
|
MD5 | 71d7abeac1df84cad65e13a7877d19e6 |
|
BLAKE2b-256 | 5f8e422f69ccc2a930a9b351956b9a25edf1e031fff42c0883503c3fa5f4b0cb |
Close
Hashes for safetensors_dataset-0.0.5rc1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 82df39c3b59f7ca7c905c2779d5eeec5efbf79a56bb2696e98d0d1154882c22f |
|
MD5 | 33b6598f3d45483db6ff32b4347067d2 |
|
BLAKE2b-256 | 57bf72782d4f9c17d56000281f9950c7920805dbe8f51fbbbb78a368de168970 |