A simple but handy Python library to save PyTorch datasets in safetensors format.
Project description
safetensors-dataset
safetensors-dataset
is a very simple and tiny package adding support to efficiently load and store Pytorch datasets in the safetensors file format:
import torch
from safetensors_dataset import SafetensorsDataset
dataset = SafetensorsDataset.from_dict({
"x": torch.randn(8, 12, 3),
"y": torch.randint(12, (8,))
})
dataset.save_to_file("test.safetensors")
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for safetensors_dataset-0.0.5rc3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4f0dba90c06bf078c6be44ca95f2222975df951c0a1d5b193564f6947b568687 |
|
MD5 | e611699a7afbb106ac9cee67393b0c88 |
|
BLAKE2b-256 | 998a04e091bd31abca84b79de83a3cd5796874ca3a209a296c9944957bcc9cdf |
Close
Hashes for safetensors_dataset-0.0.5rc3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 752535ecb6f76b65da3c0acf731092940eee1193d0775f650aad439df830beb9 |
|
MD5 | 2585026d35930255c12ad457a9ebc78f |
|
BLAKE2b-256 | 61f079e4f2bb22d9a51cf65c04db210cb4c022f8b795325b673cde189d76228e |