Use safetensors with ONNX
Project description
onnx-safetensors
ONNX extension for saving to and loading from safetensors 🤗.
Install
pip install --upgrade onnx-safetensors
Usage
Load tensors to an ONNX model
import onnx_safetensors
# Provide your ONNX model here
model: onnx.ModelProto
tensor_file = "model.safetensors"
# Apply weights from the safetensors file to the model
onnx_safetensors.load_file(model, tensor_file)
Save weights to a safetensors file
import onnx_safetensors
# Provide your ONNX model here
model: onnx.ModelProto
tensor_file = "model.safetensors"
# Save weights from to the safetensors file
onnx_safetensors.save_file(model, tensor_file, convert_attributes=True)
# Save weights from to the safetensors file and clear the raw_data fields of the ONNX model to reduce its size
# model will be updated inplace
onnx_safetensors.save_file(model, tensor_file, convert_attributes=True, strip_data=True)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
onnx-safetensors-0.1.1.tar.gz
(7.7 kB
view hashes)
Built Distribution
Close
Hashes for onnx_safetensors-0.1.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e6456595859678fe0aef9d2c13d900f799cf229f455558cd95c13c82f05ac44f |
|
MD5 | 9c13be39ef9d94deb7da1ad64eb477ed |
|
BLAKE2b-256 | b8f4447ebf56eed958ff01799f53bb49c64f18d75863f2b52e06c91f9d332d89 |