🤝 Trade any tensors over the network
Project description
TensorShare
🤝 Trade any tensors over the network
TensorShare is a powerful tool enabling ⚡ lightning-fast tensor sharing across networks.
This project leverage the best open-source tools to provide a simple and easy-to-use interface for sharing tensors:
- safetensors for secure tensor serialization and deserialization.
- pydantic for data validation and settings management.
- fastapi for building APIs (and because it's too good to avoid it).
This project is heavily in development and is not ready for production use. Feel free to contribute to the project by opening issues and pull requests.
Usage
Example of tensors serialization with torch:
import torch
from tensorshare import TensorShare
tensors = {
"embeddings": torch.zeros((2, 2)),
"labels": torch.zeros((2, 2)),
}
ts = TensorShare.from_dict(tensors, backend="torch")
For more examples and details, please refer to the documentation.
Roadmap
- Serialization and deserialization
- TensorProcessor for processing tensors
- Pydantic schema for sharing tensors
- Server for sharing tensors
- Client for sharing tensors
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
tensorshare-0.0.5.tar.gz
(14.3 kB
view details)