A simple client library for setting up secure communication channels using Google Drive
Project description
Syft-client
Syft client lets data scientists submit computations which are ran by data owners on private data — all through cloud storage their organizations already use (Google Drive, Microsoft 365, etc.). No new infrastructure required.
Docs
- Workflow — End-to-end privacy-preserving data analysis workflow
- API Reference — All public client methods and properties
- Authentication & Setup — Google Cloud OAuth setup for local/Jupyter usage
- Background Services — Email notifications, auto-approval, and TUI dashboard
- Connections — How the Google Drive transport layer works
- Permissions - Permissions for syft-client
Features
- Privacy-preserving — Private data never leaves the data owner's machine; only approved results are shared
- Transport-agnostic — Works over Google Drive today, extensible to any file-based transport
- Offline-first — Full functionality even when peers are offline; changes sync when connectivity resumes
- Peer-to-peer with explicit auth — Data owners must approve each collaborator before any data flows
- Isolated job execution — Jobs run in sandboxed Python virtual environments with controlled access to private data
- Dataset sharing with mock/private separation — Data scientists explore mock data, then submit jobs that run on the real thing
Quick Start
uv pip install syft-client
import syft_client as sc
# Login (colab auth, for non-colab pass token_path)
do = sc.login_do(email="do@org.com")
ds = sc.login_ds(email="ds@org.com")
# Peer request & approve
ds.add_peer("do@org.com")
do.approve_peer_request("ds@org.com")
# Create & sync dataset
do.create_dataset(
name="census",
mock_path="mock.txt",
private_path="private.txt",
users=["ds@org.com"],
)
do.sync(); ds.sync()
datasets = ds.datasets.get_all()
Write an analysis.py that reads the dataset and produces a result in our case this is just the length of the data. Inside a job, resolve_dataset_file_path automatically resolves to the private data:
# analysis.py
import json
import syft_client as sc
data_path = sc.resolve_dataset_file_path("census")
with open(data_path, "r") as f:
data = f.read()
with open("outputs/result.json", "w") as f:
json.dump({"length": len(data)}, f)
Submit the job and retrieve results:
# Submit job
ds.submit_python_job(
user="do@org.com",
code_path="analysis.py",
)
ds.sync(); do.sync()
# Data owner Approves & runs job
do.jobs[0].approve()
do.process_approved_jobs(share_outputs_with_submitter=True)
do.sync(); ds.sync()
result = open(ds.jobs[-1].output_paths[0]).read()
Packages
| Package | Description |
|---|---|
syft-datasets |
Dataset management and sharing |
syft-job |
Job submission and execution |
syft-permissions |
Permission system for Syft datasites |
syft-perms |
User-facing permission API for Syft datasites |
syft-bg |
Background services TUI dashboard for SyftBox |
syft-notebook-ui |
Jupyter notebook display utilities |
Development
# Install in development mode
uv pip install -e .
# Run tests
just test-unit # Unit tests (fast, mocked)
just test-integration # Integration tests (slow, real API)
Built by OpenMined — building open-source technology for privacy-preserving data science and AI.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file syft_client-0.1.112.tar.gz.
File metadata
- Download URL: syft_client-0.1.112.tar.gz
- Upload date:
- Size: 112.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2640566dad207f3139f020cf8d7d0b9874615ad7fd48e118b926623821011e09
|
|
| MD5 |
d0f7a682665824b614afe0d694d68dae
|
|
| BLAKE2b-256 |
ac0a87dc894dd2ec621702aac3f9922cc29847d901571e033fb5d12fe5c68c3b
|
File details
Details for the file syft_client-0.1.112-py3-none-any.whl.
File metadata
- Download URL: syft_client-0.1.112-py3-none-any.whl
- Upload date:
- Size: 135.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
81a804ec5f57a374328853501709b078f1f83dde3dbb09c3e8086517665f8e04
|
|
| MD5 |
5b4f966a061176105002245877f062e5
|
|
| BLAKE2b-256 |
b321a65faffcd8703ab9fb082dec422739b3cadbf8a0ce3df767ccaaf87df8d3
|