SnapFS Python client and CLI
Project description
SnapFS (Python Client)
SnapFS is a modern, scalable file indexing and metadata system designed for large-scale production environments such as VFX, animation, gaming, simulation, and machine learning pipelines.
This repository contains the Python client and CLI for interacting with a SnapFS gateway, including:
- Directory scanning and metadata ingestion
- Cache-aware incremental hashing
- File queries
- Gateway API access
SnapFS Python client communicates with a running SnapFS gateway and provides a simple domain-centric interface for querying files, snapshots, and related metadata.
Features (Current)
- Async gateway client using
aiohttp - Domain-focused Python API (
snapfs.files,snapfs.events, …) - Filesystem scanner with:
- Incremental hashing
- Cache probing
- Rich metadata collection (mtime, ctime, owners, permissions, links, etc.)
- Hardlink-aware disk usage (
fsize_du)
- CLI commands:
snapfs scan <path>snapfs query "<SQL>"
Installation
pip install snapfs
or install from source:
pip install -e .
Quick Start
Scan a directory and publish metadata to the gateway:
snapfs scan /mnt/projects
Requirements
- Python 3.8+
- A running SnapFS gateway (for ingestion and querying)
Status
Early development.
APIs, schemas, and endpoints may evolve rapidly before the 1.0 release.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file snapfs-0.2.0.tar.gz.
File metadata
- Download URL: snapfs-0.2.0.tar.gz
- Upload date:
- Size: 17.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.8.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3348937fa1371930d7feac965f438102340dfb98d581b50137742858ab1b6b06
|
|
| MD5 |
649242d632938f78b081a4932b9da96d
|
|
| BLAKE2b-256 |
a9eda7cf9b4b573eebe584928d1e6b3ce5d351aef7b3125d6364ad483669400b
|