Skip to main content

SnapFS Python client and CLI

Project description

SnapFS (Python Client)

SnapFS is a modern, scalable file indexing and metadata system designed for large-scale production environments such as VFX, animation, gaming, simulation, and machine learning pipelines.

This repository contains the Python client and CLI for interacting with a SnapFS gateway, including:

  • Directory scanning and metadata ingestion
  • Cache-aware incremental hashing
  • File queries
  • Gateway API access

SnapFS Python client communicates with a running SnapFS gateway and provides a simple domain-centric interface for querying files, snapshots, and related metadata.


Features (Current)

  • Async gateway client using aiohttp
  • Domain-focused Python API (snapfs.files, snapfs.events, …)
  • Filesystem scanner with:
    • Incremental hashing
    • Cache probing
    • Rich metadata collection (mtime, ctime, owners, permissions, links, etc.)
    • Hardlink-aware disk usage (fsize_du)
  • CLI commands:
    • snapfs scan <path>
    • snapfs query "<SQL>"

Installation

pip install snapfs

or install from source:

pip install -e .

Quick Start

Scan a directory and publish metadata to the gateway:

snapfs scan /mnt/projects

Requirements

  • Python 3.8+
  • A running SnapFS gateway (for ingestion and querying)

Status

Early development.

APIs, schemas, and endpoints may evolve rapidly before the 1.0 release.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

snapfs-0.2.0.tar.gz (17.3 kB view details)

Uploaded Source

File details

Details for the file snapfs-0.2.0.tar.gz.

File metadata

  • Download URL: snapfs-0.2.0.tar.gz
  • Upload date:
  • Size: 17.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.8.10

File hashes

Hashes for snapfs-0.2.0.tar.gz
Algorithm Hash digest
SHA256 3348937fa1371930d7feac965f438102340dfb98d581b50137742858ab1b6b06
MD5 649242d632938f78b081a4932b9da96d
BLAKE2b-256 a9eda7cf9b4b573eebe584928d1e6b3ce5d351aef7b3125d6364ad483669400b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page