Skip to main content

SnapFS Python client and CLI

Project description

SnapFS (Python Client)

SnapFS is a modern, scalable file indexing and metadata system designed for large-scale production environments such as VFX, animation, gaming, simulation, and machine learning pipelines.

This repository contains the Python client and CLI for interacting with a SnapFS gateway, including:

  • Directory scanning and metadata ingestion
  • Cache-aware incremental hashing
  • File queries
  • Gateway API access

SnapFS Python client communicates with a running SnapFS gateway and provides a simple domain-centric interface for querying files, snapshots, and related metadata.


Features (Current)

  • Async gateway client using aiohttp
  • Domain-focused Python API (snapfs.files, snapfs.events, …)
  • Filesystem scanner with:
    • Incremental hashing
    • Cache probing
    • Rich metadata collection (mtime, ctime, owners, permissions, links, etc.)
    • Hardlink-aware disk usage (fsize_du)
  • CLI commands:
    • snapfs scan <path>
    • snapfs query "<SQL>"

Installation

pip install snapfs

or install from source:

pip install -e .

Quick Start

Scan a directory and publish metadata to the gateway:

snapfs scan /mnt/projects

Requirements

  • Python 3.8+
  • A running SnapFS gateway (for ingestion and querying)

Status

Early development.

APIs, schemas, and endpoints may evolve rapidly before the 1.0 release.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

snapfs-0.2.1.tar.gz (19.3 kB view details)

Uploaded Source

File details

Details for the file snapfs-0.2.1.tar.gz.

File metadata

  • Download URL: snapfs-0.2.1.tar.gz
  • Upload date:
  • Size: 19.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.8.10

File hashes

Hashes for snapfs-0.2.1.tar.gz
Algorithm Hash digest
SHA256 0a153a113f2e8047580637e4e4d47c1ee6383a95fca1e21ee27382c817de3d27
MD5 021105d189b51f81451a82eab722c496
BLAKE2b-256 0d6172f5bbbbd5383b3eb9b10f6b460ced4aee85a33e93327cf542ce4e4f13df

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page