Skip to main content

SnapFS Python client and CLI

Project description

SnapFS (Python Client)

SnapFS is a modern, scalable file indexing and metadata system designed for large-scale production environments such as VFX, animation, gaming, simulation, and machine learning pipelines.

This repository contains the Python client and CLI for interacting with a SnapFS gateway, including:

  • Directory scanning and metadata ingestion
  • Cache-aware incremental hashing
  • File queries
  • Gateway API access

SnapFS Python client communicates with a running SnapFS gateway and provides a simple domain-centric interface for querying files, snapshots, and related metadata.


Features (Current)

  • Async gateway client using aiohttp
  • Domain-focused Python API (snapfs.files, snapfs.snapshots, …)
  • Filesystem scanner with:
    • Incremental hashing
    • Cache probing
    • Rich metadata collection (mtime, ctime, owners, permissions, links, etc.)
    • Hardlink-aware disk usage (fsize_du)
  • CLI commands:
    • snapfs scan <path>
    • snapfs query "<SQL>"

Installation

pip install snapfs

or install from source:

pip install -e .

Quick Start

Scan a directory and publish metadata to the gateway:

snapfs scan /mnt/projects

Requirements

  • Python 3.8+
  • A running SnapFS gateway (for ingestion and querying)

Status

Early development.

APIs, schemas, and endpoints may evolve rapidly before the 1.0 release.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

snapfs-0.1.0.tar.gz (16.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

snapfs-0.1.0-py3-none-any.whl (18.7 kB view details)

Uploaded Python 3

File details

Details for the file snapfs-0.1.0.tar.gz.

File metadata

  • Download URL: snapfs-0.1.0.tar.gz
  • Upload date:
  • Size: 16.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.8.10

File hashes

Hashes for snapfs-0.1.0.tar.gz
Algorithm Hash digest
SHA256 80d667c856c57dbb2dc45320311daf02792ca7c117257e292b17c44585c6c81b
MD5 2644a3ce1520ac363115177b385c90f6
BLAKE2b-256 7d7bd4ce7d34b0c79e8406a759ce60be470bdcceec28b449f683b320b4f55461

See more details on using hashes here.

File details

Details for the file snapfs-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: snapfs-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 18.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.8.10

File hashes

Hashes for snapfs-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 28d626803d9cfda3400804d54e371384bcdd127aa50c55ef655e29224c266598
MD5 04f84260939fc7225a7da870f2a9ef24
BLAKE2b-256 90d8f8fe14c9406fabe0811b8de16439db1898a725f736b71fd004ba35f17819

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page