Skip to main content

MinIO git filter for Peagen

Project description

Swarmauri Logo

PyPI - Downloads Hits PyPI - Python Version PyPI - License PyPI - swarmauri_gitfilter_minio


Swarmauri Git Filter Minio

swarmauri_gitfilter_minio packages the MinioFilter plugin used by peagen and other Swarmauri tooling to keep large Git objects in MinIO (or any S3-compatible) storage instead of the local repository. The filter implements both StorageAdapterBase and GitFilterBase, so you can call it directly from Python code or register it as a Git clean/smudge filter.

Highlights

  • Accepts minio:// (HTTP) and minios:// (HTTPS) URIs and automatically ensures the referenced bucket exists.
  • Inherits GitFilterBase, giving you clean and smudge helpers that hash content, upload it to remote storage, and hydrate it back into your working tree on checkout.
  • Provides convenience methods such as upload_dir, iter_prefix, and download_prefix for whole directory trees in addition to single-file transfers.
  • Surfaces a root_uri property that reflects the bucket and optional prefix derived from the connection string.

Installation

Choose the workflow that matches your project:

# pip
pip install swarmauri_gitfilter_minio

# Poetry
poetry add swarmauri_gitfilter_minio

# uv
uv add swarmauri_gitfilter_minio

Configuration

MinioFilter.from_uri() consults peagen.toml for credentials under [storage.filters.minio] and falls back to the MINIO_ACCESS_KEY and MINIO_SECRET_KEY environment variables when the configuration is absent. When instantiated, the filter lazily creates the bucket identified by the URI and stores objects beneath an optional prefix.

Usage

from swarmauri_gitfilter_minio import MinioFilter

# Create a filter from a connection string. The scheme `minios://` will use
# HTTPS while `minio://` uses plain HTTP.
filt = MinioFilter.from_uri("minio://localhost:9000/my-bucket/prefix")

# Upload a file and retrieve its URI
with open("README.md", "rb") as fh:
    uri = filt.upload("docs/README.md", fh)

# Download the file back into memory
buffer = filt.download("docs/README.md")
data = buffer.read()

MinioFilter also exposes helpers such as upload_dir, iter_prefix, and download_prefix for working with entire directory trees.

Want to help?

If you want to contribute to swarmauri-sdk, read up on our guidelines for contributing that will help you get started.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

swarmauri_gitfilter_minio-0.3.0.dev41.tar.gz (9.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file swarmauri_gitfilter_minio-0.3.0.dev41.tar.gz.

File metadata

  • Download URL: swarmauri_gitfilter_minio-0.3.0.dev41.tar.gz
  • Upload date:
  • Size: 9.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.8 {"installer":{"name":"uv","version":"0.10.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for swarmauri_gitfilter_minio-0.3.0.dev41.tar.gz
Algorithm Hash digest
SHA256 bf5e0bbc308e471cb34c71c4f21b395df43325ca435a81b7d6ca9aca2e68c0f3
MD5 926eaf031d7bc70208beb4c253ed69bc
BLAKE2b-256 0260db399d353af7856725fbe15012775e5214cf4c26a9c05ddab49a54261bca

See more details on using hashes here.

File details

Details for the file swarmauri_gitfilter_minio-0.3.0.dev41-py3-none-any.whl.

File metadata

  • Download URL: swarmauri_gitfilter_minio-0.3.0.dev41-py3-none-any.whl
  • Upload date:
  • Size: 10.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.8 {"installer":{"name":"uv","version":"0.10.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for swarmauri_gitfilter_minio-0.3.0.dev41-py3-none-any.whl
Algorithm Hash digest
SHA256 784a3c3cfcee1df771e3bc497eaf805fbfd372fce1d97f8da9ee2cf51f9c885c
MD5 c4d1d76ee829c4ea61925c5668b80edb
BLAKE2b-256 814480f57b6bce198261472c682e9c264259b84bf808bd21555aa40370186419

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page