Skip to main content

MinIO git filter for Peagen

Project description

Swarmauri Logo

PyPI - Downloads Hits PyPI - Python Version PyPI - License PyPI - swarmauri_gitfilter_minio


Swarmauri Git Filter Minio

swarmauri_gitfilter_minio packages the MinioFilter plugin used by peagen and other Swarmauri tooling to keep large Git objects in MinIO (or any S3-compatible) storage instead of the local repository. The filter implements both StorageAdapterBase and GitFilterBase, so you can call it directly from Python code or register it as a Git clean/smudge filter.

Highlights

  • Accepts minio:// (HTTP) and minios:// (HTTPS) URIs and automatically ensures the referenced bucket exists.
  • Inherits GitFilterBase, giving you clean and smudge helpers that hash content, upload it to remote storage, and hydrate it back into your working tree on checkout.
  • Provides convenience methods such as upload_dir, iter_prefix, and download_prefix for whole directory trees in addition to single-file transfers.
  • Surfaces a root_uri property that reflects the bucket and optional prefix derived from the connection string.

Installation

Choose the workflow that matches your project:

# pip
pip install swarmauri_gitfilter_minio

# Poetry
poetry add swarmauri_gitfilter_minio

# uv
uv add swarmauri_gitfilter_minio

Configuration

MinioFilter.from_uri() consults peagen.toml for credentials under [storage.filters.minio] and falls back to the MINIO_ACCESS_KEY and MINIO_SECRET_KEY environment variables when the configuration is absent. When instantiated, the filter lazily creates the bucket identified by the URI and stores objects beneath an optional prefix.

Usage

from swarmauri_gitfilter_minio import MinioFilter

# Create a filter from a connection string. The scheme `minios://` will use
# HTTPS while `minio://` uses plain HTTP.
filt = MinioFilter.from_uri("minio://localhost:9000/my-bucket/prefix")

# Upload a file and retrieve its URI
with open("README.md", "rb") as fh:
    uri = filt.upload("docs/README.md", fh)

# Download the file back into memory
buffer = filt.download("docs/README.md")
data = buffer.read()

MinioFilter also exposes helpers such as upload_dir, iter_prefix, and download_prefix for working with entire directory trees.

Want to help?

If you want to contribute to swarmauri-sdk, read up on our guidelines for contributing that will help you get started.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

swarmauri_gitfilter_minio-0.3.0.dev34.tar.gz (9.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

swarmauri_gitfilter_minio-0.3.0.dev34-py3-none-any.whl (10.2 kB view details)

Uploaded Python 3

File details

Details for the file swarmauri_gitfilter_minio-0.3.0.dev34.tar.gz.

File metadata

  • Download URL: swarmauri_gitfilter_minio-0.3.0.dev34.tar.gz
  • Upload date:
  • Size: 9.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.3 {"installer":{"name":"uv","version":"0.10.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for swarmauri_gitfilter_minio-0.3.0.dev34.tar.gz
Algorithm Hash digest
SHA256 1ccf9c1d73fe91d0c56795adece74b8911eb8c100c4b9470458736e7fe639459
MD5 fb5a5114037a062fb7d4509158ea8074
BLAKE2b-256 4923f437b5664a96c34d4bfa03f4676bd71ba2577b100721a5c75d3b38f4730b

See more details on using hashes here.

File details

Details for the file swarmauri_gitfilter_minio-0.3.0.dev34-py3-none-any.whl.

File metadata

  • Download URL: swarmauri_gitfilter_minio-0.3.0.dev34-py3-none-any.whl
  • Upload date:
  • Size: 10.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.3 {"installer":{"name":"uv","version":"0.10.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for swarmauri_gitfilter_minio-0.3.0.dev34-py3-none-any.whl
Algorithm Hash digest
SHA256 663d6a25854e2c94f20080db12f3670ed42c6e2aa8c07731c2dda68f0851b020
MD5 cd7825c5d3e9078227a9f443f3dcd5b8
BLAKE2b-256 e73374cbe56e8e4e770ea97038e7ee170360f703cedcf1fc5ec42bceff6d45ad

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page