Skip to main content

Reusable persistence and repository toolkit

Project description

persistence-kit

Reusable persistence toolkit with async repository implementations for:

  • memory
  • mongo (Motor)
  • postgres (SQLAlchemy async + asyncpg)

Documentation:

  • docs/repositories_and_relations.md

Author: Andres Felipe Serrano Barrios

Package Structure

persistence_kit is organized by responsibility:

  • contracts/: repository interfaces
  • settings/: shared settings, parsers, and persistence constants
  • api/: reusable API exceptions, handlers, and route loading helpers
  • bootstrap/: startup helpers, configuration registry, and seed orchestration
  • utils/: transversal helpers such as upsert utilities
  • repository/: concrete repository implementations by backend
  • repository_factory/: entity registry, repository creation, and populated view repository

Recommended rule:

  • import from persistence_kit when the public facade is enough
  • import from the internal folders only when you need an implementation-specific module

Installation

pip install persistence-kit

Quick Start

from persistence_kit import Database
from persistence_kit.repository_factory import get_repo, register_entity

# register entities during application startup
register_entity(
    "user",
    {
        "entity": User,
        "collection": "users",
        "database": Database.MEMORY,
        "unique": {"email": "email"},
    },
)

repo = get_repo("user")

Public API

Preferred public imports:

from persistence_kit import (
    Repository,
    ViewRepository,
    RepoSettings,
    Database,
    ConfigRegistry,
    configuration,
    SeederProvider,
    build_api_router,
    handle_service_errors,
    handle_repository_errors,
    NotFoundException,
    ValidationException,
    BusinessRuleException,
    DatabaseException,
)
from persistence_kit.repository_factory import (
    register_entity,
    get_repo,
    get_repo_view,
    provide_repo,
    provide_view_repo,
    set_registry_initializer,
)

Use internal paths only for implementation details, for example:

  • persistence_kit.repository.sqlalchemy_repo.sqlalchemy_repo
  • persistence_kit.repository_factory.factory.repository_factory
  • persistence_kit.repository_factory.registry.entity_registry
  • persistence_kit.repository_factory.view.populating_repository

Typical Host Application Flow

  1. Define your entities as dataclasses.
  2. Register them in a local bootstrap such as register_defaults.
  3. Call set_registry_initializer(register_defaults) during application startup.
  4. Resolve repositories through get_repo(...), get_repo_view(...), or FastAPI providers.
  5. Use ConfigRegistry and SeederProvider only as shared bootstrap infrastructure. The concrete registrations remain in the host app.

Supported Environment Variables

  • REPO_DATABASE=memory|mongo|postgres
  • MONGO_DSN
  • MONGO_DB
  • POSTGRES_USER
  • POSTGRES_PASSWORD
  • POSTGRES_HOST
  • POSTGRES_PORT
  • POSTGRES_DB

Local Development

Create the local environment and run tests from the library root:

poetry lock
poetry install --with dev
poetry run pytest -q

Current validation baseline:

  • persistence_kit: 138 passed

Publish to PyPI (Manual)

python -m pip install --upgrade build twine
python -m build
python -m twine check dist/*
python -m twine upload dist/*

Automated Publish via GitHub Actions

This repository includes a workflow at .github/workflows/publish-pypi.yml.

It publishes to PyPI when:

  • a GitHub Release is published
  • the release tag points to the current main HEAD

Prerequisite:

  • Configure PyPI Trusted Publishing for this repository and workflow file.

Preview Releases Without PRs

Use .github/workflows/publish-preview.yml to publish directly from GitHub Actions without merging a PR.

How it works:

  • Trigger Publish Preview Package manually from the Actions tab.
  • Enter a version (for example 0.1.1.dev1 or 0.1.2.dev1).
  • Choose target repository: testpypi (recommended) or pypi.
  • The workflow patches pyproject.toml version only inside the CI run, builds, and publishes.
  • No commit and no PR are required for this preview publish flow.

Important:

  • Prefer *.devN versions for preview builds.
  • PyPI/TestPyPI do not allow re-uploading the same file version.

Local Test Releases (No PR Required)

If you want to test changes from your machine in external projects without opening a PR, publish a prerelease from local code to TestPyPI.

1. Create a TestPyPI token

  • Create an API token in TestPyPI.
  • Export it as environment variable:
export TWINE_PASSWORD="pypi-***"

2. Publish from local code

bash ./scripts/publish-local.sh 0.1.1.dev1 testpypi

You can publish another local iteration with a new version:

bash ./scripts/publish-local.sh 0.1.1.dev2 testpypi

3. Install from external projects

pip install --index-url https://test.pypi.org/simple/ --extra-index-url https://pypi.org/simple persistence-kit==0.1.1.dev1

Recommended Release Strategy

  • Local experimental testing: publish 0.x.y.devN to TestPyPI from local machine.
  • Official release: publish 0.x.y to PyPI through GitHub Release (publish-pypi.yml).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

persistence_kit-3.0.1.tar.gz (24.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

persistence_kit-3.0.1-py3-none-any.whl (39.3 kB view details)

Uploaded Python 3

File details

Details for the file persistence_kit-3.0.1.tar.gz.

File metadata

  • Download URL: persistence_kit-3.0.1.tar.gz
  • Upload date:
  • Size: 24.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for persistence_kit-3.0.1.tar.gz
Algorithm Hash digest
SHA256 de2cfe6afd5dd47205138e605730598723bb19bf919b3ed6dd9c5962f1f7d2de
MD5 cefd013f737cdb6d6bbd78d6495dc1fe
BLAKE2b-256 8a7f113b685fc6e864cc3e7c52d29fc0d29092791cdfbdace519d554695ade66

See more details on using hashes here.

Provenance

The following attestation bundles were made for persistence_kit-3.0.1.tar.gz:

Publisher: publish-pypi.yml on AndresFSerrano/persistence-kit

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file persistence_kit-3.0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for persistence_kit-3.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 34d6aa0b672a428752b1850c31d404989acf6783480056347dca9a42c6648c8a
MD5 5d6e3ba68098836d43f4532f6ac71148
BLAKE2b-256 65e677ab80377125548178a73c434a3a14a72e29538b2107fc552227424e5864

See more details on using hashes here.

Provenance

The following attestation bundles were made for persistence_kit-3.0.1-py3-none-any.whl:

Publisher: publish-pypi.yml on AndresFSerrano/persistence-kit

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page