dw-lib

Tools for working with Postgres, ClickHouse, and DuckDB.

Development

Prerequisites

1. Clone the repo:

   git clone --recurse-submodules git@github.com:netbek/dw-lib.git
   

2. Install Docker Engine v23 or higher and Docker Compose v2 or higher. Follow the links for instructions or run this script:

   ./scripts/install-docker.sh
   

3. Install Mise and add activation to ~/.bashrc, e.g.

   curl -fsSL https://github.com/jdx/mise/releases/download/v2026.7.13/install.sh | sh
   

   See other installation methods.

4. Trust mise.toml:

   mise trust
   

5. Run make install to install Node dependencies, Python dependencies, pre-commit hooks, agent skills, and pinned vendor sources.

6. Create a PyPI API token, and add the token to the system keyring as the password:

   keyring set pypi-dw-lib __token__
   

Release

Build and publish the Python distribution package:

1. Run make bump-version [major|minor|patch]. This bumps pyproject.toml and package.json, then commits.
2. Push the commit.
3. Run make build. This builds the distribution package.
4. Check the tree is clean, then run make create-release.
5. Run make publish. This publishes the distribution package.

License

Copyright (c) 2025 Hein Bekker. Licensed under the GNU Affero General Public License, version 3.