sws-spark-dissemination-helper 0.1.9

A Python helper package providing streamlined Spark functions for efficient data dissemination processes

sws-spark-dissemination-helper

This repo contains the core tools for working programmatically with the SWS datatables controlling the dissemination pipelines.

How to use

Make sure to have make installed on your system and run make help to see the available commands.

Upload a new version

A new version is published to PyPI automatically by the publish workflow whenever a GitHub release is published. The workflow verifies that the release tag matches v<project.version>, so the two must always be kept in sync.

1. Update project.version in the pyproject.toml file (e.g. 0.1.9.dev0) and commit the change.

2. Create and push a tag matching the new version (note the leading v):

   git tag v0.1.9.dev0
   git push origin --tags
   

3. Go to the tags page, select the tag and create a release from it. Use the Latest release label for official releases or Pre-release for development versions, then fill in the release notes.

4. Wait for the GitHub action to run. If it succeeds the new version will be available on PyPI; otherwise check the workflow logs for the failure reason (a common one is the tag not matching project.version) and fix it.