Skip to main content

A Python helper package providing streamlined Spark functions for efficient data dissemination processes

Project description

sws-spark-dissemination-helper

This repo contains the core tools for working programmatically with the SWS datatables controlling the dissemination pipelines.

How to use

Make sure to have make installed on your system and run make help to see the available commands.

Upload a new version

A new version is published to PyPI automatically by the publish workflow whenever a GitHub release is published. The workflow verifies that the release tag matches v<project.version>, so the two must always be kept in sync.

  1. Update project.version in the pyproject.toml file (e.g. 0.1.9.dev0) and commit the change.

  2. Create and push a tag matching the new version (note the leading v):

    git tag v0.1.9.dev0
    git push origin --tags
    
  3. Go to the tags page, select the tag and create a release from it. Use the Latest release label for official releases or Pre-release for development versions, then fill in the release notes.

  4. Wait for the GitHub action to run. If it succeeds the new version will be available on PyPI; otherwise check the workflow logs for the failure reason (a common one is the tag not matching project.version) and fix it.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sws_spark_dissemination_helper-0.1.9.dev2.tar.gz (39.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file sws_spark_dissemination_helper-0.1.9.dev2.tar.gz.

File metadata

File hashes

Hashes for sws_spark_dissemination_helper-0.1.9.dev2.tar.gz
Algorithm Hash digest
SHA256 69903bdfc94f758c4ae5fe874ca9c19fee321591b390530f83964f7ba0fac441
MD5 9cbc42cfda43effe5df7c8268e7c8c46
BLAKE2b-256 7ec7db5969da298fead6d1541bc06613d2e1ac4fb662395dcde531d9b0669f88

See more details on using hashes here.

Provenance

The following attestation bundles were made for sws_spark_dissemination_helper-0.1.9.dev2.tar.gz:

Publisher: publish.yml on un-fao/fao-sws-it-python-spark-dissemination-helper

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file sws_spark_dissemination_helper-0.1.9.dev2-py3-none-any.whl.

File metadata

File hashes

Hashes for sws_spark_dissemination_helper-0.1.9.dev2-py3-none-any.whl
Algorithm Hash digest
SHA256 e3a311e0102bd70bf10cd169f124cddd36f395def00647aeb826f6c850325ea4
MD5 6d65b3ec4d2379c478f4a812b00e49a4
BLAKE2b-256 bbec47eb4a03b6fb0ab8be72ce937be7e04d3fcdb2fd17e310ef2c7b8e2b7f8d

See more details on using hashes here.

Provenance

The following attestation bundles were made for sws_spark_dissemination_helper-0.1.9.dev2-py3-none-any.whl:

Publisher: publish.yml on un-fao/fao-sws-it-python-spark-dissemination-helper

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page