SSB Spark Tools
The SSB Spark Tools Library is a colection of Data processing functions for the use in Data processing in Statistics Norway
[!WARNING] This project is deprecated and no longer maintained.
Installation
pip install ssb-spark-tools
Development setup
This repo uses poetry for dependency management and publishing to PyPi.
Install poetry as described on the poetry install page.
poetry install Install required tools for build/dev
poetry run pytest Run tests
poetry build Build dist
poetry publish Publish to PyPi
Testing
Run tests for all python distributions using GitHub Actions, see https://github.com/statisticsnorway/SSB_Spark_tools/actions
Releasing
Prerequisites: You will need to register accounts on PyPI and TestPyPI.
Before releasing:
- Make sure you're working on a "new" version number.
- Make sure to update release notes.
- Make sure the GitHub repo has a secret with the name
PYPI_API_TOKENand contains the PyPi access token.
To release and publish a new version to PyPI:
- Create a new release in the GitHub repo.
- The
Upload Python PackageGitHub Action will start and publish the new version to PyPi.
Manually:
poetry publish
For a dress rehearsal, you can do a test release to the TestPyPI index. TestPyPI is very useful, as you can try all the steps of publishing a package without any consequences if you mess up. Read more about TestPyPI here.
You should see the new release appearing here (it might take a couple of minutes for the index to update).
Release History
- 0.0.1
- Initial version with functions as in use on initiaition
Meta
Statistics Norway – https://github.com/statisticsnorway
Distributed under the MIT license. See LICENSE for more information.
https://github.com/statisticsnorway/SSB_Spark_tools
Contributing
- Fork it (https://github.com/statisticsnorway/SSB_Spark_tools/fork)
- Create your feature branch (
git checkout -b feature/fooBar) - Commit your changes (
git commit -am 'Add some fooBar') - Push to the branch (
git push origin feature/fooBar) - Create a new Pull Request
Metadata
Release files for ssb-spark-tools 0.1.14
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| ssb_spark_tools-0.1.14.tar.gz | 15.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| ssb_spark_tools-0.1.14-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 32.8 kB
Release files / ssb_spark_tools-0.1.14.tar.gz
| Download URL | ssb_spark_tools-0.1.14.tar.gz |
|---|---|
| Size | 15.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
10ddff066a0b284a7c0f7382159dbd80d6adaa14a98373be9eb60cde55b813a7
|
|
BLAKE2b-256 checksum How to use checksums |
951ea279e55cbf8dae02c953020be088efbf1630d7b1d2037a6a76a52c5f8b99
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.13
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Apr 17, 2026.
Transparency logRelease files / ssb_spark_tools-0.1.14-py3-none-any.whl
| Download URL | ssb_spark_tools-0.1.14-py3-none-any.whl |
|---|---|
| Size | 17.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
60a0b8980b5dd1084602b13581a9ec6d5890ca819cf6cc6c68d471029099d0c0
|
|
BLAKE2b-256 checksum How to use checksums |
a6049ff16a1b38ff251a718f375a561ca19c321b36143c2ad5da55ebc89e6fdf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.13
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Apr 17, 2026.
Transparency log
