Skip to main content

python module wrapper for the data analytics software framework DASF

Project description

DASF Logo

Data Analytics Software Framework

CI Code coverage Docs Latest Release PyPI version Code style: black Imports: isort PEP8 Checked with mypy REUSE status DOI JOSS

python module wrapper for the data analytics software framework DASF

Abstract

DASF: Messaging Python is part of the Data Analytics Software Framework (DASF, https://codebase.helmholtz.cloud/dasf), developed at the GFZ German Research Centre for Geosciences (https://www.gfz-potsdam.de). It is funded by the Initiative and Networking Fund of the Helmholtz Association through the Digital Earth project (https://www.digitalearth-hgf.de/).

DASF: Messaging Python is a RPC (remote procedure call) wrapper library for the python programming language. As part of the data analytics software framework DASF, it implements the DASF RPC messaging protocol. This message broker based RPC implementation supports the integration of algorithms and methods implemented in python in a distributed environment. It utilizes pydantic (https://pydantic-docs.helpmanual.io/) for data and model validation using python type annotations. DASF distributes messages via a central message broker. Currently we support a self-developed message broker called dasf-broker-django, as well as an ‘off-the-shelf’ solution called Apache Pulsar. (also see: Message Broker)


Documentation

see: https://dasf.readthedocs.io/en/latest/

Installation

Install this package in a dedicated python environment via

python -m venv venv
source venv/bin/activate
pip install demessaging

To use this in a development setup, clone the source code from gitlab, start the development server and make your changes::

git clone https://codebase.helmholtz.cloud/dasf/dasf-messaging-python
cd dasf-messaging-python
python -m venv venv
source venv/bin/activate
make dev-install

More detailed installation instructions my be found in the docs.

Technical note

This package has been generated from the template https://codebase.helmholtz.cloud/hcdc/software-templates/python-package-template.git.

See the template repository for instructions on how to update the skeleton for this package.

Source Code Examples

see: https://codebase.helmholtz.cloud/dasf/dasf-messaging-python/-/blob/master/ExampleMessageConsumer.py

Recommended Software Citation

Eggert et al., (2022). DASF: A data analytics software framework for distributed environments. Journal of Open Source Software, 7(78), 4052, https://doi.org/10.21105/joss.04052

License information

Copyright © 2019-2025 Helmholtz Centre Potsdam GFZ German Research Centre for Geosciences Copyright © 2020-2021 Helmholtz-Zentrum Geesthacht Copyright © 2021-2025 Helmholtz-Zentrum hereon GmbH

Code files in this repository are licensed under the Apache-2.0, if not stated otherwise in the file.

Documentation files in this repository are licensed under CC-BY-4.0, if not stated otherwise in the file.

Supplementary and configuration files in this repository are licensed under CC0-1.0, if not stated otherwise in the file.

Please check the header of the individual files for more detailed information.

License management

License management is handled with reuse. If you have any questions on this, please have a look into the contributing guide or contact the maintainers of dasf-messaging-python.

Contact

Philipp S. Sommer eMail: philipp.sommer@hereon.de

Helmholtz-Zentrum Hereon Max-Planck-Str. 1 21502 Geesthacht Germany

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

demessaging-0.6.3.tar.gz (60.6 kB view details)

Uploaded Source

Built Distribution

demessaging-0.6.3-py3-none-any.whl (70.9 kB view details)

Uploaded Python 3

File details

Details for the file demessaging-0.6.3.tar.gz.

File metadata

  • Download URL: demessaging-0.6.3.tar.gz
  • Upload date:
  • Size: 60.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for demessaging-0.6.3.tar.gz
Algorithm Hash digest
SHA256 b746f3d70cfb4632c5c5a5951b592afdfcce18cf639b1b6a3265c8b68fc38bad
MD5 de08816963b3f8018da906d2ea02be90
BLAKE2b-256 f2f5e7740a1f7d9293cf476835a29613cd25485266753a21af97ca3aa77db5d6

See more details on using hashes here.

File details

Details for the file demessaging-0.6.3-py3-none-any.whl.

File metadata

  • Download URL: demessaging-0.6.3-py3-none-any.whl
  • Upload date:
  • Size: 70.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for demessaging-0.6.3-py3-none-any.whl
Algorithm Hash digest
SHA256 f2ae285f7cbf8e8c66f3ac4addfe570a67065662ba23a8281f5cff17bc2337d4
MD5 38cb36c85c43b4636d808cf4ec109461
BLAKE2b-256 8da76a12cca7cb0e78f9a348a248366411215dd19af12c49ad99136d70d22e1b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page