Skip to main content

pyDataPipeline

PyPI PyPI - Python Version pyDataPipeline codecov DOI CII Best Practices

Welcome to pyDataPipeline a Python api to interact with the Fair Data Pipeline.

Full documention of the pyDataPipeline is avaialable at https://www.fairdatapipeline.org/pyDataPipeline/

Installation

pyDataPipeline can be installed from PyPi:

pip3 install data-pipeline-api

Or from the Repository:

git clone https://github.com/FAIRDataPipeline/pythonFDP.git

git checkout dev

pip3 install -e .

NB. PyDataPipeline requires Python3.

Example submission_script

Assume FDP_CONFIG_DIR, storage_locations and objects have been set by CLI tool

import os
import fairdatapipeline as pipeline

token = os.environ['FDP_LOCAL_TOKEN']
config_dir = os.environ['FDP_CONFIG_DIR']
config_path = os.path.join(config_dir, 'config.yaml')
script_path = os.path.join(config_dir, 'script.sh')

handle = pipeline.initialise(token, config_path, script_path)

pipeline.finalise(token, handle)

SEIRS Model Example

The SEIRS Model Example is available at: https://www.fairdatapipeline.org/pyDataPipeline/examples/SEIRS.html

Metadata

Release files for data_pipeline_api 0.9.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for data_pipeline_api 0.9.1
File Size Uploaded
data_pipeline_api-0.9.1.tar.gz 25.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for data_pipeline_api 0.9.1
File Interpreter ABI Platform
data_pipeline_api-0.9.1-py3-none-any.whl Python 3 none any Details

Total release size: 54.1 kB

Release files / data_pipeline_api-0.9.1.tar.gz

Download URL data_pipeline_api-0.9.1.tar.gz
Size 25.7 kB
Tags Source
SHA-256 checksum
How to use checksums
62a1123369c2d00914c69d52254533f089b30c3f1d263e71e6a5cd1204327ea4
BLAKE2b-256 checksum
How to use checksums
fd53ef92b9cbf455c01dd55b522b24c4f7981aa94600b812b33078c4d94727da
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.8.3 CPython/3.11.15 Darwin/25.6.0

Release files / data_pipeline_api-0.9.1-py3-none-any.whl

Download URL data_pipeline_api-0.9.1-py3-none-any.whl
Size 28.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
5985c26c3a53ca5de4ce217c16a5dce5cec1d5d3e0589786a790a2ba50e4594d
BLAKE2b-256 checksum
How to use checksums
fa97f3a01be588b9503d056dfc3ea3f5203740fa5c92fa92c29c9e9779e8036c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.8.3 CPython/3.11.15 Darwin/25.6.0

Release history Release notifications | RSS feed

This release

0.9.1 This release

2 release files

0.9.0

2 release files

0.8.0

2 release files

0.7.10

2 release files

0.7.9

2 release files

0.7.8

2 release files

0.7.7

2 release files

0.7.6

2 release files

0.7.5

2 release files

0.7.3

2 release files

0.7.2

2 release files

0.7.1

2 release files

0.7.0

2 release files

0.6.0

2 release files

0.2.0

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page