Skip to main content

Python api to interact with the Fair Data Pipeline

Project description

pyDataPipeline

PyPI PyPI - Python Version pyDataPipeline codecov DOI CII Best Practices

Welcome to pyDataPipeline a Python api to interact with the Fair Data Pipeline.

Full documention of the pyDataPipeline is avaialable at https://www.fairdatapipeline.org/pyDataPipeline/

Installation

pyDataPipeline can be installed from PyPi:

pip3 install data-pipeline-api

Or from the Repository:

git clone https://github.com/FAIRDataPipeline/pythonFDP.git

git checkout dev

pip3 install -e .

NB. PyDataPipeline requires Python3.

Example submission_script

Assume FDP_CONFIG_DIR, storage_locations and objects have been set by CLI tool

import os
import fairdatapipeline as pipeline

token = os.environ['FDP_LOCAL_TOKEN']
config_dir = os.environ['FDP_CONFIG_DIR']
config_path = os.path.join(config_dir, 'config.yaml')
script_path = os.path.join(config_dir, 'script.sh')

handle = pipeline.initialise(token, config_path, script_path)

pipeline.finalise(token, handle)

SEIRS Model Example

The SEIRS Model Example is available at: https://www.fairdatapipeline.org/pyDataPipeline/examples/SEIRS.html

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data_pipeline_api-0.8.0.tar.gz (25.8 kB view details)

Uploaded Source

Built Distribution

data_pipeline_api-0.8.0-py3-none-any.whl (28.4 kB view details)

Uploaded Python 3

File details

Details for the file data_pipeline_api-0.8.0.tar.gz.

File metadata

  • Download URL: data_pipeline_api-0.8.0.tar.gz
  • Upload date:
  • Size: 25.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.11.7 Darwin/23.5.0

File hashes

Hashes for data_pipeline_api-0.8.0.tar.gz
Algorithm Hash digest
SHA256 7ba4d83857cbe855c31916f73be29d3fbc0cc81958ce034f76d9cfb4370cf164
MD5 13c797e70bac8c0940f53a21af5b6ca5
BLAKE2b-256 3921e632e6688df3d00e6b397d9440a1cf17a04629b2da92515042bc3e95ae34

See more details on using hashes here.

File details

Details for the file data_pipeline_api-0.8.0-py3-none-any.whl.

File metadata

File hashes

Hashes for data_pipeline_api-0.8.0-py3-none-any.whl
Algorithm Hash digest
SHA256 597e160903ee5ac7ecd48a970a82af300c26fca9c101f0e2968077adafcfbc1a
MD5 031096f3f024a6653cdf4f33894ef2bc
BLAKE2b-256 32fc901524f5028b97702b51b2be6d8b5f8801d85fbe08c11f88b5b3b9a92be1

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page