Skip to main content

Python api to interact with the Fair Data Pipeline

Project description

pyDataPipeline

PyPI PyPI - Python Version pyDataPipeline codecov DOI CII Best Practices

Welcome to pyDataPipeline a Python api to interact with the Fair Data Pipeline.

Full documention of the pyDataPipeline is avaialable at https://www.fairdatapipeline.org/pyDataPipeline/

Installation

pyDataPipeline can be installed from PyPi:

pip3 install data-pipeline-api

Or from the Repository:

git clone https://github.com/FAIRDataPipeline/pythonFDP.git

git checkout dev

pip3 install -e .

NB. PyDataPipeline requires Python3.

Example submission_script

Assume FDP_CONFIG_DIR, storage_locations and objects have been set by CLI tool

import os
import fairdatapipeline as pipeline

token = os.environ['FDP_LOCAL_TOKEN']
config_dir = os.environ['FDP_CONFIG_DIR']
config_path = os.path.join(config_dir, 'config.yaml')
script_path = os.path.join(config_dir, 'script.sh')

handle = pipeline.initialise(token, config_path, script_path)

pipeline.finalise(token, handle)

SEIRS Model Example

The SEIRS Model Example is available at: https://www.fairdatapipeline.org/pyDataPipeline/examples/SEIRS.html

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data_pipeline_api-0.9.0.tar.gz (25.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

data_pipeline_api-0.9.0-py3-none-any.whl (28.4 kB view details)

Uploaded Python 3

File details

Details for the file data_pipeline_api-0.9.0.tar.gz.

File metadata

  • Download URL: data_pipeline_api-0.9.0.tar.gz
  • Upload date:
  • Size: 25.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.4 CPython/3.12.2 Darwin/24.1.0

File hashes

Hashes for data_pipeline_api-0.9.0.tar.gz
Algorithm Hash digest
SHA256 a1cdb353f9a2e14843a1ef02fbc1dcdd91f2df564e0ef5d7276abfdf81a7db1e
MD5 5d3b5a1487307da2fef85a72b4c4df5a
BLAKE2b-256 416c89039dbbb54e407ee897faacdabec3fabca2fc8505adbf03f60fb592b291

See more details on using hashes here.

File details

Details for the file data_pipeline_api-0.9.0-py3-none-any.whl.

File metadata

  • Download URL: data_pipeline_api-0.9.0-py3-none-any.whl
  • Upload date:
  • Size: 28.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.4 CPython/3.12.2 Darwin/24.1.0

File hashes

Hashes for data_pipeline_api-0.9.0-py3-none-any.whl
Algorithm Hash digest
SHA256 cbf1c54f23b6fbe21a86b1b2e90f03774550ce6c92cc822d5b806da75abf866f
MD5 0cfe0e1460c2ba68a7885d999d70648e
BLAKE2b-256 8acbf189d830dcf3f1af89101eff023d21e845965aac1afff3f849337ab4e204

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page