Skip to main content

No project description provided

Project description

datapipe-app

datapipe-app implements two aspects to make every datapipe pipeline to work as an application:

  1. REST API + debug UI based of FastAPI
  2. datapipe CLI tool

Common usage

Common pattern to use datapipe-app is to create app.py with the following code:

from datapipe_app import DatapipeApp

from pipeline import ds, catalog, pipeline

app = DatapipeApp(ds, catalog, pipeline)

Where pipeline is a module that defines common elements: ds, catalog and pipeline.

REST API + UI

DatapipeApp inherits from FastApi app and can be started with datapipe CLI or directly with server like uvicorn.

datapipe --pipeline app:app api

UI

Datapipe App UI

REST API

API documentation can be found at /api/v1alpha1/docs sub URL.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

datapipe_app-0.5.4.tar.gz (2.2 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

datapipe_app-0.5.4-py3-none-any.whl (2.2 MB view details)

Uploaded Python 3

File details

Details for the file datapipe_app-0.5.4.tar.gz.

File metadata

  • Download URL: datapipe_app-0.5.4.tar.gz
  • Upload date:
  • Size: 2.2 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.5 CPython/3.10.12 Linux/5.15.167.4-microsoft-standard-WSL2

File hashes

Hashes for datapipe_app-0.5.4.tar.gz
Algorithm Hash digest
SHA256 c0394157c3d9aeffd83d29bad7008b42ea21c45fb565bde3ee944c12965e271d
MD5 5b2a59ed8d3a00b91bd5e1b4ba1d1d5d
BLAKE2b-256 3e38a90dd4c3efa1382161c0744d85cafe79889d4d4b83ff6e281d60b9d1e1bc

See more details on using hashes here.

File details

Details for the file datapipe_app-0.5.4-py3-none-any.whl.

File metadata

  • Download URL: datapipe_app-0.5.4-py3-none-any.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.5 CPython/3.10.12 Linux/5.15.167.4-microsoft-standard-WSL2

File hashes

Hashes for datapipe_app-0.5.4-py3-none-any.whl
Algorithm Hash digest
SHA256 85b14901eeb26c1ae07b3cc2b05f941c1ff5c9069fa352958ff788b25ef953e1
MD5 756e824a4e6d4e09990f9c65bcf0d083
BLAKE2b-256 a3c7be670fd965379d75f045464217a4d29a1c3ac0d54620abb406e242ae21e8

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page