Skip to main content

Pull 'n' Push

Project description

Pull 'n' Push

Python PyPI version Docs GitHub Activity Build Status Coverage Status Docker: hub License: MIT Project Maintenance

Pulls data from sources and pushes it to sinks with optional transformations in between.

Installation

pip install pnp

Installation with extras:

pip install pnp[fswatcher,faceR]

Please consult the component documentation to see if a component requires an extra or not.

Getting started

Define pulls to fetch / pull data from source systems. Define one push or multiple pushes per pull to transfer the pulled data anywhere else (you only need a plugin that knows how to handle the target). You configure your pipeline in yaml:

tasks:
  - name: hello-world
    pull:
      plugin: pnp.plugins.pull.simple.Repeat
      args:
        interval: 1s
        repeat: "Hello World"
    push:
      - plugin: pnp.plugins.push.simple.Echo

Copy this configuration and create the file helloworld.yaml. Run it:

pnp helloworld.yaml

This example yields the string Hello World every second.

Hint: You can validate your config without actually executing it with

   pnp --check helloworld.yaml

If you want to learn more please see the documentation at Read the Docs.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pnp-0.28.0.tar.gz (84.6 kB view hashes)

Uploaded Source

Built Distribution

pnp-0.28.0-py3-none-any.whl (108.6 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page