Skip to main content

Pull 'n' Push

Project description

Pull 'n' Push

Python PyPI version Docs GitHub Activity Build Status Coverage Status Docker: hub License: MIT Project Maintenance

Pulls data from sources and pushes it to sinks with optional transformations in between.

Installation

pip install pnp

Installation with extras:

pip install pnp[fswatcher,faceR]

Please consult the component documentation to see if a component requires an extra or not.

Getting started

Define pulls to fetch / pull data from source systems. Define one push or multiple pushes per pull to transfer the pulled data anywhere else (you only need a plugin that knows how to handle the target). You configure your pipeline in yaml:

tasks:
  - name: hello-world
    pull:
      plugin: pnp.plugins.pull.simple.Repeat
      args:
        interval: 1s
        repeat: "Hello World"
    push:
      - plugin: pnp.plugins.push.simple.Echo

Copy this configuration and create the file helloworld.yaml. Run it:

pnp helloworld.yaml

This example yields the string Hello World every second.

Hint: You can validate your config without actually executing it with

   pnp --check helloworld.yaml

If you want to learn more please see the documentation at Read the Docs.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pnp-0.28.0.tar.gz (84.6 kB view details)

Uploaded Source

Built Distribution

pnp-0.28.0-py3-none-any.whl (108.6 kB view details)

Uploaded Python 3

File details

Details for the file pnp-0.28.0.tar.gz.

File metadata

  • Download URL: pnp-0.28.0.tar.gz
  • Upload date:
  • Size: 84.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.4 CPython/3.7.6 Darwin/20.3.0

File hashes

Hashes for pnp-0.28.0.tar.gz
Algorithm Hash digest
SHA256 ff3f9c7dca0de15ca02f80d0012cbd9c6411323471a6693ee9f789826dd06c48
MD5 bb68af3e4516f119d370cdb22e5a8061
BLAKE2b-256 48ed0898e318c0a92d367f055263f7b1e648d4c31300b46cc252ba7eea1840da

See more details on using hashes here.

File details

Details for the file pnp-0.28.0-py3-none-any.whl.

File metadata

  • Download URL: pnp-0.28.0-py3-none-any.whl
  • Upload date:
  • Size: 108.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.4 CPython/3.7.6 Darwin/20.3.0

File hashes

Hashes for pnp-0.28.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3cc07f7e40d36b45bab51b3bd690400099359ad054fe932020e90273bc77331a
MD5 8ca55f6251104f29c8d3099683da1b7d
BLAKE2b-256 c2d5390926374b8e5e085953336464f5d91393524ebb848437258caa169e71ab

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page