Pull 'n' Push
Project description
Pull 'n' Push
Pulls data from sources and pushes it to sinks with optional transformations in between.
Installation
pip install pnp
Installation with extras:
pip install pnp[fswatcher,faceR]
Please consult the component documentation to see if a component requires an extra or not.
Getting started
Define pulls
to fetch / pull data from source systems.
Define one push
or multiple pushes
per pull to transfer the pulled data anywhere else (you only need a plugin that
knows how to handle the target). You configure your pipeline in yaml
:
tasks:
- name: hello-world
pull:
plugin: pnp.plugins.pull.simple.Repeat
args:
interval: 1s
repeat: "Hello World"
push:
- plugin: pnp.plugins.push.simple.Echo
Copy this configuration and create the file helloworld.yaml
. Run it:
pnp helloworld.yaml
This example yields the string Hello World
every second.
Hint: You can validate your config without actually executing it with
pnp --check helloworld.yaml
If you want to learn more please see the documentation at Read the Docs.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file pnp-0.28.0.tar.gz
.
File metadata
- Download URL: pnp-0.28.0.tar.gz
- Upload date:
- Size: 84.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.1.4 CPython/3.7.6 Darwin/20.3.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | ff3f9c7dca0de15ca02f80d0012cbd9c6411323471a6693ee9f789826dd06c48 |
|
MD5 | bb68af3e4516f119d370cdb22e5a8061 |
|
BLAKE2b-256 | 48ed0898e318c0a92d367f055263f7b1e648d4c31300b46cc252ba7eea1840da |
File details
Details for the file pnp-0.28.0-py3-none-any.whl
.
File metadata
- Download URL: pnp-0.28.0-py3-none-any.whl
- Upload date:
- Size: 108.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.1.4 CPython/3.7.6 Darwin/20.3.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3cc07f7e40d36b45bab51b3bd690400099359ad054fe932020e90273bc77331a |
|
MD5 | 8ca55f6251104f29c8d3099683da1b7d |
|
BLAKE2b-256 | c2d5390926374b8e5e085953336464f5d91393524ebb848437258caa169e71ab |