Pull 'n' Push
Pulls data from sources and pushes it to sinks with optional transformations in between.
Installation
pip install pnp
Installation with extras:
pip install pnp[fswatcher,faceR]
Please consult the component documentation to see if a component requires an extra or not.
Getting started
Define pulls to fetch / pull data from source systems.
Define one push or multiple pushes per pull to transfer the pulled data anywhere else (you only need a plugin that
knows how to handle the target). You configure your pipeline in yaml:
tasks:
- name: hello-world
pull:
plugin: pnp.plugins.pull.simple.Repeat
args:
interval: 1s
repeat: "Hello World"
push:
- plugin: pnp.plugins.push.simple.Echo
Copy this configuration and create the file helloworld.yaml. Run it:
pnp helloworld.yaml
This example yields the string Hello World every second.
Hint: You can validate your config without actually executing it with
pnp --check helloworld.yaml
If you want to learn more please see the documentation at Read the Docs.
1 maintainer
Metadata
1 maintainer
Release files for pnp 0.28.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| pnp-0.28.0.tar.gz | 84.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| pnp-0.28.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 193.2 kB
Release files / pnp-0.28.0.tar.gz
| Download URL | pnp-0.28.0.tar.gz |
|---|---|
| Size | 84.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
ff3f9c7dca0de15ca02f80d0012cbd9c6411323471a6693ee9f789826dd06c48
|
|
BLAKE2b-256 checksum How to use checksums |
48ed0898e318c0a92d367f055263f7b1e648d4c31300b46cc252ba7eea1840da
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.1.4 CPython/3.7.6 Darwin/20.3.0
|
Release files / pnp-0.28.0-py3-none-any.whl
| Download URL | pnp-0.28.0-py3-none-any.whl |
|---|---|
| Size | 108.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
3cc07f7e40d36b45bab51b3bd690400099359ad054fe932020e90273bc77331a
|
|
BLAKE2b-256 checksum How to use checksums |
c2d5390926374b8e5e085953336464f5d91393524ebb848437258caa169e71ab
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.1.4 CPython/3.7.6 Darwin/20.3.0
|
