A plugin for nodestream providing pipeline shell execution.
Project description
Nodestream Shell Plugin
This plugin provides a Nodestream shell extractor.
NOTE: This plugin is currently in development and is not yet ready for production use.
Installation
pip install nodestream-plugin-shell
For commands that return output in json format
# pipeline.yaml
- implementation: nodestream_plugin_shell:Shell
arguments:
command: curl
arguments:
- https://example.com/api/data/json
options:
X: GET
header: "Accept: application/json"
ignore_stdout: false #Provide json output from command to next step in pipeline.
This would be equivalent to running:
curl https://example.com/api/data.json -X GET --header "Accept: application/json"
For commands that create files that you would like to read into the pipeline
Terminal command
# pipeline.yaml
- implementation: nodestream_plugin_shell:Shell
arguments:
command: curl
arguments:
- https://example.com/api/data.json
options:
X: GET
header: "Accept: application/json"
flags:
- O
ignore_stdout: true #Do not provide output from command to next step in pipeline.
- implementation: nodestream.pipeline.extractors:FileExtractor
arguments:
globs:
- data.json
This would be equivalent to running:
curl https://example.com/api/data.json -X GET --header "Accept: application/json" -O
cat data.json
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for nodestream_plugin_shell-0.12.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 86a91cee2e96b1c87a1888f692623cda07e473247540335d12bdd59d66558da6 |
|
MD5 | 6f0d91966aaa2a5d16b45e950ecb6a01 |
|
BLAKE2b-256 | 215bec0112ca92eb18108ad6d958afa226e1bf3c2518a09130f3fb114ea1d964 |
Close
Hashes for nodestream_plugin_shell-0.12.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f34c5da59f022c257bf732a989e008139f36401d8a3efcb233f0991fa39672c1 |
|
MD5 | 37741b3c2054cff8e1e45cf12951fae5 |
|
BLAKE2b-256 | b27079e23e7eb4a7c38e7c3db28b1d11bcc08eec07eee30ea1b95c108c7d7af3 |