A plugin for nodestream providing pipeline shell execution.
Project description
Nodestream Shell Plugin
This plugin provides a Nodestream shell extractor.
NOTE: This plugin is currently in development and is not yet ready for production use.
Installation
pip install nodestream-plugin-shell
For commands that return output in json format
# pipeline.yaml
- implementation: nodestream_plugin_shell:Shell
arguments:
command: curl
arguments:
- https://example.com/api/data/json
options:
X: GET
header: "Accept: application/json"
ignore_stdout: false #Provide json output from command to next step in pipeline.
This would be equivalent to running:
curl https://example.com/api/data.json -X GET --header "Accept: application/json"
For commands that create files that you would like to read into the pipeline
Terminal command
# pipeline.yaml
- implementation: nodestream_plugin_shell:Shell
arguments:
command: curl
arguments:
- https://example.com/api/data.json
options:
X: GET
header: "Accept: application/json"
flags:
- O
ignore_stdout: true #Do not provide output from command to next step in pipeline.
- implementation: nodestream.pipeline.extractors:FileExtractor
arguments:
globs:
- data.json
This would be equivalent to running:
curl https://example.com/api/data.json -X GET --header "Accept: application/json" -O
cat data.json
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for nodestream_plugin_shell-0.11.11.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | b9aff128c2e5de21ece50ae38c8f961df2ae1434b6118dc8bd4099cd63cb4d66 |
|
MD5 | a975eb7dd93df27caeffd0b29dc006bf |
|
BLAKE2b-256 | 3d563c5dc1e89131223d2a40e3f362565bae4d32593adc6b92871fc23a6a2901 |
Close
Hashes for nodestream_plugin_shell-0.11.11-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1bfc5c1ad62f129dd36b501df690447f6821635b0e1246563016c0a99e0d3d08 |
|
MD5 | 34ab72b183aa52ce1bc6cedcd9d158b0 |
|
BLAKE2b-256 | 75412567344dade757a151e64c8917455162c173fe77ad206d9417ba29bf1cfe |