`tap-pipedream` is a Singer tap for Pipedream, built with the Meltano SDK for Singer Taps.
Project description
Capabilities
catalog
state
discover
about
stream-maps
schema-flattening
Settings
Setting | Required | Default | Description |
---|---|---|---|
token | True | None | API Token for Pipedream |
start_date | False | None | Earliest timestamp to get data from |
stream_maps | False | None | Config object for stream maps capability. For more information check out Stream Maps. |
stream_map_config | False | None | User-defined config values to be used within map expressions. |
flattening_enabled | False | None | 'True' to enable schema flattening and automatically expand nested properties. |
flattening_max_depth | False | None | The max depth to flatten schemas. |
A full list of supported settings and capabilities is available by running: tap-pipedream --about
Source Authentication and Authorization
To generate an API key, follow the instructions in the docs.
Usage
You can easily run tap-pipedream
by itself or in a pipeline using Meltano.
Executing the Tap Directly
tap-pipedream --version
tap-pipedream --help
tap-pipedream --config CONFIG --discover > ./catalog.json
Developer Resources
Initialize your Development Environment
pipx install poetry
poetry install
Create and Run Tests
Create tests within the tests
subfolder and then run:
poetry run pytest
You can also test the tap-pipedream
CLI interface directly using poetry run
:
poetry run tap-pipedream --help
Testing with Meltano
Note: This tap will work in any Singer environment and does not require Meltano. Examples here are for convenience and to streamline end-to-end orchestration scenarios.
Install Meltano (if you haven't already) and any needed plugins:
# Install meltano
pipx install meltano
# Initialize meltano within this directory
cd tap-pipedream
meltano install
Now you can test and orchestrate using Meltano:
# Test invocation:
meltano invoke tap-pipedream --version
# OR run a test `elt` pipeline:
meltano elt tap-pipedream target-jsonl
SDK Dev Guide
See the dev guide for more instructions on how to use the SDK to develop your own taps and targets.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for tap_pipedream-0.0.1b3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 77aa80dd6002c32f6017b9764327797e6beba9ac5abc6c2dba86bd0ce386e9a1 |
|
MD5 | 58f10cb6ac958ca5a5f8400d9a44aee2 |
|
BLAKE2b-256 | 4881899dfd66952c0b8db4e87301115a375b155be5108e0912e302a012d244ca |