Skip to main content

Singer tap for Pipedream, built with the Meltano SDK for Singer Taps.

Project description

tap-pipedream

Singer tap for Pipedream. Built with the Meltano Singer SDK.

Capabilities

  • catalog
  • state
  • discover
  • about
  • stream-maps
  • schema-flattening

Settings

Setting Required Default Description
token True None API Token for Pipedream
start_date False None Earliest timestamp to get data from
stream_maps False None Config object for stream maps capability. For more information check out Stream Maps.
stream_map_config False None User-defined config values to be used within map expressions.
flattening_enabled False None 'True' to enable schema flattening and automatically expand nested properties.
flattening_max_depth False None The max depth to flatten schemas.

A full list of supported settings and capabilities is available by running: tap-pipedream --about

Source Authentication and Authorization

To generate an API key, follow the instructions in the docs.

Usage

You can easily run tap-pipedream by itself or in a pipeline using Meltano.

Executing the Tap Directly

tap-pipedream --version
tap-pipedream --help
tap-pipedream --config CONFIG --discover > ./catalog.json

Developer Resources

Initialize your Development Environment

pipx install hatch

Create and Run Tests

Run integration tests:

hatch run test:integration

You can also test the tap-pipedream CLI interface directly:

hatch run sync:console -- --about --format=json

Testing with Meltano

Note: This tap will work in any Singer environment and does not require Meltano. Examples here are for convenience and to streamline end-to-end orchestration scenarios.

Install Meltano (if you haven't already) and any needed plugins:

# Install meltano
pipx install meltano
# Initialize meltano within this directory
cd tap-pipedream
meltano install

Now you can test and orchestrate using Meltano:

# Test invocation:
meltano invoke tap-pipedream --version
# OR run a test `elt` pipeline:
meltano elt tap-pipedream target-jsonl

SDK Dev Guide

See the dev guide for more instructions on how to use the SDK to develop your own taps and targets.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tap_pipedream-0.5.0.tar.gz (55.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tap_pipedream-0.5.0-py3-none-any.whl (10.4 kB view details)

Uploaded Python 3

File details

Details for the file tap_pipedream-0.5.0.tar.gz.

File metadata

  • Download URL: tap_pipedream-0.5.0.tar.gz
  • Upload date:
  • Size: 55.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for tap_pipedream-0.5.0.tar.gz
Algorithm Hash digest
SHA256 b1fd2f8f63d0910b8e3ac8e0ca7abd5a7ece93ba181822ddae59fc73dd1388a9
MD5 2eb1f3b9dd74a87e3bff393f94d985ee
BLAKE2b-256 2c738c77dbe2d689b89b02455d1d863c2a3a64ef3a121c75c66b0be5d18aab47

See more details on using hashes here.

Provenance

The following attestation bundles were made for tap_pipedream-0.5.0.tar.gz:

Publisher: dynamic-publish.yaml on reservoir-data/tap-pipedream

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file tap_pipedream-0.5.0-py3-none-any.whl.

File metadata

  • Download URL: tap_pipedream-0.5.0-py3-none-any.whl
  • Upload date:
  • Size: 10.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for tap_pipedream-0.5.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a31330d23955aa5932bb3cf6534679110e32a79d401eb3f3646e3e00edea4aea
MD5 5f9325952965f17f289cd4085d9c98ba
BLAKE2b-256 5d4ee96bb578a3438a1e30ead6a6713094ccca813f620e7a56e6ac55a5c89e18

See more details on using hashes here.

Provenance

The following attestation bundles were made for tap_pipedream-0.5.0-py3-none-any.whl:

Publisher: dynamic-publish.yaml on reservoir-data/tap-pipedream

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page