Skip to main content

Singer tap for Pipedream, built with the Meltano SDK for Singer Taps.

Project description

tap-pipedream

Singer tap for Pipedream. Built with the Meltano Singer SDK.

Capabilities

  • catalog
  • state
  • discover
  • about
  • stream-maps
  • schema-flattening

Settings

Setting Required Default Description
token True None API Token for Pipedream
start_date False None Earliest timestamp to get data from
stream_maps False None Config object for stream maps capability. For more information check out Stream Maps.
stream_map_config False None User-defined config values to be used within map expressions.
flattening_enabled False None 'True' to enable schema flattening and automatically expand nested properties.
flattening_max_depth False None The max depth to flatten schemas.

A full list of supported settings and capabilities is available by running: tap-pipedream --about

Source Authentication and Authorization

To generate an API key, follow the instructions in the docs.

Usage

You can easily run tap-pipedream by itself or in a pipeline using Meltano.

Executing the Tap Directly

tap-pipedream --version
tap-pipedream --help
tap-pipedream --config CONFIG --discover > ./catalog.json

Developer Resources

Initialize your Development Environment

pipx install hatch

Create and Run Tests

Run integration tests:

hatch run test:integration

You can also test the tap-pipedream CLI interface directly:

hatch run sync:console -- --about --format=json

Testing with Meltano

Note: This tap will work in any Singer environment and does not require Meltano. Examples here are for convenience and to streamline end-to-end orchestration scenarios.

Install Meltano (if you haven't already) and any needed plugins:

# Install meltano
pipx install meltano
# Initialize meltano within this directory
cd tap-pipedream
meltano install

Now you can test and orchestrate using Meltano:

# Test invocation:
meltano invoke tap-pipedream --version
# OR run a test `elt` pipeline:
meltano elt tap-pipedream target-jsonl

SDK Dev Guide

See the dev guide for more instructions on how to use the SDK to develop your own taps and targets.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tap_pipedream-0.4.5.tar.gz (74.0 kB view details)

Uploaded Source

Built Distribution

tap_pipedream-0.4.5-py3-none-any.whl (10.5 kB view details)

Uploaded Python 3

File details

Details for the file tap_pipedream-0.4.5.tar.gz.

File metadata

  • Download URL: tap_pipedream-0.4.5.tar.gz
  • Upload date:
  • Size: 74.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for tap_pipedream-0.4.5.tar.gz
Algorithm Hash digest
SHA256 5dcaf671281cd44e00a81004c0990abdde70f2467ddb4711ebf864e4bc968f6b
MD5 c07cceb64f70df6a02916bbca5533835
BLAKE2b-256 6ba6d9220a32214cc749c29081583c089a56e9e6115b8d5e5d95b4d975ade100

See more details on using hashes here.

Provenance

The following attestation bundles were made for tap_pipedream-0.4.5.tar.gz:

Publisher: dynamic-publish.yaml on edgarrmondragon/tap-pipedream

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file tap_pipedream-0.4.5-py3-none-any.whl.

File metadata

  • Download URL: tap_pipedream-0.4.5-py3-none-any.whl
  • Upload date:
  • Size: 10.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for tap_pipedream-0.4.5-py3-none-any.whl
Algorithm Hash digest
SHA256 d22172c352f6fbd2947d887e486bef3df4bea70e02686bb1db081781c5226809
MD5 c8f9ad31382b12a897e295464e5b3000
BLAKE2b-256 c4849264679952f1ebe36af05472d618906dc08e7f8ef3c787aebd91bea2c3a2

See more details on using hashes here.

Provenance

The following attestation bundles were made for tap_pipedream-0.4.5-py3-none-any.whl:

Publisher: dynamic-publish.yaml on edgarrmondragon/tap-pipedream

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page