Skip to main content

A framework for building Singer taps

Project description

Meltano Singer SDK

The Tap and Target SDKs are the fastest way to build custom data extractors and loaders! Taps and targets built on the SDK are automatically compliant with the Singer Spec, the de-facto open source standard for extract and load pipelines.



Meltano Singer SDK Logo


Future-proof extractors and loaders, with less code

On average, developers tell us that they write about 70% less code by using the SDK, which makes learning the SDK a great investment. Furthermore, as new features and capabilities are added to the SDK, your taps and targets can always take advantage of the latest capabilities and bug fixes, simply by updating your SDK dependency to the latest version.

Meltano

Not familiar with Meltano? Meltano is your CLI for ELT+ that:

  • Starts simple: Meltano is pip-installable and comes in a prepackaged docker container, you can have your first ELT pipeline running within minutes.
  • Has DataOps out-of-the-box: Meltano provides tools that make DataOps best practices easy to use in every project.
  • Integrates with everything: 300+ natively supported data sources & targets, as well as additional plugins like great expectations or dbt are natively available.
  • Is easily customizable: Meltano isn't just extensible, it's built to be extended! The Singer SDK (for Connectors) & EDK (for Meltano Components) are easy to use. Meltano Hub helps you find all of the connectors and components created across the data community.
  • Is a mature system: Developed since 2018, runs in production at large companies like GitLab, and currently powers over a million pipeline runs monthly.
  • Has first class ELT tooling built-in: Extract data from any data source, load into any target, use inline maps to transform on data on the fly, and test the incoming data, all in one package.

If you want to get started with Meltano, we suggest you:

Documentation

Contributing back to the SDK

Making a new release of the SDK

  1. Trigger a version bump using the GitHub web UI or the cli:

    $ gh workflow run
    

    The increment: auto option will figure out the most appropriate bump based on commit history.

  2. Follow the checklist in the PR description.

  3. Publish a new release using the GitHub web UI.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

singer_sdk-0.42.0b1.tar.gz (145.2 kB view details)

Uploaded Source

Built Distribution

singer_sdk-0.42.0b1-py3-none-any.whl (179.7 kB view details)

Uploaded Python 3

File details

Details for the file singer_sdk-0.42.0b1.tar.gz.

File metadata

  • Download URL: singer_sdk-0.42.0b1.tar.gz
  • Upload date:
  • Size: 145.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for singer_sdk-0.42.0b1.tar.gz
Algorithm Hash digest
SHA256 cd35bde9aea7d684820fd50df9259a8b69ad78c8d1d586eef3234562de64e475
MD5 45dc8f43bd41840ab7f94b73d95afe7b
BLAKE2b-256 2bca5c19977e8947cb8d5a0bc1cd1df0495d1b4069710632a2c3b8e4c1d39558

See more details on using hashes here.

Provenance

The following attestation bundles were made for singer_sdk-0.42.0b1.tar.gz:

Publisher: release.yml on meltano/sdk

Attestations:

File details

Details for the file singer_sdk-0.42.0b1-py3-none-any.whl.

File metadata

File hashes

Hashes for singer_sdk-0.42.0b1-py3-none-any.whl
Algorithm Hash digest
SHA256 cb770514b10c146af1770f643beb6a6e1a577252a31b8c3f73bfb8a7481a988a
MD5 501d0e54e1433333bcb5b06e1a85f0d8
BLAKE2b-256 1428650af02d2602018193b257531c16618c1750c54b5c3218f8dd0a6040a4a3

See more details on using hashes here.

Provenance

The following attestation bundles were made for singer_sdk-0.42.0b1-py3-none-any.whl:

Publisher: release.yml on meltano/sdk

Attestations:

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page