tap-jsonl 0.2.0

Singer tap for Jsonl, built with the Meltano Singer SDK.

tap-jsonl

tap-jsonl is a Singer tap for generic JSONL extractions.

Built with the Meltano Tap SDK for Singer Taps.

Configuration

Accepted Config Options

Example config

      config:
        path: ./data/**/*.jsonl
        stream_name: my_stream
        primary_keys: ["id"]
        encoding: utf-8
        emit_state_every: 500

A full list of supported settings and capabilities for this tap is available by running:

tap-jsonl --about

Configure using environment variables

This Singer tap will automatically import any environment variables within the working directory's .env if the --config=ENV is provided, such that config values will be considered if a matching environment variable is set either in the terminal context or in the .env file.

Source Authentication and Authorization

Usage

You can easily run tap-jsonl by itself or in a pipeline using Meltano.

Executing the Tap Directly

tap-jsonl --version
tap-jsonl --help
tap-jsonl --config CONFIG --discover > ./catalog.json

Developer Resources

Follow these instructions to contribute to this project.

Initialize your Development Environment

Prerequisites:

• Python 3.10+
• uv

uv sync

Create and Run Tests

Create tests within the tests subfolder and then run:

uv run pytest

You can also test the tap-jsonl CLI interface directly using uv run:

uv run tap-jsonl --help

Testing with Meltano

Note: This tap will work in any Singer environment and does not require Meltano. Examples here are for convenience and to streamline end-to-end orchestration scenarios.

Use Meltano to run an EL pipeline:

# Install meltano
uv tool install meltano

# Test invocation
meltano invoke tap-jsonl --version

# Run a test EL pipeline
meltano run tap-jsonl target-jsonl

SDK Dev Guide

See the dev guide for more instructions on how to use the SDK to develop your own taps and targets.