Skip to main content

Community-maintained dlt sources for various APIs

Project description

dlt-community-sources

CI PyPI License: MIT Python 3.12+

Community-maintained dlt sources for various APIs. Install only what you need via extras.

Available Sources

Source Extra Description
App Store Connect app-store-connect Apple App Store Connect API
Twilio twilio Twilio SMS, Calls, Usage Records
NextDNS nextdns NextDNS logs and analytics

Installation

pip install dlt-community-sources[app-store-connect]

Or with uv:

uv add dlt-community-sources[app-store-connect]

Quick start

App Store Connect

import dlt
from dlt_community_sources.app_store_connect import app_store_connect_source

pipeline = dlt.pipeline(
    pipeline_name="app_store_connect",
    destination="bigquery",  # or any dlt destination
    dataset_name="source_app_store_connect",
)

source = app_store_connect_source(
    key_id="YOUR_KEY_ID",
    issuer_id="YOUR_ISSUER_ID",
    private_key=open("AuthKey_XXXXX.p8").read(),
    vendor_number="YOUR_VENDOR_NUMBER",
)

load_info = pipeline.run(source)
print(load_info)

Features

All sources share these common features:

  • Incremental loading where applicable
  • Automatic token/auth refresh
  • Rate limit handling with exponential backoff
  • Graceful permission handling (skips inaccessible resources)
  • Works with any dlt destination

Development

git clone https://github.com/ota2000/dlt-community-sources.git
cd dlt-community-sources
uv sync --group dev
uv run pytest -v
uv run ruff check .

Contributing

See CONTRIBUTING.md.

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dlt_community_sources-0.5.0.tar.gz (12.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dlt_community_sources-0.5.0-py3-none-any.whl (20.4 kB view details)

Uploaded Python 3

File details

Details for the file dlt_community_sources-0.5.0.tar.gz.

File metadata

  • Download URL: dlt_community_sources-0.5.0.tar.gz
  • Upload date:
  • Size: 12.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for dlt_community_sources-0.5.0.tar.gz
Algorithm Hash digest
SHA256 28befe6fc03d5f32eea6af7d7bcb30c5639b683c3741227adb7bb9489db5d2b3
MD5 26af0900a2e59bb94026349c630d7176
BLAKE2b-256 efaaaa66f1b9333aa07f14a80a306d3e99eb560c87f63bcb4f1767e7099632de

See more details on using hashes here.

Provenance

The following attestation bundles were made for dlt_community_sources-0.5.0.tar.gz:

Publisher: publish.yaml on ota2000/dlt-community-sources

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file dlt_community_sources-0.5.0-py3-none-any.whl.

File metadata

File hashes

Hashes for dlt_community_sources-0.5.0-py3-none-any.whl
Algorithm Hash digest
SHA256 e66099375984c1cb52901aa01c0f76cd3f9042e395b18754cb2ec9c1a6dffe24
MD5 94307b0a10cb17dac2fe39e497c34795
BLAKE2b-256 33e2217076ae1c91d8a10ae67aec1f5fc70c2d7c57e0349d0debd98316d867bf

See more details on using hashes here.

Provenance

The following attestation bundles were made for dlt_community_sources-0.5.0-py3-none-any.whl:

Publisher: publish.yaml on ota2000/dlt-community-sources

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page