dlt-community-sources 0.4.0

Community-maintained dlt sources for various APIs

dlt-community-sources

Community-maintained dlt sources for various APIs. Install only what you need via extras.

Available Sources

Source	Extra	Description
App Store Connect	app-store-connect	Apple App Store Connect API (15 resources)
Twilio	twilio	Twilio SMS, Calls, Usage Records (12 resources)
NextDNS	nextdns	NextDNS logs and analytics (9 resources)

Installation

pip install dlt-community-sources[app-store-connect]

Or with uv:

uv add dlt-community-sources[app-store-connect]

Quick start

App Store Connect

import dlt
from dlt_community_sources.app_store_connect import app_store_connect_source

pipeline = dlt.pipeline(
    pipeline_name="app_store_connect",
    destination="bigquery",  # or any dlt destination
    dataset_name="source_app_store_connect",
)

source = app_store_connect_source(
    key_id="YOUR_KEY_ID",
    issuer_id="YOUR_ISSUER_ID",
    private_key=open("AuthKey_XXXXX.p8").read(),
    vendor_number="YOUR_VENDOR_NUMBER",
)

load_info = pipeline.run(source)
print(load_info)

Features

All sources share these common features:

• Incremental loading where applicable
• Automatic token/auth refresh
• Rate limit handling with exponential backoff
• Graceful permission handling (skips inaccessible resources)
• Works with any dlt destination

Development

git clone https://github.com/ota2000/dlt-community-sources.git
cd dlt-community-sources
uv sync --group dev
uv run pytest -v
uv run ruff check .

Contributing

See CONTRIBUTING.md.

License

MIT