dlt-community-sources 0.5.2

Community-maintained dlt sources for various APIs

dlt-community-sources

Community-maintained dlt sources for various APIs. Install only what you need via extras.

Available Sources

Source	Extra	Description
App Store Connect	app-store-connect	Apple App Store Connect API
Twilio	twilio	Twilio SMS, Calls, Usage Records
NextDNS	nextdns	NextDNS logs and analytics

Installation

pip install dlt-community-sources[app-store-connect]

Or with uv:

uv add dlt-community-sources[app-store-connect]

Usage

import dlt
from dlt_community_sources.twilio import twilio_source

pipeline = dlt.pipeline(
    pipeline_name="twilio",
    destination="duckdb",
    dataset_name="twilio_data",
)

source = twilio_source(
    account_sid="your_account_sid",
    auth_token="your_auth_token",
    resources=["messages", "calls"],
)

load_info = pipeline.run(source)
print(load_info)

See each source's README for detailed usage and authentication options.

Features

All sources share these common features:

• Incremental loading where applicable
• Automatic token/auth refresh
• Rate limit handling with exponential backoff
• Graceful permission handling (skips inaccessible resources)
• Works with any dlt destination

Development

# Fork the repository first, then:
git clone https://github.com/YOUR_USERNAME/dlt-community-sources.git
cd dlt-community-sources
uv sync --group dev
uv run pytest -v
uv run ruff check .

AI-assisted development

This repository is set up for AI coding assistants. Rules and skills are managed in .ai/ as a single source of truth and synced to tool-specific locations via scripts/sync-ai-rules.sh.

File	Tool
.ai/rules.md	Source of truth
CLAUDE.md	Claude Code
.cursor/rules/	Cursor
.github/copilot-instructions.md	GitHub Copilot
.clinerules/	Cline
.continue/rules/	Continue
.ai/skills/*.md → .claude/skills/	Claude Code skills

Edit .ai/ only, then run bash scripts/sync-ai-rules.sh. CI checks that files are in sync.

Contributing

See CONTRIBUTING.md.

License

MIT