Skip to main content

Community-maintained dlt sources for various APIs

Project description

dlt-community-sources

CI PyPI License: MIT Python 3.12+

Community-maintained dlt sources for various APIs. Install only what you need via extras.

Available Sources

Source Extra Description
App Store Connect app-store-connect Apple App Store Connect API (15 resources)
Twilio twilio Twilio SMS, Calls, Usage Records (12 resources)

Installation

pip install dlt-community-sources[app-store-connect]

Or with uv:

uv add dlt-community-sources[app-store-connect]

Quick start

App Store Connect

import dlt
from dlt_community_sources.app_store_connect import app_store_connect_source

pipeline = dlt.pipeline(
    pipeline_name="app_store_connect",
    destination="bigquery",  # or any dlt destination
    dataset_name="source_app_store_connect",
)

source = app_store_connect_source(
    key_id="YOUR_KEY_ID",
    issuer_id="YOUR_ISSUER_ID",
    private_key=open("AuthKey_XXXXX.p8").read(),
    vendor_number="YOUR_VENDOR_NUMBER",
)

load_info = pipeline.run(source)
print(load_info)

Features

All sources share these common features:

  • Incremental loading where applicable
  • Automatic token/auth refresh
  • Rate limit handling with exponential backoff
  • Graceful permission handling (skips inaccessible resources)
  • Works with any dlt destination

Development

git clone https://github.com/ota2000/dlt-community-sources.git
cd dlt-community-sources
uv sync --group dev
uv run pytest -v
uv run ruff check .

Contributing

See CONTRIBUTING.md.

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dlt_community_sources-0.3.0.tar.gz (8.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dlt_community_sources-0.3.0-py3-none-any.whl (12.5 kB view details)

Uploaded Python 3

File details

Details for the file dlt_community_sources-0.3.0.tar.gz.

File metadata

  • Download URL: dlt_community_sources-0.3.0.tar.gz
  • Upload date:
  • Size: 8.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for dlt_community_sources-0.3.0.tar.gz
Algorithm Hash digest
SHA256 b8d634593e6356e9f7552c6a2890edd6601ff93cb7025dc7d2280000d6921164
MD5 3f0b75d4afe01152732d84fb8c7ab4cb
BLAKE2b-256 d045581fb91ac38540210e9fa0747d4ef4f4a98236642fd555e61713e197bd72

See more details on using hashes here.

Provenance

The following attestation bundles were made for dlt_community_sources-0.3.0.tar.gz:

Publisher: publish.yaml on ota2000/dlt-community-sources

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file dlt_community_sources-0.3.0-py3-none-any.whl.

File metadata

File hashes

Hashes for dlt_community_sources-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 711daab72869ea5dfaaeff1c597ce01c7827aaa6be3c2e4f6859e8e844f19465
MD5 fb1daac988a2e369f1b5c6c08d89ea0d
BLAKE2b-256 f2641de76a19f7da650eb93994e2510693bf07c9626fabd4e156a0a6b75aafdd

See more details on using hashes here.

Provenance

The following attestation bundles were made for dlt_community_sources-0.3.0-py3-none-any.whl:

Publisher: publish.yaml on ota2000/dlt-community-sources

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page