Skip to main content

Community-maintained dlt sources for various APIs

Project description

dlt-community-sources

CI PyPI License: MIT Python 3.12+

Community-maintained dlt sources for various APIs. Install only what you need via extras.

Available Sources

Source Extra Description
App Store Connect app-store-connect Apple App Store Connect API (15 resources)
Twilio twilio Twilio SMS, Calls, Usage Records (12 resources)
NextDNS nextdns NextDNS logs and analytics (9 resources)

Installation

pip install dlt-community-sources[app-store-connect]

Or with uv:

uv add dlt-community-sources[app-store-connect]

Quick start

App Store Connect

import dlt
from dlt_community_sources.app_store_connect import app_store_connect_source

pipeline = dlt.pipeline(
    pipeline_name="app_store_connect",
    destination="bigquery",  # or any dlt destination
    dataset_name="source_app_store_connect",
)

source = app_store_connect_source(
    key_id="YOUR_KEY_ID",
    issuer_id="YOUR_ISSUER_ID",
    private_key=open("AuthKey_XXXXX.p8").read(),
    vendor_number="YOUR_VENDOR_NUMBER",
)

load_info = pipeline.run(source)
print(load_info)

Features

All sources share these common features:

  • Incremental loading where applicable
  • Automatic token/auth refresh
  • Rate limit handling with exponential backoff
  • Graceful permission handling (skips inaccessible resources)
  • Works with any dlt destination

Development

git clone https://github.com/ota2000/dlt-community-sources.git
cd dlt-community-sources
uv sync --group dev
uv run pytest -v
uv run ruff check .

Contributing

See CONTRIBUTING.md.

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dlt_community_sources-0.4.1.tar.gz (11.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dlt_community_sources-0.4.1-py3-none-any.whl (18.5 kB view details)

Uploaded Python 3

File details

Details for the file dlt_community_sources-0.4.1.tar.gz.

File metadata

  • Download URL: dlt_community_sources-0.4.1.tar.gz
  • Upload date:
  • Size: 11.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for dlt_community_sources-0.4.1.tar.gz
Algorithm Hash digest
SHA256 b128b82cc70b9b2987a05249476a3d634f12ce25a217da90b74aaf2e82e71b68
MD5 9e2a9298faaf77b28beac4147185f9c1
BLAKE2b-256 b4656cfb5c0ef15ec4a5484f529004ca1b9aa2ff86ce1feb2ab8411d9ccf8ef7

See more details on using hashes here.

Provenance

The following attestation bundles were made for dlt_community_sources-0.4.1.tar.gz:

Publisher: publish.yaml on ota2000/dlt-community-sources

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file dlt_community_sources-0.4.1-py3-none-any.whl.

File metadata

File hashes

Hashes for dlt_community_sources-0.4.1-py3-none-any.whl
Algorithm Hash digest
SHA256 bc9f845948ede80440d835002af80961304f50cb90cfde0c890945995f8bcc8f
MD5 12a0aa2fc6a358200b3f874c53048ea4
BLAKE2b-256 dd1c3c7f45d7b3eba7f3d2c195f0051d43f3b50a7b47a761b50ddbf2dc170250

See more details on using hashes here.

Provenance

The following attestation bundles were made for dlt_community_sources-0.4.1-py3-none-any.whl:

Publisher: publish.yaml on ota2000/dlt-community-sources

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page