Skip to main content

Community-maintained dlt sources for various APIs

Project description

dlt-community-sources

CI PyPI License: MIT Python 3.12+

Community-maintained dlt sources for various APIs. Install only what you need via extras.

Available Sources

Source Extra Description
App Store Connect app-store-connect Apple App Store Connect API (15 resources)
Twilio twilio Twilio SMS, Calls, Usage Records (12 resources)

Installation

pip install dlt-community-sources[app-store-connect]

Or with uv:

uv add dlt-community-sources[app-store-connect]

Quick start

App Store Connect

import dlt
from dlt_community_sources.app_store_connect import app_store_connect_source

pipeline = dlt.pipeline(
    pipeline_name="app_store_connect",
    destination="bigquery",  # or any dlt destination
    dataset_name="source_app_store_connect",
)

source = app_store_connect_source(
    key_id="YOUR_KEY_ID",
    issuer_id="YOUR_ISSUER_ID",
    private_key=open("AuthKey_XXXXX.p8").read(),
    vendor_number="YOUR_VENDOR_NUMBER",
)

load_info = pipeline.run(source)
print(load_info)

Features

All sources share these common features:

  • Incremental loading where applicable
  • Automatic token/auth refresh
  • Rate limit handling with exponential backoff
  • Graceful permission handling (skips inaccessible resources)
  • Works with any dlt destination

Development

git clone https://github.com/ota2000/dlt-community-sources.git
cd dlt-community-sources
uv sync --group dev
uv run pytest -v
uv run ruff check .

Contributing

See CONTRIBUTING.md.

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dlt_community_sources-0.2.2.tar.gz (8.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dlt_community_sources-0.2.2-py3-none-any.whl (12.5 kB view details)

Uploaded Python 3

File details

Details for the file dlt_community_sources-0.2.2.tar.gz.

File metadata

  • Download URL: dlt_community_sources-0.2.2.tar.gz
  • Upload date:
  • Size: 8.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for dlt_community_sources-0.2.2.tar.gz
Algorithm Hash digest
SHA256 9cd35394218d1511ededa0590f7a46d8c39735114a8ec3288db9c33c90296b0a
MD5 96f09e9e110bbe562c0efb7756063f6b
BLAKE2b-256 441f70fc787e644c56f3b5d98b887c71a1581a523c4e23a47766a93d3e54a56f

See more details on using hashes here.

Provenance

The following attestation bundles were made for dlt_community_sources-0.2.2.tar.gz:

Publisher: publish.yaml on ota2000/dlt-community-sources

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file dlt_community_sources-0.2.2-py3-none-any.whl.

File metadata

File hashes

Hashes for dlt_community_sources-0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 9d35c3ec1616749f3ef49e39c511cd91ab671ebba2303c21a69ff653efb008d8
MD5 67625f74757c4d5dfd0f9048012be6db
BLAKE2b-256 2bb7d5e3858a22491df74d3e0ed83dc10d8dac11c78048cd889a6b2a3277b2d3

See more details on using hashes here.

Provenance

The following attestation bundles were made for dlt_community_sources-0.2.2-py3-none-any.whl:

Publisher: publish.yaml on ota2000/dlt-community-sources

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page