Skip to main content

Community-maintained dlt sources for various APIs

Project description

dlt-community-sources

CI PyPI License: MIT Python 3.12+

Community-maintained dlt sources for various APIs. Install only what you need via extras.

Available Sources

Source Extra Description
App Store Connect app-store-connect Apple App Store Connect API (15 resources)
Twilio twilio Twilio SMS, Calls, Usage Records (12 resources)

Installation

pip install dlt-community-sources[app-store-connect]

Or with uv:

uv add dlt-community-sources[app-store-connect]

Quick start

App Store Connect

import dlt
from dlt_community_sources.app_store_connect import app_store_connect_source

pipeline = dlt.pipeline(
    pipeline_name="app_store_connect",
    destination="bigquery",  # or any dlt destination
    dataset_name="source_app_store_connect",
)

source = app_store_connect_source(
    key_id="YOUR_KEY_ID",
    issuer_id="YOUR_ISSUER_ID",
    private_key=open("AuthKey_XXXXX.p8").read(),
    vendor_number="YOUR_VENDOR_NUMBER",
)

load_info = pipeline.run(source)
print(load_info)

Features

All sources share these common features:

  • Incremental loading where applicable
  • Automatic token/auth refresh
  • Rate limit handling with exponential backoff
  • Graceful permission handling (skips inaccessible resources)
  • Works with any dlt destination

Development

git clone https://github.com/ota2000/dlt-community-sources.git
cd dlt-community-sources
uv sync --group dev
uv run pytest -v
uv run ruff check .

Contributing

See CONTRIBUTING.md.

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dlt_community_sources-0.2.1.tar.gz (8.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dlt_community_sources-0.2.1-py3-none-any.whl (12.3 kB view details)

Uploaded Python 3

File details

Details for the file dlt_community_sources-0.2.1.tar.gz.

File metadata

  • Download URL: dlt_community_sources-0.2.1.tar.gz
  • Upload date:
  • Size: 8.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for dlt_community_sources-0.2.1.tar.gz
Algorithm Hash digest
SHA256 68cef204cdccccd3119cab4ab756413641f0d6a785bfc6b9b95d7ef1dee43bf5
MD5 c534166429abca950ecc3bfc8bf7ab14
BLAKE2b-256 db68ee450ca9354b6c8c944bdaf8f9121332d495032f89e513ddf319944333d8

See more details on using hashes here.

Provenance

The following attestation bundles were made for dlt_community_sources-0.2.1.tar.gz:

Publisher: publish.yaml on ota2000/dlt-community-sources

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file dlt_community_sources-0.2.1-py3-none-any.whl.

File metadata

File hashes

Hashes for dlt_community_sources-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 fac567617f61cb6598e7bb1b52b890f9bf1705b082852d717e5a67b4889636fc
MD5 58bdbfbb9b3b62bb8bfe8beac4d2d683
BLAKE2b-256 aebb69a264ca1bf268ad9c4722e20ce66f693e039c9f5a77520df2c768c3d628

See more details on using hashes here.

Provenance

The following attestation bundles were made for dlt_community_sources-0.2.1-py3-none-any.whl:

Publisher: publish.yaml on ota2000/dlt-community-sources

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page