A framework for writing Airbyte Connectors.
Verified details
These details have been verified by PyPIProject links
GitHub Statistics
Maintainers
Project description
Airbyte Python CDK and Low-Code CDK
Airbyte Python CDK is a framework for building Airbyte API Source Connectors. It provides a set of classes and helpers that make it easy to build a connector against an HTTP API (REST, GraphQL, etc), or a generic Python source connector.
Building Connectors with the CDK
If you're looking to build a connector, we highly recommend that you first
start with the Connector Builder.
It should be enough for 90% connectors out there. For more flexible and complex connectors, use the
low-code CDK and SourceDeclarativeManifest.
For more information on building connectors, please see the Connector Development guide on docs.airbyte.com.
Python CDK Overview
Airbyte CDK code is within airbyte_cdk directory. Here's a high level overview of what's inside:
airbyte_cdk/connector_builder. Internal wrapper that helps the Connector Builder platform run a declarative manifest (low-code connector). You should not use this code directly. If you need to run aSourceDeclarativeManifest, take a look atsource-declarative-manifestconnector implementation instead.airbyte_cdk/cli/source_declarative_manifest. This module defines thesource-declarative-manifest(aka "SDM") connector execution logic and associated CLI.airbyte_cdk/destinations. Basic Destination connector support! If you're building a Destination connector in Python, try that. Some of our vector DB destinations likedestination-pineconeare using that code.airbyte_cdk/modelsexposeairbyte_protocol.modelsas a part ofairbyte_cdkpackage.airbyte_cdk/sources/concurrent_sourceis the Concurrent CDK implementation. It supports reading data from streams concurrently per slice / partition, useful for connectors with high throughput and high number of records.airbyte_cdk/sources/declarativeis the low-code CDK. It works on top of Airbyte Python CDK, but provides a declarative manifest language to define streams, operations, etc. This makes it easier to build connectors without writing Python code.airbyte_cdk/sources/file_basedis the CDK for file-based sources. Examples include S3, Azure, GCS, etc.
Contributing
For instructions on how to contribute, please see our Contributing Guide.
Release Management
Please see the Release Management guide for information on how to perform releases and pre-releases.
Project details
Verified details
These details have been verified by PyPIProject links
GitHub Statistics
Maintainers
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file airbyte_cdk-6.11.2.dev1.tar.gz.
File metadata
- Download URL: airbyte_cdk-6.11.2.dev1.tar.gz
- Upload date:
- Size: 372.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/5.1.1 CPython/3.12.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | cc87864b71f4194d812d78a93373abc632e1e97c8b19d876f2292fe928e4319f |
|
| MD5 | 9d54d630be5ba2f1e0c90f8275b413f9 |
|
| BLAKE2b-256 | 94dae2c493726a8972277b56012e0452528584624c429daefc7722fb56db79e4 |
Provenance
The following attestation bundles were made for airbyte_cdk-6.11.2.dev1.tar.gz:
Publisher:
pypi_publish.yml on airbytehq/airbyte-python-cdk
-
Statement:
- Statement type:
https://in-toto.io/Statement/v1 - Predicate type:
https://docs.pypi.org/attestations/publish/v1 - Subject name:
airbyte_cdk-6.11.2.dev1.tar.gz - Subject digest:
cc87864b71f4194d812d78a93373abc632e1e97c8b19d876f2292fe928e4319f - Sigstore transparency entry: 155259387
- Sigstore integration time:
- Permalink:
airbytehq/airbyte-python-cdk@588fdb705242fe0499b115ce15a9fcc0395617dd - Branch / Tag:
refs/heads/brian/async_retriever_refactor_to_stream_slicer - Owner: https://github.com/airbytehq
- Access:
public
- Token Issuer:
https://token.actions.githubusercontent.com - Runner Environment:
github-hosted - Publication workflow:
pypi_publish.yml@588fdb705242fe0499b115ce15a9fcc0395617dd - Trigger Event:
workflow_dispatch
- Statement type:
File details
Details for the file airbyte_cdk-6.11.2.dev1-py3-none-any.whl.
File metadata
- Download URL: airbyte_cdk-6.11.2.dev1-py3-none-any.whl
- Upload date:
- Size: 539.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/5.1.1 CPython/3.12.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 40d3314875834b80c72323e6b59fc53dfea2709d73c461ce82358d9b87207647 |
|
| MD5 | de8aeacb3467f9ef4e8e4ab50f8a40d4 |
|
| BLAKE2b-256 | aef63e1a785ed7a16f77911f6f5e0db7bc8f585a582524c7e92261f6232f67b1 |
Provenance
The following attestation bundles were made for airbyte_cdk-6.11.2.dev1-py3-none-any.whl:
Publisher:
pypi_publish.yml on airbytehq/airbyte-python-cdk
-
Statement:
- Statement type:
https://in-toto.io/Statement/v1 - Predicate type:
https://docs.pypi.org/attestations/publish/v1 - Subject name:
airbyte_cdk-6.11.2.dev1-py3-none-any.whl - Subject digest:
40d3314875834b80c72323e6b59fc53dfea2709d73c461ce82358d9b87207647 - Sigstore transparency entry: 155259389
- Sigstore integration time:
- Permalink:
airbytehq/airbyte-python-cdk@588fdb705242fe0499b115ce15a9fcc0395617dd - Branch / Tag:
refs/heads/brian/async_retriever_refactor_to_stream_slicer - Owner: https://github.com/airbytehq
- Access:
public
- Token Issuer:
https://token.actions.githubusercontent.com - Runner Environment:
github-hosted - Publication workflow:
pypi_publish.yml@588fdb705242fe0499b115ce15a9fcc0395617dd - Trigger Event:
workflow_dispatch
- Statement type:
