Skip to main content

VD Studio dlt runtime for intent (Studio-local) runs targeting DuckDB — secrets from the operator-managed secrets.toml pinned via VD_LOCAL_SECRETS_DIR

Project description

vd-duckdb-dlt-studio

VD Studio dlt runtime for intent (Studio-local) runs targeting DuckDB.

Ships the vd_duckdb_dlt_utils import package (same two-call API convention as the Fabric distributions — exactly one of the family is installed per execution unit, selected at intent creation by the Domain's destination):

import dlt
from vd_duckdb_dlt_utils import setup_environment, finalize

setup_environment()
pipeline = dlt.pipeline(pipeline_name="my_pipeline", destination="duckdb", dataset_name="src_x")
try:
    pipeline.run(source)
except Exception as e:
    finalize(pipeline, error_message=str(e))
    raise
finalize(pipeline)

Secrets resolve from the operator-managed $VD_LOCAL_SECRETS_DIR/secrets.toml (Studio sets the env var per intent), keyed [<connection>.credentials]. The provider rewrites the pipeline segment to the connection name resolved from the pipeline folder's config.toml ([pipeline].connection), so any pipeline name resolves the connection's secrets.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vd_duckdb_dlt_studio-0.2.0.tar.gz (5.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vd_duckdb_dlt_studio-0.2.0-py3-none-any.whl (8.4 kB view details)

Uploaded Python 3

File details

Details for the file vd_duckdb_dlt_studio-0.2.0.tar.gz.

File metadata

File hashes

Hashes for vd_duckdb_dlt_studio-0.2.0.tar.gz
Algorithm Hash digest
SHA256 096e7bee34bc453ea39e473d7315f1098ed6b36b4e05d1767f16ab213356721e
MD5 dd597a5ccc6cfb3d607605873bf14ca4
BLAKE2b-256 2b48e133faf337de37614252ca933727ff1f39cdfb91eb6c2ac9aa782f55bbeb

See more details on using hashes here.

File details

Details for the file vd_duckdb_dlt_studio-0.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for vd_duckdb_dlt_studio-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 5b5b70b21de7c64626a2b21cc70dce1219c313097250a73efaa837f1a7ecaa60
MD5 30728301465f5c07b2ab48cc30b2b196
BLAKE2b-256 c27bc9222a203f51cd764d0d169e78c245bbf53ce8174085321d3bec3057b2e3

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page