Skip to main content

VD Studio dlt runtime for intent (Studio-local) runs targeting DuckDB — secrets from the operator-managed secrets.toml pinned via VD_LOCAL_SECRETS_DIR

Project description

vd-duckdb-dlt-studio

VD Studio dlt runtime for intent (Studio-local) runs targeting DuckDB.

Ships the vd_fabric_dlt_utils import package (same two-call API as the Fabric distributions — exactly one of the family is installed per execution unit, selected at intent creation by the Domain's destination):

import dlt
from vd_fabric_dlt_utils import setup_environment, finalize

setup_environment()
pipeline = dlt.pipeline(pipeline_name="my_pipeline", destination="duckdb", dataset_name="src_x")
try:
    pipeline.run(source)
except Exception as e:
    finalize(pipeline, error_message=str(e))
    raise
finalize(pipeline)

Secrets resolve from the operator-managed $VD_LOCAL_SECRETS_DIR/secrets.toml (Studio sets the env var per intent), keyed [<connection>.credentials]. The provider rewrites the pipeline segment to the connection name resolved from the pipeline folder's config.toml ([pipeline].connection), so any pipeline name resolves the connection's secrets.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vd_duckdb_dlt_studio-0.1.0.tar.gz (5.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vd_duckdb_dlt_studio-0.1.0-py3-none-any.whl (8.4 kB view details)

Uploaded Python 3

File details

Details for the file vd_duckdb_dlt_studio-0.1.0.tar.gz.

File metadata

File hashes

Hashes for vd_duckdb_dlt_studio-0.1.0.tar.gz
Algorithm Hash digest
SHA256 a03704f7b630b211a0d13cb63cf3e8b969601fd26b115d38374dc40fc7a84cac
MD5 6af65194e19cef59a03e05ae57399e5d
BLAKE2b-256 b0267660092c1eccf28f4999d3530196568ee88569a9fed97e10761c7c2fced2

See more details on using hashes here.

File details

Details for the file vd_duckdb_dlt_studio-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for vd_duckdb_dlt_studio-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 7690e158b4e77502a47a286de1e115ca8df653e4f890a58814cd7bf785324a4e
MD5 8bf90937b71f762356ece31e92ca1b07
BLAKE2b-256 3fa263a022bfedb5bf9f67abc5e91f17ba05205463dd290e4377b151ba7f42e7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page