Skip to main content

VD Studio dlt runtime for intent (Studio-local) runs targeting DuckDB — secrets from the operator-managed secrets.toml pinned via VD_LOCAL_SECRETS_DIR

Project description

vd-duckdb-dlt-studio

VD Studio dlt runtime for intent (Studio-local) runs targeting DuckDB.

Ships the vd_duckdb_dlt_utils import package (same two-call API convention as the Fabric distributions — exactly one of the family is installed per execution unit, selected at intent creation by the Domain's destination):

import dlt
from vd_duckdb_dlt_utils import setup_environment, finalize

setup_environment()
pipeline = dlt.pipeline(pipeline_name="my_pipeline", destination="duckdb", dataset_name="src_x")
try:
    pipeline.run(source)
except Exception as e:
    finalize(pipeline, error_message=str(e))
    raise
finalize(pipeline)

Secrets resolve from the operator-managed $VD_LOCAL_SECRETS_DIR/secrets.toml (Studio sets the env var per intent), keyed [<connection>.credentials]. The provider rewrites the pipeline segment to the connection name resolved from the pipeline folder's config.toml ([pipeline].connection), so any pipeline name resolves the connection's secrets.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vd_duckdb_dlt_studio-0.3.0.tar.gz (5.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vd_duckdb_dlt_studio-0.3.0-py3-none-any.whl (8.4 kB view details)

Uploaded Python 3

File details

Details for the file vd_duckdb_dlt_studio-0.3.0.tar.gz.

File metadata

File hashes

Hashes for vd_duckdb_dlt_studio-0.3.0.tar.gz
Algorithm Hash digest
SHA256 25d42414e54445336d1f2d072e68dddbcf9da51df22e23311897fb70a1f559b3
MD5 bd11e1ab4aa1ef3ee6da0ef35a05cf0c
BLAKE2b-256 c85c794df7ce9a9b8c15e55b7906aff5cf92decda3cbbece87120e1860377f8f

See more details on using hashes here.

File details

Details for the file vd_duckdb_dlt_studio-0.3.0-py3-none-any.whl.

File metadata

File hashes

Hashes for vd_duckdb_dlt_studio-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 edfe5e674d71318a3063354af8c8133ed87463444c9241341fa8d9e67143d9c6
MD5 f32421a855029a54730fecbfa44cdb26
BLAKE2b-256 9142c87df2860421dda938e66a910061352167848b307d60dbdde63b3afdfc0c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page