Skip to main content

vibedata-dlt-fabric-warehouse-studio

Fabric Warehouse Studio execution unit for the VibeData dlt runtime — the installed distribution for Domains whose Fabric data platform is a Warehouse rather than a Lakehouse, running in the Studio-local intent venv. dlt's own fabric destination does the loading; this unit supplies the two things it cannot get inside a Studio container: a brokered, audience-bound access token in place of a client secret, and an OneLake staging area in the Intent's bridge Lakehouse for the parquet that COPY INTO reads back.

import dlt
from vibedata.dlt.fabric_warehouse import setup_environment, finalize, onelake_staging

setup_environment()
pipeline = dlt.pipeline(pipeline_name="<name>", destination="fabric",
                        staging=onelake_staging(), dataset_name="<schema>")
try:
    pipeline.run(source)
except Exception as e:
    finalize(pipeline, error_message=str(e)); raise
finalize(pipeline)

setup_environment() and finalize() are the whole API — the same pair every execution unit exposes. setup_environment() asserts dlt's fabric destination is patched for token auth, registers the credential-broker token provider, and resolves the staging location. finalize() persists the audit tables and stops there: dlt performs the load itself, so unlike the Lakehouse unit there is nothing left to sync.

The staging identity is read from dlt config on the fabric destination — destination.fabric.workspace_id and destination.fabric.bridge_lakehouse_id, both GUIDs, overridable through DESTINATION__FABRIC__*. Fabric's OneLake endpoints reject display names, so a non-GUID is refused at setup.

The dlt pin

dlt>=1.30,<1.31. The fabric destination arrived in 1.30 and only speaks client-secret service-principal auth, so this unit patches five of its private seams: the destination's config spec, FabricCredentials.on_partial, FabricCredentials.get_odbc_dsn_dict, FabricSqlClient.open_connection, and FabricCopyFileLoadJob._ensure_fabric_token_initialized. None of those is public API, so a minor bump can move them and the upper bound is a correctness fence rather than caution. mssql and synapse are never touched.

Upstream support for an access token on the Fabric credentials — an access_token field and attrs_before on the connection — would make _spec.py and _patch.py deletable, leaving only staging and bootstrap.

Metadata

Release files for vibedata-dlt-fabric-warehouse-studio 0.1.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for vibedata-dlt-fabric-warehouse-studio 0.1.1
File Size Uploaded
vibedata_dlt_fabric_warehouse_studio-0.1.1.tar.gz 16.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for vibedata-dlt-fabric-warehouse-studio 0.1.1
File Interpreter ABI Platform
vibedata_dlt_fabric_warehouse_studio-0.1.1-py3-none-any.whl Python 3 none any Details

Total release size: 31.7 kB

Release files / vibedata_dlt_fabric_warehouse_studio-0.1.1.tar.gz

Download URL vibedata_dlt_fabric_warehouse_studio-0.1.1.tar.gz
Size 16.4 kB
Tags Source
SHA-256 checksum
How to use checksums
b196d46f6a0fa28ef2da58835b260ef20b2563c26c9c85ac235a9b9bb03347d7
BLAKE2b-256 checksum
How to use checksums
60833c0a74c8f4a00dc99c1d4997c32484e7397a73f1771d1a92993409618f0d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.11.16

Release files / vibedata_dlt_fabric_warehouse_studio-0.1.1-py3-none-any.whl

Download URL vibedata_dlt_fabric_warehouse_studio-0.1.1-py3-none-any.whl
Size 15.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
f4ba1594603cf4b9a8082cd66ae20b145796cc75a12a5acaf87078527203af07
BLAKE2b-256 checksum
How to use checksums
46b31147a43d2b3dbb3d283d2d74ec874fe5c9d79fea1f0301afe409a382ca57
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.11.16

Release history Release notifications | RSS feed

0.5.0

2 release files

0.4.0

2 release files

0.3.0

2 release files

0.2.0

2 release files

This release

0.1.1 This release

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page