Skip to main content

A Microsoft Fabric Synapse Data Warehouse adapter plugin for dbt

Project description

dbt-fabric

dbt adapter for Microsoft Fabric Synapse Data Warehouse.

The adapter supports dbt-core 1.4 or newer and follows the same versioning scheme. E.g. version 1.1.x of the adapter will be compatible with dbt-core 1.1.x.

Documentation

We've bundled all documentation on the dbt docs site

Installation

This adapter requires the Microsoft ODBC driver to be installed: Windows | macOS | Linux

Debian/Ubuntu

Make sure to install the ODBC headers as well as the driver linked above:

sudo apt-get install -y unixodbc-dev

macOS (Apple Silicon)

Install unixODBC and the ODBC driver via Homebrew:

brew install unixodbc msodbcsql18

Modern Homebrew (post-Sonoma) ships libodbc.3.dylib, but pyodbc wheels are often compiled against libodbc.2.dylib. This mismatch causes the following error at runtime:

Library not loaded: /opt/homebrew/opt/unixodbc/lib/libodbc.2.dylib

Fix — recompile pyodbc against the installed unixODBC:

export LDFLAGS="-L/opt/homebrew/opt/unixodbc/lib"
export CPPFLAGS="-I/opt/homebrew/opt/unixodbc/include"
pip install --force-reinstall --no-binary :all: pyodbc

Alternative — create a compatibility symlink:

ln -s /opt/homebrew/opt/unixodbc/lib/libodbc.3.dylib \
      /opt/homebrew/opt/unixodbc/lib/libodbc.2.dylib

Latest version: PyPI

pip install -U dbt-fabric

Performance guidance for large projects

Fabric Warehouse DDL operations (e.g. CREATE TABLE, sp_rename) hold catalog locks that can block sys.tables/sys.views reads from concurrent dbt sessions. With many models and high thread counts this causes list_<schema> steps to stall for minutes.

Strongly recommended for projects with 500+ models or concurrent dbt runs:

# profiles.yml
my_fabric_project:
  target: dev
  outputs:
    dev:
      type: fabric
      # ... connection settings ...
      threads: 4          # keep low (4–8) to reduce catalog lock pressure
      query_timeout: 30   # fail fast on blocked catalog reads (seconds)

In your dbt_project.yml:

flags:
  cache_selected_only: true  # only list schemas for models in the current run

Or pass --no-populate-cache on the CLI for a single run. This prevents dbt from listing every schema in the warehouse upfront, significantly reducing catalog read pressure during concurrent runs.

Changelog

See the changelog

Contributing

Unit tests Integration tests on Azure Publish Docker images for CI/CD

This adapter is Microsoft-maintained. You are welcome to contribute by creating issues, opening or reviewing pull requests. If you're unsure how to get started, check out our contributing guide.

License

PyPI - License

Code of Conduct

This project and everyone involved is expected to follow the Microsoft Code of Conduct.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt_fabric-1.9.10.tar.gz (46.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dbt_fabric-1.9.10-py3-none-any.whl (61.5 kB view details)

Uploaded Python 3

File details

Details for the file dbt_fabric-1.9.10.tar.gz.

File metadata

  • Download URL: dbt_fabric-1.9.10.tar.gz
  • Upload date:
  • Size: 46.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.13

File hashes

Hashes for dbt_fabric-1.9.10.tar.gz
Algorithm Hash digest
SHA256 1a8967b6958348c219171ddd2ce3dfe2d148c1b5fb1a884ba36dd16573cbd736
MD5 be09cf88b86dacc0aabdf5495e9474b4
BLAKE2b-256 ab19f1d54a5e38020046e9bff9992dbdd2a6152def83bd93410361d9c57f1c4a

See more details on using hashes here.

File details

Details for the file dbt_fabric-1.9.10-py3-none-any.whl.

File metadata

  • Download URL: dbt_fabric-1.9.10-py3-none-any.whl
  • Upload date:
  • Size: 61.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.13

File hashes

Hashes for dbt_fabric-1.9.10-py3-none-any.whl
Algorithm Hash digest
SHA256 5a001d2f0e774c889ea0e502221aa42c5ec6edf3667b806b219f3529802f3734
MD5 4bf25cc93e838a412c500984ea4a0e9e
BLAKE2b-256 46bc89706223dba4e8f863577785be644763da696559f5e985637230e0179712

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page