Skip to main content

A Python wrapper library for Microsoft Fabric and Power BI that provides a simple, consistent interface to the official Fabric REST APIs, with automatic fallback to Power BI REST APIs when required. Designed to run in Fabric notebooks, pure Python scripts, or as part of YAML-based CI/CD workflows.

Project description

Welcome to pyfabricops

PyPI version License: MIT Python versions Typing status
Ruff Tests

A Python wrapper library for Microsoft Fabric (and Power BI) operations, providing a simple interface to the official Fabric REST APIs. Falls back to Power BI REST APIs where needed. Designed to run in Python notebooks, pure Python scripts or integrated into YAML-based workflows for CI/CD. Access to the repositoy on GitHub.

๐Ÿš€ Features

  • Authenticate using environment variables (GitHub Secrets, ADO Secrets, .env ...)
  • Manage workspaces, capacities, semantic models, lakehouses, reports and connections
  • Execute Git operations and automate Fabric deployment flows (Power BI inclusive)
  • Capture and Manage Git branches automatically for CI/CD scenarios
  • Many use cases and scenarios including yaml for test and deploy using GitHub Actions

๐Ÿ“ƒ Documentation

Access: https://pyfabricops.readthedocs.io/en/latest/

โœ… Requirements

  • Requires Python >=3.10,<3.15

โš’๏ธ Installation

pip install -U pyfabricops

๐Ÿ› ๏ธ Development setup

# Install uv
pip install uv

# Sync dev dependencies (creates .venv automatically)
uv sync --group dev

โš™๏ธ Usage

Create a repository and clone it locally. Create a notebook or a script and import the library:

# Import the library
import pyfabricops as pf

Set the authentication provider

Set auth environment variables acording to your authentication method

Environment variables (.env, GitHub Secrets, Ado Secrets...)

pf.set_auth_provider("env")

This is the default behavior. You can set these in a .env file or directly in your environment (GitHub Secrets, ADO Secrets...).

Example .env file:

FAB_CLIENT_ID=your_client_id_here
FAB_CLIENT_SECRET=your_client_secret_here
FAB_TENANT_ID=your_tenant_id_here
FAB_USERNAME=your_username_here   # Necessary for some functions with no SPN support
FAB_PASSWORD=your_password_here   # Necessary for some functions with no SPN support

OAuth (Interactive)

pf.set_auth_provider("oauth")

This will open a browser window for user authentication.

Fabric Notebook (Authenticated User)

pf.set_auth_provider("fabric")

This method is designed for use inside Microsoft Fabric notebooks where the user is already authenticated.
It uses notebookutils.credentials.getToken() to retrieve the access token automatically.
No browser authentication required - perfect for notebooks running in Fabric!

See more details in the authentication guide

Create a repository and clone it locally. Prepare your environment with the required variables according to your authentication method (GitHub Secrets, ADO Secrets, .env ...)

Branches configuration

Create a branches.json file in the root of your repository to define your branch mappings:

{
    "main": "-PRD",
    "master": "-PRD",
    "dev": "-DEV",
    "develop": "-DEV",
    "staging": "-STG"
}

This file maps your local branches to Fabric branches, allowing the library to automatically manage branch names for CI/CD scenarios.

๐Ÿช„ Examples

Visit: https://github.com/alisonpezzott/pyfabricops-examples

๐Ÿงฌ Project Structure

src/
โ””โ”€โ”€ pyfabricops/
    โ”œโ”€โ”€ api/
    โ”‚   โ”œโ”€โ”€ __init__.py
    โ”‚   โ”œโ”€โ”€ api.py
    โ”‚   โ”œโ”€โ”€ auth.py
    โ”‚   โ””โ”€โ”€ scopes.py
    โ”œโ”€โ”€ cd/
    โ”‚   โ”œโ”€โ”€ __init__.py
    โ”‚   โ””โ”€โ”€ support_files.py
    โ”œโ”€โ”€ core/
    โ”‚   โ”œโ”€โ”€ __init__.py
    โ”‚   โ”œโ”€โ”€ capacities.py
    โ”‚   โ”œโ”€โ”€ connections.py
    โ”‚   โ”œโ”€โ”€ deployment_pipelines.py
    โ”‚   โ”œโ”€โ”€ domains.py
    โ”‚   โ”œโ”€โ”€ folders.py
    โ”‚   โ”œโ”€โ”€ gateways.py
    โ”‚   โ”œโ”€โ”€ gateways_encryp_creds.py
    โ”‚   โ”œโ”€โ”€ git.py
    โ”‚   โ”œโ”€โ”€ tags.py
    โ”‚   โ””โ”€โ”€ workspaces.py
    โ”œโ”€โ”€ dmv/
    โ”‚   โ”œโ”€โ”€ __init__.py
    โ”‚   โ””โ”€โ”€ dmv.py
    โ”œโ”€โ”€ graph/
    โ”‚   โ”œโ”€โ”€ __init__.py
    โ”‚   โ””โ”€โ”€ users.py
    โ”œโ”€โ”€ helpers/
    โ”‚   โ”œโ”€โ”€ __init__.py
    โ”‚   โ”œโ”€โ”€ data_pipelines.py
    โ”‚   โ”œโ”€โ”€ data_pipelines.py
    โ”‚   โ”œโ”€โ”€ dataflows_gen1.py
    โ”‚   โ”œโ”€โ”€ dataflows_gen2.py
    โ”‚   โ”œโ”€โ”€ environments.py
    โ”‚   โ”œโ”€โ”€ folders.py
    โ”‚   โ”œโ”€โ”€ items.py
    โ”‚   โ”œโ”€โ”€ lakehouses.py
    โ”‚   โ”œโ”€โ”€ notebooks.py
    โ”‚   โ”œโ”€โ”€ reports.py
    โ”‚   โ”œโ”€โ”€ semantic_models.py
    โ”‚   โ”œโ”€โ”€ warehouses.py
    โ”‚   โ””โ”€โ”€ workspaces.py
    โ”œโ”€โ”€ items/
    โ”‚   โ”œโ”€โ”€ __init__.py
    โ”‚   โ”œโ”€โ”€ data_pipelines.py
    โ”‚   โ”œโ”€โ”€ dataflows_gen1.py
    โ”‚   โ”œโ”€โ”€ dataflows_gen2.py
    โ”‚   โ”œโ”€โ”€ environments.py
    โ”‚   โ”œโ”€โ”€ items.py
    โ”‚   โ”œโ”€โ”€ lakehouses.py
    โ”‚   โ”œโ”€โ”€ notebooks.py
    โ”‚   โ”œโ”€โ”€ reports.py
    โ”‚   โ”œโ”€โ”€ semantic_models.py
    โ”‚   โ”œโ”€โ”€ shortcuts.py
    โ”‚   โ”œโ”€โ”€ spark.py
    โ”‚   โ”œโ”€โ”€ variable_libraries.py
    โ”‚   โ””โ”€โ”€ warehouses.py
    โ”œโ”€โ”€ utils/
    โ”‚   โ”œโ”€โ”€ __init__.py
    โ”‚   โ”œโ”€โ”€ decorators.py
    โ”‚   โ”œโ”€โ”€ exceptions.py
    โ”‚   โ”œโ”€โ”€ logging.py
    โ”‚   โ”œโ”€โ”€ schemas.py
    โ”‚   โ””โ”€โ”€ utils.py
    โ”œโ”€โ”€ __init__.py
    โ””โ”€โ”€ _version.py

Logging configuration

The custom logging system implemented in pyfabricops provides a complete and flexible solution for monitoring and debugging the library.

๐ŸŽจ Custom Formatting

  • Automatic colors: Different colors for each log level (DEBUG=Cyan, INFO=Green, WARNING=Yellow, ERROR=Red, CRITICAL=Magenta)
  • Multiple styles:
    • minimal: Only timestamp, level and message
    • standard: Includes module name in compact form
    • detailed: Complete format with all information

๐ŸŽ›๏ธ Easy Configuration

import pyfabricops as pf

# Basic configuration
pf.setup_logging(level="INFO", format_style="standard")

# Debug mode for development
pf.enable_debug_mode(include_external=False)

# Disable logging completely
pf.disable_logging()

# Reset to default configuration
pf.reset_logging()

For complete logging configuration options, refer to the logging_system.md

โค๏ธContributing

  1. Fork this repository
  2. Create a new branch (feat/my-feature)
  3. Run uv sync --group dev to set up the development environment
  4. Run uv run ruff format --check --diff . && uv run ruff check .
  5. Run uv run pytest -s -x --cov=pyfabricops -v to run tests
  6. Submit a pull request to branch develop ๐Ÿš€

๐Ÿš€ Publishing

For Maintainers

To publish a new version to PyPI:

  1. Update the version in pyproject.toml and src/pyfabricops/_version.py
  2. Commit and push changes
  3. Create a new release on GitHub with a tag (e.g., v0.1.0)
  4. The GitHub Action will automatically:
    • Run tests
    • Build the package
    • Publish to PyPI

Testing with TestPyPI

# Build and publish to TestPyPI
uv build
uv publish --publish-url https://test.pypi.org/legacy/ --token <your-testpypi-token>

# Install from TestPyPI
pip install --index-url https://test.pypi.org/simple/ pyfabricops

Prerequisites for Publishing

๐Ÿž Issues

If you encounter any issues, please report them at https://github.com/alisonpezzott/pyfabricops/issues

โš–๏ธ License

This project is licensed under the MIT License โ€“ see the LICENSE file for details.

๐ŸŒŸ Acknowledgements

Created and maintained by Alison Pezzott Feedback, issues and stars are welcome ๐ŸŒŸ

YouTube subscribers GitHub followers LinkedIn Discord Telegram Instagram

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyfabricops-0.5.2.tar.gz (1.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pyfabricops-0.5.2-py3-none-any.whl (119.8 kB view details)

Uploaded Python 3

File details

Details for the file pyfabricops-0.5.2.tar.gz.

File metadata

  • Download URL: pyfabricops-0.5.2.tar.gz
  • Upload date:
  • Size: 1.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.10 {"installer":{"name":"uv","version":"0.10.10","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for pyfabricops-0.5.2.tar.gz
Algorithm Hash digest
SHA256 acdc4e534d89d5d0a73a43fbbf0f9809369d13d724d78cc068da6629626b26c7
MD5 49e3fdaaf67d02af5d21abba0ff05716
BLAKE2b-256 0988d79227f9f444a0117746ce6c8d8837db9ba199eaa4d862ee6eb48efd5df6

See more details on using hashes here.

File details

Details for the file pyfabricops-0.5.2-py3-none-any.whl.

File metadata

  • Download URL: pyfabricops-0.5.2-py3-none-any.whl
  • Upload date:
  • Size: 119.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.10 {"installer":{"name":"uv","version":"0.10.10","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for pyfabricops-0.5.2-py3-none-any.whl
Algorithm Hash digest
SHA256 dc16f5031da5a9afa2f5be54cbd259b081cd830be825c1846a074524db0564b4
MD5 1e61f7044eb9e099cb6c79a5727d8eec
BLAKE2b-256 ac8ea851cc6c41dcb24507c233d3134d90902a48ad7a5ce7a38660fe84812c68

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page