Skip to main content

The GizmoSQL adapter plugin for dbt

Project description

dbt-gizmosql

An dbt adapter for GizmoSQL

dbt-gizmosql-ci Supported Python Versions PyPI version PyPI Downloads

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

dbt is the T in ELT. Organize, cleanse, denormalize, filter, rename, and pre-aggregate the raw data in your warehouse so that it's ready for analysis.

GizmoSQL

GizmoSQL is an Apache Arrow Flight-based SQL engine for data warehouses. It is designed to be fast, scalable, and easy to use.

It has DuckDB and SQLite back-ends. You can see more information about GizmoSQL here.

Installation

Option 1 - from PyPi

# Create the virtual environment
python3 -m venv .venv

# Activate the virtual environment
. .venv/bin/activate

pip install --upgrade pip

python -m pip install dbt-core dbt-gizmosql

Option 2 - from source - for development of the adapter

git clone https://github.com/gizmodata/dbt-gizmosql

cd dbt-gizmosql

# Create the virtual environment
python3 -m venv .venv

# Activate the virtual environment
. .venv/bin/activate

# Upgrade pip, setuptools, and wheel
pip install --upgrade pip setuptools wheel

# Install the dbt GizmoSQL adapter - in editable mode with dev dependencies
pip install --editable .[dev]

Usage of the dbt GizmoSQL adapter

Option 1: dbt init

You can setup the adapter by running dbt init - and choosing values that the wizard prompts you for.

Then you can run by going into the directory for the project you just created:

dbt run

Option 2: Setup dbt.profiles.yml

Add something like the following to your ~/.dbt.profiles.yml file (change the values to match your environment):

my-gizmosql-db:
  target: dev
  outputs:
    dev:
      type: gizmosql
      host: localhost
      port: 31337
      user: [username]
      password: [password]
      use_encryption: True
      tls_skip_verify: True
      threads: 2

** Note **

Adapter Scaffold default Versioning

This adapter plugin follows semantic versioning. The version of this plugin is v1.11.x, in order to be compatible with dbt Core v1.11.x.

It's also brand new! For GizmoSQL-specific functionality, we will aim for backwards-compatibility wherever possible. We are likely to be iterating more quickly than most major-version-1 software projects. To that end, backwards-incompatible changes will be clearly communicated and limited to minor versions (once every three months).

Join the dbt Community

Reporting bugs and contributing code

Code of Conduct

Everyone interacting in the dbt project's codebases, issue trackers, chat rooms, and mailing lists is expected to follow the dbt Code of Conduct.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt_gizmosql-1.11.2.tar.gz (14.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dbt_gizmosql-1.11.2-py3-none-any.whl (14.7 kB view details)

Uploaded Python 3

File details

Details for the file dbt_gizmosql-1.11.2.tar.gz.

File metadata

  • Download URL: dbt_gizmosql-1.11.2.tar.gz
  • Upload date:
  • Size: 14.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for dbt_gizmosql-1.11.2.tar.gz
Algorithm Hash digest
SHA256 04fd5b1a10d6a9ad79ef319eaa28d6854aa51b449297a5c33619b68f1e248929
MD5 b75dcc00ef1381ce27fd6eed6578cf57
BLAKE2b-256 e370712039891acb305ab2533d80c8d93db0e5218ce730e516e9c6ae1e03cbee

See more details on using hashes here.

Provenance

The following attestation bundles were made for dbt_gizmosql-1.11.2.tar.gz:

Publisher: ci.yml on gizmodata/dbt-gizmosql

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file dbt_gizmosql-1.11.2-py3-none-any.whl.

File metadata

  • Download URL: dbt_gizmosql-1.11.2-py3-none-any.whl
  • Upload date:
  • Size: 14.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for dbt_gizmosql-1.11.2-py3-none-any.whl
Algorithm Hash digest
SHA256 408d7ddfdec20e145fb857855e5a9e7eff10d17a496101b80651f73d26c29aba
MD5 3a4eb2df2cf74b23c895104640b14d62
BLAKE2b-256 32910384c27adbcabd0774af423f8264caae3d17c9ac298b9eaa52a437458d3e

See more details on using hashes here.

Provenance

The following attestation bundles were made for dbt_gizmosql-1.11.2-py3-none-any.whl:

Publisher: ci.yml on gizmodata/dbt-gizmosql

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page