Skip to main content

dbt adapter for CrateDB 5.x, derived from dbt-postgres

Project description

dbt logo

CI Badge » Unit Tests CI Badge » Integration Tests

dbt-cratedb2

The dbt-cratedb2 package contains all the code enabling dbt to work with a CrateDB database.

Because CrateDB is PostgreSQL-compatible, dbt-cratedb2 heavily builds upon the canonical dbt-postgres adapter. For more information on using dbt with CrateDB, consult the docs.

About dbt

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

dbt is the T in ELT. Organize, cleanse, denormalize, filter, rename, and pre-aggregate the raw data in your warehouse so that it's ready for analysis.

Getting started

Installation

Install dbt-cratedb2.

pip install 'dbt-cratedb2 @ git+https://github.com/crate-workbench/dbt-cratedb2.git'

psycopg2-binary vs. psycopg2

By default, dbt-cratedb2 installs psycopg2-binary. This is great for development, and even testing, as it does not require any OS dependencies; it's a pre-built wheel. However, building psycopg2 from source will grant performance improvements that are desired in a production environment. In order to install psycopg2, use the following steps:

if [[ $(pip show psycopg2-binary) ]]; then
    PSYCOPG2_VERSION=$(pip show psycopg2-binary | grep Version | cut -d " " -f 2)
    pip uninstall -y psycopg2-binary
    pip install psycopg2==$PSYCOPG2_VERSION
fi

This ensures the version of psycopg2 will match that of psycopg2-binary.

Contribute

Code of Conduct

Everyone interacting with Crate.io's codebases, issue trackers, chat rooms, and mailing lists, please follow the CrateDB Code of Conduct.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt_cratedb2-0.0.1.dev2.tar.gz (17.8 kB view details)

Uploaded Source

Built Distribution

dbt_cratedb2-0.0.1.dev2-py3-none-any.whl (21.9 kB view details)

Uploaded Python 3

File details

Details for the file dbt_cratedb2-0.0.1.dev2.tar.gz.

File metadata

  • Download URL: dbt_cratedb2-0.0.1.dev2.tar.gz
  • Upload date:
  • Size: 17.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-httpx/0.27.2

File hashes

Hashes for dbt_cratedb2-0.0.1.dev2.tar.gz
Algorithm Hash digest
SHA256 fcd8923bbe3b61fecfcdd778b3630decc22596acd5eec49658444540d37f90f9
MD5 ddfec09eab335ff5623c5cdb50bf2b52
BLAKE2b-256 c6a5d5fcc00abad808a3347e569b776b6565baedb8abea2cc7afc71106337bd2

See more details on using hashes here.

File details

Details for the file dbt_cratedb2-0.0.1.dev2-py3-none-any.whl.

File metadata

File hashes

Hashes for dbt_cratedb2-0.0.1.dev2-py3-none-any.whl
Algorithm Hash digest
SHA256 6db6a054fb4341da1484fe63c12ac702405205ca5dd8be576411fd27a27afa67
MD5 956b6745d4de20c708a78dbd4efd48bb
BLAKE2b-256 2d4baebf5f243eb6e924fefbe8f640906e9a02c586465110900442e0d4e0bc0b

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page