Skip to main content

dbt adapter for CrateDB 5.x, derived from dbt-postgres

Project description

dbt logo

CI Badge » Unit Tests CI Badge » Integration Tests

dbt-cratedb2

The dbt-cratedb2 package contains all the code enabling dbt to work with a CrateDB database.

Because CrateDB is PostgreSQL-compatible, dbt-cratedb2 heavily builds upon the canonical dbt-postgres adapter. For more information on using dbt with CrateDB, consult the docs.

About dbt

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

dbt is the T in ELT. Organize, cleanse, denormalize, filter, rename, and pre-aggregate the raw data in your warehouse so that it's ready for analysis.

Getting started

Installation

Install dbt-cratedb2.

pip install 'dbt-cratedb2 @ git+https://github.com/crate-workbench/dbt-cratedb2.git'

psycopg2-binary vs. psycopg2

By default, dbt-cratedb2 installs psycopg2-binary. This is great for development, and even testing, as it does not require any OS dependencies; it's a pre-built wheel. However, building psycopg2 from source will grant performance improvements that are desired in a production environment. In order to install psycopg2, use the following steps:

if [[ $(pip show psycopg2-binary) ]]; then
    PSYCOPG2_VERSION=$(pip show psycopg2-binary | grep Version | cut -d " " -f 2)
    pip uninstall -y psycopg2-binary
    pip install psycopg2==$PSYCOPG2_VERSION
fi

This ensures the version of psycopg2 will match that of psycopg2-binary.

Contribute

Code of Conduct

Everyone interacting with Crate.io's codebases, issue trackers, chat rooms, and mailing lists, please follow the CrateDB Code of Conduct.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt_cratedb2-0.0.1.dev0.tar.gz (17.8 kB view details)

Uploaded Source

Built Distribution

dbt_cratedb2-0.0.1.dev0-py3-none-any.whl (22.0 kB view details)

Uploaded Python 3

File details

Details for the file dbt_cratedb2-0.0.1.dev0.tar.gz.

File metadata

  • Download URL: dbt_cratedb2-0.0.1.dev0.tar.gz
  • Upload date:
  • Size: 17.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-httpx/0.27.2

File hashes

Hashes for dbt_cratedb2-0.0.1.dev0.tar.gz
Algorithm Hash digest
SHA256 06ed00dd1e25377990c3f65f6a1e7f05c01d8db91e391d52a59daf2c42ff31a6
MD5 f19187947acaed99845cd1cbab4b32d4
BLAKE2b-256 3cf14c78c7a0cc868ec67c2ef9268ef5fbb5dc0ae1af42dbc636631e4c00eae5

See more details on using hashes here.

File details

Details for the file dbt_cratedb2-0.0.1.dev0-py3-none-any.whl.

File metadata

File hashes

Hashes for dbt_cratedb2-0.0.1.dev0-py3-none-any.whl
Algorithm Hash digest
SHA256 eb3f00da7f53f7464e34a1b7d7c7151314904a8b09253340787cef7ffabe4acf
MD5 c7bc7cea9410ca472de5cc3415dd59b5
BLAKE2b-256 a75a8545cdb6a43f6212b3057f10b801d0807bbf685d2658dee57701673e6b4d

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page