dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
dbt is the T in ELT. Organize, cleanse, denormalize, filter, rename, and pre-aggregate the raw data in your warehouse so that it's ready for analysis.
ODPS
ODPS, called MaxCompute before. This adapter is a wrapper bridged PyOdps and DBT together.
MaxCompute Features:
| Feature | Status |
|---|---|
| Partition Table | ❎ |
| Cluster Table | ❎ |
| External Table | ❎ |
| Table Properties | ❎ |
DBT features:
| Name | Status |
|---|---|
| Materialization: Table | ✅ |
| Materialization: View | ✅ |
| Materialization: Incremental - Append | ✅ |
| Materialization: Incremental - Insert+Overwrite | ✅ |
| Materialization: Incremental - Merge | ✅ |
| Materialization: Ephemeral | ✅ |
| Seeds | ✅ |
| Tests | ✅ |
| Snapshots | ✅1 |
| Documentation | ✅ |
Getting Started
Install DBT-ODPS
python setup.py install --force
or pip install dbt-odps-winwin
How to Configure?
For Fresh Codebase
Run following command after installing dbt-odps:
dbt init
For Existing Codebase
Read more in here: https://docs.getdbt.com/docs/core/connection-profiles
Configuration options:
| Property | Description | Example |
|---|---|---|
| Endpoint | The endpoint of odps, read more in https://help.aliyun.com/document_detail/34951.html | http://service.cn-shanghai.maxcompute.aliyun.com/api |
| database | The project name of odps, which you can find in https://maxcompute.console.aliyun.com/{your area}/project-list | odps-test-project |
| schema | Using default if you don't know what is schema. | default |
| access_id | access id | LTAXXXXXXXXX |
| secret_access_key | secret access key | bZXXXXXXXXXX |
| type | odps | odps |
NOTES
- When using merge statement, ODPS required that table is a transactional table. So, we have to create the snapshot table before select. Under the hook, we using the first referred table as source data structure to create table, so this data source must be a table, view is not supported.
DEVELOPER REF
DBT docs what-are-adapters
1 maintainer
Metadata
1 maintainer
Release files for dbt-odps-winwin 1.9.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| dbt_odps_winwin-1.9.0.tar.gz | 117.0 kB | Without provenance | Details for dbt_odps_winwin-1.9.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| dbt_odps_winwin-1.9.0-py3-none-any.whl | Python 3 | none | any | Details for dbt_odps_winwin-1.9.0-py3-none-any.whl |
Total release size: 175.6 kB
Release files / dbt_odps_winwin-1.9.0.tar.gz
| Download URL | dbt_odps_winwin-1.9.0.tar.gz |
|---|---|
| Size | 117.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
806a49dc6e314fe2cd9c3648b90b899db06164cec0ee8ecfa74f86f2dd3dd3c6
|
|
BLAKE2b-256 checksum How to use checksums |
d6727656c9a02d10e1e4d62260cac50df18f57654fa6e18191ba83c50e545164
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.2
|
Release files / dbt_odps_winwin-1.9.0-py3-none-any.whl
| Download URL | dbt_odps_winwin-1.9.0-py3-none-any.whl |
|---|---|
| Size | 58.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
d4cebe52e7c9897e0d09299fb5a5c92125cee2c550f1008fb78a13b826f4bb12
|
|
BLAKE2b-256 checksum How to use checksums |
fe0354b5d9700f2a7a9bf23fb48de7ca3ad2a4927171df8a4b3d6490ca1c698c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.2
|
Security for dbt-odps-winwin 1.9.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
