kada-gx-plugin generates validation results in a format for loading into the K Platform.
Project description
kada-gx-plugin
kada-gx-plugin generates validation results in a format for loading into the K Platform.
Plugin has been tested for only Great Expectations versions 0.15.41
- pre 1.x
.
Results will continue to be written to existing validation stores if other checkpoint actions are defined eg StoreValidationResultAction
.
Steps to use the KadaStoreValidationResultsAction from the plugin
-
Install the plugin by
pip install kada-gx-plugin
to write to a local filesystem orpip install kada-gx-plugin[azure]
to write to an Azure blob store. Additional azure dependencies will be required. -
In your required
checkpoint
, add the following action to your checkpoint.yml
file.AZURE_BLOB_SAS_URL
is the container SAS token which is provided by KADA.prefix
should be updated to the landing folder found in K Platform Source onboarding.
Checkpoint action for writing to local filesystem
- name: store_kada_validation_result
action:
class_name: KadaStoreValidationResultsAction
module_name: kada_ge_store_plugin.kada_store_validation
prefix: lz/ge_landing/landing
test_directory: /tmp/test_ge_results
This will write validation result files to /tmp/test_ge_results/lz/ge_landing/landing
Checkpoint action for writing to Azure blob store
- name: store_kada_validation_result
action:
class_name: KadaStoreValidationResultsAction
module_name: kada_ge_store_plugin.kada_store_validation
prefix: lz/ge_landing/landing
azure_blob_sas_url: ${AZURE_BLOB_SAS_URL}
- Defined the variable
AZURE_BLOB_SAS_URL
. Inuncommited/config_variables.yml
add the variableAZURE_BLOB_SAS_URL: <SAS url blob >
or alternatively setAZURE_BLOB_SAS_URL
in the environment variables.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for kada_gx_plugin-1.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b7ad54f27df46aeedbe9f653f431f0b73eb671eb3281c8abd2ed69c4fb10bcf7 |
|
MD5 | 91ae070cf1b94704ec4542a7fb5d45e5 |
|
BLAKE2b-256 | f60a181aa0e2900660d3d3ce82d0e31aa0ef27dd9ca56f0dc6a2a969cbcc8639 |