exadata-validator 0.0.1

Validate data-model folders using DuckDB.

exadata-validator

exadata-validator validates data-model folders using DuckDB.

Install With pip

python -m venv .venv
source .venv/bin/activate
pip install exadata-validator

Validate a data model folder:

exadata-validator validate-data-model /path/to/data_model_folder

Develop With Poetry

From the repository root:

cd data-validator/exaflow-data-validator
poetry install

Then run the same CLI through Poetry:

poetry run exadata-validator validate-data-model /path/to/data_model_folder

Use exadata-validator validate-data-model --help for reporting, output, and threading options.

Folder Layout

/path/to/data_model_folder/
  CDEsMetadata.json
  dataset1.csv
  dataset2.csv

Validation Notes

• CSV validation queries files directly with DuckDB and uses fused aggregate checks to reduce scan overhead.
• Folder-level dataset uniqueness is enforced across all CSV files via SQL using normalized codes (trim + lower).