spark_generated_rules_tools
Project description
spark_generated_rules_tools
spark_generated_rules_tools is a Python library that implements quality rules in sandbox
Installation
The code is packaged for PyPI, so that the installation consists in running:
Usage
wrapper create hammurabies
Sandbox
Installation
!yes| pip uninstall spark-generated-rules-tools
pip install spark-generated-rules-tools --user --upgrade
IMPORTS
import os
import pyspark
from spark_generated_rules_tools import dq_validate_rules
Variables
user_sandbox="P030772"
Creating Workspace
dq_path_workspace(user_sandbox=user_sandbox)
Run
dq_run_sandbox(spark=spark,
sc=sc,
parameter_conf_list=parameter_conf_list,
url_conf=url_conf)
License
New features v1.0
BugFix
- choco install visualcpp-build-tools
Reference
- Jonathan Quiza github.
- Jonathan Quiza RumiMLSpark.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
File details
Details for the file spark_generated_rules_tools-0.2.8-py3-none-any.whl.
File metadata
- Download URL: spark_generated_rules_tools-0.2.8-py3-none-any.whl
- Upload date:
- Size: 13.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.9.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | bb0118cca538ff6dd61baad22b57c5f97908c59711c30b81c0a724217b6679e6 |
|
| MD5 | 580212837f93c01dd63d74321dd4cd31 |
|
| BLAKE2b-256 | 4d336ec5d31ea78e35281538e8ce17491d4ff38e4259eced95efa3f90ebbf870 |
