spark_gaps_date_rorc_tools
Project description
spark_gaps_date_rorc_tools
spark_gaps_date_rorc_tools is a Python library that implements get gaps dates
Installation
The code is packaged for PyPI, so that the installation consists in running:
pip install spark-gaps-date-rorc-tools
Usage
wrapper take gaps dates
config.yaml
===========
conf-rorc:
t_psan_test:
table_path: "/data/master/psan/data/t_psan_test/"
supplies : [
"/data/master/psan/data/t_ksag_test/",
"/data/master/psan/data/t_psan_test/"
]
t_kctk_cust_rating_atrb:
table_path: ""
supplies : []
file.py
===========
from spark_gaps_date_rorc_tools import show_gaps_date
df_detail, df_pivot = show_gaps_date(spark=spark,
path_name="config.yaml",
hdfs_uri="hdfs://pedaaswork.scmx2p100.isi",
filter_date_initial="202101",
filter_date_final="202112")
df_pivot.head()
License
New features v1.0
BugFix
- choco install visualcpp-build-tools
Reference
- Jonathan Quiza github.
- Jonathan Quiza RumiMLSpark.
- Jonathan Quiza linkedin.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for spark_gaps_date_rorc_tools-0.0.5.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6989a3ae8f346d1cccfb0f6d09fdebf5d5a344298b80db8234149c618bbc6d69 |
|
MD5 | e2fe896a8362df1e2be584c35f93b9b2 |
|
BLAKE2b-256 | e9dca6de0bbbe13778b4e7c390a02564c4b36d81577b6dea7c7654c64c1afa5c |
Close
Hashes for spark_gaps_date_rorc_tools-0.0.5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9f7717e62b384ad9ecba39f329e02c911789f3cee8532bfd95364cc1dffa8f13 |
|
MD5 | 609fd00fa26dc316c925d7f03befc917 |
|
BLAKE2b-256 | 9d7431dcd1c39501e3717b85b2444c4e1d58236f1710dc5097568bf4773b28fa |