Ctrl4BI

This is a helper package for Business Intelligence solutions.

For documentation, please read HELP.md

For demo on usage, please check README.ipynb

Lastest Version: 1.0.5

Highlights

• Connector for AWS S3 - Bulk Download Files/Directories in S3 Bucket
• PII/PHI scrubbing - Removes occurrences of SSN / Driver License / Account Numbers etc from texts
• ETL testing - Column Level Check
• Parse JSON files

Dependencies

Ctrl4BI requires:

• Python 3 (tested under Python 3.8)

Installation

The easiest way to install the latest release version of Ctrl4BI is via pip:

pip install ctrl4bi

In case you get ERROR: Could not install packages due to an EnvironmentError, try using

pip install ctrl4bi --user

Check for the latest available version in Ctrl4BI

Import

Import any module from the package thru the following method:

from ctrl4bi import cleanser

from ctrl4bi import etl_testing

Learn to use

Understand what each functions does by using help():

help(cleanser.scrub_pii)

ChangeLog

• Sort and Compare two datasets (When joining is not possible)
• Flatten JSON & Dictionary
• Connector for AWS S3

ToDo

• Connectors for various data sources
• Relationalize Unstructured Data

About Us

Proprietary Code of VKreaT

Project Owner: Shaji James