luminex 0.0.1.dev0

On the Fly ETL application

Luminex Application

luminex_application-repo/
|── .github
│   │── workflows
│   │   │── create-emr-cft.yml
│   │   │── create-emr.yml
│   │   │── pytest-pr-check.yaml
├── configs
│   ├── __init__.py
│   ├── config.yaml
│   └── config_wrapper.py
├── infrastructure
│   ├── config_parameter.json
│   └── create-emr-cft.yml
├── luminex
│   ├── __init__.py
│   ├── config_test.py
│   ├── data_standardization
│   │   ├── __init__.py
│   │   ├── s3_data_loader.py
│   │   ├── s3_data_loader_spark.py
│   │   └── s3_json_uploader.py
│   ├── kill_cluster.py
│   ├── kill_infra.py
│   ├── run_etl.py
│   ├── run_infra.py
│   └── validation
│       ├── __init__.py
│       ├── input_validator.py
│       ├── rolename_permissions_validator.py
│       ├── run_all_validations.py
│       ├── stack_name_validator.py
│       └── validate_multiple_files.py
├── requirements.txt
├── setup.py
└── tests
    ├── __init__.py
    ├── conftest.py
    ├── infra_tests.py
    ├── test_add.py
    └── test_s3_data_loader.py

Installing luminex from PyPi (Latest Release):

pip install luminex

or

pip install git+https://github.com/DISHDevEx/luminex-application.git

Installing luminex from local build (beta testing):

1. Navigate into the root luminex directory.

cd luminex-application

2. Run the following command to create the wheel file

python setup.py bdist_wheel --version <VERSION_NUMBER>

NOTE: the <VERSION_NUMBER> only effects your local build. You can use any version number you like. This can be helpful in testing prior to submitting a pull request. Alternatively, you can eclude the --version <VERSION_NUMBER> flag and the .whl file name will output as devex_sdk-VERSION_PLACEHOLDER-py3-none-any.whl

3. Next, pip install the wheel file by running the following command, note that the version will change depending upon the release:

pip install /dist/luminex-<VERSION_NUMBER>-py3-none-any.whl

Usage

Once complete, luminex will be available in your Python evironment for use. Enter your Python environment and import devex_sdk as you would with any other library or package.

>>> import luminex

All functions contained in luminex available for use can be listed by listing the package directory structure:

>>> dir(luminex)

History

View version history and release notes in HISTORY.

Contributing

Learn how about CONTRIBUTING to luminex.

Releases on GitHub

View all Luminex releases on GitHub.

Releases on PyPi

View all Luminex release history on PyPi.