Skip to main content

Common utilities for EQI project.

Project description

EQI Data Loader and Exporter


  • Download DataFrame from data vendors via S3

  • Manage and store analysis views locally or remotely on S3

  • Download DataFrame from RESLIVE DB

Key Concept:

  • Bundle: a group of data files from a specific vendor

  • DataFile: a file which contains data, e.g. Company_Daily within linkup bundle

  • View: a DataFrame serialized into a parquet file, can be stored locally, or remotely on S3

  • DBView: a DataFrame which contains the result of a SQL query

How to install:

  • Install this package using conda

    conda install -c jinzha098718 eqi-utils

Getting started:

  • Create EQI home folder

    • Create a folder named ‘.eqi’ in your home folder, on Windows, create a folder named as ‘.eqi.’

  • Go to examples/config.ini, set all the fields, and copy the config.ini file to EQI home folder created in the above step

  • Go to examples/load_export_example.html, see how to use the utilities

Known Issues:

  • Failed at downloading large parquet datafile

    Please install fastparquet using conda:

    conda install -c conda-forge fastparquet

Please feel free to create an issue in case of any problems.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

eqi-utils-1.0.3.tar.gz (26.0 kB view hashes)

Uploaded source

Built Distribution

eqi_utils-1.0.3-py3-none-any.whl (13.9 kB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page