Skip to main content

Common utilities for EQI project.

Project description

EQI Data Loader and Exporter


  • Download DataFrame from data vendors via S3
  • Manage and store analysis views locally or remotely on S3
  • Download DataFrame from RESLIVE DB

Key Concept:

  • Bundle: a group of data files from a specific vendor
  • DataFile: a file which contains data, e.g. Company_Daily within linkup bundle
  • View: a DataFrame serialized into a parquet file, can be stored locally, or remotely on S3
  • DBView: a DataFrame which contains the result of a SQL query

How to install:

  • Install this package using conda

    conda install -c jinzha098718 eqi-utils

Getting started:

  • Create EQI home folder
    • Create a folder named ‘.eqi’ in your home folder, on Windows, create a folder named as ‘.eqi.’
  • Go to examples/config.ini, set all the fields, and copy the config.ini file to EQI home folder created in the above step
  • Go to examples/load_export_example.html, see how to use the utilities

Known Issues:

  • Failed at downloading large parquet datafile

    Please install fastparquet using conda:

    conda install -c conda-forge fastparquet

Please feel free to create an issue in case of any problems.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for eqi-utils, version 1.0.3
Filename, size File type Python version Upload date Hashes
Filename, size eqi_utils-1.0.3-py3-none-any.whl (13.9 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size eqi-utils-1.0.3.tar.gz (26.0 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page