Common utilities for EQI project.
Project description
EQI Data Loader and Exporter
Features:
Download DataFrame from data vendors via S3
Manage and store analysis views locally or remotely on S3
Download DataFrame from RESLIVE DB
Key Concept:
Bundle: a group of data files from a specific vendor
DataFile: a file which contains data, e.g. Company_Daily within linkup bundle
View: a DataFrame serialized into a parquet file, can be stored locally, or remotely on S3
DBView: a DataFrame which contains the result of a SQL query
How to install:
Install this package using conda
conda install -c jinzha098718 eqi-utils
Getting started:
Create EQI home folder
Create a folder named ‘.eqi’ in your home folder, on Windows, create a folder named as ‘.eqi.’
Go to examples/config.ini, set all the fields, and copy the config.ini file to EQI home folder created in the above step
Go to examples/load_export_example.html, see how to use the utilities
Known Issues:
- Failed at downloading large parquet datafile
Please install fastparquet using conda:
conda install -c conda-forge fastparquet
Please feel free to create an issue in case of any problems.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for eqi_utils-1.0.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fece16706c1111932202526c8f4099f8c2e36cda6cbee81b004b153506fe7928 |
|
MD5 | 246406a501d329e3516d19f2ee7b8295 |
|
BLAKE2b-256 | 7033e8f8cab89a1d0cdb9d98a22a13ae0d2f6d938dfba3a041167e0bf489ff66 |