Common utilities for EQI project.
Project description
EQI Data Loader and Exporter
Features:
Download DataFrame from data vendors via S3
Manage and store analysis views locally or remotely on S3
Download DataFrame from RESLIVE DB
Key Concept:
Bundle: a group of data files from a specific vendor, e.g. linkup
DataFile: a file which contains data, e.g. Company_Daily within linkup bundle
View: a DataFrame serialized into a parquet file, can be stored locally, or remotely on S3
DBView: a DataFrame which contains the result of a SQL query
How to install:
Install this package using pip
pip install eqi-utilities
Getting started:
Create EQI home folder
Create a folder named ‘.eqi’ in your home folder, on Windows, create a folder named as ‘.eqi.’
Go to examples/config.ini, set all the fields, and copy the config.ini file to EQI home folder created in the above step
Go to examples/load_export_example.html, see how to use the utilities
Known Issues:
- Failed at downloading large parquet datafile
Please install fastparquet using conda: .. code:: bash
conda install -c conda-forge fastparquet
Please feel free to create an issue in case of any problems.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for eqi_utils-1.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 818f1213fa2316f878355956fcf539c91d0281da0020d3df101f348df8585140 |
|
MD5 | edd91ae8744b40af24f70adf32db6eeb |
|
BLAKE2b-256 | d3db3b2db035c03be7ccf91ea0a7892c0be4f1df320cf3b1d7849daa7fad3e70 |