Skip to main content

Ehdtd - cryptoCurrency Exchange history data to database

Project description

Ehdtd - cryptoCurrency Exchange history data to database

This class retrieves historical data from exchanges and stores it in a database.

Example:

Install

```bash
pip install ehdtd
```

Use

```python
import time
from ehdtd import Ehdtd

exchange = 'binance'
symbol = 'BTC/USDT'
interval = '1m'
limit = 10

db_data = {
    'db_type': 'postgresql',  # postgresql, mysql
    'db_name': 'ehdtd',
    'db_user': 'ehdtd',
    'db_pass': 'xxxxxxxxx',
    'db_host': '127.0.0.1',
    'db_port': '5432'
}

fetch_data = [
    {
        'symbol': symbol,
        'interval': interval
    }
]

ehd = Ehdtd(exchange, fetch_data, db_data)  # Create an instance
ehd.start()  # Start fetching data

time.sleep(900)  # First time Wait for available data, for the data to be updated,
                 # you must wait between 90 minutes and 2.5 hours depending on the interval

for v in fetch_data:
    symbol = v['symbol']
    interval = v['interval']
    start_from = 0
    until_to = None
    return_type = 'pandas'
    data_db = ehd.get_data_from_db(symbol, interval, start_from, until_to, return_type)
    print(data_db)
    print('=========================================================================')
    print('')
    time.sleep(1)

ehd.stop()  # Stop fetching data
```

How It Works:

For Binance:

  1. Try to retrieve data from a file. Check this link:
    Binance Public Data
  2. If the file is not available, try to retrieve data from the API.
  3. Then get data from the WebSocket API using the Ccxw class.

Database Columns:

  • open_time, open_date, open_price, close_time, close_date, close_price, low, high, volume, exchange, symbol, interval, status, data

  • Column data is not used,
    and column status can have three values: '__NON_CHECK__', '__OK__', '__ERROR__'.

    • If status == '__OK__', the file has consistent data.
    • If status == '__ERROR__', the file has inconsistent data.
    • If status == '__NON_CHECK__', the file is not analyzed.

Retrieving Data from Database:

Use the function ehd.get_data_from_db(symbol, interval, start_from, until_to, return_type):

  • If return_type == 'pandas', it returns a Pandas DataFrame.
  • If return_type == 'list', it returns a list of dictionaries.

View License

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ehdtd-0.2.30.tar.gz (36.2 kB view details)

Uploaded Source

Built Distribution

ehdtd-0.2.30-py3-none-any.whl (52.8 kB view details)

Uploaded Python 3

File details

Details for the file ehdtd-0.2.30.tar.gz.

File metadata

  • Download URL: ehdtd-0.2.30.tar.gz
  • Upload date:
  • Size: 36.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.2

File hashes

Hashes for ehdtd-0.2.30.tar.gz
Algorithm Hash digest
SHA256 0349b3841cb6a39d61c087df560719e4b7ad4dd37e344408225098ebeeb96d21
MD5 22b16e3451c7ee983f4aa560a03a9b6c
BLAKE2b-256 7a9f74b824282fab630c193df59f76335ad04c4fbe608c05700b720cd277087f

See more details on using hashes here.

File details

Details for the file ehdtd-0.2.30-py3-none-any.whl.

File metadata

  • Download URL: ehdtd-0.2.30-py3-none-any.whl
  • Upload date:
  • Size: 52.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.2

File hashes

Hashes for ehdtd-0.2.30-py3-none-any.whl
Algorithm Hash digest
SHA256 99fc0ee4a68182fd6673cdb408b892c41d3cdc84204d9bda29185ac652518689
MD5 a07d90e67a485eb0e4f545dc2cbab053
BLAKE2b-256 203322c7d9cce635b03e5765827e9f8a8df72fd78591953dc8e7463064eda59a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page