Bunch of decorators to decorate clickhouse-driver's execute method
Project description
clickhouse-driver-decorators
Bunch of decorators to decorate clickhouse-driver's execute
method
Available decorators:
add_column_names
-- converts each row to dict or namedtuple with column names as keys;apply_callback
-- applies a given callback to each row of result;convert_string_to_datetime
-- converts string datetime to python datetime object in a needed timezone for a given column. String datetime have to be in UTC;convert_timestamp_to_datetime
-- converts timestamp to python datetime object in a needed timezone for a given column.transform_to_pandas_dataframe
-- creates pandas frame based on result from db
Examples
For a closer look, check out the tests
from typing import Generator
from pandas import DataFrame
from clickhouse_driver import Client
from clickhouse_driver_decorators import *
def replace_empty_with_none(row: tuple) -> Generator:
yield tuple([None if v == '' else v for v in row])
class A:
def __init__(self, client: Client):
self.__client = client
def get_data(self) -> Generator[]:
return self.__decorated_execute("""
select
toUnixTimestamp(now()) as now_ts,
formatDateTime(now(), '%F %T', 'UTC') as now_str,
'' as empty
""")
@add_column_names()
@apply_callback(on_row_callable=replace_empty_with_none)
@convert_timestamp_to_datetime(columns_to_convert={'now_ts': 'Europe/Moscow'})
@convert_string_to_datetime(date_format='%Y-%m-%d %H:%M:%S', columns_to_convert={'now_str': 'Europe/Moscow'})
def __decorated_execute(self, query: str):
return self.__client.execute(query, with_column_types=True)
class B:
def __init__(self, client: Client):
self.__client = client
def get_pandas_df(self) -> DataFrame:
return self.__decorated_execute("select 'val1' as col1, 'val2' as col2")
@transform_to_pandas_dataframe()
def __decorated_execute(self, query: str):
return self.__client.execute(query, with_column_types=True)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for clickhouse-driver-decorators-0.2.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 32154434cc50d2982f40258501ea02f2e372475a0472cf3cf88ce423f198991a |
|
MD5 | 128f5517545fe841be5d0a23e5e90c0e |
|
BLAKE2b-256 | 571fd7b723c0d3a2c15fdb8add0c64c44eb0251e1f19e27cd50a75d9667ca1f1 |
Close
Hashes for clickhouse_driver_decorators-0.2.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | df05e25e7f2428d1ec478324e0fcaddb0d47e52fd0b0a0ec20d21b8013744dee |
|
MD5 | 2a636e93fb6ec12de591a3463c300548 |
|
BLAKE2b-256 | 1e5fd357ca76c9791d495d1e00aff112adc665c845156b3708623f2a409816bd |