The hiereskopia package is a library to infer properties like date formats or numeric separators in pandas series of type object or string.
Project description
Hieroskopia
The hiereskopia package is a library to infer properties like date formats or numeric separators in pandas series of type object or string.
Support
Date-times:
- Support to dates and datetime format
- This library receive a series as input and try to return a dictionary with the format found in the series Based on the 1989 C (Default) , Snowflake Standard or Java Simple date time format code.
Numeric:
- This library receive a series as input and try to return a dictionary with the three digit and decimal character separator
Usage
Infer datetime
>>> from hieroskopia import InferDatetime
>>> InferDatetime.infer(pd.Series(["2019-11-27",
"2019/11/28",
"2018-11-08"]))
>>> {'formats': ['%Y-%m-%d', '%Y/%m/%d'], 'type':'datetime'}
Using return_format
parameter
>>> from hieroskopia import InferDatetime
>>> InferDatetime.infer(pd.Series(["2019-11-27",
"2019/11/28",
"2018-11-08"]), return_format='snowflake')
>>> {'formats': ['yyyy-mm-dd', 'yyyy/mm/dd'], 'type':'datetime'}
>>> from hieroskopia import InferDatetime
>>> InferDatetime.infer(pd.Series(["2019-11-27",
"2019/11/28",
"2018-11-08"]), return_format='java')
>>> {'formats': ['yyyy-MM-dd', 'yyyy/MM/dd'], 'type':'datetime'}
The above method works with a best guess approach to detect a format in a object type series and try
to return a datetime.strftime
/strptime
, Snowflake Date format
, Java Simple Date Format
format that will cover or parse the majority
of the samples.
Infer numeric
>>> from hieroskopia import InferNumeric
>>> InferNumeric.infer(pd.Series(['767313628196.2', '76731362819.546', '767313628196']))
>>> {'three_digit_separator': '', 'decimal_separator': '.', 'type':'float'}
The above method will try to detect and return certain properties in a object type series
like datatype
, three_digit_separator
or decimal_separator
character that will cover
the majority of the samples.
To do:
- Feed more regular expressions
- Add Time format
- Develop multiple algorithms to get a better precision.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for hieroskopia-0.1.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 474502f83d8b292b560a06129871852f140bb10ba724f0c7ae48d586f73d0bc1 |
|
MD5 | 325a9722cece8ab4a04e3c522473b37a |
|
BLAKE2b-256 | 5806d0e7e58a200eeb2f80fb3c33f9c1c99693fba69d5e6c91f9c5b52d5ce454 |