Infers date format from examples, by using a series of pattern matching and rewriting rules to compute a 'best guess' datetime.strptime format string give a list of example date strings.
Project description
hi-dateinfer
Python library to infer date format from examples. This is an actively maintained fork of the original dateinfer library by Jeffery Starr. It maintains python 2/3 compatibility and will be released as hi-dateinfer. Pull requests and issues welcome.
Table of Contents
Problem Statement
Imagine that you are given a large collection of documents and, as part of the extraction process, extract date information and store it in a normalized format. If the documents follow a single schema, the ideal approach is to craft a date parsing string for the schema. However, if the documents follow different schemas or if the contents are noisy (e.g. date fields were hand-populated), the development can become onerous.
This library makes a "best guess" on the proper date parsing string (datetime.strptime
) based on examples in
the file.
Installation
git clone https://github.com/hi-primus/hi-dateinfer.git
cd dateinfer
pip install .
or
pip install hi-dateinfer
Usage
>>> import dateinfer
>>> dateinfer.infer(['Mon Jan 13 09:52:52 MST 2014', 'Tue Jan 21 15:30:00 EST 2014'])
'%a %b %d %H:%M:%S %Z %Y'
>>>
Give dateinfer.infer
a list of example date strings. infer
returns a datetime.strftime
/strptime
-compliant
date format string for its "best guess" of a format string that will correctly parse the majority of the examples.
Development
Use the following to install the package locally for development purposes:
# create empty virtual environment
virtualenv venv --python=python3.7
source venv/bin/activate
# install dateinfer in editable mode
pip install -e .
# install development dependencies
pip install -r requirements.txt
You can run unit tests as follows:
python -m unittest dateinfer/tests.py
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for hi_dateinfer-0.4.6-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 46d27ccc875890315eec9d71d76c2306e84388c4a88106d2f768a921debb49e8 |
|
MD5 | f93cbbc21a5bdc9579f1b7d4500e1807 |
|
BLAKE2b-256 | 13c7868b174e83cf03ffa8ad4cb70d121278f5691abed1ade1b19485de869e3e |