Skip to main content
Help us improve PyPI by participating in user testing. All experience levels needed!

A data analysis and visualization helper module.

Project description

[![Build Status](https://travis-ci.org/fmv1992/data_utilities.svg?branch=master)](https://travis-ci.org/fmv1992/data_utilities)

# Data Utilities

Data utilities library focused on machine learning and data analysis.

The library relies upon python's scientific/numeric stack to expand their
capabilities. The dependencies are:
* numpy
* scipy
* pandas
* matplotlib
* seaborn
* scikit-learn

Optional dependencies are:
* XGBoost
* deap

Highlights are:
* matplotlib_utilities: out-of-the-shelf data description with
`histogram_of_dataframe`.
* pandas_utilities: easier dataframe preparation with
`rename_columns_to_lower`, `categorical_serie_to_binary_dataframe`,
`balance_ndframe` and `get_numeric_columns`.
* sklearn_utilities: multiprocessing and persistence support for hyper
parameter grid search, both exhaustive and using a genetic algorithmic
approach; convenience functions to the XGBoost module.

And much more.

# Organization and files

./data_utilities
├── __init__.py
├── matplotlib_utilities.py
├── pandas_utilities.py
├── python_utilities.py
├── sklearn_utilities
│   ├── evolutionary_grid_search.py
│   ├── grid_search.py
│   └── __init__.py
└── tests
├── __init__.py
├── test_matplotlib_utilities.py
├── test_pandas_utilities.py
├── test_python_utilities.py
├── test_sklearn_utilities.py
└── test_support.py

Each of python's significant data modules has its own set of functions.
Optional dependencies functions are interspersed throughout the code.

This module does not intend to create its own API or standards. Instead each of
the utilities module should follow the guidelines and APIs provided by the
parent module.

Note: This is a primitive project. Expect backwards incompatible changes as I
figure out the best way to to develop the utilities.

# What's new

Check our [changelog](https://github.com/fmv1992/data_utilities/blob/master/changelog.md).

# Development guidelines

* Coding style: [PEP 8](https://www.python.org/dev/peps/pep-0008/) compliant.
* Docstrings: [google docstrings](http://sphinxcontrib-napoleon.readthedocs.io/en/latest/example_google.html).
* Before commiting new versions do a test for different versions of python3:
* python3.4
* python3.5
* python3.6
* (newer versions)
* Rationale: even though stability is expected between python versions some
changes occur. See for instance that on commit v1.2.8 (60573d7) there was
as unexpected import error on python34 but not on python36.

Project details


Release history Release notifications

This version
History Node

1.2.9

History Node

1.2.8

History Node

1.2.7

History Node

1.2.6

History Node

1.2.5

History Node

1.2.4

History Node

1.2.2

History Node

1.2.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
data_utilities-1.2.9.tar.gz (42.4 kB) Copy SHA256 hash SHA256 Source None Jan 20, 2018

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page