Skip to main content

pandas DataFrame validation library

Project description

# Pandas DataFrame Validator

`pd-validator` is a pandas wrapper library for validating DataFrames against a user-defined schema.

>>> import pandas as pd
>>> from pd_validator import Schema
>>> from pd_validator import Report

>>> df = pd.read_csv('data.csv')
>>> df
col_1 col_2
1 BC
2 D

>>> rules = {'col_1': {'dtype': int,
'length': 1,
'range': [0,1],
'required': True,
'codes': False,
'regex': False},
'col_2': {'dtype': str,
'length': 1,
'range': False,
'required': False,
'codes': ['A', 'B', 'C'],
'regex': False}

>>> schema = Schema(rules=rules)

>>> report = Report(df=df, schema=schema())
>>> report()
col_1 col_2 inval_line inval_col inval_val err_msg
1 BC 2 col_2 BC Invalid length: 1 char max
1 BC 2 col_2 BC Invalid code: ['A', 'B', 'C'] required
2 D 3 col_2 D Invalid code: ['A', 'B', 'C'] required
A B 1 col_1 A Invalid dtype: int required
A B 1 col_1 A Invalid range: [0, 1] required
2 D 3 col_1 2 Invalid range: [0, 1] required
NaN A 4 col_1 NaN Missing value: col_1 required


Project details

Release history Release notifications

This version
History Node


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
pd_validator-1.0.0-py2.7.egg (13.1 kB) Copy SHA256 hash SHA256 Egg 2.7
pd_validator-1.0.0-py3.5.egg (13.6 kB) Copy SHA256 hash SHA256 Egg 3.5

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page