The Open-source Framework for Dataset Validation
📊 🔎 ✅
Data validation for scientists, engineers, and analysts seeking correctness.
Pandera is a Union.ai open source project that provides a flexible and expressive API for performing data validation on dataframe-like objects. The goal of Pandera is to make data processing pipelines more readable and robust with statistically typed dataframes.
Install
Pandera supports multiple dataframe libraries, including pandas, polars, pyspark, and more. To validate pandas DataFrames, install Pandera with the pandas extra:
With pip:
pip install 'pandera[pandas]'
With uv:
uv pip install 'pandera[pandas]'
With conda:
conda install -c conda-forge pandera-pandas
Get started
First, create a dataframe:
import pandas as pd
import pandera.pandas as pa
# data to validate
df = pd.DataFrame({
"column1": [1, 2, 3],
"column2": [1.1, 1.2, 1.3],
"column3": ["a", "b", "c"],
})
Validate the data using the object-based API:
# define a schema
schema = pa.DataFrameSchema({
"column1": pa.Column(int, pa.Check.ge(0)),
"column2": pa.Column(float, pa.Check.lt(10)),
"column3": pa.Column(
str,
[
pa.Check.isin([*"abc"]),
pa.Check(lambda series: series.str.len() == 1),
]
),
})
print(schema.validate(df))
# column1 column2 column3
# 0 1 1.1 a
# 1 2 1.2 b
# 2 3 1.3 c
Or validate the data using the class-based API:
# define a schema
class Schema(pa.DataFrameModel):
column1: int = pa.Field(ge=0)
column2: float = pa.Field(lt=10)
column3: str = pa.Field(isin=[*"abc"])
@pa.check("column3")
def custom_check(cls, series: pd.Series) -> pd.Series:
return series.str.len() == 1
print(Schema.validate(df))
# column1 column2 column3
# 0 1 1.1 a
# 1 2 1.2 b
# 2 3 1.3 c
[!WARNING] Pandera
v0.24.0introduces thepandera.pandasmodule, which is now the (highly) recommended way of definingDataFrameSchemas andDataFrameModels forpandasdata structures likeDataFrames. Defining a dataframe schema from the top-levelpanderamodule will produce aFutureWarning:import pandera as pa schema = pa.DataFrameSchema({"col": pa.Column(str)})Update your import to:
import pandera.pandas as paAnd all of the rest of your pandera code should work. Using the top-level
panderamodule to accessDataFrameSchemaand the other pandera classes or functions will be deprecated in version0.29.0
Next steps
See the official documentation to learn more.
3 maintainers
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file pandera-0.33.1.tar.gz.
File metadata
- Download URL: pandera-0.33.1.tar.gz
- Upload date:
- Size: 976.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
909e2e269a3f9c17d94c11268f92a5f48e889af633ea1414053993874d613626
|
|
| MD5 |
436400393c4f85174d5d940777c38ba7
|
|
| BLAKE2b-256 |
477a702612a2b5e3335722395d6de71206549f64a43588527f411ff60a7c3456
|
File details
Details for the file pandera-0.33.1-py3-none-any.whl.
File metadata
- Download URL: pandera-0.33.1-py3-none-any.whl
- Upload date:
- Size: 502.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8283bc12f7c85f0b429107d71b55150205f7e5ca59d68117aff971273a3bd2d8
|
|
| MD5 |
fb06e6ba0aa9529820fb6199f44b5765
|
|
| BLAKE2b-256 |
d284107a480f7aa34a6878fb4fb85cda66f37e8aaee769c5917e3eaa2d55222e
|
