Vrame
Vrame is a Python library designed to efficiently parse and validate all columns in pandas DataFrame. It leverages the vectorized operations of pandas to significantly speed up the validation process, making it a powerful tool for data validation in data science and machine learning projects.
Features
- Vectorized Validation: Utilizes pandas' vectorized operations for fast and efficient data validation.
- Similar Syntax to Pydantic: Offers a familiar API for those who have used Pydantic, making it easy to adopt.
- Custom Validators: Allows for the definition of custom validation rules to meet specific data requirements.
Installation
To install Vrame, use pip:
pip install vrame
Usage
First, define a schema for your DataFrame using Vrame's syntax, which is similar to Pydantic's:
import pandas as pd
import numpy as np
from vrame.basemodel import BaseModel
from vrame.column_types import (
Integer,
Float,
Boolean,
Datetime,
String,
List,
Tuple,
Dictionary,
Set,
Object
)
class Model(BaseModel):
integer = Integer(lower=-1, upper=6, nullable=True)
float = Float(lower=-1.0, upper=6.0, nullable=True)
bool = Boolean(nullable=True)
datetime = Datetime(lower="2024-03-20", upper="2024-03-21", nullable=True)
list = List(nullable=True, min_items=1, max_items=3)
tuple = Tuple(nullable=True, min_items=1, max_items=3)
dictionary = Dictionary(nullable=True, min_items=1, max_items=3)
set = Set(nullable=True, min_items=1, max_items=3)
string = String(min_length=0, max_length=5, nullable=True)
object = Object(nullable=True)
if __name__ == "__main__":
df = pd.DataFrame(
{
'integer': [1, "2", 3, 4, np.nan],
'float': [1.0, "2.0", 3, "4", "5"],
'bool': [True, "False", "True", False, False],
'datetime': [
"2024-03-20",
"2024-03-21",
"2024-03-21",
"2024-03-21",
"2024-03-21"
],
'list': [[1, 2], "[3, 4]", [5, 6], [7, 8], [9, 10]],
'tuple': [(1, 2), "(3, 4)", (5, 6), (7, 8), (9, 10)],
'dictionary': [
{'a': 1, 'b': 2.1},
"{'e': 3, 'f': 4.0}",
{'a': 1, 'b': 2.1},
{'a': 1, 'b': 2.1},
{'a': 1, 'b': 2.1}
],
'set': [{1, 2}, "{1, 2}", {1, 2}, {1, 2}, {1, 2}],
'string': ["str1", "str2", "", "12345", "I"],
'object': [1, 2.0, False, np.nan, None]
}
)
m = Model(df)
df = m.parse_and_validate()
Metadata
Release files for Vrame 1.0.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| Vrame-1.0.3.tar.gz | 9.9 kB | Without provenance | Details for Vrame-1.0.3.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| Vrame-1.0.3-py3-none-any.whl | Python 3 | none | any | Details for Vrame-1.0.3-py3-none-any.whl |
Total release size: 21.4 kB
Release files / Vrame-1.0.3.tar.gz
| Download URL | Vrame-1.0.3.tar.gz |
|---|---|
| Size | 9.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
442fa0c253cce08a3adbe87349739873f8e69381debd8009f9bd2e743302a0d3
|
|
BLAKE2b-256 checksum How to use checksums |
56c428144a7cb9e0c51a1c7365b106885ad3b4ca6bf35ffaefa302072595a946
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.10.11
|
Release files / Vrame-1.0.3-py3-none-any.whl
| Download URL | Vrame-1.0.3-py3-none-any.whl |
|---|---|
| Size | 11.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
fea500594250dde9fd438cdd419c4417234d19a9b8cc662cd6f38d3229c2b125
|
|
BLAKE2b-256 checksum How to use checksums |
08ae8e98f28f35762d0f66b94b13afabc0f8dc6b7d557217cdc64565337c4829
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.10.11
|
Security for Vrame 1.0.3
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.