Skip to main content

Streamlit Data Validator Tool helps you validate your data with dataframe-type objects

Project description

Welcome to Data Validator!

Go to App

Release

Data Validator is your go-to tool for clean data ingestion and validation, seamlessly integrating Streamlit and Panderas to make your data processing tasks a breeze.

Features

  • Easy Data Ingestion: Select your file format (CSV or JSON) and provide a URL to a Panderas schema.
  • Streamlined Validation: With just a few clicks, submit your selections and validate your data effortlessly.

streamlit-pandera

Installation instructions

pip install streamlit-pandera

Usage instructions

import streamlit as st

from streamlit_pandera.io_file_validator import run_validate_file


def validate():
    standards = {
        "store_schema": ("https://raw.githubusercontent.com/resilientinfrastructure/standards/main/panderas_schema.yml")
    }
    st.set_page_config(
        page_title="Data Validator Home",
        page_icon="📊",
    )
    validated_df = run_validate_file(standards=standards)
    # TODO: DO SOMETHING ELSE WITH VALIDATED_DF

Instructions

Step 1: Select File Format

Choose the file format you want to ingest. Whether it's CSV or JSON, streamlit-pandera has got you covered.

Step 2: Provide Panderas Schema URL

Enter the URL to the Panderas schema you want to use for validation. Don't worry, we support various schema sources to suit your needs.

Step 3: Submit and Validate

Hit that submit button and let streamlit-pandera work its magic! Your data will be validated against the specified schema in no time.

Go to Demo

Video

Run Tests

To ensure everything is functioning smoothly, run the tests using the following commands:

poetry install
poetry run playwright install
poetry run pytest e2e

Run the App

Ready to see streamlit-pandera in action? Simply run the following command:

poetry run streamlit run streamlit_pandera/Home.py

Contributions

We welcome contributions from the community! If you have any ideas, bug fixes, or enhancements, feel free to submit a pull request.

Feedback

We'd love to hear your feedback! Whether you have suggestions for improvement or just want to share your experience using streamlit-pandera, don't hesitate to reach out.

Happy data ingesting with streamlit-pandera!

Feel free to customize it further to better suit your project's tone and style!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

streamlit_pandera-0.0.1.tar.gz (5.9 kB view details)

Uploaded Source

Built Distribution

streamlit_pandera-0.0.1-py3-none-any.whl (8.0 kB view details)

Uploaded Python 3

File details

Details for the file streamlit_pandera-0.0.1.tar.gz.

File metadata

  • Download URL: streamlit_pandera-0.0.1.tar.gz
  • Upload date:
  • Size: 5.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.10.14 Linux/6.5.0-1021-azure

File hashes

Hashes for streamlit_pandera-0.0.1.tar.gz
Algorithm Hash digest
SHA256 ad4ea105d4e25d58b41be3d2447fb2dcb14a46be2f982f75e703244a1f0a1eb2
MD5 e12849e103a708c01c15aa84619851fb
BLAKE2b-256 a67cb947ae62753163032e5a4a16d323691c7499c8eb76e61ebad90603fdf6f3

See more details on using hashes here.

File details

Details for the file streamlit_pandera-0.0.1-py3-none-any.whl.

File metadata

  • Download URL: streamlit_pandera-0.0.1-py3-none-any.whl
  • Upload date:
  • Size: 8.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.10.14 Linux/6.5.0-1021-azure

File hashes

Hashes for streamlit_pandera-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 98811ed0d45f0db8fb52dc11c5c06c58d2adb65b8109a0f09e456211e363898e
MD5 027c3d03318ced5d738e9e581dfaf4ee
BLAKE2b-256 99ef1d3207ed9360300d871f2b0b34c07ad185552a97bc32e5eb252089bd4fc3

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page