Skip to main content

A reusable Python library for data cleaning, ETL pipelines, and SQL query building

Project description

datavitals

datavitals is a production-ready Python library that simplifies real-world data engineering workflows by standardizing:

  • Data Cleaning
  • ETL Pipelines
  • SQL Query Generation

It helps developers and data engineers avoid repetitive boilerplate, reduce runtime errors, and build consistent pipelines faster.


👤 Author

Kamaleshkumar.K
🔗 LinkedIn: https://www.linkedin.com/in/kamaleshkumaroffi
💻 GitHub: https://github.com/kamaleshkumaroffi/datavitals


🚀 Why datavitals?

In real projects:

  • Data is messy (nulls, duplicates, wrong types)
  • ETL code breaks due to edge cases
  • SQL strings become unsafe and unreadable

datavitals solves this by providing safe, tested, reusable utilities that work out-of-the-box.


✨ Features

🧹 Data Cleaning

  • Remove duplicates
  • Drop or fill null values
  • Trim string columns
  • Safe numeric conversion
  • Strong validation with meaningful errors

🔄 ETL Pipelines

  • Plug-and-play Extract → Transform → Load
  • Supports custom transform functions
  • Safe handling of empty or invalid data
  • Execution time measurement

🧠 SQL Builder

  • Dynamic SELECT queries
  • WHERE clause with safe value handling
  • Optional LIMIT
  • Clear error messages for invalid inputs

🧪 Production-Ready Tests

  • Pytest-based validation
  • Covers edge cases and failure scenarios
  • Ensures reliability during future changes

📦 Installation

pip install datavitals

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

datavitals-0.1.6.tar.gz (5.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

datavitals-0.1.6-py3-none-any.whl (6.8 kB view details)

Uploaded Python 3

File details

Details for the file datavitals-0.1.6.tar.gz.

File metadata

  • Download URL: datavitals-0.1.6.tar.gz
  • Upload date:
  • Size: 5.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for datavitals-0.1.6.tar.gz
Algorithm Hash digest
SHA256 44c7d044dfaf6267110db421e023f3f9c8b86425869ef99a2f108d149ceed023
MD5 89cfc616504a20cb3ecc5b0cb85899ed
BLAKE2b-256 d93c76338622ac9d2e9227b62462811496d01b412e83b75e6d4793ee438db94c

See more details on using hashes here.

File details

Details for the file datavitals-0.1.6-py3-none-any.whl.

File metadata

  • Download URL: datavitals-0.1.6-py3-none-any.whl
  • Upload date:
  • Size: 6.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for datavitals-0.1.6-py3-none-any.whl
Algorithm Hash digest
SHA256 868e6209c0879dc1904fae48cba9a342c7ebf88d09690aee70fe7f15ee22f74a
MD5 4e524ef85b71fb53fa76a34629de0765
BLAKE2b-256 4344a03d6a3dceb64a0bf0ebde7de07200bd226b653290dfb62c7fa8950c3138

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page