Skip to main content

A DataFrame workflow accelerator for fast, deterministic data prep and analysis.

Project description

dfxpy: The DataFrame Workflow Accelerator ⚡

dfxpy Logo

PyPI version Python versions License: MIT Build Status

dfxpy is a high-performance Python library designed to reduce the entire data preparation and analysis workflow into a few powerful, deterministic operations. It helps data scientists and engineers go from raw, messy datasets to model-ready features in seconds, not hours.


🎯 Why dfxpy?

While pandas is the industry standard for data manipulation, cleaning a dataset for machine learning often requires writing repetitive boilerplate code. dfxpy acts as an accelerator, automating the "grunt work" while providing intelligent diagnostics and insights.

  • Fast & Deterministic: Optimized operations without the unpredictability of AI.
  • Production-Ready: Type-hinted, modular, and follows PEP8 standards.
  • Lightweight: Minimal dependencies—built on top of pandas, numpy, and scikit-learn.
  • Self-Contained: Load and analyze data without needing to import multiple libraries.

✨ Key Features

🛠️ Auto-Pilot Cleaning (auto)

One-line pipeline for column normalization (snake_case), duplicate removal, smart type inference (Object → Numeric/Datetime), and missing value imputation.

🔍 Deep Audit (audit)

Intelligent dataset diagnostics that detect:

  • ID-like columns (uniqueness checks)
  • High cardinality categoricals
  • Multicollinearity (correlated features)
  • Data skewness and low-variance columns

🚀 ML Preparation (prepare)

Transform your data into X and y instantly. Automatically handles categorical target encoding (LabelEncoding), feature encoding (One-Hot), and optional scaling.

📉 Smart EDA (eda)

Generates structured, human-readable summaries of shapes, nulls, unique counts, and correlation matrices.

🧹 Outlier Management (outliers)

Detect and handle outliers using the IQR (Interquartile Range) method with options to remove or cap.


📦 Installation

Install the latest version via pip:

pip install dfxpy

🚀 Quick Start

Python API

import dfxpy as dfx

# 1. Load data directly
df = dfx.load("raw_data.csv")

# 2. Run auto-clean (names, types, nulls, encoding)
df_clean = dfx.auto(df)

# 3. Get intelligent insights
dfx.audit(df_clean)

# 4. Prepare for Machine Learning
X, y = dfx.prepare(df_clean, target="outcome")

Command Line Interface (CLI)

# Analyze a dataset instantly
dfxpy analyze data.csv

# Prepare data for ML via CLI
dfxpy prepare data.csv --target price --output cleaned_features.csv

🧠 Pandas vs. dfxpy

Task Standard Pandas dfxpy
Load Data pd.read_csv("data.csv") dfx.load("data.csv")
Clean Names df.columns = [c.lower().replace(' ', '_') for c in df.columns] dfx.auto(df)
Handle Nulls df['val'].fillna(df['val'].median()) dfx.auto(df)
ML Prep 10+ lines (Split, Encode, Scale) dfx.prepare(df, target='y')
Audit Manual inspection dfx.audit(df)

🤝 Contributing

We welcome contributions! Please see our CONTRIBUTING.md for guidelines on how to submit issues, feature requests, and pull requests.

📄 License

dfxpy is licensed under the MIT License.


Built with ❤️ for the Data Science Community.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dfxpy-0.2.1.tar.gz (13.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dfxpy-0.2.1-py3-none-any.whl (13.2 kB view details)

Uploaded Python 3

File details

Details for the file dfxpy-0.2.1.tar.gz.

File metadata

  • Download URL: dfxpy-0.2.1.tar.gz
  • Upload date:
  • Size: 13.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for dfxpy-0.2.1.tar.gz
Algorithm Hash digest
SHA256 ec68e900e856ba6f634660dec99c50adc3018b7d613ad453b2c22d7f064f91b0
MD5 c9aebf746d10893ae5c7bebb979d330c
BLAKE2b-256 742188f004d47c5a7d37d5e0fab0ecb81409ab6d43db13ebc2de84919e2315d9

See more details on using hashes here.

File details

Details for the file dfxpy-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: dfxpy-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 13.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for dfxpy-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 71ad57a3d64a795fbeaddd289e2b6595c30ae2c1d3fe4d8f798bd82f179a690a
MD5 18ef58715a82dd774ea8325a559069cd
BLAKE2b-256 af88cf325ba5130a6a5dfe18a8e6d509594b03d333945b4d7abac06c9e99ab6c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page