Skip to main content

Deep Study - Dataset Overview and Feature Analysis for Data Science

Project description

Deep Study

Automated Dataset Overview and Feature Analysis for Data Science

Deep Study is a lightweight Python package for automated exploratory data analysis (EDA), featuring detailed feature profiling and analysis with target variables. Generate professional HTML reports with just a few lines of code.

PyPI version Python 3.8+

Features

  • Feature Profiling: Detailed statistics for each feature (distinct values, missing values, distribution, memory usage)
  • Target Analysis: Automatic analysis of feature relationships with target variable
  • Feature Importance: ML-based feature importance using Random Forest
  • Beautiful Reports: Generate professional HTML reports with visualizations
  • Jupyter Integration: Reports render beautifully in Jupyter notebooks
  • Easy to Use: Simple API - just 3 lines of code to generate a complete analysis

Installation

pip install deep-study

Or install from source:

git clone https://github.com/arshadziban/deep_study_lib.git
cd deep_study_lib
pip install -e .

Quick Start

from deep_study import Analyzer

# Create analyzer with your data
analyzer = Analyzer(df, target="target_column")

# Run analysis
report = analyzer.run()

# Show output
report

Report Contents

The generated HTML report includes:

1. Dataset Summary

  • Total rows and columns
  • Target variable information
  • Overall dataset statistics

2. Feature Overview with Target Variable

  • All features with their types and statistics
  • Relationship indicators with target variable
  • Missing value analysis

3. Individual Feature Profiles

For each feature in your dataset:

  • Type: Numeric, Categorical, or DateTime
  • Distinct Values: Count and percentage
  • Missing Values: Count and percentage
  • Memory Usage: Efficient memory tracking
  • Distribution Visualization: Histograms for numeric, bar charts for categorical
  • Statistics: Mean, min, max (with K/M/B formatting for large numbers)
  • Top Values: Most frequent values for categorical features

API Reference

Analyzer

from deep_study import Analyzer

analyzer = Analyzer(data, target)

Parameters:

  • data: pandas DataFrame or path to CSV/Excel file
  • target: Name of the target column

Methods:

  • run(): Execute analysis and return Report object

Report

Methods:

  • get_top_features(n): Get top N important features
  • get_feature_profile(name): Get profile for specific feature

Example Output

from deep_study import Analyzer
import pandas as pd

# Load your data
df = pd.read_csv("your_data.csv")

# Analyze
analyzer = Analyzer(df, target="outcome")
report = analyzer.run()

# Show output
report

Requirements

  • Python >= 3.8
  • pandas >= 1.3.0
  • numpy >= 1.20.0
  • scikit-learn >= 1.0.0
  • matplotlib >= 3.4.0
  • jinja2 >= 3.0.0

Author

Shah Md. Arshad Rahman Ziban

Acknowledgments

  • Built with pandas, scikit-learn, and matplotlib
  • Inspired by the need for quick, professional data analysis reports

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

deep_study-1.0.5.tar.gz (13.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

deep_study-1.0.5-py3-none-any.whl (13.9 kB view details)

Uploaded Python 3

File details

Details for the file deep_study-1.0.5.tar.gz.

File metadata

  • Download URL: deep_study-1.0.5.tar.gz
  • Upload date:
  • Size: 13.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for deep_study-1.0.5.tar.gz
Algorithm Hash digest
SHA256 108e87ccbcab61942407e6eeafbe026dc09820a2613afb6184c8813d416fad89
MD5 1e55c58b3005c728767a3024f5e07a2d
BLAKE2b-256 84ee666779069cfeb45fdab566d3cca2d5aad3ebfe1a75d78e3a8e8b3cfb1209

See more details on using hashes here.

Provenance

The following attestation bundles were made for deep_study-1.0.5.tar.gz:

Publisher: publish.yml on arshadziban/deep_study_lib

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file deep_study-1.0.5-py3-none-any.whl.

File metadata

  • Download URL: deep_study-1.0.5-py3-none-any.whl
  • Upload date:
  • Size: 13.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for deep_study-1.0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 54b626d91b5a7851202f999fb7e659cd5fe01ddfa1f06d1e110c554557150cc0
MD5 8538be304b00ebb073d7958198195d5e
BLAKE2b-256 1dc08ac080fef0b9c3b5645f6b66b19231d6edf31caa76705d7d001b06318469

See more details on using hashes here.

Provenance

The following attestation bundles were made for deep_study-1.0.5-py3-none-any.whl:

Publisher: publish.yml on arshadziban/deep_study_lib

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page