jiboia-gpu 0.1.0

jiboia_gpu is a python package for automatically normalizing DataFrames and optimizing types efficiently.

Jiboia

jiboia-gpu is a Python package to normalize and optimize DataFrames automatically efficiently using the Nvidia GPU in the RAPIDS ecosystem.

Key features:

• String normalization:
  • Removes extra spaces.
  • Strips leading and trailing spaces.
  • Detects data pollution (e.g., columns that should be numeric but contain strings).
• Type conversion:
  • Numeric strings and floats ending in .0 → integers (int8, int16, int32, …).
  • Converts floats and integers to the most memory-efficient type.
  • Converts strings in various date formats to datetime (yyyy?mm?dd, dd?mm?yyyy, yyyymmd, dd?mm?yy).
  • Converts time strings (hhmm UTC, hh:mm:ss, hh:mm:ss.s) to timedelta.
• Null standardization → converts different null representations to pd.NA.
• Automatic CSV detection:
  • Detects delimiter.
  • Detects encoding.
• Memory optimization:
  • Provides memory usage information for DataFrames.
  • Converts columns to the most compact types possible.

---

Example Usage

from jiboia-gpu import jiboia_gpu as jb

pd.normalize_category("data_frame_cudf")