Skip to main content

Pandas helpers (force_df, melt_cols, find_pval, mv, slice, sort, round, …) — standalone module from the SciTeX ecosystem

Project description

scitex-pd

SciTeX

Pandas helpers — coerce, reshape, find p-values, merge/melt columns, sort/slice/round.

Full Documentation · uv pip install scitex-pd[all]

pypi python docs

tests install-check quality cov


Problem and Solution

# Problem Solution
1 Pandas reshape boilerplate — coercing dicts/Series/lists into DataFrames, pivoting long↔wide, and locating p-value columns is repeated noise across analysis scripts force_df, from_xyz/to_xy, find_pval — small composable helpers with sensible defaults
2 Column ops drift — every project re-implements rename / reorder / round / merge for stats tables merge_columns, mv, round, replace, sort, slice — uniform DataFrame-in / DataFrame-out helpers

Installation

pip install scitex-pd

Architecture

src/scitex_pd/
├── __init__.py              # public API surface
├── _force_df.py             # dict / Series / list → DataFrame
├── _find_pval.py            # locate p-value columns
├── _find_indi.py            # boolean-mask helpers
├── _get_unique.py           # unique-values per column
├── _merge_columns.py        # combine columns into one
├── _melt_cols.py            # long ↔ wide reshapes
├── _mv.py                   # reorder columns
├── _replace.py              # value remapping
├── _round.py                # rounding with NaN safety
├── _slice.py                # row / column subsetting
├── _sort.py                 # multi-key sort wrappers
├── _ignore_SettingWithCopyWarning.py
└── _convert/                # long ↔ wide pivots (from_xyz / to_xy / to_xyz)

scitex-pd is a thin layer on top of pandas + numpy; the only non-stdlib dep beyond those is scitex-types (for is_listed_X).

1 Interfaces

Python API
import scitex_pd as pd_

# Coerce / convert
pd_.force_df(data)
pd_.from_xyz(df, x, y, z)
pd_.to_xy(df)
pd_.to_xyz(df)
pd_.to_numeric(df)

# Find / inspect
pd_.find_pval(df)
pd_.find_indi(df, mask)
pd_.get_unique(df, "col")

# Reshape / restructure
pd_.merge_columns(df, [...], "out")
pd_.melt_cols(df, [...])
pd_.mv(df, col, position=-1)

# Transform
pd_.replace(df, mapping)
pd_.round(df, ndigits=2)
pd_.slice(df, ...)
pd_.sort(df, ...)

# Warnings
pd_.ignore_setting_with_copy_warning()

Demo

flowchart LR
    raw["dict / Series / list / scalar"] --> force["force_df"]
    force --> df[(DataFrame)]
    df --> reshape["from_xyz / to_xy / melt_cols"]
    df --> inspect["find_pval / get_unique"]
    df --> transform["round / replace / sort / slice / mv"]
    reshape --> out[(reshaped DataFrame)]
    inspect --> out2[("p-value columns / uniques")]
    transform --> out3[(transformed DataFrame)]

Quick Start

import scitex_pd as pd_

pd_.force_df(data)              # Coerce dict / Series / list / scalar → DataFrame
pd_.from_xyz(df, x, y, z)       # Long → wide pivot
pd_.to_xy(df)                   # Wide → long
pd_.find_pval(df)               # Locate p-value columns

Status

Standalone fork of scitex.pd. Deps: numpy, pandas, scitex-types (for is_listed_X). The umbrella package's scitex.pd import path is preserved via a sys.modules-alias bridge.

Part of SciTeX

scitex-pd is part of SciTeX. Install via the umbrella with pip install scitex[pd] to use as scitex.pd (Python) or scitex pd ... (CLI).

Four Freedoms for Research

  1. The freedom to run your research anywhere — your machine, your terms.
  2. The freedom to study how every step works — from raw data to final manuscript.
  3. The freedom to redistribute your workflows, not just your papers.
  4. The freedom to modify any module and share improvements with the community.

AGPL-3.0 — because we believe research infrastructure deserves the same freedoms as the software it runs on.

License

AGPL-3.0-only (see LICENSE).


SciTeX

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scitex_pd-0.1.4.tar.gz (33.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

scitex_pd-0.1.4-py3-none-any.whl (39.6 kB view details)

Uploaded Python 3

File details

Details for the file scitex_pd-0.1.4.tar.gz.

File metadata

  • Download URL: scitex_pd-0.1.4.tar.gz
  • Upload date:
  • Size: 33.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for scitex_pd-0.1.4.tar.gz
Algorithm Hash digest
SHA256 a0f11ca1827becde9a9f731104342b90c72046bd77e2a0eb8e53addc69f9ea41
MD5 88419a1e21fd2a4087cc3dc301d719d7
BLAKE2b-256 ad70bde3d1dfb5a28a8867528d5706450a915a5ca047fb4adcba7c031a264116

See more details on using hashes here.

Provenance

The following attestation bundles were made for scitex_pd-0.1.4.tar.gz:

Publisher: pypi-publish-and-github-release-on-tag.yml on ywatanabe1989/scitex-pd

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file scitex_pd-0.1.4-py3-none-any.whl.

File metadata

  • Download URL: scitex_pd-0.1.4-py3-none-any.whl
  • Upload date:
  • Size: 39.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for scitex_pd-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 e81a920b0dc7ca89517234df75113520bb498993cd93c4a0a80949a2e1e18727
MD5 833daf3336ba2f56ab9ea412b22ea9dd
BLAKE2b-256 d88f0fe64e61bf22c33796f7be54f32c7224d8893ea4c680a47a1d96056e3485

See more details on using hashes here.

Provenance

The following attestation bundles were made for scitex_pd-0.1.4-py3-none-any.whl:

Publisher: pypi-publish-and-github-release-on-tag.yml on ywatanabe1989/scitex-pd

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page