Pandas helpers (force_df, melt_cols, find_pval, mv, slice, sort, round, …) — standalone module from the SciTeX ecosystem
Project description
scitex-pd
Pandas helpers — coerce, reshape, find p-values, merge/melt columns, sort/slice/round.
Full Documentation · uv pip install scitex-pd[all]
Problem and Solution
| # | Problem | Solution |
|---|---|---|
| 1 | Pandas reshape boilerplate — coercing dicts/Series/lists into DataFrames, pivoting long↔wide, and locating p-value columns is repeated noise across analysis scripts | force_df, from_xyz/to_xy, find_pval — small composable helpers with sensible defaults |
| 2 | Column ops drift — every project re-implements rename / reorder / round / merge for stats tables | merge_columns, mv, round, replace, sort, slice — uniform DataFrame-in / DataFrame-out helpers |
Installation
pip install scitex-pd
Architecture
src/scitex_pd/
├── __init__.py # public API surface
├── _force_df.py # dict / Series / list → DataFrame
├── _find_pval.py # locate p-value columns
├── _find_indi.py # boolean-mask helpers
├── _get_unique.py # unique-values per column
├── _merge_columns.py # combine columns into one
├── _melt_cols.py # long ↔ wide reshapes
├── _mv.py # reorder columns
├── _replace.py # value remapping
├── _round.py # rounding with NaN safety
├── _slice.py # row / column subsetting
├── _sort.py # multi-key sort wrappers
├── _ignore_SettingWithCopyWarning.py
└── _convert/ # long ↔ wide pivots (from_xyz / to_xy / to_xyz)
scitex-pd is a thin layer on top of pandas + numpy; the only
non-stdlib dep beyond those is scitex-types (for is_listed_X).
1 Interfaces
Python API
import scitex_pd as pd_
# Coerce / convert
pd_.force_df(data)
pd_.from_xyz(df, x, y, z)
pd_.to_xy(df)
pd_.to_xyz(df)
pd_.to_numeric(df)
# Find / inspect
pd_.find_pval(df)
pd_.find_indi(df, mask)
pd_.get_unique(df, "col")
# Reshape / restructure
pd_.merge_columns(df, [...], "out")
pd_.melt_cols(df, [...])
pd_.mv(df, col, position=-1)
# Transform
pd_.replace(df, mapping)
pd_.round(df, ndigits=2)
pd_.slice(df, ...)
pd_.sort(df, ...)
# Warnings
pd_.ignore_setting_with_copy_warning()
Demo
flowchart LR
raw["dict / Series / list / scalar"] --> force["force_df"]
force --> df[(DataFrame)]
df --> reshape["from_xyz / to_xy / melt_cols"]
df --> inspect["find_pval / get_unique"]
df --> transform["round / replace / sort / slice / mv"]
reshape --> out[(reshaped DataFrame)]
inspect --> out2[("p-value columns / uniques")]
transform --> out3[(transformed DataFrame)]
Quick Start
import scitex_pd as pd_
pd_.force_df(data) # Coerce dict / Series / list / scalar → DataFrame
pd_.from_xyz(df, x, y, z) # Long → wide pivot
pd_.to_xy(df) # Wide → long
pd_.find_pval(df) # Locate p-value columns
Status
Standalone fork of scitex.pd. Deps: numpy, pandas, scitex-types (for is_listed_X).
The umbrella package's scitex.pd import path is preserved via a
sys.modules-alias bridge.
Part of SciTeX
scitex-pd is part of SciTeX. Install via
the umbrella with pip install scitex[pd] to use as
scitex.pd (Python) or scitex pd ... (CLI).
Four Freedoms for Research
- The freedom to run your research anywhere — your machine, your terms.
- The freedom to study how every step works — from raw data to final manuscript.
- The freedom to redistribute your workflows, not just your papers.
- The freedom to modify any module and share improvements with the community.
AGPL-3.0 — because we believe research infrastructure deserves the same freedoms as the software it runs on.
License
AGPL-3.0-only (see LICENSE).
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file scitex_pd-0.1.6.tar.gz.
File metadata
- Download URL: scitex_pd-0.1.6.tar.gz
- Upload date:
- Size: 33.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c90a11376d13e3423ee9975fde9fe2243847a3fa883275ae3ae8b7619c7edd4f
|
|
| MD5 |
ce82b3b684092d281dfddd3896991b71
|
|
| BLAKE2b-256 |
24d2b2865ad3506319fd59636e3aefa99844e0407785e45a597c524c31078f91
|
Provenance
The following attestation bundles were made for scitex_pd-0.1.6.tar.gz:
Publisher:
pypi-publish-and-github-release-on-tag.yml on ywatanabe1989/scitex-pd
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
scitex_pd-0.1.6.tar.gz -
Subject digest:
c90a11376d13e3423ee9975fde9fe2243847a3fa883275ae3ae8b7619c7edd4f - Sigstore transparency entry: 1625006855
- Sigstore integration time:
-
Permalink:
ywatanabe1989/scitex-pd@bc894aacdb5cba1baaab7eba5c33c499d51496bf -
Branch / Tag:
refs/tags/v0.1.6 - Owner: https://github.com/ywatanabe1989
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
pypi-publish-and-github-release-on-tag.yml@bc894aacdb5cba1baaab7eba5c33c499d51496bf -
Trigger Event:
workflow_dispatch
-
Statement type:
File details
Details for the file scitex_pd-0.1.6-py3-none-any.whl.
File metadata
- Download URL: scitex_pd-0.1.6-py3-none-any.whl
- Upload date:
- Size: 39.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
76d58836e53a09fcfa351242e2134e12285f1abca3a6e08d09a64c56d12c37d1
|
|
| MD5 |
234a1f5f723286bbeded6854d5f19bfd
|
|
| BLAKE2b-256 |
424a92a05400279ee5f40f8ec01529a665515ce4a7a1d1c1c761346b3eeeb783
|
Provenance
The following attestation bundles were made for scitex_pd-0.1.6-py3-none-any.whl:
Publisher:
pypi-publish-and-github-release-on-tag.yml on ywatanabe1989/scitex-pd
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
scitex_pd-0.1.6-py3-none-any.whl -
Subject digest:
76d58836e53a09fcfa351242e2134e12285f1abca3a6e08d09a64c56d12c37d1 - Sigstore transparency entry: 1625006886
- Sigstore integration time:
-
Permalink:
ywatanabe1989/scitex-pd@bc894aacdb5cba1baaab7eba5c33c499d51496bf -
Branch / Tag:
refs/tags/v0.1.6 - Owner: https://github.com/ywatanabe1989
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
pypi-publish-and-github-release-on-tag.yml@bc894aacdb5cba1baaab7eba5c33c499d51496bf -
Trigger Event:
workflow_dispatch
-
Statement type: