Skip to main content

Supercharged DataFrame indexing

Project description

Github Actions status Coverage Documentation status Latest PyPI version Python versions supported License Code style: black https://img.shields.io/badge/style-wemake-000000.svg

pandas-select is a collection of DataFrame selectors that facilitates indexing and selecting data, fully compatible with pandas vanilla indexing.

The selector functions can choose variables based on their name, data type, arbitrary conditions, or any combination of these.

pandas-select is inspired by the excellent R library tidyselect.

Installation

pandas-select is a Python-only package hosted on PyPI. It can be installed via pip:

pip install pandas-select

Design goals

# pandas-select
df[AllNumeric()]
# vanilla
df.select_dtypes("number").columns

# pandas-select
df[StartsWith("Type") | "Legendary"]
# vanilla
df.loc[:, df.columns.str.startswith("Type") | (df.columns == "Legendary")]
# pandas-select
df_mi.loc[Contains("Jeff", axis="index", level="Name")]

# vanilla
df_mi.loc[df_mi.index.get_level_values("Name").str.contains("Jeff")]
  • Play well with machine learning applications.

    • Respect the columns order.

    • Allow deferred selection when the DataFrame’s columns are not known in advance, for example in automated machine learning applications.

    • Offer integration with sklearn.

      from pandas_select import AnyOf, AllBool, AllNominal, AllNumeric, ColumnSelector
      from sklearn.compose import make_column_transformer
      from sklearn.preprocessing import OneHotEncoder, StandardScaler
      
      ct = make_column_transformer(
         (StandardScaler(), ColumnSelector(AllNumeric() & ~AnyOf("Generation"))),
         (OneHotEncoder(), ColumnSelector(AllNominal() | AllBool() | "Generation")),
      )
      ct.fit_transform(df)

Project Information

pandas-select is released under the BS3 license, its documentation lives at Read the Docs, the code on GitHub, and the latest release on PyPI. It is tested on Python 3.6+.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pandas-select-0.2.0.tar.gz (16.2 kB view hashes)

Uploaded Source

Built Distribution

pandas_select-0.2.0-py3-none-any.whl (17.1 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page