Dependencies

pybear operating on Python 3.14 requires:

• Python (==3.14)

• joblib (>=1.5.2)

• numpy (>=2.3.2)

• pandas (>=2.3.3)

• polars (>=1.19.0)

• psutil (>=7.1.2)

• pyarrow (>=22.0.0)

• scikit-learn (>=1.7.2)

• scipy (>=1.16.1)

• typing_extensions (>=4.6.0)

pybear operating on Python 3.13 requires:

• Python (==3.13)

• joblib (>=1.3.0)

• numpy (>=2.1.0)

• pandas (>=2.2.3)

• polars (>=1.19.0)

• psutil (>=5.9.4)

• pyarrow (>=18.0.0)

• scikit-learn (>=1.5.2)

• scipy (>=1.14.1)

• typing_extensions (>=4.6.0)

pybear operating on Python 3.12 requires:

• Python (==3.12)

• joblib (>=1.3.0)

• numpy (>=1.26.0)

• pandas (>=2.1.1)

• polars (>=1.19.0)

• psutil (>=5.9.4)

• pyarrow (>=14.0.0)

• scikit-learn (>=1.3.1)

• scipy (>=1.12.0)

• typing_extensions (>=4.6.0)

pybear operating on Python 3.11 requires:

• Python (==3.11)

• joblib (>=1.3.0)

• numpy (>=1.23.3)

• pandas (>=1.5.1)

• polars (>=1.19.0)

• psutil (>=5.9.4)

• pyarrow (>=10.0.1)

• scikit-learn (>=1.3.0)

• scipy (>=1.12.0)

• typing_extensions (>=4.6.0)

pybear operating on Python 3.10 requires:

• Python (==3.10)

• joblib (>=1.3.0)

• numpy (>=1.23.3, <2.3)

• pandas (>=1.3.4, <3.0)

• polars (>=1.19.0)

• psutil (>=5.9.0)

• pyarrow (>=6.0.0)

• scikit-learn (>=1.3.0,<1.8)

• scipy (>=1.12.0,<1.16)

• typing_extensions (>=4.6.0)

User installation

Install pybear from the online PyPI package repository using pip:

(your-env) $ pip install pybear

A Conda distribution is not expected to be made available anytime soon.

AutoGridSearchCV

Perform multiple uninterrupted passes of grid search with sci-kit learn GridSearchCV utilizing progressively narrower search grids.

• Access via pybear.model_selection.AutoGridSearchCV.

autogridsearch_wrapper

Create your own auto-gridsearch class. A function that wraps any scikit-learn, pybear, or dask_ml GridSearchCV module to create an identical GridSearch class that performs multiple passes of grid search using progressively narrower search grids.

• Access via pybear.model_selection.autogridsearch_wrapper.

GSTCV (GridSearchThresholdCV)

Perform conventional grid search on a classifier with concurrent threshold search. Finds the global optima for the passed parameters and thresholds. Fully compliant with the scikit-learn GridSearchCV API.

• Access via pybear.model_selection.GSTCV.

AutoGSTCV

Perform multiple uninterrupted passes of grid search with pybear GSTCV utilizing progressively narrower search grids.

• Access via pybear.model_selection.AutoGSTCV.

MinCountTransformer

Perform minimum frequency thresholding on numerical or categorical data simultaneously across an entire array of data. Violates the scikit-learn API in that datasets are modified along the example axis (examples may be deleted.) Otherwise is fully compliant with the sci-kit learn transformer API, with fit, transform, and partial_fit methods.

• Access via pybear.preprocessing.MinCountTransformer.

ColumnDeduplicator

Identify and selectively remove duplicate columns in numerical or categorical data. Fully compliant with the scikit-learn transformer API, with fit, transform, and partial_fit methods. Perfect for removing duplicate columns from one-hot encoded data in a scikit-learn pipeline. Also fits and transforms data batch-wise, such as with dask_ml Incremental and ParallelPostFit wrappers.

• Access via pybear.preprocessing.ColumnDeduplicator.

InterceptManager

A scikit-style transformer that identifies and manages constant columns in a dataset. IM can remove all, selectively keep one, or append a column of constants. Handles numerical & non-numerical data, and nan-like values. Does batch-wise fitting via a partial_fit method, and can be wrapped with dask_ml Incremental and ParallelPostFit wrappers.

• Access via pybear.preprocessing.InterceptManager.

SlimPolyFeatures

Perform a polynomial feature expansion on a dataset omitting constant and duplicate columns. Follows the standard scikit-learn transformer API. Handles scipy sparse matrices/arrays. Suitable for sklearn pipelines. Has a partial_fit method for batch-wise training and can be wrapped with dask_ml Incremental and ParallelPostFit wrappers.

• Access via pybear.preprocessing.SlimPolyFeatures.

The pybear Text Wrangling Suite

pybear has a wide selection of text wrangling tools for those who don’t have a PhD in NLP. Most modules have the dual capability of working with regular expressions or literal strings (for those who don’t know regular expressions!) Most of the modules also accept data in 1D list-like format or (ragged!) 2D array-like format. All of these are built in scikit transformer API style and can be stacked in a scikit pipeline.

These modules can be found in pybear.feature_extraction.text. The modules include:

• Lexicon - A class exposing 68,000+ English words and a stop words attribute

• NGramMerger - Join select adjacent tokens together to handle as a single token

• StopRemover - Remove pybear stop words from a body of text

• TextJoiner - Join tokenized text into a contiguous string with separators

• TextJustifier - Justify to a fixed margin; wrap on literals or regex patterns

• TextLookup - Compare words in a body of text against the pybear Lexicon

• TextLookupRealTime - Same as TextLookup but with in-situ save capability

• TextNormalizer - Normalize text to the same case

• TextPadder - Pad ragged text into shaped containers using fill

• TextRemover - Remove units of contiguous text

• TextReplacer - Remove substrings from contiguous text

• TextSplitter - Split contiguous text into tokens using literal strings or regex

• TextStatistics - Compile statistics about a body of text

• TextStripper - Remove leading and trailing spaces from text

Important links

• Official source code repo: https://github.com/PylarBear/pybear

• Download releases: https://pypi.org/project/pybear/

• Issue tracker: https://github.com/PylarBear/pybear/issues

Source code

You can clone the latest source code with the command:

git clone https://github.com/PylarBear/pybear.git

Contributing

For guidelines on how to contribute to pybear, see the CONTRIBUTING.rst file in the source code repository. You can also access the contributing guidelines on the contributing webpage of the pybear documentation website.

Testing

pybear 0.2 is tested via GitHub Actions to run on Linux, Windows, and MacOS, with Python versions 3.10, 3.11, 3.12, 3.13, and 3.14. pybear is not supported nor test tested on earlier versions.

If you want to test pybear yourself, you will need:

• pytest (>=8.0.0) for Python version 3.14

• pytest (>=7.0.0) for Python versions 3.13, 3.12, 3.11, and 3.10

The tests are not available in the PyPI pip installation. You can get the tests by downloading the tarball from the pybear project page on pypi.org or cloning the pybear repo from GitHub. Once you have the source files in a local project folder, create a poetry environment for the project and install the test dependencies. After installation, open the poetry environment shell and you can launch the test suite from the root of your pybear project folder with:

(your-pybear-env) you@your_computer:/path/to/pybear/project$ pytest tests/

Documentation

• HTML documentation: https://pybear.readthedocs.io/en/stable/index.html

Communication

• GitHub Discussions: https://github.com/PylarBear/pybear/discussions