Skip to main content

Transform string-based expressions into Polars DataFrame operations

Project description

Polars Expression Transformer

Polars Expression Transformer is a Python library that provides a simple and intuitive way to transform and manipulate data using Polars expressions. It is designed for users who are familiar with SQL and Tableau and want to leverage the power of Polars for data processing tasks.

Purpose

The purpose of Polars Expression Transformer is to provide a high-level interface for working with Polars expressions. It allows users to write simple string expressions that can be easily translated into Polars expressions, making it easy to perform complex data transformations without having to write Python code.

Target Group

Polars Expression Transformer is ideal for users who:

  • Are familiar with SQL or Tableau and want to use Polars for data transformation tasks.
  • Want to perform complex data transformations without having to write Python code.
  • Need to integrate Polars into an application or tool and want to provide a simple and intuitive interface for users to perform data transformations.

When to Use

Polars Expression Transformer is particularly useful in the following scenarios:

  • When you are not directly exposed to Python, for example in an application.
  • When you want to provide a simple and intuitive interface for users to perform complex data transformations without having to write Python code.

When Not to Use

Polars Expression Transformer may not be the best choice for users who:

  • Are already familiar with Polars and are developing in an IDE. In this case, it may be more efficient to write Polars expressions directly.
  • Want to have the best performance and all features of Polars. Polars Expression Transformer adds an additional layer on top of Polars, which may result in a performance overhead.
  • Need to perform low-level optimizations or custom transformations that are not supported by Polars Expression Transformer

Installation

To install Polars Expression Transformer, you can use pip:

pip install polars-expr-transformer

Example Use Case

Let's say you have a Polars DataFrame df with columns "names" and "subnames", and you want to create a new column "combined" that concatenates the values in "names" and "subnames" with a space in between.

Without Polars Expression Transformer, you would need to write Python code to accomplish this:

df = df.with_column(pl.col("names") + " " + pl.col("subnames").alias("combined"))

With Polars Expression Transformer, you can write a simple string expression instead:

from polars_expr_transformer.process.polars_expr_transformer import simple_function_to_expr

df = df.select(simple_function_to_expr('concat([names], " ", [subnames])').alias("combined"))

This makes it easy to perform complex data transformations without having to write Python code.

Built on Polars

Polars Expression Transformer is built on top of the amazing Polars library. Polars is a blazing fast DataFrame library implemented in Rust and Python. It is designed to be a high-performance alternative to Pandas and other DataFrame libraries. I highly recommend checking out Polars if you are working with large datasets or need to perform complex data transformations quickly.

Acknowledgements

We would like to thank the Polars team for creating such an amazing library.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

polars_expr_transformer-0.2.50.0.tar.gz (22.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

polars_expr_transformer-0.2.50.0-py3-none-any.whl (29.0 kB view details)

Uploaded Python 3

File details

Details for the file polars_expr_transformer-0.2.50.0.tar.gz.

File metadata

  • Download URL: polars_expr_transformer-0.2.50.0.tar.gz
  • Upload date:
  • Size: 22.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.11.9 Linux/6.5.0-1021-azure

File hashes

Hashes for polars_expr_transformer-0.2.50.0.tar.gz
Algorithm Hash digest
SHA256 6ae97ca64aee69e91f2d1c9c074c687e4431d45fb1997fe94ddbe88290f83367
MD5 61d8695ac65a930cddc2ca1154946481
BLAKE2b-256 4c2009f91c01345a3226cb9053ae4f7e73938272881a3f980b2f8d7750301d64

See more details on using hashes here.

File details

Details for the file polars_expr_transformer-0.2.50.0-py3-none-any.whl.

File metadata

File hashes

Hashes for polars_expr_transformer-0.2.50.0-py3-none-any.whl
Algorithm Hash digest
SHA256 0fd038f420cdf819d1c0fb50bf80e877a648f077da854810059600bb186cd1ee
MD5 b4a90c5b493c59966a312537392b9022
BLAKE2b-256 2d4b4d568d0cd4712812dabf6e6971a0ef2f323db585f8a99df9a1cf618b81e9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page