Skip to main content

Fast parallel DataFrame library built on PyArrow, optimized for Delta Lake and Azure Fabric

Project description

TurboFrame

A fast, parallel DataFrame library built on PyArrow. Optimized for Delta Lake reads and parallel GroupBy on Microsoft Fabric notebooks.

Install

# Core (parquet, csv, json)
pip install turboframe

# With Delta Lake support
pip install turboframe[delta]

# Everything
pip install turboframe[all]

Quick Start

from turboframe import TurboFrame

# From ANY source
tf = TurboFrame({"region": ["E","W","E"], "sales": [100,200,150]})
tf = TurboFrame(my_pandas_df)
tf = TurboFrame(my_spark_df)
tf = TurboFrame.read_csv("data.csv")
tf = TurboFrame.read_delta("/lakehouse/default/Tables/sales")
tf = TurboFrame.read_parquet("data.parquet")
tf = TurboFrame.read_excel("report.xlsx")
tf = TurboFrame.read_sql("SELECT * FROM sales", connection)

# Filter + GroupBy + Sort
result = (
    tf.filter("sales > 100")
      .groupby("region")
      .agg({"sales": "sum"})
      .sort("sales_sum", ascending=False)
)
result.show()

Supported Aggregations

sum, mean, min, max, count, std, var, median, nunique

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

turboframe-0.1.0.tar.gz (12.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

turboframe-0.1.0-py3-none-any.whl (10.3 kB view details)

Uploaded Python 3

File details

Details for the file turboframe-0.1.0.tar.gz.

File metadata

  • Download URL: turboframe-0.1.0.tar.gz
  • Upload date:
  • Size: 12.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.11

File hashes

Hashes for turboframe-0.1.0.tar.gz
Algorithm Hash digest
SHA256 a537fcc190d8e379291ed6dd02646e8120a3b2a4144fcd0bc83a6d59c10661dd
MD5 30a4d25d1aced72f07100c59c4232f62
BLAKE2b-256 cc42f8c0333342c16421b2bfba4811cd386c53a2d90d447f4c8609c46e226682

See more details on using hashes here.

File details

Details for the file turboframe-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: turboframe-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 10.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.11

File hashes

Hashes for turboframe-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 14fa603535857a27be8bceb815c821b59a43a49d35e0c037030bd0b408bef520
MD5 b3443fa1f2379e88434a0c28e8138820
BLAKE2b-256 e3e9482c5285765fecec42baa10d876693ad5ecb15d31b1db1b0c016b263cbd8

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page