Skip to main content

Fast parallel DataFrame library built on PyArrow, optimized for Delta Lake and Azure Fabric

Project description

TurboFrame

A fast, parallel DataFrame library built on PyArrow. Optimized for Delta Lake reads and parallel GroupBy on Microsoft Fabric notebooks.

Install

# Core (parquet, csv, json)
pip install turboframe

# With Delta Lake support
pip install turboframe[delta]

# Everything
pip install turboframe[all]

Quick Start

from turboframe import TurboFrame

# From ANY source
tf = TurboFrame({"region": ["E","W","E"], "sales": [100,200,150]})
tf = TurboFrame(my_pandas_df)
tf = TurboFrame(my_spark_df)
tf = TurboFrame.read_csv("data.csv")
tf = TurboFrame.read_delta("/lakehouse/default/Tables/sales")
tf = TurboFrame.read_parquet("data.parquet")
tf = TurboFrame.read_excel("report.xlsx")
tf = TurboFrame.read_sql("SELECT * FROM sales", connection)

# Filter + GroupBy + Sort
result = (
    tf.filter("sales > 100")
      .groupby("region")
      .agg({"sales": "sum"})
      .sort("sales_sum", ascending=False)
)
result.show()

Supported Aggregations

sum, mean, min, max, count, std, var, median, nunique

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

turboframe-0.2.0.tar.gz (14.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

turboframe-0.2.0-py3-none-any.whl (12.2 kB view details)

Uploaded Python 3

File details

Details for the file turboframe-0.2.0.tar.gz.

File metadata

  • Download URL: turboframe-0.2.0.tar.gz
  • Upload date:
  • Size: 14.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.11

File hashes

Hashes for turboframe-0.2.0.tar.gz
Algorithm Hash digest
SHA256 7479b3660880e56f9a4461c25e65504cf3a4ab060d880b3eb402e674a5c7f25f
MD5 ee963186c652743dd862f29d46ec9fcb
BLAKE2b-256 71bed3bdb2a5657ec18bdedb1694c5fc918f07380e1889898c8302271b15edec

See more details on using hashes here.

File details

Details for the file turboframe-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: turboframe-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 12.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.11

File hashes

Hashes for turboframe-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 7b70e183d3225425d2559baf3eaee134ced1dcef19ada3c57bcfe448d9ad77e7
MD5 91cb1fb2d04fd051cf786dc973a74a5b
BLAKE2b-256 71fd9590e25f781c4ab580fcca5425ffe9aa7202b077692997b5a6a36fe975f3

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page