colnade-dask 0.3.7

Dask backend adapter for Colnade

colnade-dask

Dask backend adapter for Colnade. Supports lazy evaluation and distributed computation.

Installation

pip install colnade-dask

Usage

from colnade import Column, Schema, UInt64, Float64, Utf8
from colnade_dask import scan_parquet

class Users(Schema):
    id: Column[UInt64]
    name: Column[Utf8]
    age: Column[UInt64]
    score: Column[Float64]

lf = scan_parquet("users.parquet", Users)
result = lf.filter(Users.age > 25).sort(Users.score.desc()).collect()

I/O Functions

• scan_parquet / scan_csv (lazy reads)
• write_parquet / write_csv
• from_dict / from_rows (in-memory construction)

Documentation

Full documentation at colnade.com.