Bounded-memory serverless distributed N-dimensional array processing
Project description
Cubed
Note: this is a proof-of-concept, and many things are incomplete or don't work.
Bounded-memory serverless distributed N-dimensional array processing
Cubed is a distributed N-dimensional array library implemented in Python using bounded-memory serverless processing and Zarr for storage.
- Implements the Python Array API standard (see coverage status)
- Guaranteed maximum memory usage for standard array functions
- Follows Dask Array's chunked array API (
map_blocks
,rechunk
, etc) - Zarr for storage
- Multiple serverless runtimes: Python (in-process), Lithops, Modal, Apache Beam
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
cubed-0.4.0.tar.gz
(53.7 kB
view hashes)
Built Distribution
cubed-0.4.0-py3-none-any.whl
(69.8 kB
view hashes)