sdpk 0.0.2

Small DPK - an extended fork of Data Preparation Toolkit Library for Ray and Python

Data Processing Library

This provides a python framework for developing transforms on data stored in files and running them in a pure Python or ray cluster. Data files may be stored in the local file system or COS/S3. For more details see the documentation.

Library Artifact Build and Publish

To build the library

make build_dist

To publish it to PyPi

make publish

To up the version number, edit the Makefile to change VERSION and rerun the above. This will require committing both the Makefile and the autotmatically updated pyproject.toml file.