Skip to main content

Data Processing Library

This provides a python framework for developing transforms on data stored in files - currently parquet files are supported - and running them in a ray cluster. Data files may be stored in the local file system or COS/S3. For more details see the documentation.

Virtual Environment

The project uses pyproject.toml and a Makefile for operations. To do development you should establish the virtual environment

make venv

and then either activate

source venv/bin/activate

or set up your IDE to use the venv directory when developing in this project

Library Artifact Build and Publish

To test, build and publish the library to artifactory

make test build publish

To up the version number, edit the Makefile to change VERSION and rerun the above. This will require committing both the Makefile and the autotmatically updated pyproject.toml file.

Metadata

Release files for data-prep-lab 0.1.6

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for data-prep-lab 0.1.6
File Size Uploaded Provenance Actions
data_prep_lab-0.1.6.tar.gz 293.3 kB Without provenance Details for data_prep_lab-0.1.6.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for data-prep-lab 0.1.6
File Interpreter ABI Platform Actions
data_prep_lab-0.1.6-py3-none-any.whl Python 3 none any Details for data_prep_lab-0.1.6-py3-none-any.whl

Total release size: 349.7 kB

Release files / data_prep_lab-0.1.6.tar.gz

Download URL data_prep_lab-0.1.6.tar.gz
Size 293.3 kB
Tags Source
SHA-256 checksum
How to use checksums
8197e52f19e355028211b324cd2132709ff58fbd6c686d908407b198f4e1e8b9
BLAKE2b-256 checksum
How to use checksums
ea66f7e8772e520ffa71164a29cc96a540baa0534f0c54fce2934746f57ecb7c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.0.0 CPython/3.10.11

Release files / data_prep_lab-0.1.6-py3-none-any.whl

Download URL data_prep_lab-0.1.6-py3-none-any.whl
Size 56.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
bb05092ea99e8f7293176272fc9c93c0eff7412e05cf8a51145aeaad59be3260
BLAKE2b-256 checksum
How to use checksums
160365a64b18029b2c15fd8a810f7cb98a8461a364d1c5aa698acd787f80af33
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.0.0 CPython/3.10.11

Security for data-prep-lab 0.1.6

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page