Skip to main content

Data Refinery: transformating data

Project description

Build Status Coverage Docs Version PyVersions License

Data Refinery

The main goal of the library is perform a Transformation over a data event. Supports a variety of functions typically used on machine learning and AI.

Development is oriented into a functional style avoiding side effects on transformations.

Installation

In console pip install data-refinery or python setup.py install from sources.

Usage example

from datarefinery.TupleOperations import wrap, keep, substitution
from datarefinery.CombineOperations import sequential

x2 = wrap(lambda x: x*2)

operation = sequential(keep(["name"]), substitution(["value"], x2))
(res, err) = operation({"name": "John", "value": 10})
print(res) # {"name": "John", "value": 20}

Documentation

Visit complete documentation at readthedocs.io.

Compatibility

Python: 3.5, 3.6

Contribute

Follow the steps on the how to contribute document.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data-refinery-0.2.13.tar.gz (10.1 kB view hashes)

Uploaded source

Built Distribution

data_refinery-0.2.13-py3-none-any.whl (16.0 kB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page