Skip to main content

Data Refinery: transformating data

Project description

Build Status Coverage Docs Version PyVersions License

Data Refinery

The main goal of the library is perform a Transformation over a data event. Supports a variety of functions typically used on machine learning and AI.

Development is oriented into a functional style avoiding side effects on transformations.

Installation

In console pip install data-refinery or python setup.py install from sources.

Usage example

from datarefinery.tuple.TupleOperations import wrap, keep, substitution
from datarefinery.Tr import Tr

x2 = wrap(lambda x: x*2)

tr = Tr(keep(["name"])).then(substitution(["value"], x2))
operation = tr.apply()
(inp, res, err) = operation({"name": "John", "value": 10})
print(res) # {"name": "John", "value": 20}

Documentation

Visit complete documentation at github pages branch or at readthedocs.io.

Compatibility

Python: 3.5, 3.6

Contribute

Follow the steps on the how to contribute document.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data-refinery-0.1.63.tar.gz (7.9 kB view details)

Uploaded Source

Built Distribution

data_refinery-0.1.63-py3-none-any.whl (11.9 kB view details)

Uploaded Python 3

File details

Details for the file data-refinery-0.1.63.tar.gz.

File metadata

File hashes

Hashes for data-refinery-0.1.63.tar.gz
Algorithm Hash digest
SHA256 e06f4a245b7f6aae17a1ab547dc868f049a3ad166b6ec5104cfe85f1e7f935c0
MD5 ba5bfb5841de5054d106d1f99d0a8b17
BLAKE2b-256 44bd2ae48178394f1af4199c5e455d39b014980b9b50c72b7d01ae4136a35e31

See more details on using hashes here.

File details

Details for the file data_refinery-0.1.63-py3-none-any.whl.

File metadata

File hashes

Hashes for data_refinery-0.1.63-py3-none-any.whl
Algorithm Hash digest
SHA256 a09d48d0c1f97ffa3dd45d2f0401fab4110d4026db23ce1d3b1c920b39ce74cc
MD5 373008639d6b931ea28a13f4d98e76c2
BLAKE2b-256 c9a892f840255908c67e594ffcf1bd3412fc5c6a812e8513d2b6bf8eaa5ea300

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page