Skip to main content

Data Refinery: transformating data

Project description

Build Status Coverage Docs Version PyVersions License

Data Refinery

The main goal of the library is perform a Transformation over a data event. Supports a variety of functions typically used on machine learning and AI.

Development is oriented into a functional style avoiding side effects on transformations.

Installation

In console pip install data-refinery or python setup.py install from sources.

Usage example

from datarefinery.tuple.TupleOperations import wrap, keep, substitution
from datarefinery.Tr import Tr

x2 = wrap(lambda x: x*2)

tr = Tr(keep(["name"])).then(substitution(["value"], x2))
operation = tr.apply()
(inp, res, err) = operation({"name": "John", "value": 10})
print(res) # {"name": "John", "value": 20}

Documentation

Visit complete documentation at github pages branch or at readthedocs.io.

Compatibility

Python: 3.5, 3.6

Contribute

Follow the steps on the how to contribute document.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data-refinery-0.1.67.tar.gz (8.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

data_refinery-0.1.67-py3-none-any.whl (13.0 kB view details)

Uploaded Python 3

File details

Details for the file data-refinery-0.1.67.tar.gz.

File metadata

File hashes

Hashes for data-refinery-0.1.67.tar.gz
Algorithm Hash digest
SHA256 c74ea6bf33bf74cf5441cc382e1fb5e11cf27b9627a61b9ed5124ffa4a7ce23b
MD5 8c2d8c8836b5b5ee3aa92e03f57613cc
BLAKE2b-256 5d03f3e6637f68982882b0f92795eef117ecd0aec0327e246663983263ae9f0d

See more details on using hashes here.

File details

Details for the file data_refinery-0.1.67-py3-none-any.whl.

File metadata

File hashes

Hashes for data_refinery-0.1.67-py3-none-any.whl
Algorithm Hash digest
SHA256 90ec5c37d5afbd1235be055cba201396b2304917ab644e3defb6d8da28de2c01
MD5 0caabf70ae6e7bf039b85bbacc995151
BLAKE2b-256 b78ff0e1c552fee6cdaff951be5466efc36ea0e919cdaa5e7d458c418053fb5f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page