Data Refinery: transformating data
Project description
ETL library
The main goal of the library is perform a Transformation over a data event. Supports a variety of functions typically used on machine learning and AI.
Development is oriented into a functional style avoiding side effects on transformations.
Installation
In console pip install data-refinery or python setup.py install from sources.
Usage example
from datarefinery.tuple.TupleOperations import wrap, keep, substitution
from datarefinery.Tr import Tr
x2 = wrap(lambda x: x*2)
tr = Tr(keep(["name"])).then(substitution(["value"], x2))
operation = tr.apply()
(inp, res, err) = operation({"name": "John", "value": 10})
print(res) # {"name": "John", "value": 20}
Documentation
Visit complete documentation at github pages branch or at readthedocs.io.
Compatibility
Python: 3.5, 3.6
Contribute
Follow the steps on the how to contribute document.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
data-refinery-0.1.54.tar.gz
(7.9 kB
view hashes)
Built Distribution
Close
Hashes for data_refinery-0.1.54-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f2dfb71132f5216e1c0d20c8c6d1dd93ef0910f90034398de98f452e3689f354 |
|
MD5 | 510b682efbb3c3d72cd9da79e9ab58da |
|
BLAKE2b-256 | b2b9fb798e21edbb51e725e122e93ee501c23761744d58f95b4fa3ef0c5779eb |