Skip to main content

Python data pipelines

Project description

Python data pipelines

Documentation Status Updates

Features

This package implements the basics for building pipelines similar to magrittr in R. Pipelines are created using >>. Internally it uses singledispatch to provide a way for a unified API for different kinds of inputs (SQL databases, HDF, simple dicts, …).

Basic example what can be build with this package:

>>> from my_library import append_col
>>> import pandas as pd

>>> pd.DataFrame({"a" : [1,2,3]}) >> append_col(x=3)
   a  X
0  1  3
1  2  3
2  3  3

In the future, this package might also implement the verbs from the R packages dplyr and tidyr for pandas.DataFrame and or I will fold this into one of the other available implementation of dplyr style pipelines/verbs for pandas.

Documentation

The documentaiton can be found on ReadTheDocs: https://pydatapipes.readthedocs.io

License

Free software: MIT license

Credits

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.

History

0.1.0 (2016-10-22)

  • First release on PyPI.

Project details


Release history Release notifications

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
pydatapipes-0.1.0-py2.py3-none-any.whl (6.9 kB) Copy SHA256 hash SHA256 Wheel py2.py3 Oct 22, 2016
pydatapipes-0.1.0.tar.gz (26.8 kB) Copy SHA256 hash SHA256 Source None Oct 22, 2016

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page