Avro reader for Dask.
Project description
=========Dask-Avro=========.. image:: https://img.shields.io/pypi/v/dask-avro.svg :target: https://pypi.python.org/pypi/dask-avro.. image:: https://img.shields.io/pypi/pyversions/dask-avro.svg :target: https://pypi.python.org/pypi/dask-avro.. image:: https://readthedocs.org/projects/dask-avro/badge/?version=latest :target: https://readthedocs.org/projects/dask-avro/?badge=latest :alt: Documentation Status.. image:: https://img.shields.io/travis/rmax/dask-avro.svg :target: https://travis-ci.org/rmax/dask-avro.. image:: https://codecov.io/github/rmax/dask-avro/coverage.svg?branch=master :alt: Coverage Status :target: https://codecov.io/github/rmax/dask-avro.. image:: https://landscape.io/github/rmax/dask-avro/master/landscape.svg?style=flat :target: https://landscape.io/github/rmax/dask-avro/master :alt: Code Quality Status.. image:: https://requires.io/github/rmax/dask-avro/requirements.svg?branch=master :alt: Requirements Status :target: https://requires.io/github/rmax/dask-avro/requirements/?branch=masterAvro reader for Dask.* Free software: MIT license* Documentation: https://dask-avro.readthedocs.org.* Python versions: 2.7, 3.4+Features--------This projects provides an Avro_ format reader for Dask_. Provides a convenientfunction to read one or more Avro files and partition them arbitrarily.Quickstart----------Usage:: import dask.bag import dask_avro delayeds = dask_avro.read_avro("data-*.avro", blocksize=2**26) data = dask.bag.from_delayed(delayeds)Credits-------This package was created with Cookiecutter_ and the `rmax/cookiecutter-pypackage`_ project template... _Avro: https://avro.apache.org/docs/1.2.0/.. _Cookiecutter: https://github.com/audreyr/cookiecutter.. _Dask: http://dask.pydata.org/en/latest/.. _`rmax/cookiecutter-pypackage`: https://github.com/rmax/cookiecutter-pypackage
=======History=======0.1.1 (2018-01-18)------------------* Pin fastavro version to <0.16 as latest versions don't allow to use internal C-based ``_iter_avro`` function.0.1.0 (2017-02-02)------------------* First release on PyPI.
=======History=======0.1.1 (2018-01-18)------------------* Pin fastavro version to <0.16 as latest versions don't allow to use internal C-based ``_iter_avro`` function.0.1.0 (2017-02-02)------------------* First release on PyPI.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dask-avro-0.1.1.tar.gz
(11.0 MB
view hashes)
Built Distribution
Close
Hashes for dask_avro-0.1.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9839b12bd8c54bfa62fd2e2e69dbd31fe27992d2cae24a20b1d1a65e88c03aaa |
|
MD5 | fcad330bf9e2ee6ed9b61858c7684f3b |
|
BLAKE2b-256 | 72d8d00290f07e89ac6eb58353ce42c5f2ab8c31b6dee3a70d6141a1bafeaed2 |