Skip to main content

Avro reader for Dask.

Project description

=========Dask-Avro=========.. image:: https://img.shields.io/pypi/v/dask-avro.svg :target: https://pypi.python.org/pypi/dask-avro.. image:: https://img.shields.io/pypi/pyversions/dask-avro.svg :target: https://pypi.python.org/pypi/dask-avro.. image:: https://readthedocs.org/projects/dask-avro/badge/?version=latest :target: https://readthedocs.org/projects/dask-avro/?badge=latest :alt: Documentation Status.. image:: https://img.shields.io/travis/rmax/dask-avro.svg :target: https://travis-ci.org/rmax/dask-avro.. image:: https://codecov.io/github/rmax/dask-avro/coverage.svg?branch=master :alt: Coverage Status :target: https://codecov.io/github/rmax/dask-avro.. image:: https://landscape.io/github/rmax/dask-avro/master/landscape.svg?style=flat :target: https://landscape.io/github/rmax/dask-avro/master :alt: Code Quality Status.. image:: https://requires.io/github/rmax/dask-avro/requirements.svg?branch=master :alt: Requirements Status :target: https://requires.io/github/rmax/dask-avro/requirements/?branch=masterAvro reader for Dask.* Free software: MIT license* Documentation: https://dask-avro.readthedocs.org.* Python versions: 2.7, 3.4+Features--------This projects provides an Avro_ format reader for Dask_. Provides a convenientfunction to read one or more Avro files and partition them arbitrarily.Quickstart----------Usage:: import dask.bag import dask_avro delayeds = dask_avro.read_avro("data-*.avro", blocksize=2**26) data = dask.bag.from_delayed(delayeds)Credits-------This package was created with Cookiecutter_ and the `rmax/cookiecutter-pypackage`_ project template... _Avro: https://avro.apache.org/docs/1.2.0/.. _Cookiecutter: https://github.com/audreyr/cookiecutter.. _Dask: http://dask.pydata.org/en/latest/.. _`rmax/cookiecutter-pypackage`: https://github.com/rmax/cookiecutter-pypackage

=======History=======0.1.1 (2018-01-18)------------------* Pin fastavro version to <0.16 as latest versions don't allow to use internal C-based ``_iter_avro`` function.0.1.0 (2017-02-02)------------------* First release on PyPI.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dask-avro-0.1.1.tar.gz (11.0 MB view hashes)

Uploaded Source

Built Distribution

dask_avro-0.1.1-py2.py3-none-any.whl (4.9 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page