Dask-Avro
Avro reader for Dask.
Free software: MIT license
Documentation: https://dask-avro.readthedocs.org.
Python versions: 2.7, 3.5+
Features
This projects provides an Avro format reader for Dask. Provides a convenient function to read one or more Avro files and partition them arbitrarily.
Quickstart
Usage:
import dask.bag
import dask_avro
delayeds = dask_avro.read_avro("data-*.avro", blocksize=2**26)
data = dask.bag.from_delayed(delayeds)
Credits
This package was created with Cookiecutter and the rmax/cookiecutter-pypackage project template.
History
0.3.0 (2018-06-16)
Fixed support for latest fastavro release.
Require fastavro>=0.17.
0.2.1 (2018-06-15)
Pin fastavro version to <=0.19.6 due to breaking changes.
0.2.0 (2018-02-12)
Added support for fastavro 0.16+.
0.1.2 (2018-02-12)
Fix compatibility with dask 0.17.0.
0.1.1 (2018-01-18)
Pin fastavro version to <0.16 as latest versions don’t allow to use internal C-based _iter_avro function.
0.1.0 (2017-02-02)
First release on PyPI.
1 maintainer
Metadata
1 maintainer
Release files for dask-avro 0.3.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| dask-avro-0.3.0.tar.gz | 11.0 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| dask_avro-0.3.0-py2.py3-none-any.whl | Python 3, Python 2 | none | any | Details |
Total release size: 11.0 MB
Release files / dask-avro-0.3.0.tar.gz
| Download URL | dask-avro-0.3.0.tar.gz |
|---|---|
| Size | 11.0 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
60e8cf79e5527f2d24a19b6956fdf5f090d9c44faf473876eddc16a21bece833
|
|
BLAKE2b-256 checksum How to use checksums |
c4da1fb1cbecda8bedd880f8a2e8c065d63fdad92ac9561c03a3e72e6f335a07
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / dask_avro-0.3.0-py2.py3-none-any.whl
| Download URL | dask_avro-0.3.0-py2.py3-none-any.whl |
|---|---|
| Size | 3.8 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
1784a523826dec30cd20a6e360c0caca3f2268fbfe6556e28e110cd2b1e3b655
|
|
BLAKE2b-256 checksum How to use checksums |
36674e54ea449224829476e053a20e55291da150a549829afa20892f67ebb956
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
