Skip to main content

Very fast Avro library for Python.

Project description

quickavro Build Status

quickavro is a Python library for working with the Avro file format. The purpose of this library is to provide a high-performance interface in Python for reading/writing Avro files. The performance of Avro has been historically very poor in Python, so quickavro makes use of a Python C extension that directly interacts with the official Avro C API. quickavro is currently alpha quality.

Documentation

API documentation and examples can be found at http://chrisrx.github.io/quickavro.

Install

$ pip install quickavro

It is important to note, however, that until PyPi allows binary wheels for linux, setup.py will attempt to download and compile the dependencies when installing with pip install.

Building from source

quickavro depends upon several C libraries:

They depend upon traditional build/config tools (cmake, autoconf, pkgconfig, etc), that sometimes make compiling this a nightmare so I ended up trying something a little different here and so far it is working well.

make vendor
make
make install

The vendor make target downloads and unpacks the source files for all the libraries, while the default make target build, calls Python setuptools/distutils to staticly compile these and creates a Wheel binary package. This removes the need for these libraries to be dynamically linked correctly and can trivially be packaged within the binary Wheel package without worries like if the header package has installed for the library.

Project details


Release history Release notifications

This version
History Node

0.1.22

History Node

0.1.21

History Node

0.1.20

History Node

0.1.19

History Node

0.1.18

History Node

0.1.17

History Node

0.1.13

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
quickavro-0.1.22.tar.gz (17.9 kB) Copy SHA256 hash SHA256 Source None Apr 23, 2018

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page