Skip to main content

Conventions for Python + Apache Beam

Project description

The klio Library

Latest version of klio on PyPI Status of klio unit tests

The library for implementing Klio-ified Apache Beam transforms with decorators, helper transforms, and leverage Klio’s message-handling logic.

As the klio library is not meant to be installed directly, check out the installation guide for how to setup installation. There is also the user guide and the API documentation for more information.

What is Klio?

Klio is an ecosystem that allows you to process audio files – or any binary files – easily and at scale.

Klio jobs are opinionated data pipelines in Python (streaming or batch) built upon Apache Beam and tuned for audio and binary file processing.

Klio was built by Spotify to run our large-scale audio intelligence systems and is used by teams of engineers and audio researchers to help develop and deploy next generation audio algorithms.

Read more about Klio here.

Get Started

Check out our Quick Start guide on how to start using Klio.

Resources

Release Information

21.9.0 (2021-10-12)

Fixed

  • max_thread_count parameter in the handle_klio decorator now correctly works for DoFn process methods (See PR 209).

Changed

  • Klio’s config file is now read from disk once per worker instead of once per thread (See PR 218).

Full Changelog.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for klio, version 21.9.0
Filename, size File type Python version Upload date Hashes
Filename, size klio-21.9.0-py2.py3-none-any.whl (69.5 kB) File type Wheel Python version py2.py3 Upload date Hashes View
Filename, size klio-21.9.0.tar.gz (77.1 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page