Skip to main content

Data aggregation pipeline for running real-time predictive models

Project description

Blurr

CircleCI Documentation Status Coverage Status PyPI version

Table of contents

What is Blurr?

Blurr transforms structured, streaming raw data into features for model training and prediction using a high-level expressive YAML-based language called the Blurr Transform Spec (BTS). The BTS merges the schema and computation model for data processing.

The BTS is a data transform definition for structured data. The BTS encapsulates the business logic of data transforms and Blurr orchestrates the execution of data transforms. Blurr is runner-agnostic, so BTSs can be run by event processors such as Spark, Spark Streaming or Flink.

Is Blurr for you?

Yes, if: you are well on your way on the ML 'curve of enlightenment', and are thinking about how to do online scoring

Curve

Playground

Launch playground

Tutorial and Docs

Coming up with features is difficult, time-consuming, requires expert knowledge. 'Applied machine learning' is basically feature engineering --- Andrew Ng

Read the docs

Streaming BTS Tutorial | Window BTS Tutorial

Preparing data for specific use cases using Blurr:

Contribute to Blurr

Welcome to the Blurr community! We are so glad that you share our passion for building MLOps!

Please create a new issue to begin a discussion. Alternatively, feel free to pick up an existing issue!

Please sign the Contributor License Agreement before raising a pull request.

Data Science 'Joel Test'

Inspired by the (old school) Joel Test to rate software teams, here's our version for data science teams. What's your score?

  1. Data pipelines are versioned and reproducible
  2. Pipelines (re)build in one step
  3. Deploying to production needs minimal engineering help
  4. Successful ML is a long game. You play it like it is
  5. Kaizen. Experimentation and iterations are a way of life

Roadmap

Blurr is currently in Developer Preview. Stay in touch!: Star this project or email hello@blurr.ai

  • Local transformations only
  • Support for custom functions and other python libraries in the BTS
  • Spark runner
  • S3 support for data sink
  • DynamoDB as an Intermediate Store
  • Features server

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

blurr-dev-0.1093.tar.gz (36.4 kB view details)

Uploaded Source

Built Distribution

blurr_dev-0.1093-py3-none-any.whl (52.5 kB view details)

Uploaded Python 3

File details

Details for the file blurr-dev-0.1093.tar.gz.

File metadata

  • Download URL: blurr-dev-0.1093.tar.gz
  • Upload date:
  • Size: 36.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for blurr-dev-0.1093.tar.gz
Algorithm Hash digest
SHA256 0cfbd5d93a33f79ad181a3994b1bb310e337ef2194c3d75f5f8cc8f870abc076
MD5 8826ee8081a07359ce4339753f41c33c
BLAKE2b-256 30ab163b06acf4c4a66dbe37136f294eb4fad5de92bf3347bdddb037c1924c1a

See more details on using hashes here.

File details

Details for the file blurr_dev-0.1093-py3-none-any.whl.

File metadata

File hashes

Hashes for blurr_dev-0.1093-py3-none-any.whl
Algorithm Hash digest
SHA256 f824ea6737a548a952661a72c62fc2cafb3e89054289f194de6bbb7b95a56a1b
MD5 b2f06281e6ab7b209e3e226e6a47ced7
BLAKE2b-256 ce583c90a254184e35ca96a74aaef9a84a4d234423c09154d886e2c339af5cae

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page