Skip to main content

Redis Cluster with Some Features

Project description

A Redis cluster for when single points of failure leave you flustered.

Overview

Redis Fluster is a very limited Redis pool/cluster implementation that makes sharding simple for a few common use cases.

Quickstart

import redis
from fluster import FlusterCluster
cluster = FlusterCluster([redis.Redis(6379), redis.Redis(6380)])

while True:
  for key in ('foo', 'bar'):
    try:
      client = cluster.get_client(key)
      client.incr(key, 1)
      client.get(key)
    except ConnectionError:
      client = cluster.get_client(key)
      client.incr(key, 1)
      client.get(key)
  time.sleep(1)

Limited, how? I want to use this for everything!

Simply put, don’t. Fluster maintains a pool of connections to various Redis instances and will return a connection to one based on a shard key provided. If one goes down, it gets put in a penalty box until it comes back up, at which point it’s usable again.

At not point are keys duplicated, nor are they redistributed when nodes drop/join. If you’re writing INCR statements and the node goes down, now you’re writing them to another instance. Once the original instance returns, you’ve got two sets of values for the same key. This will be seamless and your program won’t crash, so maybe that’s enough.

Then what’s it good for?

Caches and ephemeral data. The ideal case is where going down is worse than duplicated data. If a Redis fluster node goes down and you’ve got two copies of a cache, this probably isn’t a problem. You’ve set expiries on the data, right?

Likewise, if you’re using lists to distribute a queue to multiple Redis instances, then one dropping and joining isn’t a problem. Items queued while it was down went elsewhere and if your workers read from all available instances, then nothing has been lost, or is really all that different.

What about Redis Cluster?

Looks great! Unfortunately, it’s very new and not ready for production use. With all due luck, that will achieve all its promise and this project can quietly fade away.

Project details


Release history Release notifications

This version
History Node

0.0.4

History Node

0.0.3

History Node

0.0.2

History Node

0.0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
fluster-0.0.4-py2.py3-none-any.whl (15.7 kB) Copy SHA256 hash SHA256 Wheel 3.5 Oct 19, 2016
fluster-0.0.4.tar.gz (10.6 kB) Copy SHA256 hash SHA256 Source None Oct 19, 2016

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page