Skip to main content
Join the official 2019 Python Developers SurveyStart the survey!

Redis python interface that serializes all values using json, pickle, msgpack or a custom serializer.

Project description

Redis python interface that serializes all values using json, pickle, msgpack or a custom serializer.

https://secure.travis-ci.org/michael-mri/serialized-redis.svg?branch=master https://codecov.io/gh/michael-mri/serialized-redis/branch/master/graph/badge.svg

Getting Started

Installation

pip install serialized-redis-interface

Usage

>>> import serialized_redis

>>> r = serialized_redis.JSONSerializedRedis(host='localhost', port=6379, db=0)
>>> r.set('foo', { 'test': 'dict' })
True
>>> r.get('foo')
{'test': 'dict'}

>>> r = serialized_redis.PickleSerializedRedis(host='localhost', port=6379, db=0)
>>> r.set('foo', { 'test': 'dict' })
True
>>> r.get('foo')
{'test': 'dict'}

>>> r = serialized_redis.MsgpackSerializedRedis(host='localhost', port=6379, db=0)
>>> r.set('foo', { 'test': 'dict' })
True
>>> r.get('foo')
{'test': 'dict'}

serialized-redis extends redis-py and uses the same interface.

Most commands, Piplines and PubSub are supported and take care of serializing and deserializing values.

msgpack must be installed in order to use MsgpackSerializedRedis.

All strings are python str.

Limitations

As values are serialized, Redis operations that manipulate or extract data from values are not supported.

  • SORT commands may not return correct order depending on the serializer used.
  • ZSCAN and SSCAN MATCH option will only work for exact match.
  • STRLENGTH and HSTRLENGTH will return the length of the serialized value.
  • all lexicographical commands like ZLEXCOUNT, ZREMRANGEBYLEX and ZREVRANGEBYLEX are not supported
  • INCR is only supported with JSON serializer
  • fields of Redis hashes are not serialized

Extra Methods

  • smembers_as_list, sdiff_as_list, sinter_as_list, sunion_as_list can be used when members of the redis set may not be hashable once deserialized.

    >>> r = serialized_redis.JSONSerializedRedis()
    >>> r.sadd('myset', {'dict': 1})
    1
    >>> r.smembers('myset')
    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
      File "/home/michael/workspace/Origin_Nexus/serialized_redis/serialized_redis/__init__.py", line 176, in smembers
        return set(super().smembers(*args, **kwargs))
    TypeError: unhashable type: 'dict'
    >>> r.smembers_as_list('myset')
    [{'dict': 1}]
    
  • smart_get and smart_set can be used to retrieve and store python structure with their redis counterpart:

    • python list as redis LIST
    • python set as redis SET
    • python dict as redis HASH, fields will not be (de)serialized.

Custom Serializer

You can use your own seriliazing and deserializing functions:

>>> r = serialized_redis.SerializedRedis(serialization_fn=my_serializer, deserialization_fn=my_deserializer)

If your deserializer function expects python 3 strings instead of bytes, you can add decode_responses=True parameter.

Decoding bytes to str when required is the responsability of the deserialization function.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for serialized-redis-interface, version 0.3.1
Filename, size File type Python version Upload date Hashes
Filename, size serialized_redis_interface-0.3.1-py3-none-any.whl (7.8 kB) File type Wheel Python version py3 Upload date Hashes View hashes
Filename, size serialized-redis-interface-0.3.1.tar.gz (19.8 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page