Skip to main content
https://travis-ci.org/Gandi/pyramid_kvs.svg?branch=master

Some Key Value Store basics for pyramid:

Two KVS are implemented:
  • memcache

  • redis

Here are the provides features:

  • An application cache, shared by every request.

  • A session manager

  • A rate limit per session holder

  • A perl session reader (except you are migrating a perl website, you probably don’t want to use it).

Every of this components are optional, they exists if they are set in the configuration like below. Component settings are written in json.

Cache

The application cache is a new attribute of the session. request.cache if the settings kvs.cache exists. Here are an example of configuration

kvs.cache = {"kvs": "redis",
             "codec": "pickle",
             "kvs_kwargs": {},
             "ttl": 300,
             "key_prefix": "cache::"}

Every kvs, except the type are optional. The example contains every key with their default values for a redis instance. The kvs_kwargs key is passed to the driver to build the client connection.

Session

The session is accessible via “request.session”, it’s in every pyramid application. This is just an implementation for Key Value Store users.

kvs.session = {"kvs": "redis",
               "key_name": "session_id",
               "session_type": "cookie",
                "ttl": 300,
                "key_prefix": "session::"}

Every kvs, except the type are optional. The example contains every key with their default values for a redis instance.

You can also create a session for an http header like authentication token, it’s help to create a cache per user in an API. API don’t use cookies.

kvs.session = {"kvs": "redis",
               "key_name": "X-Auth-Token",
               "session_type": "header",
                "ttl": 300,
                "key_prefix": "session::"}

Ratelimit

The ratelimit works only if the kvs.session is used! Ratelimit is per session hold and limit number of http queries in a defined period.

kvs.ratelimit = {"window": 1, "limit": 15}

All keys are optional. The example contains every key with their default values for a redis instance.

If the ratelimit is enabled, every response will be decorated with the following http headers:

  • X-RateLimit-Limit: max queries in the period.

  • X-RateLimit-Remaining: current remaining queries in that period.

perlsess

This permit to read a session from a perl that use storable session.

storable: http://search.cpan.org/~ams/Storable-2.45/Storable.pm

Here is an example.

# declare the perlsess
kvs.perlsess = {"type": "memcached"}

Usage:

Declare the addons in the pyramid.includes in your config, then tweak the settings like above.

# development.ini
[app:main]
pyramid.includes =
    pyramid_kvs

# declare the application cache
# except type, every keys are optional
# kvs_kwargs for redis is the parameters of the redis.Redis class
# see: http://redis-py.readthedocs.org/en/latest/
# for memcache, parameters of the memcache.Client class
# https://github.com/linsomniac/python-memcached/blob/master/memcache.py#L160
kvs.cache = {"type": "redis"}

# declare the session
kvs.session = {"type": "redis"}

# Authorize a session holder to do 20 http queries max in 2 seconds.
kvs.ratelimit = {"window": 2, "limit": 20}

tests

pyramid_kvs have also a ‘mock’ implementation of a kvs used for testing purpose, register it using the pyramid plugins in your tests::

::
pyramid.includes =

pyramid_kvs.testing

Changelog

0.4.1 (2019-03-12)

  • Switch default serializer to json

..warning:

pickle serialize datetime by default, json don't, force the
serializer to pickle for backward compatibility in case datetime
are serialized

0.4.0 (2019-02-18)

  • Fix backward incompatibility of redis 3.x

  • Drop support of redix 2.x branch

0.3.1 (2019-02-22)

  • Switch default serializer to json

..warning::

pickle serialize datetime by default, json don’t, force the serializer to pickle for backward compatibility in case datetime serialized

0.3.0 (2018-03-15)

  • Don’t freeze pyramid version

  • Remove support of python 2.6

0.2.3 (2015-09-14)

  • Add get keys for Redis

0.2.2 (2015-05-29)

  • Bump version for PyPI upload problems

A file named “pyramid-kvs-0.2.1.tar.gz” already exists for pyramid-kvs-0.2.1. To fix problems with that file you should create a new release.

0.2.1

  • Improve testing

0.2

  • Add python 3 support

0.1.1

  • Fix package, files are missing

0.1

  • Initial version

Metadata

Release files for pyramid-kvs 1.0.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pyramid-kvs 1.0.0
File Size Uploaded
pyramid-kvs-1.0.0.tar.gz 21.3 kB Details

Release files / pyramid-kvs-1.0.0.tar.gz

Download URL pyramid-kvs-1.0.0.tar.gz
Size 21.3 kB
Tags Source
SHA-256 checksum
How to use checksums
c7831cd75abf412c246136ff1ef4c1aaa08f093676e9c0b6925d27e23a137009
BLAKE2b-256 checksum
How to use checksums
a26cb1fe09ca5ae037a4971fddd2570228633ce4570b116700f6fdabb8f9c03b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.0 CPython/3.10.4

Release history Release notifications | RSS feed

This release

1.0.0 This release

1 release file

0.4.1

1 release file

0.4.0

1 release file

0.3.1

1 release file

0.3.0

1 release file

0.2.3

1 release file

0.2.2

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page