Skip to main content

guillotina cache implementation using redis + lru in-memory cache

Project description

https://travis-ci.org/guillotinaweb/guillotina_rediscache.svg?branch=master

guillotina_rediscache implements redis into guillotina with an additional in-memory layer cache.

In order to coordinate invalidating the in-memory cache, guillotina_rediscache utilizes the pub/sub feature redis provides.

Configuration

app_settings for this:

{
  "databases": {
    "db": {
      ...
      "cache_strategy": "redis"
      ...
    }
  },
  "redis": {
      'host': 'localhost',
      'port': 6379,
      'ttl': 3600,
      'memory_cache_size': 209715200,
      'pool': {
          'minsize': 5,
          'maxsize': 100
      }
  }
}

Run measures

Using guillotina run command:

./bin/g run --script=measures/serialize.py -c measures/config.yaml

With profiling:

./bin/g run --script=measures/serialize.py -c measures/config.yaml --line-profiler --line-profiler-matcher="*serialize*"

2.0.2 (2018-06-18)

  • Improve size calculation [jordic]

2.0.1 (2018-06-15)

  • Change default cache size to 209715200 [vangheem]

2.0.0 (2018-06-15)

  • Cache based on memory size instead of total number of keys [jordic]

1.3.4 (2018-04-03)

  • Fix fixture [vangheem]

1.3.3 (2018-04-03)

  • Upgrade testing for guillotina 3.0 [vangheem]

1.3.2 (2018-03-26)

  • Use after commit hook to update data for file manager implementation [vangheem]

1.3.1 (2018-03-19)

  • Fix redis file manager finish method [vangheem]

1.3.0 (2018-03-19)

  • Provide redis file manager [vangheem]

1.2.0 (2018-03-14)

  • Upgrade to work with guillotina 2.4.x [vangheem]

1.1.6 (2018-03-01)

  • Handle errors while canceling task init task [vangheem]

1.1.5 (2018-03-01)

  • Handle errors while canceling task [vangheem]

1.1.4 (2018-02-15)

  • Fix cache stats endpoint [vangheem]

1.1.3 (2018-01-22)

  • Be able to disable deleting group of cache keys together with cluster_mode option. [vangheem]

1.1.2 (2018-01-17)

  • Fix using redis.delete when keys are of length 0 [vangheem]

1.1.1 (2018-01-17)

  • batch all cache deletes into one request [vangheem]

1.1.0 (2018-01-12)

  • Push cache updates to redis subscriber. This should improve cache hits dramatically [vangheem]

1.0.14 (2018-01-10)

  • Only run invalidation task if we have keys to invalidate [vangheem]

1.0.13 (2017-12-15)

  • Improve request performance [vangheem]

  • Change the way we’re using the redis pool so it reuses connections [vangheem]

1.0.12 (2017-11-30)

  • Missing await statement for self.get_redis() [vangheem]

1.0.11 (2017-11-08)

  • Handle CancelledError [vangheem]

1.0.10 (2017-11-06)

  • upgrade for guillotina 2.0.0 [vangheem]

1.0.9 (2017-10-23)

  • Fix handling connection objects and releasing back to pool [vangheem]

1.0.8 (2017-10-23)

  • Fix use of pool [vangheem]

1.0.7 (2017-10-23)

  • Use pickle instead of json from load/dumps because it is much faster [vangheem]

1.0.6 (2017-10-19)

  • Use ujson [vangheem]

1.0.5 (2017-10-02)

  • Track all keys needing invalidation and do invalidation in an async task so the request can finish faster. [vangheem]

1.0.4 (2017-05-29)

  • Test fixes [vangheem]

1.0.3 (2017-05-26)

  • Fix delete not properly invalidating cache [vangheem]

1.0.2 (2017-05-15)

  • Fix channel publishing invalidations [vangheem]

1.0.1 (2017-05-15)

  • Fix release

1.0.0 (2017-05-15)

  • initial release

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

guillotina_rediscache-2.0.2.tar.gz (19.0 kB view details)

Uploaded Source

Built Distribution

guillotina_rediscache-2.0.2-cp36-cp36m-macosx_10_12_x86_64.whl (31.6 kB view details)

Uploaded CPython 3.6m macOS 10.12+ x86-64

File details

Details for the file guillotina_rediscache-2.0.2.tar.gz.

File metadata

File hashes

Hashes for guillotina_rediscache-2.0.2.tar.gz
Algorithm Hash digest
SHA256 29de3fd3cb0f02dc510204a187599e0bfa9d69e63545591f9c2322269ab1ba57
MD5 1111ad6a8ab14e428f269960085b9e58
BLAKE2b-256 d11e32576950c0a2113575fc3a7b5bd000c6a1d80622b30faf3335f96b1ea0a3

See more details on using hashes here.

File details

Details for the file guillotina_rediscache-2.0.2-cp36-cp36m-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for guillotina_rediscache-2.0.2-cp36-cp36m-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 8f6c296aaa1b59aa664336329ee05c0459b5a99e7138cb2704b646ba81e5f76f
MD5 adb8843c5339eeb9cd334b3c43651b87
BLAKE2b-256 479ce5b4e2cdbaa20943ab0cf6c2bb3190284dd9d80dcc0e76e662119e154be1

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page