Skip to main content

Keep a record of diffs made to a Django model or collection of models

Project description

Django Diffs

https://travis-ci.org/linuxlewis/django-diffs.svg?branch=master

Django diffs allows models to be registered to cache it’s changes (or diffs) over a fixed time period.

The diffs are stored in redis using a SortedSet and accessed via a manager-like object on the registered django model class.

It’s compatible with Python 2/3 and Django 1.8 and above. It requires an available redis server.

How does it Work?

Models are registered with the @diffs.register decorator and their changes are serialized and saved to redis on signals. The decorator installs django-dirtyfields to the model on registration to get the changed fields of the model instance.

Changes can be accessed via the diffs manager on the registered model. The diffs manager returns a list of Diff objects that have properties of data, created, and timestamp.

The manager can be accessed via the class like Question.diffs or like a related manager on the instance instance.diffs.

Here’s a quick example.

# models.py

import diffs

@diffs.register
class Question(models.Model):
    question_text = models.CharField(max_length=200)
    pub_date = models.DateTimeField('date published')

question = Question.objects.create(question_text='What is life?')

question.question_text = 'What is python?'
question.save()

for diff in question.diffs:
    print(diff.timestamp)
    print(diff.data)
    print(diff.created)

diffs = Question.diffs.get_by_object_id(question.id)

Why?

You need to cache the changes to a single django model or collection of models for a fixed time period.

Tracking the changes prevents clients from having to re-request all of the model data which is assumed to be costly.

Getting Started

  • Add django-diffs to requirements.txt
pip install django-diffs
  • Add diffs to INSTALLED_APPS
INSTALLED_APPS = (
    'diffs',
)
  • Register a Model
# models.py

import diffs

@diffs.register
class Question(models.Model):
    question_text = models.CharField(max_length=200)
    pub_date = models.DateTimeField('date published')

That’s it! Changes will now be tracked automatically for this model.

Configuration

Django-diffs can be configured via django.conf.settings. Below is the default configuration

# settings.py

DIFFS_SETTINGS = {
    'redis': {
        'host': 'localhost',
        'port': 6379,
        'db': 0,
    },
    'max_element_age': 60*60,
    'use_transactions': True,
    'test_mode': False
}

The following keys are supported for DIFFS_SETTINGS

redis – A dictionary with the keys host, port and db for details of the redis server.

max_element_age – Defines the number of seconds a single diff should be allowed to live. This is used in the pruning script to remove old elements from the set.

use_transactions – Boolean to configure django-diffs using Django’s connection.on_commit callback registry. When enabled django-diffs will defer persistence to on_commit.

test_mode – Boolean to configure using test mode. Test mode uses fake_redis instead of real redis so a server isn’t required. Use this mode when running your unittests.

Pruning Diffs

By default redis only allows you to set an expire on an entire key. You cannot set an expiry per element in a set or sorted set.

To work around this django-diffs sets the current unix timestamp as the SortedSet element score. Items can then be easily removed using the redis command ZREMRANGEBYSCORE.

All of this has been handled for you in the custom management command prune_diffs. Run this on a cron schedule to keep your cache up to date.

python manage.py prune_diffs

Custom Serialization

By default django-diffs uses django.core.serializers module to serialize the diff to json.

To use your own custom serialization format just implement the serialize_diff method on your model. It will be passed the list of dirty_fields and the created kwarg.

# models.py

import diffs

@diffs.register
class Question(models.Model):
    question_text = models.CharField(max_length=200)
    pub_date = models.DateTimeField('date published')

    def serialize_diff(self, dirty_fields, created=False):
        return {'fields': dirty_fields}

question = Question.objects.create(question_text='What will happen?')

Question.diffs.get_by_object_id(question.id)[-1].data
# {'fields': ['question_name']}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for django-diffs, version 0.1.16
Filename, size File type Python version Upload date Hashes
Filename, size django_diffs-0.1.16-py2.py3-none-any.whl (12.1 kB) File type Wheel Python version 3.5 Upload date Hashes View hashes
Filename, size django-diffs-0.1.16.tar.gz (7.6 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page