This is a pre-production deployment of Warehouse, however changes made here WILL affect the production instance of PyPI.
Latest Version Dependencies status unknown Test status unknown Test coverage unknown
Project Description

Django custom collector used to get every objects that are related to given object.

Usage

Create a new instance of RelatedObjectsCollector, and launch collector on one object:

from deep_collector.core import RelatedObjectsCollector
from django.contrib.auth.models import User

user = User.objects.all()[0]
collector = RelatedObjectsCollector()
collector.collect(user)
related_objects = collector.get_collected_objects()

If you want to save it in a file to be ‘django load_data’-like imported, you can use:

string_buffer = collector.get_json_serialized_objects()

How it works

This class is used to introspect an object, to get every other objects that depend on it, following its ‘relation’ fields, i.e. ForeignKey, OneToOneField, ManyToManyField, GenericForeignKey and GenericRelation.

  1. We start from given object (of class classA for example), and loop over :
  • Its ‘direct’ fields, it means the relation fields that are explicitly declared in this django model.
class classA(models.Model):
    fkey = models.ForeignKey(classB)
    o2o = models.OneToOneField(classC)
    m2m = models.ManyToManyField(classD)
  • Its ‘related’ fields, so other django model that are related to this object by relation fields.
class classB(models.Model):
    fkeyto = models.ForeignKey(classA)

class classC(models.Model):
    o2oto = models.OneToOneField(classA)

class classD(models.Model):
    m2mto = models.ManyToManyField(classA)
  1. For every field, we get associated object(s) of objA:
  • If it’s a direct field, we get objects by:
class classA(models.Model):
    fkey = models.ForeignKey(classB)        # objA.fkey
    o2o = models.OneToOneField(classC)      # objA.o2o
    m2m = models.ManyToManyField(classD)    # objA.m2m.all()
  • If it’s a related field, we get objects by:
class classB(models.Model):
    fkeyto = models.ForeignKey(classA)      # objA.classb_set.all()

class classC(models.Model):
    o2oto = models.OneToOneField(classA)    # objA.classC (not a manager, because OneToOneField is a unique rel)

class classD(models.Model):
    m2mto = models.ManyToManyField(classA)  # objA.classd_set.all()

If we are using related_name attribute, then we access manager with its related_name:

class classE(models.Model):
    m2mto = models.ForeignKey(classA, related_name='classE')  # objA.classE.all()
  1. For each associated object, we go back to step 1. and get every field, …

GenericForeignKey

The GenericForeignKey has a small exception. If you want it to be collected in the “reverse” way, you should explicitly define a GenericRelation in the models you want to follow this “reverse” relation.

class GFKModel(models.Model):
    content_type = models.ForeignKey(ContentType, on_delete=models.CASCADE)
    object_id = models.PositiveIntegerField()
    content_object = GenericForeignKey('content_type', 'object_id')


class BaseToGFKModel(models.Model):
    gfk_relation = GenericRelation(GFKModel)

In above example, if you collect a BaseToGFKModel instance, the collector will look for all GFKModel instances related to your initial BaseToGFKModel instance. That happens because the BaseToGFKModel model explicitly defines a GenericRelation.

Parameters

You can customize which model/field is collected. By default, every model and field is collected, but you can override some parameters to have custom behaviour:

  • EXCLUDE_MODELS: exclude models (expecting a list of ‘<app_label>.<module_name>’)
EXCLUDE_MODELS = ['sites.site', 'auth.permission', 'auth.group']

Every time we will try to collect an object of this model type, it won’t be collected.

  • EXCLUDE_DIRECT_FIELDS: exclude direct fields from specified models
EXCLUDE_DIRECT_FIELDS = {
    'auth.user': ['groups'],
}

On User model, when we will get direct fields, we won’t take into account ‘groups’ field.

  • EXCLUDE_RELATED_FIELDS: exclude related fields from specified models
EXCLUDE_RELATED_FIELDS = {
    'auth.user': ['session_set']
}

On User model, we don’t want to collect sessions that are associated to this user, so we put the exact accessor name we have to use to get these sessions, ‘session_set’, to exclude them from collection.

  • ALLOWS_SAME_TYPE_AS_ROOT_COLLECT: avoid by default to collect objects that have the same type as the root one, to prevent collecting too many data.

Miscellaneous

To avoid some recursive collect between 2 objects (if an object has a direct field to another one, it means that other object has a related field to this first one), we detect if an object has already been collected before trying to collect it.

Release History

Release History

0.4.2

This version

History Node

TODO: Figure out how to actually get changelog content.

Changelog content for this version goes here.

Donec et mollis dolor. Praesent et diam eget libero egestas mattis sit amet vitae augue. Nam tincidunt congue enim, ut porta lorem lacinia consectetur. Donec ut libero sed arcu vehicula ultricies a non tortor. Lorem ipsum dolor sit amet, consectetur adipiscing elit.

Show More

0.4.1

History Node

TODO: Figure out how to actually get changelog content.

Changelog content for this version goes here.

Donec et mollis dolor. Praesent et diam eget libero egestas mattis sit amet vitae augue. Nam tincidunt congue enim, ut porta lorem lacinia consectetur. Donec ut libero sed arcu vehicula ultricies a non tortor. Lorem ipsum dolor sit amet, consectetur adipiscing elit.

Show More

0.4

History Node

TODO: Figure out how to actually get changelog content.

Changelog content for this version goes here.

Donec et mollis dolor. Praesent et diam eget libero egestas mattis sit amet vitae augue. Nam tincidunt congue enim, ut porta lorem lacinia consectetur. Donec ut libero sed arcu vehicula ultricies a non tortor. Lorem ipsum dolor sit amet, consectetur adipiscing elit.

Show More

0.3.1

History Node

TODO: Figure out how to actually get changelog content.

Changelog content for this version goes here.

Donec et mollis dolor. Praesent et diam eget libero egestas mattis sit amet vitae augue. Nam tincidunt congue enim, ut porta lorem lacinia consectetur. Donec ut libero sed arcu vehicula ultricies a non tortor. Lorem ipsum dolor sit amet, consectetur adipiscing elit.

Show More

0.3

History Node

TODO: Figure out how to actually get changelog content.

Changelog content for this version goes here.

Donec et mollis dolor. Praesent et diam eget libero egestas mattis sit amet vitae augue. Nam tincidunt congue enim, ut porta lorem lacinia consectetur. Donec ut libero sed arcu vehicula ultricies a non tortor. Lorem ipsum dolor sit amet, consectetur adipiscing elit.

Show More

0.2.1

History Node

TODO: Figure out how to actually get changelog content.

Changelog content for this version goes here.

Donec et mollis dolor. Praesent et diam eget libero egestas mattis sit amet vitae augue. Nam tincidunt congue enim, ut porta lorem lacinia consectetur. Donec ut libero sed arcu vehicula ultricies a non tortor. Lorem ipsum dolor sit amet, consectetur adipiscing elit.

Show More

0.2

History Node

TODO: Figure out how to actually get changelog content.

Changelog content for this version goes here.

Donec et mollis dolor. Praesent et diam eget libero egestas mattis sit amet vitae augue. Nam tincidunt congue enim, ut porta lorem lacinia consectetur. Donec ut libero sed arcu vehicula ultricies a non tortor. Lorem ipsum dolor sit amet, consectetur adipiscing elit.

Show More

0.1.1

History Node

TODO: Figure out how to actually get changelog content.

Changelog content for this version goes here.

Donec et mollis dolor. Praesent et diam eget libero egestas mattis sit amet vitae augue. Nam tincidunt congue enim, ut porta lorem lacinia consectetur. Donec ut libero sed arcu vehicula ultricies a non tortor. Lorem ipsum dolor sit amet, consectetur adipiscing elit.

Show More

0.1

History Node

TODO: Figure out how to actually get changelog content.

Changelog content for this version goes here.

Donec et mollis dolor. Praesent et diam eget libero egestas mattis sit amet vitae augue. Nam tincidunt congue enim, ut porta lorem lacinia consectetur. Donec ut libero sed arcu vehicula ultricies a non tortor. Lorem ipsum dolor sit amet, consectetur adipiscing elit.

Show More

Download Files

Download Files

TODO: Brief introduction on what you do with files - including link to relevant help section.

File Name & Checksum SHA256 Checksum Help Version File Type Upload Date
django-deep-collector-0.4.2.tar.gz (13.1 kB) Copy SHA256 Checksum SHA256 Source Jul 4, 2016

Supported By

WebFaction WebFaction Technical Writing Elastic Elastic Search Pingdom Pingdom Monitoring Dyn Dyn DNS HPE HPE Development Sentry Sentry Error Logging CloudAMQP CloudAMQP RabbitMQ Heroku Heroku PaaS Kabu Creative Kabu Creative UX & Design Fastly Fastly CDN DigiCert DigiCert EV Certificate Rackspace Rackspace Cloud Servers DreamHost DreamHost Log Hosting