Skip to main content

Manage data from multiple sources using django-popolo

This package provides a PopoloSource Django model to represent a URL from which you can fetch Popolo JSON data. It allows you to import data from multiple such sources into django-popolo models while maintaining an association with the source they came from, and making sure that a change in one source doesn’t affect the models from any other.

In addition, this package allows you to track objects that have been deleted from a source; they are marked as having disappeared, but the django-popolo models are not deleted. If they reappear with the same ID in the Popolo JSON source, the disappeared flag (deleted_from_source) will be set back to False.

It is only the objects that are listed at the top level of a Popolo JSON file that are tracked by the code in this package. That includes:

  • Area

  • Membership

  • Organization

  • Person

  • Post

But does not include, for example, ContactDetail.

Usage

To create a new PopoloSource you can do:

from popolo_sources.models import PopoloSource

ps = PopoloSource(url='http://example.com/parliament.json')

To then create django-popolo models (Person, Organization, etc.) based on the Popolo JSON at that URL, you can now do:

ps.update_from_source()

You can run .update_from_source() again to update the models based on any changes in the Popolo JSON source.

The model that represents the join table linking PopoloSource models with django-popolo models is popolo_sources.models.LinkToPopoloSource. This model has the deleted_from_source attributed, so you can find all non-deleted top-level django-popolo with code like:

for ltps in LinkToPopoloSource.filter(deleted_from_source=False):
    print ltps.popolo_object

Tests

To run the tests you can do:

pip install -e .[test]
./runtests.py

Metadata

Release files for multiple-django-popolo-sources 0.0.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for multiple-django-popolo-sources 0.0.3
File Size Uploaded
multiple-django-popolo-sources-0.0.3.tar.gz 6.4 kB Details

Release files / multiple-django-popolo-sources-0.0.3.tar.gz

Download URL multiple-django-popolo-sources-0.0.3.tar.gz
Size 6.4 kB
Tags Source
SHA-256 checksum
How to use checksums
c347154cf684825bc1be23613b238f9772bbb24622a324990073ea131004f7b4
BLAKE2b-256 checksum
How to use checksums
647b88b2b64799b717c75cf645e8c4807bffd011cfe0601bcde40ba954e9630e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release history Release notifications | RSS feed

This release

0.0.3 This release

1 release file

0.0.2

1 release file

0.0.1

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page