Skip to main content

Util for marking Django DB fields as deprecated, enabling migration consistency with rolling deploys

Project description

Django Deprecated Field

A Django field util that allows you to mark model fields as deprecated. This will enable you to have migration consistency when using rolling deploy.

Motivation

When you have multiple instances of Django running, for redundancy, you typically deploy new versions in a rolling manner. One instance will be updated to the new versions before the other, and for a period, you will be running both the new and the old version in parallel. Normally, the database migrations will be run before any of the Django instances are updated. This poses a problem for certain types of database migrations, since your database schema needs to support both versions at all times.

One of these problematic migrations is deleting a column from a table. You can quickly end up in a situation where the row has been deleted from the table with the migration, and you have one Django instance to expects it to still exist. Since Django enumerates all known fields in database queries (SELECT field1, field2 FROM ... not SELECT * FROM ...), the instance with the old version will generate queries that aren't consistent with the database schema, and will fail.

One approach to this can be to first deploy a version that has the field removed from the Django model class, but doesn't include the accompanying database migration file. That will remove the Django instances' dependency on the field. Then, in a second deploy that contains the migration file, the column is actually deleted from the database table.

However, this means that you have to allow builds/deploys that have inconsistencies between the Django models in the code, and the migrations. That can lead to a lot of other, unwanted inconsistencies.

django-deprecated-field solves this problem, by introducing the notion of a field being "deprecated, marked for deletion".

Features

When a field is deprecated, we:

  • Ensure that is is nullable, which is necessary for cross-version compatibility for INSERTs
  • Omit the field from SELECTs and other queries, ensuring cross-version compatibility for SELECTs, etc
  • Log a warning, or raise an exception, if the deprecated field is accessed in any code

Usage

Mark a field as deprecated:

from django.db import models
from django_deprecated_field import deprecated

class MyClass(models.Model):

    my_field = deprecated(
        models.CharField(...)
    )

The deprecated() field will return a new version of the CharField that ensures that it will be compatible with both new and old versions. If the field wasn't nullable before, it will become so now, so you may have to generate a new migration python manage.py makemigrations.

After deploying this version to production, you are free to delete the field definition, make a new migrations, and deploy the version that deletes the field.

Configuration

DEPRECATED_FIELD_STRICT

Boolean. Default: False.

Set to True to raise an exception whenever the field is accessed in the code. Setting it to False will trigger a ERROR log. It's recommended to set this to True in development, CI and staging, and to False in production.

DEPRECATED_FIELD_USE_STRUCTLOG

Boolean. Default: False.

Set to True to use structlog instead of the standard logging module for logging.

Installation

Using pip

pip install django-deprecated-field

Using uv (recommended)

# Install uv if you haven't already
curl -LsSf https://astral.sh/uv/install.sh | sh

# Install the package
uv pip install django-deprecated-field

Development Setup

  1. Clone the repository:
git clone https://github.com/kolonialno/django-deprecated-field.git
cd django-deprecated-field
  1. Install and setup asdf (if not already installed):
# Install asdf
git clone https://github.com/asdf-vm/asdf.git ~/.asdf --branch v0.13.1
echo '. "$HOME/.asdf/asdf.sh"' >> ~/.bashrc  # or ~/.zshrc for Zsh
echo '. "$HOME/.asdf/completions/asdf.bash"' >> ~/.bashrc  # or ~/.zshrc for Zsh

# Install plugins
asdf plugin add python
asdf plugin add uv https://github.com/looztra/asdf-uv.git
asdf plugin add direnv

# Install Python and uv versions specified in .tool-versions
asdf install
  1. Allow direnv
direnv allow
  1. Install development dependencies using uv:
# Install the packagse with development dependencies
uv sync --dev

Development

The project uses several tools to maintain code quality:

  • ruff for linting and code formatting (replaces black and isort)
  • mypy for type checking
  • pytest for testing

All tools are configured in pyproject.toml.

Code Quality

To check and fix code quality issues:

# Check for issues
ruff check .

# Fix issues automatically
ruff check --fix .

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

Pull Request Title Requirement

We require the Pull Request titles to follow the Conventional Commit specification, and there's a CI check that enforces this.

The very short version of that is that your PR title must be prefixed with fix:, feat: or BREAKING CHANGE:, depending on what you're doing. This will be the basis for the release (semantic) version, and the automatic changelog. Please see the specification for more details.

Releasing

When changes are committed to main, a release PR for the package is automatically created, using Release Please. The changelog is also automatically updated. When we're ready to package your changes into a release and distribute it to users, that PR will be merged.

A new distributable package will be built, and and published to PyPi.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

django_deprecated_field-0.1.1.tar.gz (40.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

django_deprecated_field-0.1.1-py3-none-any.whl (7.2 kB view details)

Uploaded Python 3

File details

Details for the file django_deprecated_field-0.1.1.tar.gz.

File metadata

File hashes

Hashes for django_deprecated_field-0.1.1.tar.gz
Algorithm Hash digest
SHA256 217b344b6f9989b4d8a94339596682064fd0e912cc0338fb4e84a276aca0c11a
MD5 66523b92c73009ce11bfff760b264b44
BLAKE2b-256 717383033bd539b6c6e085046748408e1abddffdf47bfe6203da39bb80ce8ff7

See more details on using hashes here.

File details

Details for the file django_deprecated_field-0.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for django_deprecated_field-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 e6b8c3018c3328d7640c73ad49c1a0c55f77fdef612b121946a267a9744fcc2d
MD5 c04e43fa4ed11d62b3ed7ac45e892d95
BLAKE2b-256 e792042c028b3591691e0179ae7e4ad93199c0ae1c38dc0bb707e2247d0c9b6f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page