Skip to main content

Context manager to upload explain plans to https://explain.dalibo.com/

Project description

Django Postgres Explain Visualizer (Django-PEV)

PyPI version versions Lint

This tool captures sql queries and uploads the query plan to postgresql explain visualizer (PEV) by dalibo. This is especially helpful for debugging slow queries.

This tool also exports a graphical UI similar to pghero but is embedded within your django app.

Installation

  1. pip install django-pev

  2. Add to your urls

# urls.py
from django.urls import include, path

urlpatterns = [
    # ....

    path('django-pev/', include(('django_pev.urls', 'django_pev'), namespace='django_pev')),
]
  1. Add to your installed apps
# settings.py

INSTALLED_APPS = [
    # ...
    "django_pev"
]

Usage

Wrap some code with the explain context manager. All sql queries are captured alongside a stacktrace (to locate where it was called). The slowest query is accessible via .slowest.

import django_pev
from django.contrib.auth.models import User

with django_pev.explain() as e:
    # Every SQL query is captured
    list(User.objects.filter(email='test@test.com').all())

# Rerun the slowest query with `EXPLAIN (ANALYZE, COSTS, VERBOSE, BUFFERS, FORMAT JSON)`
pev_response = e.slowest.visualize(
    # By default the text of the query is not uploaded for security reasons
    upload_query=True,
    # Set to false if the query is slow and you want only an explain
    analyze=True,
    # Give a helpful title for the uploaded query plan
    title="Measuring email filter",
)
print(pev_response.url)

# View the postgres explain visualization
e.slowest.visualize_in_browser()

# View the stack trace of the slowest query
print(e.slowest.stacktrace)

# Delete the plan hosted on https://explain.dalibo.com
pev_response.delete()

Optionally configure additional settings:

# Replace the default test client used during explain with a custom class
DJANGO_PEV_EXPLAIN_TEST_CLIENT = 'django.test.Client'

How to debug a slow endpoint in production

If you have access to python manage.py shell on the production server; you can run the following code snippet to get an explain plan uploaded. In general this technique is all types of profiling.

import django_pev

from django.contrib.auth.models import User
from django.test import Client as TestClient

client = TestClient()
# Authentication
client.force_login(User.objects.get(id=1))
url = "/some_slow_url"

with django_pev.explain() as e:
    response = client.get(url)

print(e.slowest.visualize(title=f"Fetching {url}"))

TODO

  • Add migration to ensure pg_stats_statement_info is correct
  • Do not crash when its not available
  • Add explain tab
  • Add index suggester

Disclaimer

Credit goes to Pierre Giraud (@pgiraud) for PEV2 and Alex Tatiyants (@AlexTatiyants) for the original pev tool.

IN NO EVENT SHALL DALIBO BE LIABLE TO ANY PARTY FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES, INCLUDING LOST PROFITS, ARISING OUT OF THE USE OF THIS SOFTWARE AND ITS DOCUMENTATION, EVEN IF DALIBO HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

DALIBO SPECIFICALLY DISCLAIMS ANY WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE SOFTWARE PROVIDED HEREUNDER IS ON AN "AS IS" BASIS, AND DALIBO HAS NO OBLIGATIONS TO PROVIDE MAINTENANCE, SUPPORT, UPDATES, ENHANCEMENTS, OR MODIFICATIONS.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

django_pev-0.2.0.tar.gz (20.9 kB view details)

Uploaded Source

Built Distribution

django_pev-0.2.0-py3-none-any.whl (28.5 kB view details)

Uploaded Python 3

File details

Details for the file django_pev-0.2.0.tar.gz.

File metadata

  • Download URL: django_pev-0.2.0.tar.gz
  • Upload date:
  • Size: 20.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.12.1 Darwin/23.2.0

File hashes

Hashes for django_pev-0.2.0.tar.gz
Algorithm Hash digest
SHA256 81a65ebf0e1005c5cac77c5b7269191e7334b11ac786e379993e1280c7f1f65f
MD5 cf66cc978d94eea4431cba2ded6f38ea
BLAKE2b-256 ab6b264cf0ea1fa282e28cfc53792fddcce6e2b51a95a8e48f0ea18b7ead2e0f

See more details on using hashes here.

File details

Details for the file django_pev-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: django_pev-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 28.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.12.1 Darwin/23.2.0

File hashes

Hashes for django_pev-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 9943d1a1c1621e7a8ec1fbc8e761f1c114399ff9bc8b7e08b68ceabd09dd49e5
MD5 c6165c430dc71976436147341547c556
BLAKE2b-256 45d5d79fc1bceddd4e61532ddd9e39be5619c315146917b7bdbc04169f753a91

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page