Skip to main content

Request waterfall tracing for Starlette-compatible ASGI applications

Project description

waterfall-log

waterfall-log is a small Python library for Starlette-compatible applications that prints a request waterfall to the console after every HTTP request.

It is designed for FastAPI and other ASGI apps built on Starlette, and it focuses on two things:

  • capturing the Python call tree for one request
  • making the slowest parts obvious in the console output

What it does

For each HTTP request, the middleware:

  • profiles Python function calls in the active request task
  • builds a nested call tree with timestamps
  • prints a waterfall-style timeline to the configured output stream
  • reports the hottest frames by inclusive and self time
  • focuses on frames from your application code by default, not FastAPI, Starlette, or other helper libraries

Install

poetry install --with dev,demo

Install the library into another project from a built artifact or directly from PyPI later with:

pip install waterfall-log

Quick start

from fastapi import FastAPI

from waterfall_log import WaterfallMiddleware

app = FastAPI()
app.add_middleware(WaterfallMiddleware)


@app.get("/hello")
async def hello() -> dict[str, str]:
    return {"message": "hello"}

By default, the middleware captures frames from the current working directory and skips framework and dependency code. You can override that with include_paths and exclude_paths if your application source lives elsewhere.

Run the sample app:

poetry run python sample_app.py

It prints a small startup banner with the request URL and a ready-to-run curl command.

Optional environment variables:

WATERFALL_DEMO_HOST=0.0.0.0 WATERFALL_DEMO_PORT=9000 WATERFALL_DEMO_RELOAD=1 poetry run python sample_app.py

Then call:

curl http://127.0.0.1:8000/report/42

Example output:

Request 200 GET /report/42 took 86.54 ms
Hotspots
  38.12 ms total | 36.89 ms self  sample_app.py:24 load_line_items
  21.07 ms total | 20.81 ms self  sample_app.py:36 render_summary
Waterfall
    0.00 ms |############################################################|   86.54 ms 100.0% GET /report/42
    1.14 ms | ###                                                        |    4.93 ms   5.7% sample_app.py:51 compute_discount
    7.03 ms |     ##########################                             |   38.12 ms  44.0% sample_app.py:24 load_line_items  <<< hottest
   49.82 ms |                                  ###############          |   21.07 ms  24.3% sample_app.py:36 render_summary

Notes

  • The profiler automatically isolates the active asyncio task, so overlapping requests handled on the same event loop do not share one trace.
  • Work executed in background threads or native extensions is not profiled directly. Time spent there is still visible in the waiting parent frame.
  • The middleware only traces HTTP requests. WebSocket and lifespan scopes pass through unchanged.

Poetry workflow

Install dependencies for local work:

poetry install --with dev,demo

Run tests:

poetry run pytest

Build publishable artifacts:

poetry build

Check package metadata:

poetry check

Publish to PyPI:

poetry config pypi-token.pypi <token>
poetry publish --build

If you want to publish to TestPyPI first:

poetry config repositories.testpypi https://test.pypi.org/legacy/
poetry publish --build --repository testpypi

Files

  • src/waterfall_log: library package
  • sample_app.py: runnable FastAPI demo
  • tests/test_middleware.py: smoke test for middleware output

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

waterfall_log-0.1.1.tar.gz (5.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

waterfall_log-0.1.1-py3-none-any.whl (7.2 kB view details)

Uploaded Python 3

File details

Details for the file waterfall_log-0.1.1.tar.gz.

File metadata

  • Download URL: waterfall_log-0.1.1.tar.gz
  • Upload date:
  • Size: 5.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.11

File hashes

Hashes for waterfall_log-0.1.1.tar.gz
Algorithm Hash digest
SHA256 5cf3ebdd490cd8bd9928b6a9abad6b95bc5d481a6d2c649e909bfa38df045aae
MD5 02bf0191f10dc9c41dd2ba5e743d6193
BLAKE2b-256 9794d8f807c0da796019b54512f5bd961061e4dc79fb9be194fbd198d5580c1c

See more details on using hashes here.

File details

Details for the file waterfall_log-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: waterfall_log-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 7.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.11

File hashes

Hashes for waterfall_log-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 7ced18592281541f39ea78284f88cfcc7e199699376cb552d4bb6c0192613e25
MD5 f7bce59301c184f6ad59a2fa293d06d7
BLAKE2b-256 6bd51e5469de8c76e5104b4871bc48c032433ab9d8170c74474a1d3ae53f7818

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page