Detect leaked asyncio tasks, threads, and event loop blocking in Python. Inspired by Go's goleak
Project description
pyleak
Detect leaked asyncio tasks, threads, and event loop blocking in Python. Inspired by Go's goleak.
Installation
pip install pyleak
Quick Start
import asyncio
from pyleak import no_task_leaks, no_thread_leaks, no_event_loop_blocking
# Detect leaked asyncio tasks
async def main():
async with no_task_leaks():
asyncio.create_task(asyncio.sleep(10)) # This will be detected
await asyncio.sleep(0.1)
# Detect leaked threads
def sync_main():
with no_thread_leaks():
threading.Thread(target=lambda: time.sleep(10)).start() # This will be detected
# Detect event loop blocking
async def async_main():
with no_event_loop_blocking():
time.sleep(0.5) # This will be detected
Usage
Context Managers
All detectors can be used as context managers:
# AsyncIO tasks (async context)
async with no_task_leaks():
# Your async code here
pass
# Threads (sync context)
with no_thread_leaks():
# Your threaded code here
pass
# Event loop blocking (async context only)
async def main():
with no_event_loop_blocking():
# Your potentially blocking code here
pass
Decorators
All detectors can also be used as decorators:
@no_task_leaks()
async def my_async_function():
# Any leaked tasks will be detected
pass
@no_thread_leaks()
def my_threaded_function():
# Any leaked threads will be detected
pass
@no_event_loop_blocking()
async def my_potentially_blocking_function():
# Any event loop blocking will be detected
pass
Get stack trace from leaked asyncio tasks
When using no_task_leaks, you get detailed stack trace information showing exactly where leaked tasks are executing and where they were created.
import asyncio
from pyleak import TaskLeakError, no_task_leaks
async def leaky_function():
async def background_task():
print("background task started")
await asyncio.sleep(10)
print("creating a long running task")
asyncio.create_task(background_task())
async def main():
try:
async with no_task_leaks(action="raise"):
await leaky_function()
except TaskLeakError as e:
print(e)
if __name__ == "__main__":
asyncio.run(main())
Output:
creating a long running task
background task started
Detected 1 leaked asyncio tasks
Leaked Task: Task-2
ID: 4345977088
State: TaskState.RUNNING
Current Stack:
File "/tmp/example.py", line 9, in background_task
await asyncio.sleep(10)
Include creation stack trace
You can also include the creation stack trace by passing enable_creation_tracking=True to no_task_leaks.
async def main():
try:
async with no_task_leaks(action="raise", enable_creation_tracking=True):
await leaky_function()
except TaskLeakError as e:
print(e)
Output:
creating a long running task
background task started
Detected 1 leaked asyncio tasks
Leaked Task: Task-2
ID: 4392245504
State: TaskState.RUNNING
Current Stack:
File "/tmp/example.py", line 9, in background_task
await asyncio.sleep(10)
Creation Stack:
File "/tmp/example.py", line 24, in <module>
asyncio.run(main())
File "/opt/homebrew/.../asyncio/runners.py", line 194, in run
return runner.run(main)
File "/opt/homebrew/.../asyncio/runners.py", line 118, in run
return self._loop.run_until_complete(task)
File "/opt/homebrew/.../asyncio/base_events.py", line 671, in run_until_complete
self.run_forever()
File "/opt/homebrew/.../asyncio/base_events.py", line 638, in run_forever
self._run_once()
File "/opt/homebrew/.../asyncio/base_events.py", line 1971, in _run_once
handle._run()
File "/opt/homebrew/.../asyncio/events.py", line 84, in _run
self._context.run(self._callback, *self._args)
File "/tmp/example.py", line 18, in main
await leaky_function()
File "/tmp/example.py", line 12, in leaky_function
asyncio.create_task(background_task())
TaskLeakError has a leaked_tasks attribute that contains a list of LeakedTask objects including the stack trace details.
Note:
enable_creation_trackingmonkey patchesasyncio.create_taskto include the creation stack trace. It is not recommended to be used in production to avoid unnecessary side effects.
Actions
Control what happens when leaks/blocking are detected:
| Action | AsyncIO Tasks | Threads | Event Loop Blocking |
|---|---|---|---|
"warn" (default) |
✅ Issues ResourceWarning |
✅ Issues ResourceWarning |
✅ Issues ResourceWarning |
"log" |
✅ Writes to logger | ✅ Writes to logger | ✅ Writes to logger |
"cancel" |
✅ Cancels leaked tasks | ❌ Warns (can't force-stop) | ❌ Warns (can't cancel) |
"raise" |
✅ Raises TaskLeakError |
✅ Raises ThreadLeakError |
✅ Raises EventLoopBlockError |
# Examples
async with no_task_leaks(action="cancel"): # Cancels leaked tasks
pass
with no_thread_leaks(action="raise"): # Raises exception on thread leaks
pass
with no_event_loop_blocking(action="log"): # Logs blocking events
pass
Name Filtering
Filter detection by resource names (tasks and threads only):
import re
# Exact match
async with no_task_leaks(name_filter="background-worker"):
pass
with no_thread_leaks(name_filter="worker-thread"):
pass
# Regex pattern
async with no_task_leaks(name_filter=re.compile(r"worker-\d+")):
pass
with no_thread_leaks(name_filter=re.compile(r"background-.*")):
pass
Note: Event loop blocking detection doesn't support name filtering.
Configuration Options
AsyncIO Tasks
no_task_leaks(
action="warn", # Action to take on detection
name_filter=None, # Filter by task name
logger=None # Custom logger
)
Threads
no_thread_leaks(
action="warn", # Action to take on detection
name_filter=None, # Filter by thread name
logger=None, # Custom logger
exclude_daemon=True, # Exclude daemon threads
)
Event Loop Blocking
no_event_loop_blocking(
action="warn", # Action to take on detection
logger=None, # Custom logger
threshold=0.1, # Minimum blocking time to report (seconds)
check_interval=0.01 # How often to check (seconds)
)
Testing
Perfect for catching issues in tests:
import pytest
from pyleak import no_task_leaks, no_thread_leaks, no_event_loop_blocking
@pytest.mark.asyncio
async def test_no_leaked_tasks():
async with no_task_leaks(action="raise"):
await my_async_function()
def test_no_leaked_threads():
with no_thread_leaks(action="raise"):
my_threaded_function()
@pytest.mark.asyncio
async def test_no_event_loop_blocking():
with no_event_loop_blocking(action="raise", threshold=0.1):
await my_potentially_blocking_function()
Real-World Examples
Detecting Synchronous HTTP Calls in Async Code
import httpx
from starlette.testclient import TestClient
async def test_sync_vs_async_http():
# This will detect blocking
with no_event_loop_blocking(action="warn"):
response = TestClient(app).get("/endpoint") # Synchronous!
# This will not detect blocking
with no_event_loop_blocking(action="warn"):
async with httpx.AsyncClient() as client:
response = await client.get("/endpoint") # Asynchronous!
Ensuring Proper Resource Cleanup
async def test_background_task_cleanup():
async with no_task_leaks(action="raise"):
# This would fail the test
asyncio.create_task(long_running_task())
# This would pass
task = asyncio.create_task(long_running_task())
task.cancel()
try:
await task
except asyncio.CancelledError:
pass
Debugging complex task leaks
import asyncio
import random
import re
from pyleak import TaskLeakError, no_task_leaks
async def debug_task_leaks():
"""Example showing how to debug complex task leaks."""
async def worker(worker_id: int, sleep_time: int):
print(f"Worker {worker_id} starting")
await asyncio.sleep(sleep_time) # Simulate work
print(f"Worker {worker_id} done")
async def spawn_workers():
for i in range(3):
asyncio.create_task(worker(i, random.randint(1, 10)), name=f"worker-{i}")
try:
async with no_task_leaks(
action="raise",
enable_creation_tracking=True,
name_filter=re.compile(r"worker-\d+"), # Only catch worker tasks
):
await spawn_workers()
await asyncio.sleep(0.1) # Let workers start
except TaskLeakError as e:
print(f"\nFound {e.task_count} leaked worker tasks:")
for task_info in e.leaked_tasks:
print(f"\n--- {task_info.name} ---")
print("Currently executing:")
print(task_info.format_current_stack())
print("Created at:")
print(task_info.format_creation_stack())
# Cancel the leaked task
if task_info.task_ref:
task_info.task_ref.cancel()
if __name__ == "__main__":
asyncio.run(debug_task_leaks())
Toggle to see the output
Worker 0 starting
Worker 1 starting
Worker 2 starting
Found 3 leaked worker tasks:
--- worker-2 ---
Currently executing:
File "/private/tmp/example.py", line 33, in worker
await asyncio.sleep(sleep_time) # Simulate work
Created at:
File "/private/tmp/example.py", line 65, in <module>
asyncio.run(debug_task_leaks())
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/runners.py", line 194, in run
return runner.run(main)
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/runners.py", line 118, in run
return self._loop.run_until_complete(task)
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/base_events.py", line 671, in run_until_complete
self.run_forever()
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/base_events.py", line 638, in run_forever
self._run_once()
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/base_events.py", line 1971, in _run_once
handle._run()
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/events.py", line 84, in _run
self._context.run(self._callback, *self._args)
File "/private/tmp/example.py", line 47, in debug_task_leaks
await spawn_workers()
File "/private/tmp/example.py", line 39, in spawn_workers
asyncio.create_task(worker(i, random.randint(1, 10)), name=f"worker-{i}")
--- worker-0 ---
Currently executing:
File "/private/tmp/example.py", line 33, in worker
await asyncio.sleep(sleep_time) # Simulate work
Created at:
File "/private/tmp/example.py", line 65, in <module>
asyncio.run(debug_task_leaks())
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/runners.py", line 194, in run
return runner.run(main)
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/runners.py", line 118, in run
return self._loop.run_until_complete(task)
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/base_events.py", line 671, in run_until_complete
self.run_forever()
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/base_events.py", line 638, in run_forever
self._run_once()
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/base_events.py", line 1971, in _run_once
handle._run()
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/events.py", line 84, in _run
self._context.run(self._callback, *self._args)
File "/private/tmp/example.py", line 47, in debug_task_leaks
await spawn_workers()
File "/private/tmp/example.py", line 39, in spawn_workers
asyncio.create_task(worker(i, random.randint(1, 10)), name=f"worker-{i}")
--- worker-1 ---
Currently executing:
File "/private/tmp/example.py", line 33, in worker
await asyncio.sleep(sleep_time) # Simulate work
Created at:
File "/private/tmp/example.py", line 65, in <module>
asyncio.run(debug_task_leaks())
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/runners.py", line 194, in run
return runner.run(main)
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/runners.py", line 118, in run
return self._loop.run_until_complete(task)
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/base_events.py", line 671, in run_until_complete
self.run_forever()
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/base_events.py", line 638, in run_forever
self._run_once()
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/base_events.py", line 1971, in _run_once
handle._run()
File "/opt/homebrew/anaconda3/envs/ffa/lib/python3.12/asyncio/events.py", line 84, in _run
self._context.run(self._callback, *self._args)
File "/private/tmp/example.py", line 47, in debug_task_leaks
await spawn_workers()
File "/private/tmp/example.py", line 39, in spawn_workers
asyncio.create_task(worker(i, random.randint(1, 10)), name=f"worker-{i}")
Why Use pyleak?
AsyncIO Tasks: Leaked tasks can cause memory leaks, prevent graceful shutdown, and make debugging difficult.
Threads: Leaked threads consume system resources and can prevent proper application termination.
Event Loop Blocking: Synchronous operations in async code destroy performance and can cause timeouts.
pyleak helps you catch these issues during development and testing, before they reach production.
Examples
More examples can be found in the test files:
Disclaimer: Most of the code and tests are written by Claude.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file pyleak-0.1.6.tar.gz.
File metadata
- Download URL: pyleak-0.1.6.tar.gz
- Upload date:
- Size: 105.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.7.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fdf750150288ae4e0734f8a561d0adf49f102da4fefcf79d5d19c2b78daeee10
|
|
| MD5 |
f36412cc36c8b123e0487f9cfecdbb5b
|
|
| BLAKE2b-256 |
309b7dd5188a97c46a9a96490c7d7af7cf243f6afe0799c075ef5de90398cf98
|
File details
Details for the file pyleak-0.1.6-py3-none-any.whl.
File metadata
- Download URL: pyleak-0.1.6-py3-none-any.whl
- Upload date:
- Size: 18.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.7.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
58a8cf1164c4f9150c9504775d939770e698d3134e2e8a8dd5a3511cd57818df
|
|
| MD5 |
d766f5849627eaa06b23eb3bd12b69d6
|
|
| BLAKE2b-256 |
89f8e8e4ba14dac0d7c6c9840f95716f023329022060800a8a2ba1cffb1002c4
|