Skip to main content

Patch asyncio to allow nested event loops

Project description

nest-asyncio2

Build status PyPi License Downloads

Introduction

By design asyncio does not allow its event loop to be nested. This presents a practical problem: When in an environment where the event loop is already running it's impossible to run tasks and wait for the result. Trying to do so will give the error "RuntimeError: This event loop is already running".

The issue pops up in various environments, such as web servers, GUI applications and in Jupyter notebooks.

This module patches asyncio to allow nested use of asyncio.run and loop.run_until_complete.

Installation

pip3 install nest-asyncio2

Python 3.5 or higher is required.

Usage

import nest_asyncio2
nest_asyncio2.apply()

Optionally the specific loop that needs patching can be given as argument to apply, otherwise the current event loop is used. An event loop can be patched whether it is already running or not. Only event loops from asyncio can be patched; Loops from other projects, such as uvloop or quamash, generally can't be patched.

Examples

aiohttp

# /// script
# requires-python = ">=3.5"
# dependencies = [
#     "aiohttp",
#     "nest-asyncio2",
# ]
# ///
import asyncio
import nest_asyncio2
import aiohttp

nest_asyncio2.apply()

async def f_async():
    # Note that ClientSession must be created and used
    # in the same event loop (under the same asyncio.run())
    async with aiohttp.ClientSession() as session:
        async with session.get('http://httpbin.org/get') as resp:
            print(resp.status)
            print(await resp.text())
            assert resp.status == 200

# async to sync
def f():
    asyncio.run(f_async())

async def main():
    f()
asyncio.run(main())

Known issues

Leaked loop

[!TIP] TL;DR: Usually you don't need to worry about this. The biggest side effect is a ResourceWarning: unclosed event loop at exit on Python 3.12+ that is hidden by default.

If there is no existing event loop, patched asyncio.run() will create one but not close it afterwards. It will be reused later, so there will be at most one leaked loop.

asyncio.run() will always create and close the loop. But nest_asyncio (by accident or intentionally) missed it. As changing this behavior will break existing projects (e.g. ComfyScript, pyvista), nest-asyncio2 follows this behavior.

This will cause a ResourceWarning: unclosed event loop at exit on Python 3.12+, although it is hidden by default. (Note that if you call asyncio.get_event_loop() on the main thread without setting the loop before, ResourceWarning is expected on Python 3.12~3.13, not caused by nest-asyncio2.)

If you want to follow asyncio.run()'s behavior and get rid of the ResourceWarning, you can set run_close_loop=True for all apply():

nest_asyncio2.apply(run_close_loop=True)

Or pass loop_factory to asyncio.run() on Python 3.12+:

asyncio.run(..., loop_factory=asyncio.new_event_loop)

nest-asyncio2 v2 may change run_close_loop to be enalbed by default.

Comparison with nest_asyncio

nest-asyncio2 is a fork of the unmaintained nest_asyncio, with the following changes:

  • Support setting run_close_loop to avoid leaked loop
  • Python 3.12 support
    • loop_factory parameter support
  • Python 3.14 support
    • Fix broken asyncio.current_task() and others
    • Fix DeprecationWarning: 'asyncio.get_event_loop_policy' is deprecated and slated for removal in Python 3.16

All interfaces are kept as they are. To migrate, you just need to change the package and module name to nest_asyncio2.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nest_asyncio2-1.7.0.tar.gz (13.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nest_asyncio2-1.7.0-py3-none-any.whl (7.5 kB view details)

Uploaded Python 3

File details

Details for the file nest_asyncio2-1.7.0.tar.gz.

File metadata

  • Download URL: nest_asyncio2-1.7.0.tar.gz
  • Upload date:
  • Size: 13.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.0

File hashes

Hashes for nest_asyncio2-1.7.0.tar.gz
Algorithm Hash digest
SHA256 9abb13499d23af422f827d5819c24eea14b378ee9801ec557034217f4ccc96f6
MD5 4d8ab54e31efd74be2e076df8f2552af
BLAKE2b-256 698169e3c95ff11dd4e02f24f36c1a2d1b5e3c0641aa21169d26046afc4352be

See more details on using hashes here.

File details

Details for the file nest_asyncio2-1.7.0-py3-none-any.whl.

File metadata

  • Download URL: nest_asyncio2-1.7.0-py3-none-any.whl
  • Upload date:
  • Size: 7.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.0

File hashes

Hashes for nest_asyncio2-1.7.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3f33f3df6c82ff3fa46cee82651190d3b95648975201f03020e99a169a7e4cbc
MD5 bd63a5d2d994fc4fbcb51ce8c11b5d74
BLAKE2b-256 60034a69259273622ba7e6fa355ccd518847719759371da425a3f2f67391e1e0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page