Skip to main content

Patch asyncio to allow nested event loops

Project description

nest-asyncio2

Build status PyPi License Downloads

Introduction

By design asyncio does not allow its event loop to be nested. This presents a practical problem: When in an environment where the event loop is already running it's impossible to run tasks and wait for the result. Trying to do so will give the error "RuntimeError: This event loop is already running".

The issue pops up in various environments, such as web servers, GUI applications and in Jupyter notebooks.

This module patches asyncio to allow nested use of asyncio.run and loop.run_until_complete.

Installation

pip3 install nest-asyncio2

Python 3.5 or higher is required.

Usage

import nest_asyncio2
nest_asyncio2.apply()

Optionally the specific loop that needs patching can be given as argument to apply, otherwise the current event loop is used. An event loop can be patched whether it is already running or not. Only event loops from asyncio can be patched; Loops from other projects, such as uvloop or quamash, generally can't be patched.

Examples

aiohttp

# /// script
# requires-python = ">=3.5"
# dependencies = [
#     "aiohttp",
#     "nest-asyncio2",
# ]
# ///
import asyncio
import nest_asyncio2
import aiohttp

nest_asyncio2.apply()

async def f_async():
    # Note that ClientSession must be created and used
    # in the same event loop (under the same asyncio.run())
    async with aiohttp.ClientSession() as session:
        async with session.get('http://httpbin.org/get') as resp:
            print(resp.status)
            print(await resp.text())
            assert resp.status == 200

# async to sync
def f():
    asyncio.run(f_async())

async def main():
    f()
asyncio.run(main())

Known issues

Leaked loop

[!TIP] TL;DR: Usually you don't need to worry about this. The biggest side effect is a ResourceWarning: unclosed event loop at exit on Python 3.12+ that is hidden by default.

If there is no existing event loop, patched asyncio.run() will create one but not close it afterwards. It will be reused later, so there will be at most one leaked loop.

asyncio.run() will always create and close the loop. But nest_asyncio (by accident or intentionally) missed it. As changing this behavior will break existing projects (e.g. ComfyScript, pyvista), nest-asyncio2 follows this behavior.

This will cause a ResourceWarning: unclosed event loop at exit on Python 3.12+, although it is hidden by default. (Note that if you call asyncio.get_event_loop() on the main thread without setting the loop before, ResourceWarning is expected on Python 3.12~3.13, not caused by nest-asyncio2.)

If you want to follow asyncio.run()'s behavior and get rid of the ResourceWarning, you can set run_close_loop=True for all apply():

nest_asyncio2.apply(run_close_loop=True)

Or pass loop_factory to asyncio.run() on Python 3.12+:

asyncio.run(..., loop_factory=asyncio.new_event_loop)

nest-asyncio2 v2 may change run_close_loop to be enalbed by default.

Comparison with nest_asyncio

nest-asyncio2 is a fork of the unmaintained nest_asyncio, with the following changes:

  • Support setting run_close_loop to avoid leaked loop
  • Python 3.12 support
    • loop_factory parameter support
  • Python 3.14 support
    • Fix broken asyncio.current_task() and others
    • Fix DeprecationWarning: 'asyncio.get_event_loop_policy' is deprecated and slated for removal in Python 3.16

All interfaces are kept as they are. To migrate, you just need to change the package and module name to nest_asyncio2.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nest_asyncio2-1.7.1.tar.gz (13.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nest_asyncio2-1.7.1-py3-none-any.whl (7.5 kB view details)

Uploaded Python 3

File details

Details for the file nest_asyncio2-1.7.1.tar.gz.

File metadata

  • Download URL: nest_asyncio2-1.7.1.tar.gz
  • Upload date:
  • Size: 13.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.0

File hashes

Hashes for nest_asyncio2-1.7.1.tar.gz
Algorithm Hash digest
SHA256 a1fe5bbbd20894dcceb1842322d74992c5834d5ab692af2c4f59a9a4fcf75fe8
MD5 354ed083b2fb08fc5032cadd25dddd11
BLAKE2b-256 2debecf8bbf9d22a4e8f7be1628336fe0202da7660790053aa28abeb6c15eb14

See more details on using hashes here.

File details

Details for the file nest_asyncio2-1.7.1-py3-none-any.whl.

File metadata

  • Download URL: nest_asyncio2-1.7.1-py3-none-any.whl
  • Upload date:
  • Size: 7.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.0

File hashes

Hashes for nest_asyncio2-1.7.1-py3-none-any.whl
Algorithm Hash digest
SHA256 f83bc1744c3cfa7d47fd29431e5e168db6cb76eda1bb20108955c32f60d7eddf
MD5 dbc0d2b7859ba464cfa1ec44c45a09ee
BLAKE2b-256 8c48c1f1ddcfd04bba60470235c2f83733ecff43ebe068dc7715aab60bc92ad8

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page