An asyncio-compatible socket pool
Project description
aiosocketpool
An asyncio-compatible socket pool. Simple, compact, easily extended.
If your application needs to connect to many remote hosts simultaneously (and often), it probably
makes sense to keep connections open and re-use them rather than establishing a new connection for
every request. Combining an asyncio
event loop and a socket pool might be the way to go!
Based on socketpool.
Requires Python 3.7 or above.
Examples
Run a simple TCP echo server in a background thread, using the asyncio
library.
import asyncio import threading # start a new event loop running in a background thread def run_loop_forever(loop): loop.run_forever() loop = asyncio.new_event_loop() t = threading.Thread(name="BackgroundEventLoop", target=run_loop_forever, args=[loop], daemon=True) t.start() # run a tcp echo server using asyncio in the background event loop async def echo_handler(reader, writer): writer.write(await reader.read(32)) await writer.drain() writer.close() async def echo_server(tcp_port): server = await asyncio.start_server(echo_handler, "127.0.0.1", tcp_port) await server.serve_forever() asyncio.run_coroutine_threadsafe(echo_server(12345), loop)
Create a new TCP connection pool in the main thread, get a connection, and send and receive data.
from aiosocketpool import AsyncConnectionPool, AsyncTcpConnector pool = AsyncConnectionPool( factory=AsyncTcpConnector, reap_connections=True, # a background task will destroy old and idle connections max_lifetime=10, # connections will remain idle at most 10 seconds max_size=10, # we will maintain at most 10 idle connections in the pool ) async def hello_world(): async with pool.connection(host="127.0.0.1", port=12345) as conn: await conn.sendall(b"hello world") print(await conn.recv(32)) await hello_world()
Create a bunch of connections and run them all concurrently.
loop = asyncio.get_event_loop() tasks = [] for _ in range(25): tasks.append(loop.create_task(hello_world())) loop.run_until_complete(asyncio.gather(*tasks))
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Filename, size | File type | Python version | Upload date | Hashes |
---|---|---|---|---|
Filename, size aiosocketpool-0.0.2.tar.gz (6.7 kB) | File type Source | Python version None | Upload date | Hashes View |