Korvex

A fast router for Python, written in Rust, with an ASGI app on top and a built-in server to run it.

Korvex is young (alpha). It's fast (see Performance), but it lacks some of what full frameworks offer: validation, OpenAPI. The roadmap lists what's coming.

pip install korvex

The router

Router maps a path and an HTTP method to a handler name. It never calls your code: what you do with the name is up to you.

from korvex import Router

router = Router()
router.get("/users/{id:int}", "get_user")
router.post("/users", "create_user", middleware=["auth"])

router.match("/users/42")         # ("get_user", {"id": 42}, ())
router.match("/users", "POST")    # ("create_user", {}, ("auth",))
router.match("/nope")             # None
router.match("/users", "DELETE")  # raises MethodNotAllowed, .allowed == ["POST"]

Path syntax

{id:int} gives an int and {id:uuid} a uuid.UUID; every other captured value is a string. When several routes could match, the most specific one wins: literal, then {id:int}/{id:uuid}, then {id}, then *path.

API

Invalid paths or methods raise ValueError.

match keeps the last 1,024 distinct lookups in a cache, and adding or removing a route clears it. Its results are shared between calls, so they are immutable: params is a read-only mapping and middleware a tuple.

Route groups

api = router.group("/api", middleware=["auth"])
api.get("/users", "list_users")             # GET /api/users, middleware ("auth",)

admin = api.group("/admin", middleware=["admin"])
admin.get("/stats", "stats")                # GET /api/admin/stats, middleware ("auth", "admin")

The ASGI app

App runs the matched handler for you. Serve it with any ASGI server (uvicorn, hypercorn, granian...).

from korvex import App, Response

app = App()

@app.get("/users/{id:int}", middleware=["auth"])
async def get_user(request, id):
    return Response.json({"id": id})

@app.middleware("auth")
def auth(request):
    if request.headers.get("Authorization") is None:
        return Response.text("Unauthorized", status=401)  # stops here
    return None                                          # carries on

pip install "korvex[serve]"   # installs uvicorn
uvicorn mymodule:app

• Handlers receive the Request plus path params as keyword arguments, and return a Response. Middleware returns a Response to answer early, or None to continue. Both can be sync or async.
• Request has method, path, headers, query_params, path_params, cookies, client ((host, port)), scheme, and await request.body(), await request.json(), await request.form(). A form maps each field to its values; files from a multipart form are UploadedFiles (filename, content_type, data). A body that can't be parsed is answered with a 400.
• Response(body, status=, headers=), Response.text(...), Response.json(...), Response.redirect(...), and response.set_cookie(...) / response.delete_cookie(...).
• Response.stream(chunks) sends a body piece by piece, from a sync or async generator. Response.file(path, filename=None) sends a file in chunks (with filename, as a download). app.static("/static", "public") serves a directory; paths that leave it get a 404.
• HEAD requests are answered by the GET route, without the body.
• Unknown paths get a 404; known paths with the wrong method get a 405 with an Allow header.
• @app.before_request runs before every request, ahead of routing (so for unknown paths too), and returns a Response to answer right away or None to carry on. @app.after_request gets every response, errors included, and returns the one to send (or None to keep it).
• raise HTTPException(404, "user not found") in a handler or middleware answers with that error. @app.exception_handler(404) (a status) or @app.exception_handler(ValueError) (an exception class) customizes the response. Any other exception gives a 500 and is logged to the korvex logger.
• app.group(prefix, middleware=[...]) works like router.group(), with decorators: api = app.group("/api"), then @api.get("/users"). Groups nest.
• Routes registered on app.router directly are linked to a function with @app.handler("name").
• @app.on_startup and @app.on_shutdown run a function (sync or async) when the server starts and stops, for example to open and close a database pool. Shutdown hooks run in reverse order. If a startup hook raises, the server doesn't start. Both @app.on_startup and @app.on_startup() work.

Validation

Type annotations say where a handler's parameters come from. Models can be msgspec structs or pydantic models; Korvex needs neither.

import msgspec

class UserIn(msgspec.Struct):
    name: str
    age: int

class UserOut(msgspec.Struct):
    id: int
    name: str

@app.post("/users")
async def create(request, body: UserIn, notify: bool = False) -> UserOut:
    return UserOut(id=1, name=body.name)

• A model (or list[Model]) parameter is the JSON body, validated.
• A path parameter's name gets its value, converted to the annotated type.
• Other str, int, float, bool, UUID, date or datetime parameters (or Optional or list of them) come from the query string, dates in ISO 8601; a default makes them optional. Any other annotation is refused when the route is registered.
• A model return annotation turns the returned object into JSON; a returned Response is sent as is.
• Invalid input gets a 422 with {"detail": [{"loc": ["body", "age"], "msg": ..., "type": ...}]}. pydantic lists every problem; msgspec stops at the first. @app.exception_handler(422) changes the response.
• Annotations are read once, when the route is registered: a handler without them costs nothing extra, and one that can't be understood fails at import.

app.openapi(title=..., version=...) describes the API as an OpenAPI 3.1 document: paths, typed path and query parameters, request and response models, and each handler's docstring (its first line as the summary). app.docs(title=..., version=...) serves it at /openapi.json, with Swagger UI at /docs to try the API from a browser (loaded from a CDN; docs_path=None leaves it out).

WebSockets

@app.websocket("/ws/{room}")
async def chat(ws, room):
    if ws.cookies.get("session") is None:
        await ws.close(code=1008)  # before accept: refuses it (403)
        return
    await ws.accept()
    async for message in ws:  # text or bytes, until the client leaves
        await ws.send_text(f"{room}: {message}")

• A WebSocket has the handshake's headers, cookies, query_params, path_params, client and scheme; accept(subprotocol=...), receive() (raises WebSocketDisconnect), receive_text/bytes/json, send_text/bytes/json and close(code).
• They work the same under ASGI servers and in the built-in server. Groups support them (api.websocket(...)); app hooks don't run for them.

Ready-made hooks

korvex.middleware registers hooks for common jobs:

from korvex.middleware import cors

cors(app, allow_origins=["https://example.com"], allow_credentials=True)

• cors(app, allow_origins=..., allow_methods=..., allow_headers=..., allow_credentials=False, expose_headers=(), max_age=600) lets browsers call the app from other origins. Preflight requests are answered before routing; every response to an allowed origin, errors included, gets the CORS headers.
• request_id(app, header="X-Request-ID", trust_incoming=True) gives every request an ID (the incoming one if it's safe, a new one otherwise) and sends it back. current_request_id() returns it anywhere in your code, RequestIdFilter adds it to log records (%(request_id)s), and the built-in server's access logs show it.
• rate_limit(app, requests=100, per=60, key=...) allows each key (the client's address by default, or an API key, a user ID...) that many requests per period; beyond that, a 429 with Retry-After. Responses carry RateLimit-Limit, RateLimit-Remaining and RateLimit-Reset. Counters live in each worker's memory, so with 3 workers a client can get up to 3 times the limit; store= takes a shared store instead.

More in examples/, up to a complete app laid out like a real project. To put it in production (behind nginx or Caddy, in Docker, on AWS Lambda or Vercel), see the deployment guide.

The built-in server

Korvex can run an App without an ASGI server, on Linux and macOS. On the same CPU cores, it serves 20 to 36% more requests than uvicorn with about 40% less memory (see Performance).

korvex run main:app --workers 3

or, from Python, app.run(workers=3). The same options exist in both:

How it works: a Rust thread per worker reads each request in full, without touching Python, then hands it to the asyncio loop, which runs your handlers. A slow or huge upload never holds a Python worker.

Things to know:

• Run it behind a reverse proxy (nginx, Caddy, Traefik) in production: it speaks HTTP/1.1 and WebSocket; HTTPS, HTTP/2 and HTTP/3 are the proxy's job.
• The 413 and 408 errors are answered by the server itself, before your app sees the request, so @app.exception_handler doesn't apply to them.
• The App is still a plain ASGI app: uvicorn, Granian or a serverless platform keep working, and Windows needs one of them.

Performance

Servers

The same app, served by each server on the same 4 CPU cores, each with its best number of workers:

• Granian is a Rust ASGI server too: it does better than uvicorn here, but the built-in server still leads, because it skips the ASGI layer.
• Robyn runs its own version of the app with its own Rust server.
• No request failed.

Reproduce with uv run python benches/servers.py (needs cargo install oha, takes about 4 minutes).

Under load

The same small app (1,000 routes, one JSON endpoint) in each framework, served the same way (uvicorn, one worker, one CPU core) and flooded with requests to random URLs by oha:

• Every framework uses a full CPU core under load, so requests per second is also how much work each one gets out of that core.
• Falcon, and Starlette in its best case, come within about 10% of Korvex.
• Starlette, FastAPI and Django try routes one by one: the ranges go from the tested route declared after the 1,000 others to declared first. BlackSheep tries them one by one too, but sorts them itself, deepest first, so here the tested route always comes last.
• No request failed. Throughput holds steady as clients are added; latency grows because requests queue, not because each one gets slower. After the flood, memory stays flat and speed is back to normal.

Robyn isn't in this table, since it can't run on uvicorn: it's compared with Korvex's built-in server above.

Reproduce with uv run python benches/load_test.py (needs cargo install oha, takes about 11 minutes).

Router alone

Route matching only, without any server:

Median time per lookup, 10,000 routes:

• Korvex is the fastest in both cases, and its time stays flat as routes are added. Django and Starlette try routes one by one, so they slow down linearly.
• Korvex, Litestar and Sanic cache the last 1,024 lookups. The cache helps most with static URLs; URLs with parameters (/users/1, /users/2, ...) are often different, so they hit it less.
• With few routes, the server and the handler cost more than the router. With many routes, a router that tries them one by one becomes the main cost (see Under load).

Reproduce with uv run pytest benches/bench_router.py --benchmark-only --benchmark-json=benches/results.json, then uv run python benches/plot.py to redraw both charts. Results depend on the machine: measure your own workload before relying on any number.

Validation

One POST with a small JSON body, answered with JSON, run through the app in-process (no server). Median time per request:

• Validating is faster than not validating here: msgspec and pydantic decode and encode JSON in compiled code, request.json() and Response.json() use Python's json module.
• Handlers without annotations take the same time as in 0.6.

Reproduce with uv run pytest benches/bench_validation.py --benchmark-only.

Development

uv run maturin develop --release   # build the Rust extension
uv run pytest                      # Python tests
cargo test                         # Rust tests

See CONTRIBUTING.md, and ROADMAP.md for what's planned.

License

MIT