chalk-remote-call-python

A Python runtime interface for Chalk's RemoteCallService. This package provides a gRPC server backed by a Rust implementation (tonic + PyO3) that lets you define a handler(event, context) function to process incoming Arrow-serialized requests.

The server receives Arrow IPC record batches over a bidirectional gRPC stream, transforms them into a Python dict, invokes your handler, and streams the results back as Arrow IPC.

Requirements

Python >= 3.10
Rust toolchain (for building the native extension)
pyarrow >= 14.0.0

Usage

1. Write a handler

Create a Python module with a handler function:

# my_handler.py
import pyarrow as pa
import pyarrow.compute as pc


def on_startup():
    """Optional -- runs once before the server starts accepting requests."""
    print("Loading model weights...")


def handler(event: dict[str, pa.Array], context: dict) -> pa.Array:
    """Called for each incoming request.

    Args:
        event: dict mapping column names to pyarrow.Array values.
        context: dict with request metadata

    Returns:
        A pyarrow.Array, pyarrow.RecordBatch, pyarrow.Table, list, dict, or scalar.
        The framework auto-converts the result to Arrow IPC for the response.
    """
    return pc.multiply(event["x"], event["y"])


def on_shutdown():
    """Optional -- runs once after the server stops accepting requests."""
    print("Releasing resources...")

2. Start the server

chalk-remote-call --handler my_handler.handler

Or via python -m:

python -m chalk_remote_call --handler my_handler.handler

CLI options

Flag	Env var	Default	Description
`--handler`		(required)	Dotted path to handler function
`--port`	`CHALK_REMOTE_CALL_PORT`	`6666`	Port to listen on
`--host`	`CHALK_REMOTE_CALL_HOST`	`[::]`	Host to bind to
`--workers`	`CHALK_REMOTE_CALL_WORKERS`	`10`	Tokio runtime worker threads
`--on-startup`			Dotted path to a startup function
`--on-shutdown`			Dotted path to a shutdown function
`--log-level`		`INFO`	`DEBUG`, `INFO`, `WARNING`, or `ERROR`

Environment variables

Variable	Description
`CHALK_INPUT_ARGS`	Comma-separated list of column names (e.g. `x,y,z`). Renames incoming RecordBatch columns by index. If unset, the original column names are used. Reserved columns (below) are held out of this mapping and keep their own name.
`CHALK_FNQ_QUEUE_PROTOCOL`	Self-consumer work transport: `list_v1` (default/backward compatible) or `stream_v1`. Deployment tooling sets this from immutable scaling-group revision metadata.

Reserved columns

A caller may attach framework side-channel data to a request as an extra column. Reserved columns are matched by name, are optional on any given request, and are excluded from the positional CHALK_INPUT_ARGS mapping — so CHALK_INPUT_ARGS always lists exactly the handler's declared arguments, whether or not the caller sent one.

Column	Meaning
`__chalk_row_metadata__`	Per-row binary blob supplied by the caller (Chalk's engine sets it from `catalog_call(..., row_metadata => ...)`). Handlers read it via `chalkcompute.get_row_metadata()`.

3. Docker image

FROM python:3.11-slim

WORKDIR /app

RUN pip install chalk-remote-call-python

# Copy your handler code
COPY my_handler.py /app

EXPOSE 6666

ENTRYPOINT ["chalk-remote-call"]
CMD ["--handler", "handler.handler"]

Build and run:

docker build -t my-chalk-handler .
docker run -p 6666:6666 -e CHALK_INPUT_ARGS="x,y" my-chalk-handler

Programmatic usage

You can also start the server from Python:

from chalk_remote_call import serve

def handler(event, context):
    return list(event.values())[0]

serve(handler=handler, port=8080)

Local Testing

Use grpcurl to verify the server is running:

# Check health
grpcurl -plaintext localhost:6666 grpc.health.v1.Health/Check

# List services via reflection
grpcurl -plaintext localhost:6666 list

Architecture

The server uses a Rust backend via PyO3:

tonic — gRPC server with health checking and reflection
prost — protobuf message handling
arrow-rs — Arrow IPC validation
PyO3 — FFI bridge to call Python handler functions

The Rust server runs on a tokio async runtime. When a request arrives, Arrow IPC bytes are passed to Python via PyO3 (spawn_blocking + GIL acquisition), where the handler is invoked. Results are passed back as IPC bytes.

Development

Setup

cd chalk-remote-call-python
uv venv --python 3.11
uv pip install -e ".[dev]"

Running tests

pytest tests/ -v

Rust code

Rust source lives in chalk-remote-call-rs/:

To check the Rust code independently:

PYO3_PYTHON=python3 cargo check --manifest-path chalk-remote-call-rs/chalk-remote-call-server/Cargo.toml

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

chalk_remote_call_python-1.9.1.tar.gz (138.8 kB view details)

Uploaded Sep 13, 2026 Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

chalk_remote_call_python-1.9.1-cp314-cp314-win_amd64.whl (2.2 MB view details)

Uploaded Sep 13, 2026 CPython 3.14Windows x86-64

chalk_remote_call_python-1.9.1-cp314-cp314-musllinux_1_2_x86_64.whl (9.1 MB view details)

Uploaded Sep 13, 2026 CPython 3.14musllinux: musl 1.2+ x86-64

chalk_remote_call_python-1.9.1-cp314-cp314-musllinux_1_2_aarch64.whl (9.3 MB view details)

Uploaded Sep 13, 2026 CPython 3.14musllinux: musl 1.2+ ARM64

chalk_remote_call_python-1.9.1-cp314-cp314-manylinux_2_28_x86_64.whl (8.1 MB view details)

Uploaded Sep 13, 2026 CPython 3.14manylinux: glibc 2.28+ x86-64

chalk_remote_call_python-1.9.1-cp314-cp314-manylinux_2_28_aarch64.whl (9.2 MB view details)

Uploaded Sep 13, 2026 CPython 3.14manylinux: glibc 2.28+ ARM64

chalk_remote_call_python-1.9.1-cp314-cp314-macosx_11_0_arm64.whl (2.3 MB view details)

Uploaded Sep 13, 2026 CPython 3.14macOS 11.0+ ARM64

chalk_remote_call_python-1.9.1-cp314-cp314-macosx_10_13_x86_64.whl (2.4 MB view details)

Uploaded Sep 13, 2026 CPython 3.14macOS 10.13+ x86-64

chalk_remote_call_python-1.9.1-cp313-cp313-win_amd64.whl (2.1 MB view details)

Uploaded Sep 13, 2026 CPython 3.13Windows x86-64

chalk_remote_call_python-1.9.1-cp313-cp313-musllinux_1_2_x86_64.whl (9.1 MB view details)

Uploaded Sep 13, 2026 CPython 3.13musllinux: musl 1.2+ x86-64

chalk_remote_call_python-1.9.1-cp313-cp313-musllinux_1_2_aarch64.whl (9.3 MB view details)

Uploaded Sep 13, 2026 CPython 3.13musllinux: musl 1.2+ ARM64

chalk_remote_call_python-1.9.1-cp313-cp313-manylinux_2_28_x86_64.whl (8.1 MB view details)

Uploaded Sep 13, 2026 CPython 3.13manylinux: glibc 2.28+ x86-64

chalk_remote_call_python-1.9.1-cp313-cp313-manylinux_2_28_aarch64.whl (9.2 MB view details)

Uploaded Sep 13, 2026 CPython 3.13manylinux: glibc 2.28+ ARM64

chalk_remote_call_python-1.9.1-cp313-cp313-macosx_11_0_arm64.whl (2.3 MB view details)

Uploaded Sep 13, 2026 CPython 3.13macOS 11.0+ ARM64

chalk_remote_call_python-1.9.1-cp313-cp313-macosx_10_13_x86_64.whl (2.4 MB view details)

Uploaded Sep 13, 2026 CPython 3.13macOS 10.13+ x86-64

chalk_remote_call_python-1.9.1-cp312-cp312-win_amd64.whl (2.1 MB view details)

Uploaded Sep 13, 2026 CPython 3.12Windows x86-64

chalk_remote_call_python-1.9.1-cp312-cp312-musllinux_1_2_x86_64.whl (9.1 MB view details)

Uploaded Sep 13, 2026 CPython 3.12musllinux: musl 1.2+ x86-64

chalk_remote_call_python-1.9.1-cp312-cp312-musllinux_1_2_aarch64.whl (9.3 MB view details)

Uploaded Sep 13, 2026 CPython 3.12musllinux: musl 1.2+ ARM64

chalk_remote_call_python-1.9.1-cp312-cp312-manylinux_2_28_x86_64.whl (8.1 MB view details)

Uploaded Sep 13, 2026 CPython 3.12manylinux: glibc 2.28+ x86-64

chalk_remote_call_python-1.9.1-cp312-cp312-manylinux_2_28_aarch64.whl (9.2 MB view details)

Uploaded Sep 13, 2026 CPython 3.12manylinux: glibc 2.28+ ARM64

chalk_remote_call_python-1.9.1-cp312-cp312-macosx_11_0_arm64.whl (2.3 MB view details)

Uploaded Sep 13, 2026 CPython 3.12macOS 11.0+ ARM64

chalk_remote_call_python-1.9.1-cp312-cp312-macosx_10_13_x86_64.whl (2.4 MB view details)

Uploaded Sep 13, 2026 CPython 3.12macOS 10.13+ x86-64

chalk_remote_call_python-1.9.1-cp311-cp311-win_amd64.whl (2.1 MB view details)

Uploaded Sep 13, 2026 CPython 3.11Windows x86-64

chalk_remote_call_python-1.9.1-cp311-cp311-musllinux_1_2_x86_64.whl (9.1 MB view details)

Uploaded Sep 13, 2026 CPython 3.11musllinux: musl 1.2+ x86-64

chalk_remote_call_python-1.9.1-cp311-cp311-musllinux_1_2_aarch64.whl (9.3 MB view details)

Uploaded Sep 13, 2026 CPython 3.11musllinux: musl 1.2+ ARM64

chalk_remote_call_python-1.9.1-cp311-cp311-manylinux_2_28_x86_64.whl (8.1 MB view details)

Uploaded Sep 13, 2026 CPython 3.11manylinux: glibc 2.28+ x86-64

chalk_remote_call_python-1.9.1-cp311-cp311-manylinux_2_28_aarch64.whl (9.2 MB view details)

Uploaded Sep 13, 2026 CPython 3.11manylinux: glibc 2.28+ ARM64

chalk_remote_call_python-1.9.1-cp311-cp311-macosx_11_0_arm64.whl (2.3 MB view details)

Uploaded Sep 13, 2026 CPython 3.11macOS 11.0+ ARM64

chalk_remote_call_python-1.9.1-cp311-cp311-macosx_10_13_x86_64.whl (2.4 MB view details)

Uploaded Sep 13, 2026 CPython 3.11macOS 10.13+ x86-64

chalk_remote_call_python-1.9.1-cp310-cp310-win_amd64.whl (2.1 MB view details)

Uploaded Sep 13, 2026 CPython 3.10Windows x86-64

chalk_remote_call_python-1.9.1-cp310-cp310-musllinux_1_2_x86_64.whl (9.1 MB view details)

Uploaded Sep 13, 2026 CPython 3.10musllinux: musl 1.2+ x86-64

chalk_remote_call_python-1.9.1-cp310-cp310-musllinux_1_2_aarch64.whl (9.3 MB view details)

Uploaded Sep 13, 2026 CPython 3.10musllinux: musl 1.2+ ARM64

chalk_remote_call_python-1.9.1-cp310-cp310-manylinux_2_28_x86_64.whl (8.1 MB view details)

Uploaded Sep 13, 2026 CPython 3.10manylinux: glibc 2.28+ x86-64

chalk_remote_call_python-1.9.1-cp310-cp310-manylinux_2_28_aarch64.whl (9.2 MB view details)

Uploaded Sep 13, 2026 CPython 3.10manylinux: glibc 2.28+ ARM64

chalk_remote_call_python-1.9.1-cp310-cp310-macosx_11_0_arm64.whl (2.3 MB view details)

Uploaded Sep 13, 2026 CPython 3.10macOS 11.0+ ARM64

chalk_remote_call_python-1.9.1-cp310-cp310-macosx_10_13_x86_64.whl (2.4 MB view details)

Uploaded Sep 13, 2026 CPython 3.10macOS 10.13+ x86-64

File details

Details for the file chalk_remote_call_python-1.9.1.tar.gz.

File metadata

Download URL: chalk_remote_call_python-1.9.1.tar.gz
Upload date: Sep 13, 2026
Size: 138.8 kB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for chalk_remote_call_python-1.9.1.tar.gz
Algorithm	Hash digest
SHA256	`1fb0f22bd4de5c3de1076f12dab6fef143ecaa04c3e127aa267839e0377a4614`
MD5	`8f21a2fdf86fd3ce7abac41f065227cd`
BLAKE2b-256	`21910b131d20f6a4b8323eb18c6dcd6bafc767f521b7688db64c42e555702036`

Algorithm	Hash digest
SHA256	`34a7eb53f102193e4614f97719fe171e61673d6d3474ac72be2d5347925673c9`
MD5	`0c4f2e762453614686655459e41a866f`
BLAKE2b-256	`42532709b210073489c7e4623579623f744879083487e77ef756fa14fa82e8a3`

Algorithm	Hash digest
SHA256	`437b0d499f60f6bdd2bebb8aaa6213e502e2fa9b1681b9dc304897a1a36ba94b`
MD5	`973b9712613d4e479cfe5eac4fc95d7c`
BLAKE2b-256	`962d99e614fab4894a4d3f4a69739c2cd324b77c2c9373d212a7c2dfda31dec3`

Algorithm	Hash digest
SHA256	`6ca3fb45371e4313843c570be4fe2843b7fac9a6bb4eab2b225a9259d6bb96b4`
MD5	`758c58851901fc253ca033f7da5b01ab`
BLAKE2b-256	`f110b5c4a778df525d98980c05a25c16150c4325516ae3cbd025fb551de43bd9`

Algorithm	Hash digest
SHA256	`f8c834c87a90eded39b0185033b354579abc266cc396ea858d6ddd58c7c8f2c2`
MD5	`5d2c09f4c887292197270c99f8a1c7e7`
BLAKE2b-256	`5935e0533b168d3309ae4ea1062c1f75dbcd2adb4fd739866327471f54195b82`

Algorithm	Hash digest
SHA256	`63ac69afd4151751b6bb4e78b566b7dcd79a6bc8b017b92987c2456971f844fb`
MD5	`c48f2adb88140226a288360583657401`
BLAKE2b-256	`cff0bb0345751a54692a94b4ad49a29aaa6b830ad4bd9859ff0e56ef4b64d748`

Algorithm	Hash digest
SHA256	`974274e8977789f7624a6eed06308124fcf3bae16b4814e33016a6609485db91`
MD5	`329ea59847cb4393d52492db2e62c843`
BLAKE2b-256	`dc764d61c81dade04c248984375d4d19601058fa6c260d5e872c68b437f90697`

Algorithm	Hash digest
SHA256	`d4644c77cf12b73df1a41c322a03f459994f1674e9d9e3fec8687f3b9e85be4c`
MD5	`95cf0ad9159068bf34c5ef7792e32157`
BLAKE2b-256	`722e69c1d1725e3d18cbece5026c1d10bd2369d33c3c42dd44eeaa3de0edefdd`

Algorithm	Hash digest
SHA256	`d983da84333dfc20dafb63f637ae41350b6677e95a3f4746def5185f9d1b27ef`
MD5	`e4f01d29175fadd348406dfc8d07f2df`
BLAKE2b-256	`6e8cc2f64d483e3c2345df4299669e2ca39934b3af0c5ba0d4cc073875b4b20c`

Algorithm	Hash digest
SHA256	`1c3f32385eeb8e64f0b72f89074d750385564ab34b618d84fda72cbc07c38184`
MD5	`2c78aa7df6d2f3fe7ab8663d7e825944`
BLAKE2b-256	`50a38d15b78774567f20c9b092e2ac455461cf649c4c22d19ec9c28f13636452`

Algorithm	Hash digest
SHA256	`3ba91f1bf180abe518098c570dd02c178be13a968e21b4ef312d8dee0d989231`
MD5	`b0e739a518960a064d15aae224c6dd70`
BLAKE2b-256	`2573ff161f09dd517daf2eeba20550d29f17b3a2d4f3862f4bfe94776bd24f88`

Algorithm	Hash digest
SHA256	`2a231dfacaf496dd84f5dc7ce0be2503e53a94233a25c2e28e185214719b851e`
MD5	`30946dd2c10c6ff4f20cf6edd696d9b9`
BLAKE2b-256	`713990bd2467fc03ca8b3573b4363c8344f99b9c15ccbe337229ce91d71f0c1b`

Algorithm	Hash digest
SHA256	`0383e5f7072e08780149d898e6b1991b8b39f3b43ab19161f247572a97665438`
MD5	`31b40db961e73f14daddb0dced1599a8`
BLAKE2b-256	`fda84e1e6cbe9097f751c053970c4ac090103aa3066aa89e2ff88c0207ebe5cd`

Algorithm	Hash digest
SHA256	`cdbaa4050f3f0e257ac45c692279fd97638a68fc169817e0aa50aab2b415d79f`
MD5	`79751ee710e47a283556a5c2cdc85e81`
BLAKE2b-256	`e5456ba105182ae5b10c5fa38f318cdf61c20cafb7b1a796fcecd15535c27432`

Algorithm	Hash digest
SHA256	`88ad76b34330095efad79ce48bc1fe91fb8eb4663cbe55e80fdcac44c0bd693e`
MD5	`42b60fb9caee42d2eecf268491e5c077`
BLAKE2b-256	`784805089d825ecc66caa993c30ddc3487babc7d88bcdfac0bbc0e314a00444d`

Algorithm	Hash digest
SHA256	`a99310146fd67e17a5a9d459723e89607c96a07c0d31efc19fa498c9b85d9a12`
MD5	`173d79f5046e292dbbd4e118401b269f`
BLAKE2b-256	`e3a76d826c632b363323d3ceadb96b28737a25298309412f9b8ebb44cb3a0c57`

Algorithm	Hash digest
SHA256	`ae0c9c11f1e3b50af5003433b050871b128078ea5bc8116827f2634b7d550c1e`
MD5	`c039ba5e5d868f46aa94b13a48f30a64`
BLAKE2b-256	`9c552b5f2716e88b1362e15dc7ef6594939210438d3068bacccf54b5e88c3b96`

Algorithm	Hash digest
SHA256	`1297ad5de87daf034b0fd70de26a3851ac12b4b68e02782a28a3d338e05c9e1c`
MD5	`90b056fd356d36b2a86ea649936a2e89`
BLAKE2b-256	`c6663d97a7169e24a9d20ae11cd7a4fe1db85a233b98408958ed1eb517dbf9cf`

Algorithm	Hash digest
SHA256	`ffee638a4908debf9f24264e736a8f2a10e919c28cf9defdf575ec689f5b379e`
MD5	`ba05dc1b14b220cd9c0ce69c36f7b9d8`
BLAKE2b-256	`a922e4666bdad7c53f019837a72dc947c6a0436a9e6c0144783a21b8e83c9257`

Algorithm	Hash digest
SHA256	`c25093301c197e96b6718c1c0836f85fbc3978dba33cb3a7984d92ebf10d64f0`
MD5	`db195987ac035c762e573bdd686579f0`
BLAKE2b-256	`03249612024aa61be4635d712e84bbb8f8b596ea9b555b7e88513571ecdf9eb6`

Algorithm	Hash digest
SHA256	`df28456444075b8a996945c2bd9d0616e1b3e1bec74a393b935202ce2d0e2841`
MD5	`8669973c9ac99f3884caefd98fea457d`
BLAKE2b-256	`b192ecf2cd942c288e5d5050dc378aea0960d0a670f799f856fc58191bbca0eb`

chalk-remote-call-python 1.9.1

chalk-remote-call-python

Requirements

Usage

1. Write a handler

2. Start the server

CLI options

Environment variables

Reserved columns

3. Docker image

Programmatic usage

Local Testing

Architecture

Development

Setup

Running tests

Rust code

Project links

Key dates

Owner

Credits

Requires

Provides Extra

Classifiers

Download files

Source Distribution

Built Distributions

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

Algorithm	Hash digest
SHA256	`118531522e9987f15f59b459764d87dff85dce8709df5776ba834f105d4fcd66`
MD5	`d06544282a092a4709cb946ff65f3aae`
BLAKE2b-256	`26f4e996724b55fd928e318b96b417d1694676e15babe4b3bc4da481b8b8f8ab`

Algorithm	Hash digest
SHA256	`a9a7b85894b40e4dfe09d2f86e6e1695f700e45640f5b38cf386f11c465c41f6`
MD5	`d5e34774fc1d29b6aa5ced9db22724a1`
BLAKE2b-256	`c453049509e235d84699d2b2af04f3cdeb9f76ded55d49808b511f7f68d6baeb`

Algorithm	Hash digest
SHA256	`4d852646c77f8f04ffc7ac911214c5a3c24b33ff0fb3f19db810dadfcca5b1bf`
MD5	`3732c0b55206c2e7e0fdde9c97151515`
BLAKE2b-256	`14a46b2d61dd0fc3b11736a26cc8a8af53e95cc482d25c0a63e6aab703c7b5de`

Algorithm	Hash digest
SHA256	`dce32de5fb4bb4835bc781d8d320196ed2276c85425cf0615d609f2aabed9d6b`
MD5	`b3f56c99f5398efd5f693ecf194dcd5a`
BLAKE2b-256	`7218ebdb70ae2615c963554de27fc4cb30d2cc36321a364745c7dd8f6e86d60b`

Algorithm	Hash digest
SHA256	`d022a282bf124af73aa55346875ca16495abaf6c8be51841ef3f1e30ee0d59ce`
MD5	`a6d8dd9bf6993c77a38aab39d7c9dd87`
BLAKE2b-256	`1e91d49c3d720cb4d0be4d2be1a85c968de2464b47e2f1b5cc0987fb2866bb3f`

Algorithm	Hash digest
SHA256	`ab6d61a95d7982f928f1f6833a7e4df7897d7bfdfdf076da49e68e4b1b9f4914`
MD5	`6755f4b9bb86666b375453bf7175502c`
BLAKE2b-256	`f07dd10072de258467d89882a24f30a2c4c1228e4980bc3c8fe97bb6221cf036`

Algorithm	Hash digest
SHA256	`e87a16988bffad72807d7202ff0e796ca9c6cef719c333ac2932f4d249548bbb`
MD5	`396354db1a01a9b6753b797741317e7f`
BLAKE2b-256	`714e8df2a110eec60041993b53d417d3eb6f1b05c98dd052efb02c3a487d7707`

Algorithm	Hash digest
SHA256	`1b65dce894e9a6d5e08a617a210508a52ebec786284f24e93af53b36214cf8a5`
MD5	`d7371f17090c5a8d83ac6c4ae7a6c79a`
BLAKE2b-256	`ccce862bd5ad519b48243c5024119baf1bba177f78be47e9bb2f28a58caf325d`

Algorithm	Hash digest
SHA256	`b28edc7c36f0b480d82042e76321872b13aaf09230065553437f72031882d324`
MD5	`65b4a063d8f3d0a396a5a4160939d229`
BLAKE2b-256	`ea788248d765110977f332639254feb1b8a90aea6556fa71d4e79923c9f9ab06`

Algorithm	Hash digest
SHA256	`bd6b5a812cbb923c035be73dd25517f92db8f6ae2fd7f365132fd7c7996088e9`
MD5	`6891c0331b8d9267237a75509f263b59`
BLAKE2b-256	`e958090fe5d836e7810dc7ff877a5be92b007eed569fc6dd794e2588783d1c03`