Skip to main content

Grid Cortex Client

PyPI version Python

Python client for GRID Cortex.

Installation

pip install grid-cortex-client

Quick Start

from grid_cortex_client import CortexClient, ModelType

client = CortexClient(api_key="your-api-key")

# Monocular depth estimation
depth_map = client.run(ModelType.ZOEDEPTH, image_input="path/to/image.jpg")

Configuration

Pass your API key and base URL directly, or set them as environment variables:

export GRID_CORTEX_API_KEY="your-api-key"
export GRID_CORTEX_BASE_URL="https://cortex-prod.generalrobotics.dev/cortex"
# Explicit configuration
client = CortexClient(api_key="your-key", base_url="https://...")

# Or rely on environment variables
client = CortexClient()

Input Formats

RGB and stereo model inputs accept multiple input types:

  • File path: "path/to/image.jpg"
  • URL: "https://example.com/image.jpg"
  • PIL Image: Image.open("image.jpg")
  • NumPy array: np.ndarray with shape (H, W, 3)
  • GRID Image: grid_types.Image

For RGB and stereo models, encoded JPEG and PNG GRID Images are forwarded without decoding or re-encoding. Other GRID Image inputs follow the model's existing conversion path; PI05 still resizes its images to 224×224 before sending them. Numerical depth and segmentation inputs retain their existing NumPy/NPY contract.

Async & Concurrent Inference

The async client lets you call multiple models concurrently so total latency equals the slowest model, not the sum of all of them.

Concurrent multi-model example

import asyncio
import numpy as np
from grid_cortex_client import AsyncCortexClient, ModelType

async def run_perception_pipeline(image: np.ndarray):
    """Run depth, detection, and segmentation concurrently on the same frame."""
    async with AsyncCortexClient() as client:
        depth, detections, mask = await asyncio.gather(
            client.run(ModelType.ZOEDEPTH, image_input=image),
            client.run(ModelType.OWLV2, image_input=image, prompt="bottle"),
            client.run(ModelType.GSAM2, image_input=image, prompt="bottle"),
        )
    return depth, detections, mask

depth, detections, mask = asyncio.run(
    run_perception_pipeline(np.array(Image.open("scene.jpg")))
)

High-throughput streaming with pub/sub

For continuous streams (e.g. camera feeds), the CortexHubClient uses WebSockets to overlap sending and receiving. While frame N's result is being returned, frame N+1 is already being processed server-side:

import asyncio
import numpy as np
from grid_cortex_client import CortexHubClient, ModelType

async def publisher(hub: CortexHubClient, frames: list[np.ndarray]):
    """Send frames as fast as possible."""
    for i, frame in enumerate(frames):
        await hub.publish(ModelType.ZOEDEPTH, request_id=f"frame_{i}", image_input=frame)

async def subscriber(hub: CortexHubClient, num_frames: int):
    """Receive results as they arrive."""
    count = 0
    async for result in hub.subscribe():
        if result.ok:
            print(f"{result.request_id}: shape={result.data.shape}")
        count += 1
        if count >= num_frames:
            break

async def main():
    frames = [np.random.randint(0, 255, (480, 640, 3), dtype=np.uint8)] * 100

    async with CortexHubClient() as hub:
        await asyncio.gather(
            publisher(hub, frames),
            subscriber(hub, len(frames)),
        )

asyncio.run(main())

Documentation

For model-specific usage examples, parameter references, and detailed guides, see the full documentation:

docs.generalrobotics.dev/models/cortex

Requirements

  • Python >= 3.8

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

grid_cortex_client-1.0.7-py3-none-any.whl (74.5 kB view details)

Uploaded Python 3

File details

Details for the file grid_cortex_client-1.0.7-py3-none-any.whl.

File metadata

File hashes

Hashes for grid_cortex_client-1.0.7-py3-none-any.whl
Algorithm Hash digest
SHA256 07738778474a2914bd5a74370b5327140f484086c0a1e9d846b23f409370e9e4
MD5 b02ad8c829c879aef3ad30ef5d80b509
BLAKE2b-256 8e993b61f938775c5c0660cb3ae1fb6017a7777cdce817881158f2a1a03fd312

See more details on using hashes here.

Release history Release notifications | RSS feed

2.0.0

1 file

1.1.0

1 file

1.0.9

1 file

1.0.8

1 file

This release

1.0.7 This release

1 file

1.0.6

1 file

0.6.1

2 files

0.6.0

2 files

0.5.1

2 files

0.5.0

2 files

0.4.0

2 files

0.3.0

2 files

0.2.118

1 file

0.2.117

1 file

0.2.110

1 file

0.2.109

1 file

0.2.83

1 file

0.2.52

1 file

0.2.43

1 file

0.2.25

1 file

0.2.9

1 file

0.2.4

1 file

0.2.3

1 file

0.1.273

1 file

0.1.265

1 file

0.1.264

1 file

0.1.263

1 file

0.1.262

1 file

0.1.261

1 file

0.1.255

1 file

0.1.244

1 file

0.1.228

1 file

0.1.221

1 file

0.1.150

1 file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page