Standalone HTTP client for hosted and local Rescale AI inference servers
Project description
rescale-ai-client
Standalone Python client for Rescale AI hosted and local inference servers.
Communicates over the shared HTTP API. No rescale_ai package dependency.
Installation
pip install rescale-ai-client
For mesh loading, prediction plotting, or VTK mesh helpers (.vtp and .vtm):
pip install "rescale-ai-client[mesh]"
For interactive 3D notebook plots:
pip install "rescale-ai-client[mesh,jupyter]"
This extra also installs jupyter_bokeh, which Panel needs for interactive rendering
in VSCode notebooks.
For development (do not run unless making local changes to the rescale-ai-client library)
pip install -e ".[dev]"
License Request
uvx rescale-ai-client request-license --email user@customer.com
Writes license-request.json for the current user and machine.
License Registration
uvx rescale-ai-client register
Registers the issued license for the current user. Without a path, the command
looks for a valid license in ~/Downloads, then the current directory, then
prompts for the absolute path to the license file.
You can also pass the license path explicitly:
uvx rescale-ai-client register <path_to_license_file>
Quickstart
Launch Local Jupyter Notebook:
cd <path_to_workspace>/rescale-ai-client
source .venv/bin/activate
python -m ensurepip --upgrade
python -m pip install --upgrade pip
pip install uv
jupyter notebook
See example/notebooks/quickstart.ipynb for an example Jupyter notebook to get started. The directory contains other more advanced examples.
Retrieve Server-Available Models:
from rescale_ai_client import InferenceClient
client = InferenceClient.connect(base_url="http://127.0.0.1:65432") # Connects to local Inference Runner. Modify to connect to remote Host & Port
catalog = client.list_models()
model = catalog.model("MyModel").latest()
prediction = client.run_inference(
"/path/to/case.vtm",
parameters={"mach": 0.82},
model_name=model.model_name,
version_number=model.version_number,
)
print(prediction.global_predictions)
prediction.save("/tmp/result.vtm")
No-mesh Core Install, Summary-Only Inference:
from rescale_ai_client import InferenceClient
client = InferenceClient.connect(base_url="http://127.0.0.1:65432") # Connects to local Inference Runner. Modify to connect to remote Host & Port
summary = client.run_inference_summary(
"/path/to/case.vtm",
parameters={"mach": 0.82},
model_name="MyModel",
version_number=7,
)
print(summary.global_predictions)
print(summary.prediction_id)
Offline Install Bundle:
This installation path used when downloading an inference bundle directly from the Web UI.
from rescale_ai_client import InferenceClient
client = InferenceClient.connect(base_url="http://127.0.0.1:65432") # Connects to local Inference Runner. Modify to connect to remote Host & Port
installed = client.install_bundle(
"/path/to/MyModel_v0_local_inference.zip"
)
prediction = client.run_inference(
"/path/to/case.vtm",
parameters={"mach": 0.82},
model_version_path=installed.model_version_path,
)
print(installed.model_name, installed.version_number)
print(prediction.global_predictions)
extensions for Optional Future Data
Most JSON request methods accept an optional extensions={...} payload. This is the additive
escape hatch for future server features that should not force a client upgrade.
Example: Send Optional Request Hints During Prediction:
from rescale_ai_client import InferenceClient
client = InferenceClient.connect(base_url="http://127.0.0.1:65432") # Connects to local Inference Runner. Modify to connect to remote Host & Port
summary = client.run_inference_summary(
"/path/to/case.vtm",
parameters={"mach": 0.82},
model_name="MyModel",
version_number=7,
extensions={
"rescale": {
"ui_session": "demo-123",
"include_debug": True,
}
},
)
print(summary.extensions)
print(summary.warnings)
Example: Read Capability-Style or Server-Added Metadata from Typed Responses:
from rescale_ai_client import InferenceClient
client = InferenceClient.connect(base_url="http://127.0.0.1:65432")
server_info = client.server_info()
print(server_info.capabilities)
metadata = client.get_model_version_metadata(
model_name="MyModel",
version_number=7,
)
print(metadata.extensions)
print(metadata.warnings)
Design rules:
extensionsare optional and additive- unknown request extensions are ignored by the server
- unknown response extensions are ignored by clients
- if a field becomes core contract, it should graduate into a typed top-level field
Optimization
The rescale_ai_client.optimization package turns mesh inference into a
design-optimization loop. Define an Objective (built-ins cover global scalar
outputs, point-field reductions, and multi-model chains) and hand it to a search
driver. Every driver minimizes ObjectiveResult.value (use maximize=True on
the built-in objectives to flip the sign) and returns a result carrying the full
evaluation history, which the plot_* helpers can render.
Install the extra:
pip install "rescale-ai-client[optimization]" # adds SciPy
pip install "rescale-ai-client[cma]" # also adds CMA-ES support
Available drivers:
| Driver | Kind | Use when |
|---|---|---|
minimize_scipy |
Local (L-BFGS-B / SLSQP / TNC) | A good starting point is known and the response is smooth |
sqp_minimize |
Local SQP (SLSQP / trust-constr) with nonlinear constraints | The problem has constraints (e.g. max_stress <= 500); warm-start from a global driver |
differential_evolution |
Global, population | Multi-modal landscape, evaluations are cheap |
random_search |
Baseline sampling | A quick lower bound / sanity check |
bayesian_optimization |
Global, GP surrogate + Expected Improvement | Each evaluation is an expensive inference call (most sample-efficient) |
cma_es |
Global evolution strategy (needs [cma]) |
Noisy or ill-conditioned, multi-modal objectives |
from rescale_ai_client import InferenceClient
from rescale_ai_client.optimization import (
GlobalOutputObjective,
bayesian_optimization,
cma_es,
minimize_scipy,
random_search,
)
client = InferenceClient.connect(base_url="http://127.0.0.1:65432")
obj = GlobalOutputObjective(
client,
model_name="MyModel",
version=0,
vtp="/path/to/case.vtm",
output_name="Cd",
maximize=False,
)
bounds = {"AngleBeta1": (10.0, 35.0), "RPM": (25000.0, 32000.0)}
# Sample-efficient global search — best for expensive inference objectives.
result = bayesian_optimization(obj, bounds=bounds, n_calls=25, seed=0, verbose=True)
print(result.x, result.fun)
# Other drivers share the same call/return shape:
# minimize_scipy(obj, x0={...}, bounds=bounds)
# cma_es(obj, x0={...}, bounds=bounds) # requires the [cma] extra
# random_search(obj, bounds=bounds, n_calls=50)
Constrained optimization with SQP
sqp_minimize adds nonlinear constraints. Each Constraint receives both the
parameters and the cached ObjectiveResult at that point, so a constraint on
a model output reuses the objective's inference (no extra call):
from rescale_ai_client.optimization import Constraint, sqp_minimize
constraints = [
# Keep a predicted global output under a limit (read from the cached result).
Constraint(
fn=lambda params, result: result.info["global_outputs"]["max_stress"],
upper=500.0,
name="max_stress",
),
# A purely geometric/parameter constraint ignores the result argument.
Constraint(fn=lambda params, result: params["t1"] - params["t2"], lower=0.0),
]
result = sqp_minimize(
obj,
x0={"AngleBeta1": 20.0, "RPM": 29607.0},
bounds=bounds,
constraints=constraints,
method="SLSQP", # or "trust-constr" for harder problems
verbose=True,
)
print(result.x, result.fun, result.feasible, result.constraint_values)
Because SQP estimates gradients by finite differences, it's most effective on a smooth response and warm-started from a global driver's best point.
API
InferenceClient.connect(*, base_url=None, host=None, port=None, url=None, timeout=600.0)
Factory method. If omitted, defaults to local loopback at http://127.0.0.1:65432. base_url first. host / port and url remain convenience inputs. Scheme-less non-local endpoints default to HTTPS; explicit HTTP for non-local endpoints raises an InsecureConnectionWarning and stores the message on client.insecure_transport_warning.
// Give example here: connecting to my most recent Workstation
InferenceClient.connect_via_ssh(*, ssh_user_host, remote_port=65432, ...)
SSH tunnel helper. ssh_user_host required. If remote_port is omitted, defaults to 65432.
run_inference(vtp, parameters=None, *, model=None, model_version_path=None, model_name=None, model_uuid=None, version_number=None, ...)
Canonical Python entrypoint. The vtp argument name is kept for compatibility, but path inputs may be .vtp or .vtm; .vtm paths are sent to the inference server so block structure is preserved. Same shape for hosted and local servers. CamelCase aliases still work, but new code should use snake_case.
JSON request methods also accept extensions=... for optional future payloads.
run_inference_summary(...)
Lightweight entrypoint for core installs without the optional mesh dependencies. Returns typed prediction metadata plus global scalar outputs without constructing a pyvista mesh.
list_models(...)
Returns a typed ListModelsResult with helpers like .model("name"), .get("name", version_number=7), and .model("name").latest().
inspect_bundle(...) / install_bundle(...)
Inspect, upload, and install an offline local-inference bundle zip into the local installer. install_bundle(...) is idempotent: same content is a no-op, changed content updates the installed version.
get_model_version_metadata(version_number, *, model_name=None, model_uuid=None, ...)
Fetches typed metadata for one model version.
get_loaded_model()
Returns the server's current active-model bookkeeping status.
server_info()
Returns typed inference server capability and compatibility metadata:
api_versionsupported_api_versionsschema_revisionserver_buildcapabilities
Client
Compatibility alias for one release. Use InferenceClient for new code.
Advanced
Protocol Sync
The committed wire DTOs under src/rescale_ai_client/_generated/ are generated from the
closed-source inference server OpenAPI schema snapshot at
openapi/inference-server.openapi.json.
Update flow:
# from the closed-source rescale_ai repo
PYTHONPATH=/path/to/rescale_ai \
/path/to/rescale_ai/.venv/bin/python \
- <<'PY'
from pathlib import Path
from rescale_ai.inference.server.openapi_compat import export_openapi_schema
export_openapi_schema(
Path("/path/to/rescale-ai-client/openapi/inference-server.openapi.json")
)
PY
# from this repo
python scripts/generate_protocol_models.py
python scripts/generate_protocol_models.py --check
Releasing
Releases are published by GitHub Actions with uv build and uv publish.
One-Time Setup:
- In GitHub, create an environment named
pypiunder Settings -> Environments. - In PyPI, add a trusted publisher for:
- Owner:
rescale - Repository:
rescale-ai-client - Workflow:
release.yml - Environment:
pypi
- Owner:
No PyPI API token needs to be stored in GitHub secrets for this workflow. PyPI issues a short-lived publishing credential to the tagged GitHub Actions run through OIDC.
Publish a Release:
uv version 0.1.1
git commit -am "Release 0.1.1"
git tag -a v0.1.1 -m v0.1.1
git push origin main
git push origin v0.1.1
The workflow runs tests, verifies generated protocol models, builds both wheel and source distributions, smoke-tests both artifacts, and publishes to PyPI.
License
Apache-2.0
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file rescale_ai_client-0.3.2.tar.gz.
File metadata
- Download URL: rescale_ai_client-0.3.2.tar.gz
- Upload date:
- Size: 1.1 MB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: uv/0.11.26 {"installer":{"name":"uv","version":"0.11.26","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c42f2f2ba57cd4b5d830bdc55ce5ea2bbaf8d6ce0a0a48be48ca8becd03b60b5
|
|
| MD5 |
c1b0f1e3973c39528b14b9299685c38e
|
|
| BLAKE2b-256 |
9c16ce5efd4fa178eb370b43319062b5e7cab2090319a172d995afff5d53fe27
|
File details
Details for the file rescale_ai_client-0.3.2-py3-none-any.whl.
File metadata
- Download URL: rescale_ai_client-0.3.2-py3-none-any.whl
- Upload date:
- Size: 72.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: uv/0.11.26 {"installer":{"name":"uv","version":"0.11.26","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
90a6d67148a164d14209d9eec7e366c0a9ace0699523360bc56da99d95b60692
|
|
| MD5 |
fab20c9bee3a9716aaf6ae3051cea139
|
|
| BLAKE2b-256 |
13b0fc0a31a8ed08a72bd534d989cea3ac5fb1b212a527e965710aca2d2ef499
|