Skip to main content

Batch Inference Client

This is a client for the Jane Street dormant models batch inference/activations API.

The main client is defined in src/jsinfer/client.py. It currently supports the following:

  • Requesting access to the API
  • Creating batch file line items
  • Uploading a file to the API
  • Submitting a batch of inference/activations requests
  • Fetching the results of a batch of inference/activations requests
  • Cancelling a batch of inference/activations requests

Usage

Example usage is provided in examples/basic.py.

PyPi Package

To build and publish the client as a PyPi package, run the following commands:

uv build
uv publish --token <pypi_token>

Metadata

Release files for jsinfer 0.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for jsinfer 0.2.1
File Size Uploaded
jsinfer-0.2.1.tar.gz 5.0 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for jsinfer 0.2.1
File Interpreter ABI Platform
jsinfer-0.2.1-py3-none-any.whl Python 3 none any Details

Total release size: 11.1 kB

Release files / jsinfer-0.2.1.tar.gz

Download URL jsinfer-0.2.1.tar.gz
Size 5.0 kB
Tags Source
SHA-256 checksum
How to use checksums
4a4f6bd50a941ac626ff1b4c735a07d0b08d7d2b9497f153f21a412b50171b66
BLAKE2b-256 checksum
How to use checksums
a763e149cf18e602ad265c3575c86785921dbe0588d0e84302a57e01fe4ab9b7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.9.24 {"installer":{"name":"uv","version":"0.9.24","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"11","id":"bullseye","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Release files / jsinfer-0.2.1-py3-none-any.whl

Download URL jsinfer-0.2.1-py3-none-any.whl
Size 6.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
969ca097dffef17f981399ed46f5165513afa7b0038518266c15187f62f81184
BLAKE2b-256 checksum
How to use checksums
4134907c6e33dab80ccc2e6a5b12b34568ea481e983236dc2e6b93acd9e26ce2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.9.24 {"installer":{"name":"uv","version":"0.9.24","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"11","id":"bullseye","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Release history Release notifications | RSS feed

This release

0.2.1 This release

2 release files

0.2.0

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page