Skip to main content

Low-overhead latency metrics for SSE streaming responses (TTFT, E2E, throughput).

Project description

streamlat

Tiny utility to measure latency for SSE streaming responses.

Metrics:

  • TTFT (time to first text)
  • End-to-end latency (request start to stream done)
  • Stream text time (first text to last text)
  • Event and text event counts
  • Estimated token throughput (optional)

Install

pip install streamlat

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

streamlat-0.1.0.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

streamlat-0.1.0-py3-none-any.whl (3.8 kB view details)

Uploaded Python 3

File details

Details for the file streamlat-0.1.0.tar.gz.

File metadata

  • Download URL: streamlat-0.1.0.tar.gz
  • Upload date:
  • Size: 4.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.0

File hashes

Hashes for streamlat-0.1.0.tar.gz
Algorithm Hash digest
SHA256 e8df1070de61b1539ff41df3127a4e610568fe114fecf8e08f34dd1a05a3f519
MD5 182e9e5e2c7a91519e3dbe85b060afb6
BLAKE2b-256 705cc748340e9cb47d85a5dc8130cffe072c24f875a5c8133c1a65d3e4da7622

See more details on using hashes here.

File details

Details for the file streamlat-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: streamlat-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 3.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.0

File hashes

Hashes for streamlat-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 16abce2c54b87e292fb891df1a327744c13921c07e23246a588b2172a79d3397
MD5 49143b1d8a6e1ae280b4f07009b102a2
BLAKE2b-256 3cd003885c1714c6fcd974f32960d64cb0ca7b2618b13fce60d4d432e7498f0d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page