nominal-streaming Python Bindings
nominal-streaming is a thin python wrapper around the existing nominal-streaming rust crate.
Usage semantics remain largely the same, but with some slight alterations to allow for a more pythonic interface.
The library aims to balance three concerns:
- Data should exist in-memory only for a limited, configurable amount of time before it's sent to Core.
- Writes should fall back to disk if there are network failures.
- Backpressure should be applied to incoming requests when network throughput is saturated.
This library streams data to Nominal Core, to a file, or to Nominal Core with a file as backup (recommended to protect against network failures). It also provides configuration to manage the tradeoff between above listed concerns.
[!WARNING] This library is still under active development and may make breaking changes.
Usage example: streaming from memory to Nominal Core with file fallback
import pathlib
import time
from nominal.core import NominalClient
from nominal_streaming import NominalDatasetStream, PyNominalStreamOpts
if __name__ == "__main__":
num_points = 100_000
stream = (
NominalDatasetStream(
auth_header="<api key>",
opts=PyNominalStreamOpts(),
)
.enable_logging("info") # can set debug, warn, etc.
.with_core_consumer("<dataset rid>")
.with_file_fallback(pathlib.Path("local_fallback.avro"))
)
with stream:
# Stream 100_000 live readings (made up values)
for idx in range(num_points):
time_ns = int(time.time() * 1e9)
value = (idx % 50) + 0.5
stream.enqueue("channel_name", time_ns, value, tags={"tag_key": "tag_value"})
# Stream 100_000 points in one batch
start_time = int(time.time() * 1e9)
timestamp_offsets = int(1e9 / 1600)
timestamps = [start_time + timestamp_offsets * idx for idx in range(num_points)]
values = [(idx % 50) + 0.5 for idx in range(num_points)]
stream.enqueue_batch(
"channel_name",
timestamps,
values,
tags={"tag_key": "tag_value"}
)
1 maintainer
Metadata
1 maintainer
Release files for nominal-streaming 0.9.9
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
| File | Reset | |||
|---|---|---|---|---|
| nominal_streaming-0.9.9-cp310-abi3-win_amd64.whl | CPython 3.10 | abi3 | Windows x86-64 | Details |
| nominal_streaming-0.9.9-cp310-abi3-musllinux_1_2_x86_64.whl | CPython 3.10 | abi3 | Linux musl 1.2+ x86-64 | Details |
| nominal_streaming-0.9.9-cp310-abi3-musllinux_1_2_armv7l.whl | CPython 3.10 | abi3 | Linux musl 1.2+ ARMv7l | Details |
| nominal_streaming-0.9.9-cp310-abi3-musllinux_1_2_aarch64.whl | CPython 3.10 | abi3 | Linux musl 1.2+ ARM64 | Details |
| nominal_streaming-0.9.9-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl | CPython 3.10 | abi3 | Linux glibc 2.17+ x86-64 | Details |
| nominal_streaming-0.9.9-cp310-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whl | CPython 3.10 | abi3 | Linux glibc 2.17+ ARMv7l | Details |
| nominal_streaming-0.9.9-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl | CPython 3.10 | abi3 | Linux glibc 2.17+ ARM64 | Details |
| nominal_streaming-0.9.9-cp310-abi3-macosx_11_0_arm64.whl | CPython 3.10 | abi3 | macOS 11.0+ ARM64 | Details |
Total release size: 30.3 MB
Release files / nominal_streaming-0.9.9-cp310-abi3-win_amd64.whl
| Download URL | nominal_streaming-0.9.9-cp310-abi3-win_amd64.whl |
|---|---|
| Size | 4.1 MB |
| Tags | CPython 3.10 Windows x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
76b26dbb8fe6c10f73bc14a4f15a5296173768cde6ef97c5841852c5e34b59e5
|
|
BLAKE2b-256 checksum How to use checksums |
812c898c8ed4fde26c623792d971b08e94aa965563283e2775a6c98ed0a4e34e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.24
|
Release files / nominal_streaming-0.9.9-cp310-abi3-musllinux_1_2_x86_64.whl
| Download URL | nominal_streaming-0.9.9-cp310-abi3-musllinux_1_2_x86_64.whl |
|---|---|
| Size | 4.1 MB |
| Tags | CPython 3.10 Linux musl 1.2+ x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
539d0b9db8fdd790a28e217918dce0f8537d915ee32ddb3d02b24daaaccb3827
|
|
BLAKE2b-256 checksum How to use checksums |
f6747e4641fbbcd20b6e3c882979074c43c817200bc495068fc41518ee65f14f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.24
|
Release files / nominal_streaming-0.9.9-cp310-abi3-musllinux_1_2_armv7l.whl
| Download URL | nominal_streaming-0.9.9-cp310-abi3-musllinux_1_2_armv7l.whl |
|---|---|
| Size | 3.6 MB |
| Tags | CPython 3.10 Linux musl 1.2+ ARMv7l abi3 |
|
SHA-256 checksum How to use checksums |
482596a5880c80bf14f0f565ea4cc826e9a2170cd002dc39ad0436ee26b239ac
|
|
BLAKE2b-256 checksum How to use checksums |
34651e8f8ca7ec813bb962d2656728c2ad35893feb72fab89786a675f99ab402
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.24
|
Release files / nominal_streaming-0.9.9-cp310-abi3-musllinux_1_2_aarch64.whl
| Download URL | nominal_streaming-0.9.9-cp310-abi3-musllinux_1_2_aarch64.whl |
|---|---|
| Size | 3.8 MB |
| Tags | CPython 3.10 Linux musl 1.2+ ARM64 abi3 |
|
SHA-256 checksum How to use checksums |
5d897e2d1cda98b9ddd75c41fbaf1c548251bc38af2c06a7ba2a94786a366d93
|
|
BLAKE2b-256 checksum How to use checksums |
126e0a461b26aaa59140b710c8533afd675e2c7ef2048ca15a969b93a427058f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.24
|
Release files / nominal_streaming-0.9.9-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | nominal_streaming-0.9.9-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 3.9 MB |
| Tags | CPython 3.10 Linux glibc 2.17+ x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
d8ba2350a21a223ca5e71530254ccd97772bd7c84f8873cabd3cbebf8694b081
|
|
BLAKE2b-256 checksum How to use checksums |
6d74066868cf73e1bb80ff906e47fddaabaab6db252e2603fefb50b1ea1339e6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.24
|
Release files / nominal_streaming-0.9.9-cp310-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
| Download URL | nominal_streaming-0.9.9-cp310-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whl |
|---|---|
| Size | 3.4 MB |
| Tags | CPython 3.10 Linux glibc 2.17+ ARMv7l abi3 |
|
SHA-256 checksum How to use checksums |
ef656e0faacd71ea00a3a9eed7aadc816efb9c345b67b989f51e65331f78f368
|
|
BLAKE2b-256 checksum How to use checksums |
80944f592f109bc47c7d2f73f7b2a9e69b8d99c8f9c4c5aeaadf4dd06199e94d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.24
|
Release files / nominal_streaming-0.9.9-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Download URL | nominal_streaming-0.9.9-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl |
|---|---|
| Size | 3.7 MB |
| Tags | CPython 3.10 Linux glibc 2.17+ ARM64 abi3 |
|
SHA-256 checksum How to use checksums |
67aa03ca0e2f35bc802aa758564637c3c8c1468461fbb56e384e95d018fa9340
|
|
BLAKE2b-256 checksum How to use checksums |
49147046cb69c6899d91403daebb5bf7db290b59ea82ea0df851a3f5e0131ffd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.24
|
Release files / nominal_streaming-0.9.9-cp310-abi3-macosx_11_0_arm64.whl
| Download URL | nominal_streaming-0.9.9-cp310-abi3-macosx_11_0_arm64.whl |
|---|---|
| Size | 3.7 MB |
| Tags | CPython 3.10 abi3 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
31bc140b44009f6ddd9e06655f5b7a2f361c87a7a0cfbd418094f8e06627f8d2
|
|
BLAKE2b-256 checksum How to use checksums |
a31f88a37c8f38d135fd18e52636e946a81e59d018417ce7cf364b204dc78680
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.24
|
