Skip to main content

Redis Streams IngestSource adapter for Astrocyte

Project description

astrocyte-ingestion-redis

Optional IngestSource implementation: Redis Streams consumer (XREADGROUP / XACK), wired from sources: with type: stream and driver: redis.

Install

pip install astrocyte-ingestion-redis

In this monorepo, astrocyte[stream] includes this package (see astrocyte-py/pyproject.toml; package lives under adapters-ingestion-py/).

The package registers redis under the astrocyte.ingest_stream_drivers entry-point group (same mechanism as storage adapters under astrocyte.vector_stores, etc.). Core resolves sources: with type: stream and driver: redis via that group.

Config sketch

sources:
  events:
    type: stream
    driver: redis
    url: "redis://localhost:6379/0"
    topic: "my-stream"
    consumer_group: "astrocyte"
    target_bank: "ingest"

Message field shapes match astrocyte.ingest.payload.parse_ingest_stream_fields (see core docs).

Develop

cd adapters-ingestion-py/astrocyte-ingestion-redis
uv sync --extra dev
uv run pytest

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

astrocyte_ingestion_redis-0.15.1.tar.gz (38.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

astrocyte_ingestion_redis-0.15.1-py3-none-any.whl (4.3 kB view details)

Uploaded Python 3

File details

Details for the file astrocyte_ingestion_redis-0.15.1.tar.gz.

File metadata

File hashes

Hashes for astrocyte_ingestion_redis-0.15.1.tar.gz
Algorithm Hash digest
SHA256 aa4bbe0e66f175a092e3cb07d5b28808b5a18fb8c1700cda46a7aff5672354cc
MD5 25c5c48eb14e5ae6c69b7054b546a689
BLAKE2b-256 8ca3800e4a918e1e4bb4cf4bd812b81e91655d73f028307e887fe6212e01228b

See more details on using hashes here.

File details

Details for the file astrocyte_ingestion_redis-0.15.1-py3-none-any.whl.

File metadata

File hashes

Hashes for astrocyte_ingestion_redis-0.15.1-py3-none-any.whl
Algorithm Hash digest
SHA256 d5ac76ab269011abf989eca30f6eff1b32ac9ea88d257a3bcfee2620b574a234
MD5 5c439475bd835659c98e383fe4228d99
BLAKE2b-256 b72227e56198ddd3beb42e22763ffb2cc5547fa0418a2ee143c6e46999aef55d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page