Skip to main content

Redis Streams IngestSource adapter for Astrocyte

Project description

astrocyte-ingestion-redis

Optional IngestSource implementation: Redis Streams consumer (XREADGROUP / XACK), wired from sources: with type: stream and driver: redis.

Install

pip install astrocyte-ingestion-redis

In this monorepo, astrocyte[stream] includes this package (see astrocyte-py/pyproject.toml; package lives under adapters-ingestion-py/).

The package registers redis under the astrocyte.ingest_stream_drivers entry-point group (same mechanism as storage adapters under astrocyte.vector_stores, etc.). Core resolves sources: with type: stream and driver: redis via that group.

Config sketch

sources:
  events:
    type: stream
    driver: redis
    url: "redis://localhost:6379/0"
    topic: "my-stream"
    consumer_group: "astrocyte"
    target_bank: "ingest"

Message field shapes match astrocyte.ingest.payload.parse_ingest_stream_fields (see core docs).

Develop

cd adapters-ingestion-py/astrocyte-ingestion-redis
uv sync --extra dev
uv run pytest

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

astrocyte_ingestion_redis-0.7.5.tar.gz (13.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

astrocyte_ingestion_redis-0.7.5-py3-none-any.whl (4.2 kB view details)

Uploaded Python 3

File details

Details for the file astrocyte_ingestion_redis-0.7.5.tar.gz.

File metadata

File hashes

Hashes for astrocyte_ingestion_redis-0.7.5.tar.gz
Algorithm Hash digest
SHA256 f87b72f9e004f86a88fee3fb6f6886a90f7896dbbd5ab59fdbd9421d9fa3e9cf
MD5 c6f67e44bb798dd6ee4216d01521afe6
BLAKE2b-256 d34247de5e0d499799267ec90947c664f572cc7deec7f06567e315db916fe7c7

See more details on using hashes here.

File details

Details for the file astrocyte_ingestion_redis-0.7.5-py3-none-any.whl.

File metadata

File hashes

Hashes for astrocyte_ingestion_redis-0.7.5-py3-none-any.whl
Algorithm Hash digest
SHA256 c28e9183fb440e4f1fcc5044ba47a9807b4d6f058de003055e5a31a80187f795
MD5 01cbe414189b10775045622135043d36
BLAKE2b-256 11c73332a92925bed09fb422137058e5fa45828ce7d68b3821d83766be0905f0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page