Arroyo

Arroyo is a library to build streaming applications that consume from and produce to Kafka.

Arroyo consists of three components:

  • Consumer and producer backends
    • The Kafka backend is a wrapper around the librdkafka client, and attempts to simplify rebalancing and offset management even further
    • There is also an in memory and a file based consumer and producer implementation that can be used for testing
  • A strategy interface
    • Arroyo includes a number of pre-built strategies such as RunTask, Filter, Reduce, CommitOffsets and more.
    • Users can write their own strategies, though in most cases this should not be needed as the library aims to provide generic, reusable strategies that cover most stream processing use cases
    • Strategies can be chained together to form complex message processing pipelines.
  • A streaming engine which manages the relationship between the consumer and strategies
    • The StreamProcessor controls progress by the consumer and schedules work for execution by the strategies.

All documentation is in the docs directory. It is hosted at https://getsentry.github.io/arroyo/ and can be built locally by running make docs

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for getsentry from gravatar.com getsentry

Credits

Author: Sentry

License

Apache Software License (Apache-2.0)

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sentry_arroyo-2.43.1.tar.gz (99.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sentry_arroyo-2.43.1-py3-none-any.whl (127.6 kB view details)

Uploaded Python 3

File details

Details for the file sentry_arroyo-2.43.1.tar.gz.

File metadata

  • Download URL: sentry_arroyo-2.43.1.tar.gz
  • Upload date:
  • Size: 99.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.2

File hashes

Hashes for sentry_arroyo-2.43.1.tar.gz
Algorithm Hash digest
SHA256 f2de0c90b32c2008409949fb813deafe17f626780cd521ecd500f637f253d60a
MD5 3bfb8dee1abf927e56878911e80e6fe0
BLAKE2b-256 2fd61979c45583b35802c7479ab102ab68315847510bddf3a562b160fecfd04c

See more details on using hashes here.

File details

Details for the file sentry_arroyo-2.43.1-py3-none-any.whl.

File metadata

  • Download URL: sentry_arroyo-2.43.1-py3-none-any.whl
  • Upload date:
  • Size: 127.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.2

File hashes

Hashes for sentry_arroyo-2.43.1-py3-none-any.whl
Algorithm Hash digest
SHA256 6195bbdca5a2149e2af524821549305c51988f5c3c6e3d69237a62c431b5bda0
MD5 1332e69c46f21f41b3e20254bb912d60
BLAKE2b-256 bfa0561a9ee90070b08f28aca602f47f8899c129545bd5824795bac2a4ad33ec

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

2.43.1 This release

2 files

2.43.0

2 files

2.42.2

2 files

2.42.1

2 files

2.42.0

2 files

2.41.4

2 files

2.41.3

2 files

2.41.2

2 files

2.41.1

2 files

2.41.0

2 files

2.40.3

2 files

2.40.1

2 files

2.40.0

2 files

2.39.2

2 files

2.39.1

2 files

2.39.0

2 files

2.38.7

2 files

2.38.6

2 files

2.38.5

2 files

2.38.4

2 files

2.38.3

2 files

2.38.2

2 files

2.38.1

2 files

2.38.0

2 files

2.37.1

2 files

2.37.0

2 files

2.36.0

2 files

2.35.0

2 files

2.34.0

2 files

2.33.1

2 files

2.33.0

2 files

2.32.5

2 files

2.32.4

2 files

2.32.3

2 files

2.32.2

2 files

2.32.1

2 files

2.32.0

2 files

2.31.2

2 files

2.31.1

2 files

2.31.0

2 files

2.30.0

2 files

2.29.7

2 files

2.29.6

2 files

2.29.5

2 files

2.29.4

2 files

2.29.3

2 files

2.29.2

2 files

2.29.1

2 files

2.29.0

2 files

2.28.4

2 files

2.28.3

2 files

2.28.2

2 files

2.28.1

2 files

2.28.0

2 files

2.27.0

2 files

2.26.0

2 files

2.25.0

2 files

2.24.0

2 files

2.23.0

2 files

2.22.0

2 files

2.21.0

2 files

2.20.10

2 files

2.20.9

2 files

2.20.8

2 files

2.20.7

2 files

2.20.6

2 files

2.20.5

2 files

2.20.4

2 files

2.20.3

2 files

2.20.2

2 files

2.20.0

2 files

2.19.12

2 files

2.19.11

2 files

2.19.10

2 files

2.19.9

2 files

2.19.8

2 files

2.19.7

2 files

2.19.6

2 files

2.19.5

2 files

2.19.4

2 files

2.19.3

2 files

2.19.2

2 files

2.19.1

2 files

2.19.0

2 files

2.18.2

2 files

2.18.1

2 files

2.18.0

2 files

2.17.6

2 files

2.17.5

2 files

2.17.4

2 files

2.17.3

2 files

2.17.2

2 files

2.17.1

2 files

2.17.0

2 files

2.16.5

2 files

2.16.4

2 files

2.16.3

2 files

2.16.2

2 files

2.16.1

2 files

2.16.0

2 files

2.15.4

2 files

2.15.3

2 files

2.15.2

2 files

2.15.1

2 files

2.15.0

2 files

2.14.25

2 files

2.14.24

2 files

2.14.23

2 files

2.14.22

2 files

2.14.21

2 files

2.14.20

2 files

2.14.19

2 files

2.14.18

2 files

2.14.17

2 files

2.14.16

2 files

2.14.15

2 files

2.14.14

2 files

2.14.13

2 files

2.14.12

2 files

2.14.11

2 files

2.14.10

2 files

2.14.9

2 files

2.14.8

2 files

2.14.7

2 files

2.14.6

2 files

2.14.5

2 files

2.14.4

2 files

2.14.3

2 files

2.14.2

2 files

2.14.1

2 files

2.14.0

2 files

2.13.0

2 files

2.12.1

2 files

2.12.0

2 files

2.11.7

2 files

2.11.6

2 files

2.11.5

2 files

2.11.4

2 files

2.11.3

2 files

2.11.2

2 files

2.11.1

2 files

2.11.0

2 files

2.10.6

2 files

2.10.5

2 files

2.10.4

2 files

2.10.3

2 files

2.10.2

2 files

2.10.1

2 files

2.10.0

2 files

2.9.1

2 files

2.9.0

2 files

2.8.0

2 files

2.7.1

2 files

2.7.0

2 files

2.6.0

2 files

2.5.3

2 files

2.5.2

2 files

2.5.1

2 files

2.5.0

2 files

2.4.0

2 files

2.3.1

2 files

2.3.0

2 files

2.2.0

2 files

2.1.0

2 files

2.0.0

2 files

1.2.0

2 files

1.1.0

2 files

1.0.7

2 files

1.0.6

2 files

1.0.5

2 files

1.0.4

2 files

1.0.3

2 files

1.0.2

2 files

1.0.1

2 files

1.0.0

2 files

0.2.2

2 files

0.2.1

2 files

0.2.0

2 files

0.1.1

2 files

0.1.0

2 files

0.0.33

2 files

0.0.21

2 files

0.0.20

2 files

0.0.19

2 files

0.0.18

2 files

0.0.17

2 files

0.0.16

2 files

0.0.15

2 files

0.0.14

2 files

0.0.13

2 files

0.0.12

2 files

0.0.11

2 files

0.0.10

2 files

0.0.9

2 files

0.0.8

2 files

0.0.7

2 files

0.0.6

2 files

0.0.5

2 files

0.0.4

2 files

0.0.3

2 files

0.0.2

2 files

0.0.1

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page