Arroyo

Arroyo is a library to build streaming applications that consume from and produce to Kafka.

Arroyo consists of three components:

  • Consumer and producer backends
    • The Kafka backend is a wrapper around the librdkafka client, and attempts to simplify rebalancing and offset management even further
    • There is also an in memory and a file based consumer and producer implementation that can be used for testing
  • A strategy interface
    • Arroyo includes a number of pre-built strategies such as RunTask, Filter, Reduce, CommitOffsets and more.
    • Users can write their own strategies, though in most cases this should not be needed as the library aims to provide generic, reusable strategies that cover most stream processing use cases
    • Strategies can be chained together to form complex message processing pipelines.
  • A streaming engine which manages the relationship between the consumer and strategies
    • The StreamProcessor controls progress by the consumer and schedules work for execution by the strategies.

All documentation is in the docs directory. It is hosted at https://getsentry.github.io/arroyo/ and can be built locally by running make docs

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (2.44.1)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for getsentry from gravatar.com getsentry

Credits

Author: Sentry

License

Apache Software License (Apache-2.0)

Classifiers

Report project as malware

Release files for sentry-arroyo 2.44.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for sentry-arroyo 2.44.0
File Size Uploaded
sentry_arroyo-2.44.0.tar.gz 99.9 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for sentry-arroyo 2.44.0
File Interpreter ABI Platform
sentry_arroyo-2.44.0-py3-none-any.whl 128.2 kB Python 3 none any Details

Total release size: 228.2 kB

Release files / sentry_arroyo-2.44.0.tar.gz

Download URL sentry_arroyo-2.44.0.tar.gz
Size 99.9 kB
Tags Source
SHA-256 checksum
How to use checksums 		7d1b1f6afd94d7a7138638e726a82e2a9247f1abc2f5c6cf307cc5474c8387f2
BLAKE2b-256 checksum
How to use checksums 		f071d27928a85f09ae2fbbc8ef3645a5448581be73854150324ef2456443efaf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/6.1.0 CPython/3.11.2

Release files / sentry_arroyo-2.44.0-py3-none-any.whl

Download URL sentry_arroyo-2.44.0-py3-none-any.whl
Size 128.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums 		cd2a5199626839a6c7d6f2c305398fbd3b686b2c31b6c1872f34aa6bc1ee75fe
BLAKE2b-256 checksum
How to use checksums 		d843fb335b89fd68cb11595011df2e3ad9b1f52e446d886969fd2d4c6ba3e09f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/6.1.0 CPython/3.11.2

Release history Release notifications | RSS feed

2.44.1

2 release files

This release

2.44.0 This release

2 release files

2.43.1

2 release files

2.43.0

2 release files

2.42.2

2 release files

2.42.1

2 release files

2.42.0

2 release files

2.41.4

2 release files

2.41.3

2 release files

2.41.2

2 release files

2.41.1

2 release files

2.41.0

2 release files

2.40.3

2 release files

2.40.1

2 release files

2.40.0

2 release files

2.39.2

2 release files

2.39.1

2 release files

2.39.0

2 release files

2.38.7

2 release files

2.38.6

2 release files

2.38.5

2 release files

2.38.4

2 release files

2.38.3

2 release files

2.38.2

2 release files

2.38.1

2 release files

2.38.0

2 release files

2.37.1

2 release files

2.37.0

2 release files

2.36.0

2 release files

2.35.0

2 release files

2.34.0

2 release files

2.33.1

2 release files

2.33.0

2 release files

2.32.5

2 release files

2.32.4

2 release files

2.32.3

2 release files

2.32.2

2 release files

2.32.1

2 release files

2.32.0

2 release files

2.31.2

2 release files

2.31.1

2 release files

2.31.0

2 release files

2.30.0

2 release files

2.29.7

2 release files

2.29.6

2 release files

2.29.5

2 release files

2.29.4

2 release files

2.29.3

2 release files

2.29.2

2 release files

2.29.1

2 release files

2.29.0

2 release files

2.28.4

2 release files

2.28.3

2 release files

2.28.2

2 release files

2.28.1

2 release files

2.28.0

2 release files

2.27.0

2 release files

2.26.0

2 release files

2.25.0

2 release files

2.24.0

2 release files

2.23.0

2 release files

2.22.0

2 release files

2.21.0

2 release files

2.20.10

2 release files

2.20.9

2 release files

2.20.8

2 release files

2.20.7

2 release files

2.20.6

2 release files

2.20.5

2 release files

2.20.4

2 release files

2.20.3

2 release files

2.20.2

2 release files

2.20.0

2 release files

2.19.12

2 release files

2.19.11

2 release files

2.19.10

2 release files

2.19.9

2 release files

2.19.8

2 release files

2.19.7

2 release files

2.19.6

2 release files

2.19.5

2 release files

2.19.4

2 release files

2.19.3

2 release files

2.19.2

2 release files

2.19.1

2 release files

2.19.0

2 release files

2.18.2

2 release files

2.18.1

2 release files

2.18.0

2 release files

2.17.6

2 release files

2.17.5

2 release files

2.17.4

2 release files

2.17.3

2 release files

2.17.2

2 release files

2.17.1

2 release files

2.17.0

2 release files

2.16.5

2 release files

2.16.4

2 release files

2.16.3

2 release files

2.16.2

2 release files

2.16.1

2 release files

2.16.0

2 release files

2.15.4

2 release files

2.15.3

2 release files

2.15.2

2 release files

2.15.1

2 release files

2.15.0

2 release files

2.14.25

2 release files

2.14.24

2 release files

2.14.23

2 release files

2.14.22

2 release files

2.14.21

2 release files

2.14.20

2 release files

2.14.19

2 release files

2.14.18

2 release files

2.14.17

2 release files

2.14.16

2 release files

2.14.15

2 release files

2.14.14

2 release files

2.14.13

2 release files

2.14.12

2 release files

2.14.11

2 release files

2.14.10

2 release files

2.14.9

2 release files

2.14.8

2 release files

2.14.7

2 release files

2.14.6

2 release files

2.14.5

2 release files

2.14.4

2 release files

2.14.3

2 release files

2.14.2

2 release files

2.14.1

2 release files

2.14.0

2 release files

2.13.0

2 release files

2.12.1

2 release files

2.12.0

2 release files

2.11.7

2 release files

2.11.6

2 release files

2.11.5

2 release files

2.11.4

2 release files

2.11.3

2 release files

2.11.2

2 release files

2.11.1

2 release files

2.11.0

2 release files

2.10.6

2 release files

2.10.5

2 release files

2.10.4

2 release files

2.10.3

2 release files

2.10.2

2 release files

2.10.1

2 release files

2.10.0

2 release files

2.9.1

2 release files

2.9.0

2 release files

2.8.0

2 release files

2.7.1

2 release files

2.7.0

2 release files

2.6.0

2 release files

2.5.3

2 release files

2.5.2

2 release files

2.5.1

2 release files

2.5.0

2 release files

2.4.0

2 release files

2.3.1

2 release files

2.3.0

2 release files

2.2.0

2 release files

2.1.0

2 release files

2.0.0

2 release files

1.2.0

2 release files

1.1.0

2 release files

1.0.7

2 release files

1.0.6

2 release files

1.0.5

2 release files

1.0.4

2 release files

1.0.3

2 release files

1.0.2

2 release files

1.0.1

2 release files

1.0.0

2 release files

0.2.2

2 release files

0.2.1

2 release files

0.2.0

2 release files

0.1.1

2 release files

0.1.0

2 release files

0.0.33

2 release files

0.0.21

2 release files

0.0.20

2 release files

0.0.19

2 release files

0.0.18

2 release files

0.0.17

2 release files

0.0.16

2 release files

0.0.15

2 release files

0.0.14

2 release files

0.0.13

2 release files

0.0.12

2 release files

0.0.11

2 release files

0.0.10

2 release files

0.0.9

2 release files

0.0.8

2 release files

0.0.7

2 release files

0.0.6

2 release files

0.0.5

2 release files

0.0.4

2 release files

0.0.3

2 release files

0.0.2

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page