Arroyo

Arroyo is a library to build streaming applications that consume from and produce to Kafka.

Arroyo consists of three components:

  • Consumer and producer backends
    • The Kafka backend is a wrapper around the librdkafka client, and attempts to simplify rebalancing and offset management even further
    • There is also an in memory and a file based consumer and producer implementation that can be used for testing
  • A strategy interface
    • Arroyo includes a number of pre-built strategies such as RunTask, Filter, Reduce, CommitOffsets and more.
    • Users can write their own strategies, though in most cases this should not be needed as the library aims to provide generic, reusable strategies that cover most stream processing use cases
    • Strategies can be chained together to form complex message processing pipelines.
  • A streaming engine which manages the relationship between the consumer and strategies
    • The StreamProcessor controls progress by the consumer and schedules work for execution by the strategies.

All documentation is in the docs directory. It is hosted at https://getsentry.github.io/arroyo/ and can be built locally by running make docs

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for getsentry from gravatar.com getsentry

Credits

Author: Sentry

License

Apache Software License (Apache-2.0)

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sentry_arroyo-2.42.2.tar.gz (99.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sentry_arroyo-2.42.2-py3-none-any.whl (127.5 kB view details)

Uploaded Python 3

File details

Details for the file sentry_arroyo-2.42.2.tar.gz.

File metadata

  • Download URL: sentry_arroyo-2.42.2.tar.gz
  • Upload date:
  • Size: 99.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.2

File hashes

Hashes for sentry_arroyo-2.42.2.tar.gz
Algorithm Hash digest
SHA256 9c1f646ce11d2e1bc55c13d8d67880a7b2e460f98d0357494af09c3ced44c798
MD5 01cc2d022e827b8b14462a84fb2cefb5
BLAKE2b-256 863addfde59d14baf69b9db43e4267db0cc5bf65fea26544bfa50c1ea299b8dd

See more details on using hashes here.

File details

Details for the file sentry_arroyo-2.42.2-py3-none-any.whl.

File metadata

  • Download URL: sentry_arroyo-2.42.2-py3-none-any.whl
  • Upload date:
  • Size: 127.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.2

File hashes

Hashes for sentry_arroyo-2.42.2-py3-none-any.whl
Algorithm Hash digest
SHA256 ff6c3b52e372cab05e964c6e9b3d4a892b16a41a4cdfaa4c1735798214532e07
MD5 933e43a5ee0a4ca273197c7be26f4d9f
BLAKE2b-256 d761651f3fc9aa25a6a60f8c74f77407976e4106533a19de13750e32b1780b28

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

2.42.2

2.42.1

2.42.0

2.41.4

2.41.3

2.41.2

2.41.1

2.41.0

2.40.3

2.40.1

2.40.0

2.39.2

2.39.1

2.39.0

2.38.7

2.38.6

2.38.5

2.38.4

2.38.3

2.38.2

2.38.1

2.38.0

2.37.1

2.37.0

2.36.0

2.35.0

2.34.0

2.33.1

2.33.0

2.32.5

2.32.4

2.32.3

2.32.2

2.32.1

2.32.0

2.31.2

2.31.1

2.31.0

2.30.0

2.29.7

2.29.6

2.29.5

2.29.4

2.29.3

2.29.2

2.29.1

2.29.0

2.28.4

2.28.3

2.28.2

2.28.1

2.28.0

2.27.0

2.26.0

2.25.0

2.24.0

2.23.0

2.22.0

2.21.0

2.20.10

2.20.9

2.20.8

2.20.7

2.20.6

2.20.5

2.20.4

2.20.3

2.20.2

2.20.0

2.19.12

2.19.11

2.19.10

2.19.9

2.19.8

2.19.7

2.19.6

2.19.5

2.19.4

2.19.3

2.19.2

2.19.1

2.19.0

2.18.2

2.18.1

2.18.0

2.17.6

2.17.5

2.17.4

2.17.3

2.17.2

2.17.1

2.17.0

2.16.5

2.16.4

2.16.3

2.16.2

2.16.1

2.16.0

2.15.4

2.15.3

2.15.2

2.15.1

2.15.0

2.14.25

2.14.24

2.14.23

2.14.22

2.14.21

2.14.20

2.14.19

2.14.18

2.14.17

2.14.16

2.14.15

2.14.14

2.14.13

2.14.12

2.14.11

2.14.10

2.14.9

2.14.8

2.14.7

2.14.6

2.14.5

2.14.4

2.14.3

2.14.2

2.14.1

2.14.0

2.13.0

2.12.1

2.12.0

2.11.7

2.11.6

2.11.5

2.11.4

2.11.3

2.11.2

2.11.1

2.11.0

2.10.6

2.10.5

2.10.4

2.10.3

2.10.2

2.10.1

2.10.0

2.9.1

2.9.0

2.8.0

2.7.1

2.7.0

2.6.0

2.5.3

2.5.2

2.5.1

2.5.0

2.4.0

2.3.1

2.3.0

2.2.0

2.1.0

2.0.0

1.2.0

1.1.0

1.0.7

1.0.6

1.0.5

1.0.4

1.0.3

1.0.2

1.0.1

1.0.0

0.2.2

0.2.1

0.2.0

0.1.1

0.1.0

0.0.33

0.0.21

0.0.20

0.0.19

0.0.18

0.0.17

0.0.16

0.0.15

0.0.14

0.0.13

0.0.12

0.0.11

0.0.10

0.0.9

0.0.8

0.0.7

0.0.6

0.0.5

0.0.4

0.0.3

0.0.2

0.0.1

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page