Python Hydra
Hydra is a Python implementation of various capabilities used for multi-proces sand multi-host distributed processing and logic. It is design to encompass more and more functionality over time, as new common use cases are identified.
Hydra Distributed Queues
Hydra distribute queues are queues that can be accessed across multiple hosts. There are two types of queues. First, a source queue, where a single host serves a queue that allows a client to populate a common queue on one host, and allow other processes and hosts to get (pull) from this common queue. Secondly, a sink queue, where a single host serves a queue that allows other remote clients to put (push) items into the common queue. These are essentially mirrors of each other.
Motivation
Hydra distributed queues were motivated for use in multi-host, distributed Python testing. A single queue is created and populated with tests to be executed. Remote clients then pull from this queue to get the next test. Only one test is served to one client -- the one that happens to request the next item in the queue.
Likewise, the remote clients can push results to a single sink-queue for the main process to read and collate test results in a single place.
This type of set up allows for very efficient execution. As each client completes one test, it simply pulls the next available test for execution with minimal delay. The queues are joinable queues and the source-queue is a task-based queue that allows signaling start and end of each test executed.
1 maintainer
Release files for py-hydra 1.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| py_hydra-1.1.0.tar.gz | 69.0 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| py_hydra-1.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 141.8 kB
Release files / py_hydra-1.1.0.tar.gz
| Download URL | py_hydra-1.1.0.tar.gz |
|---|---|
| Size | 69.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9d35ef4fe67dd990501c980fcfc01f8b80684619035293c52d691769144c1567
|
|
BLAKE2b-256 checksum How to use checksums |
0a9d0148cb96a5188bd9cf1431093552be8b4211c6c7579919167237c95ed08c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.3
|
Release files / py_hydra-1.1.0-py3-none-any.whl
| Download URL | py_hydra-1.1.0-py3-none-any.whl |
|---|---|
| Size | 72.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
559e25bf94ae2fdb477775d716dd53368c4f4def7637a27d0e3c21975673fdc5
|
|
BLAKE2b-256 checksum How to use checksums |
eea6195cf4f3c383f6a5ba4bf3d556e8c17ba954310f9a2a6f413859c8f85b72
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.3
|
