wurzel
wurzel is the german word for root. So with this framework we provide a combination of the best out of the whole domain of retrieval and beyond.
wurzel is an open-source Python library built to address advanced Extract, Transform, Load (ETL) needs for Retrieval-Augmented Generation (RAG) systems. It is designed to streamline ETL processes while offering essential features like multi-tenancy, cloud-native deployment support, and job scheduling.
The repository includes initial implementations for widely-used frameworks in the RAG ecosystem, such as Qdrant, Milvus, and Hugging Face, providing users with a strong starting point for building scalable and efficient RAG pipelines.
Features
- Advanced ETL Pipelines: Tailored for the specific needs of RAG systems.
- Multi-Tenancy: Easily manage multiple tenants or projects within a single system.
- Cloud-Native Deployment: Designed for seamless integration with Kubernetes, Docker, and other cloud platforms.
- Scheduling Capabilities: Schedule and manage ETL tasks using built-in or external tools.
- Framework Integrations: Pre-built support for popular tools like Qdrant, Milvus, and Hugging Face.
- Type Security: By leveraging capabilities of pydantic and pandera we ensure type security
Installation
To get started with wurzel, install the library using pip:
pip install wurzel
Run a Step (Two Ways)
1. CLI-based Execution
Run a step using the CLI:
wurzel run <step_file_path> --inputs ./data --output ./out
To inspect the step requirements:
wurzel inspect wurzel.<step_path>
2. Programmatic Execution (Python)
Run a step using the snippet below:
import os
from pathlib import Path
from wurzel.executors import BaseStepExecutor
from wurzel.steps.manual_markdown import ManualMarkdownStep
# Create input dir and set folder (required by ManualMarkdownStep)
input_dir = Path("./input")
input_dir.mkdir(exist_ok=True)
abs_input = input_dir.resolve()
os.environ["MANUALMARKDOWNSTEP__FOLDER_PATH"] = str(abs_input)
with BaseStepExecutor() as ex:
ex(ManualMarkdownStep, {abs_input}, Path("./output"))
Building your one step
For detailed instructions and examples on how to use wurzel, please refer to our official documentation.
Code of Conduct
This project has adopted the Contributor Covenant in version 2.1 as our code of conduct. Please see the details in our CODE_OF_CONDUCT.md. All contributors must abide by the code of conduct.
By participating in this project, you agree to abide by its Code of Conduct at all times.
Licensing
This project follows the REUSE standard for software licensing. Each file contains copyright and license information, and license texts can be found in the ./LICENSES folder. For more information visit https://reuse.software/. You can find a guide for developers at https://telekom.github.io/reuse-template/.
1 maintainer
Metadata
1 maintainer
Release files for wurzel 3.3.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| wurzel-3.3.0.tar.gz | 10.3 MB | With provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| wurzel-3.3.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 20.7 MB
Release files / wurzel-3.3.0.tar.gz
| Download URL | wurzel-3.3.0.tar.gz |
|---|---|
| Size | 10.3 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9553a640c1a9c941600e673c185d0f2ec64e9ca5254a4cc59262dfb5c9e0bd4c
|
|
BLAKE2b-256 checksum How to use checksums |
e2bed88b39e06003ad89ffc3b784ddddb3549c300a494f228d37723a1420286b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Aug 24, 2026.
Transparency logRelease files / wurzel-3.3.0-py3-none-any.whl
| Download URL | wurzel-3.3.0-py3-none-any.whl |
|---|---|
| Size | 10.4 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
b18aee0d4dbab4d1faa9004f60a41e384eeb035095de8994ccc3627d2c9085b3
|
|
BLAKE2b-256 checksum How to use checksums |
bff6fc86506ae9b5bda2b0abe7c8b3eed9272e8e5f9b98975dd19d6ef809a208
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Aug 24, 2026.
Transparency logSecurity for wurzel 3.3.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
Full provenance
All 2 files in this release have been uploaded with provenance metadata.
Attestation for wurzel-3.3.0.tar.gz
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Aug 24, 2026.
Transparency logA note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
