Pipelex is an open-source dev tool based on a simple declarative language that lets you define replicable, structured, composable LLM pipelines.
Project description
Lean-code language for repeatable workflows
Pipelex is based on a simple declarative language that lets you define repeatable, structured, composable AI workflows.
📜 The Knowledge Pipeline Manifesto
Read why we built Pipelex to transform unreliable AI workflows into deterministic pipelines 🔗
🚀 See Pipelex in Action
📑 Table of Contents
Introduction
Pipelex makes it easy for developers to define and run repeatable AI workflows. At its core is a clear, declarative pipeline language specifically crafted for knowledge-processing tasks.
Build pipelines from modular pipes that snap together. Each pipe can use a different language model (LLM) or software to process knowledge. Pipes consistently deliver structured, predictable outputs at each stage.
Pipelex uses TOML syntax, making workflows readable and shareable. Business professionals, developers, and AI coding agents can all understand and modify the same pipeline definitions.
Example:
[concept]
Buyer = "The person who made the purchase"
PurchaseDocumentText = "Transcript of a receipt, invoice, or order confirmation"
[pipe.extract_buyer]
PipeLLM = "Extract buyer from purchase document"
inputs = { purchase_document_text = "PurchaseDocumentText" }
output = "Buyer"
llm = "llm_to_extract_info"
prompt_template = """
Extract the first and last name of the buyer from this purchase document:
@purchase_document_text
"""
Pipes are modular building blocks that connect sequentially, run in parallel, or call sub-pipes. Like function calls in traditional programming, but with a clear contract: knowledge-in, knowledge-out. This modularity makes pipelines perfect for sharing: fork someone's invoice processor, adapt it for receipts, share it back.
Pipelex is an open-source Python library with a hosted API launching soon. It integrates seamlessly into existing systems and automation frameworks. Plus, it works as an MCP server so AI agents can use pipelines as tools.
🚀 Quick start
:books: Note that you can check out the Pipelex Documentation for more information and clone the Pipelex Cookbook repository for ready-to-run samples.
Follow these steps to get started:
Installation
Prerequisites
Install the package
# Using pip
pip install pipelex
# Using Poetry
poetry add pipelex
# Using uv (Recommended)
uv pip install pipelex
IDE extension
We highly recommend installing an extension for TOML files into your IDE of choice. For VS Code, the Even Better TOML extension does a great job of syntax coloring and checking.
Optional Features
The package supports the following additional features:
anthropic: Anthropic/Claude supportgoogle: Google models (Vertex) supportmistralai: Mistral AI supportbedrock: AWS Bedrock supportfal: Image generation with Black Forest Labs "FAL" service
Install all extras:
Using pip:
pip install "pipelex[anthropic,google,mistralai,bedrock,fal]"
Using poetry:
poetry add "pipelex[anthropic,google,mistralai,bedrock,fal]"
Using uv:
uv pip install "pipelex[anthropic,google,mistralai,bedrock,fal]"
🤝 Contributing
We welcome contributions! Please see our Contributing Guidelines for details on how to get started, including development setup and testing information.
👥 Join the Community
Join our vibrant Discord community to connect with other developers, share your experiences, and get help with your Pipelex projects!
💬 Support
- GitHub Issues: For bug reports and feature requests
- Discussions: For questions and community discussions
- Documentation
⭐ Star Us!
If you find Pipelex helpful, please consider giving us a star! It helps us reach more developers and continue improving the tool.
📝 License
This project is licensed under the MIT license. Runtime dependencies are distributed under their own licenses via PyPI.
"Pipelex" is a trademark of Evotis S.A.S.
© 2025 Evotis S.A.S.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file pipelex-0.3.2.tar.gz.
File metadata
- Download URL: pipelex-0.3.2.tar.gz
- Upload date:
- Size: 166.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.12.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d3e3403a0261cc289c5ff21b8cdc7ea8b9348f42fdfccdbf801a2f850380a844
|
|
| MD5 |
c1da2d6297550fadd0f1da1a686eb5c0
|
|
| BLAKE2b-256 |
2be0da1ce4f2fe6bda2e5c983db87a23cecc4bd4f4c12248b2bfee5a34f7c54d
|
Provenance
The following attestation bundles were made for pipelex-0.3.2.tar.gz:
Publisher:
publish-pypi.yml on Pipelex/pipelex
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
pipelex-0.3.2.tar.gz -
Subject digest:
d3e3403a0261cc289c5ff21b8cdc7ea8b9348f42fdfccdbf801a2f850380a844 - Sigstore transparency entry: 237024911
- Sigstore integration time:
-
Permalink:
Pipelex/pipelex@9ca4e6b18aad67af1a2053806f4add03c2f44dd0 -
Branch / Tag:
refs/heads/main - Owner: https://github.com/Pipelex
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-pypi.yml@9ca4e6b18aad67af1a2053806f4add03c2f44dd0 -
Trigger Event:
push
-
Statement type:
File details
Details for the file pipelex-0.3.2-py3-none-any.whl.
File metadata
- Download URL: pipelex-0.3.2-py3-none-any.whl
- Upload date:
- Size: 278.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.12.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1b2e4c78ff45610f762185c1766995328b4a20fc33b656aecdf30ab7b439df9d
|
|
| MD5 |
c43d69d8c4ead4f3f41e688e2b35e3db
|
|
| BLAKE2b-256 |
731a2ad52039b3d40051d263fe915a9026d84a16e2d9c1c5319e2b704d53cf1a
|
Provenance
The following attestation bundles were made for pipelex-0.3.2-py3-none-any.whl:
Publisher:
publish-pypi.yml on Pipelex/pipelex
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
pipelex-0.3.2-py3-none-any.whl -
Subject digest:
1b2e4c78ff45610f762185c1766995328b4a20fc33b656aecdf30ab7b439df9d - Sigstore transparency entry: 237024916
- Sigstore integration time:
-
Permalink:
Pipelex/pipelex@9ca4e6b18aad67af1a2053806f4add03c2f44dd0 -
Branch / Tag:
refs/heads/main - Owner: https://github.com/Pipelex
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-pypi.yml@9ca4e6b18aad67af1a2053806f4add03c2f44dd0 -
Trigger Event:
push
-
Statement type: