The Programmable Neuro-Symbolic AGI
Project description
HybridAGI: for people who want AI to behave as expected
The Programmable Cypher-based Neuro-Symbolic AGI
Your All-In-One framework for interactive knowledge intensive LLM applications
Disclaimer: We are currently refactoring the project for better modularity and better ease of use. For now, only the Local integration if available, the FalkorDB & Kuzu integration will be done at the end of this refactoring. At that time we will accept contributions for the integration of other Cypher-based graph databases. For more information, join the Discord channel.
Notebooks
- Datatypes
- GraphPrograms
- Interpreter Prompting
- Simulating User
- Vector Only RAG
- Knowledge Graph RAG
- Episodic RAG
- Extracting Knowledge Graphs
- Dynamic Graph Program
- Using External Tools
- Add Documents (on the fly)
- Add Facts (on the fly)
What is HybridAGI?
HybridAGI is the first programmable LLM-based Agent that enables you to define its behavior using a graph-based prompt programming approach. Unlike other frameworks that view agents as advanced chatbots, we have adopted a methodology that is rooted in computer science, cognitive sciences, and symbolic AI.
To us, an agent system is an goal-directed cognitive software that can process natural language and execute the tasks it has been programmed to perform. Just like with traditional software, the developer specifies the behavior of the application, and the system is not truly autonomous unless it has been programmed to be so. Programming the system not only helps the agent to carry out its tasks but also allows for the formalization of the developer's intent.
HybridAGI is designed for data scientists, prompt engineers, researchers, and AI enthusiasts who love to experiment with AI. It is a "Build Yourself" product that focuses on human creativity rather than AI autonomy.
Why HybridAGI?
We are not satisfied with the current trajectory of Agent-based systems that lack control and efficiency. Today's approach is to build React/MKRL agents that do what they want without any human control, resulting in infinite loops of nonsense because they tend to stay in their data distribution. Multi-agent systems try to solve that, but instead result in more nonsense and prohibitive costs due to the agents chitchatting with each other. Moreover, today's agents require fine-tuning to enhance/correct the behavior of the agent system. In contrast, with HybridAGI, the only thing you need to do is to modify the behavior graph (the graph programs).
We advocate that fine-tuning should be done only as a last resort when in-context learning fails to give you the expected result. Any person who has already fine-tuned a LLM knows that gathering data is hard, but having the right variability in your dataset is even harder, thus prohibiting most companies from leveraging this technology if they don't have many AI scientists. By rooting cognitive sciences into computer science concepts, without obfuscating them, we empower programmers to build the Agent system of their dreams by controlling the sequence of action and decision.
Our goal is to build an agent system that solves real-world problems by using an intermediary language interpretable by both humans and machines. If we want to keep humans in the loop in the coming years, we need to design Agent systems for that purpose.
Install
pip install hybridagi
Graphs for planning and knowledge management, no finetuning required.
No React Agents here, the only agent system that we provide is our custom Graph Interpreter Agent that follow a strict methodology by executing node by node the graph programs it have in memory. Because we control the behavior of the Agent from end-to-end by offloading planning to symbolic components, we can correct/enhance the behavior of the system easely, removing the needs for finetuning but also allowing the system to learn on the fly.
HybridAGI is build upon years of experience in making reliable Robotics systems. We have combined our knowledge in Robotics, Symbolic AI, LLMs and Cognitive Sciences into a product for programmers, data-scientists and AI engineers. The long-term memory of our Agent system heavily use graphs to store structured and unstructured knowledge as well as its graph programs.
We provide everything for you to build your LLM application with a focus around Cypher Graph databases. We provide also a local database for rapid prototyping before scaling your application with one of our integration.
Predictable/Deterministic behavior and infinite number of tools
Because we don't let the Agent choose the sequence of tools to use, we can use an infinite number of tools. By following the Graph Programs, we ensure a predictable and deterministic methodology for our Agent system. We can combine every memory system into one unique Agent by using the corresponding tools without limitation.
import hybridagi.core.graph_program as gp
main = gp.GraphProgram(
name="main",
description="The main program",
)
main.add(gp.Decision(
id="is_objective_unclear",
purpose="Check if the Objective's is unclear",
question="Is the Objective's question unclear?",
))
main.add(gp.Action(
id="clarify",
purpose="Ask one question to clarify the user's Objective",
tool="AskUser",
prompt="Please pick one question to clarify the Objective's question",
))
main.add(gp.Action(
id="answer",
purpose="Answer the question",
tool="Speak",
prompt="Please answer to the Objective's question",
))
main.add(gp.Action(
id="refine_objective",
purpose="Refine the objective",
tool="UpdateObjective",
prompt="Please refine the user Objective",
))
main.connect("start", "is_objective_unclear")
main.connect("is_objective_unclear", "clarify", label="Clarify")
main.connect("is_objective_unclear", "answer", label="Answer")
main.connect("clarify", "refine_objective")
main.connect("refine_objective", "answer")
main.connect("answer", "end")
main.build() # Verify the structure of the program
print(main)
# // @desc: The main program
# CREATE
# // Nodes declaration
# (start:Control {id: "start"}),
# (end:Control {id: "end"}),
# (is_objective_unclear:Decision {
# id: "is_objective_unclear",
# purpose: "Check if the Objective's is unclear",
# question: "Is the Objective's question unclear?"
# }),
# (clarify:Action {
# id: "clarify",
# purpose: "Ask one question to clarify the user's Objective",
# tool: "AskUser",
# prompt: "Please pick one question to clarify the Objective's question"
# }),
# (answer:Action {
# id: "answer",
# purpose: "Answer the question",
# tool: "Speak",
# prompt: "Please answer to the Objective's question"
# }),
# (refine_objective:Action {
# id: "refine_objective",
# purpose: "Refine the objective",
# tool: "UpdateObjective",
# prompt: "Please refine the user Objective"
# }),
# // Structure declaration
# (start)-[:NEXT]->(is_objective_unclear),
# (is_objective_unclear)-[:CLARIFY]->(clarify),
# (is_objective_unclear)-[:ANSWER]->(answer),
# (clarify)-[:NEXT]->(refine_objective),
# (answer)-[:NEXT]->(end),
# (refine_objective)-[:NEXT]->(answer)
Modular Pipelines
With HybridAGI you can build data extraction pipelines, RAG applications or advanced Agent systems, each being possibly optimized by using DSPy optimizers. We also provide pre-made modules and metrics for easy prototyping.
Each module and data type is strictly typed and use Pydantic as data validation layer. You can build pipelines in no time by stacking Modules sequentially like in Keras or HuggingFace.
from hybridagi.embeddings import SentenceTransformerEmbeddings
from hybridagi.readers import PDFReader
from hybridagi.core.pipeline import Pipeline
from hybridagi.modules.splitters import DocumentSentenceSplitter
from hybridagi.modules.embedders import DocumentEmbedder
embeddings = SentenceTransformerEmbeddings(
model_name_or_path = "all-MiniLM-L6-v2",
dim = 384, # The dimention of the embeddings vector
)
reader = PDFReader()
input_docs = reader("data/SpelkeKinzlerCoreKnowledge.pdf") # This is going to extract 1 document per page
# Now that we have our input documents, we can start to make our data processing pipeline
pipeline = Pipeline()
pipeline.add("chunk_documents", DocumentSentenceSplitter())
pipeline.add("embed_chunks", DocumentEmbedder(embeddings=embeddings))
output_docs = pipeline(input_docs)
Native tools
We provide the following list of native tools to R/W into the memory system or modify the state of the agent:
Tool Name | Usage |
---|---|
Predict |
Used to populate the context with reasoning information |
ChainOfThought |
Used to populate the context with reasoning information |
Speak |
Used to send message to the User and give the final answer |
AskUser |
Used to ask question to the User (can simulate the user persona) |
UpdateObjective |
Update the long-term Objective of the Agent |
AddDocument |
Save into memory a new document |
AddFacts |
Save into memory new facts |
DocumentSearch |
Used to search for information into the document memory |
PastActionSearch |
Used to search for past actions into the trace memory |
EntitySearch |
Used to search for entities into the fact memory |
FactSearch |
Used to search for facts into the fact memory |
QueryFacts |
Used to query facts from the fact memory |
GraphProgramSearch |
Used to search for graph programs into the program memory |
ReadGraphProgram |
Used to read a graph program from memory by name |
CallGraphProgram |
Used to dynamically call a graph program from memory by name |
Adding more tools
You can add more tools by using the FunctionTool
and python functions like nowadays function calling.
import requests
from hybridagi.modules.agents.tools import FunctionTool
# The function inputs should be one or multiple strings, you can then convert or process them in your function
# The docstring and input arguments will be used to create automatically a DSPy signature
def get_crypto_price(crypto_name: str):
"""
Please only give the name of the crypto to fetch like "bitcoin" or "cardano"
Never explain or apology, only give the crypto name.
"""
base_url = "https://api.coingecko.com/api/v3/simple/price?"
complete_url = base_url + "ids=" + crypto_name + "&vs_currencies=usd"
response = requests.get(complete_url)
data = response.json()
# The output of the tool should always be a dict
# It usually contains the sanitized input of the tool + the tool result (or observation)
if crypto_name in data:
return {"crypto_name": crypto_name, "result": str(data[crypto_name]["usd"])+" USD"}
else:
return {"crypto_name": crypto_name, "result": "Invalid crypto name"}
my_tool = FunctionTool(
name = "GetCryptoPrice",
func = get_crypto_price,
)
Graph Databases Integrations
- Local Graph Memory for rapid prototyping based on NetworkX
- FalkorDB low latency in-memory hybrid vector/graph database (coming soon)
- Kuzu A highly scalable, extremely fast, easy-to-use embeddable graph database (coming soon)
LLM Agent as Graph VS LLM Agent as Graph Interpreter
What makes our approach different from Agent as Graph is the fact that our Agent system is not a process represented by a graph, but an interpreter that can read/write and execute a graph data (the graph programs) structure separated from that process. Making possible for the Agent to learn by executing, reading and modifying the graph programs (like any other data), in its essence HybridAGI is intended to be a self-programming system centered around the Cypher language. It is a production-ready research project centered around neuro-symbolic programming, program synthesis and symbolic AI.
Differences with LangGraph/LangChain or Llama-Index
We focus on explainable and robust systems, we don't support ReACT Agents that lack control and efficiency. The Agent system we provide, is custom made. We also provide everything to scale your application into production by offering optimizable pipelines, agents and graph databases integrations. Our system is a memory-centric agent with a special care to the long-term memory. Moreover our codebase is readable, clean and elegant we didn't over-engineer our system to obfuscate it to sell other services.
Differences with DSPy
Unlike DSPy, our programs are not static but dynamic and can adapt to the user query by dynamically calling programs stored into memory. Moreover we focus our work on explainable neuro-symbolic AGI systems using Graphs. The graph programs are easier to build than implementing them from scratch using DSPy. If DSPy is the PyTorch of LLM applications, think of HybridAGI as the Keras or HuggingFace of neuro-symbolic LLM applications.
Get Involved
Become a part of our community of developers, researchers, and AI enthusiasts. Contribute to the project, share your feedback, and help shape the future of HybridAGI. We welcome and value your participation!
Contributors
Who we are?
We're not based in Silicon Valley or part of a big company; we're a small, dedicated team from the south of France. Our focus is on delivering an AI product where the user maintains control. We're dissatisfied with the current trajectory of Agent-based products. We are expert in human-robot interactions and building interactive systems that behave as expected. While we draw inspiration from cognitive sciences and symbolic AI, we aim to keep our concepts grounded in computer science for a wider audience.
Our mission extends beyond AI safety and performance; it's about shaping the world we want to live in. Even if programming becomes obsolete in 5 or 10 years, replaced by some magical prompt, we believe that traditional prompts are insufficient for preserving jobs. They're too simplistic and fail to accurately convey intentions.
In contrast, programming each reasoning step demands expert knowledge in prompt engineering and programming. Surprisingly, it's enjoyable and not that difficult for programmers, you'll gain insight into how AI truly operates by controlling it, being able to enhance the sequence of action and decision. Natural language combined with algorithms opens up endless possibilities. We can't envision a world without it.
Commercial Usage
Our software is released under GNU GPL license to protect ourselves and the contributions of the community. The logic of your application being separated (the graph programs) there is no IP problems for you to use HybridAGI. Moreover when used in production, you surely want to make a FastAPI server to request your agent and separate the backend and frontend of your app (like a website), so the GPL license doesn't contaminate the other pieces of your software.
Star History
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for hybridagi-0.2.432-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a941e7f1e41af79c7572984659ae0f4d62fe3eadd238a7ab81b4dc401d21f428 |
|
MD5 | 1b47bbb8906171c00c07f900b9287a21 |
|
BLAKE2b-256 | 5d2caea13367136eea1d9b871a27d1070cdfc9f22a2bfdf184c97b6f6ea46f44 |