galaxybrain 0.0.6

LLM extensions framework

GalaxyBrain

Turn LLMs into mighty shape rotators!

GalaxyBrain is a Python framework for AI workflows. Initially, we focus on supporting various large language models (LLMs) starting with GPT. The framework allows developers to define prompt completion steps, prompt rules, result validators, and more. The framework also enhances LLM workflows by providing memory capabilities, enabling easy handling of state between steps.

Please note that GalaxyBrain is an experimental project in early development. Its APIs and documentation are subject to change. For usage examples, check out the examples repository.

Goals

1. Reduce surprises when it comes to working with LLMs.
2. Focus on production AI use cases and CI/CD compatibility.
3. Avoid bloat and keep base primitives simple.

Getting Started

First, install the library:

pip install galaxybrain

Currently, GalaxyBrain only supports OpenAI APIs, so you'll need to get an API key and keep it on your path as OPENAI_API_KEY or pass it to the driver object manually. For example:

import os
from dotenv import load_dotenv
from galaxybrain.drivers import OpenAiCompletionDriver

load_dotenv()

driver = OpenAiCompletionDriver(os.environ.get('OPENAI_KEY'))

Working with GalaxyBrain

So...what can you do with GalaxyBrain?

📋 Define and Validate Prompt Rules

You can define rules that will be passed to the language model in the prompt stack:

chat_rules = [
    rules.json.return_valid_json(),
    rules.json.put_answer_in_field("Names"),
    rules.meta.be_truthful(),
    rules.meta.your_name_is("GalaxyGPT"),
    Rule("only use information from fantasy novels")
]
driver = OpenAiCompletionDriver(temperature=0.5, user="demo")
workflow = Workflow(rules=chat_rules, completion_driver=driver)

workflow.add_step(
    CompletionStep(input=Prompt("Give me ideas for two names from the same setting"))
)

workflow.start()

# {
#     "Names": ["Frodo Baggins", "Gandalf the Grey"]
# }

workflow.add_step(
    CompletionStep(input=Prompt("Give me 3 more from another setting"))
)

workflow.resume()

# {
#     "Names": ["Dumbledore", "Luna Lovegood", "Harry Potter"]
# }

Some rules have explicit validators (e.g., checking for valid JSON). You can use the built-in validator to run them:

validator = Validator(workflow.last_step().output, chat_rules)

if validator.validate():
    print("Rule validations passed")
else:
    print("Rule validations failed")
    print(validator.failed_rules())

⚙️ Delegate Compute Tasks to Python

Use ComputeStep to delegate compute tasks to Python:

ComputeStep(input=Prompt(f"generate two random 3x3 matrices and multiply them"))

This will generate the following code that GalaxyBrain executes locally and returns to the LLM in the follow-up prompt:

print(np.matmul(np.random.rand(3,3), np.random.rand(3,3)))

You can also ask more open-ended computational questions:

ComputeStep(input=Prompt(f"Sally is 5 feet tall, Jack is 14 inches taller than Sally. How tall is Jack?"))

💾 Memorize and Summarize Workflows

GalaxyBrain Workflow uses unbounded memory by default, but you can pass BufferMemory or SummaryMemory to it explicitly:

workflow = Workflow(
    completion_driver=OpenAiCompletionDriver(),
    memory=BufferMemory(buffer_size=1)
)

BufferMemory will keep a sliding window of steps that are used to construct a prompt. This works great for shorter conversations but falls short if the whole workflow context needs to be present. Use SummaryMemory to address that:

driver = OpenAiCompletionDriver()
workflow = Workflow(
    completion_driver=driver,
    memory=SummaryMemory(
        summarizer=CompletionDriverSummarizer(driver=driver),
        offset=3
    )
)

This will progressively summarize the whole conversation except for the latest three steps.

Contributing

Contributions in the form of bug reports, feature ideas, or pull requests are super welcome! Take a look at the current issues and if you'd like to help please submit a pull request with some tests.

License

GalaxyBrain is available under the Apache 2.0 License.