A Jupyter-based assistant for data analysis tasks
Project description
bia-bob
BIA bob
is a Jupyter-based assistant for interacting with data using large language models which generate python code.
It can make use of OpenAI's chatGPT API or Google's Vertex AI API and Gemini.
You need an OpenAI API account or a Google Cloud account to use it.
Usage
You can initialize bob
like this:
from bia_bob import bob
Code generation
You can ask Bob to generate code like this:
%bob Load blobs.tif and show it
It will then respond with a python code snippet that you can execute (see full example):
Bug fixing
Bob can fix simple bugs in code you executed. Just add %%fix
on top of the cell right after the error happened.
Code documentation
Using the %%doc
magic, you can generate documentation for a given code cell.
Example notebooks
- Basic demo
- Bio-image analysis workflow
- Choosing a model
- Using Gemini and chatGPT altenating
- Interpreting images
- Documenting code
- Fixing bugs
- Graphical user interfaces
- Exploring tabular data
Known issues
If you want to ask bob
a question, you need to put a space before the ?
.
%bob What do you know about blobs.tif ?
Installation
You can install bia-bob
using pip. it is recommended to install it into via conda/mamba environment. If you have never used conda before, please read this guide first.
It is recommended to install bia-bob
in a conda-environment together with useful tools for bio-image analysis.
mamba env create -f https://github.com/haesleinhuepf/bia-bob/raw/main/environment.yml
You can then activate this environment...
mamba activate bob_env
... and install bia-bob
.
Using OpenAI as backend
pip install bia-bob openai
(Recommended openai version >= 1.2.0)
Create an OpenAI API Key and add it to your environment variables as explained on this page.
Using Google's Vertex AI API as backend
pip install bia-bob google-cloud-aiplatform
(Recommended google-cloud-aiplatform version >= 1.38.1)
To make use of the Vertex AI API, you need to create a Google Cloud account here and
a project within the Google cloud (for billing) here.
You needs to store authentication details locally as explained here.
This requires installing Google Cloud CLI (Note: In December 2023 the Windows installer seems broken as reported here, Workaround: Install an older version (download link). Unzip, run install.bat
from within the folder, restart terminal run gcloud init
. Restart the terminal window.)
After installing Google Cloud CLI, start a terminal and authenticate using: gcloud auth application-default login
. Follow the instructions in the browser. Enter your Project ID (not the name). If it worked the terminal should approximately look like this:
Development
If you want to contribute to bia-bob
, you can install it in development mode like this:
git clone https://github.com/haesleinhuepf/bia-bob.git
cd bia-bob
pip install -e .
Similar projects
There are similar projects:
Issues
If you encounter any problems or want to provide feedback or suggestions, please create a thread on image.sc along with a detailed description and tag @haesleinhuepf .
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.