Skip to main content

Flowco a new mixed-initiative system leveraging visual dataflow programming and LLMs to support authoring reliable and robust data analyses.

Project description

Flowco

by Emery Berger, Stephen Freund, Eunice Jun, Brooke Simon (ordered alphabetically)

Flowco PyPI Latest Release

Flowco is a system for authoring data analysis workflows with LLM assistance at every stage of the process. Flowco employs a dataflow programming model that serves as a foundation for reliable LLM-centric programming.

Watch Flowco in Action!

Demo Video Tutorial Video Exploratoration Multiverse Analysis Logistic Regression
finch-3 mortgage-wide logistic-full

For technical details, see our arXiv paper, Flowco: Rethinking Data Analysis in the Age of LLMs.

Web Service

You can try Flowco on the web here.

[!NOTE] This web service is intended for demonstration and experimentation only. It should scale to a modest number of users, but if it is slow or unresponsive, please try again later or install locally.

Local Installation

Configuration

  • Use a conda virtual environment or some other virtual environment.
  • Use Python 3.11+.
  • Ensure dot is on your path.

OpenAI API Key

[!IMPORTANT]

Flowco needs to be connected to an OpenAI account. Your account will need to have a positive balance for this to work (check your balance). Get a key here.

Once you have an API key, set it as an environment variable called OPENAI_API_KEY.

export OPENAI_API_KEY=<your-api-key>

Installing

From Pypi [Recommended]

With pip:

pip3 install flowco
From Source

Or clone the repo and install as an editable package.

pip3 install -e .

This installs a bunch of normal packages, a custom component for Streamlit, and then Flowco as an editable package that you can run locally (rather than as the web service).

Running

On the command line, run flowco, passing it the directory in which to store its files. That directory should already exist:

mkdir /tmp/example
flowco /tmp/example

The first time you run, it may take 15-20 seconds to bring up the web page. It should launch more quickly after that. Flowco will intially open a welcome.flowco graph. Follow the instructions in the right-hand panel to get started. Then proceed through the numbered tutorials to experiment with additional features.

Use -v to turn on logging.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

flowco-0.73.0.tar.gz (32.0 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

flowco-0.73.0-py3-none-any.whl (13.6 MB view details)

Uploaded Python 3

File details

Details for the file flowco-0.73.0.tar.gz.

File metadata

  • Download URL: flowco-0.73.0.tar.gz
  • Upload date:
  • Size: 32.0 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for flowco-0.73.0.tar.gz
Algorithm Hash digest
SHA256 334c9a885af116358bf843908c2b6f38b98ef23b19e7a0e920fc0fd279da8a24
MD5 2ebb2495e623d598ff50bd2aa80dde9e
BLAKE2b-256 9eb719a1932f0293b00fd86d3ec98f9455ff104b1cc31f7ed3ed8fdb44e76e93

See more details on using hashes here.

File details

Details for the file flowco-0.73.0-py3-none-any.whl.

File metadata

  • Download URL: flowco-0.73.0-py3-none-any.whl
  • Upload date:
  • Size: 13.6 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for flowco-0.73.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a8c59531537895abf0f62aa692c62b1b7a2d20878ebaca32adacd99a4ad44652
MD5 0461b5c6056aef721f763de1987a5564
BLAKE2b-256 d66fb1658eff93aa4f268c364f8085c2c9c7d1c356d3ad2744b3e233e0ba02c4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page