Skip to main content

ScienceFlow

CI PyPI arXiv paper Feedback Python 3.11–3.13

ScienceFlow turns an executable task with a measurable objective into persistent, evaluator-guided research. It coordinates parallel workers, promotes valid results into recoverable stages, preserves the best artifacts, and exposes the full process through a TUI and Web monitor.

News

  • [2026-09] Released the ScienceFlow harness preview for long-horizon scientific research agents, with TUI and Web interfaces.
  • [2026-08] Released ScienceFlow commit ad1f7dd and arXiv.

Quick start

Requirements: Python 3.11–3.13 and access to a supported model API.

Install

Create an isolated Conda environment, then install ScienceFlow from PyPI:

conda create -n scienceflow python=3.12 -y
conda activate scienceflow
python -m pip install scienceflow==0.2.0
scienceflow --help
Other installation methods

pipx

pipx install scienceflow==0.2.0

uv

uv tool install scienceflow==0.2.0

Python virtual environment

python3 -m venv .venv
source .venv/bin/activate
python -m pip install scienceflow==0.2.0

Configure and start

scienceflow config init
scienceflow config path     # edit the generated private model registry
scienceflow tui

Chat normally in the TUI, or enter /long-research to configure and launch a managed task. Closing the TUI detaches from research without terminating its workers.

Minimal TUI example

The built-in circle-packing example needs no dataset. After starting the TUI, complete these prompts in order:

1 · Prepare the task

/long-research circle-packing workers=2 cpu=16 gpu=cpu duration=1h

2 · Start after preflight passes

run

ScienceFlow runs preflight checks, starts two CPU workers, evaluates candidate solutions, and retains the best valid artifact under the workspace. Follow it with /tasks or /status 1.

Command Purpose
/long-research DESCRIPTIONPrepare and launch a research task.
/tasks, /status NList tasks or inspect results, model usage, and resources.
/stop N, /resume N, /attach NControl or follow a task.
/modelsSelect the fixed chat model.
/web, /web stopStart or stop the workspace Web monitor.

Choose a saved chat session with:

scienceflow tui --resume

See the runtime guide for workspace and execution details.

How it works

ScienceFlow system architecture

  1. Explore: isolated workers advance executable workspaces under explicit CPU, GPU, model, and time budgets.
  2. Evaluate: task evaluators convert artifacts into normalized evidence and final scores.
  3. Preserve: Stage Gate admits valid results as immutable, recoverable stages while the best artifact remains available independently of submission state.
  4. Adapt: ESTRA continues the current route or re-anchors work to a stronger archived stage at research boundaries.

Agent messages, reasoning, tool calls, evaluator results, resource samples, costs, and stage lineage are retained as structured events for inspection and future training workflows.

Task contract

You provide ScienceFlow manages
Objective, constraints, and metric directionResearch lifecycle and parallel workers
Executable task code and required dataIsolated workspaces and resource leases
Evaluator and valid artifact contractEvidence normalization and Stage admission
Baseline or starting implementationExploration, recovery, selection, and finalization

A registered task.yaml is the source of truth for measurement and valid artifacts. ScienceFlow does not invent a missing evaluator or silently replace required task data.

Models, resources, and task environments

Model settings stay local in ~/.config/scienceflow/models.json (mode 600); API keys are excluded from task manifests, sessions, and reports. See the redacted example.

The base package provides the control plane and TUI. Install task-specific ML/GPU dependencies only when needed:

python -m pip install "scienceflow[full]"==0.2.0

CPU and GPU allocations form task boundaries; CPU capacity is divided across workers. Model pricing is optional—without it, the UI reports Cost —. Do not resume a workspace with a different task, dataset, evaluator, prompt, or artifact contract.

Develop from source

git clone --branch master https://github.com/science-learner/ScienceFlow.git
cd ScienceFlow
uv sync --python 3.12 --group dev
uv run scienceflow config init
uv run scienceflow tui

Use uv sync --extra full --group dev only when tests require the full ML/GPU environment.

Research

ScienceFlow uses the same Stage Gate and evaluator contract across machine-learning engineering, scientific modeling, and mathematical optimization. In the reported 24-hour, 75-task MLE-bench evaluation, it reaches 70.22 ± 1.18% Any-Medal over three runs.

Representative full MLE-bench Any-Medal leaderboard

Citation

If ScienceFlow supports your research, please cite:

@misc{zhao2026scienceflow,
  title         = {{ScienceFlow}: A Long-Horizon Agent for {ML} Research, Scientific Discovery and Beyond},
  author        = {Mingming Zhao and Jiqian Dong and Kangping Xu and Zadid Hasan and Chengrui Fan and Shan Jiang and Shuai Mao and Yating Ling and Linyi Zou and Tailin Zhou and Yun Hin Chan and Wenkai Zhang and Zhanhong Zhou and Guowei Huang and Hongliang Li and Wenjing Cun and Zhitang Chen and Mingxuan Yuan and Yanhui Geng},
  year          = {2026},
  eprint        = {2608.14354},
  archivePrefix = {arXiv},
  primaryClass  = {cs.AI},
  doi           = {10.48550/arXiv.2608.14354},
  url           = {https://arxiv.org/abs/2608.14354}
}

Metadata

Release files for scienceflow 0.2.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for scienceflow 0.2.0
File Size Uploaded Provenance Actions
scienceflow-0.2.0.tar.gz 2.0 MB With provenance Details for scienceflow-0.2.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for scienceflow 0.2.0
File Interpreter ABI Platform Actions
scienceflow-0.2.0-py3-none-any.whl Python 3 none any Details for scienceflow-0.2.0-py3-none-any.whl

Total release size: 4.0 MB

Release files / scienceflow-0.2.0.tar.gz

Download URL scienceflow-0.2.0.tar.gz
Size 2.0 MB
Tags Source
SHA-256 checksum
How to use checksums
e83c4e2c0b3153d753a606e207da562a84916faf87a3775952d3338bf2199658
BLAKE2b-256 checksum
How to use checksums
702fd0d8164fc01ccf8e469da321ecf44af1cb04f072c0cac94cb10c1bd78943
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 23, 2026.

Transparency log

Release files / scienceflow-0.2.0-py3-none-any.whl

Download URL scienceflow-0.2.0-py3-none-any.whl
Size 2.0 MB
Tags Python 3
SHA-256 checksum
How to use checksums
300899897ae2beb40e1024d708316a4403c17b5318ed4742154818ed05598553
BLAKE2b-256 checksum
How to use checksums
084e68315f1c2bcffd6066b13678ea2f3d143aae3ae1ad10ebaad9b03ea160ee
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 23, 2026.

Transparency log

Security for scienceflow 0.2.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 2 files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for scienceflow-0.2.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 23, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page