Skip to main content

FSQ — Fully Self Quality

Describe what to test. Let AI help to test the user flow.

Describe the goal and let AI operate the real app. FSQ records evidence and turns the exploration into a test you can review and replay.

An open-source project from FSQ Lab.

CI status Python 3.11 or newer MIT license Alpha status

Quick start · 中文 · Guide · Contribute

See FSQ in action

https://github.com/user-attachments/assets/aa9d0a12-2f93-4894-8349-52a013424939

Watch the full demo on YouTube.

How it works

  1. Describe: You define the platform and target, goal, success criteria, and allowed and forbidden actions.
  2. Observe as AI tests the real UI flow and FSQ captures screenshots, interface state, events, and may produce a reviewable test.
  3. Control what happens next: inspect the evidence and, if FSQ returns a test, inspect it unchanged before separately requesting any deterministic replay.

You get an evidence-backed result and, when FSQ returns one, a portable, reusable test you can review, keep, and replay without surrendering control.

Quick start

Start with the real outcome you want to test. You need Python 3.11+ and the prerequisites for your platform and target. Choose one of the two paths below. Enter Provider credentials only in the FSQ UI—not in Coding Agent chat. Review the result first and, if FSQ returns a Case, review it unchanged before separately requesting any replay.

1. Coding Agent

Initial setup. Open your project in a Coding Agent and paste:

The official FSQ project is https://github.com/FSQ-lab/FSQ. Establish the exact opened project root. Batch the read-only Python, fsq, and Skill-presence checks with their exact working directories, commands, purpose, and effects. Then request one approval for the listed changes, covering only installation or upgrade of fsq-agent and one fsq init --agent skill in this project; disclose the exact commands and Python-environment and project-file effects before asking. Perform only the approved operations, verify fsq, and report the exact installed Skill path. This one-time setup does not initialize a Workspace, configure a Provider, or run a test. Tell me to reload or start a new Coding Agent session, then stop.

Complete that reload before continuing.

First test. Copy this prompt into your Coding Agent:

Use FSQ to test this user goal: launch Microsoft Edge Stable, use Bing to search for FSQ GitHub, then inspect the organic search results and report the current position/ranking of the FSQ GitHub repository. Select the Web platform and Microsoft Edge Stable. Follow the installed FSQ Skill and ask only for decisions it cannot establish.

Treat the platform and exact target as facts or user-owned decisions: provide them when asked rather than letting the agent guess a target ID or path, and do not substitute a different Edge channel.

Review the result first. If FSQ returns a Case, review it unchanged before deciding whether to request replay separately.

2. FSQ UI

Initial setup.

python -m pip install --upgrade fsq-agent
fsq ui

In Settings, configure the FSQ LLM Provider and explicitly select a model.

First test.

  1. Create or select a Workspace, and configure its platform and target as needed.
  2. In Test Runner, select the exact target.
  3. Describe a verifiable result, review the test setup, and start the test. Review the result first and, if FSQ returns a Case, review it unchanged before separately requesting any replay.

FSQ Test Runner for describing a test goal

Detailed first-test guide

Platforms

FSQ supports Web, Android, Windows, and macOS targets; see platform prerequisites, and help broaden support through contributions.

Documentation

Built by FSQ Lab and the community

Built by FSQ Lab with thanks to all contributors. Want to help? Read CONTRIBUTING.md and join us.

License

MIT — Copyright (c) Microsoft Corporation.

Metadata

Release files for fsq-agent 0.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for fsq-agent 0.2.1
File Size Uploaded Provenance
fsq_agent-0.2.1.tar.gz 11.5 MB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for fsq-agent 0.2.1
File Interpreter ABI Platform
fsq_agent-0.2.1-py3-none-any.whl Python 3 none any Details

Total release size: 12.5 MB

Release files / fsq_agent-0.2.1.tar.gz

Download URL fsq_agent-0.2.1.tar.gz
Size 11.5 MB
Tags Source
SHA-256 checksum
How to use checksums
69b5ed7b96435414afcafe1e4275479b2a75956745fd0b2ec0a2abbacd7adc66
BLAKE2b-256 checksum
How to use checksums
e5e75765722ca94a309c3715739f481e399aed882eeb8f0739617630f9893a40
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.13.1 {"installer":{"name":"uv","version":"0.13.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / fsq_agent-0.2.1-py3-none-any.whl

Download URL fsq_agent-0.2.1-py3-none-any.whl
Size 959.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
65fb74dc1714d7e20b85c5459aa19ab5a0c69752f4c5df469a6265c8b48f95e2
BLAKE2b-256 checksum
How to use checksums
7a92544fce3817d9d8eca612a56232a14e05aebf7497d0efa2ced8fc985dc997
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.13.1 {"installer":{"name":"uv","version":"0.13.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Security for fsq-agent 0.2.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page