Skip to main content

Reporter's notebooks: git-friendly research corpora maintained by humans and agents

Project description

flip

Format and tooling for reporter's notebooks — source-controlled research corpora created and maintained by any mix of humans and agents.

A flip notebook is an Open Knowledge Format (OKF v0.1) knowledge bundle at rest: a directory of markdown pages with YAML frontmatter, an index.md root, and a generated log.md. Any OKF consumer can browse one; any markdown editor can edit one. What flip adds is an extension profile for lineage — the discipline the LLM-wiki pattern (Karpathy's framing, OKF, LangChain's OpenWiki) deliberately leaves open: custody of the sources you rely on (local bytes, hashed at capture), explicit source grading, claims gated by a corroboration bar, work and LLM-session logs, and a timestamped history. A wiki tells an agent what we know; a notebook can prove where it came from.

Humans and agents work in the same files. Every source, claim, decision, question, and session is one page with a human-slug filename and its immutable id in frontmatter — open the notebook as an Obsidian vault and frontmatter is the properties panel, aliases make [[A3]]-style id links resolve, and relative links light up the graph view. Re-grading a source from the properties panel is a legitimate flip operation; flip doctor validates after the fact instead of gatekeeping before.

SPEC.md has the full format: directory layout, the manifest (root index.md frontmatter), source pages and capture provenance, claims and the verification bar, logs and sessions, the flip lineage profile (SPEC §6), profiles, the beat layer, the CLI, skills, and the integration contract.

Design commitments:

  • Plain files, no services. Markdown + YAML frontmatter for entities, append-only JSONL for events. Readable with less, diffable with git, browsable by any OKF consumer or markdown tool. Standards (BagIt, CSL, RO-Crate, Web Annotation) are generated exports, never the canonical format — except OKF, which the notebook natively is.
  • No proprietary dependencies. Capture tools, retrieval services, and render targets are all pluggable; a notebook is intelligible from its local files alone.
  • Custody first. Local archival copies with hashes at capture; processing is logged and re-runnable; LLM output is a lead, not evidence, until promoted through references/ and graded.
  • Graceful co-editing. One entity per file, metadata in frontmatter, prose in the body; tools preserve frontmatter keys they don't own, so human edits and agent edits round-trip through each other.

Install

uv tool install flip-notebook      # or: pipx install flip-notebook

From source: git clone https://github.com/lavallee/flip && cd flip && uv sync, then uv run flip --help. Python 3.12+; the core is stdlib + click + PyYAML.

Quickstart

flip new nj-schools --kind scout --title "NJ enrollment dip"
cd nj-schools
flip add-source ./districts.csv --note "district enrollment table"
# F1 · sources/raw/F1.csv · references/districts.md (grade ?)
flip grade F1 --grade A --independence original         # judge it after reading
flip claim add "Enrollment fell 4.2% since 2021" --source F1 --load-bearing
# C1 asserted · sources: F1 · corroboration: 1
flip claim status C1 verified      # gated: refused until the corroboration bar is met
flip decide --question "Which county first?" --decision "Start with Essex" --why "largest swing"
flip pass "2019 funding blog post" --reason "republishes state PR verbatim"
flip show                          # the hot view: open questions, claims needing work, recent log
flip doctor                        # lint: OKF conformance, profile minimums, verification bar

Filenames are human slugs (references/districts.md); the immutable id (F1) lives in frontmatter. flip open F1 resolves an id to its page; flip rename F1 district-enrollment-table renames the file and rewrites every link to it. flip migrate upgrades a pre-0.4 notebook in place.

URL and DOI capture route through fetchers you configure (e.g. SingleFile for web pages) — see docs/quickstart.md for the walkthrough, fetcher config, profiles, and the Obsidian setup.

For agents

Notebooks are built to be maintained by humans and agents together:

  • AGENTS.md — the five-minute tour, the lineage rules agents must honor (capture before cite, grade-C-until-promoted, the verification bar, the round-trip rule, flip doctor, FLIP_ACTOR), and task recipes.
  • llms.txt — doc map for LLM consumption.
  • src/flip/skills/ — procedural skills (notebook-create, notebook-source, notebook-log, notebook-audit, notebook-handoff, notebook-lessons) as plain SKILL.md files usable by any agent runtime. The skills also ship as a spindle package named flip.

For humans (Obsidian)

A notebook is already a valid Obsidian vault; flip obsidian finishes the job — it writes the vault link config to match flip's relative markdown links and installs the packaged companion plugin (doctor findings and the hot view in the sidebar, a status bar summary, open-by-id navigation, all driven by flip … --json). The walkthrough is docs/obsidian.md.

Status: spec draft v0.5 — notebooks are native OKF v0.1 bundles. The CLI covers the full surface (new, add-source, grade, log, decide, pass, question, claim, session, show, open, rename, doctor, index, migrate, export bag|csl|okf), plus beats — the standing layer above notebooks (flip beat new / thread add / graduate / show): a mission with weighted-triage threads that graduate into notebooks and keep cross-notebook coverage memory. flip migrate converts v0.3 notebooks in place. See docs/wiki-alignment.md for how flip relates to OKF and OpenWiki, and docs/okf-provenance-profile.md for flip's vocabulary as a draft OKF provenance profile. flip obsidian prepares a notebook as an Obsidian vault, with a packaged plugin surfacing doctor findings inline (docs/obsidian.md).

Contributions welcome — see CONTRIBUTING.md. Changes are tracked in CHANGELOG.md. MIT licensed.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

flip_notebook-0.6.0.tar.gz (183.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

flip_notebook-0.6.0-py3-none-any.whl (103.4 kB view details)

Uploaded Python 3

File details

Details for the file flip_notebook-0.6.0.tar.gz.

File metadata

  • Download URL: flip_notebook-0.6.0.tar.gz
  • Upload date:
  • Size: 183.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for flip_notebook-0.6.0.tar.gz
Algorithm Hash digest
SHA256 17736d3c168f94ae1ad43d72a1e9e38b54fbd35212586b4a62c68413a51a0b50
MD5 6ab7615074d3447a98d27043e5db888f
BLAKE2b-256 bad8f852c0657e3c6a547c5cf271c02b1fb3edd3a5210598bbad76d0da64e31f

See more details on using hashes here.

Provenance

The following attestation bundles were made for flip_notebook-0.6.0.tar.gz:

Publisher: publish.yml on lavallee/flip

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file flip_notebook-0.6.0-py3-none-any.whl.

File metadata

  • Download URL: flip_notebook-0.6.0-py3-none-any.whl
  • Upload date:
  • Size: 103.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for flip_notebook-0.6.0-py3-none-any.whl
Algorithm Hash digest
SHA256 dd16b3cdca65171a8e53ba13f214492630c450347becc912ddce6163aefccd36
MD5 eb62f93c13a63825624e9fee713cfe97
BLAKE2b-256 d3e2132f05515dc7e20c62fa1321fdc32da24fd7e844fc0c0b38fa5614e26b3b

See more details on using hashes here.

Provenance

The following attestation bundles were made for flip_notebook-0.6.0-py3-none-any.whl:

Publisher: publish.yml on lavallee/flip

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page