Skip to main content

Build expert agents from documented domains

Project description

expert-agent-builder

Build expert agents from documented domains. Automates the knowledge pipeline: fetch docs, chunk large files, generate summaries, extract beliefs, derive deeper conclusions, review and repair, build FTS5 search indexes.

Install

uv tool install ftl-expert-build

Requires ftl-reasons and either claude or gemini CLI on PATH.

Quick Start

# Bootstrap a new expert agent
expert-build init rhcsa --domain "Red Hat Certified System Administrator"

# Fetch documentation
expert-build fetch-docs https://docs.redhat.com/en/documentation/red_hat_enterprise_linux/9/ --depth 2

# Generate entries from sources
expert-build summarize --parallel 4

# Extract beliefs for review
expert-build propose-beliefs --parallel 4
# Edit proposed-beliefs.md: LLM marks each as [ACCEPT] or [REJECT]
expert-build accept-beliefs

# Run the full pipeline end-to-end
expert-build pipeline --url https://docs.example.com --parallel 4

Commands

Command Description
init Bootstrap a new expert agent repo
fetch-docs Fetch documentation from URLs
chunk-pdf Split PDFs into section-based entries
chunk-docs Split large .md/.py/.txt files by structural boundaries
summarize Generate entries from source documents via LLM
propose-beliefs Extract candidate beliefs from entries via LLM
accept-beliefs Import accepted beliefs into reasons.db
cert-coverage Map certification objectives to beliefs
exam Run practice questions, discover knowledge gaps
pipeline Run end-to-end EEM construction (9 stages)
derive-review-repair Run derive/review/repair loop on existing beliefs
index-sources Build FTS5 chunks database for RAG search
status Show pipeline progress

Pipeline Stages

1. Ingest (fetch-docs / chunk-pdf)
2. Summarize (LLM summaries of source documents)
3. Extract (propose-beliefs + accept-beliefs)
4-7. Derive → Review → Repair → Deduplicate (convergence loop)
8. Export (network.json + README card)
9. Index (FTS5 search database)
# Full pipeline with parallel LLM calls and recursive source discovery
expert-build pipeline --url https://docs.example.com --parallel 4 --recursive

# Resume after a crash
expert-build pipeline --resume

# Run just the knowledge refinement loop
expert-build derive-review-repair --rounds 5

Working with Large Repos

# Summarize a repo with nested directories
expert-build summarize --input-dir ~/git/my-project --recursive --parallel 4

# Chunk large files before summarizing
expert-build chunk-docs --input-dir ~/git/my-project --recursive

# Build search index
expert-build index-sources --input-dir ~/git/my-project --recursive
expert-build index-sources --input-dir entries/ --recursive --type summary

# Query with reasons
reasons search-sources "kubernetes scheduling" --db rag_fts.db
reasons ask "How does pod scheduling work?" --full-sources rag_fts.db

Features

  • Parallel LLM calls--parallel N on summarize, propose-beliefs, and pipeline
  • Recursive file discovery--recursive for nested directory structures
  • Cost tracking — token counts and costs printed after every command
  • Crash resilience — incremental writes, pipeline state file with --resume
  • JSON pseudo-tool-calling — structured LLM output with retry for all parsing stages
  • Source provenance — every entry tracks its source file, URL, and document ID
  • FTS5 indexing — build search indexes compatible with reasons search-sources

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ftl_expert_build-0.3.0.tar.gz (910.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ftl_expert_build-0.3.0-py3-none-any.whl (42.8 kB view details)

Uploaded Python 3

File details

Details for the file ftl_expert_build-0.3.0.tar.gz.

File metadata

  • Download URL: ftl_expert_build-0.3.0.tar.gz
  • Upload date:
  • Size: 910.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.8.12

File hashes

Hashes for ftl_expert_build-0.3.0.tar.gz
Algorithm Hash digest
SHA256 d57b8612c35e0c621df824172123bae268cb3eca17602a0d5f8180bff73fa1de
MD5 fbacb2c005c44da010851274294db4c3
BLAKE2b-256 b1e88b4a4e493f7e546552e0cc19c944d3d5ed07d55b1d8112d85dcade58e007

See more details on using hashes here.

File details

Details for the file ftl_expert_build-0.3.0-py3-none-any.whl.

File metadata

File hashes

Hashes for ftl_expert_build-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 f9d0a568697adf7b1192fb1748041cbaec00390e0d65a950a2772e7895881195
MD5 8b89ca10315f27d266a6165b01a9bd0b
BLAKE2b-256 3343a365be0dc4fe299a7760d7a5d9226a1bdd5fe079f32caa9d2d5987830358

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page