Skip to main content

A frontend-agnostic core for the transcript correction workflow — the first downstream graph-extension core; composes the graph-storage capability worker into a headless pipeline that applies unified, non-destructive corrections (text, punctuation, segmentation) as a supersede-able overlay on a committed decomposition spine, recomputes the review worklist from deterministic signals, and exposes a CLI as its first driver.

Project description

cjm-transcript-correction-core

A frontend-agnostic core for the transcript correction workflow — the first downstream graph-extension core; composes the graph-storage capability worker into a headless pipeline that applies unified, non-destructive corrections (text, punctuation, segmentation) as a supersede-able overlay on a committed decomposition spine, recomputes the review worklist from deterministic signals, and exposes a CLI as its first driver.

Modules

  • cjm_transcript_correction_core.cli — The CLI driver — the correction core's first (and currently only) frontend. run corrects the committed spine in the decomp graph DB, pointing the graph worker at that shared DB via load-time config, with optional session resume/reopen; review runs the interactive text-correction loop (the cross-transcriber diff is intra-graph since stage 5).
  • cjm_transcript_correction_core.graph — The correction overlay's graph I/O: targeted (scale-shaped) reads of a committed spine via the graph-storage query action, construction of Correction / CorrectionSession nodes + CORRECTS / SUPERSEDES / DERIVED_FROM / REVIEWED edges, the in-core effective-spine projection (layer-0 + applied corrections), and commit through the job queue. Hand-rolled (revolution-1) = direct CR-18 spec material; append-only on layer-0 (never update/delete a Segment).
  • cjm_transcript_correction_core.models — Overlay data shapes for the transcript-correction workflow: the Correction / CorrectionSession graph nodes + their relation registry, the read view of a committed spine segment, the worklist item, run configuration, and the correction run manifest (proto-bundle that chains decomp -> correction).
  • cjm_transcript_correction_core.pipeline — The headless correction workflow: load a decomp run manifest, resolve the shared graph DB, start/resume/reopen a CorrectionSession, recompute the worklist from deterministic signals + persisted review state, run the D14 empty-segment prune (first operation), and record a chainable correction run manifest — with a cheapest-form HITL approval seam.
  • cjm_transcript_correction_core.signals — Pure deterministic Tier-1 signal functions (no capability calls): empty-segment detection, bidirectional boundary punctuation/capitalization heuristics, forced-alignment coverage flags, positional cross-transcriber diff, and phonetic + edit-distance variant clustering. The worklist is recomputed from these each session; revolution-1 builds ZERO new capabilities.
  • tests.test_graph — Tests for cjm_transcript_correction_core.graph — overlay construction + effective spine.
  • tests.test_models — Tests for cjm_transcript_correction_core.models — correction overlay data shapes.
  • tests.test_signals — Tests for cjm_transcript_correction_core.signals — pure deterministic Tier-1 signals.

API

cjm_transcript_correction_core.cli

  • build_parser function — Build the CLI parser (subcommands: run, review).
  • load_capabilities function — Discover manifests + load each capability, passing per-capability config (CR-2 caller-wins).
  • main function — CLI entry point (console script: cjm-transcript-correction-core).
  • review_command function — Execute the review subcommand: interactive text corrections over the flagged worklist.
  • run_command function — Execute the run subcommand: correct a decomp manifest's committed spine.

cjm_transcript_correction_core.graph

  • active_corrections function — Filter to the effective correction set (the layer's resolve_active over a read superseded set).
  • build_correction_node function — Construct a Correction overlay node (pure; commit happens separately).
  • build_prune_correction function — Build one batch grouping Correction that prunes empty segments (D14).
  • build_text_correction function — Build a text_content Correction + its CORRECTS (+ optional SUPERSEDES) edges.
  • commit_nodes_edges function — Commit overlay nodes/edges through the layer's idempotent extend_graph.
  • commit_text_correction function — Commit a text_content correction (node + CORRECTS [+ SUPERSEDES]) + a REVIEWED marker.
  • corrections_to_edits function — Map this core's Correction payloads onto the layer's spine-edit vocabulary.
  • count_source_segments function — Count a Source's segments server-side under its chosen rendition (typed count mode).
  • find_active_text_correction function — Single-segment convenience over the batch read (cross-session; latest wins).
  • find_active_text_corrections_batch function — Active text corrections for MANY segments in TWO round-trips (C17).
  • find_corrections_for_session function — List corrections recorded in a session (typed property filter).
  • find_prior_corrections_by_hash function — Cross-transcript correction-cache lookup (targeted; the graph IS the lexicon).
  • get_session function — Fetch a CorrectionSession node by id (resume/reopen) — typed get, dict shape preserved.
  • load_empty_segments function — Load ONLY a Source's empty-text segments under its chosen rendition (D14 prune).
  • load_review_markers function — Load a session's review markers (typed edge projection over REVIEWED edges).
  • load_source_corrections function — Load every Correction targeting a Source (across sessions) + the superseded-id set.
  • load_source_segments function — Load a Source's fine Segment spine under its chosen rendition (typed query surface).
  • load_variant_texts function — Resolve per-transcriber chunk texts from the segments' CharSlice refs.
  • project_effective_spine function — Project the effective spine = layer-0 + applied corrections.
  • record_review_markers function — Persist per-(session, segment) review markers as REVIEWED edges.
  • resolve_source_renditions function — Pick the AudioRendition set whose fine Segment spine correction operates on.
  • set_session_status function — Update a session's status + updated_at.
  • source_audio_segment_ids function — The Source's coarse spine (one small typed read; ordered by index).
  • start_session function — Create + commit a new CorrectionSession node.
  • submit_and_wait function — Submit one capability job, wait for it, return its result (raise on failure).

cjm_transcript_correction_core.models

  • Correction class — A single non-destructive correction over the committed spine (overlay node).
  • CorrectionConfig class — Configuration for one correction run.
  • CorrectionManifest class — Durable record of one correction run (proto-bundle; chainable, CR-20).
  • CorrectionRelations class — Registry of edge types the correction overlay adds to the spine graph.
  • CorrectionSession class — A resumable, reopen-able correction review over one or more sources.
  • SpineSegment class — A committed layer-0 Segment loaded from the graph (read view).
  • WorklistItem class — One spine segment surfaced for review, with its deterministic Tier-1 flags.
  • new_run_id function — Generate a unique, sortable correction run id.

cjm_transcript_correction_core.pipeline

  • collect_capability_info function — Record capability identity + data-DB pointers for the run manifest (provenance).
  • compute_worklist function — Recompute the worklist from layer-0 + signals + review state (only decisions persist).
  • confirm_seam function — HITL approval seam in its cheapest viable form (log + optional CLI prompt).
  • load_decomp_manifest function — Load + lightly validate a decomp-core run manifest (untyped JSON; CR-20 interchange).
  • prune_empty_segments function — First operation: prune empty (silence) segments as one grouping correction (D14).
  • resolve_graph_db_path function — Resolve the graph DB path: explicit override > the decomp manifest's recorded db_path.
  • review_worklist function — Interactive review loop -> text_content corrections (cheapest HITL seam).
  • run_correction function — Correct every source in a decomp run manifest (prune + worklist surfacing).
  • run_review function — Interactive review pass over a decomp manifest's flagged worklist (text corrections).

cjm_transcript_correction_core.signals

  • boundary_punct_caps_flags function — Bidirectional boundary punctuation/capitalization heuristics (in-segment only).
  • cluster_variants function — Cluster word variants by phonetic key + edit distance (fix-one-fix-all).
  • compute_signal_flags function — Combine all deterministic Tier-1 signals into per-segment flags.
  • detect_empty_segments function — Find empty-text segments (silence VAD chunks with no aligned words; decomp D14).
  • fa_coverage_flags function — Flag segments whose forced-alignment coverage looks suspect (Tier-1).
  • levenshtein function — Levenshtein edit distance (pure, in-core; variant-clustering primitive).
  • phonetic_key function — Compute a coarse phonetic key for a word (groups like-sounding variants).
  • variant_divergence function — Within-segment cross-transcriber divergence (stage 5: intra-graph).

tests.test_graph

  • test_build_prune_correction function
  • test_build_text_correction_and_active_filter function
  • test_latest_wins_ordering_from_layer function
  • test_project_effective_spine_prune_replace_supersede function

tests.test_models

  • test_correction_graph_node_mapping function
  • test_correction_relations_registry function
  • test_correction_session_node function
  • test_manifest_save_round_trip function
  • test_manifest_shape_and_run_id function
  • test_spine_segment_and_worklist_item function

tests.test_signals

  • test_boundary_punct_caps_flags function
  • test_clustering_primitives function
  • test_compute_signal_flags_combined function
  • test_empty_and_coverage_flags function
  • test_variant_divergence_within_segment function

Dependencies

Depends on: cjm-substrate Used by: cjm-transcript-correction-tui

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cjm_transcript_correction_core-0.0.1.tar.gz (40.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

cjm_transcript_correction_core-0.0.1-py3-none-any.whl (37.4 kB view details)

Uploaded Python 3

File details

Details for the file cjm_transcript_correction_core-0.0.1.tar.gz.

File metadata

File hashes

Hashes for cjm_transcript_correction_core-0.0.1.tar.gz
Algorithm Hash digest
SHA256 8b3c7e93d2c98df2c78dc3129d959794c20e97eae0f0756714d095b0b767eab1
MD5 a79cc028d016b99f6903ba990e3d2105
BLAKE2b-256 878886c99e9958b084e34039b3eeaad85bd6ae5bcfb0d18586273b36e746549b

See more details on using hashes here.

File details

Details for the file cjm_transcript_correction_core-0.0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for cjm_transcript_correction_core-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 67f07248f14adb53241b39cc4344d83c088e8966a749eb00a6417cfcdaa77fca
MD5 cd0fbcbfe5a7981082e509ab5c8821a7
BLAKE2b-256 9cc2a22d2da559cfa20cc3c347d2b972abcd053b3bce0c0f804876eef88fe7cb

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page