Telryn
Find complaints your AI and human support teams missed. Telryn helps a complaints lead at a lender or payments company check which closed conversations passed QA while a required complaint was still missing from the register at its deadline. It reads the team’s score export, asks reviewers for an independent policy grade, then checks dated register entries and owner actions.
On 6 October, a customer told a payments agent, “Please open a complaint about this duplicate charge.” In Telryn’s synthetic rehearsal the scorecard passed the conversation and classified it as no complaint. The firm’s registration deadline was 7 October at 17:00 UTC. On 12 October the case manager accepted the work at 11:00. Registration and completion followed at noon. A second case shows a different failure: the scorecard recognized the complaint, passed the conversation, and the deadline still went by. Open the first weekly audit
Try the two-week audit
Use pipx on Linux or macOS with CPython 3.12–3.15 and SQLite. The base package uses the Python standard library. Choose a new output directory.
pipx install telryn
telryn demo --qa-passes --out runs/qa-passes
Open the first report.html, find C102 in the scorecard results and follow its link to the dated evidence. In week two, open C204. Each week has one signed private report and one blinded grading packet. The command prints a verification command for its private trust store inside the output directory. In bank/report.html, a bank reviewer can see the scope, denominators, unresolved evidence and what owners did. PyPI · Sample bank statement · Rehearsal records
Use your own scorecard
- Freeze one queue and one scorecard version. Supply the closed conversations, original revisions, score times and QA decisions as of a declared cutoff. A complaint prediction and the overall pass/fail decision are separate fields. Choose whether the scored population includes cases ordinary human QA already reviewed. Unscored conversations appear in the coverage count.
- Blind the reviewers. Reviewers receive case references and the firm’s policy question. The lead can request a second review and adjudicate disputes. Telryn estimates how often the vendor’s complaint classification disagreed with the human grade. For QA passes it separately estimates how often a required registration missed its deadline. Each measure has its own denominator and uncertainty range. CSV and weekly plan · Sampling method
- Check what happened. Attach the dated register and work ledger. The lead can follow a case from the customer’s words to the deadline, acceptance, registration and completion. Incomplete sources and ambiguous matches stay visible. The bank can replay a disputed finding against its private copy and original exports using the digest supplied through an authenticated channel. Complaint evidence · Bank handoff
In the desk, a lead can import Zendesk QA, MaestroQA or AI QA scores, attach the case records, review the policy and download the bank statement. Start it with telryn desk --out runs/desk. IT can put it behind the firm’s SSO proxy with separate lead and reviewer roles. Score formats · Hosted desk
Schedule telryn weekly /path/to/week.toml --out /path/to/new-run. The weekly job can run offline. IT can deploy the signed Linux container on amd64 and arm64, including through Docker Desktop on Windows. Weekly operating guide · Container deployment · Security review pack and SBOMs
Give risk teams evidence they can verify
A bank can keep signed weekly reports across quarters, check whether the same population and clocks still apply, and verify the series against an earlier checkpoint. An agent vendor can issue an attestation with a passing release test, quarterly calibration, a bank statement and the customer’s control IDs. The recipient verifies it with an approved issuer key. Signed history · Vendor attestation
- Deadline data. Download the versioned rules, schemas and dated calendars separately. Reports show the calendar used and flag approaching expiry. Signed data package
- Peer benchmarks. An independent operator can collect opt-in signed aggregates and return a configuration’s frozen peer result to qualifying contributors. Collector guide
- Data and agent evals. Capture a read-only warehouse snapshot, or run Telryn’s cited rubric and deadline checks from Braintrust or Langfuse. Warehouse snapshots · Scorer adapters
What the examples establish
The first scored week contains seven QA passes. Three missed their registration deadlines, three had determinate answers without a miss, and one remained unresolved. The supported count is three to four of seven. All cases are synthetic.
A separate two-week rehearsal compares Telryn with an analyst’s saved SQL search at the same staff budget. Across all 1,350 possible draws, SQL matches or exceeds Telryn’s count of owner-accepted episodes 96% of the time. Run telryn demo --complaints --out runs/sql-comparison to see the selections and staff minutes. The field protocol asks whether a lead can bring a consequential case to action sooner or reach the same finding with less total effort, then repeat the work in week two. Customer savings and repeat demand remain unmeasured. Field comparison
A separate detection study tested 320 authored chats using local cited extraction and a frozen keyword search. Across all cases, recall was 90.0% for extraction and 47.5% for SQL. Precision was 72.4% and 77.6%, respectively. At the same modeled review budget, extraction found 89 complaints and SQL found 85. The interval for the four-case difference ran from −5 to +15. Study, labels and intervals
Other outcomes and agent checks
- Requested accommodations. Run
telryn outcome --example accommodationto trace a large-print statement from the customer’s request to the provider’s delivery receipt. It was registered on time, dispatched before the agreed deadline and delivered late. A team can supply the same records for an individual case. Evidence format - Disclosed support needs. Run
telryn outcome --example vulnerabilityto compare register recognition across groups. Small cells are withheld. Cohort evidence - Vendor and board reporting. Generate a weekly calibration trend or quarterly committee pack from verified audits. An optional benchmark file stays local until the firm decides to share it. Oversight reports
- Agent releases. Run
telryn demo --agent-release --out runs/agent-check. Exercise an agent with synthetic complaints before rollout and check its test register independently. A missing, late or unverifiable entry keeps the release gate closed. Agent test and adapter contract - Screening and intake. Use structured signals, approved helpdesk exports or connectors. Optional Ollama, Azure OpenAI and Bedrock extraction requires a cited passage for each definite fact. Integrations · Model setup
Run telryn qualify for the bundled checks. Architecture · Policy packs · Contributing · Apache-2.0
Metadata
Release files for telryn 0.12.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| telryn-0.12.0.tar.gz | 423.4 kB | With provenance | Details for telryn-0.12.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| telryn-0.12.0-py3-none-any.whl | Python 3 | none | any | Details for telryn-0.12.0-py3-none-any.whl |
Total release size: 944.1 kB
Release files / telryn-0.12.0.tar.gz
| Download URL | telryn-0.12.0.tar.gz |
|---|---|
| Size | 423.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
74a5b481e0f4c3820058ede7e137dab1e62837656c52b5a40c2f1eafa5568b63
|
|
BLAKE2b-256 checksum How to use checksums |
eb3b39c331e1f081bd4cff457331e54bf53fad879ed4a3cfa02e04ea1fdddcca
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Nov 22, 2026.
Transparency logRelease files / telryn-0.12.0-py3-none-any.whl
| Download URL | telryn-0.12.0-py3-none-any.whl |
|---|---|
| Size | 520.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
bc8f213c763c310f5e94c13933899565f50f8270d333d3e7681a6126f844b8c1
|
|
BLAKE2b-256 checksum How to use checksums |
8dadb8b35b6ee7a55e4a99f59c8b3734e5a701d9293c78c30c93746984c96659
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Nov 22, 2026.
Transparency logSecurity for telryn 0.12.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
Full provenance
Both files in this release have been uploaded with provenance metadata.
Attestation for telryn-0.12.0.tar.gz
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Nov 22, 2026.
Transparency logA note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.