John WilsonSessionwire

Triage

When something breaks in Sessionwire, Triage finds out why and shows the evidence. On 22 real past problems, it gave the right answer to 20.

I've led development at Sessionwire since 2017. I built Triage there in October 2026.

what it does

Finding why something broke meant checking six places by hand: error reports, logs, the database, call records, payments and the code. I had the order written down. Triage does that checking and comes back with a likely cause and the evidence for it.

It can look at everything and change nothing. Anything that changes the product still goes through me.

The detail: Triage is an MCP server, a set of 23 read-only tools that Claude Code can call.

  1. signalan error, a log line or a user report
  2. reasonClaude Code
  3. readTriage, 23 read-only tools across six sources
  4. reporta likely cause and the evidence
  5. actme, for anything that changes the product

how it was tested

I tested it on 22 real problems from the past where I already knew the answer: real bugs, false alarms, and old problems whose evidence is gone. Each investigation was recorded once, then replayed. The replays never touch live customer data.

Before trusting the score, I tested the test. An answer sheet that is always right scores 100%. Giving the same answer every time scores 33%. A second model grades each answer, so Triage never grades itself.

Right answer
20 of 22 real past problems. The 22 were 9 real bugs, 8 false alarms and 5 with no evidence left.
Cause found
8 of 9 real bugs, with the cause in the code named correctly.
Against guessing
90% with bugs, false alarms and no-evidence cases counted equally (balanced accuracy), against 33% for giving the same answer every time.
Cost
About 24 cents and 17 seconds a problem, at list price.
Detail
Run on 7 October 2026. Claude Opus 5.5 investigated, Claude Sonnet 5.5 graded. A 23rd recording could not be replayed, so it isn't counted.

when the test was wrong

In an earlier run on 6 problems, all 3 misses came from one problem. A page broke in an old version of Safari before the page's error tracking had loaded, so it left no trace.

The honest answer was “I can't tell”. Triage said that 3 times out of 3. My answer key expected the real cause, so it marked each one wrong.

I fixed the answer key, not Triage. “I can't tell” is sometimes the right answer, and a test should reward it.

what it found

In its first live investigation, Triage found a real payment bug that no customer had reported. I checked its evidence and confirmed it.

a part I removed

I also built a version for Sessionwire's admin page, so support staff could ask it directly. It ran on the server, where it could not read the code. I measured it: it scored the same as answering “I can't tell” every time. I deleted it, with the automation around it, about 11,000 lines. The version that reads the code is the one that works.

limits

I'm the only user so far. 22 problems is a small set, and each problem in this run ran once, so the numbers have wide margins. Triage runs when I ask. It does not yet start on its own when something breaks.

more

Sessionwire
The product, year by year.
Call rebuild
How Call rebuild changed Sessionwire's calls in July 2026.
Search
How Search finds people and music from a description.
Remote control
How Remote control lets you run someone else's computer in a Sessionwire call.