Classifier Analytics

Should you trust a Firetrail flag? That's not a rhetorical question — it's a measurable one, and this page measures it. Classifier Analytics shows how each built-in classifier actually performs on your repository: what it flags, how often, and — the part that matters — whether the things it flagged went on to cause real bugs.

Each classifier's card

• Flag rate — the share of your PRs this check flags. Context, not a grade: a high rate might mean a real team habit (lots of genuinely mixed PRs) or a check that's noisy for your codebase. The rest of the card helps you tell which.
• Bugfix-origin implications — the trust number. Of the code this check flagged, how often was it later found to be the origin of a bugfix? A check whose flags keep showing up at bug origins has earned its opinion; one that flags plenty but never predicts anything deserves more skepticism.
• Risk distribution — how its findings spread across critical / high / medium / low / none. Shows whether it's an alarm that mostly murmurs or one that means it.
• Average confidence — how sure this check tends to be on your code.
• Top authors — who triggers it most. Coaching input, not a leaderboard: if one person accounts for most Multi-Intent flags, that's one friendly conversation about PR scoping, not a performance review.
• Example PRs — real PRs it flagged, clickable. The fastest way to decide whether you agree with a check is reading three of its calls on your own code.

One label to read correctly: checks that work in your favor — like Triviality, which subtracts score points for big-but-harmless changes — are badged as false-positive reducers. A high flag rate on one of those is good news, not noise.

What this page is for

Two things, really. First, calibrating trust: after a few weeks of data you'll know which checks are sharp on your codebase and which to read with a raised eyebrow. Second, seeing your team's habits in aggregate — the checks that fire constantly are your structural patterns, and the Engineering Health page turns those into a coaching agenda.