PR Quiz
Here's an uncomfortable modern truth: with AI writing more of every diff, it's entirely possible to ship code you never actually read. Careful engineers do it too — you review the generated change, it looks right, tests pass, merge. Three weeks later someone asks "why does this endpoint retry five times?" and you genuinely don't know, because you never made that decision — you just shipped it.
The PR Quiz is a quick self-check against exactly that. After analysis, Firetrail takes the PR's riskiest parts — the top drivers from its score breakdown — and turns them into 2–4 multiple-choice questions about what the change actually does. Answering them confirms you truly know what you're shipping, before reviewers or production find out for you.
It's a tool for sharpening your own understanding — not a test your manager grades. And it's not only for authors: any team member can take the quiz, which makes it a genuinely good way for a reviewer to check their own read of a diff before approving it.
How it works
Each question offers three readings of the diff — one true, two plausible but wrong. All three are written to sound reasonable, and nothing hints at which one Firetrail believes, so there's no pattern-matching your way through. You either know what the code does or you find out.
- Pick your answer and press Submit answer. Answers are final — right or wrong, your response is recorded and can't be changed. If you picked wrong, Firetrail shows what the diff actually does, side by side with what you thought. That moment — "wait, it does what?" — is the entire point of the feature, and it's a much cheaper place to have it than in an incident review.
- If none of the three options match your understanding, choose "None of these — I'll write my own" and describe the change in your own words. Written answers are graded gently and asymmetrically: they're only flagged when they clearly contradict what the diff does. Being brief is never held against you.
The record on GitHub
The PR's Firetrail comment carries a quiz status line:
- 📝 PR Quiz waiting — questions are ready, nobody has answered yet.
- ✅ PR Quiz taken — someone engaged with it, and how many questions they answered.
Over time this builds a lightweight, durable record of who engaged with each change's riskiest parts, and when. Teams that want to make that engagement a required step can bind a Merge Check to it.
Availability
The PR Quiz is included on Pro and Business plans. See Plans & billing.