The Quiet Bugs Nobody Had Time to Catch
How SeekOut got consistent code review across 56 repos and 200 engineers
SeekOut builds AI-powered talent intelligence for the enterprise. Its recruiting platform, Recruit, searches over a billion candidate profiles for 750+ companies, including six of the ten most valuable companies in the US.
Behind it sits a 200-engineer team and 56+ actively reviewed repos, from the search and ranking engine to the ML pipelines and infrastructure. At that scale, human review stops keeping up. Coverage gets uneven, and the repos that get skimmed are the ones with the sharpest edges: auth, idempotency, infra config. SeekOut brought in Entelligence to review every PR, across every repo.
In 10 weeks
1,000+ PRs reviewed across all 56 repos
3,400+ review runs, 99% completed successfully
13,000+ inline comments left
3,500+ verified as real fixes, about 1 in 4 comments
7+ files and under 3 minutes per review
Fast enough to sit inside the normal PR loop, not bolt on as a separate gate.
What it caught
The findings clustered exactly where human review thins out.
Findings | |
|---|---|
Replay tokens in the clear. | Idempotency keys were being logged verbatim to telemetry, widening their exposure. Fixed by hashing before emit. |
A revoke lost to a race. | A concurrent revoke wasn't honored after a rate-limit update returned, letting a stale write overwrite the one that should have won. |
A null clear that didn't stick. | A legacy field was promoted over an explicit clear, silently reviving a value the caller meant to unset. |
A fallback that could never run. | A hardcoded flag left a documented fallback path as dead code. |
None of these look alarming in a diff. They only surface when something reads every change with the same attention.
The result
About 1 in 4 comments Entelligence left changed the code. Those fixes touched 600+ of the 1,000+ PRs reviewed, and the rate held steady across the repos that get careful review and the ones that usually get skimmed.
On a 200-engineer team where no human process covers 56 repos evenly, that consistency is the win. SeekOut didn't add a review team. It put a second reader on every PR that never skims the hard parts.