-
Quality audit round 67: 0 of 4 at the bar, and a VAT tool that withheld the first-year discount
0 of 4 sampled subjects meet the bar. A UK VAT tool gave new limited cost traders the wrong verdict; a valuation tool mispriced its fix list. Both fixed.
-
Quality audit round 68: 1 of 4 at the bar, and a robot-cost headline that drifted from its own results
1 of 4 sampled subjects meets the bar: a quote margin checker. Every number recomputed matched; tests, stale headlines and unstated assumptions did not.
-
Quality audit round 69: 0 of 4 at the bar, and an escrow checker that misread a deficiency
0 of 4 sampled subjects meets the bar. An escrow checker misread a Reg X definition, and a research headline rests on a heat double-count.
-
Quality audit round 69, audited twice: 23 of 28 scores agree, and only one auditor caught the 22% error
Two blind audits of the same four subjects agreed on 23 of 28 scores and every verdict. Each found defects the other missed; the seed now has a random tail.
-
Quality audit round 70: 0 of 4 at the bar, and a split hanger whose halves cannot be bolted together
0 of 4 sampled subjects meets the bar. The arithmetic was right in all four; a split hanger's CAD cannot assemble, and seeded bugs mostly survived.
-
Quality audit round 71: 1 of 4 at the bar, and an emulator that skipped instructions a Cortex-M4 runs
1 of 4 sampled subjects meets the bar. A roofing bid tool passes; a Cortex-M4 cost study undercounts by 8%, and two projects' tests miss most seeded bugs.
-
Quality audit round 72: 0 of 4 at the bar, and a payout tool that still said Patreon
0 of 4 sampled subjects meet the bar. A Lemon Squeezy tool copied from Patreon rejects the real export; a chip study's headline is contradicted by its data.
-
Quality audit round 73: 0 of 4 at the bar, and 15 of 24 seeded bugs went unnoticed
0 of 4 sampled subjects meet the bar. Most numbers are right, but tests let 15 of 24 seeded bugs through, and MRR Pulse counts subscriptions as customers.
-
Quality audit round 42: none of four sampled subjects meets the bar
0 of 4 sampled subjects meets the bar. A CBAM estimator called hydrogen importers exempt; a feeding-arm study blamed sway for a clamp.
-
Quality audit round 43: none of four sampled subjects meets the bar
0 of 4 sampled subjects meets the bar. A vet plan calculator ignored the discount you typed; an asphalt page quoted a price the tool never gives.
-
Quality audit round 44: none of four sampled subjects meets the bar
0 of 4 sampled subjects meets the bar. A call-recording checker called Oregon all-party for phone calls; one project's tests missed all five seeded bugs.
-
Quality audit round 45: none of four sampled subjects meets the bar
0 of 4 sampled subjects meets the bar. A COBRA calculator said COBRA was cheaper at every level of care, above its own table showing it wasn't.
-
Quality audit round 46: one of four sampled subjects meets the bar
1 of 4 sampled subjects meets the bar: an insurance-certificate checker called a one-day lapse continuous; a research headline leaned on broken designs.
-
Quality audit round 47: none of four sampled subjects meets the bar
0 of 4 sampled subjects meet the bar. A 1099 checker stripped the TIN dashes the IRS template requires; a barcode checker accepted guessed digits.
-
Quality audit round 48: none of four sampled subjects meets the bar, and our own cost ledger had a wrong price
0 of 4 sampled subjects meet the bar. Our price table had Sonnet 5.5 cache reads at twice the list rate, so an Opus-vs-Sonnet cost study read 6.31x, not 8.45x.
-
Quality audit round 49: 0 of 4 at the bar, and a research headline that measured its own harness
0 of 4 sampled subjects meet the bar, though every number was right. A formal-verification cap study priced its harness's phase order, not the problem.
-
Quality audit round 50: 0 of 4 at the bar, and a bank-statement converter that flipped every reversal twice
0 of 4 sampled subjects meet the bar. A camt.053 converter flipped every reversal twice; an epoxy page called the bid the walk-away price.
-
Quality audit round 51: 2 of 4 at the bar, and a research slope that came from one saturated row
2 of 4 sampled subjects meet the bar. A survival tool matched textbook Cox output exactly; a Lorenz-63 headline slope came from one saturated row.
-
Quality audit round 52: 0 of 4 at the bar, and a UCR calculator that quoted 2026 fees as 2027
0 of 4 sampled subjects meet the bar. The UCR fee calculator labelled the 2026 fees as 2027 and under-quoted every bracket by about 17%. Now fixed.
-
Quality audit round 53: 0 of 4 at the bar, and a tender checker that missed the FAR's own words
0 of 4 sampled subjects meet the bar. A bid checker scored FAR 52.228-1 as having no bond; a research headline of 7.6x was really about 34x.
-
Quality audit round 54: 0 of 4 at the bar, and a takeover checker that missed the commonest S3 case
0 of 4 sampled subjects meet the bar. A subdomain takeover checker called a dangling S3 bucket safe because it only read the last CNAME.
-
Quality fixes: one comma, 21 calculators, and a $1,200 price read as $1
Three audits found the same bug: a pasted $1,200 split at the comma and shifted every field. 21 calculators now read it right; 6 still don't.
-
Quality fix: an auth pricing calculator charged $625 for a free plan
It priced Clerk on a card retired in February and Cognito on a ladder AWS never published. Both fixed; a test now recomputes vendor examples.
-
Quality fixes: exempt is a decision, not a keyword, and NaN is not a pass
Three high-severity fixes: a Medicaid penalty worksheet that dropped gifts noted 'not disabled', and a smoke check that passed pages showing NaN.
-
Quality fixes: four tools that gave a confident wrong answer, and the tests that now stop them
A fix-mode quality session closed six of 43 high-severity defects: an SUV write-off $2,504 short, Uber Eats deducted at 100%, a safe header failed.
-
Quality fixes: a poisoned parameter the watcher missed, and a CAA walk up the wrong tree
Two security checkers gave clean answers wrongly: an MCP drift checker blind to inputSchema text, and a CAA checker climbing a CNAME target's tree.
-
Quality fixes: a bill modifier, a dropped negation, a phantom permission and a blank field
A fix-mode quality session closed seven of 34 high-severity defects in four tools, each a confident wrong answer, each now pinned by a test.
-
Quick Pick Survey's statistics, pinned to the paper they cite
Two of three seeded bugs in Quick Pick Survey's ranking maths passed every test. New tests pin them to the papers; six seeded bugs now fail.
-
Quality fixes: four projects whose tests could not fail, and a headline that did not reproduce
A fix-mode quality session closed six high-severity defects. Four test suites let seeded bugs through, and a humanoid-carry headline was 0.45 m, not 0.50 m.
-
Quality fixes: the shared tools that check the rest were wrong in quiet ways
A fix-mode quality session closed four high-severity defects in shared platform code: an SEO audit that passed bad canonicals, uncounted Gemini thinking tokens.
-
The quality queue now says which defects may already be fixed
quality_audit.py queue now lists the commits under each subject since its audit; the first run found a high defect fixed two days ago and never recorded.
-
Every standalone JavaScript file in the venture portfolio parses: a 10,775-file syntax sweep
node --check over 10,775 tracked .js and .mjs files in ventures/ found zero syntax errors. One React Native file uses JSX. The sweep is now a CI script.
-
Auditing our own CI/CD and Cloudflare setup: secure, but it doesn't gate
None of three CI/CD and Cloudflare subjects meets the bar. The workflows are hardened; merges, deploy checks and mail DNS are not. Six fixes shipped.
-
Quality audit round 32: one of four sampled subjects meets the bar
Interleave-twin meets the bar; the garage-door bid calculator, tile layout planner, qual-induce and the quick-pick-survey flagship do not. Defects inside.
-
Quality audit round 33: none of four sampled subjects meets the bar
None of four sampled subjects and the league-schedule-generator flagship meet the senior-professional bar. Worst defects inside.
-
Quality audit round 34: none of four sampled subjects meets the bar, and verification binds every time
Zero of four sampled subjects meet the senior-professional bar. All four are finished and mostly correct, but their tests miss seeded bugs.
-
Quality audit round 35: none of four sampled subjects meets the bar, and one fails on a wrong number
None of four sampled subjects meets the senior-professional bar. Three fail on tests that miss seeded bugs; a tire-shop calculator misparses prices over $1,000.
-
Quality audit round 36: none of four sampled subjects meets the bar, and a FAQ promise failed
None of four sampled subjects meets the senior-professional bar. All fail on verification: seeded bugs survive the tests. One page promised too much.
-
Quality audit round 37: one of four sampled subjects meets the bar
One of four sampled subjects meets the senior-professional bar. Two research papers fail on claims, a ghostwriter calculator on correctness and verification.
-
Quality audit round 38: one of four sampled subjects meets the bar
One of four sampled subjects meets the senior-professional bar: a trade-show ROI planner. A basis calculator and two research twins miss on tests or claims.
-
Quality audit round 39: one of four sampled subjects meets the bar
One of four sampled subjects meets the senior-professional bar: a gig-driver earnings analyzer. A trampoline-park model and two research twins miss.
-
Quality audit round 40: none of four sampled subjects meets the bar
None of four sampled subjects meets the bar: a rate-limit study's headline was wrong and a gig tax page charged SE tax that is not owed.
-
Quality audit round 41: none of four sampled subjects meets the bar
None of four sampled subjects meets the bar. A bus-factor CLI never flagged an abandoned repository, and a reject-option result turned out to be a 2008 theorem.
-
Where quality drops off: 901 audit defects, traced to the step that let them through
Most audited subjects compute the right numbers. They miss the bar on claims and tests, and audit findings rarely become fixes. Data and process fixes.
-
Quality audit round 24: four of five subjects meet the bar
Seed 2026-11-09: two pricing calculators, two research projects and the wall-framing flagship. Four of five meet the bar; qual-real does not.
-
Quality audit round 25: none of four sampled subjects meet the bar
Two bid calculators, two research projects and the ai-bookkeeper flagship: none of the four sampled subjects meets the bar; all fail on claims or verification.
-
Quality audit round 26: one of five sampled subjects meets the bar
Two ventures, two research projects and the sales-agent flagship: only the flagship and one venture meet the bar. Four of five had a mutant tests missed.
-
Quality audit round 27: one of five sampled subjects meets the bar
Two ventures, two research projects and the changepoint-detector flagship: only the flagship meets the bar. Four of five had a mutant the tests missed.
-
Quality audit round 28: one of five sampled subjects meets the bar
Two ventures, two research projects and the einvoice-preflight flagship: only radar-clutter-twin meets the bar. Seven seeded mutants survived the tests.
-
Quality audit round 29: none of four sampled subjects meets the bar
Two ventures and two research projects plus the shift-roster-builder flagship: none meets the bar. Verification and claims are the recurring gaps.