how automated healthcare fails, how you'd know, and what to do at each tier — every claim sourced, reviewed continuously
Ontario's Auditor General found every AI scribe on the province's approved vendor list had fabricated, wrong or missing content in procurement tests, including 12 of 20 recording the wrong drug.
TierThe automation stayed up and kept producing output that was wrong or went unchecked; there was no outage to fall back from. How tiers are assigned.
The Auditor General's May 2026 special report on AI in the Ontario government reviewed Supply Ontario's evaluation of AI Scribe systems, which vendors tested on two simulated doctor-patient conversations. All 20 approved vendors showed at least one type of inaccuracy. Nine of 20 fabricated information, including treatment-plan steps such as therapy referrals or blood tests that were never discussed, and statements like 'no masses found'. Twelve of 20 recorded a different drug than the one prescribed. Seventeen of 20 missed key mental-health details in at least one test. Global News reported that vendors were not required to demonstrate their systems live and that at least five were approved without submitting required risk and privacy impact assessments. The province said the tests were an evaluation stage, not operational use.[1,2]
None documented; findings are from procurement testing, not patient records.
All incidents · Models & agents · Human handoff
Information only, not advice. FailSystems is an aggregation and synthesis of published sources. It is not consulting, engineering, legal, regulatory or medical advice, and using it creates no professional relationship. Health systems are complex and no approach fits every organisation: anything you adopt is your own decision, at your own risk, and should be checked against the current official sources and by qualified people who know your setting. Full disclaimer.