how automated healthcare fails, how you'd know, and what to do at each tier — every claim sourced, reviewed continuously
In a controlled experiment, 27 radiologists' accuracy on mammograms fell sharply when a purported AI suggested an incorrect BI-RADS category.
Dratsch and colleagues had 27 radiologists read 50 mammograms with a purported AI suggesting a BI-RADS category; in 12 of 40 test cases the suggestion was deliberately wrong. Correct ratings fell from 79.7% to 19.8% for inexperienced readers, 81.3% to 24.8% for moderately experienced readers, and 82.3% to 45.5% for very experienced readers when the suggestion was incorrect. Inexperienced readers were most likely to follow incorrect higher-category suggestions. This is an experiment, not a clinical event, and is listed as the clearest measurement of automation bias in a clinical task.[1]
None (experimental setting).
All incidents · Human handoff · Models & agents
Information only, not advice. FailSystems is an aggregation and synthesis of published sources. It is not consulting, engineering, legal, regulatory or medical advice, and using it creates no professional relationship. Health systems are complex and no approach fits every organisation: anything you adopt is your own decision, at your own risk, and should be checked against the current official sources and by qualified people who know your setting. Full disclaimer.