how automated healthcare fails, how you'd know, and what to do at each tier — every claim sourced, reviewed continuously
Non-clinical analogue. The human operator meant to back up an automated driving system was looking at her phone; the NTSB cited automation complacency.
NON-CLINICAL ANALOGUE. An Uber automated test vehicle travelling at 45 mph struck a pedestrian; the automated driving system detected her 5.6 seconds before impact. The NTSB (report HAR-19-03) found the probable cause was the operator's failure to monitor the driving environment and the automated system because she was visually distracted throughout the trip by her personal phone. Contributing factors included Uber's inadequate safety procedures, ineffective oversight of vehicle operators, and a lack of adequate mechanisms for addressing operators' automation complacency.[1]
Non-clinical: death of the pedestrian.
Information only, not advice. FailSystems is an aggregation and synthesis of published sources. It is not consulting, engineering, legal, regulatory or medical advice, and using it creates no professional relationship. Health systems are complex and no approach fits every organisation: anything you adopt is your own decision, at your own risk, and should be checked against the current official sources and by qualified people who know your setting. Full disclaimer.