Uber Self-Driving Car Kills Pedestrian While Safety Driver Watches TV
What happened
Elaine Herzberg was struck and killed by an Uber autonomous test vehicle in Tempe, Arizona. The vehicle's sensors detected her 5.6 seconds before impact but the system classified her ambiguously and ultimately took no action. The safety driver was watching a video on a personal phone. It was the first pedestrian fatality involving an autonomous vehicle.[1]
What went wrong
Uber's software had disabled Volvo's built-in automatic emergency braking for autonomous mode, planning to handle such scenarios internally. The system's object classification failed to identify a pedestrian with a bicycle crossing outside a crosswalk. The human safety driver — the critical backup — was not monitoring the road.[1]
Lesson learned
Disabling existing safety systems in test vehicles requires the software replacement to be provably better — not a work in progress. Human safety drivers must be actively engaged and must not perform other tasks. The operational design domain for autonomous test vehicles must match the system's actual capabilities.