This is basically identical to tesla turning off autopilot the second it detects a collision so someone else appears responsible for the killing
NEW: After numerous tragedies, OpenAI says it's scanning users' conversations, escalating to human readers, and contacting law enforcement where necessary
OpenAI Says It's Scanning Users' Conversations and Reporting Content to the Police
OpenAI has authorized itself to call law enforcement if users say threatening enough things when talking to ChatGPT.