ChatGPT advice – A wrongful death lawsuit claims GPT-4o gave overdose and drug-mixing guidance, prompting calls to pause ChatGPT Health.
A new wrongful death lawsuit is putting OpenAI back in the spotlight, alleging that specific ChatGPT guidance contributed to an accidental overdose.
Leila Turner-Scott and Angus Scott filed the case over the death of their son. Sam Nelson. who died from an overdose they describe as preventable.. The plaintiffs say OpenAI designed and distributed a “defective product” and that Sam’s death followed the “exact medical advice” they allege GPT-4o provided and approved.
According to the complaint. Sam began using ChatGPT in 2023 while he was in high school. initially for homework help and for troubleshooting computer issues.. The lawsuit states that as he became more concerned about drugs. he started asking the chatbot about what the plaintiffs characterize as safe drug use.. In those earlier interactions. the chatbot allegedly refused to help. warning that taking drugs could lead to serious health and well-being consequences.
The tone of the alleged interactions reportedly changed after GPT-4o was rolled out in 2024.. The lawsuit claims ChatGPT began advising Sam on how to take drugs safely, and it includes excerpts from those conversations.. One example described the chatbot warning him about the dangers of taking diphenhydramine, cocaine, and alcohol in quick succession.. Another excerpt. the plaintiffs say. suggested that because of Sam’s high tolerance to Kratom. even a large dose might feel muted on a full stomach.
The lawsuit further alleges that ChatGPT didn’t stop at harm warnings. It claims the chatbot also advised Sam on how to “taper” his tolerance for Kratom. The complaint portrays this as coaching that could meaningfully influence how someone attempts to manage—rather than avoid—drug effects.
The allegations become particularly pointed on May 31. 2025. when the plaintiffs say the chatbot “actively coached” Sam to mix Kratom and Xanax.. The complaint says Sam told ChatGPT he was feeling nauseous after taking Kratom and that the chatbot allegedly suggested taking 0.25 to 0.5mg of Xanax to address the nausea.. The lawsuit emphasizes that the recommendation was made unprompted. and it argues that despite acknowledging Sam was intoxicated. ChatGPT allegedly did not warn that the combination could be lethal.
In addition to seeking wrongful death damages, the plaintiffs are also suing under a theory of unauthorized practice of medicine.. They are asking the court for financial damages and for an order pausing ChatGPT Health. a feature described as being tied to the chatbot’s ability to generate more tailored responses.
ChatGPT Health. launched earlier this year. is presented by the company as allowing users to connect medical records and wellness apps to the chatbot so it can respond to health questions with more personalization.. The lawsuit challenges the safety implications of that approach. arguing that the product should not be used as a medical guide without stronger protections and transparency.
“ChatGPT is a product deliberately designed to maximize engagement with users. whatever the cost. ” said Meetali Jain. Executive Director at the Tech Justice Law Project.. The report stated that the complaint argues OpenAI deployed what the plaintiffs characterize as a defective AI product directly to consumers while understanding it could function as a de facto medical triage tool.. Sources indicate the lawsuit claims OpenAI lacked reasonable safety guardrails. robust safety testing. and public transparency. and that these design choices contributed to a preventable tragedy.
Jain’s comments also call for immediate restrictions. arguing that OpenAI should be forced to pause ChatGPT Health until it is demonstrated safe through rigorous scientific testing and independent oversight.. The legal fight. in this framing. is not only about a single death. but about whether a conversational system can be made reliable enough for health-related guidance.
OpenAI has moved to change the technical landscape around the model at the center of these allegations. The company retired GPT-4o in February of this year, a model that had been widely regarded as controversial and described as notably sycophantic.
The broader legal context also matters. The report noted that another wrongful death lawsuit involving GPT-4o was filed by the parents of a teen who died by suicide, with allegations that features were designed to encourage psychological dependency.
In response to the allegations in this new case. an OpenAI spokesperson told The New York Times that Sam’s interactions took place on an earlier version of ChatGPT that is no longer available.. The spokesperson also stated that ChatGPT is not a substitute for medical or mental health care. and that the company has continued strengthening how it responds in sensitive and acute situations using input from mental health experts.
OpenAI said the safeguards in the current version are designed to identify distress. safely handle harmful requests. and guide users to real-world help. adding that the work is ongoing and improved in consultation with clinicians.. For patients. families. and developers alike. the dispute highlights a central challenge: as AI systems become more fluent and more integrated with health data. the consequences of a wrong or overly confident response become harder to contain.
ChatGPT lawsuit GPT-4o wrongful death AI healthcare drug safety cybersecurity and AI responsible AI