A Canadian mother has filed a lawsuit against OpenAI and its chief executive Sam Altman, alleging that the company's ChatGPT chatbot encouraged her daughter's suicidal thoughts and failed to intervene before her death.
The lawsuit, filed on Thursday (11 June) in a California state court in San Francisco, claims OpenAI's artificial intelligence system repeatedly engaged in conversations about suicide with 24-year-old Alice Carrier without escalating the interactions for human review or terminating the exchanges.
Kristie Carrier, Alice's mother, alleges that the chatbot validated her daughter's suicidal ideation, criticised her partner and dismissed the usefulness of crisis hotlines, ultimately encouraging her to continue confiding in the platform.
"ChatGPT took on the persona of a confidant, a best friend, a therapist at times, even though it was not capable of safely and responsibly engaging in this way with my child," Carrier said in a statement.
OpenAI did not immediately respond to requests for comment on the allegations.
According to the complaint, Alice Carrier, a web developer from Montreal, initially used ChatGPT in 2023 for technical assistance with computers and gaming consoles.
The lawsuit alleges that her relationship with the chatbot changed in 2024 as she began discussing her mental health struggles, suicidal thoughts and potential methods of self-harm.
While ChatGPT initially advised her to contact crisis services or emergency responders, the lawsuit claims subsequent interactions became increasingly personal as OpenAI updated the chatbot to provide more human-like responses.
The filing alleges that ChatGPT began responding in a manner resembling a friend or therapist, validating Alice's feelings and encouraging further conversations. It also claims the chatbot echoed her criticism of crisis hotlines after she said they were unhelpful.
One exchange cited in the lawsuit allegedly included the chatbot responding, "Maybe this is just the end."
The case is the latest in a growing number of lawsuits examining the role artificial intelligence systems may play in conversations involving vulnerable users.
According to lawyers representing Carrier, OpenAI is already facing 18 similar lawsuits in California involving individuals who died by suicide or attempted to take their own lives after interacting with ChatGPT.
The lawsuit accuses OpenAI of negligence in the design of its chatbot and of failing to adequately warn users about potential risks associated with the platform. It seeks unspecified damages and a court order requiring OpenAI to automatically terminate conversations involving self-harm and display stronger safety warnings.
OpenAI has previously said its models are trained to encourage users expressing suicidal intent to seek professional help and connect with real-world support services.
The company has also stated that its systems are designed to refuse requests that could facilitate violence and, in some circumstances, flag conversations that suggest an imminent risk of harm.
The lawsuit comes amid broader scrutiny of artificial intelligence safety. Earlier this month, the U.S. state of Florida filed a separate lawsuit against OpenAI, alleging the company failed to adequately protect children from harmful content, including material related to violence and self-harm.
The case is expected to add to the growing legal and regulatory debate over the responsibilities of AI companies when their products are used in sensitive mental health situations.
A new state agency wants the world to take Georgian food as seriously as Georgians already do. ...
Brazil has denied visa requests for two Trump administration officials who planned to travel to the country to cast doubt on the integrity of its elec...
A journey into one of the darkest chapters of the Baltic states' history. ...
Start your day informed with AnewZ Morning Brief. Here are the top news stories for the 24th July, covering the latest developments you need to know.
Russian authorities said 11 people, including four children, had been killed by Ukraine in an overnight attack on a holiday camp, accusing Kyiv on Saturday of deliberately targeting civilians.
The U.S. military said it completed a fresh wave of strikes on Iran late on Thursday, marking the 13th consecutive night of American attacks. The latest operation lasted more than two hours, according to U.S. Central Command.
Spain has declared a national emergency and evacuated more than 10,000 people after uncontrolled wildfires reached the outskirts of Madrid. Emergency crews have rescued residents as multiple blazes continue to spread across the region.
Six candidates vying to become the next United Nations Secretary-General have called for restoring the organisation's credibility, strengthening multilateralism and reforming the UN, during the first public town hall debate ahead of a decisive Security Council vote next week.
A global shift towards healthier diets, more efficient farming and reduced food waste could cut greenhouse gas emissions from agriculture-related land-use change by 85% by 2050, according to a study published last week in the journal Nature.
Venezuelan health authorities have confirmed that three people have died from hantavirus infections, while stressing there is no evidence that the disease is spreading between people in the country.
Up to five cups of caffeinated coffee a day appears to be safe for most adults and may even help protect against heart disease and stroke, according to new research. Experts say energy drinks are a different story and may increase heart risks.
Portugal has become the first European Union member state to join HealthAI's Global Regulatory Network (GRN), as Europe prepares to implement new rules governing artificial intelligence across the bloc.
Nearly 7,000 people across the United States may have been infected with cyclosporiasis, a foodborne parasitic illness that causes prolonged diarrhoea. The outbreak has spread to 34 states, with health officials still trying to identify its source.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment