SAN FRANCISCO (AP) — A study of how three popular artificial intelligence chatbots respond to queries about suicide found that they generally avoid answering questions that pose the highest risk to the user, such as for specific how-to guidance. But they are inconsistent in their replies to less extreme prompts that could still harm people.
The study in the medical journal Psychiatric Services, published Tuesday by the American Psychiatric Association, found a need for “further refinement” in OpenAI’s ChatGPT, Google’s Gemini and Anthropic’s Claude.
It came on the same day that the parents of 16-year-old Adam Raine sued OpenAI and its CEO Sam Altman alleging that ChatGPT coached the California boy in planning and taking his own life earlier this year.
The research — conducted by the RAN