Article Excerpt: AI-drafted responses to patient portal messages can take physicians more time to edit than it would take to write the replies from scratch, Hanover, N.H.-based Dartmouth researchers found.
The team analyzed 146,000 messages exchanged between 10,105 patients and their primary care physicians on the online portal at Lebanon, N.H.-based Dartmouth Health. AI-generated drafts frequently introduced errors and extraneous details and often failed to ask relevant follow-up questions, according to the study presented July 7 at the 64th Annual Meeting of the Association for Computational Linguistics in San Diego.
Researchers tested drafts from Claude, Gemini and ChatGPT, along with three smaller commercial models — Llama, Aloe and Qwen — against a dataset of real clinician-written responses.
“We find that AI can sound like a doctor but not think like one,” said Sarah Preum, PhD, the study’s co-corresponding author and an assistant professor of computer science at Dartmouth College, in a July 6 Dartmouth news release.
Full Article: https://tinyurl.com/ysw7w74s
Article Source: Becker’s Health IT