Evaluating interactions of patients with large language models for medical information
Objectives To explore the interaction of real-world patients with a chatbot in a clinical setting, investigating key aspects of medical information provided by large language models (LLMs). Patients and methods The study enrolled 300 patients seeking urological counselling between February and July...
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
June 2025
|
| In: |
BJU international
Year: 2025, Jahrgang: 135, Heft: 6, Pages: 1010-1017 |
| ISSN: | 1464-410X |
| DOI: | 10.1111/bju.16676 |
| Online-Zugang: | Verlag, kostenfrei, Volltext: https://doi.org/10.1111/bju.16676 Verlag, kostenfrei, Volltext: https://onlinelibrary.wiley.com/doi/abs/10.1111/bju.16676 
|
| Verfasserangaben: | Nicolas Carl, Sarah Haggenmüller, Christoph Wies, Lisa Nguyen, Jana Theres Winterstein, Martin Joachim Hetz, Maurin Helen Mangold, Friedrich Otto Hartung, Britta Grüne, Tim Holland-Letz, Maurice Stephan Michel, Titus Josef Brinker and Frederik Wessels |
MARC
| LEADER | 00000naa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1933022450 | ||
| 003 | DE-627 | ||
| 005 | 20250812140417.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 250812s2025 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1111/bju.16676 |2 doi | |
| 035 | |a (DE-627)1933022450 | ||
| 035 | |a (DE-599)KXP1933022450 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Carl, Nicolas |d 1995- |e VerfasserIn |0 (DE-588)1274470323 |0 (DE-627)1824326920 |4 aut | |
| 245 | 1 | 0 | |a Evaluating interactions of patients with large language models for medical information |c Nicolas Carl, Sarah Haggenmüller, Christoph Wies, Lisa Nguyen, Jana Theres Winterstein, Martin Joachim Hetz, Maurin Helen Mangold, Friedrich Otto Hartung, Britta Grüne, Tim Holland-Letz, Maurice Stephan Michel, Titus Josef Brinker and Frederik Wessels |
| 264 | 1 | |c June 2025 | |
| 300 | |b Illustrationen | ||
| 300 | |a 8 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Online veröffentlicht: 18. Februar 2025 | ||
| 500 | |a Gesehen am 12.08.2025 | ||
| 520 | |a Objectives To explore the interaction of real-world patients with a chatbot in a clinical setting, investigating key aspects of medical information provided by large language models (LLMs). Patients and methods The study enrolled 300 patients seeking urological counselling between February and July 2024. First, participants voluntarily conversed with a Generative Pre-trained Transformer 4 (GPT-4) powered chatbot to ask questions related to their medical situation. In the following survey, patients rated the perceived utility, completeness, and understandability of the information provided during the simulated conversation as well as user-friendliness. Finally, patients were asked which, in their experience, best answered their questions: LLMs, urologists, or search engines. Results A total of 292 patients completed the study. The majority of patients perceived the chatbot as providing useful, complete, and understandable information, as well as being user-friendly. However, the ability of human urologists to answer medical questions in an understandable way was rated higher than of LLMs. Interestingly, 53% of participants rated the question-answering ability of LLMs higher than search engines. Age was not associated with preferences. Limitations include social desirability and sampling biases. Discussion This study highlights the potential of LLMs to enhance patient education and communication in clinical settings, with patients valuing their user-friendliness and comprehensiveness for medical information. By addressing preliminary questions, LLMs could potentially relieve time constraints on healthcare providers, enabling medical personnel to focus on complex inquiries and patient care. | ||
| 650 | 4 | |a artificial intelligence | |
| 650 | 4 | |a clinical trial | |
| 650 | 4 | |a implementation science | |
| 650 | 4 | |a large language models | |
| 650 | 4 | |a patient interaction | |
| 700 | 1 | |a Haggenmüller, Sarah |d 1995- |e VerfasserIn |0 (DE-588)1231946709 |0 (DE-627)1755618042 |4 aut | |
| 700 | 1 | |a Wies, Christoph |e VerfasserIn |4 aut | |
| 700 | 1 | |a Nguyen, Lisa |d 2001- |e VerfasserIn |0 (DE-588)137364995X |0 (DE-627)1933024062 |4 aut | |
| 700 | 1 | |a Winterstein, Jana Theres |e VerfasserIn |4 aut | |
| 700 | 1 | |a Hetz, Martin Joachim |e VerfasserIn |4 aut | |
| 700 | 1 | |a Mangold, Maurin Helen |d 1996- |e VerfasserIn |0 (DE-588)1282415905 |0 (DE-627)1838145826 |4 aut | |
| 700 | 1 | |a Hartung, Friedrich |d 1993- |e VerfasserIn |0 (DE-588)1223629066 |0 (DE-627)1743101791 |4 aut | |
| 700 | 1 | |a Grüne, Britta |e VerfasserIn |0 (DE-588)1233692895 |0 (DE-627)1758052597 |4 aut | |
| 700 | 1 | |a Holland-Letz, Tim |e VerfasserIn |0 (DE-588)142336491 |0 (DE-627)658880470 |0 (DE-576)343311291 |4 aut | |
| 700 | 1 | |a Michel, Maurice Stephan |d 1970- |e VerfasserIn |0 (DE-588)121842568 |0 (DE-627)705674134 |0 (DE-576)29291363X |4 aut | |
| 700 | 1 | |a Brinker, Titus Josef |d 1990- |e VerfasserIn |0 (DE-588)1156309395 |0 (DE-627)1018860487 |0 (DE-576)502097434 |4 aut | |
| 700 | 1 | |a Wessels, Frederik |d 1990- |e VerfasserIn |0 (DE-588)1183323255 |0 (DE-627)1663137226 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t BJU international |d Oxford : Wiley-Blackwell, 1999 |g 135(2025), 6, Seite 1010-1017 |h Online-Ressource |w (DE-627)320599426 |w (DE-600)2019983-1 |w (DE-576)091140862 |x 1464-410X |7 nnas |a Evaluating interactions of patients with large language models for medical information |
| 773 | 1 | 8 | |g volume:135 |g year:2025 |g number:6 |g pages:1010-1017 |g extent:8 |a Evaluating interactions of patients with large language models for medical information |
| 856 | 4 | 0 | |u https://doi.org/10.1111/bju.16676 |x Verlag |x Resolving-System |z kostenfrei |3 Volltext |
| 856 | 4 | 0 | |u https://onlinelibrary.wiley.com/doi/abs/10.1111/bju.16676 |x Verlag |z kostenfrei |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20250812 | ||
| 993 | |a Article | ||
| 994 | |a 2025 | ||
| 998 | |g 1183323255 |a Wessels, Frederik |m 1183323255:Wessels, Frederik |d 60000 |d 63100 |d 60000 |e 60000PW1183323255 |e 63100PW1183323255 |e 60000PW1183323255 |k 0/60000/ |k 1/60000/63100/ |k 0/60000/ |p 13 |y j | ||
| 998 | |g 1156309395 |a Brinker, Titus Josef |m 1156309395:Brinker, Titus Josef |d 50000 |e 50000PB1156309395 |k 0/50000/ |p 12 | ||
| 998 | |g 121842568 |a Michel, Maurice Stephan |m 121842568:Michel, Maurice Stephan |d 60000 |d 63100 |e 60000PM121842568 |e 63100PM121842568 |k 0/60000/ |k 1/60000/63100/ |p 11 | ||
| 998 | |g 142336491 |a Holland-Letz, Tim |m 142336491:Holland-Letz, Tim |d 50000 |e 50000PH142336491 |k 0/50000/ |p 10 | ||
| 998 | |g 1233692895 |a Grüne, Britta |m 1233692895:Grüne, Britta |d 60000 |d 63100 |e 60000PG1233692895 |e 63100PG1233692895 |k 0/60000/ |k 1/60000/63100/ |p 9 | ||
| 998 | |g 1223629066 |a Hartung, Friedrich |m 1223629066:Hartung, Friedrich |d 60000 |d 63100 |e 60000PH1223629066 |e 63100PH1223629066 |k 0/60000/ |k 1/60000/63100/ |p 8 | ||
| 998 | |g 1282415905 |a Mangold, Maurin Helen |m 1282415905:Mangold, Maurin Helen |d 60000 |e 60000PM1282415905 |k 0/60000/ |p 7 | ||
| 998 | |g 137364995X |a Nguyen, Lisa |m 137364995X:Nguyen, Lisa |d 60000 |e 60000PN137364995X |k 0/60000/ |p 4 | ||
| 998 | |g 1231946709 |a Haggenmüller, Sarah |m 1231946709:Haggenmüller, Sarah |d 60000 |e 60000PH1231946709 |k 0/60000/ |p 2 | ||
| 998 | |g 1274470323 |a Carl, Nicolas |m 1274470323:Carl, Nicolas |d 60000 |e 60000PC1274470323 |k 0/60000/ |p 1 |x j | ||
| 999 | |a KXP-PPN1933022450 |e 4756728936 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"physDesc":[{"noteIll":"Illustrationen","extent":"8 S."}],"language":["eng"],"title":[{"title":"Evaluating interactions of patients with large language models for medical information","title_sort":"Evaluating interactions of patients with large language models for medical information"}],"name":{"displayForm":["Nicolas Carl, Sarah Haggenmüller, Christoph Wies, Lisa Nguyen, Jana Theres Winterstein, Martin Joachim Hetz, Maurin Helen Mangold, Friedrich Otto Hartung, Britta Grüne, Tim Holland-Letz, Maurice Stephan Michel, Titus Josef Brinker and Frederik Wessels"]},"note":["Online veröffentlicht: 18. Februar 2025","Gesehen am 12.08.2025"],"type":{"bibl":"article-journal","media":"Online-Ressource"},"person":[{"given":"Nicolas","family":"Carl","display":"Carl, Nicolas","role":"aut"},{"role":"aut","family":"Haggenmüller","display":"Haggenmüller, Sarah","given":"Sarah"},{"given":"Christoph","family":"Wies","display":"Wies, Christoph","role":"aut"},{"role":"aut","display":"Nguyen, Lisa","family":"Nguyen","given":"Lisa"},{"given":"Jana Theres","family":"Winterstein","display":"Winterstein, Jana Theres","role":"aut"},{"family":"Hetz","display":"Hetz, Martin Joachim","role":"aut","given":"Martin Joachim"},{"given":"Maurin Helen","role":"aut","family":"Mangold","display":"Mangold, Maurin Helen"},{"role":"aut","family":"Hartung","display":"Hartung, Friedrich","given":"Friedrich"},{"given":"Britta","role":"aut","display":"Grüne, Britta","family":"Grüne"},{"display":"Holland-Letz, Tim","family":"Holland-Letz","role":"aut","given":"Tim"},{"role":"aut","display":"Michel, Maurice Stephan","family":"Michel","given":"Maurice Stephan"},{"family":"Brinker","display":"Brinker, Titus Josef","role":"aut","given":"Titus Josef"},{"given":"Frederik","display":"Wessels, Frederik","family":"Wessels","role":"aut"}],"relHost":[{"pubHistory":["83.1999 -"],"disp":"Evaluating interactions of patients with large language models for medical informationBJU international","part":{"volume":"135","pages":"1010-1017","text":"135(2025), 6, Seite 1010-1017","extent":"8","year":"2025","issue":"6"},"recId":"320599426","type":{"media":"Online-Ressource","bibl":"periodical"},"note":["Gesehen am 14.03.25"],"language":["eng"],"physDesc":[{"extent":"Online-Ressource"}],"title":[{"title_sort":"BJU international","title":"BJU international","subtitle":"the journal of the British Association of Urological Surgeons, the European Society of Paediatric Urology and the Societé Internationale d'Urologie"}],"origin":[{"dateIssuedDisp":"1999-","dateIssuedKey":"1999","publisherPlace":"Oxford ; Oxford ; Oxford [u.a.]","publisher":"Wiley-Blackwell ; Blackwell Science ; Blackwell"}],"id":{"eki":["320599426"],"zdb":["2019983-1"],"issn":["1464-410X"],"doi":["10.1111/(ISSN)1464-410X"]}}],"id":{"eki":["1933022450"],"doi":["10.1111/bju.16676"]},"recId":"1933022450","origin":[{"dateIssuedKey":"2025","dateIssuedDisp":"June 2025"}]} | ||
| SRT | |a CARLNICOLAEVALUATING2025 | ||