Readability of chatbot responses in prostate cancer and urological care: objective metrics versus patient perceptions
Large language models (LLMs) are increasingly explored as chatbots for patient education, including applications in urooncology. Since only 12% of adults have proficient health literacy and most patient information materials exceed recommended reading levels, improving readability is crucial. Althou...
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
19 October 2025
|
| In: |
Current oncology
Year: 2025, Jahrgang: 32, Heft: 10, Pages: 1-13 |
| ISSN: | 1718-7729 |
| DOI: | 10.3390/curroncol32100582 |
| Online-Zugang: | Verlag, kostenfrei, Volltext: https://doi.org/10.3390/curroncol32100582 Verlag, kostenfrei, Volltext: https://www.mdpi.com/1718-7729/32/10/582 
|
| Verfasserangaben: | Lasse Maywald, Lisa Nguyen, Jana Theres Winterstein, Martin Joachim Hetz, Maurin Helen Mangold, Luisa Vivienne Renner, Titus Josef Brinker, Frederik Wessels and Nicolas Carl |
MARC
| LEADER | 00000naa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1943744688 | ||
| 003 | DE-627 | ||
| 005 | 20251203103536.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 251203s2025 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.3390/curroncol32100582 |2 doi | |
| 035 | |a (DE-627)1943744688 | ||
| 035 | |a (DE-599)KXP1943744688 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Maywald, Lasse |d 1996- |e VerfasserIn |0 (DE-588)1283585405 |0 (DE-627)1839353996 |4 aut | |
| 245 | 1 | 0 | |a Readability of chatbot responses in prostate cancer and urological care |b objective metrics versus patient perceptions |c Lasse Maywald, Lisa Nguyen, Jana Theres Winterstein, Martin Joachim Hetz, Maurin Helen Mangold, Luisa Vivienne Renner, Titus Josef Brinker, Frederik Wessels and Nicolas Carl |
| 264 | 1 | |c 19 October 2025 | |
| 300 | |b Illustrationen | ||
| 300 | |a 13 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Veröffentlicht: 19. Oktober 2025 | ||
| 500 | |a Gesehen am 03.12.2025 | ||
| 520 | |a Large language models (LLMs) are increasingly explored as chatbots for patient education, including applications in urooncology. Since only 12% of adults have proficient health literacy and most patient information materials exceed recommended reading levels, improving readability is crucial. Although LLMs could potentially increase the readability of medical information, evidence is mixed, underscoring the need to assess chatbot outputs in clinical settings. Therefore, this study evaluates the measured and perceived readability of chatbot responses in speech-based interactions with urological patients. Urological patients engaged in unscripted conversations with a GPT-4-based chatbot. Transcripts were analyzed using three readability indices: Flesch-Reading-Ease (FRE), Lesbarkeitsindex (LIX) and Wiener-Sachtextformel (WSF). Perceived readability was assessed using a survey covering technical language, clarity and explainability. Associations between measured and perceived readability were analyzed. Knowledge retention was not assessed in this study. A total of 231 conversations were evaluated. The most frequently addressed topics were prostate cancer (22.5%), robotic-assisted prostatectomy (19.9%) and follow-up (18.6%). Objectively, responses were classified as difficult to read (FRE 43.1 ± 9.1; LIX 52.8 ± 6.2; WSF 11.2 ± 1.6). In contrast, perceived readability was rated highly for technical language, clarity and explainability (83-90%). Correlation analyses revealed no association between objective and perceived readability. Chatbot responses were objectively written at a difficult reading level, exceeding recommendations for optimized health literacy. Nevertheless, most patients perceived the information as clear and understandable. This discrepancy suggests that perceived comprehensibility is influenced by factors beyond measurable linguistic complexity. | ||
| 650 | 4 | |a artificial intelligence | |
| 650 | 4 | |a chatbots | |
| 650 | 4 | |a GPT-4 | |
| 650 | 4 | |a health literacy | |
| 650 | 4 | |a large language models | |
| 650 | 4 | |a patient education | |
| 650 | 4 | |a readability | |
| 650 | 4 | |a urology | |
| 650 | 4 | |a urooncology | |
| 700 | 1 | |a Nguyen, Lisa |d 2001- |e VerfasserIn |0 (DE-588)137364995X |0 (DE-627)1933024062 |4 aut | |
| 700 | 1 | |a Winterstein, Jana Therés |e VerfasserIn |0 (DE-588)1371584729 |0 (DE-627)1930549865 |4 aut | |
| 700 | 1 | |a Hetz, Martin Joachim |d 1993- |e VerfasserIn |0 (DE-588)1380936772 |0 (DE-627)1940604591 |4 aut | |
| 700 | 1 | |a Mangold, Maurin Helen |d 1996- |e VerfasserIn |0 (DE-588)1282415905 |0 (DE-627)1838145826 |4 aut | |
| 700 | 1 | |a Renner, Luisa Vivienne |d 1998- |e VerfasserIn |0 (DE-588)1340391171 |0 (DE-627)1899893458 |4 aut | |
| 700 | 1 | |a Brinker, Titus Josef |d 1990- |e VerfasserIn |0 (DE-588)1156309395 |0 (DE-627)1018860487 |0 (DE-576)502097434 |4 aut | |
| 700 | 1 | |a Wessels, Frederik |d 1990- |e VerfasserIn |0 (DE-588)1183323255 |0 (DE-627)1663137226 |4 aut | |
| 700 | 1 | |a Carl, Nicolas |d 1995- |e VerfasserIn |0 (DE-588)1274470323 |0 (DE-627)1824326920 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Current oncology |d Toronto, Ontario : Multimed, 2005 |g 32(2025), 10, Artikel-ID 582, Seite 1-13 |h Online-Ressource |w (DE-627)524623112 |w (DE-600)2270777-3 |w (DE-576)347278280 |x 1718-7729 |7 nnas |a Readability of chatbot responses in prostate cancer and urological care objective metrics versus patient perceptions |
| 773 | 1 | 8 | |g volume:32 |g year:2025 |g number:10 |g elocationid:582 |g pages:1-13 |g extent:13 |a Readability of chatbot responses in prostate cancer and urological care objective metrics versus patient perceptions |
| 856 | 4 | 0 | |u https://doi.org/10.3390/curroncol32100582 |x Verlag |x Resolving-System |z kostenfrei |3 Volltext |
| 856 | 4 | 0 | |u https://www.mdpi.com/1718-7729/32/10/582 |x Verlag |z kostenfrei |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20251203 | ||
| 993 | |a Article | ||
| 994 | |a 2025 | ||
| 998 | |g 1274470323 |a Carl, Nicolas |m 1274470323:Carl, Nicolas |d 60000 |e 60000PC1274470323 |k 0/60000/ |p 9 |y j | ||
| 998 | |g 1183323255 |a Wessels, Frederik |m 1183323255:Wessels, Frederik |d 60000 |d 63100 |d 60000 |e 60000PW1183323255 |e 63100PW1183323255 |e 60000PW1183323255 |k 0/60000/ |k 1/60000/63100/ |k 0/60000/ |p 8 | ||
| 998 | |g 1156309395 |a Brinker, Titus Josef |m 1156309395:Brinker, Titus Josef |d 50000 |e 50000PB1156309395 |k 0/50000/ |p 7 | ||
| 998 | |g 1340391171 |a Renner, Luisa |m 1340391171:Renner, Luisa |d 60000 |d 63100 |e 60000PR1340391171 |e 63100PR1340391171 |k 0/60000/ |k 1/60000/63100/ |p 6 | ||
| 998 | |g 1282415905 |a Mangold, Maurin Helen |m 1282415905:Mangold, Maurin Helen |d 60000 |e 60000PM1282415905 |k 0/60000/ |p 5 | ||
| 998 | |g 1380936772 |a Hetz, Martin Joachim |m 1380936772:Hetz, Martin Joachim |p 4 | ||
| 998 | |g 1371584729 |a Winterstein, Jana Therés |m 1371584729:Winterstein, Jana Therés |d 50000 |e 50000PW1371584729 |k 0/50000/ |p 3 | ||
| 998 | |g 137364995X |a Nguyen, Lisa |m 137364995X:Nguyen, Lisa |d 60000 |e 60000PN137364995X |k 0/60000/ |p 2 | ||
| 998 | |g 1283585405 |a Maywald, Lasse |m 1283585405:Maywald, Lasse |d 60000 |e 60000PM1283585405 |k 0/60000/ |p 1 |x j | ||
| 999 | |a KXP-PPN1943744688 |e 4819868225 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"name":{"displayForm":["Lasse Maywald, Lisa Nguyen, Jana Theres Winterstein, Martin Joachim Hetz, Maurin Helen Mangold, Luisa Vivienne Renner, Titus Josef Brinker, Frederik Wessels and Nicolas Carl"]},"id":{"eki":["1943744688"],"doi":["10.3390/curroncol32100582"]},"recId":"1943744688","physDesc":[{"noteIll":"Illustrationen","extent":"13 S."}],"person":[{"display":"Maywald, Lasse","role":"aut","given":"Lasse","family":"Maywald"},{"display":"Nguyen, Lisa","family":"Nguyen","role":"aut","given":"Lisa"},{"given":"Jana Therés","role":"aut","family":"Winterstein","display":"Winterstein, Jana Therés"},{"given":"Martin Joachim","role":"aut","family":"Hetz","display":"Hetz, Martin Joachim"},{"family":"Mangold","given":"Maurin Helen","role":"aut","display":"Mangold, Maurin Helen"},{"display":"Renner, Luisa Vivienne","family":"Renner","role":"aut","given":"Luisa Vivienne"},{"display":"Brinker, Titus Josef","role":"aut","given":"Titus Josef","family":"Brinker"},{"role":"aut","given":"Frederik","family":"Wessels","display":"Wessels, Frederik"},{"display":"Carl, Nicolas","role":"aut","given":"Nicolas","family":"Carl"}],"relHost":[{"part":{"pages":"1-13","text":"32(2025), 10, Artikel-ID 582, Seite 1-13","extent":"13","issue":"10","year":"2025","volume":"32"},"title":[{"title":"Current oncology","title_sort":"Current oncology"}],"id":{"issn":["1718-7729"],"eki":["524623112"],"zdb":["2270777-3"]},"note":["Gesehen am 21.11.2025","Volltext auch als Teil einer Datenbank verfügbar"],"language":["eng"],"type":{"bibl":"periodical","media":"Online-Ressource"},"pubHistory":["Nachgewiesen 12.2005 -"],"origin":[{"publisherPlace":"Toronto, Ontario","dateIssuedKey":"2005","dateIssuedDisp":"2005-","publisher":"Multimed"}],"disp":"Readability of chatbot responses in prostate cancer and urological care objective metrics versus patient perceptionsCurrent oncology","recId":"524623112","physDesc":[{"extent":"Online-Ressource"}]}],"origin":[{"dateIssuedDisp":"19 October 2025","dateIssuedKey":"2025"}],"title":[{"subtitle":"objective metrics versus patient perceptions","title":"Readability of chatbot responses in prostate cancer and urological care","title_sort":"Readability of chatbot responses in prostate cancer and urological care"}],"note":["Veröffentlicht: 19. Oktober 2025","Gesehen am 03.12.2025"],"type":{"media":"Online-Ressource","bibl":"article-journal"},"language":["eng"]} | ||
| SRT | |a MAYWALDLASREADABILIT1920 | ||