Automated generation of discharge summaries: leveraging large language models with clinical data
Abstract - This study explores the use of open-source large language models (LLMs) to automate generation of German discharge summaries from structured clinical data. The structured data used to produce AI-generated summaries were manually extracted from electronic health records (EHRs)...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article (Journal) |
| Language: | English |
| Published: |
12 May 2025
|
| In: |
Scientific reports
Year: 2025, Volume: 15, Pages: 1-13 |
| ISSN: | 2045-2322 |
| DOI: | 10.1038/s41598-025-01618-7 |
| Online Access: | Verlag, kostenfrei, Volltext: https://doi.org/10.1038/s41598-025-01618-7 Verlag, kostenfrei, Volltext: https://www.nature.com/articles/s41598-025-01618-7 
|
| Author Notes: | Matthias Ganzinger, Nicola Kunz, Pascal Fuchs, Cornelia K. Lyu, Martin Loos, Martin Dugas & Thomas M. Pausch |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1934617911 | ||
| 003 | DE-627 | ||
| 005 | 20250918104851.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 250825s2025 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1038/s41598-025-01618-7 |2 doi | |
| 035 | |a (DE-627)1934617911 | ||
| 035 | |a (DE-599)KXP1934617911 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Ganzinger, Matthias |d 1974- |e VerfasserIn |0 (DE-588)102301890X |0 (DE-627)717346471 |0 (DE-576)366268082 |4 aut | |
| 245 | 1 | 0 | |a Automated generation of discharge summaries |b leveraging large language models with clinical data |c Matthias Ganzinger, Nicola Kunz, Pascal Fuchs, Cornelia K. Lyu, Martin Loos, Martin Dugas & Thomas M. Pausch |
| 264 | 1 | |c 12 May 2025 | |
| 300 | |a 13 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 25.08.2025 | ||
| 520 | |a Abstract - This study explores the use of open-source large language models (LLMs) to automate generation of German discharge summaries from structured clinical data. The structured data used to produce AI-generated summaries were manually extracted from electronic health records (EHRs) by a trained medical professional. By leveraging structured documentation collected for research and quality management, the goal is to assist physicians with editable draft summaries. After de-identifying 25 patient datasets, we optimized the output of the LLaMA3 model through prompt engineering and evaluated it using error analysis, as well as quantitative and qualitative metrics. The LLM-generated summaries were rated by physicians on comprehensiveness, conciseness, correctness, and fluency. Key results include an error rate of 2.84 mistakes per summary, and low-to-moderate alignment between generated and physician-written summaries (ROUGE-1: 0.25, BERTScore: 0.64). Medical professionals rated the summaries 3.72 ± 0.89 for comprehensiveness and 3.88 ± 0.97 for factual correctness on a 5-point Likert-scale; however, only 60% rated the comprehensiveness as good (4 or 5 out of 5). Despite overall informativeness, essential details—such as patient history, lifestyle factors, and intraoperative findings—were frequently omitted, reflecting gaps in summary completeness. While the LLaMA3 model captured much of the clinical information, complex cases and temporal reasoning presented challenges, leading to factual inaccuracies, such as incorrect age calculations. Limitations include a small dataset size, missing structured data elements, and the model’s limited proficiency with German medical terminology, highlighting the need for large, more complete datasets and potential model fine-tuning. In conclusion, this work provides a set of real-world methods, findings, experiences, insights, and descriptive results for a focused use case that may be useful to guide future work in the LLM generation of discharge summaries, perhaps especially for those working with German and possibly other non-English content. | ||
| 700 | 1 | |a Kunz, Nicola |e VerfasserIn |0 (DE-588)1374701491 |0 (DE-627)1934618535 |4 aut | |
| 700 | 1 | |a Fuchs, Pascal |e VerfasserIn |4 aut | |
| 700 | 1 | |a Lyu, Cornelia K. |e VerfasserIn |4 aut | |
| 700 | 1 | |a Loos, Martin |d 1974- |e VerfasserIn |0 (DE-588)13060044X |0 (DE-627)504175025 |0 (DE-576)298290626 |4 aut | |
| 700 | 1 | |a Dugas, Martin |e VerfasserIn |0 (DE-588)1131361393 |0 (DE-627)886028701 |0 (DE-576)487948939 |4 aut | |
| 700 | 1 | |a Pausch, Thomas |d 1982- |e VerfasserIn |0 (DE-588)1115219197 |0 (DE-627)869542311 |0 (DE-576)477679536 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Scientific reports |d [London] : Springer Nature, 2011 |g 15(2025), Artikel-ID 16466, Seite 1-13 |h Online-Ressource |w (DE-627)663366712 |w (DE-600)2615211-3 |w (DE-576)346641179 |x 2045-2322 |7 nnas |a Automated generation of discharge summaries leveraging large language models with clinical data |
| 773 | 1 | 8 | |g volume:15 |g year:2025 |g elocationid:16466 |g pages:1-13 |g extent:13 |a Automated generation of discharge summaries leveraging large language models with clinical data |
| 856 | 4 | 0 | |u https://doi.org/10.1038/s41598-025-01618-7 |x Verlag |x Resolving-System |z kostenfrei |3 Volltext |
| 856 | 4 | 0 | |u https://www.nature.com/articles/s41598-025-01618-7 |x Verlag |z kostenfrei |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20250825 | ||
| 993 | |a Article | ||
| 994 | |a 2025 | ||
| 998 | |g 1115219197 |a Pausch, Thomas |m 1115219197:Pausch, Thomas |d 910000 |d 910200 |e 910000PP1115219197 |e 910200PP1115219197 |k 0/910000/ |k 1/910000/910200/ |p 7 |y j | ||
| 998 | |g 1131361393 |a Dugas, Martin |m 1131361393:Dugas, Martin |d 910000 |d 911800 |e 910000PD1131361393 |e 911800PD1131361393 |k 0/910000/ |k 1/910000/911800/ |p 6 | ||
| 998 | |g 13060044X |a Loos, Martin |m 13060044X:Loos, Martin |d 910000 |d 910200 |e 910000PL13060044X |e 910200PL13060044X |k 0/910000/ |k 1/910000/910200/ |p 5 | ||
| 998 | |g 1374701491 |a Kunz, Nicola |m 1374701491:Kunz, Nicola |d 910000 |d 911800 |e 910000PK1374701491 |e 911800PK1374701491 |k 0/910000/ |k 1/910000/911800/ |p 2 | ||
| 998 | |g 102301890X |a Ganzinger, Matthias |m 102301890X:Ganzinger, Matthias |d 910000 |d 911800 |e 910000PG102301890X |e 911800PG102301890X |k 0/910000/ |k 1/910000/911800/ |p 1 |x j | ||
| 999 | |a KXP-PPN1934617911 |e 4763801279 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"language":["eng"],"relHost":[{"origin":[{"dateIssuedDisp":"2011-","publisherPlace":"[London] ; London","dateIssuedKey":"2011","publisher":"Springer Nature ; Nature Publishing Group"}],"disp":"Automated generation of discharge summaries leveraging large language models with clinical dataScientific reports","title":[{"title":"Scientific reports","title_sort":"Scientific reports"}],"note":["Gesehen am 12.07.24"],"id":{"issn":["2045-2322"],"eki":["663366712"],"zdb":["2615211-3"]},"physDesc":[{"extent":"Online-Ressource"}],"recId":"663366712","type":{"media":"Online-Ressource","bibl":"periodical"},"part":{"text":"15(2025), Artikel-ID 16466, Seite 1-13","extent":"13","pages":"1-13","year":"2025","volume":"15"},"language":["eng"],"pubHistory":["1, article number 1 (2011)-"]}],"type":{"bibl":"article-journal","media":"Online-Ressource"},"recId":"1934617911","physDesc":[{"extent":"13 S."}],"name":{"displayForm":["Matthias Ganzinger, Nicola Kunz, Pascal Fuchs, Cornelia K. Lyu, Martin Loos, Martin Dugas & Thomas M. Pausch"]},"title":[{"title_sort":"Automated generation of discharge summaries","title":"Automated generation of discharge summaries","subtitle":"leveraging large language models with clinical data"}],"person":[{"given":"Matthias","display":"Ganzinger, Matthias","role":"aut","family":"Ganzinger"},{"given":"Nicola","display":"Kunz, Nicola","role":"aut","family":"Kunz"},{"role":"aut","family":"Fuchs","given":"Pascal","display":"Fuchs, Pascal"},{"display":"Lyu, Cornelia K.","given":"Cornelia K.","family":"Lyu","role":"aut"},{"family":"Loos","role":"aut","display":"Loos, Martin","given":"Martin"},{"family":"Dugas","role":"aut","display":"Dugas, Martin","given":"Martin"},{"given":"Thomas","display":"Pausch, Thomas","role":"aut","family":"Pausch"}],"note":["Gesehen am 25.08.2025"],"id":{"eki":["1934617911"],"doi":["10.1038/s41598-025-01618-7"]},"origin":[{"dateIssuedKey":"2025","dateIssuedDisp":"12 May 2025"}]} | ||
| SRT | |a GANZINGERMAUTOMATEDG1220 | ||