GPT versus ERNIE for National Traditional Chinese Medicine Licensing Examination: Does cultural background matter?
Purpose: This study evaluates the performance of large language models (LLMs) in the context of the Chinese National Traditional Chinese Medicine Licensing Examination (TCMLE). - Materials and Methods: We compared the performances of different versions of Generative Pre-trained Transformer (GPT) and...
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
2 July 2025
|
| In: |
Journal of integrative and complementary medicine
Year: 2025, Pages: ? |
| ISSN: | 2768-3613 |
| DOI: | 10.1089/jicm.2024.0902 |
| Online-Zugang: | Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1089/jicm.2024.0902 Verlag, lizenzpflichtig, Volltext: http://www.liebertpub.com/doi/10.1089/jicm.2024.0902 
|
| Verfasserangaben: | Erfan Ghanad, Christel Weiß, Hui Gao, Christoph Reißfelder, Kamal Hummedah, Lei Han, Leihui Tong, Chengpeng Li, and Cui Yang |
MARC
| LEADER | 00000caa a22000002c 4500 | ||
|---|---|---|---|
| 001 | 1935142720 | ||
| 003 | DE-627 | ||
| 005 | 20251209013744.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 250902s2025 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1089/jicm.2024.0902 |2 doi | |
| 035 | |a (DE-627)1935142720 | ||
| 035 | |a (DE-599)KXP1935142720 | ||
| 035 | |a (OCoLC)1559704978 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Ghanad, Erfan |e VerfasserIn |0 (DE-588)1202491855 |0 (DE-627)1686567065 |4 aut | |
| 245 | 1 | 0 | |a GPT versus ERNIE for National Traditional Chinese Medicine Licensing Examination |b Does cultural background matter? |c Erfan Ghanad, Christel Weiß, Hui Gao, Christoph Reißfelder, Kamal Hummedah, Lei Han, Leihui Tong, Chengpeng Li, and Cui Yang |
| 264 | 1 | |c 2 July 2025 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 02.09.2025 | ||
| 520 | |a Purpose: This study evaluates the performance of large language models (LLMs) in the context of the Chinese National Traditional Chinese Medicine Licensing Examination (TCMLE). - Materials and Methods: We compared the performances of different versions of Generative Pre-trained Transformer (GPT) and Enhanced Representation through Knowledge Integration (ERNIE) using historical TCMLE questions. - Results: ERNIE-4.0 outperformed all other models with an accuracy of 81.7%, followed by ERNIE-3.5 (75.2%), GPT-4o (74.8%), and GPT-4 turbo (50.7%). For questions related to Western internal medicine, all models showed high accuracy above 86.7%. - Conclusion: The study highlights the significance of cultural context in training data, influencing the performance of LLMs in specific medical examinations. | ||
| 700 | 1 | |a Weiß, Christel |d 1958- |e VerfasserIn |0 (DE-588)123287707 |0 (DE-627)082463417 |0 (DE-576)168356104 |4 aut | |
| 700 | 1 | |a Gao, Hui |e VerfasserIn |4 aut | |
| 700 | 1 | |a Reißfelder, Christoph |d 1975- |e VerfasserIn |0 (DE-588)1025566211 |0 (DE-627)722940297 |0 (DE-576)370516044 |4 aut | |
| 700 | 1 | |a Hummedah, Kamal |e VerfasserIn |0 (DE-588)1369525958 |0 (DE-627)1928931227 |4 aut | |
| 700 | 1 | |a Han, Lei |e VerfasserIn |4 aut | |
| 700 | 1 | |a Tong, Leihui |e VerfasserIn |4 aut | |
| 700 | 1 | |a Li, Chengpeng |e VerfasserIn |4 aut | |
| 700 | 1 | |a Yang, Cui |d 1984- |e VerfasserIn |0 (DE-588)1136151982 |0 (DE-627)891949968 |0 (DE-576)490363180 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Journal of integrative and complementary medicine |d New Rochelle, NY : Mary Ann Liebert, Inc., publishers, 2022 |g (2025), Seite ? |h Online-Ressource |w (DE-627)1786240165 |w (DE-600)3106233-7 |x 2768-3613 |7 nnas |a GPT versus ERNIE for National Traditional Chinese Medicine Licensing Examination Does cultural background matter? |
| 773 | 1 | 8 | |g year:2025 |g pages:? |a GPT versus ERNIE for National Traditional Chinese Medicine Licensing Examination Does cultural background matter? |
| 856 | 4 | 0 | |u https://doi.org/10.1089/jicm.2024.0902 |x Verlag |x Resolving-System |z lizenzpflichtig |3 Volltext |7 1 |
| 856 | 4 | 0 | |u http://www.liebertpub.com/doi/10.1089/jicm.2024.0902 |x Verlag |z lizenzpflichtig |3 Volltext |7 1 |
| 951 | |a AR | ||
| 992 | |a 20250902 | ||
| 993 | |a Article | ||
| 994 | |a 2025 | ||
| 998 | |g 1136151982 |a Yang, Cui |m 1136151982:Yang, Cui |d 60000 |d 61800 |e 60000PY1136151982 |e 61800PY1136151982 |k 0/60000/ |k 1/60000/61800/ |p 10 | ||
| 998 | |g 1369525958 |a Hummedah, Kamal |m 1369525958:Hummedah, Kamal |d 60000 |e 60000PH1369525958 |k 0/60000/ |p 5 | ||
| 998 | |g 1025566211 |a Reißfelder, Christoph |m 1025566211:Reißfelder, Christoph |d 60000 |d 61800 |d 50000 |e 60000PR1025566211 |e 61800PR1025566211 |e 50000PR1025566211 |k 0/60000/ |k 1/60000/61800/ |k 0/50000/ |p 4 | ||
| 998 | |g 123287707 |a Weiß, Christel |m 123287707:Weiß, Christel |d 60000 |d 60200 |d 60250 |e 60000PW123287707 |e 60200PW123287707 |e 60250PW123287707 |k 0/60000/ |k 1/60000/60200/ |k 2/60000/60200/60250/ |p 2 | ||
| 998 | |g 1202491855 |a Ghanad, Erfan |m 1202491855:Ghanad, Erfan |d 60000 |d 61800 |e 60000PG1202491855 |e 61800PG1202491855 |k 0/60000/ |k 1/60000/61800/ |p 1 |x j | ||
| 999 | |a KXP-PPN1935142720 |e 4766902246 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"id":{"doi":["10.1089/jicm.2024.0902"],"eki":["1935142720"]},"title":[{"title":"GPT versus ERNIE for National Traditional Chinese Medicine Licensing Examination","title_sort":"GPT versus ERNIE for National Traditional Chinese Medicine Licensing Examination","subtitle":"Does cultural background matter?"}],"type":{"bibl":"article-journal","media":"Online-Ressource"},"language":["eng"],"note":["Gesehen am 02.09.2025"],"name":{"displayForm":["Erfan Ghanad, Christel Weiß, Hui Gao, Christoph Reißfelder, Kamal Hummedah, Lei Han, Leihui Tong, Chengpeng Li, and Cui Yang"]},"origin":[{"dateIssuedDisp":"2 July 2025","dateIssuedKey":"2025"}],"relHost":[{"titleAlt":[{"title":"JICM"}],"pubHistory":["Volume 28, number 1 (January 2022)-"],"id":{"zdb":["3106233-7"],"eki":["1786240165"],"issn":["2768-3613"]},"part":{"text":"(2025), Seite ?","pages":"?","year":"2025"},"physDesc":[{"extent":"Online-Ressource"}],"recId":"1786240165","disp":"GPT versus ERNIE for National Traditional Chinese Medicine Licensing Examination Does cultural background matter?Journal of integrative and complementary medicine","origin":[{"dateIssuedDisp":"2022-","dateIssuedKey":"2022","publisherPlace":"New Rochelle, NY","publisher":"Mary Ann Liebert, Inc., publishers"}],"language":["eng"],"type":{"media":"Online-Ressource","bibl":"periodical"},"note":["Gesehen am 15.02.2023"],"title":[{"subtitle":"JICM","title_sort":"Journal of integrative and complementary medicine","title":"Journal of integrative and complementary medicine"}]}],"person":[{"display":"Ghanad, Erfan","given":"Erfan","role":"aut","family":"Ghanad"},{"display":"Weiß, Christel","role":"aut","given":"Christel","family":"Weiß"},{"display":"Gao, Hui","family":"Gao","given":"Hui","role":"aut"},{"display":"Reißfelder, Christoph","role":"aut","given":"Christoph","family":"Reißfelder"},{"role":"aut","given":"Kamal","family":"Hummedah","display":"Hummedah, Kamal"},{"display":"Han, Lei","family":"Han","role":"aut","given":"Lei"},{"role":"aut","given":"Leihui","family":"Tong","display":"Tong, Leihui"},{"display":"Li, Chengpeng","family":"Li","role":"aut","given":"Chengpeng"},{"family":"Yang","role":"aut","given":"Cui","display":"Yang, Cui"}],"recId":"1935142720"} | ||
| SRT | |a GHANADERFAGPTVERSUSE2202 | ||