Feedback, fairness, and validity: effects of disclosing and reusing multiple-choice questions in medical schools
Background Disclosure of items used in multiple-choice-question (MCQ) exams may decrease student anxiety and improve transparency, feedback, and test-enhanced learning but potentially compromises the reliability and fairness of exams if items are eventually reused. Evidence regarding whether disclos...
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
2023
|
| In: |
Medical education online
Year: 2023, Jahrgang: 28, Heft: 1, Pages: 1-7 |
| ISSN: | 1087-2981 |
| DOI: | 10.1080/10872981.2022.2143298 |
| Online-Zugang: | Verlag, kostenfrei, Volltext: https://doi.org/10.1080/10872981.2022.2143298
|
| Verfasserangaben: | Stefan Appelhaus, Susanne Werner, Pascal Grosse and Juliane E. Kämmer |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1843446316 | ||
| 003 | DE-627 | ||
| 005 | 20230706212155.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 230424s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1080/10872981.2022.2143298 |2 doi | |
| 035 | |a (DE-627)1843446316 | ||
| 035 | |a (DE-599)KXP1843446316 | ||
| 035 | |a (OCoLC)1389530604 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Appelhaus, Stefan |d 1990- |e VerfasserIn |0 (DE-588)128862106X |0 (DE-627)1844765059 |4 aut | |
| 245 | 1 | 0 | |a Feedback, fairness, and validity: effects of disclosing and reusing multiple-choice questions in medical schools |c Stefan Appelhaus, Susanne Werner, Pascal Grosse and Juliane E. Kämmer |
| 264 | 1 | |c 2023 | |
| 300 | |a 7 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Published online: 09 Nov 2022 | ||
| 500 | |a Gesehen am 08.05.2023 | ||
| 520 | |a Background Disclosure of items used in multiple-choice-question (MCQ) exams may decrease student anxiety and improve transparency, feedback, and test-enhanced learning but potentially compromises the reliability and fairness of exams if items are eventually reused. Evidence regarding whether disclosure and reuse of test items change item psychometrics is scarce and inconclusive.Methods We retrospectively analysed difficulty and discrimination coefficients of 10,148 MCQ items used between fall 2017 and fall 2019 in a large European medical school in which items were disclosed from fall 2017 onwards. We categorised items as ‘new’; ‘reused, not disclosed’; or ‘reused, disclosed’. For reused items, we calculated the difference from their first ever use, that is, when they were new. Differences between categories and terms were analysed with one-way analyses of variance and independent-samples t tests.Results The proportion of reused, disclosed items grew from 0% to 48.4%; mean difficulty coefficients increased from 0.70 to 0.76; that is, items became easier, P < .001, ηp2 = 0.011. On average, reused, disclosed items were significantly easier (M = 0.83) than reused, not disclosed items (M = 0.71) and entirely new items (M = 0.66), P < .001, ηp2 = 0.087. Mean discrimination coefficients increased from 0.21 to 0.23; that is, item became slightly more discriminating, P = .002, ηp2 = 0.002.Conclusions Disclosing test items provides the opportunity to enhance feedback and transparency in MCQ exams but potentially at the expense of decreased item reliability. Discrimination was positively affected. Our study may help weigh advantages and disadvantages of using previously disclosed items. | ||
| 650 | 4 | |a Assessment | |
| 650 | 4 | |a disclosure | |
| 650 | 4 | |a feedback | |
| 650 | 4 | |a formative assessment | |
| 650 | 4 | |a item reuse | |
| 650 | 4 | |a multiple-choice questions | |
| 650 | 4 | |a progress testing | |
| 700 | 1 | |a Werner, Susanne |e VerfasserIn |4 aut | |
| 700 | 1 | |a Grosse, Pascal |e VerfasserIn |4 aut | |
| 700 | 1 | |a Kämmer, Juliane |e VerfasserIn |0 (DE-588)1042665958 |0 (DE-627)76932424X |0 (DE-576)39410286X |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Medical education online |d East Lansing, Mich. : [Verlag nicht ermittelbar], 1996 |g 28(2023), 1, Artikel-ID 2143298, Seite 1-7 |w (DE-627)332165809 |w (DE-600)2052877-2 |w (DE-576)281205213 |x 1087-2981 |7 nnas |a Feedback, fairness, and validity: effects of disclosing and reusing multiple-choice questions in medical schools |
| 773 | 1 | 8 | |g volume:28 |g year:2023 |g number:1 |g elocationid:2143298 |g pages:1-7 |g extent:7 |a Feedback, fairness, and validity: effects of disclosing and reusing multiple-choice questions in medical schools |
| 856 | 4 | 0 | |u https://doi.org/10.1080/10872981.2022.2143298 |x Verlag |x Resolving-System |z kostenfrei |3 Volltext |
| 856 | 4 | 0 | |u https://doi.org/10.1080/10872981.2022.2143298 |x Verlag |z kostenfrei |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20230508 | ||
| 993 | |a Article | ||
| 994 | |a 2023 | ||
| 998 | |g 128862106X |a Appelhaus, Stefan |m 128862106X:Appelhaus, Stefan |d 60000 |d 62900 |e 60000PA128862106X |e 62900PA128862106X |k 0/60000/ |k 1/60000/62900/ |p 1 |x j | ||
| 999 | |a KXP-PPN1843446316 |e 4319152662 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"type":{"bibl":"article-journal","media":"Online-Ressource"},"person":[{"role":"aut","family":"Appelhaus","display":"Appelhaus, Stefan","roleDisplay":"VerfasserIn","given":"Stefan"},{"role":"aut","family":"Werner","given":"Susanne","roleDisplay":"VerfasserIn","display":"Werner, Susanne"},{"family":"Grosse","roleDisplay":"VerfasserIn","display":"Grosse, Pascal","given":"Pascal","role":"aut"},{"family":"Kämmer","roleDisplay":"VerfasserIn","display":"Kämmer, Juliane","given":"Juliane","role":"aut"}],"title":[{"title":"Feedback, fairness, and validity: effects of disclosing and reusing multiple-choice questions in medical schools","title_sort":"Feedback, fairness, and validity: effects of disclosing and reusing multiple-choice questions in medical schools"}],"id":{"eki":["1843446316"],"doi":["10.1080/10872981.2022.2143298"]},"recId":"1843446316","name":{"displayForm":["Stefan Appelhaus, Susanne Werner, Pascal Grosse and Juliane E. Kämmer"]},"note":["Published online: 09 Nov 2022","Gesehen am 08.05.2023"],"physDesc":[{"extent":"7 S."}],"relHost":[{"recId":"332165809","id":{"zdb":["2052877-2"],"eki":["332165809"],"issn":["1087-2981"]},"pubHistory":["1.1996 -"],"origin":[{"dateIssuedKey":"1996","dateIssuedDisp":"1996-","publisherPlace":"East Lansing, Mich.","publisher":"[Verlag nicht ermittelbar]"}],"part":{"issue":"1","pages":"1-7","year":"2023","text":"28(2023), 1, Artikel-ID 2143298, Seite 1-7","extent":"7","volume":"28"},"note":["Gesehen am 23.06.20"],"type":{"media":"Online-Ressource","bibl":"periodical"},"title":[{"title_sort":"Medical education online","subtitle":"MEO ; an electronic journal","title":"Medical education online"}],"titleAlt":[{"title":"MEO"}],"language":["eng"],"disp":"Feedback, fairness, and validity: effects of disclosing and reusing multiple-choice questions in medical schoolsMedical education online"}],"language":["eng"],"origin":[{"dateIssuedDisp":"2023","dateIssuedKey":"2023"}]} | ||
| SRT | |a APPELHAUSSFEEDBACKFA2023 | ||