Unfolding the phenomenon of interrater agreement: a multicomponent approach for in-depth examination was proposed
OBJECTIVE: The overall objective was to unfold the phenomenon of interrater agreement: to identify potential sources of variation in agreement data and to explore how they can be statistically accounted for. The ultimate aim was to propose recommendations for in-depth examination of agreement to imp...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article (Journal) |
| Language: | English |
| Published: |
2012
|
| In: |
Journal of clinical epidemiology
Year: 2012, Volume: 65, Issue: 9, Pages: 1016-1025 |
| ISSN: | 1878-5921 |
| DOI: | 10.1016/j.jclinepi.2012.02.016 |
| Online Access: | Verlag, Volltext: http://dx.doi.org/10.1016/j.jclinepi.2012.02.016
|
| Author Notes: | Björn Slaug, Oliver Schilling, Tina Helle, Susanne Iwarsson, Gunilla Carlsson and Åse Brandt |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1668817640 | ||
| 003 | DE-627 | ||
| 005 | 20220816185535.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 190709s2012 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.jclinepi.2012.02.016 |2 doi | |
| 035 | |a (DE-627)1668817640 | ||
| 035 | |a (DE-599)KXP1668817640 | ||
| 035 | |a (OCoLC)1341233324 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 11 |2 sdnb | ||
| 100 | 1 | |a Slaug, Björn |e VerfasserIn |0 (DE-588)1153039958 |0 (DE-627)1014424925 |0 (DE-576)382683455 |4 aut | |
| 245 | 1 | 0 | |a Unfolding the phenomenon of interrater agreement |b a multicomponent approach for in-depth examination was proposed |c Björn Slaug, Oliver Schilling, Tina Helle, Susanne Iwarsson, Gunilla Carlsson and Åse Brandt |
| 264 | 1 | |c 2012 | |
| 300 | |a 10 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 09.07.2019 | ||
| 520 | |a OBJECTIVE: The overall objective was to unfold the phenomenon of interrater agreement: to identify potential sources of variation in agreement data and to explore how they can be statistically accounted for. The ultimate aim was to propose recommendations for in-depth examination of agreement to improve the reliability of assessment instruments. - STUDY DESIGN AND SETTING: Using a sample where 10 rater pairs had assessed the presence/absence of 188 environmental barriers by a systematic rating form, a raters × items data set was generated (N=1,880). In addition to common agreement indices, relative shares of agreement variation were calculated. Multilevel regression analysis was carried out, using rater and item characteristics as predictors of agreement variation. - RESULTS: Following a conceptual decomposition, the agreement variation was statistically disentangled into relative shares. The raters accounted for 6-11%, the items for 32-33%, and the residual for 57-60% of the variation. Multilevel regression analysis showed barrier prevalence and raters' familiarity with using standardized instruments to have the strongest impact on agreement. - CONCLUSION: Supported by a conceptual analysis, we propose an approach of in-depth examination of agreement variation, as a strategy for increasing the level of interrater agreement. By identifying and limiting the most important sources of disagreement, instrument reliability can be improved ultimately. | ||
| 650 | 4 | |a Consensus | |
| 650 | 4 | |a Humans | |
| 650 | 4 | |a Observer Variation | |
| 650 | 4 | |a Regression Analysis | |
| 650 | 4 | |a Reproducibility of Results | |
| 650 | 4 | |a Research | |
| 700 | 1 | |a Schilling, Oliver |d 1968- |e VerfasserIn |0 (DE-588)123234646 |0 (DE-627)706220242 |0 (DE-576)293615764 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Journal of clinical epidemiology |d Amsterdam [u.a.] : Elsevier Science, 1988 |g 65(2012), 9, Seite 1016-1025 |h Online-Ressource |w (DE-627)306659700 |w (DE-600)1500490-9 |w (DE-576)081986343 |x 1878-5921 |7 nnas |a Unfolding the phenomenon of interrater agreement a multicomponent approach for in-depth examination was proposed |
| 773 | 1 | 8 | |g volume:65 |g year:2012 |g number:9 |g pages:1016-1025 |g extent:10 |a Unfolding the phenomenon of interrater agreement a multicomponent approach for in-depth examination was proposed |
| 776 | 0 | 8 | |i Erscheint auch als |n Druck-Ausgabe |t Unfolding the phenomenon of interrater agreement |d 2012 |w (DE-627)1632018047 |w (DE-576)38268365X |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.jclinepi.2012.02.016 |x Verlag |x Resolving-System |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20190709 | ||
| 993 | |a Article | ||
| 994 | |a 2012 | ||
| 998 | |g 123234646 |a Schilling, Oliver |m 123234646:Schilling, Oliver |d 100000 |d 100200 |e 100000PS123234646 |e 100200PS123234646 |k 0/100000/ |k 1/100000/100200/ |p 2 | ||
| 999 | |a KXP-PPN1668817640 |e 3492176291 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"name":{"displayForm":["Björn Slaug, Oliver Schilling, Tina Helle, Susanne Iwarsson, Gunilla Carlsson and Åse Brandt"]},"origin":[{"dateIssuedDisp":"2012","dateIssuedKey":"2012"}],"id":{"doi":["10.1016/j.jclinepi.2012.02.016"],"eki":["1668817640"]},"physDesc":[{"extent":"10 S."}],"relHost":[{"id":{"eki":["306659700"],"zdb":["1500490-9"],"issn":["1878-5921"]},"origin":[{"dateIssuedDisp":"1988-","publisher":"Elsevier Science","dateIssuedKey":"1988","publisherPlace":"Amsterdam [u.a.]"}],"physDesc":[{"extent":"Online-Ressource"}],"title":[{"subtitle":"including pharmacoepidemiology reports","title":"Journal of clinical epidemiology","title_sort":"Journal of clinical epidemiology"}],"part":{"pages":"1016-1025","issue":"9","year":"2012","extent":"10","text":"65(2012), 9, Seite 1016-1025","volume":"65"},"pubHistory":["Nachgewiesen 41.1988 -"],"language":["eng"],"recId":"306659700","note":["Gesehen am 04.05.07"],"type":{"media":"Online-Ressource","bibl":"periodical"},"disp":"Unfolding the phenomenon of interrater agreement a multicomponent approach for in-depth examination was proposedJournal of clinical epidemiology"}],"person":[{"role":"aut","roleDisplay":"VerfasserIn","display":"Slaug, Björn","given":"Björn","family":"Slaug"},{"role":"aut","roleDisplay":"VerfasserIn","display":"Schilling, Oliver","given":"Oliver","family":"Schilling"}],"title":[{"title_sort":"Unfolding the phenomenon of interrater agreement","title":"Unfolding the phenomenon of interrater agreement","subtitle":"a multicomponent approach for in-depth examination was proposed"}],"note":["Gesehen am 09.07.2019"],"type":{"bibl":"article-journal","media":"Online-Ressource"},"language":["eng"],"recId":"1668817640"} | ||
| SRT | |a SLAUGBJOERUNFOLDINGT2012 | ||