Evaluating the model fit of diffusion models with the root mean square error of approximation

The statistical evaluation of model fit is one of the greatest challenges in the application of diffusion modeling in research on individual differences. Relative model fit indices such as the AIC and BIC are often used for model comparison, but they provide no information about absolute model fit....

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Schubert, Anna-Lena (VerfasserIn) , Hagemann, Dirk (VerfasserIn) , Voß, Andreas (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: 2017
In: Journal of mathematical psychology
Year: 2017, Jahrgang: 77, Pages: 29-45
ISSN:0022-2496
DOI:10.1016/j.jmp.2016.08.004
Online-Zugang:Verlag, Pay-per-use, Volltext: http://dx.doi.org/10.1016/j.jmp.2016.08.004
Verlag, Pay-per-use, Volltext: http://www.sciencedirect.com/science/article/pii/S0022249616300712
Volltext
Verfasserangaben:Anna-Lena Schubert, Dirk Hagemann, Andreas Voss, Katharina Bergmann

MARC

LEADER 00000caa a2200000 c 4500
001 155983594X
003 DE-627
005 20220813183038.0
007 cr uuu---uuuuu
008 170619s2017 xx |||||o 00| ||eng c
024 7 |a 10.1016/j.jmp.2016.08.004  |2 doi 
035 |a (DE-627)155983594X 
035 |a (DE-576)489835945 
035 |a (DE-599)BSZ489835945 
035 |a (OCoLC)1340976154 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 11  |2 sdnb 
100 1 |a Schubert, Anna-Lena  |e VerfasserIn  |0 (DE-588)1078232504  |0 (DE-627)838182631  |0 (DE-576)449147290  |4 aut 
245 1 0 |a Evaluating the model fit of diffusion models with the root mean square error of approximation  |c Anna-Lena Schubert, Dirk Hagemann, Andreas Voss, Katharina Bergmann 
246 3 0 |a sqrt 
264 1 |c 2017 
300 |a 17 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Gesehen am 19.06.2017 
520 |a The statistical evaluation of model fit is one of the greatest challenges in the application of diffusion modeling in research on individual differences. Relative model fit indices such as the AIC and BIC are often used for model comparison, but they provide no information about absolute model fit. Statistical and graphical tests can be used to identify individuals whose data cannot be accounted for by the diffusion model, but they become overly sensitive when trial numbers are large, and are subjective and time-consuming. We propose that the evaluation of model fit may be supplemented with the root mean square error of approximation (RMSEA; Steiger & Lind, 1980), which is one of the most popular goodness-of-fit indices in structural equation modeling. It is largely invariant to trial numbers, and allows identifying cases with poor model fit, calculating confidence intervals, and conducting power analyses. In two simulation studies, we evaluated whether the RMSEA correctly rejects badly-fitting models irrespective of trial numbers. Moreover, we evaluated how variation in the number of trials, the degree of measurement noise, the presence of contaminant outliers, and the number of estimated parameters affect RMSEA values. The RMSEA correctly distinguished between well- and badly-fitting models unless trial numbers were very small. Moreover, RMSEA values were in a value range expected from structural equation modeling. Finally, we computed cut-off values as heuristics for model acceptance or rejection. In a third simulation study we assessed how the RMSEA performs in model selection in comparison to the AIC and BIC. The RMSEA correctly identified the generating model in the majority of cases, but was outperformed by the AIC and BIC. All in all, we showed that the RMSEA can be of great value in the evaluation of absolute model fit, but that it should only be used in addition to other fit indices in model selection scenarios. 
650 4 |a Diffusion model 
650 4 |a Model fit 
650 4 |a Reaction times 
650 4 |a Root mean square error of approximation 
700 1 |a Hagemann, Dirk  |d 19XX-  |e VerfasserIn  |0 (DE-588)1018146512  |0 (DE-627)690526709  |0 (DE-576)355113759  |4 aut 
700 1 |a Voß, Andreas  |d 1972-  |e VerfasserIn  |0 (DE-588)1028372574  |0 (DE-627)730618919  |0 (DE-576)375905065  |4 aut 
773 0 8 |i Enthalten in  |t Journal of mathematical psychology  |d Orlando, Fla. : Academic Press, 1964  |g 77(2017), Seite 29-45  |h Online-Ressource  |w (DE-627)270425713  |w (DE-600)1477252-8  |w (DE-576)104194111  |x 0022-2496  |7 nnas  |a Evaluating the model fit of diffusion models with the root mean square error of approximation 
773 1 8 |g volume:77  |g year:2017  |g pages:29-45  |g extent:17  |a Evaluating the model fit of diffusion models with the root mean square error of approximation 
856 4 0 |u http://dx.doi.org/10.1016/j.jmp.2016.08.004  |x Verlag  |x Resolving-System  |z Pay-per-use  |3 Volltext 
856 4 0 |u http://www.sciencedirect.com/science/article/pii/S0022249616300712  |x Verlag  |z Pay-per-use  |3 Volltext 
951 |a AR 
992 |a 20170619 
993 |a Article 
994 |a 2017 
998 |g 1028372574  |a Voß, Andreas  |m 1028372574:Voß, Andreas  |d 100000  |d 100200  |e 100000PV1028372574  |e 100200PV1028372574  |k 0/100000/  |k 1/100000/100200/  |p 3 
998 |g 1018146512  |a Hagemann, Dirk  |m 1018146512:Hagemann, Dirk  |d 100000  |d 100200  |e 100000PH1018146512  |e 100200PH1018146512  |k 0/100000/  |k 1/100000/100200/  |p 2 
998 |g 1078232504  |a Schubert, Anna-Lena  |m 1078232504:Schubert, Anna-Lena  |d 100000  |d 100200  |e 100000PS1078232504  |e 100200PS1078232504  |k 0/100000/  |k 1/100000/100200/  |p 1  |x j 
999 |a KXP-PPN155983594X  |e 2972064569 
BIB |a Y 
SER |a journal 
JSO |a {"id":{"doi":["10.1016/j.jmp.2016.08.004"],"eki":["155983594X"]},"name":{"displayForm":["Anna-Lena Schubert, Dirk Hagemann, Andreas Voss, Katharina Bergmann"]},"note":["Gesehen am 19.06.2017"],"language":["eng"],"type":{"media":"Online-Ressource","bibl":"article-journal"},"title":[{"title":"Evaluating the model fit of diffusion models with the root mean square error of approximation","title_sort":"Evaluating the model fit of diffusion models with the root mean square error of approximation"}],"person":[{"role":"aut","given":"Anna-Lena","family":"Schubert","display":"Schubert, Anna-Lena"},{"family":"Hagemann","role":"aut","given":"Dirk","display":"Hagemann, Dirk"},{"display":"Voß, Andreas","family":"Voß","role":"aut","given":"Andreas"}],"relHost":[{"origin":[{"dateIssuedKey":"1964","publisherPlace":"Orlando, Fla.","dateIssuedDisp":"1964-","publisher":"Academic Press"}],"language":["eng"],"type":{"bibl":"periodical","media":"Online-Ressource"},"note":["Gesehen am 30.05.08"],"title":[{"title_sort":"Journal of mathematical psychology","title":"Journal of mathematical psychology"}],"physDesc":[{"extent":"Online-Ressource"}],"recId":"270425713","disp":"Evaluating the model fit of diffusion models with the root mean square error of approximationJournal of mathematical psychology","corporate":[{"role":"isb","display":"Society for Mathematical Psychology"}],"name":{"displayForm":["affiliated with the Society for Mathematical Psychology"]},"pubHistory":["1.1964 -"],"id":{"zdb":["1477252-8"],"eki":["270425713"],"issn":["0022-2496"]},"part":{"pages":"29-45","year":"2017","text":"77(2017), Seite 29-45","volume":"77","extent":"17"}}],"origin":[{"dateIssuedKey":"2017","dateIssuedDisp":"2017"}],"physDesc":[{"extent":"17 S."}],"recId":"155983594X"} 
SRT |a SCHUBERTANEVALUATING2017