The quality of response time data inference: a blinded, collaborative assessment of the validity of cognitive models
Most data analyses rely on models. To complement statistical models, psychologists have developed cognitive models, which translate observed variables into psychologically interesting constructs. Response time models, in particular, assume that response time and accuracy are the observed expression...
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
2018
|
| In: |
Psychonomic bulletin & review
Year: 2019, Jahrgang: 26, Heft: 4, Pages: 1051–1069 |
| ISSN: | 1531-5320 |
| DOI: | 10.3758/s13423-017-1417-2 |
| Online-Zugang: | Verlag, lizenzpflichtig, Volltext: http://dx.doi.org/10.3758/s13423-017-1417-2 Verlag, lizenzpflichtig, Volltext: https://link.springer.com/article/10.3758/s13423-017-1417-2 
|
| Verfasserangaben: | Gilles Dutilh, Jeffrey Annis, Scott D. Brown, Peter Cassey, Nathan J. Evans, Raoul P. P. P. Grasman, Guy E. Hawkins, Andrew Heathcote, William R. Holmes, Angelos-Miltiadis Krypotos, Colin N. Kupitz, Fábio P. Leite, Veronika Lerche, Yi-Shin Lin, Gordon D. Logan, Thomas J. Palmeri, Jeffrey J. Starns, Jennifer S. Trueblood, Leendert van Maanen, Don van Ravenzwaaij, Joachim Vandekerckhove, Ingmar Visser, Andreas Voss, Corey N. White, Thomas V. Wiecki, Jörg Rieskamp, Chris Donkin |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1571522794 | ||
| 003 | DE-627 | ||
| 005 | 20220814102757.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 180328s2019 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.3758/s13423-017-1417-2 |2 doi | |
| 035 | |a (DE-627)1571522794 | ||
| 035 | |a (DE-576)501522794 | ||
| 035 | |a (DE-599)BSZ501522794 | ||
| 035 | |a (OCoLC)1341000655 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 11 |2 sdnb | ||
| 100 | 1 | |a Dutilh, Gilles |e VerfasserIn |0 (DE-588)1155274393 |0 (DE-627)1016599196 |0 (DE-576)501523537 |4 aut | |
| 245 | 1 | 4 | |a The quality of response time data inference |b a blinded, collaborative assessment of the validity of cognitive models |c Gilles Dutilh, Jeffrey Annis, Scott D. Brown, Peter Cassey, Nathan J. Evans, Raoul P. P. P. Grasman, Guy E. Hawkins, Andrew Heathcote, William R. Holmes, Angelos-Miltiadis Krypotos, Colin N. Kupitz, Fábio P. Leite, Veronika Lerche, Yi-Shin Lin, Gordon D. Logan, Thomas J. Palmeri, Jeffrey J. Starns, Jennifer S. Trueblood, Leendert van Maanen, Don van Ravenzwaaij, Joachim Vandekerckhove, Ingmar Visser, Andreas Voss, Corey N. White, Thomas V. Wiecki, Jörg Rieskamp, Chris Donkin |
| 264 | 1 | |c 2018 | |
| 300 | |a 19 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Published online: 15 February 2018 | ||
| 500 | |a Gesehen am 05.10.2020 | ||
| 520 | |a Most data analyses rely on models. To complement statistical models, psychologists have developed cognitive models, which translate observed variables into psychologically interesting constructs. Response time models, in particular, assume that response time and accuracy are the observed expression of latent variables including 1) ease of processing, 2) response caution, 3) response bias, and 4) non-decision time. Inferences about these psychological factors hinge upon the validity of the models’ parameters. Here, we use a blinded, collaborative approach to assess the validity of such model-based inferences. Seventeen teams of researchers analyzed the same 14 data sets. In each of these two-condition data sets, we manipulated properties of participants’ behavior in a two-alternative forced choice task. The contributing teams were blind to the manipulations, and had to infer what aspect of behavior was changed using their method of choice. The contributors chose to employ a variety of models, estimation methods, and inference procedures. Our results show that, although conclusions were similar across different methods, these "modeler’s degrees of freedom" did affect their inferences. Interestingly, many of the simpler approaches yielded as robust and accurate inferences as the more complex methods. We recommend that, in general, cognitive models become a typical analysis tool for response time data. In particular, we argue that the simpler models and procedures are sufficient for standard experimental designs. We finish by outlining situations in which more complicated models and methods may be necessary, and discuss potential pitfalls when interpreting the output from response time models. | ||
| 700 | 1 | |a Lerche, Veronika |e VerfasserIn |0 (DE-588)1042780285 |0 (DE-627)769657605 |0 (DE-576)39421465X |4 aut | |
| 700 | 1 | |a Voß, Andreas |d 1972- |e VerfasserIn |0 (DE-588)1028372574 |0 (DE-627)730618919 |0 (DE-576)375905065 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Psychonomic bulletin & review |d New York, NY : Springer, 1994 |g 26(2019), 4, Seite 1051–1069 |h Online-Ressource |w (DE-627)324827121 |w (DE-600)2031311-1 |w (DE-576)093983999 |x 1531-5320 |7 nnas |a The quality of response time data inference a blinded, collaborative assessment of the validity of cognitive models |
| 773 | 1 | 8 | |g volume:26 |g year:2019 |g number:4 |g pages:1051–1069 |g extent:19 |a The quality of response time data inference a blinded, collaborative assessment of the validity of cognitive models |
| 856 | 4 | 0 | |u http://dx.doi.org/10.3758/s13423-017-1417-2 |x Verlag |x Resolving-System |z lizenzpflichtig |3 Volltext |
| 856 | 4 | 0 | |u https://link.springer.com/article/10.3758/s13423-017-1417-2 |x Verlag |z lizenzpflichtig |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20180328 | ||
| 993 | |a Article | ||
| 994 | |a 2019 | ||
| 998 | |g 1028372574 |a Voß, Andreas |m 1028372574:Voß, Andreas |d 100000 |d 100200 |e 100000PV1028372574 |e 100200PV1028372574 |k 0/100000/ |k 1/100000/100200/ |p 23 | ||
| 998 | |g 1042780285 |a Lerche, Veronika |m 1042780285:Lerche, Veronika |d 100000 |d 100200 |e 100000PL1042780285 |e 100200PL1042780285 |k 0/100000/ |k 1/100000/100200/ |p 13 | ||
| 999 | |a KXP-PPN1571522794 |e 3004452995 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"physDesc":[{"extent":"19 S."}],"recId":"1571522794","origin":[{"dateIssuedKey":"2019","dateIssuedDisp":"2018"}],"relHost":[{"title":[{"title_sort":"Psychonomic bulletin & review","title":"Psychonomic bulletin & review","subtitle":"a journal of the Psychonomic Society"}],"language":["eng"],"type":{"media":"Online-Ressource","bibl":"periodical"},"note":["Gesehen am 01.03.13"],"origin":[{"publisher":"Springer ; Psychonomic Society Publ.","dateIssuedDisp":"1994-","dateIssuedKey":"1994","publisherPlace":"New York, NY ; Austin, Tex."}],"disp":"The quality of response time data inference a blinded, collaborative assessment of the validity of cognitive modelsPsychonomic bulletin & review","recId":"324827121","physDesc":[{"extent":"Online-Ressource"}],"id":{"eki":["324827121"],"issn":["1531-5320"],"zdb":["2031311-1"]},"part":{"pages":"1051–1069","issue":"4","extent":"19","text":"26(2019), 4, Seite 1051–1069","year":"2019","volume":"26"},"titleAlt":[{"title":"PB&R"},{"title":"Psychonomic bulletin and review"}],"pubHistory":["1.1994 -"],"corporate":[{"display":"Psychonomic Society","role":"isb"}]}],"person":[{"display":"Dutilh, Gilles","family":"Dutilh","role":"aut","given":"Gilles"},{"display":"Lerche, Veronika","given":"Veronika","role":"aut","family":"Lerche"},{"display":"Voß, Andreas","given":"Andreas","role":"aut","family":"Voß"}],"type":{"bibl":"article-journal","media":"Online-Ressource"},"language":["eng"],"note":["Published online: 15 February 2018","Gesehen am 05.10.2020"],"title":[{"subtitle":"a blinded, collaborative assessment of the validity of cognitive models","title_sort":"quality of response time data inference","title":"The quality of response time data inference"}],"name":{"displayForm":["Gilles Dutilh, Jeffrey Annis, Scott D. Brown, Peter Cassey, Nathan J. Evans, Raoul P. P. P. Grasman, Guy E. Hawkins, Andrew Heathcote, William R. Holmes, Angelos-Miltiadis Krypotos, Colin N. Kupitz, Fábio P. Leite, Veronika Lerche, Yi-Shin Lin, Gordon D. Logan, Thomas J. Palmeri, Jeffrey J. Starns, Jennifer S. Trueblood, Leendert van Maanen, Don van Ravenzwaaij, Joachim Vandekerckhove, Ingmar Visser, Andreas Voss, Corey N. White, Thomas V. Wiecki, Jörg Rieskamp, Chris Donkin"]},"id":{"eki":["1571522794"],"doi":["10.3758/s13423-017-1417-2"]}} | ||
| SRT | |a DUTILHGILLQUALITYOFR2018 | ||