A multitrait-multimethod study of assessment instruments for complex problem solving

Recently published studies on Complex Problem Solving (CPS) suggest that assessments of CPS using multiple complex systems are only moderately related to tests of classical cognitive abilities. Further, CPS assessments show incremental validity beyond tests of other cognitive abilities when predicti...

Full description

Saved in:
Bibliographic Details
Main Authors: Greiff, Samuel (Author) , Fischer, Andreas (Author) , Wüstenberg, Sascha (Author) , Sonnleitner, Philipp (Author) , Brunner, Martin (Author) , Martin, Romain (Author)
Format: Article (Journal)
Language:English
Published: 23 August 2013
In: Intelligence
Year: 2013, Volume: 41, Issue: 5, Pages: 579-596
ISSN:1873-7935
DOI:10.1016/j.intell.2013.07.012
Online Access:Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1016/j.intell.2013.07.012
Verlag, lizenzpflichtig, Volltext: https://www.sciencedirect.com/science/article/pii/S0160289613001050
Get full text
Author Notes:Samuel Greiff, Andreas Fischer, Sascha Wüstenberg, Philipp Sonnleitner, Martin Brunner, Romain Martin

MARC

LEADER 00000caa a2200000 c 4500
001 175113279X
003 DE-627
005 20220819133400.0
007 cr uuu---uuuuu
008 210311s2013 xx |||||o 00| ||eng c
024 7 |a 10.1016/j.intell.2013.07.012  |2 doi 
035 |a (DE-627)175113279X 
035 |a (DE-599)KXP175113279X 
035 |a (OCoLC)1341398558 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 11  |2 sdnb 
100 1 |a Greiff, Samuel  |d 1979-  |e VerfasserIn  |0 (DE-588)132816792  |0 (DE-627)527110094  |0 (DE-576)265589533  |4 aut 
245 1 2 |a A multitrait-multimethod study of assessment instruments for complex problem solving  |c Samuel Greiff, Andreas Fischer, Sascha Wüstenberg, Philipp Sonnleitner, Martin Brunner, Romain Martin 
264 1 |c 23 August 2013 
300 |a 18 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Gesehen am 11.03.2021 
520 |a Recently published studies on Complex Problem Solving (CPS) suggest that assessments of CPS using multiple complex systems are only moderately related to tests of classical cognitive abilities. Further, CPS assessments show incremental validity beyond tests of other cognitive abilities when predicting relevant outcomes. However, these empirical accounts have relied on single CPS assessment instruments. We do not know whether these findings will generalize to the construct level across different CPS assessment instruments. To answer this question, we tested a sample of N=339 German university students who completed three CPS assessment instruments based on multiple complex systems (MicroDYN, the Genetics Lab, and MicroFIN) and the matrices subtest of the Intelligence Structure Test as measure of reasoning. Students further reported their school grades. Analyses including latent multitrait-multimethod models provided support for the conceptualization of CPS as a complex cognitive ability. Results indicated that different CPS assessment instruments showed sufficient convergent validity (with a consistency mostly between .50 and .60). In addition, we found evidence for the divergent validity of CPS from reasoning (reasoning predicted two CPS facets, knowledge and control, βKNOW=.49 and βCON=.53, respectively). In the prediction of academic achievement, CPS explained variance in natural science grades after we controlled for reasoning (βCPS=.22), whereas social science grades were not predicted. Our findings suggest that the validity of CPS generalizes across different measurement instruments. 
650 4 |a Complex Problem Solving 
650 4 |a Genetics Lab 
650 4 |a MicroDYN 
650 4 |a MicroFIN 
650 4 |a Reasoning 
700 1 |a Fischer, Andreas  |e VerfasserIn  |0 (DE-588)1213099099  |0 (DE-627)1703411463  |0 (DE-576)452155061  |4 aut 
700 1 |a Wüstenberg, Sascha  |d 1982-  |e VerfasserIn  |0 (DE-588)1033571342  |0 (DE-627)741663805  |0 (DE-576)381195252  |4 aut 
700 1 |a Sonnleitner, Philipp  |e VerfasserIn  |4 aut 
700 1 |a Brunner, Martin  |e VerfasserIn  |4 aut 
700 1 |a Martin, Romain  |e VerfasserIn  |4 aut 
773 0 8 |i Enthalten in  |t Intelligence  |d [Amsterdam] : Elsevier, 1977  |g 41(2013), 5, Seite 579-596  |h Online-Ressource  |w (DE-627)319720993  |w (DE-600)2013999-8  |w (DE-576)099879069  |x 1873-7935  |7 nnas  |a A multitrait-multimethod study of assessment instruments for complex problem solving 
773 1 8 |g volume:41  |g year:2013  |g number:5  |g pages:579-596  |g extent:18  |a A multitrait-multimethod study of assessment instruments for complex problem solving 
776 0 8 |i Erscheint auch als  |n Druck-Ausgabe  |a Greiff, Samuel, 1979 -   |t A multitrait-multimethod study of assessment instruments for complex problem solving  |d 2013  |w (DE-627)163925823X  |w (DE-576)407271945 
856 4 0 |u https://doi.org/10.1016/j.intell.2013.07.012  |x Verlag  |x Resolving-System  |z lizenzpflichtig  |3 Volltext 
856 4 0 |u https://www.sciencedirect.com/science/article/pii/S0160289613001050  |x Verlag  |z lizenzpflichtig  |3 Volltext 
951 |a AR 
992 |a 20210311 
993 |a Article 
994 |a 2013 
998 |g 1033571342  |a Wüstenberg, Sascha  |m 1033571342:Wüstenberg, Sascha  |d 100000  |e 100000PW1033571342  |k 0/100000/  |p 3 
998 |g 1213099099  |a Fischer, Andreas  |m 1213099099:Fischer, Andreas  |d 100000  |d 100200  |e 100000PF1213099099  |e 100200PF1213099099  |k 0/100000/  |k 1/100000/100200/  |p 2 
998 |g 132816792  |a Greiff, Samuel  |m 132816792:Greiff, Samuel  |p 1  |x j 
999 |a KXP-PPN175113279X  |e 3884777645 
BIB |a Y 
SER |a journal 
JSO |a {"title":[{"title":"A multitrait-multimethod study of assessment instruments for complex problem solving","title_sort":"multitrait-multimethod study of assessment instruments for complex problem solving"}],"language":["eng"],"name":{"displayForm":["Samuel Greiff, Andreas Fischer, Sascha Wüstenberg, Philipp Sonnleitner, Martin Brunner, Romain Martin"]},"note":["Gesehen am 11.03.2021"],"id":{"eki":["175113279X"],"doi":["10.1016/j.intell.2013.07.012"]},"recId":"175113279X","relHost":[{"part":{"pages":"579-596","volume":"41","extent":"18","issue":"5","year":"2013","text":"41(2013), 5, Seite 579-596"},"type":{"bibl":"periodical","media":"Online-Ressource"},"pubHistory":["1.1977 -"],"origin":[{"publisher":"Elsevier ; Ablex publishing corporation","dateIssuedKey":"1999","dateIssuedDisp":"1999-","publisherPlace":"[Amsterdam] ; Stamford, CT"}],"physDesc":[{"extent":"Online-Ressource"}],"id":{"issn":["1873-7935"],"zdb":["2013999-8"],"eki":["319720993"]},"recId":"319720993","note":["Gesehen am 28.08.2024","Volltext teilweise auch als Teil einer Datenbank verfügbar"],"title":[{"title_sort":"Intelligence","title":"Intelligence","subtitle":"a multidisciplinary journal"}],"language":["eng"],"disp":"A multitrait-multimethod study of assessment instruments for complex problem solvingIntelligence"}],"person":[{"given":"Samuel","family":"Greiff","display":"Greiff, Samuel","role":"aut","roleDisplay":"VerfasserIn"},{"role":"aut","roleDisplay":"VerfasserIn","display":"Fischer, Andreas","family":"Fischer","given":"Andreas"},{"display":"Wüstenberg, Sascha","family":"Wüstenberg","role":"aut","roleDisplay":"VerfasserIn","given":"Sascha"},{"given":"Philipp","roleDisplay":"VerfasserIn","role":"aut","display":"Sonnleitner, Philipp","family":"Sonnleitner"},{"family":"Brunner","display":"Brunner, Martin","role":"aut","roleDisplay":"VerfasserIn","given":"Martin"},{"given":"Romain","family":"Martin","display":"Martin, Romain","roleDisplay":"VerfasserIn","role":"aut"}],"physDesc":[{"extent":"18 S."}],"origin":[{"dateIssuedDisp":"23 August 2013","dateIssuedKey":"2013"}],"type":{"bibl":"article-journal","media":"Online-Ressource"}} 
SRT |a GREIFFSAMUMULTITRAIT2320