Computerized adaptive testing: the capitalization on chance problem

Biblos-e Archivo/Manakin Repository

Show simple item record Olea Díaz, Julio es_ES Barrada, Juan Ramón es_ES Abad García, Francisco José es_ES Ponsoda, Vicente es_ES
dc.contributor.other UAM. Departamento de Psicología Social y Metodología es_ES 2015-04-27T18:01:28Z 2015-04-27T18:01:28Z 2013-01-10
dc.identifier.citation Spanish Journal of Psychology 15.1 (2012): 424-441 en_US
dc.identifier.issn 1138-7416 (print) en_US
dc.identifier.issn 1988-2904 (online) en_US
dc.description.abstract This paper describes several simulation studies that examine the effects of capitalization on chance in the selection of items and the ability estimation in CAT, employing the 3-parameter logistic model. In order to generate different estimation errors for the item parameters, the calibration sample size was manipulated (! = 500, 1000 and 2000 subjects) as was the ratio of item bank size to test length (banks of 197 and 788 items, test lengths of 20 and 40 items), both in a CAT and in a random test. Results show that capitalization on chance is particularly serious in CAT, as revealed by the large positive bias found in the small sample calibration conditions. For broad ranges of θ, the overestimation of the precision (asymptotic Se) reaches levels of 40%, something that does not occur with the RMSE (θ). The problem is greater as the item bank size to test length ratio increases. Potential solutions were tested in a second study, where two exposure control methods were incorporated into the item selection algorithm. Some alternative solutions are discussed. en_US
dc.description.sponsorship This research was partly supported by two grants from the Spanish Ministerio de Educación y Ciencia (projects PSI2008-01685 and PSI2009-10341) and by the UAM-IIC Chair Psychometric Models and Applications. en_US
dc.format.extent 18 pag. es_ES
dc.format.mimetype application/pdf en_US
dc.language.iso eng en_US
dc.publisher Cambridge University Press en_US
dc.relation.ispartof Spanish Journal of Psychology en_US
dc.rights © Copyright 2012 by The Spanish Journal of Psychology en_US
dc.subject.other Computerized adaptive testing en_US
dc.subject.other Capitalization on chance en_US
dc.subject.other Ítem parameter estimation en_US
dc.title Computerized adaptive testing: the capitalization on chance problem en_US
dc.type article en_US
dc.subject.eciencia Psicología es_ES
dc.relation.publisherversion en_US
dc.identifier.doi 10.5209/rev_SJOP.2012.v15.n1.37348 es_ES
dc.identifier.publicationfirstpage 424 es_ES
dc.identifier.publicationissue 1 es_ES
dc.identifier.publicationlastpage 441 es_ES
dc.identifier.publicationvolume 15 es_ES
dc.relation.projectID Gobierno de España. PSI2008-01685 es_ES
dc.relation.projectID Gobierno de España. PSI2009-10341 es_ES
dc.type.version info:eu-repo/semantics/publishedVersion en_US
dc.rights.accessRights openAccess en_US
dc.authorUAM Abad García, Francisco José (260351)
dc.authorUAM Ponsoda Gil, Vicente (259297)
dc.authorUAM Olea Díaz, Julio Alberto (259229)

Files in this item


This item appears in the following Collection(s)

Show simple item record