Application of cognitive diagnosis models to competency-based situational judgment tests
Entity
UAM. Departamento de Psicología Social y MetodologíaPublisher
Colegio Oficial de Psicólogos del Principado de AsturiasDate
2014-08Citation
10.7334/psicothema2013.322
Psicothema 26.3 (2014): 372-377
ISSN
0214-9915 (print); 1886-144X (online)DOI
10.7334/psicothema2013.322Funded by
This research was supported in part by the UAM-IIC Chair for Psychometric Models and ApplicationsEditor's Version
http://dx.doi.org/10.7334/psicothema2013.322Subjects
Cognitive diagnosis models (CDM); G-DINA model; Situational judgment tests (SJT); Great eight model; Modelos de diagnóstico cognitivo (MDC); Modelo G-DINA; Tests de juicio situacional (TJS); Modelo great eight; Empresa; PsicologíaRights
© 2014 PsicothemaAbstract
Profiling of jobs in terms of competency requirements has increasingly been applied in many organizational settings. Testing these competencies through situational judgment tests (SJTs) leads to validity problems because it is not usually clear which constructs SJTs measure. The primary purpose of this paper is to evaluate whether the application of cognitive diagnosis models (CDM) to competency-based SJTs can ascertain the underlying competencies measured by the items, and whether these competencies can be estimated precisely. Method: The generalized deterministic inputs, noisy “and” gate (G-DINA) model was applied to 26 situational judgment items measuring professional
competencies based on the great eight model. These items were applied to 485 employees of a Spanish fi nancial company. The fi t of the model to the data and the convergent validity between the estimated competencies and personality dimensions were examined. Results: The G-DINA showed a good fi t to the data and the estimated competency factors, adapting and coping and interacting and presenting were positively related to emotional stability and extraversion, respectively. Conclusions: This work indicates that CDM can be a useful tool when measuring professional competencies
through SJTs. CDM can clarify the competencies being measured and provide precise estimates of these competencies Muchas organizaciones definen sus puestos de trabajo en base a las competencias profesionales que requieren. La medición de tales competencias mediante tests de juicio situacional (TJS) presenta problemas de validez, en tanto
no suele estar claro los constructos que miden. El objetivo principal de este estudio es evaluar si la aplicación de los modelos de diagnóstico cognitivo (MDC) a estos tests permite clarificar y estimar de forma precisa las competencias medidas. Método: se aplicó el modelo G-DINA (generalized deterministic inputs, noisy “and” gate) a 26 ítems de juicio situacional que medían competencias profesionales fundamentadas en el
modelo great eight. Se aplicó el test a 485 trabajadores de una entidad financiera española. Se examinó el ajuste del modelo a los datos, y la validez convergente entre las competencias estimadas y dimensiones de personalidad. Resultados: G-DINA mostró un buen ajuste a los datos, y los factores competenciales estimados adaptarse y aguantar, e interactuar y presentar mostraron una relación positiva con estabilidad emocional y extraversión, respectivamente. Conclusiones: este trabajo muestra que los
MDC pueden ser una herramienta útil para la medición de competencias profesionales a través de TJS, aclarando las competencias que miden y obteniendo estimaciones precisas de las mismas
Files in this item
Google Scholar:García, Pablo Eduardo
-
Olea Díaz, Julio
-
Torre, Jimmy de la
This item appears in the following Collection(s)
Related items
Showing items related by title, author, creator and subject.