Modeling wording effects does not help in recovering uncontaminated person scores: A systematic evaluation with random intercept item factor analysis
Entity
UAM. Departamento de Psicología Social y MetodologíaPublisher
Frontiers Media SADate
2021-06-02Citation
10.3389/fpsyg.2021.685326
Frontiers In Psychology 12 (2021): 685326
ISSN
1664-1078 (online)DOI
10.3389/fpsyg.2021.685326Funded by
This research was partially supported jointly by the Grant PSI2017-85022-P from the Ministerio de Ciencia, Innovación y Universidades (Spain), European Social Fund, and the UAMIIC Chair Psychometric Models and Applications (Instituto de Ingeniería del Conocimiento and Autonomous University of Madrid)Project
Gobierno de España. PSI2017-85022-PEditor's Version
https://doi.org/10.3389/fpsyg.2021.685326Subjects
acquiescence; carelessness; factor scores; method factor; structural equation modeling; wording effects; PsicologíaRights
© 2021 The AuthorsAbstract
The item wording (or keying) effect consists of logically inconsistent answers to positively and negatively worded items that tap into similar (but polarly opposite) content. Previous research has shown that this effect can be successfully modeled through the random intercept item factor analysis (RIIFA) model, as evidenced by the improvements in the model fit in comparison to models that only contain substantive factors. However, little is known regarding the capability of this model in recovering the uncontaminated person scores. To address this issue, the study analyzes the performance of the RIIFA approach across three types of wording effects proposed in the literature: carelessness, item verification difficulty, and acquiescence. In the context of unidimensional substantive models, four independent variables were manipulated, using Monte Carlo methods: type of wording effect, amount of wording effect, sample size, and test length. The results corroborated previous findings by showing that the RIIFA models were consistently able to account for the variance in the data, attaining an excellent fit regardless of the amount of bias. Conversely, the models without the RIIFA factor produced increasingly a poorer fit with greater amounts of wording effects. Surprisingly, however, the RIIFA models were not able to better estimate the uncontaminated person scores for any type of wording effect in comparison to the substantive unidimensional models. The simulation results were then corroborated with an empirical dataset, examining the relationship between learning strategies and personality with grade point average in undergraduate studies. The apparently paradoxical findings regarding the model fit and the recovery of the person scores are explained, considering the properties of the factor models examined
Files in this item
Google Scholar:Nieto, María Dolores
-
Garrido, Luis Eduardo
-
Martínez-Molina, Agustín
-
Abad García, Francisco José
This item appears in the following Collection(s)
Related items
Showing items related by title, author, creator and subject.
-
Effectiveness of a cognitive behavioral intervention in patients with medically unexplained symptoms: Cluster randomized trial
Lápez-García-Franco, Alberto; Del-Cura-González, Ma Isabel; Caballero Martínez, Luis; Sanz-Cuesta, Teresa; Díaz-García, Marta Isabel; Rodríguez Monje, Ma Teresa; Chahua, Marcela; Mũoz-Sanchez, Inmaculada; Serrano-González, Dolores; Rollán-Llanderas, Teresa; Nieto-Blanco, Esther; Losada-Cucco, Liliana; Caballero-Martínez, Fernando; Sanz-García, Nuria; Pose-García, Belén; Jurado-Sueiro, Montserrat; Rey, ManuelaLuque; De Blas González, Francisca García; Abanto, Ma Angeles Miguel; Bayona, Teresa Sanz; Ayllán-Camargo, Rafaela; Lopez, Inmaculada Santamaría; Hernando, María Luisa Santiago; Beltran-Alvarez, Rosario; Aguilar-Gutierrez, Ana Isabel; Mota-Rodriguez, Jose Luis; Cosculluela-Pueyo, Rafaél; Lápez-Martín-Aragán, Teresa; Bonilla-Sanchez, Rosa; Aritieda-González-Granda, Ma Carmen; Razola-Rincán, Raquel; Sanchez-de-la-Ventana, Ma Angeles; Martinez-Guinea, Concepcián; Huerta-Galindo, Luis; Barrio-Ovalle, Ana Belén; Miguel-Martín, Susana; Portero-Fraile, Paz; Pensado-Freire, Higinio; Herrera-Garcia, María Luisa; Azcoaga-Lorenzo, Amaya; Gámez-García, Inés; Llamas-Sandino, Nuria; Lápez-Borja, Isabel; Maldonado-Castro, Hortensia; Lumbreras-Villarán, Patricia; Ascanio-Durán, Carlos
2012-12-12 -
Effectiveness of immunosuppression minimisation, conversion or withdrawal strategies in paediatric solid organ and haematopoietic stem cell transplantation: A protocol of a systematic review and meta-analysis
Martin Saborido, Carlos; Borobia Pérez, Alberto M.; Cobas, Javier; D'Antiga, Lorenzo; Frauca, Esteban; Hernández-Oliveros, Francisco; Jara, Paloma; López-Granados, Eduardo; Muñoz, Jose María; Nicastro, Emanuele; Ojeda, Jose Jonay; Pérez Martínez, Antonio
; Torres, Juan Manuel; Carcas Sansuán, Antonio Javier
2020-12-03