Impact of usability mechanisms: a family of experiments on efficiency, effectiveness and user satisfaction
Entity
UAM. Departamento de Ingeniería InformáticaPublisher
IEEEDate
2022-02-08Citation
10.1109/TSE.2022.3149586
IEEE Transactions on Software Engineering 49.1 (2023) 251-267
ISSN
0098-5589 (print); 1939-3520 (online); 2326-3881 (CD)DOI
10.1109/TSE.2022.3149586Funded by
This work was funded in part by the FEDER/Spanish Ministry of Science and Innovation-Research State Agency (MASSIVE) under Grants RTI2018- 095255-B-I00 and PGC2018-097265-B-I00, and in part by the R&D pro gramme of Madrid FORTE, under Grant P2018/TCS-4314Project
Gobierno de España. RTI2018- 095255-B-I00; Gobierno de España. PGC2018-097265-B-I00; Comunidad de Madrid. P2018/TCS-4314Editor's Version
https://doi.org/10.1109/TSE.2022.3149586Subjects
effectiveness; efficiency; experimental software engineering; family of experiments; satisfaction; Usability mechanism; InformáticaAbstract
Context: The usability software quality characteristic aims to improve system user performance. In a previous study, we found evidence of the impact of a set of usability features from the viewpoint of users in terms of efficiency, effectiveness and satisfaction. However, the impact level appears to depend on the usability feature and suggest priorities with respect to their implementation depending on how they promote user performance. Objectives: We use a family of three experiments to increase the precision and generalization of the results in the baseline experiment and provide findings regarding the impact on user performance of the Abort Operation, Progress Feedback and Preferences usability mechanisms. Method: We conduct two replications of the baseline experiment in academic settings. We analyse the data of 366 experimental subjects and apply aggregation (meta-analysis) procedures. Results: We find that the Abort Operation and Preferences usability mechanisms appear to improve system usability a great deal with respect to efficiency, effectiveness and user satisfaction. Conclusions: We find that the family of experiments further corroborates the results of the baseline experiment. Most of the results are statistically significant, and, because of the large number of experimental subjects, the evidence that we gathered in the replications is sufficient to outweigh other experiments
Files in this item
Google Scholar:Ferreira, Juan M.
-
Rodríguez, Francy D.
-
Santos, Adrián
-
Dieste, Oscar
-
Acuña Castillo, Silvia Teresita
-
Juristo, Natalia
This item appears in the following Collection(s)
Related items
Showing items related by title, author, creator and subject.