Show simple item record

dc.contributor.authorRen, Rancies_ES
dc.contributor.authorCastro, John W.es_ES
dc.contributor.authorSantos, Adriánes_ES
dc.contributor.authorPérez Soler, Sara es_ES
dc.contributor.authorAcuña Castillo, Silvia Teresita es_ES
dc.contributor.authorLara Jaramillo, Juan de es_ES
dc.contributor.editorJingyue, Lien_US
dc.contributor.editorJaccheri, Letiziaen_US
dc.contributor.otherUAM. Departamento de Ingeniería Informáticaes_ES
dc.date.accessioned2022-07-06T12:31:18Zen_US
dc.date.available2022-07-06T12:31:18Zen_US
dc.date.issued2020-04-15en_US
dc.identifier.citationR. Ren, J. W. Castro, A. Santos, S. Pérez-Soler, S. T. Acuña and J. de Lara. “Collaborative modelling: chatbots or on-line tools? An experimental study”. In Proceedings of International Conference on Evaluation and Assessment in Software Engineering (EASE’20). ACM, New York, NY, USA (2020): 260-269en_US
dc.identifier.isbn9781450377317es_ES
dc.identifier.urihttp://hdl.handle.net/10486/702970en_US
dc.description© Owner/Author 2020. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in EASE '20: Proceedings of the Evaluation and Assessment in Software Engineering, https://doi.org/10.1145/3383219.3383246en_US
dc.description.abstractModelling is a fundamental activity in software engineering, which is often performed in collaboration. For this purpose, on-line tools running on the cloud are frequently used. However, recent advances in Natural Language Processing have fostered the emergence of chatbots, which are increasingly used for all sorts of software engineering tasks, including modelling. To evaluate to what extent chatbots are suitable for collaborative modelling, we conducted an experimental study with 54 participants, to evaluate the usability of a modelling chatbot called SOCIO, comparing it with the on-line tool Creately. We employed a within-subjects cross-over design of 2 sequences and 2 periods. Usability was determined by attributes of efficiency, effectiveness, satisfaction and quality of the results. We found that SOCIO saved time and reduced communication effort over Creately. SOCIO satisfied users to a greater extent than Creately, while in effectiveness results were similar. With respect to diagram quality, SOCIO outperformed Creately in terms of precision, while solutions with Creately had better recall and perceived success. However, in terms of accuracy and error scores, both tools were similaren_US
dc.description.sponsorshipWork funded by the Spanish Ministry of Science (project MASSIVE, RTI2018-095255-B-I00) and the R&D programme of Madrid (project FORTE, P2018/TCS-4314)en_US
dc.format.extent11 pag.en_US
dc.format.mimetypeapplication/pdfen_US
dc.language.isoengv
dc.publisherAssociation for Computing Machineryen_US
dc.relation.ispartofACM International Conference Proceeding Series: EASE '20: Proceedings of the Evaluation and Assessment in Software Engineeringen_US
dc.rights© The author(s)en_US
dc.subject.otherChatbotsen_US
dc.subject.otherCollaborative modellingen_US
dc.subject.otherEffectivenessen_US
dc.subject.otherEfficiencyen_US
dc.subject.otherQualityen_US
dc.subject.otherSatisfactionen_US
dc.subject.otherUsabilityen_US
dc.titleCollaborative Modelling: Chatbots or On-Line Tools? An Experimental Studyen_US
dc.typebookParten_US
dc.typeconferenceObjecten_US
dc.subject.ecienciaInformáticaes_ES
dc.relation.publisherversionhttps://doi.org/10.1145/3383219.3383246es_ES
dc.identifier.doi10.1145/3383219.3383246es_ES
dc.identifier.publicationfirstpage260es_ES
dc.identifier.publicationlastpage269es_ES
dc.relation.projectIDGobierno de España. RTI2018-095255-B-I00es_ES
dc.relation.projectIDComunidad de Madrid. P2018/TCS-4314/FORTE-CMes_ES
dc.type.versioninfo:eu-repo/semantics/acceptedVersionen_US
dc.rights.accessRightsopenAccessen_US
dc.facultadUAMEscuela Politécnica Superiores_ES


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record