RT info:eu-repo/semantics/article
T1 Análise Quantitativa da Concordância de Avaliadores de Recursos Educacionais Digitais dentro de Repositórios
A1 Stein, Mayara Sousa
A1 Cechinel, Cristian
A1 Ramos, Vinicius
K1 User-generated content, Educational technology,  Multimedia databases, Online services, Open Educational Resources
AB Quality assessment inside learning object repositories is normally performed by the community of users that shareinterest and rate the same resources. At the same time, thisstrategy is largely disseminated in the most known repositories.In addition, the final presentation of the overall quality of theresources is normally restricted to the average rating given by thecommunity, thus, hiding the internal distribution of the ratingsand the characteristics of the users involved in the evaluationprocess. The present paper analyzes to which extent differentraters tend to agree about the quality of the resources insidethe Merlot repository. For that, data were collected from therepository and calculated the Intra-Class Correlation coefficientfor 102 pairs of evaluators, as well as the Spearman correlationamong the average ratings of a given resource by evaluatorscoming from the same categories of disciplines. Results pointout a high concentration of poor agreement between raters(75% to 85% of the pairs of raters tended to disagree), and nocorrelation among the average ratings of the resources from thedifferent disciplines. Based on these findings, the authors suggestimprovements to the repository interface better presenting theoverall quality of the resources.
PB IEEE
YR 2023
FD 2023
LK http://riull.ull.es/xmlui/handle/915/32826
UL http://riull.ull.es/xmlui/handle/915/32826
LA pt
NO M. S. Stein, C. Cechinel and V. F. C. Ramos, "Quantitative Analysis of Users’ Agreement on Open Educational Resources Quality Inside Repositories," in IEEE Revista Iberoamericana de Tecnologias del Aprendizaje, vol. 18, no. 1, pp. 2-9, Feb. 2023, doi: 10.1109/RITA.2023.3250446.
DS Repositorio institucional de la Universidad de La Laguna
RD 19-may-2024