Experimental Evaluation of Similarity Measures for Educational Items

Warning

This publication doesn't include Faculty of Arts. It includes Faculty of Informatics. Official publication website can be found on muni.cz.

Authors

ČECHÁK Jaroslav PELÁNEK Radek

Year of publication 2021
Type Article in Proceedings
MU Faculty or unit

Faculty of Informatics

Citation
Web https://educationaldatamining.org/EDM2021/EDM2021Proceedings.pdf
Keywords item similarity; evaluation; generalizability
Description Measuring similarity of educational items has several applications in the development of adaptive learning systems, and previous research has already proposed a wide range of similarity measures. In this work, we provide an experimental evaluation of selected similarity measures using a large dataset. The used items are alternate-choice questions for the practice of English grammar for second language learners; the dataset contains thousands of items and over 10 million student answers. Our results provide warnings about the generalizability of results presented in EDM works: 1) the results vary significantly between knowledge components and 2) the size of available data is an important factor.
Related projects:

You are running an old browser version. We recommend updating your browser to its latest version.