Research on the Application of Cognitive Diagnostic Models in Assessment Evaluation
DOI:
https://doi.org/10.54691/3x5hkp70Keywords:
Cognitive Diagnostic Models; Excel Data Analysis; DINA Model; Assessment Evaluation.Abstract
With the integration of cognitive diagnostic technology into the field of education, meeting individual learning needs has become possible. This study takes the “Excel Data Analysis” module in the “University Computer Basics” course as the research subject, aiming to evaluate the application effect of Cognitive Diagnostic Models in student assessment and evaluation. Through in-depth interviews with teachers and experts, the key competencies that students need to master were clarified, including data understanding and basic operations, data computation and processing, data management and analysis, data visualization, etc. This study constructed a DINA model, established a hierarchical structure of competence attributes, defined the Q-matrix and the ideal competence mastery pattern, and used the flexCDMs platform for parameter estimation, analyzing the test item parameters and the probability of students' competence attributes mastery. The results show that students perform well in “data computation and processing,” while “advanced analysis skills” need to be strengthened. The study provides evidence for teaching improvement, and although there are limitations, it points out the direction for future research.
Downloads
References
[1] Tu Dongbo, Cai Yan, Gao Xuliang, et al. Advanced Cognitive Diagnosis [M]. Beijing: Beijing Normal University Press, 2019, p.22-23.
[2] Xu T, Wu X, Sun S, et al. Cognitive diagnostic analysis of students' mathematical competency based on the DINA model[J]. Psychology in the Schools,2023,60(9),p.3135-3150.
[3] Wang Fengsi, et al. Educational Big Data -- Assessment Evaluation Data Analysis, Mining, and Application [M]. Beijing: Science Press, 2020, p. 61-66.
[4] Hang Dandan. Research on the Validation Method and Application of Q Matrix in Multidimensional Cognitive Diagnostic Assessment [D]. Jiangxi Normal University, 2020. DOI: 10.27178/d. cnki. gjxsu. 2020.001433.
[5] Dai Haiqi, Zhang Qinghua. Application Study of Rule Space Model in Descriptive Statistical Learning Pattern Recognition [J]. Psychological Science, 2004, (04), p.949-951+948. DOI: 10.16719/j.cnki.1671-6981.2004.04.048.
[6] Jianhua X, Zhaosheng L, Guanzhong L, et al. Data-driven Q-matrix learning based on Boolean matrix factorization in cognitive diagnostic assessment. [J].The British journal of mathematical and statistical psychology, 2022,75(3),p.638-667.
Downloads
Published
Issue
Section
License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.