Multi-object Face Tracking and Classroom Participation Analysis in Smart Classrooms
DOI:
https://doi.org/10.54691/m5wy0a48Keywords:
Smart classroom; multi-object face tracking; classroom participation analysis; algorithm optimization; system integrationAbstract
Smart classrooms, integrating various new technologies, overcome traditional classrooms' limitations like the inability to dynamically monitor students' learning states, lack of personalized teaching support, and inefficient manual participation evaluation. The key face analysis technologies in this field include multi-object face tracking and classroom participation analysis. The former relies on algorithms such as YOLO, MTCNN, SORT, and DeepSORT to realize real-time monitoring of students' facial expressions, head poses, gaze directions, and other information. The latter constructs an evaluation index system to comprehensively assess classroom participation levels by integrating facial expression recognition, behavior analysis, and data fusion technologies. This paper systematically sorts out the core principles and application effects of these technologies, and deeply analyzes the limitations of current methods, such as insufficient tracking accuracy in complex occlusion scenarios and limited model generalization ability. Corresponding future research directions are put forward: focus should be placed on algorithm optimization to enhance robustness, expand datasets to improve model generalization ability, and strengthen privacy protection mechanisms to promote healthy development, laying a foundation for the subsequent performance improvement and function optimization of the model.
Downloads
References
[1] Zhao, Mingyi, Linrui Gong, and Abdul Sattar Din. "A review of the emotion recognition model of robots." Applied Intelligence 55.6 (2025): 364.
[2] Li, Huixiang, et al. "AI face recognition and processing technology based on GPU computing." Journal of Theory and Practice of Engineering Science 4.05 (2024): 9-16.
[3] Dubey, Parul, et al. "Enhanced iot-based face mask detection framework using optimized deep learning models: a hybrid approach with adaptive algorithms." IEEE Access (2025).
[4] Hai, Fu, and Li Gang. "Artificial Intelligence and Intelligent Information Systems Based Multi-Dimensional Classroom Computer Evaluation Model." 2022 IEEE International Conference on Electrical Engineering, Big Data and Algorithms (EEBDA). IEEE, 2022.
[5] Vishnumolakala, Sai Krishna, et al. "In-class student emotion and engagement detection system (iSEEDS): an AI-based approach for responsive teaching." 2023 IEEE Global Engineering Education Conference (EDUCON). IEEE, 2023.
[6] Chen, Yong. "Recognition Model Construction and Analysis of College Students' Classroom Behavior." 2025 6th International Conference on Computer Vision, Image and Deep Learning (CVIDL). IEEE, 2025.
[7] Wang, Li-Wen, et al. "Video assisted face recognition in smart classroom." 2024 IEEE International symposium on circuits and systems (ISCAS). IEEE, 2024.
[8] Alayary, Yomna, et al. "Face Masked and Unmasked Humans Detection and Tracking in Video Surveillance." 2022 4th Novel Intelligent and Leading Emerging Sciences Conference (NILES). IEEE, 2022.
[9] Pradeep, Aneesh. "Developing an IoT enabled smart classroom S3TH System." 2023 5th International Conference on Inventive Research in Computing Applications (ICIRCA). IEEE, 2023.
[10] Colares, Willian Guerreiro, Marly GF Costa, and Cícero FF Costa Filho. "Enhancing Emotion Recognition: A Dual-Input Model for Facial Expression Recognition Using Images and Facial Landmarks." 2024 46th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 2024.
[11] Tariyal, Sumit, et al. "A comparitive study of MTCNN, Viola-Jones, SSD and YOLO face detection algorithms." 2024 international conference on intelligent and innovative technologies in computing, electrical and electronics (IITCEE). IEEE, 2024.
[12] Haq, H. B. U., et al. "Enhanced real-time facial expression recognition using deep learning." Acadlore Trans. Mach. Learn 3.1 (2024): 24-35.
[13] Zhang, Xiaona, Xiaoming Zhang, and Ts Dr Jasni Bin Dolah. "Intelligent classroom teaching assessment system based on deep learning model face recognition technology." Scientific Programming 2022.1 (2022): 1851409.
[14] Galligan, Claire, et al. Cameras in the classroom: Facial recognition technology in schools. 2020.
[15] Fakhar, Shariqa, et al. "Smart classroom monitoring using novel real-time facial expression recognition system." Applied Sciences 12.23 (2022): 12134.
[16] Gomes, Clyde, et al. "Class attendance management system using facial recognition." ITM Web of Conferences. Vol. 32. EDP Sciences, 2020.
[17] Narzillo, Mamatov, et al. "Peculiarities of face detection and recognition." 2021 International Conference on Information Science and Communications Technologies (ICISCT). IEEE, 2021.
[18] Li, Li, and Dengfeng Yao. "Emotion recognition in complex classroom scenes based on improved convolutional block attention module algorithm." IEEE Access 11 (2023): 143050-143059.
[19] Aly, Mohammed, Abdullatif Ghallab, and Islam S. Fathi. "Enhancing facial expression recognition system in online learning context using efficient deep learning model." IEEE Access 11 (2023): 121419-121433.
[20] Tang, Jiangbo, Fenglan Mai, and Xianghong Xie. "Intelligent recognition of teaching behaviors in smart classroom." 2024 International Conference on Informatics Education and Computer Technology Applications (IECA). IEEE, 2024.
[21] Ma, Chengze, and Ping Yang. "Research on classroom teaching behavior analysis and evaluation system based on deep learning face recognition technology." Journal of Physics: Conference Series. Vol. 1992. No. 3. IOP Publishing, 2021.
[22] Shi, Sumeng, Jie Gao, and Wei Wang. "Classroom teaching behavior analysis based on artificial intelligence." Artificial intelligence in education and teaching assessment. Singapore: Springer Singapore, 2022. 25-36.
[23] Nidhya, R., et al. "Exploring Facial Recognition Technologies for Classroom Management." 2024 10th International Conference on Communication and Signal Processing (ICCSP). IEEE, 2024.
[24] Tang, Xiao-Yu, et al. "Classroom teaching evaluation based on facial expression recognition." Proceedings of the 2020 9th international conference on educational and information technology. 2020.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Scientific Journal of Intelligent Systems Research

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.




