Swimming Style Recognition with Convolutional Neural Network with Single IMU

Authors

  • Yiran Meng

DOI:

https://doi.org/10.6911/WSRJ.202411_10(11).0004

Keywords:

Convolutional Neural Network (CNN); inertial measurement unit (IMU); swimming style recognition.

Abstract

The study focuses on swimming style recognition using a Convolutional Neural Network (CNN) and a single inertial measurement unit (IMU) located on the wrist, mimicking the setup of a typical smartwatch. Traditional methods often employ multiple sensors or sensors placed in impractical locations, limiting everyday usability for swimmers. This research utilizes data collected from 40 swimmers, integrating 53,732 input windows from sessions in a 50-meter pool, where swimmers wore a smartwatch on their wrist. The CNN model was modified to enhance pattern recognition capabilities across swimming styles: Butterfly, Backstroke, Breaststroke, Freestyle, and Transitions. Enhanced data processing techniques, including normalization and augmentation (time-scaling, noise addition, reversing, and rotation), were applied to simulate real-world variances. The model was evaluated using a Leave-One-Subject-Out (LOSO) cross-validation method, demonstrating high precision and minimal misclassification, signifying a robust model capable of accurately detecting and classifying swimming strokes with potential for real-time application in sports and health monitoring. This approach offers a significant improvement over previous systems by reducing the sensor complexity and focusing on individual movement patterns, potentially increasing the accessibility and precision of swimming activity recognition.

Downloads

Download data is not yet available.

References

[1] Bächlin, M., & Tröster, G. (2012). Swimming performance and technique evaluation with wearable acceleration sensors. Pervasive and Mobile Computing, 8(1), 68-81. https://doi.org/10.1016/j.pmcj.2011.05.003

[2] Delhaye, E., Bouvet, A., Nicolas, G., Vilas-Boas, J. P., Bideau, B., & Bideau, N. (2022). Automatic swimming activity recognition and lap time assessment based on a single imu: A deep learning approach. Sensors, 22(15), 5786. https://doi.org/10.3390/s22155786

[3] Fantozzi, S., Coloretti, V., Piacentini, M. F., Quagliarotti, C., Bartolomei, S., Gatta, G., & Cortesi, M. (2022). Integrated timing of stroking, breathing, and kicking in front-crawl swimming: A novel stroke-by-stroke approach using wearable inertial sensors. Sensors, 22(4), 1419. https://doi.org/10.3390/s22041419

[4] Ferrari, A., Micucci, D., Mobilio, M., & Napoletano, P. (2022). Deep learning and model personalization in sensor-based human activity recognition. Journal of Reliable Intelligent Environments, 9(1), 27-39. https://doi.org/10.1007/s40860-021-00167-w

[5] Fiche, G., Sevestre, V., Gonzalez-Barral, C., Leglaive, S., & Séguier, R. (n.d.). SwimXYZ: A large-scale dataset of synthetic swimming motions and videos. MIG '23: Proceedings of the 16th ACM SIGGRAPH Conference on Motion, Interaction and Games. https://doi.org/10.1145/3623264.3624440

[6] Le Sage, T., Bindel, A., Conway, P. P., Justham, L. M., Slawson, S. E., & West, A. A. (2011). Embedded programming and real-time signal processing of swimming strokes. Sports Engineering, 14(1), 1-14. https://doi.org/10.1007/s12283-011-0070-7

[7] Mooney, R., Corley, G., Godfrey, A., Quinlan, L., & ÓLaighin, G. (2015). Inertial sensor technology for elite swimming performance analysis: A systematic review. Sensors, 16(1), 18. https://doi.org/10.3390/s16010018

[8] Nakashima, M., Ohgi, Y., Akiyama, E., & Kazami, N. (2010). Development of a swimming motion display system for athlete swimmers' training using a wristwatch-style acceleration and gyroscopic sensor device. Procedia Engineering, 2(2), 3035-3040. https://doi.org/10.1016/j.proeng.2010.04.107

[9] Ohgi, Y. (n.d.). Microcomputer-based acceleration sensor device for sports biomechanics -stroke evaluation by using swimmer's wrist acceleration. SENSORS, 2002 IEEE. https://doi.org/10.1109/icsens.2002.1037188

[10] Wang, Z., Shi, X., Wang, J., Gao, F., Li, J., Guo, M., Zhao, H., & Qiu, S. (n.d.). Swimming motion analysis and posture recognition based on wearable inertial sensors. IEEE International Conference on Systems, Man and Cybernetics. https://doi.org/10.1109/smc.2019.8913847

[11] Brunner, G., Melnyk, D., Sigfússon, B., & Wattenhofer, R. (n.d.). Swimming style recognition and lap counting using a smartwatch and deep learning. ISWC '19: Proceedings of the 2019 ACM International Symposium on Wearable Computers. https://doi.org/10.1145/3341163.33

Downloads

Published

2024-10-22

Issue

Section

Articles

How to Cite

Meng, Yiran. 2024. “Swimming Style Recognition With Convolutional Neural Network With Single IMU”. World Scientific Research Journal 10 (11): 39-43. https://doi.org/10.6911/WSRJ.202411_10(11).0004.