Attitude Detection Classification based on Feature Selection and Integrated Machine Learning Model


  • Yonglin Zou
  • Xuefen Liu
  • Ziqi Liao
  • Zhi Li



MIV; Xgboost; Integrated; Grid Search; Comprehensive Sampling.


This paper classifies 19 human actions based on a dataset of 1.2 million human actions acquired from sensors. The Xgboost classification model is established, and the MIV algorithm is used as an index to evaluate the importance of each variable to the dependent variable. The MIV values of all features are sorted according to the absolute value of each variable, and finally the top 10 groups of features are selected as the features of the reduced data set, and fine-tuned by grid search. Select the simplified data set, get the maximum roc_auc through continuous testing, and get the optimal model. The model has a recall of 1 and a precision, F1-score, and AUC of 0.99. Then, in order to make the model have a good generalization ability under the limited data set, a feasible method is designed to evaluate the generalization ability of the model. using the SMOTE-Tomek integrated sampling method to calculate k-nearest neighbor samples for each minority class sample, select the class samples whose neighbor similarity coefficients meet the requirements. Randomly generate new samples according to the adjacency relationship between the linearly interpolated sample and its neighbor samples. According to the original data training set, generate similar data samples and put them into the model trained with the original data for prediction evaluation. Finally, the classification accuracy rate of the generated samples is obtained, the precision rate is 0.98, and the recall rate is 0.99. The F1 value is 0.98, and the Roc_AUC value is 0.98, which proves that the evaluation model has good generalization ability.


Download data is not yet available.


Wu W.H., Bui A.A.T., Batalin M.A., Liu D., Kaiser W.J. Incremental diagnosis methods for smart wearable sensor systems[J]. IEEE T. Information Technology, 2017, 11(5).

Jafari Sadiqa, Byun YungCheol. XGBoost-Based Remaining Useful Life Estimation Model with Extended Kalman Particle Filter for Lithium-Ion Batteries[J]. Sensors, 2022, 22(23).

S. KOCAOGLU, E. AKDOGAN. Comparison of Classification Algorithms for Detecting Patient Posture in Expandable Tumor Prostheses[J]. Advances in Electrical and Computer Engineering, 2020, 20(2).

Tian Zhanxiao, Qu Wei, Zhao Yanli, Zhu Xiaolin, Wang Zhiren, Tan Yunlong, Jiang Ronghuan, Tan Shuping. Predicting depression and anxiety of Chinese population during COVID-19 in psychological evaluation data by XGBoost[J]. Journal of Affective Disorders, 2023, 323.

Pan Zidong, Lu Wenxi, Wang Han, Bai Yukun. Groundwater contaminant source identification based on an ensemble learning search framework associated with an auto xgboost surrogate[J]. Environmental Modelling and Software, 2023, 159.

MA H H. Application of random forest and XGBoost model in personal credit risk assessment[D]. The central university for nationalities, 2021. DOI: 10.27667 /, dc nki. Gzymu. 2021.000622.







How to Cite

Zou, Y., Liu, X., Liao, Z., & Li, Z. (2023). Attitude Detection Classification based on Feature Selection and Integrated Machine Learning Model. Scientific Journal of Technology, 5(3), 84-90.

Similar Articles

1-10 of 93

You may also start an advanced similarity search for this article.