Performance of deep-learning models incorporating knee alignment information for predicting ground reaction force during walking

Abstract

Background: Wearable sensors combined with deep-learning models are increasingly being used to predict biomechanical variables. Researchers have focused on either simple neural networks or complex pretrained models with multiple layers. In addition, studies have rarely integrated knee alignment information or the side affected by injury as features to improve model predictions. In this study, we compared the performance of selected model architectures, including complex pretrained models, in predicting three-dimensional (3D) ground reaction force (GRF) data during level walking by using data obtained from motion capture systems and wearable accelerometers.

Results: Ten deep-learning models for predicting the 3D GRF were developed using motion capture and accelerometer data with or without subject-specific features. Incorporating subject-specific features improved prediction accuracy for all models except the long short-term memory (LSTM) model. A two-dimensional (2D)-CNN-LSTM hybrid model achieved the best results. Established models, such as ResNet50 and Inception, performed better when trained with pretrained ImageNet weights and subject-specific features, underscoring the value of pretrained knowledge and subject-specific information for improving accuracy. However, these models did not outperform the custom hybrid models in predicting time-series 3D GRF data, indicating that larger models do not necessarily perform better for time-series applications but do always have greater computational demands.

Conclusion: Incorporating subject-specific features, such as alignment information, enhanced the accuracy of GRF predictions during walking. Complex pretrained models were outperformed by custom hybrid models for time-series 3D GRF prediction during walking. Custom models with lower computational demands and using alignment features are a more efficient and effective choice for applications requiring accurate and resource-efficient predictions.

Keywords: Artificial intelligence; Deep learning; Ground reaction force; Motion capture system; Prediction; Wearable sensors.