Application of Gesture Recognition Based on Spatiotemporal Graph Convolution Network in Virtual Reality Interaction

Ting Liao

Source Title: Journal of Cases on Information Technology (JCIT)24(5)

ISSN: 1548-7717|EISSN: 1548-7725|EISBN13: 9781668453926|DOI: 10.4018/JCIT.295246

MLA

Liao, Ting. "Application of Gesture Recognition Based on Spatiotemporal Graph Convolution Network in Virtual Reality Interaction." JCIT vol.24, no.5 2022: pp.1-12. http://doi.org/10.4018/JCIT.295246

APA

Liao, T. (2022). Application of Gesture Recognition Based on Spatiotemporal Graph Convolution Network in Virtual Reality Interaction. Journal of Cases on Information Technology (JCIT), 24(5), 1-12. http://doi.org/10.4018/JCIT.295246

Chicago

Liao, Ting. "Application of Gesture Recognition Based on Spatiotemporal Graph Convolution Network in Virtual Reality Interaction," Journal of Cases on Information Technology (JCIT) 24, no.5: 1-12. http://doi.org/10.4018/JCIT.295246

Export Reference

Favorite Full-Issue Download

View Full Text HTML

View Full Text PDF

Abstract

Aiming at the low recognition rate of traditional gesture, a gesture recognition algorithm based on spatiotemporal graph convolution network is proposed in this paper. Firstly, the dynamic gesture data were preprocessed, including removing invalid gesture frames, completing gesture frame data and normalization of joint length. Then, the key frame of the gesture is extracted according to the given coordinate information of the hand joint. A connected graph is constructed according to the natural connection of time series information and gesture skeleton. A spatio-temporal convolutional network with multi-attention mechanism is used to learn spatio-temporal features to predict gestures. Finally, experiments are carried out on 14 types of gesture dataset in DHG-14 dynamic gesture dataset. Experimental results show that this method can recognize gestures accurately.