Gesture Recognition Based on MediaPipe for Computer Game Control

Yufan Zheng

doi:10.47297/wspciWSP2516-252721.20230702

PDF
Export
Share
Collection
Album

Gesture Recognition Based on MediaPipe for Computer Game Control

Volume 7, Issue 2

Views: 0 Downloads: 0

Gesture Recognition Based on MediaPipe for Computer Game Control
Gesture Recognition Based on MediaPipe for Computer Game Control
Chengdu Shishi Baima High School
Vol. 7, Issue 2, Pages: 160-166(2023)
Published： 2023 ，
DOI：10.47297/wspciWSP2516-252721.20230702
Accepted：

Scan QR Code

YUFAN ZHENG. (2023). Gesture Recognition Based on MediaPipe for Computer Game Control. Creativity and Innovation, 7(2), 160-166..
DOI：

YUFAN ZHENG. (2023). Gesture Recognition Based on MediaPipe for Computer Game Control. Creativity and Innovation, 7(2), 160-166.. DOI： 10.47297/wspciWSP2516-252721.20230702.

摘要

Abstract

The social function of computer games has gradually been recognized in modern society. With the rapid development of computing science

games based on human-computer interaction (HCI) and computer vision have attracted people's attention. Unlike traditional games based on keyboard or controller

these games focus on the user experience

where user interaction can create an immersive feeling that is beyond the reach of graphical user interfaces. This paper researches the application of gesture recognition technology in games via Google Mediapipe framework and Pygame. We evaluate the performance through hand gesture recognition and Flappy bird game control. The experiment shows the good result and user experience.

关键词

Keywords

Computer visionMediapipeGame control

references

J.Lee, T. Kunii. Model based analysis of hand posture. Computer Graphics and Applications. 1995, 5(5):77-86.[2] Liangguo Zhang, Jiangqin Wu, Wen Gao, etc. Gesture Recognition Based on Huadsorff Distance. Chinese Journal of Image Graphics. 2002, Vol7A, No.11.[3] Y. Boussemart, F. Rioux, F. Rudzicz, M. Wozniewski, J. Cooperstock. A framework for 3D visualisation and manipulation in an immersive space using an untethered bimanual gestural interface. ACM Proceedings of VRST’04, 2004.[4] H. Gerrit, B. Martin, A. Kurt, K. Gudrun. Inverse Kinematic Infrared Optical Finger Tracking. In Proceedings of 9th International Conference on Humans and Computers (HC), Aizu, Japan, 2006.[5] W. Robert. Real Time Hand Tracking as a User Input Device, ACM UIST’08, October, 2008. Monterey, CA. [6] R. Wang , J. Popovic. Real-Time Hand-Tracking with a Color Glove, In Proceedings of ACM SIGGRAPH 2009.[7] M. Bhuyan, D. Ghosh, P. Bora. Hand motion tracking and trajectory matching for dynamic hand gesture recognition. Journal of Experimental & Theoretical Artificial Intelligence, 2006. 18(4):1362-3079.[8] CF. Shan, YC. Wei, XC. Qiu, TN. Tan Gesture Recognition Using Temporal Template Based Trajectories. Proceedings of 17th International Conference on Pattern Recognition (ICPR'04) , 2004, Volume 3:954-957.[9] CF. Shan, TN. Tan, YC. Wei. Real-time hand tracking using a mean shift embedded particle filter. Pattern Recognition, 2007, 40:1958-70.[10]H. Reza, W. Stephan, S. Asadollah. Vision-Based Hand Gesture Recognition for Human Computer Interaction: A Review. IADIS International Conference Interfaces and Human Computer Interaction, 2008.[11]C. Ross, T. Matthew, View-based Interpretation of Real-time Optical Flow for Gesture Recognition. 3rd IEEE Conference on Face and Gesture Recognition, Nara, Japan, April, 1998.[12]T. Starner, J. Weaver, A. Pentland. Real-time American sign language recognition using desk and wearable computer based video. PAMI ,1998, 1371-75.[13]C.Vogler, D. Metaxas, A framework for recognizing the simultaneous aspects of American sign language. CVIU, 2001, 81: 358–84.[14]S. Wong, R. Cipolla. Real-time Adaptive Hand Motion Recognition using a Sparse Bayesian Classifier. IEEE International Workshop on Human-Computer Interaction, 2005, Beijing, China, Springer LNCS#3766, 170-79.

Alert me when the article has been cited

Submit

No data

Related Author

No data

Related Institution

No data

⁰