METHOD OF GESTURE RECOGNITION FOR INTERACTIVE COMPUTER PERFORMANCE

Authors

  • Natalia Bolohova
  • Ihor Bilousov

DOI:

https://doi.org/10.26906/SUNZ.2025.2.083

Keywords:

gesture recognition, webcam, video filtering, multi-threading, context adaptation, real time, MediaPipe, automatic brightness adjustment

Abstract

Topicality. As the demand for fast and convenient interaction with computers increases across various domains (from multimedia applications to industrial systems), the need for contactless control methods also grows. Gesture recognition is becoming a key solution, as it can boost responsiveness, minimize reliance on traditional input devices, and provide a natural, intuitive means of communication.. The goal of this work is to develop a gesture recognition method that operates in real time, delivers balanced performance, remains robust under varying lighting conditions, and is capable of adapting its responses depending on the context of the active application. The object of research is the process of capturing frames from a webcam and recognizing hand gestures in real time. The subject of research involves the algorithms and technologies (in particular, video stream filtering, multi-threading mechanisms, and context adaptation) aimed at increasing the effectiveness and reliability of a gesture recognition system. Results. The work analyzes several implementations featuring automatic brightness/contrast adjustment to enhance stable hand detection in changing lighting conditions, as well as multi-threaded processing to avoid interface freezes. It is demonstrated that context adaptation of gestures makes the system flexible: one gesture can perform various actions depending on the active window. Experiments confirmed real-time operation at 25–30 FPS and high recognition accuracy given proper parameter settings. The proposed webcam-based gesture recognition method has proved its effectiveness in real-life scenarios. Combining frame filtering, multi-threading, and context adaptation enables the system to function steadily, swiftly, and be easily scalable to the specific tasks of various applications.

Downloads

Download data is not yet available.

References

1. Hinckley K. Synchronous gestures for multiple users and computers // ACM UIST. 2003. P. 149–158.

2. Mankoff J., Hudson S., Abowd G. Interaction techniques for ambiguity resolution in recognition based interfaces // ACM UIST. 2000. P. 11–20.

3. Wilson A., Bobick A. Realtime online adaptive gesture recognition // ICPR'00 International Conference on Pattern Recognition. 2000. P. 1270–1275.

4. Wu M., Balakrishnan R. Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays // ACM UIST. 2003. P. 193–202.

5. Pavlovic V., Sharma R., Huang T. S. Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review // IEEE Transactions on Pattern Analysis and Machine Intelligence. 1997. Vol. 19, No. 7. P. 677–695.

6. Viola P., Jones M. Rapid Object Detection Using a Boosted Cascade of Simple Features // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR). 2001. P. 511–518.

7. Ionescu B., Coquin D., Lambert P., Buzuloiu V. Dynamic Hand Gesture Recognition Using the Skeleton of the Hand // EURASIP Journal on Applied Signal Processing. 2005. Vol. 13. P. 2101–2109.

8. Freeman W. T., Anderson D. B., Beardsley P. A. et al. Computer Vision for Interactive Computer Graphics // IEEE Computer Graphics and Applications. 1998. Vol. 18, No. 3. P. 42–53.

9. Conic N., Cerseato P., De Natale F. G. B. Natural Human–Machine Interface Using an Interactive Virtual Blackboard // Proceedings of the IEEE International Conference on Image Processing (ICIP). 2007. P. 181–184.

10. Szeliski R. Computer Vision: Algorithms and Applications. London: Springer, 2011. 812 p.

11. Dix A., Finlay J., Abowd G. D., Beale R. Human–Computer Interaction. 3rd ed. Harlow: Prentice Hall, 2003. 832 p.

12. Forsyth D. A., Ponce J. Computer Vision: A Modern Approach. Upper Saddle River: Prentice Hall, 2012. 792 p.

13. Rautaray S. S., Agrawal A. Advances in Vision-Based Human-Computer Interaction: Hand Gesture Recognition System // Chapter in collective monograph. Hershey: IGI Global, 2015.

14. Bradski G., Kaehler A. Learning OpenCV: Computer Vision with the OpenCV Library. Sebastopol: O’Reilly Media, 2008. 555 p

Published

2025-06-19