Title : Virtual Mouse and Keyboard for Computer Interaction by Hand Gestures Using Machine Learning

Vol 6 No 8 (2023): Volume 06 Issue 08 August 2023

Article Date Published : 4 August 2023 | Page No.: 5469-5479 | Google Scholar | Crossref doi for this article

Abstract :

Human-computer interaction has changed since the advent of computer technology. Gestures are a useful way to communicate, and the Covid-19 era had an impact on us. Both the keyboard and the mouse are tools used to communicate with computers. Here, we’ve attempted to use hand gestures to interact with the mouse and keyboard. Eventually, get rid of the electronics. Consequently, use a virtual keyboard and your finger to move the mouse cursor. Using different hand gestures, actions like clicking, dragging, and typing data will be carried out.
A webcam is the IOT device required to accomplish this. The output from the camera will be displayed on the system’s screen so that the user can fine-tune it. We employ tools like Python, Media- Pipe, and Open-CV. The Media-Pipe library offers features that improve the model’s effectiveness and is particularly helpful in AI projects. The user will be able to move the computer cursor with various hand motions, type on the virtual keyboard while holding coloured caps or tapes, and left-click and drag objects. In this research, we suggest a hand gesture detection system for a natural human computer interface that can control a virtual mouse and keyboard.

Keywords :

CNN, Gesture control, Hand gesture recognition, Hand tracking, Human-Computer Interaction, Virtual Keyboard, Virtual Mouse, Volume control.

References :

  1. Suarez, J., & Murphy, R. R. (2012, September). Hand gesture recognition with depth images: A review. In 2012 IEEE ROMAN: the 21st IEEE international symposium on robot and human interactive communication (pp. 411-417). IEEE.
  2. Shah, P., Pandya, K., Shah, H., & Gandhi, J. (2019). Survey on vision-based hand gesture recognition. International Journal of Computer Sciences and Engineering, 7, 281- 288.
  3. Chen, L., Wang, F., Deng, H., & Ji, K. (2013, December). A survey on hand gesture recognition. In 2013 International conference on computer sciences and applications (pp. 313-316). IEEE.
  4. Panwar, M., & Mehra, P. S. (2011, November). Hand gesture recognition for human computer interaction. In 2011 International Conference on Image Information Processing (pp. 1-7). IEEE.
  5. Cheng, H., Yang, L., & Liu, Z. (2015). Survey on 3D hand gesture recognition. IEEE transactions on circuits and systems for video technology, 26(9), 1659-1673.
  6. Patil, N., Sali, G., &Lokhande, N. (2019). Mouse on Finger Tips using ML and AI.
  7. Sharma, V. K., Kumar, V., Iqbal, M., Tawara, S., &Jayaswal, V. Virtual Mouse Control Using Hand Class Gesture.
  8. Abhilash, S. S., Thomas, L., Wilson, N., &Chaithanya, C. (2018). Virtual Mouse Using Hand Gesture. International Research Journal of Engineering and Technology (IRJET), 5(4), 3903-3906.
  9. Shibly, K. H., Dey, S. K., Islam, M. A., &Showrav, S. I. (2019, May). Design and development of hand gesture based virtual mouse. In 2019 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT) (pp. 1-5). IEEE.
  10. Nandwana, B., Tazi, S., Trivedi, S., Kumar, D., &Vipparthi, S. K. (2017, November). A survey paper on hand gesture recognition. In 2017 7th International Conference on Communication Systems and Network Technologies (CSNT) (pp. 147-152). IEEE.
  11. Ashok, M. A., Revathi, M. P., & Nirmal, B. (2020). FINGER RECONGITION AND GESTURE BASED VIRTUAL KEYBOARD. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 11(3), 2237-2245.
  12. Nikhil, C. D. S., Rao, C. U. S., Brumancia, E., Indira, K., Anandhi, T., &Ajitha, P. (2020, June). Finger Recognition and Gesture based Virtual Keyboard. In 2020 5th International Conference on Communication and Electronics Systems (ICCES) (pp. 1321- 1324). IEEE.
  13. Shinde, O., Navale, K., Kunjir, D., More, A., &Taksal, A. GESTURE RECOGNITION BASED VIRTUAL MOUSE AND KEYBOARD.
  14. Gupta, R. G., Reddy, R. S., & Parmar, N. N. (2016). Virtual Keyboard Using Image Processing. International Research Journal of Engineering and Technology, 3(4), 2009- 2013.
  15. Rustagi, D., Maindola, G., Jain, H., Gakhar, B., &Chugh, G. (2022). Virtual Control UsinHand‒Tracking.
  16. Du, H., &Charbon, E. (2007, February). 3D hand model fitting for virtual keyboard system. In 2007 IEEE Workshop on Applications of Computer Vision (WACV’07) (pp. 31-31). IEEE.
  17. https://mediapipe.dev/
  18. https://autopy.org/
  19. https://w3schools.com/python/numpy/nu mpy_intro.as

How to Cite :

Virtual Mouse and Keyboard for Computer Interaction by Hand Gestures Using Machine Learning. Pooja S Kumari Verma, Sucharitha Mahanta, Sevanth B N, Assistant Prof. Shreedhar B , 6(8), 5469-5479. Retrieved from https://ijcsrr.org/single-view/?id=12038&pid=11944

Most read articles by the same author(s)

Pooja S Kumari Verma, Sucharitha Mahanta, Sevanth B N, Assistant Prof. Shreedhar B,

View

239

Citation

Downloads

Article Details