Articles

Virtual Mouse and Keyboard for Computer Interaction by Hand Gestures Using Machine Learning

Human-computer interaction has changed since the advent of computer technology. Gestures are a useful way to communicate, and the Covid-19 era had an impact on us. Both the keyboard and the mouse are tools used to communicate with computers. Here, we’ve attempted to use hand gestures to interact with the mouse and keyboard. Eventually, get rid of the electronics. Consequently, use a virtual keyboard and your finger to move the mouse cursor. Using different hand gestures, actions like clicking, dragging, and typing data will be carried out.
A webcam is the IOT device required to accomplish this. The output from the camera will be displayed on the system’s screen so that the user can fine-tune it. We employ tools like Python, Media- Pipe, and Open-CV. The Media-Pipe library offers features that improve the model’s effectiveness and is particularly helpful in AI projects. The user will be able to move the computer cursor with various hand motions, type on the virtual keyboard while holding coloured caps or tapes, and left-click and drag objects. In this research, we suggest a hand gesture detection system for a natural human computer interface that can control a virtual mouse and keyboard.