Laptop Hand Gesture Control

Overview

As the technology tends to make human life easier and safer. So our main aim is to reduce the effort of interaction with computers through input devices using simple gestures. You might have seen Hand Gesture Controlled Robots, where the motion of a robot is controlled by the gestures of the hand. Another interesting project based on a similar principle is an Arduino based Hand Gesture Control of your computer or laptop.
Instead of using a keyboard, mouse or joystick, we can use our hand gestures to control certain functions of a computer like play/pause a video, move left/right in a photo slide show, scroll up/down.
​In this project, we have implemented a simple Arduino based hand gesture control where you can control few functions of your web browser like switching between tabs, scrolling up and down in web pages, shift between tasks (applications), play or pause a video and increase or decrease the volume (in VLC Player) with the help of hand gestures.

Concept Behind The Project

The principle behind the project is very simple . All we have to do is use two ultrasonic sensors with Arduino  UNO , place your hand in front of the Ultrasonic sensor which calculates the distance between the hand and the sensor , using an ultrasonic wave. Using this information, relevant actions in the computer can be performed. To perform actions on our computer we use Python pyautogui library. The commands from Arduino are sent to the computer through serial port (USB). This data will be then read by python which is running on the computer and based on the read data an action will be performed

/ Multitasking
/ Gaming
/ Makes life simpler

Programming With Arduino

The important part of this project is to write a program for Arduino such that it converts the distances measured by both the sensors into the appropriate commands for controlling certain actions.

Programming With Python

Writing Python Program for Arduino based Hand Gesture Control is very simple. You just need to read the Serial data from Arduino and invoke certain keyboard key presses. The user is also suggested to define COM port in the code and also the baud rate In order to achieve this, you have to install a special Python Module called PyAutoGUI.

Hardware Used

1. Arduino UNO

    Arduino UNO is complete and breadboard-friendly board based on the ATmega328P.
    Features of the Arduino UNO:

    • Microcontroller: ATmega328.
    • Operating Voltage: 5V.
    • Input Voltage (recommended): 7-12V.
    • Input Voltage (limits): 6-20V. 
    • Digital I/O Pins: 14 (of which 6 provide PWM output)
    • Analog Input Pins: 6.
    • DC Current per I/O Pin: 40 mA.
    • DC Current for 3.3V Pin: 50 mA.

        2. Ultrasonic Sensor

        Ultrasonic Sensor(HC-SR04) is easy to use sensor, easy to program and also not dangerous during operation for nearby objects, person, equipment or material. HC-SR04 is also cheaper than the other sensor those can be used.
        Advantages of Ultrasonic sensor:

        • The ultrasonic sensor has high frequency, high sensitivity and high penetrating power therefore it can easily detect the external or deep objects.
        • HC-SR04 easily interface with micro-controller or any type of controller.
        • HC-SR04 have greater accuracy then other methods for measuring the thickness and depth of parallel surface.
        • HC-SR04 could easily sense the nature, shape and orientation of that specific objects which is within the area of this sensors.

        Block Diagram

        Circuit Diagram

        Software Used

        Video Illustration

        http://www.youtube.com/embed/KIszs4WeCiQ?wmode=opaque

        Team Members

        AADESH VARUDE
        SURAJ KUMAR
        JATIN PARDHI
        SHIVRAJ DHONDE
        RISHABH RUNWAL

        Mentors

        MAYURESH BHOYAR
        MAYURESH SARODE
        NEHA MARNE
        SIMRAN CHAUHAN