Overview
The objective of the project is to bridge the existing gap of communication between society and the hearing and speaking disabled. By the use of an array of features such as speech to text and text to speech conversion, tactile keys to act as a keyboard and mouse pointer control help further control of computers and other digital environments.
An android application will also help in making the learning process more interactive too. The major application of this device is proposed in schools, to help the hearing and speaking disabled to learn in public schools.
Hardware
This device is made up of Texas Instrument components. We have used TI TIVA-C series Launchpad, Beaglebone Black as main processor and XBEE module for wireless transmission. The left hand glove consist conductive fabric keys on the finger tips arranged in the fashion of standard mobile keypad. Right hand glove is used to tap on the keys on left hand. When we tap on the keys on left hand glove data is wirelessly send to Beaglebone Black using XBEE module.
Software
We have installed Ubuntu on Beaglebone Black and connecting it with mouse, keyboard, Wi-Fi and Bluetooth dongle it works as a mini computer hence we can type using our gloves. Right hand glove also have TI sensor-hub booster pack for the gesture controlled application such as controlling mouse pointer. We then integrated Beaglebone Black with android applications. By making apps for text to speech and speech to text conversion we were able to teach peoples with hearing and speech disabilities.
