Gesture Aided Voice For Voiceless

Dipti Jadhav, Tejaswini Koilakuntla, Sonam M. Mutalik Desai,Ramya Ramakrishnan

INTELLIGENT HUMAN COMPUTER INTERACTION(2018)

引用 0|浏览19
暂无评分
摘要
Language is used to express to our thoughts and to communicate with others. It is not limited to speech and sound. A sign language uses gestures which are a combination of hand movements and shapes, orientation, body movements and facial expressions instead of using sound. Sign language is the primary communication medium for the differently abled who have been given the title of "Divyang". But the inability of common people to comprehend it poses as a problem for efficient communication between the specially abled and others. The idea is to solve the problem by building an wireless and efficient two way communication system to bridge the gap between sign and speech and also vice versa. The system makes use of gloves fitted with flex sensors along the fingers and wrists of both hands to record the bend and corresponding change in resistance while performing Indian Sign Language (ISL) gestures. Microcontroller would be used for mapping the voltage values and its corresponding identifier i.e. the word as it is fast and is effective in a real-time communication scenario. This is then sent to a mobile app using a Bluetooth module where the text is displayed and converted to speech which the normal person can understand. The proposed system would help the hearing and speech impaired community in their daily lives as well as to enhance their employability.
更多
查看译文
关键词
Human machine interaction, Indian Sign Language, Hand gesture interpretation, Microcontroller, Natural language processing
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要