Gesture Recognition

Life is a blessing from the graces of God that he granted to all His creatures. God has excelled in creating this life in its most beautiful form, making the difference of people and the difference of graces among them a cornerstone for enjoying life. Created nature around him, which fascinates hearts, and some enjoy hearing the melody of nature and the chirping of birds and the chants of the seas. The situation regarding the deaf and dumb category is different, because life on a daily basis faces the deaf and dumb category with various difficulties, some of which are similar to what other natural individuals face, Some of the others are his own, that is, they are caused by the problems he suffers because of his disability, and the deaf-dumb tries to continue living relying on his attempt to be able to adapt to the conditions of his life, so they succeed and fail at times. The greater challenge for the deafdumb is to strive all possible ways to communicate with the society easily and confidently. They face many problems because most of the individuals they interact may lack knowledge of communicating using sign language. This research aims to reach solutions to overcome this problem by proposing an application to communicate for the Deaf and dumb. This application will help the public to understand the sign language used by deaf and dumb individuals. Therefore, the deaf and dumb group can communicate with people who do not know sign language without feeling embarrassed.

Under the V-Must project, “Imago Bononiae”
(2013) stands as a real example of how to build-up a reliable and
efficient experimentation caring about the quality and
effectiveness of a gesture-based Virtual Museum application in
relation with game design patterns. This paper focuses indeed on
the user-centric gesture design and progressive gestural skills
(rewards) that user can acquire in order to gain an engaging
experience and a massive comprehension of large urban contexts
mediated by visual strategies, while enabling spatial and
volumetric comparisons. Structured as a serious game, the
project foresaw a user experience evaluation carried out in
occasion of Digital Heritage Expo, held in Marseille in november
2013. During the event, “Imago Bononiae” was studied to
understand more on the interaction’s aspects that take place
between system and user. The visual design features that mostly
connote the main interface and that, consequently, influence the
behavior of users have been studied, like visibility, reliability and
memorability. The affordance of the whole system has been then
observed. Results presented show that “Imago Bononiae” has
proved to be suitable for the large audience given its facilitated
usability and the well-structured game strategy

—Many people can't talk due to speech problem like a dumb one or they have never heard the pronunciations of the word/symbol like a deaf one and that's why those people can't communicate with others who don't know the sign language. We have come up with a novel idea of a system that will convert the hand movements (Gestures) into the voice and display the message and allow the deaf and dumb to express them better. A sensor equipped glove needs to be worn on the hand and depending on the various gestures made by individual, the gesture will be interpreted to the corresponding voice and display message by the device. Further, that particular message can be transmitted as a voice or text to the doctor's phone as well as to the concerned person. For this we are using flex sensors, MEMS (Micro-Electro Mechanical System) accelerometer, microcontroller, speech IC, speakers, LCD display and GSM Module.

This paper describes a command interface for games based on hand gestures and voice command defined by postures, movement and location. The system uses computer vision requiring no sensors or markers by the user. In voice command the speech recognizer, recognize the input from the user. It stores and passes command to the game, action takes place. We propose a simple architecture for performing real time colour detection and motion tracking using a webcam. The next step is to track the motion of the specified colours and the resulting actions are given as input commands to the system. We specify blue colour for motion tracking and green colour for mouse pointer. The speech recognition is the process of automatically recognizing a certain word spoken by a particular speaker based on individual information included in speech waves. This application will help in reduction in hardware requirement and can be implemented in other electronic devices also.

Autonomous and remotely controlled mobile robots are used extensively in industries and are slowly becoming a norm in day-today life. They can be manually controlled using devices such as joysticks or by using mobile phone applications, through Bluetooth or similar technologies. In this paper, the authors propose usage of Leap Motion device which can track hands of human users. By using the gestures, the human can operate a mobile robot. For the demonstration, the authors propose its usage on a 3 Omni-wheel based mobile platform. First, the mathematical model of the robot was formulated and simulated in V-REP software for various types of motion. Then, a physical prototype was developed, which was integrated with both Bluetooth based mobile phone application and Leap Motion device. Field trials and survey of 30 people was carried out, where both methods were perceived to be of similar ease of use and intuitiveness. However, the authors feel the results of Leap Motion control may improve with subsequent usage by the users.

Communication plays a crucial part in human life. It encourages a man to pass on his sentiments, feelings and messages by talking, composing or by utilizing some other medium. Gesture based communication is the main method for Communication for the discourse and hearing weakened individuals. Communication via gestures is a dialect that utilizations outwardly transmitted motions that consolidates hand signs and development of the hands, arms, lip designs, body developments and outward appearances, rather than utilizing discourse or content, to express the individual's musings. Gestures are the expressive and important body developments that speaks to some message or data. Gestures are the requirement for hearing and discourse hindered, they pass on their message to others just with the assistance of motions. Gesture Recognition System is the capacity of the computer interface to catch, track and perceive the motions and deliver the yield in light of the caught signals. It enables the clients to interface with machines (HMI) without the any need of mechanical gadgets. There are two sorts of sign recognition methods: image-based and sensor-based strategies. Image-based approach is utilized as a part of this project that manages communication via gestures motions to distinguish and track the signs and change over them into the relating discourse and content.