University Institute of Engineering, Chandigarh University
Department of Computer Science & Engineering
Phase I (Project Scope, Planning and Task Definition)
Date: 9 th March,2022
Project Title
Sign Language Converter to text and audio for divyangjan.
Project Team
Team Designation Name UID Section
Lead Abhishek Sharma 20BCS9162 PH20BCS-804/B
Member1 Anant Tripathi 20BCS9167 PH20BCS-804/B
Member2 Aditya Raj 20BCS9168 PH20BCS-804/B
Member3 Abhishek Pandey 20BCS9188 PH20BCS-806/A
Project Scope
The aim of this project is to convert ISL (Indian Sign Language) signed hand gestures into text as well as
speech using machine learning/deep learning to eliminate communication barrier with the divyangjan having
hearing problem as well as provide teaching aid.
This sign language recognition project is a motion capture system which is used for sign language conversion
and a voice recognition system for voice conversion using OpenCV and Keras module of python.
Project Planning and Task Definition
In this project we create a motion and voice detector which detects alphabets from ISL as well as variety of
daily conversational words and sentences.
The layman model of our project sketches as:
Collect key points which contains optimized face, hand and pose components.
Train a deep neural network with LSTM layers for sequences
Performs real time sign language detection using OpenCV
Technologies and Tools:
Python
TensorFlow
Keras
OpenCV
Features that can be added:
Station the project on cloud and create an API for using it.
Incorporate feedback mechanism to make the model more robust
Add more sign languages
Add some pre-defined signed system to make it easy for both hands
Make our project more usable for the users at both endpoints
Project ID (If selected from project basket) 413
Project Outcome (Tick the Journal H/W + S/W
Patent S/W Project Other
Column) Paper Project
Remark of Supervisor
Name of Supervisor Er. Sumit Malhotra Signature
Name of Co-Supervisor Er. Gauri Shankar Signature
S.No. Signature of the Students Contact No. Signature
1. Abhishek Sharma 8637334065
2. Anant Tripathi 6388934852
3. Aditya Raj 7392038383
4. Abhishek Pandey 8340656517
Signature
(Project Teacher)