## Supporting Success for Deaf and Mute Primary Schoolchildren with Sinhala Language
### *Main Objective*
check
### *Main Research Questions*
The main objective of our research document is to develop a mobile application that aims to facilitate communication and enhance the learning experience of deaf and mute children in Sri Lanka through the utilization of the Sinhala language. This application will incorporate components such as Sinhala sign language to Sinhala text conversion, Sinhala voice to Sinhala sign language translation, a noise identification system for children, and Sinhala Text-to-Speech technique with emotion detection.
### *Main Research Question*
The research problem focuses on addressing the communication and social integration challenges faced by non-verbal or minimally verbal children, deaf children, and children with hearing loss. These children encounter difficulties in expressing themselves, regulating emotions, socializing, and accessing education. Additionally, the lack of fluency in sign language among parents further hampers language acquisition and communication development in deaf and hard-of-hearing children. The research problem aims to investigate effective interventions and support systems to enhance communication, emotional well-being, and educational opportunities for these children, ultimately improving their quality of life and social integration.
The proposed research problem seeks to explore strategies to empower non-verbal or minimally verbal children by developing effective communication methods tailored to their individual needs, addressing behavioral challenges, and promoting emotional regulation. Additionally, the research aims to investigate comprehensive approaches to support deaf children, including the development of assistive technologies for communication, promoting safety awareness, and addressing the emotional and educational barriers they face. Moreover, the research problem seeks to identify early identification methods for hearing loss in children and provide appropriate interventions to optimize language acquisition, academic performance, and social integration. Furthermore, the research aims to address the significant communication gap between parents and deaf or hard-of-hearing children by exploring effective means to improve parental fluency in sign language, fostering a supportive language-rich environment at home.
By addressing these research problems, the study aims to improve the overall well-being, communication abilities, educational opportunities, and social integration of non-verbal or minimally verbal children, deaf children, and children with hearing loss. The findings of the research can inform the development of targeted interventions, assistive technologies, educational strategies, and support systems to empower and enhance the lives of these children, ultimately promoting their overall development and inclusion in society.
### *Individual Research Questions*
### IT20116606
Children who cannot talk, but can communicate through typing, writing or using devices, are often referred to as non-verbal or minimally verbal children. This can be due to a variety of reasons, such as developmental delays, neurological disorders, or physical disabilities. These can be happened after an accident as well. In terms of their emotional development, these children may have difficulty regulating their emotions or communicating their needs, which can result in behavioral issues or tantrums.
### IT20117146
Deaf children suffer from hearing loss which affects many aspects of their lives; they cannot communicate or socialize effectively with normal people around them. Deaf children's safety is also frequently compromised because they are unable to make the best decision based on their brain's analysis of noises, particularly alarming ones. The severity of hearing loss affects how it is treated. Many children with severe or profound deafness cannot be cured by medicine, and as a result they lose hope of ever leading a normal life. Also, because they are deaf, their parents must constantly watch over them, which is a serious problem.
### IT20016616
For children, hearing is key to learning spoken language, performing academically, and engaging socially. Hearing loss poses a barrier to education and social integration. As such children with hearing loss can benefit greatly from being identified early in life and offered appropriate interventions. 90-95% of deaf and hard-of-hearing children are born to hearing parents.
### IT20386436
Most of these parents have little or no exposure to Sign Language. While many parents begin learning to sign, many others don’t. Those who do learn often don’t rise to the level of fluency. It’s estimated that 70% of parents of deaf and hard-of-hearing children aren’t fluent in Sign Language. Since most language acquisition happens in the home, deaf and hard-of-hearing children are at a huge disadvantage.
### *Individual Objectives*
### IT20116606 - Developing an emotion detection and text-to-speech system for non-verbal children
Develop a system that detects the emotion of mute children and convert their typed text into voice with the corresponding emotion. This system is intended to help non-verbal children communicate more effectively and express themselves emotionally in a more natural way. By detecting emotions and providing voice output, this system can help children express their feelings and needs more accurately, which can improve their socialization, emotional regulation, and overall quality of life.
### IT20117146 - Sound Recognition and Classification System for Enhancing Safety and Security of Deaf Children in Home Environments
In here we are going to implement a sound recognition and classification system to recognize important or dangerous sounds in the home environment, such as a smoke alarm, thundering, crying baby likewise and generate notifications and alerts for those detected sounds and send them to the users by using Mobile push notifications, Vibration and Flashing screen. Moreover, this system Preprocess the audio data by filtering out noise and converting the data into a suitable format. Using machine learning algorithms such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and Support Vector Machines (SVMs) a sound recognition model will be trained. Then it classifies the detected sound based on the trained model's predictions, which can include identifying important or dangerous sounds and send the notifications to the users.
### IT20016616 - Detect Sinhala sign language and convert it into Sinhala text and audio
To enhance its performance over time and offer greater detection and identification skills, the system also makes use of cutting-edge algorithms and machine learning approaches. It will detect the sign language and turn it into a Sinhala language text and audio. The interaction between deaf children and their parents will be facilitated by this feature.
### IT203864364 - Detect Sinhala voice and convert it into sign language
In here using algorithms and machine learning approaches to detect Sinhala voice and convert into Sinhala sign language. This feature will make it easier for deaf kids and their parents to communicate.
