Enhanced Assistive Technology on Audio-Visual Speech Recognition for the Hearing Impaired

View Sample PDF

Author(s): N. Ambika (St. Francis College, India)
Copyright: 2023
Pages: 11
Source title: Handbook of Research on AI-Based Technologies and Applications in the Era of the Metaverse
Source Author(s)/Editor(s): Alex Khang (Global Research Institute of Technology and Engineering, USA), Vrushank Shah (Institute of Technology and Engineering, Indus University, India)and Sita Rani (Department of Computer Science and Engineering, Guru Nanak Dev Engineering College, India)
DOI: 10.4018/978-1-6684-8851-5.ch017

Keywords: Artificial Intelligence / Engineering Science Reference / Media & Communications / Virtual Communities & Virtual Reality

Purchase

View Enhanced Assistive Technology on Audio-Visual Speech Recognition for the Hearing Impaired on the publisher's website for pricing and purchasing information.

Abstract

People who have difficulty hearing can use speech recognition software to communicate differently. The task is audio-visual speech recognition for better lip-reading comprehension. Audio speech recognition is the process of turning spoken words into text. The neural network model is trained using the Librispeech dataset. The input sound signal creates sound frames with a stride of 10 milliseconds and a window size of 20-25 milliseconds. It uses audio as the input, and feature extraction extracts information from features. A visual speech recognition system automatically recognizes spoken words by observing how the speaker moves their lips. The suggestion considers body language to understand the communicator's spoken words, increasing interpretation accuracy by 5.05%.

The IRMA Community

Research IRM

Enhanced Assistive Technology on Audio-Visual Speech Recognition for the Hearing Impaired

Purchase

Abstract

Related Content

IRMA Sponsors