Design of a System of Response Options Using a Neural Network for People with Communication Difficulties

International Journal of Electrical and Electronics Engineering

© 2024 by SSRG - IJEEE Journal

Volume 11 Issue 3

Year of Publication : 2024

Authors : Giancarlo Apaza Zurita, Sebastian Miguel Cáceres Huamán, Jonathan Jesús Mendoza Núñez, Talavera-Suarez, Jesus, Joseph, G. M.

10.14445/23488379/IJEEE-V11I3P119

How to Cite?

Giancarlo Apaza Zurita, Sebastian Miguel Cáceres Huamán, Jonathan Jesús Mendoza Núñez, Talavera-Suarez, Jesus, Joseph, G. M., "Design of a System of Response Options Using a Neural Network for People with Communication Difficulties," SSRG International Journal of Electrical and Electronics Engineering, vol. 11,  no. 3, pp. 231-239, 2024. Crossref, https://doi.org/10.14445/23488379/IJEEE-V11I3P119

Abstract:

The paper proposes a communication system aimed at improving the interaction of people who have lost the ability to speak due to various circumstances, such as accidents, facial paralysis, or vegetative states. The system consists of speech recognition and a neural network with Bidirectional Encoder Representations from Transformers (BERT) structure, which was trained to provide response options in order to establish fluid and meaningful interactions and maintain a conversation between the patient and the environment. Its design seeks to improve the quality of life of those with substantial communication challenges; for this purpose, we propose an interface consisting of two modes, one for people who have some mobility in their hands and another for people in a completely vegetative state using Electrooculogram (EOG) systems to configure the signals with our proposed system. The effectiveness of the system was evaluated using the subjective Scale Utility System (SUS) method, yielding promising positives that underline its effectiveness and perceived usefulness for real environments.

Keywords:

Artificial Intelligence, Assisted communication, Assistive technology, EOG, Voice recognition.

References:

[1] Gunes Ekim, Nuri Ikizler, and Ayten Atasoy, “A Study on Eye-Blink Detection-Based Communication System by Using K-Nearest Neighbors Classifier,” Advances in Electrical and Computer Engineering, vol. 23, no. 1, pp. 71-78, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[2] Armagan Amcalar, and Mujdat Cetin, “A Brain-Computer Interface System for Online Spelling,” 2010 IEEE 18th Signal Processing and Communications Applications Conference, Diyarbakir, Turkey, pp. 196-199, 2010.
[CrossRef] [Google Scholar] [Publisher Link]
[3] Faraz Akram, Seung Moo Han, and Tae-Seong Kim, “An Efficient Word Typing P300-BCI System Using a Modified T9 Interface and Random Forest Classifier,” Computers in Biology and Medicine, vol. 56, pp. 30-36, 2015.
[CrossRef] [Google Scholar] [Publisher Link]
[4] Ali Bulent Usakli, and Serkan Gurkan, “Design of a Novel Efficient Human–Computer Interface: An Electrooculagram Based Virtual Keyboard,” IEEE Transactions on Instrumentation and Measurement, vol. 59, no. 8, pp. 2099-2108, 2010.
[CrossRef] [Google Scholar] [Publisher Link]
[5] Chi Zhang, Rui Yao, and Jinpeng Cai, “Efficient Eye Typing with 9-Direction Gaze Estimation,” Multimed Tools Applications, vol. 77, pp. 19679-19696, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[6] Jang-Zern Tsai et al., “A Feasibility Study of an Eye-Writing System Based on Electro-Oculography,” Journal of Medical and Biological Engineering, vol. 28, no. 1, pp. 39-46, 2008.
[Google Scholar]
[7] Kingshuk Mukherjee, and Debdatta Chatterjee, “Augmentative and Alternative Communication Device Based on Eye-Blink Detection and Conversion to Morse-Code to Aid Paralyzed Individuals,” 2015 International Conference on Communication, Information & Computing Technology (ICCICT), Mumbai, India, pp. 1-5, 2015.
[CrossRef] [Google Scholar] [Publisher Link]
[8] Antonia Pirrera et al., “Assistive Technologies and Quadriplegia: A Map Point on the Development and Spread of the Tongue Barbell Piercing,” Healthcare, vol. 11, no. 1. pp. 1-20, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[9] Sayyed G. Maisikeli, “Level of Assistive Technology Use and Awareness among People with Physical Disability in the United Arab Emirates,” Technology and Disability, vol. 35, no. 1, pp. 11-20, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[10] Mohd Rizwan Jafar, and D.S. Nagesh, “Literature Review on Assistive Devices Available for Quadriplegic People: Indian Context,” Disability and Rehabilitation: Assistive Technology, vol. 18, no. 6, pp. 929-941, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[11] Nordine Sebkhi et al., “Evaluation of a Head-Tongue Controller for Power Wheelchair Driving by People With Quadriplegia,” IEEE Transactions on Biomedical Engineering, vol. 69, no. 4, pp. 1302-1309, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[12] Petra Karlsson, Megan Shepherd, and Ingrid Honan, “Accommodations to Cognitive Assessment for a Child with Dyskinetic Cerebral Palsy: Case Study”, Disability and Rehabilitation: Assistive Technology, vol. 19, no. 2, pp. 360-366, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[13] Shengchang Lan, Linting Ye, and Kang Zhang, “Applying mmWave Radar Sensors to Vocabulary-Level Dynamic Chinese Sign Language Recognition for the Community With Deafness and Hearing Loss”, IEEE Sensors Journal, vol. 23, no. 22, pp. 27273-27283, 2023.
[CrossRef] [Google Scholar] [Publisher Link]