EEG Based Emotion Recognition Using Deep CNN Classifier and Hybrid Feature Selection Algorithm

International Journal of Electrical and Electronics Engineering

© 2023 by SSRG - IJEEE Journal

Volume 10 Issue 9

Year of Publication : 2023

Authors : T. Manoj Prasath, R. Vasuki

10.14445/23488379/IJEEE-V10I9P112

How to Cite?

T. Manoj Prasath, R. Vasuki, "EEG Based Emotion Recognition Using Deep CNN Classifier and Hybrid Feature Selection Algorithm," SSRG International Journal of Electrical and Electronics Engineering, vol. 10,  no. 9, pp. 124-136, 2023. Crossref, https://doi.org/10.14445/23488379/IJEEE-V10I9P112

Abstract:

Electroencephalogram (EEG) based emotional evaluation has achieved excellent outcomes in medicine, security, and interaction between humans and computers. Especially compared with traditional signal processing and Machine Learning (ML) based applications, Deep Learning (DL) based techniques have recently dramatically increased the classification precision. Due to its sufficient spatial accuracy and enhanced temporal resolution, EEG signals typically represent emotional states. It is essential to consider that identifying emotions based on EEG signals relies on the efficacy of three processes: extracting features, selecting features, and classifying the feelings. Therefore, this work proposes a computerized approach for recognizing emotions from EEG signals. High Pass Infinite Impulse Response with Zero-Filtering (HPIIRZ) approach is used to reduce artifacts in EEG signals. Following this, the frequency and spectral features are extracted using Power Spectral Density (PSD), from which the optimal features are selected by a hybrid Improved Artificial Bee Colony algorithm-Particle Swarm Optimization (IABC-PSO). Deep Convolutional Neural Networks (DCNNs) are then used for classifying emotional states at the classification stage. An evaluation model is developed using the Python platform to evaluate the performance of the proposed model, including accuracy, specificity, and sensitivity. The outcomes demonstrate that the proposed method is more efficient; the DCNN-based method achieves a higher accuracy of 95.80%.

Keywords:

EEG, HPIIRZ Filtering technique, Power Spectral Density, Hybrid IABC-PSO, DCNN.

References:

[1] Eman A. Abdel-Ghaffar, Yujin Wu, and Mohamed Daoudi, “Subject-Dependent Emotion Recognition System Based on Multidimensional Electroencephalographic Signals: A Riemannian Geometry Approach,” IEEE Access, vol. 10, pp. 14993–15006, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[2] Tengfei Song et al., “MPED: A Multi-Modal Physiological Emotion Database for Discrete Emotion Recognition,” IEEE Access, vol. 7, pp. 12177–12191, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[3] Smith K. Khare, and Varun Bajaj, “Time–Frequency Representation and Convolutional Neural Network-Based Emotion Recognition,” IEEE Transactions on Neural Networks and Learning Systems, vol. 32, no. 7, pp. 2901–2909, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[4] Xiaobing Du et al., “An Efficient LSTM Network for Emotion Recognition from Multichannel EEG Signals,” IEEE Transactions on Affective Computing, vol. 13, no. 3, pp. 1528–1540, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[5] Haiyun Huang et al., “An EEG-Based Brain-Computer Interface for Emotion Recognition and Its Application in Patients with Disorder of Consciousness,” IEEE Transactions on Affective Computing, vol. 12, no. 4, pp. 832–842, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[6] Chang Li et al., “EEG-Based Emotion Recognition via Transformer Neural Architecture Search,” IEEE Transactions on Industrial Informatics, vol. 19, no. 4, pp. 6016–6025, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[7] Zhi Zhang, Yan Liu, and Sheng-hua Zhong, “GANSER: A Self-Supervised Data Augmentation Framework for EEG-Based Emotion Recognition,” IEEE Transactions on Affective Computing, vol. 14, no. 3, pp. 2048-2063, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[8] Yang Li et al., “GMSS: Graph-Based Multi-Task Self-Supervised Learning for EEG Emotion Recognition,” IEEE Transactions on Affective Computing, vol. 14, no. 3, pp. 2512-2525, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[9] Wei Tao et al., “EEG-Based Emotion Recognition via Channel-Wise Attention and Self-Attention,” IEEE Transactions on Affective Computing, vol. 14, no. 1, pp. 382-393, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[10] Alireza Samavat et al., “Deep Learning Model with Adaptive Regularization for EEG-Based Emotion Recognition Using Temporal and Frequency Features,” IEEE Access, vol. 10, pp. 24520–24527, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[11] Ningjie Liu et al., “Multiple Feature Fusion for Automatic Emotion Recognition Using EEG Signals,” 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 896-900, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[12] Tengfei Song et al., “EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks,” IEEE Transactions on Affective Computing, vol. 11, no. 3, pp. 532–541, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[13] Jingzhao Hu et al., “ScalingNet: Extracting Features from Raw EEG Data for Emotion Recognition,” Neurocomputing, vol. 463, pp. 177–184, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Luz Santamaria-Granados et al., “Using the Deep Convolutional Neural Network for Emotion Detection on a Physiological Signals Dataset (AMIGOS),” IEEE Access, vol. 7, pp. 57–67, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[15] Laura Piho, and Tardi Tjahjadi, “A Mutual Information Based Adaptive Windowing of Informative EEG for Emotion Recognition,” IEEE Transactions on Affective Computing, vol. 11, no. 4, pp. 722–735, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[16] Ante Topic, and Mladen Russo, “Emotion Recognition Based on EEG Feature Maps through Deep Learning Network,” Engineering Science and Technology, An International Journal, vol. 24, no. 6, pp. 1442–1454, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[17] Yi Ding et al., “TSception: A Deep Learning Framework for Emotion Detection Using EEG,” 2020 International Joint Conference on Neural Networks (IJCNN), pp. 1-7, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[18] Shailaja Kotte, and J.R.K. Kumar Dabbakuti, “EEG Signal in Emotion Detection Feature Extraction and Classification using Fuzzy Based Feature Search Algorithm and Deep Q Neural Network in Deep Learning Architectures,” SSRG International Journal of Electronics and Communication Engineering, vol. 10, no. 5, pp. 85-95, 2023.
[CrossRef] [Publisher Link]
[19] Shengfu Lu et al., “Emotion Recognition from Multichannel EEG Signals Using K-Nearest Neighbor Classification,” Technology and Health Care, vol. 26, no. S1, pp. 509–519, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[20] Wei-Long Zheng et al., “EEG-Based Emotion Classification Using Deep Belief Networks,” 2014 IEEE International Conference on Multimedia and Expo (ICME), pp. 1-6, 2014.
[CrossRef] [Google Scholar] [Publisher Link]
[21] Nikhil Kumar Singh, and Gokul Rajan V., “Facial Emotion Recognition in Python,” SSRG International Journal of Computer Science and Engineering, vol. 7, no. 6, pp. 20-23, 2020.
[CrossRef] [Publisher Link]
[22] Adnan Mehmood Bhatti et al., “Human Emotion Recognition and Analysis in Response to Audio Music Using Brain Signals,” Computers in Human Behavior, vol. 65, pp. 267–275, 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[23] Pooja G. Nair, and Sneha R. “A Review: Facial Recognition Using Machine Learning,” International Journal of Recent Engineering Science, vol. 7, no. 3, pp. 85-89, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[24] Rania Alhalaseh, and Suzan Alasasfeh, “Machine-Learning-Based Emotion Recognition System Using EEG signals,” Computers, vol. 9, no. 4, pp. 1-15, 2020.
[CrossRef] [Google Scholar] [Publisher Link]