Deep Transfer Learning Model for EEG Biometric Decoding
DOI:
https://doi.org/10.58496/ADSA/024/002Keywords:
Brain-Computer Interface, Motor Imagery, Deep Learning, Transfer Learning, VGG-19, Biometric, Short-time Fourier transformAbstract
In automated systems, biometric systems can be used for efficient and unique identification and authentication of individuals without requiring users to carry or remember any physical tokens or passwords. Biometric systems are a rapidly developing and promising technology domain. in contrasting with conventional methods like password IDs. Biometrics refer to biological measures or physical traits that can be employed to identify and authenticate individuals. The motivation to employ brain activity as a biometric identifier in automatic identification systems has increased substantially in recent years. with a specific focus on data obtained through electroencephalography (EEG). Numerous investigations have revealed the existence of discriminative characteristics in brain signals captured during different types of cognitive tasks. However, because of their high dimensional and nonstationary properties, EEG signals are inherently complex, which means that both feature extraction and classification methods must take this into consideration. In this study, a hybridization method that combined a classical classifier with a pre-trained convolutional neural network (CNN) and the short-time Fourier transform (STFT) spectrum was employed. For tasks such as subject identification and lock and unlock classification, we employed a hybrid model in mobile biometric authentication to decode two-class motor imagery (MI) signals. This was accomplished by building nine distinct hybrid models using nine potential classifiers, primarily classification algorithms, from which the best one was finally selected. The experimental portion of this study involved, in practice, six experiments. For biometric authentication tasks, the first experiment tries to create a hybrid model. In order to accomplish this, nine hybrid models were constructed using nine potential classifiers, which are largely classification methods. Comparing the RF-VGG19 model to other models, it is evident that the former performed better. As a result, it was chosen as the method for mobile biometric authentication. The performance RF-VGG19 model is validated using the second experiment. The third experiment attempts for verifying the RF-VGG19 model's performance. The fourth experiment performs the lock and unlock classification process with an average accuracy of 91.0% using the RF-VGG19 model. The fifth experiment was performed to verify the accuracy and effectiveness of the RF-VGG19 model in performing the lock and unlock task. The mean accuracy achieved was 94.40%. Validating the RF-VGG19 model for the lock and unlock task using a different dataset (unseen data) was the goal of the sixth experiment, which achieved an accuracy of 92.8%. This indicates the hybrid model assesses the left and right hands' ability to decode the MI signal. Consequently, The RF-VGG19 model can aid the BCI-MI community by simplifying the implementation of the mobile biometric authentication requirement, specifically in subject identification and lock and unlock classification.
Downloads
References
S. Zhang, L. Sun, X. Mao, and P. Liu, "EEG topomap-based Identification scheme," in 2021 3rd International Academic Exchange Conference on Science and Technology Innovation (IAECST), 2021, pp. 287-293: IEEE.
O. S. Ojo, M. O. Oyediran, B. J. Bamgbade, A. E. Adeniyi, G. N. Ebong, and S. A. Ajagbe, "Development of an Improved Convolutional Neural Network for an Automated Face Based University Attendance System," ParadigmPlus, vol. 4, no. 1, pp. 18-28, 2023.
R. Andersson, "Evaluation of the security of components in distributed information systems," ed: Institutionen för systemteknik, 2003.
R. A. Hamid et al., "How smart is e-tourism? A systematic review of smart tourism recommendation system applying data management," Computer Science Review, vol. 39, p. 100337, 2021.
N. S. Baqer, H. A. Mohammed, A. Albahri, A. Zaidan, Z. Al-qaysi, and O. Albahri, "Development of the Internet of Things sensory technology for ensuring proper indoor air quality in hospital facilities: Taxonomy analysis, challenges, motivations, open issues and recommended solution," Measurement, vol. 192, p. 110920, 2022.
H. Mouratidis, P. Giorgini, and G. Manson, "When security meets software engineering: a case of modelling secure information systems," Information Systems, vol. 30, no. 8, pp. 609-629, 2005.
S. Puengdang, S. Tuarob, T. Sattabongkot, and B. Sakboonyarat, "EEG-based person authentication method using deep learning with visual stimulation," in 2019 11th International Conference on Knowledge and Smart Technology (KST), 2019, pp. 6-10: IEEE.
I. Jayarathne, M. Cohen, and S. Amarakeerthi, "BrainID: Development of an EEG-based biometric authentication system," in 2016 IEEE 7th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON), 2016, pp. 1-6: IEEE.
M. H. Jasim et al., "Emotion detection among Muslims and non-Muslims while listening to Quran recitation using EEG," Int J Acad Res Bus Soc Sci, vol. 9, p. 14, 2019.
M. Wang, J. Hu, and H. A. Abbass, "BrainPrint: EEG biometric identification based on analyzing brain connectivity graphs," Pattern Recognition, vol. 105, p. 107381, 2020.
K. P. Thomas and A. Vinod, "Toward EEG-based biometric systems: The great potential of brain-wave-based biometrics," IEEE Systems, Man, and Cybernetics Magazine, vol. 3, no. 4, pp. 6-15, 2017.
A. Khosla, P. Khandnor, and T. Chand, "A comparative analysis of signal processing and classification methods for different applications based on EEG signals," Biocybernetics and Biomedical Engineering, vol. 40, no. 2, pp. 649-690, 2020.
Z. Al-Qaysi, B. Zaidan, A. Zaidan, and M. Suzani, "A review of disability EEG based wheelchair control system: Coherent taxonomy, open challenges and recommendations," Computer methods and programs in biomedicine, vol. 164, pp. 221-237, 2018.
M. M. Salih, M. Ahmed, B. Al-Bander, K. F. Hasan, M. L. Shuwandy, and Z. Al-Qaysi, "Benchmarking Framework for COVID-19 Classification Machine Learning Method Based on Fuzzy Decision by Opinion Score Method," Iraqi Journal of Science, pp. 922-943, 2023.
Z. Al-Qaysi et al., "Systematic review of training environments with motor imagery brain–computer interface: coherent taxonomy, open issues and recommendation pathway solution," Health and Technology, vol. 11, no. 4, pp. 783-801, 2021.
A. B. Tatar, "Biometric identification system using EEG signals," Neural Computing and Applications, vol. 35, no. 1, pp. 1009-1023, 2023.
R. Das, E. Maiorana, and P. Campisi, "Motor imagery for EEG biometrics using convolutional neural network," in 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2018, pp. 2062-2066: IEEE.
Z. Al-Qaysi et al., "A systematic rank of smart training environment applications with motor imagery brain-computer interface," Multimedia Tools and Applications, vol. 82, no. 12, pp. 17905-17927, 2023.
S. U. Amin, M. Alsulaiman, G. Muhammad, M. A. Mekhtiche, and M. S. Hossain, "Deep Learning for EEG motor imagery classification based on multi-layer CNNs feature fusion," Future Generation computer systems, vol. 101, pp. 542-554, 2019.
R. Liu, Z. Zhang, F. Duan, X. Zhou, and Z. Meng, "Identification of Anisomerous Motor Imagery EEG Signals Based on Complex Algorithms," Computational intelligence and neuroscience, vol. 2017, 2017.
R. A. Aljanabi, Z. Al-Qaysi, M. Ahmed, and M. M. Salih, "Hybrid Model for Motor Imagery Biometric Identification," Iraqi Journal For Computer Science and Mathematics, vol. 5, no. 1, pp. 1-12, 2024.
S. M. Samuri, T. V. Nova, B. Rahmatullah, S. L. Wang, and Z. T. Al-Qaysi, "Classification model for breast cancer mammograms," IIUM Engineering Journal, vol. 23, no. 1, pp. 187-199, 2022.
Z. Al-qaysi, A. Albahri, M. Ahmed, and M. M. Salih, "Dynamic decision-making framework for benchmarking brain–computer interface applications: a fuzzy-weighted zero-inconsistency method for consistent weights and VIKOR for stable rank," Neural Computing and Applications, pp. 1-24, 2024.
M. Ahmed, B. Zaidan, A. Zaidan, M. M. Salih, Z. Al-Qaysi, and A. Alamoodi, "Based on wearable sensory device in 3D-printed humanoid: A new real-time sign language recognition system," Measurement, vol. 168, p. 108431, 2021.
T. Kaur and T. K. Gandhi, "Automated brain image classification based on VGG-16 and transfer learning," in 2019 International Conference on Information Technology (ICIT), 2019, pp. 94-98: IEEE.
M. Ahmed, Z. Al-Qaysi, M. L. Shuwandy, M. M. Salih, and M. H. Ali, "Automatic COVID-19 pneumonia diagnosis from x-ray lung image: A Deep Feature and Machine Learning Solution," in Journal of Physics: Conference Series, 2021, vol. 1963, no. 1, p. 012099: IOP Publishing.
Y. Mangalmurti and N. Wattanapongsakorn, "COVID-19 and Other Lung Disease Detection Using VGG19 Pretrained Features and Support Vector Machine," in 2021 25th International Computer Science and Engineering Conference (ICSEC), 2021, pp. 51-56: IEEE.
M. Ahmed, Z. Al-qaysi, M. L. Shuwandy, M. M. Salih, and M. H. Ali, "Automatic COVID-19 pneumonia diagnosis from x-ray lung image: A Deep Feature and Machine Learning Solution," in Journal of Physics: Conference Series, 2021, vol. 1963, p. 012099: IOP Publishing.
A. S. Albahri et al., "Role of biological data mining and machine learning techniques in detecting and diagnosing the novel coronavirus (COVID-19): a systematic review," Journal of medical systems, vol. 44, pp. 1-11, 2020.
A. Saidi, S. B. Othman, and S. B. Saoud, "A novel epileptic seizure detection system using scalp EEG signals based on hybrid CNN-SVM classifier," in 2021 IEEE Symposium on Industrial Electronics & Applications (ISIEA), 2021, pp. 1-6: IEEE.
S. Garfan et al., "Telehealth utilization during the Covid-19 pandemic: A systematic review," Computers in biology and medicine, vol. 138, p. 104878, 2021.
Z. Al-Qaysi, A. Al-Saegh, A. F. Hussein, and M. Ahmed, "Wavelet-based Hybrid learning framework for motor imagery classification," Iraqi J Electr Electron Eng, 2022.
M. Hadid, Q. M. Hussein, Z. Al-Qaysi, M. Ahmed, and M. M. Salih, "An Overview of Content-Based Image Retrieval Methods And Techniques," Iraqi Journal For Computer Science and Mathematics, vol. 4, no. 3, pp. 66-78, 2023.
Z. Al-Qaysi, A. Albahri, M. Ahmed, and S. M. Mohammed, "Development of hybrid feature learner model integrating FDOSM for golden subject identification in motor imagery," Physical and Engineering Sciences in Medicine, pp. 1-16, 2023.
A. Albahri et al., "A Trustworthy and Explainable Framework for Benchmarking Hybrid Deep Learning Models Based on Chest X-Ray Analysis in CAD Systems," International Journal of Information Technology & Decision Making, 2024.
O. Albahri et al., "Systematic review of artificial intelligence techniques in the detection and classification of COVID-19 medical images in terms of evaluation and benchmarking: Taxonomy analysis, challenges, future solutions and methodological aspects," Journal of infection and public health, vol. 13, no. 10, pp. 1381-1396, 2020.
N. Begum and M. K. Hazarika, "Maturity detection of tomatoes using Transfer Learning," Measurement: Food, p. 100038, 2022.
A. H. Alamoodi et al., "Sentiment analysis and its applications in fighting COVID-19 and infectious diseases: A systematic review," Expert systems with applications, vol. 167, p. 114155, 2021.
M. Ahmed et al., "Intelligent decision-making framework for evaluating and benchmarking hybridized multi-deep transfer learning models: managing COVID-19 and beyond," International Journal of Information Technology & Decision Making, 2023.
Z. Al-Qaysi, A. Albahri, M. Ahmed, and S. M. Mohammed, "Development of hybrid feature learner model integrating FDOSM for golden subject identification in motor imagery," Physical and Engineering Sciences in Medicine, vol. 46, no. 4, pp. 1519-1534, 2023.
Y. Xia, M. Cai, C. Ni, C. Wang, E. Shiping, and H. Li, "A Switch State Recognition Method based on Improved VGG19 network," in 2019 IEEE 4th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), 2019, vol. 1, pp. 1658-1662: IEEE.
M. Ahmed, M. D. Salman, R. Adel, Z. Alsharida, and M. Hammood, "An intelligent attendance system based on convolutional neural networks for real-time student face identifications," Journal of Engineering Science and Technology, vol. 17, no. 5, pp. 3326-3341, 2022.
S. Kavitha, B. Dhanapriya, G. N. Vignesh, and K. Baskaran, "Neural Style Transfer Using VGG19 and Alexnet," in 2021 International Conference on Advancements in Electrical, Electronics, Communication, Computing and Automation (ICAECA), 2021, pp. 1-6: IEEE.
N. Abuared, A. Panthakkan, M. Al-Saad, S. A. Amin, and W. Mansoor, "Skin Cancer Classification Model Based on VGG 19 and Transfer Learning," in 2020 3rd International Conference on Signal Processing and Information Security (ICSPIS), 2020, pp. 1-4: IEEE.
S. Mascarenhas and M. Agarwal, "A comparison between VGG16, VGG19 and ResNet50 architecture frameworks for Image Classification," in 2021 International Conference on Disruptive Technologies for Multi-Disciplinary Research and Applications (CENTCON), 2021, vol. 1, pp. 96-99: IEEE.
A. Albahri et al., "A systematic review of using deep learning technology in the steady-state visually evoked potential-based brain-computer interface applications: current trends and future trust methodology," International Journal of Telemedicine and Applications, vol. 2023, 2023.
C. Huang, Y. Xiao, and G. Xu, "Predicting human intention-behavior through EEG signal analysis using multi-scale CNN," IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 18, no. 5, pp. 1722-1729, 2020.
T. H. Shovon, Z. Al Nazi, S. Dash, and M. F. Hossain, "Classification of motor imagery EEG signals with multi-input convolutional neural network by augmenting STFT," in 2019 5th International Conference on Advances in Electrical Engineering (ICAEE), 2019, pp. 398-403: IEEE.
S. Chaudhary, S. Taran, V. Bajaj, and A. Sengur, "Convolutional neural network based approach towards motor imagery tasks EEG signals classification," IEEE Sensors Journal, vol. 19, no. 12, pp. 4494-4500, 2019.
G. Xu et al., "A deep transfer convolutional neural network framework for EEG signal classification," IEEE Access, vol. 7, pp. 112767-112776, 2019.
A. Al-Saegh, S. A. Dawwd, and J. M. Abdul-Jabbar, "CutCat: An augmentation method for EEG classification," Neural Networks, vol. 141, pp. 433-443, 2021.
R. Masoomi and A. Khadem, "Enhancing LDA-based discrimination of left and right hand motor imagery: Outperforming the winner of BCI Competition II," in 2015 2nd International Conference on Knowledge-Based Engineering and Innovation (KBEI), 2015, pp. 392-398: IEEE.
T.-U. Jang, B. M. Kim, Y.-M. Yang, W. Lim, and D.-H. Oh, "Motor-imagery EEG signal classification using position matching and vector quantisation," International Journal of Telemedicine and Clinical Practices, vol. 1, no. 4, pp. 306-313, 2016.
A. B. Das and M. I. H. Bhuiyan, "Discrimination and classification of focal and non-focal EEG signals using entropy-based features in the EMD-DWT domain," Biomedical Signal Processing and Control, vol. 29, pp. 11-21, 2016.
S. K. Bashar and M. I. H. Bhuiyan, "Classification of motor imagery movements using multivariate empirical mode decomposition and short time Fourier transform based hybrid method," Engineering science and technology, an international journal, vol. 19, no. 3, pp. 1457-1464, 2016.
R. Chatterjee, T. Bandyopadhyay, D. K. Sanyal, and D. Guha, "Dimensionality reduction of EEG signal using fuzzy discernibility matrix," in 2017 10th International Conference on Human System Interactions (HSI), 2017, pp. 131-136: IEEE.
S. V. Eslahi, N. J. Dabanloo, and K. Maghooli, "A GA-based feature selection of the EEG signals by classification evaluation: Application in BCI systems," arXiv preprint arXiv:1903.02081, 2019.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Rasha A. Aljanabi, Z.T. Al-Qaysi , M. S Suzani
This work is licensed under a Creative Commons Attribution 4.0 International License.
