Fatigue State Detection Through Multiple Machine Learning Classifiers Using EEG Signal
Keywords:
Decision Tree, EEG signal, Fatigue detection, K-Nearest Neighbor, Machine learning, Random Forest.Abstract
Fatigued drivers can often cause long-distance accidents worldwide. Fatigue states are the primary cause of highway accidents. This study is conducted to provide a comprehensive and reliable fatigue state detection system to avoid accidents and make a good decision. Three machine learning algorithms were applied to seventy-six subjects' electroencephalogram (EEG) readings to test their performance. A preprocessing stage extracts relevant information before applying machine learning algorithms to the signal. Three analytical methods were employed in this study, specifically the Decision Tree, the K-Nearest Neighbors and the Random Forest. The study revealed that employing all the classifiers resulted in a satisfactory accuracy rate compared to existing state-of-the-art methods for detecting fatigue states. The classification accuracy using Decision Tree for four classes and two classes were achieved at 88.61% and 88.21% respectively, which can make this EEG-based technology a practical and dependable solution for real-time applications.References
E. S. Ford, T. J. Cunningham, W. H. Giles and J. B. Croft, Trends in insomnia and excessive daytime sleepiness among US adults from 2002 to 2012, Sleep Medicine, 16(3), 2015, 372-378.
A. C. Hayley et al., Excessive daytime sleepiness and falls among older men and women: cross-sectional examination of a population-based sample, BMC Geriatrics, 15(1), 2015, 74.
C. Hara, F. Lopes Rocha and M. F. F. Lima-Costa, Prevalence of excessive daytime sleepiness and associated factors in a Brazilian community: the Bambuı́ study, Sleep Medicine, 5(1), 2004, 31-36.
T. B. Young, Epidemiology of daytime sleepiness: definitions, symptomatology, and prevalence, The Journal of Clinical Psychiatry, 65(16), 2004, 12-16.
J. Mathis and C. W. Hess, Sleepiness and vigilance tests, Swiss Medical Weekly, 19(15-16), 2009, 214-219.
T. Akerstedt, C. Bassetti, F. Cirignotta and D. Garc’ia-Borreguero, Sleepiness at the wheel: white paper, European Sleep Research Society, French Motorway Companies (ASFA), National Institute of Sleep and Vigilance (INSV), 2013.
D. J. Gottlieb, J. M. Ellenbogen, M. T. Bianchi and C. A. Czeisler, Sleep deficiency and motor vehicle crash risk in the general population: a prospective cohort study, BMC Medicine, 16(1), 2018, 44.
J. Skorucak, A. Hertig-Godeschalk, D. R. Schreier, A. Malafeev, J. Mathis and P. Achermann, Automatic detection of microsleep episodes with feature-based machine learning, Sleep, 43(1), 2020, zsz225.
Commercial Motor Vehicle Driver Fatigue, Long-Term Health, and Highway Safety: Research Needs, National Academies Press, Washington, USA, 2016.
A. Kareem, Review of global menace of road accidents with special reference to malaysia- a social perspective, Malaysian Journal of Medical Sciences, 10(2), 2003, 31-39.
I. A. Fouad, A robust and efficient EEG-based drowsiness detection system using different machine learning algorithms, Ain Shams Engineering Journal, 14(3), 2023, 101895.
Fatigue European Road Safety Observator Report, http://www.erso.eu, 2006 ((accessed 08.09.2023).
A. Rechtschaffen and A. Kales, A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects. Public Health Service, US Government Printing Office, Washington DC, 1968.
R. B. Berri et al., The AASM manual for the scoring of sleep and associated events: Rules, terminology and technical specifications, version 2.5. Darien, CT: American Association of Sleep Medicine, 2018.
C. Iber, The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology, and Technical Specification, https://cir.nii.ac.jp/crid/1370004237604151044, 2007 (accessed 08.09.2023).
M. A. Carskadon, Guidelines for the multiple sleep latency test (MSLT): A standard measure of sleepiness, Sleep, 9(4), 1986, 519-524.
M. Mitler, K. S. Gujavarty and C. P. Browman, Maintenance of wakefulness test: A polysomnographic technique for evaluating treatment efficacy in patients with excessive somnolence, Electroencephalography and Clinical Neurophysiology, 53(6), 1982, 658-661.
J. Mathis, S. de Lacy, C. Roth and E. A. Hill, Measuring-monitoring sleep and wakefulness, ESRS European Sleep Medicine Textbook. Regensburg: European Sleep Research Society, 2014, 125-143.
M. R. Littner et al., Practice parameters for clinical use of the multiple sleep latency test and the maintenance of wakefulness test, Sleep, 28(1), 2005, 113-121.
J. Mathis and D. Schreier, Daytime sleepiness and driving behaviour, Therapeutische Umschau, 71(11), 2014, 679-686.
Y. Harrison and J. A. Horne, Occurrence of ‘microsleeps’ during daytime sleep onset in normal subjects, Electroencephalography and Clinical Neurophysiology, 98(5), 1996, 411-416.
C. Guilleminault, M. Billiard, J. Montplaisir and W. C. Dement, Altered states of consciousness in disorders of daytime sleepiness, Journal of the Neurological Sciences, 26(3), 1975, 377-393.
V. L. Tirunahari, S. A. Zaidi, R. Sharma, J. Skurnick and H. Ashtyani, Microsleep and sleepiness: a comparison of multiple sleep latency test and scoring of microsleep as a diagnostic test for excessive daytime sleepiness, Sleep Medicine, 4(1), 2003, 63-67.
H. J. Moller, L. Kayumov, E. L. Bulmash, J. Nhan and C. M. Shapiro, Simulator performance, microsleep episodes, and subjective sleepiness: normative data using convergent methodologies to assess driver drowsiness, Journal of Psychosomatic Research, 61(3), 2006, 335-342.
L. N. Boyle, J. Tippin, A. Paul and M. Rizzo, Driver performance in the moments surrounding a microsleep, Transportation Research Part F: Traffic Psychology and Behaviour, 11(2), 2008, 126-136.
U. S. Herrmann, C. W. Hess, A. G. Guggisberg, C. Roth, M. Gugger and J. Mathis, Sleepiness is not always perceived before falling asleep in healthy, sleep-deprived subjects, Sleep Medicine, 11(8), 2010, 747-751.
M. -P. Hosseini, A. Hosseini and K. Ahi, A review on machine learning for EEG signal processing in bioengineering, IEEE Reviews in Biomedical Engineering, 14, 2021, 204-218.
A. Quintero-Rincon, M. E. Fontecha and C. D’Giano, Driver fatigue EEG signals detection by using robust univariate analysis. arXiv, 2019 (accessed 08.09.2023).
D. Jing, D. Liu, S. Zhang and Z. Guo, Fatigue driving detection method based on EEG analysis in low-voltage and hypoxia plateau environment, International Journal of Transportation Science and Technology, 9(4), 2020, 366-376.
C. Zhang, L. Sun, F. Cong, T. Kujala, T. Ristaniemi and T. Parviainen, Optimal imaging of multi-channel EEG features based on a novel clustering technique for driver fatigue detection, Biomedical Signal Processing and Control, 62, 2020, 102103.
T. Tuncer, S. Dogan, F. Ertam and A. Subasi, A dynamic center and multi threshold point based stable feature extraction network for driver fatigue detection utilizing EEG signals, Cognitive Neurodynamics, 15(2), 2021, 223-237.
M. Rashid, M. Mustafa, N. Sulaiman, N. R. H. Abdullah and R. Samad, Random subspace K-NN based ensemble classifier for driver fatigue detection utilizing selected EEG channels, Traitement du Signal, 38(5), 2021, 1259-1270.
S. Hwang, S. Park, D. Kim, J. Lee and H. Byun, Mitigating inter-subject brain signal variability for EEG-based driver fatigue state classification, 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, Canada, 2021, 990-994.
T. Wilaiprasitporn, A. Ditthapron, K. Matchaparn, T. Tongbuasirilai, N. Banluesombatkul and E. Chuangsuwanich, Affective EEG-based person identification using the deep learning approach, IEEE Transactions on Cognitive and Developmental Systems, 12(3), 2020, 486-496.
H. Qin and P. Wang, Finger-vein verification based on LSTM recurrent neural networks, Applied Sciences, 9(8), 2019, 1687.
V. Vijayan and E. Sherly, Real time detection system of driver drowsiness based on representation learning using deep neural networks, Journal of Intelligent & Fuzzy Systems, 36(3), 2019, 1977-1985.
F. Wang, Y. Wan, M. Li, H. Huang, L. Li, X. Hou, J. Pan, Z. Wen and J. Li, Recent advances in fatigue detection algorithm based on EEG, Intelligent Automation & Soft Computing, 35(3), 2023, 3573-3586.
C. Zhao, C. Zheng, M. Zhao, Y. Tu and J. Liu, Multivariate autoregressive models and kernel learning algorithms for classifying driving mental fatigue based on electroencephalographic, Expert Systems with Applications, 38(3), 2011, 1859-1865.
R. Chai, G. R. Naik, T. N. Nguyen, S. H. Ling, Y. Tran, A. Craig and H.T. Nguyen, Driver fatigue classification with independent component by entropy rate bound minimization analysis in an EEG-based system, IEEE Journal of Biomedical and Health Informatics, 21(3), 2017, 715-724.
Y. LeCun, Y. Bengio and G. Hinton, Deep learning, Nature, 521(7553), 2015, 436-444.
T. K. Reddy, V. Arora, V. Gupta, R. Biswas and L. Behera, EEG-based drowsiness detection with fuzzy independent phase-locking value representations using Lagrangian-based deep neural networks, IEEE Transactions on Systems, Man, and Cybernetics, 52(1), 2022, 101-111.
J. R. Paulo, G. Pires and U. J. Nunes, Cross-subject zero calibration driver’s drowsiness detection: exploring spatiotemporal image encoding of EEG signals for convolutional neural network classification, IEEE Transactions on Neural Systems and Rehabilitation Engineering, 29, 2021, 905-915.
Y. Liu, Z. Lan, J. Cui, O. Sourina and W. Müller-Wittig, Inter-subject transfer learning for EEG-based mental fatigue recognition, Advanced Engineering Informatics, 46, 2020, 101157.
H. -G. Anneke, S. Jelena, M. Alexander, A. Peter, M. Johannes and R. Schreier David, Maintenance of wakefulness test (MWT) recordings, Zenodo, Sep. 27, 2019.
J. McNames, T. Thong and M. Aboy, Impulse rejection filter for artifact removal in spectral analysis of biomedical signals, 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Francisco, CA, USA, 2004, 145-148.
M. Misiti, Y. Michel, G. Oppenheim and J. -M. Poggi, Wavelet Toolbox 4 - User’s Guide, The MathWorks Inc., Massachusetts, USA, 2007.
J. Wagner, J. Kim and E. Andre, From physiological signals to emotions: implementing and comparing selected methods for feature extraction and classification, IEEE International Conference on Multimedia and Expo, Amsterdam, The Netherlands, 2005, 940-943.
L. Sun and M. Shen, Analysis of non-stationary electroencephalogram using the wavelet transformation, 6th International Conference on Signal Processing, Beijing, China, 2002, 1520-1523.
S. I. Hjelm, S. Ilstedt and C. Browall, Brainball-using brain activity for cool competition, NordiCHI2000 Proceedings, 7(9), 2000, 19.
M. Murugappan, S. Murugappan, Balaganapathy and C. Gerard, Wireless EEG signals based neuromarketing system using Fast Fourier Transform (FFT), IEEE 10th International Colloquium on Signal Processing and its Applications, Kuala Lumpur, Malaysia, 2014, 25-30.
Anuradha and G. Gupta, A self explanatory review of decision tree classifiers, International Conference on Recent Advances and Innovations in Engineering (ICRAIE-2014), Jaipur, India, 2014, 1-7.
Downloads
Published
How to Cite
Issue
Section
License
Authors who publish with this journal agree to the following terms:Authors hold and retain copyright, and grant the journal right of first publication, with the work after publication simultaneously licensed under a Creative Commons Attribution 4.0 License CC BY that permits any use, reproduction and distribution of the work and article without further permission provided that the original work is properly cited.
Authors are permitted and encouraged to post their work online in institutional repositories, website and other social media before and after publication, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
