A Neuroergonomics Approach to Measure Pilot’s Cognitive Incapacitation in the Real World with EEG

  • Frédéric DehaisEmail author
  • Bertille Somon
  • Tim Mullen
  • Daniel E. Callan
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1201)


手机体育投注平台Mental overload and mental fatigue are two degraded cognitive states that are known to promote cognitive incapacitation. We adopted a neuroergonomics approach to investigate these states that remain difficult to induce under laboratory settings thus impeding their measurement. Two experiments were conducted under real flight conditions to respectively measure the electrophysiological correlates of mental fatigue and mental overload with a 32 channel-dry EEG system. Our findings revealed that the occurrence of mental fatigue was related to higher theta and alpha band power. Mental overload was associated with higher beta band power over frontal sites. We performed single trial classification to detect mental fatigue and over-load states. Classification accuracy reached 76.9% and 89.1%, respectively, in discriminating mental fatigue vs. no fatigue and mental overload vs. low-high load. These preliminary results provide evidence for the feasibility of detecting neural correlates of cognitive fatigue and load during real flight conditions and provide promising perspectives on the implementation of neuroadaptive technology especially in the context of single pilot-operation.


Mental overload Mental fatigue EEG Neuroergonomics 



This study was supported by AID (Agence Innovation de la Défense) and ANITI ANR-19-PI3A-0004 and the AXA research fund (Neuroergonomics chair).


  1. 1.
    Gateau, T., Ayaz, H., Dehais, F.: In silico versus over the clouds: on-the-fly mental state estimation of aircraft pilots, using a functional near infrared spectroscopy based passive-BCI. Front. Hum. Neurosci. 12, 187 (2018)
  2. 2.
    Wickens, C.D., Dehais, F.: Expertise in Aviation (2019)
  3. 3.
    Somon, B., Campagne, A., Delorme, A., Berberian, B.: Performance monitoring applied to system supervision. Front. Hum. Neurosci. 11, 360 (2017)
  4. 4.
    Baddeley, A.D., Hitch, G.: Working memory. In: Bower, G.A. (ed.) Recent Advances in Learning and Motivation, vol. 8 (1974)
  5. 5.
    Harrivel, A.R., Weissman, D.H., Noll, D.C., Peltier, S.J.: Monitoring attentional state with fNIRS. Front. Hum. Neurosci. 7, 861 (2013)
  6. 6.
    Dehais, F., et al.: Momentary lapse of control: a cognitive continuum approach to understanding and mitigating perseveration in human error. Neurosci. Biobehav., Rev (2019)
  7. 7.
    Hettinger, L.J., Branco, P., Encarnacao, L.M., Bonato, P.: Neuroadaptive technologies: applying neuroergonomics to the design of advanced interfaces. Theor. Issues Ergon. Sci. 4, 220–237 (2003)
  8. 8.
    Liu, J., Gardi, A., Ramasamy, S., Lim, Y., Sabatini, R.: Cognitive pilot-aircraft interface for single-pilot operations. Knowl.-Based Syst. 112, 37–53 (2016)
  9. 9.
    Roy, R.N., Bonnet, S., Charbonnier, S., Campagne, A.: Mental fatigue and working memory load estimation: interaction and implications for EEG-based passive BCI. In: 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 6607–6610. IEEE (2013)
  10. 10.
    Borghini, G., Astolfi, L., Vecchiato, G., Mattia, D., Babiloni, F.: Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci. Biobehav. Rev. 44, 58–75 (2014)
  11. 11.
    Durantin, G., Gagnon, J.-F., Tremblay, S., Dehais, F.: Using near infrared spectroscopy and heart rate variability to detect mental overload. Behav. Brain Res. 259, 16–23 (2014)
  12. 12.
    Ewing, K.C., Fairclough, S.H., Gilleade, K.: Evaluation of an adaptive game that uses EEG measures validated during the design process as inputs to a biocybernetic loop. Front. Hum. Neurosci. 10, 223 (2016)
  13. 13.
    Fairclough, S.H., Burns, C., Kreplin, U.: FNIRS activity in the prefrontal cortex and motivational intensity: impact of working memory load, financial reward, and correlation-based signal improvement. Neurophotonics 5, 035001 (2018)
  14. 14.
    Ayaz, H., Dehais, F.: Neuroergonomics: The Brain at Work and in Everyday Life. Academic Press, Cambridge (2018)
  15. 15.
    Callan, D.E., Gateau, T., Durantin, G., Gonthier, N., Dehais, F.: Disruption in neural phase synchrony is related to identification of inattentional deafness in real-world setting. Hum. Brain Map. 39(6), 2596–2608 (2018)
  16. 16.
    Dehais, F., Roy, R. N., Durantin, G., Gateau, T., Callan, D.: EEG-engagement index and auditory alarm misperception: an inattentional deafness study in actual flight condition (2017)
  17. 17.
    Callan, D., Durantin, G., Terzibas, C.: Classification of single-trial auditory events using dry-wireless EEG during real and motion simulated flight. Front. Syst. Neurosci. 9, 11 (2015)
  18. 18.
    Dehais, F., et al.: A pBCI to predict attentional error before it happens in real flight conditions. In: 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), pp. 4155–4160. IEEE (2019)
  19. 19.
    Dehais, F., et al.: Monitoring pilot’s cognitive fatigue with engagement features in simulated and actual flight conditions using an hybrid fNIRS-EEG passive BCI. In: 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 544–549. IEEE (2018)
  20. 20.
    Dehais, F., et al.: Monitoring pilot’s mental workload using ERPs and spectral power with a six-dry-electrode EEG System in real flight conditions. Sensors 19, 1324 (2019)
  21. 21.
    Mullen, T., et al.: Real-time modeling and 3D visualization of source dynamics and connectivity using wearable EEG. In: 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 2184–2187. IEEE (2013)
  22. 22.
    Lotte, F.: Signal processing approaches to minimize or suppress calibration time in oscillatory activity-based brain–computer interfaces. Proc. IEEE 103, 871–890 (2015)
  23. 23.
    Okogbaa, O.G., Shell, R.L., Filipusic, D.: On the investigation of the neurophysiological correlates of knowledge worker mental fatigue using the EEG signal. Appl. Ergon. 25, 355–365 (1994)
  24. 24.
    Dehais, F., Callan, D.E.: A neuroergonomics approach to human performance in aviation. Improving aviation performance through applying engineering psychology. Adv. Aviat. Psychol. 3, 123 (2019)

Copyright information

© The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG 2021

Authors and Affiliations

  • Frédéric Dehais
    • 1
    • 2
    Email author
  • Bertille Somon
    • 1
  • Tim Mullen
    • 3
  • Daniel E. Callan
    • 1
    • 4
  1. 1.ISAE-SUPAERO, University of ToulouseToulouseFrance
  2. 2.Drexel UniversityPhiladelphiaUSA
  3. 3.ISA Intheon LabsSand DiegoUSA
  4. 4.Center for Information and Neural Networks CiNet, National Institute of Information and Communications Technology NICTOsaka UniversitySuitaJapan

Personalised recommendations