OperatorEYEVP: Operator Dataset for Fatigue Detection Based on Eye Movements, Heart Rate Data, and Video Information

Detection of fatigue is extremely important in the development of different kinds of preventive systems (such as driver monitoring or operator monitoring for accident prevention). The presence of fatigue for this task should be determined with physiological and objective behavioral indicators. To develop an effective model of fatigue detection, it is important to record a dataset with people in a state of fatigue as well as in a normal state. We carried out data collection using an eye tracker, a video camera, a stage camera, and a heart rate monitor to record a different kind of signal to analyze them. In our proposed dataset, 10 participants took part in the experiment and recorded data 3 times a day for 8 days. They performed different types of activity (choice reaction time, reading, correction test Landolt rings, playing Tetris), imitating everyday tasks. Our dataset is useful for studying fatigue and finding indicators of its manifestation. We have analyzed datasets that have public access to find the best for this task. Each of them contains data of eye movements and other types of data. We evaluated each of them to determine their suitability for fatigue studies, but none of them fully fit the fatigue detection task. We evaluated the recorded dataset by calculating the correspondences between eye-tracking data and CRT (choice reaction time) that show the presence of fatigue. © 2023 by the authors.

Authors
Kovalenko S. , Mamonov A. , Kuznetsov V. , Bulygin A. , Shoshina I. , Brak I. , Kashevnik A.
Publisher
MDPI AG
Number of issue
13
Language
English
Status
Published
Number
6197
Volume
23
Year
2023
Organizations
  • 1 Institute of Cognitive Neuroscience, HSE University, Moscow, 101000, Russian Federation
  • 2 Faculty of Physics and Mathematics and Natural Sciences, Peoples’ Friendship University of Russia, Moscow, 117198, Russian Federation
  • 3 Federal Research Center “Computer Science and Control” of Russian Academy of Sciences (FRC CSC RAS), Moscow, 119333, Russian Federation
  • 4 St. Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), St. Petersburg, 199178, Russian Federation
  • 5 Institute for Cognitive Research, Saint Petersburg State University, St. Petersburg, 199034, Russian Federation
  • 6 Faculty of Information Technologies, Novosibirsk State University, Novosibirsk, 630090, Russian Federation
  • 7 Institute of Mathematics and Information Technologies, Petrozavodsk State University, Petrozavodsk, 185910, Russian Federation
Keywords
dataset; eye tracking; face and head video; fatigue; gaze tracking; HRV (heart rate variability)

Other records