CN113243917A - Fatigue detection method and device for civil aviation controller, electronic equipment and medium - Google Patents
Fatigue detection method and device for civil aviation controller, electronic equipment and medium Download PDFInfo
- Publication number
- CN113243917A CN113243917A CN202110541505.9A CN202110541505A CN113243917A CN 113243917 A CN113243917 A CN 113243917A CN 202110541505 A CN202110541505 A CN 202110541505A CN 113243917 A CN113243917 A CN 113243917A
- Authority
- CN
- China
- Prior art keywords
- civil aviation
- fatigue
- feedback
- controller
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1103—Detecting eye twinkling
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique
- A61B5/1128—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique using image analysis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/163—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The utility model provides a fatigue detection method, a device, an electronic device and a medium for civil aviation controllers, which comprises the following steps: displaying setting contents on a display device in response to the triggering of the setting condition; receiving feedback of a civil aviation controller for the set content; determining a fatigue value of the civil aviation controller according to the feedback; and outputting reminding information according to the fatigue value. The fatigue detection method for the civil aviation controller can display the set content on the display device corresponding to the triggering of the set conditions, and receive the feedback of the civil aviation controller for the set content, so that the fatigue value of the civil aviation controller is determined according to the feedback, and the method is automatically implemented in the whole process, convenient and effective. The method has the advantages of no contact and no harm to civil aviation controllers, can realize rapidness and convenience, and establishes a rapid, convenient and objective method for detecting the fatigue state of the controllers before duty by combining the control working characteristics.
Description
Technical Field
The invention relates to the field of civil aviation, in particular to a fatigue detection method and device for a civil aviation controller, electronic equipment and a medium.
Background
The fatigue of civil aviation air traffic controllers seriously threatens the aviation safety, and the one hundred and twenty six items in the China civil aviation air traffic control regulations (CCAR-93-R5) clearly stipulate that the control unit cannot continuously arrange the fatigue controllers to be on duty. Therefore, the fatigue state of the controller is detected quickly, accurately and objectively before the controller is on duty, and the method has important significance for executing the regulations and guaranteeing the safe, efficient and sustainable development of civil aviation air traffic control.
The existing human body fatigue degree detection methods can be divided into subjective detection methods and objective detection methods. Subjective detection methods such as Stanford Sleepiness Scale (Stanford Sleepiness Scale), carolina sca Sleepiness Scale (KSS), etc., Nealley, etc. (int.j.aviat.psychol.2015,25,14-47.) indicate that the accuracy and reliability of detection results are questioned due to interference from factors such as emotion, benefit, etc. The objective detection method comprises methods of disciplines such as behaviourology, psychology, physiology, biochemistry and the like, wherein the biochemical detection method has the advantages of objectivity, good repeatability, good reproducibility and the like (Chen et al anal. chem.2016,88,11293-11296.), but the measurement needs to be carried out by using a precise analytical chemical instrument at present, and the requirement of rapidly outputting results on a control work site is difficult to meet; physiological detection methods comprise detection methods such as electroencephalogram and heart rate variability, electroencephalogram equipment is complex and lacks a rapid data processing method, so that results are difficult to obtain rapidly (Lal and the like 2002); the individual difference of heart rate variability is large (Lal et al 2001), and the fatigue generated by the control work lacks sensitivity, and the requirement of the control work cannot be met; psychological methods include methods such as cognitive tests and alertness, wherein the cognitive tests are easily interfered by learning effects, the traditional alertness tests take longer time and generally require 10 to 20 minutes to obtain enough data volume (Lal and the like 2002), and the requirement of rapid detection before a controller on duty is difficult to meet; the ethological detection method comprises facial features such as mouth yawning, eye blinking, eyelid closure degree and other monitoring methods, and the methods are often applied to monitoring and fatigue management during driving of drivers of vehicles such as roads, railways and the like (Lal and the like 2002), and cannot be directly used for fatigue state detection before the controllers are on duty. More attention needs to be paid to the fact that the fatigue degree of a road driver only does not influence the driver to operate a steering wheel, step on a brake and see the road condition clearly; the fatigue degree of the air traffic controller influences the working memory to cause the aviation safety to face a huge risk, for example, in the event of the invasion of the runway of the Shanghai hong bridge airport 10.11, the controller only forgets the airplane dynamic state to cause serious human accident symptoms. Therefore, the fatigue state of the controller before the duty is required to be detected more strictly and more extensively to meet the requirement of the control operation characteristic.
In summary, a method for rapidly, conveniently, objectively and effectively detecting the fatigue state of the air traffic controller before duty is absent so far.
Disclosure of Invention
In view of the above, the present invention provides a method, an apparatus, an electronic device and a storage medium for detecting fatigue of a civil aviation controller, which at least partially solve the problems in the prior art.
According to one aspect of the disclosure, a fatigue detection method for a civil aviation controller is provided, which comprises the following steps:
displaying setting contents on a display device in response to the triggering of the setting condition;
receiving feedback of a civil aviation controller for the set content;
determining a fatigue value of the civil aviation controller according to the feedback;
and outputting reminding information according to the fatigue value.
In an exemplary embodiment of the present disclosure, the displaying of the setting contents on the display device includes:
selecting N target items from M candidate items, wherein M > N > 0;
displaying the to-be-selected items on the display equipment according to the target sequence;
wherein the candidate item comprises the target item, and the target item appears at least 1 time.
In an exemplary embodiment of the present disclosure, the feedback includes a decision force parameter;
the receiving of the feedback of the civil aviation controller for the set content comprises:
receiving confirmation operation of the civil aviation controller on an input device;
and determining the decision force parameter according to the moment of receiving the confirmation operation and the content displayed on the display equipment at the moment.
In an exemplary embodiment of the disclosure, the determining the decision force parameter according to a time when the confirmation operation is received and a content displayed on the display device at the time includes:
if the content displayed on the display equipment is the target item when the confirmation operation is received, the record is correct;
if the content displayed on the display equipment is not the target item when the confirmation operation is received, recording as an error;
if the confirmation operation is not received during the period that the target item is displayed by the display equipment, recording as missing;
determining the decision force parameter according to the number of errors, the number of misses, and the number of occurrences of the target item.
In an exemplary embodiment of the present disclosure, the feedback further includes: a reaction force parameter;
the receiving of the feedback of the civil aviation controller for the set content further comprises:
and determining the reaction force parameter according to the moment of receiving the confirmation operation and the occurrence moment of the target item.
In an exemplary embodiment of the present disclosure, the feedback further comprises an eye movement parameter;
the receiving of the feedback of the civil aviation controller for the set content further comprises:
and acquiring at least two images including the civil aviation controller, and determining the eye movement parameter according to the at least two images.
In an exemplary embodiment of the disclosure, the determining the fatigue value of the civil aviation controller according to the feedback includes:
and determining the fatigue value of the civil aviation controller according to at least one of the decision force parameter, the reaction force parameter and the eye movement parameter.
According to an aspect of the present disclosure, there is provided a fatigue detecting device including:
the display module is used for responding to the trigger of the setting condition and displaying the setting content on the display equipment;
the receiving module is used for receiving feedback of a civil aviation controller for the set content;
the determining module is used for determining the fatigue value of the civil aviation controller according to the feedback;
and the output module is used for outputting reminding information according to the fatigue value.
According to an aspect of the present disclosure, there is provided an electronic apparatus including:
a processor;
a memory for storing the processor-executable instructions;
the processor is configured to read the executable instructions from the memory and execute the instructions to implement any of the methods described above.
According to an aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon a computer program for executing the method of any one of the above.
The utility model provides a fatigue detection method of civil aviation controller can be corresponding to the triggering of settlement condition and show the content of setting for on display device, and receive the feedback of civil aviation controller to setting for the content to confirm the fatigue value of civil aviation controller according to the feedback, whole automatic implementation and convenient effective. The method has the advantages of no contact and no harm to civil aviation controllers, can realize rapidness and convenience, and establishes a rapid, convenient and objective method for detecting the fatigue state of the controllers before duty by combining the control working characteristics.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart of a fatigue detection method for a civil aviation controller according to this embodiment.
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
It should be noted that, in the case of no conflict, the features in the following embodiments and examples may be combined with each other; moreover, all other embodiments that can be derived by one of ordinary skill in the art from the embodiments disclosed herein without making any creative effort fall within the scope of the present disclosure.
It is noted that various aspects of the embodiments are described below within the scope of the appended claims. It should be apparent that the aspects described herein may be embodied in a wide variety of forms and that any specific structure and/or function described herein is merely illustrative. Based on the disclosure, one skilled in the art should appreciate that one aspect described herein may be implemented independently of any other aspects and that two or more of these aspects may be combined in various ways. For example, an apparatus may be implemented and/or a method practiced using any number of the aspects set forth herein. Additionally, such an apparatus may be implemented and/or such a method may be practiced using other structure and/or functionality in addition to one or more of the aspects set forth herein.
The embodiment provides a fatigue detection method for a civil aviation controller, which can be applied to equipment driven by a driver, such as space equipment and driving equipment. Meanwhile, in order to avoid an influence on driving, it is recommended to use when driving is stopped.
Specifically, referring to fig. 1, the method includes the following steps:
step S100, responding to the trigger of the setting condition, and displaying the setting content on the display device.
And step S300, receiving feedback of the civil aviation controller for the set content.
And S500, determining the fatigue value of the civil aviation controller according to the feedback.
And S700, outputting reminding information according to the fatigue value.
The setting condition may be a preset trigger condition, for example, a set event is reached, a set time length is set at an interval, a set button is pressed, and the like. The display device can be a display or a vehicle window with a display function, glass and the like, the setting content can be preset content, such as patterns, characters, letters, shapes and the like, and can be selected according to requirements, and the letters are selected as the setting content in the embodiment.
The feedback of receiving the civil aviation controller can be the initiative feedback of receiving the civil aviation controller through input equipment, and can also be equipment such as camera, sensor, initiatively receive the information of civil aviation controller.
When fatigue is judged to be too high, prompts such as post adjustment or alternate rest can be pertinently performed on the civil aviation controller.
The utility model provides a fatigue detection method of civil aviation controller can be corresponding to the triggering of settlement condition and show the content of setting for on display device, and receive the feedback of civil aviation controller to setting for the content to confirm the fatigue value of civil aviation controller according to the feedback, whole automatic implementation and convenient effective. The method has the advantages of no contact and no harm to civil aviation controllers, can realize rapidness and convenience, and establishes a rapid, convenient and objective method for detecting the fatigue state of the controllers before duty by combining the control working characteristics.
In an exemplary embodiment of the present disclosure, the step S100 includes:
step S110, in response to the trigger of the setting condition, selecting N target items from M candidates, where M > N > 0.
And step S130, displaying the to-be-selected items on the display equipment according to the target sequence. At this time, the candidate item includes at least one target item, and may also include at least part or all of the candidate items.
Wherein the candidate item comprises the target item, and the target item appears at least 1 time.
In this embodiment, for example, 26 english letters are used, M (10) candidates are selected from the 26 english letters, and then N (2) target items are selected from the M candidates.
After the selection is finished, the 10 letter busbars are arranged into a target sequence according to a preset rule, the sequence can be random, the occurrence frequency of each letter is not hard regulated, and only at least one target item is ensured to appear. Before displaying the candidate items according to the target sequence, the civil aviation controller needs to be informed of what the target items are in a display mode, a sound mode or the like. When the waiting items are displayed according to the target sequence, the display time of each waiting item can be set to be the same fixed value, and the display time length can also be changed according to the requirement, for example, the display time length is gradually shortened along with the increase of the correct times of civil aviation controllers. The selection of the set content is carried out according to the method, the method is simple and convenient, external personnel are not needed to intervene, the selection is carried out only according to the set rule, the displayed content is simple, and the understanding of civil aviation controllers is facilitated.
In an exemplary embodiment of the present disclosure, the feedback includes a decision force parameter;
the step S300 includes:
step S310, receiving confirmation operation of the civil aviation controller on an input device;
step S320, determining the decision force parameter according to the time when the confirmation operation is received and the content displayed on the display device at the time.
The civil aviation controller can input confirmation operation through clicking of an input device such as a keyboard. Specifically, the confirmation operation may be input by clicking a setting case (for example, a space bar) of the keyboard when the target item is displayed. The judgment rule at this moment is that whether the civil aviation controller can accurately select the correct target item or not, so as to judge the decision force parameter of the civil aviation controller, the higher the accuracy is, the higher the decision force parameter is, and the decision force parameter is negatively correlated in fatigue, namely, the higher the decision force parameter is, the lower the fatigue is, and the method also conforms to the rule that the decision force of a human body is reduced in fatigue.
In an exemplary embodiment of the present disclosure, step S320 includes:
and if the content displayed on the display equipment is the target item when the confirmation operation is received, the record is correct.
If the content displayed on the display equipment is not the target item when the confirmation operation is received, recording as an error;
if the confirmation operation is not received during the period that the target item is displayed by the display equipment, recording as missing;
determining the decision force parameter according to the number of errors, the number of misses, and the number of occurrences of the target item.
Specifically, the calculation of the decision force parameter may be performed using the following parameters:
wherein E is a decision force parameter, NoIs the number of misses, NeNumber of times of error, NtThe number of occurrences of the target item.
In an exemplary embodiment of the present disclosure, the feedback further includes: a reaction force parameter;
the step S300 further includes:
step S330, determining the reaction force parameter according to the time of receiving the confirmation operation and the appearance time of the target item.
Specifically, under the condition of correct judgment, the reaction force parameter is determined according to the interval between the time when the civil aviation controller inputs the confirmation operation and the occurrence time of the target item, and the reaction force parameter is lower as the interval time is longer.
The calculated reaction force parameter can be confirmed by the following formula:
wherein R is a reaction force parameter, t is a reaction measurement, tTIs reaction time threshold (ms), the size of the reaction time threshold is related to the display time and the detection time of the target item, and the value range is generally [300,500]](unit: ms).
In an exemplary embodiment of the present disclosure, the feedback further comprises an eye movement parameter;
the step S300 further includes:
step S340, collecting at least two images including the civil aviation controller, and determining the eye movement parameter according to the at least two images.
It can be understood that the acquisition of at least two images of the civil aviation controller can be understood as fast photo shooting, and can also be understood as video recording of the civil aviation controller, and only because the photo is processed substantially regardless of the processing and identification of the photo or the video recording, the image is described in this embodiment, and is not limited to the photo shooting.
In actual implementation, the images or videos of the civil aviation controller need to be acquired by using acquisition equipment such as a camera, and specifically, the images or videos of the civil aviation controller during the period of displaying the set content by the display equipment can be acquired. The processing system can perform face recognition according to the collected pictures or videos to obtain eye movement parameters of the civil aviation controller, wherein the eye movement parameters can be specifically parameters such as eye rotation speed, blink frequency and eye opening and closing size. And judging the fatigue value of the civil aviation controller according to the detected eye movement parameters.
In an exemplary embodiment of the present disclosure, the step S500 includes:
and determining the fatigue value of the civil aviation controller according to at least one of the decision force parameter, the reaction force parameter and the eye movement parameter.
In specific implementation, the fatigue value can be calculated according to the following formula:
F＝A1F1+A2F2+A3F3 (1)
wherein F is a fatigue value and consists of three parts, and the first item is an eye movement information item; the second item is a reaction force information item; the third item is a judgment decision power information item;
specifically, F1 is the eye movement parameter, F2 is the reaction force parameter, and F3 is the decision force parameter, the equation is further expressed as follows:
F＝A1f(P)+A2g(R)+A3h(E) (2)
further:
F＝A1f(P)+A2g(R)+A3tan(EX) (3)
setting the weight coefficient A according to the sensitivity of three variables1、A2、A3The variable with high sensitivity is endowed with a larger weight coefficient, and the value ranges are all [1,10 ]]And the relationship of the three meets the following constraint requirements:
A1+A2+A3＝10
and substituting the three indexes and the weight coefficients into the formula (3), and calculating and outputting the fatigue value of the tested person when the test is finished.
In order to further explain the fatigue detection method for civil aviation controllers provided by the embodiment, the embodiment provides a practical implementation case for reference and understanding.
The specific description is as follows:
the invention researches and develops a rapid detection method for fatigue states capable of acquiring reaction time, judgment and decision force of a tested person and eyelid closure degree based on control working characteristics, wherein the fatigue values output by the detection method are comprehensive reactions of the reaction force, the judgment and decision force of the tested person and the fatigue states of oculomotor parasympathetic nerves.
The invention comprises the following parts:
1. fatigue values are defined as shown in the following equation:
F＝A1F1+A2F2+A3F3 (1)
wherein F is a fatigue value and consists of three parts, and the first item is an eye movement information item; the second item is a reaction force information item; the third item is a judgment decision power information item;
specifically, F1 is the eye movement variable, F2 is the reaction force variable, and F3 is the judgment decision force variable, and the equation is further expressed as follows:
F＝A1F(P)+A2g(R)+A3h(E) (2)
further:
F＝A1f(P)+A2g(R)+A3tan(EX) (3)
wherein the eye movement variable is measured by:
F(P)：
wherein the reaction force variable is measured by the following formula:
g(R):
wherein the decision force variable is measured by the following formula:
h(E)＝tan(E×π/2):
where a (i ═ 1,2,3) is a weight coefficient of the first to third terms, and is set according to each item of sensitivity and importance.
2. Rapid and objective detection method
The method comprises four modules, namely an eye movement detection module, a reaction judgment decision power detection module, a fatigue value calculation output module and a measurement and data acquisition module
(1) Eye movement detection module: the eye movement detection module comprises an eye movement state capture system and an instant data analysis system
The eye movement state capturing system includes: image acquisition precision setting (24 frames per second), image acquisition start and end instructions;
the instant data processing system comprises: face recognition, eye region recognition, gray level conversion, and P70 real-time calculation function;
(2) a reaction judgment decision power detection module: comprises a task setting system and a detection system
The task setting system includes: randomly drawing 10 letters from the 26 letters, and drawing 2 letters from the 10 letters as target objects; the continuous appearance of target letters is a target signal and needs to be confirmed by trying to knock the space key.
In the test, one letter of 10 letters appears on the screen at random each time, the screen stops for 100 milliseconds and disappears, and the interval between the letters is 300-1000 millimeters; in the test sequence, the occurrence frequency of the target signal is 25% -35%;
setting task guide words and setting task practice programs.
The detection system comprises: detecting the reaction time of the tested person knocking the space key every time when the target signal appears; and (4) whether the target signal identification is correctly detected by the tested person.
(3) Measuring module
The tested person faces the screen, completes task operation according to the task requirement of the reaction judgment decision-making power detection module, collects the original data of eye movement, reaction time and error operation in the process, and calculates the P70 and reaction time index error rate index in real time in the background.
(4) Fatigue value calculation output module
Eye movement variable detection and calculation:
the eyelid closure degree is selected as the detection index of the eye movement variable, the eyelid closure degree P80 index is often adopted by road drivers such as highway truck drivers, high-speed rail drivers and other documents, but the control work requires that a controller keeps high alertness, and in the invention, a stricter P70 index is selected as a measurement value by combining the control work characteristic, so that the eye movement variable can be obtained by measuring the P70 index according to the following formula:
where FPs is the frame rate (frames/second), n is the number of blinks in the t period (second), sign is a variable from 0 to 1,
reaction force variable detection and calculation:
when the detection index of the reaction variable is a reaction, which is the time t (millisecond) between the occurrence of the target signal and the key pressing of the tested person, the reaction variable can be obtained by measuring the reaction index according to the following formula:
where t is the response time measurement and tT is the response time threshold (ms), the magnitude of which is related to the signal stimulation interval and the detection time, and is typically in the range of 300,500 (units: ms).
The values are given according to the following table:
| duration of test | 3min | 5min | 10min | 20min |
| Time interval between signals | 300-700ms | 800-1200ms | 1s-1.5s | 1s-1.5s |
| Threshold of reaction time | 300-500ms | 300-500ms | 500ms | 500ms |
Judging and calculating decision variables:
and judging whether the detection index of the decision variable is an error rate and is an error response to the target signal, wherein the error response comprises omission of the target signal and error identification of a non-target signal, and the decision variable can be obtained by measuring the error response index of the tested person to the target signal according to the following formula:
wherein N isoIs the number of missing target signals, NeFor the number of signals selected by mistake, NtIs the number of target signals.
Calculation of the weight coefficients:
setting the weight coefficient A according to the sensitivity of three variables1、A2、A3The variable with high sensitivity is endowed with a larger weight coefficient, and the value ranges are all [1,10 ]]And the relationship of the three meets the following constraint requirements:
A1+A2+A3＝10
and substituting the three indexes and the weight coefficients into the formula (3), and calculating and outputting the fatigue value of the tested person when the test is finished.
3. Parameter optimization
(1) Optimization of fatigue detection duration
In a regional control center in China, 4 volunteers of controllers were recruited to perform pretests in a 10-minute test period. The results show that the fatigue values of the volunteers greatly fluctuate at the beginning of the test, then fluctuate little and tend to be stable and stable. The time series single-factor analysis method is adopted to respectively test the change trend of the fatigue values of each controller along with the measurement time, the result shows that when the measurement time reaches 3 minutes, the average value of the fatigue values of the controllers begins to stabilize, the average value is respectively 0.98, 0.56, 0.77 and 0.62, and the variance is respectively 0.72, 0.67, 0.95 and 0.83, and the detection time is determined to be 3-5 minutes in consideration of the adaptability of a detection object.
(2) Sensitivity and effectiveness of the detection method
In order to verify the effectiveness of the method, 5 volunteers of airport controllers are recruited in a certain large international airport in China, and the fatigue state of the volunteers is detected before and after 1.5 hours of duty. Testing time of each controller for 5 minutes, signal occurrence interval time of 1000 milliseconds, eyelid closure degree variable adopting P70 index, reaction time variable threshold value of 500 millimeters, judging decision variable adopting error rate index, and variable weight coefficient as follows:
A1＝8.0，A2＝1.0，A3＝1.0
the measurement results were as follows:
TABLE 1 fatigue Change before and after 1.5 hours of duty of apron controller
The detection result shows that the fatigue value of the controller shows an increasing trend after the controller is on duty for 1.5 hours. The results show that the fatigue detection results before the duty are obviously lower than those of the fatigue control group after the duty. During busy hours, air traffic control personnel are under high workload and duty safety pressure and are prone to fatigue. The greater standard deviation of fatigue values after the policer's duty may be due to different workloads. The field test result shows that the established fatigue detection method for the civil aviation controller can sensitively and effectively detect the change of the fatigue state of the controller.
According to an aspect of the present disclosure, there is provided a fatigue detecting device including:
the display module is used for responding to the trigger of the setting condition and displaying the setting content on the display equipment;
the receiving module is used for receiving feedback of a civil aviation controller for the set content;
the determining module is used for determining the fatigue value of the civil aviation controller according to the feedback;
and the output module is used for outputting reminding information according to the fatigue value.
Moreover, although the steps of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that the steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions, etc.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.
In an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
An electronic device according to this embodiment of the invention. The electronic device is only an example and should not bring any limitation to the function and the scope of use of the embodiments of the present invention.
The electronic device is in the form of a general purpose computing device. Components of the electronic device may include, but are not limited to: the at least one processor, the at least one memory, and a bus connecting the various system components (including the memory and the processor).
Wherein the storage stores program code executable by the processor to cause the processor to perform steps according to various exemplary embodiments of the present invention as described in the "exemplary methods" section above.
The memory may include readable media in the form of volatile memory, such as Random Access Memory (RAM) and/or cache memory, and may further include Read Only Memory (ROM).
The storage may also include a program/utility having a set (at least one) of program modules including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
The bus may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures.
The electronic device may also communicate with one or more external devices (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface. Also, the electronic device may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via a network adapter. As shown, the network adapter communicates with other modules of the electronic device over a bus. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.
In an exemplary embodiment of the present disclosure, there is also provided a computer-readable storage medium having stored thereon a program product capable of implementing the above-described method of the present specification. In some possible embodiments, aspects of the invention may also be implemented in the form of a program product comprising program code means for causing a terminal device to carry out the steps according to various exemplary embodiments of the invention described in the above section "exemplary methods" of the present description, when said program product is run on the terminal device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
Furthermore, the above-described figures are merely schematic illustrations of processes involved in methods according to exemplary embodiments of the invention, and are not intended to be limiting. It will be readily understood that the processes shown in the above figures are not intended to indicate or limit the chronological order of the processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, e.g., in multiple modules.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
The above description is only for the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. A fatigue detection method for civil aviation controllers is characterized by comprising the following steps:
displaying setting contents on a display device in response to the triggering of the setting condition;
receiving feedback of a civil aviation controller for the set content;
determining a fatigue value of the civil aviation controller according to the feedback;
and outputting reminding information according to the fatigue value.
2. The fatigue detection method for civil aviation controllers as claimed in claim 1, wherein said displaying the setting content on the display device comprises:
selecting N target items from M candidate items, wherein M > N > 0;
displaying the to-be-selected items on the display equipment according to the target sequence;
wherein the candidate item comprises the target item, and the target item appears at least 1 time.
3. The method of fatigue detection for civil aviation controllers as claimed in claim 2, wherein said feedback comprises decision force parameters;
the receiving of the feedback of the civil aviation controller for the set content comprises:
receiving confirmation operation of the civil aviation controller on an input device;
and determining the decision force parameter according to the moment of receiving the confirmation operation and the content displayed on the display equipment at the moment.
4. The method for detecting fatigue of civil aviation controller as claimed in claim 3, wherein the determining the decision force parameter according to the moment of receiving the confirmation operation and the content displayed on the display device at the moment comprises:
if the content displayed on the display equipment is the target item when the confirmation operation is received, the record is correct;
if the content displayed on the display equipment is not the target item when the confirmation operation is received, recording as an error;
if the confirmation operation is not received during the period that the target item is displayed by the display equipment, recording as missing;
determining the decision force parameter according to the number of errors, the number of misses, and the number of occurrences of the target item.
5. The method for fatigue detection of civil aviation controllers as claimed in claim 4,
the feedback further comprises: a reaction force parameter;
the receiving of the feedback of the civil aviation controller for the set content further comprises:
and determining the reaction force parameter according to the moment of receiving the confirmation operation and the occurrence moment of the target item.
6. The method of fatigue detection for civil aviation controllers as claimed in claim 5, wherein said feedback further comprises eye movement parameters;
the receiving of the feedback of the civil aviation controller for the set content further comprises:
and acquiring at least two images including the civil aviation controller, and determining the eye movement parameter according to the at least two images.
7. The method for detecting fatigue of civil aviation controller according to claim 6, wherein said determining fatigue value of civil aviation controller according to said feedback comprises:
and determining the fatigue value of the civil aviation controller according to at least one of the decision force parameter, the reaction force parameter and the eye movement parameter.
8. A fatigue detecting device, comprising:
the display module is used for responding to the trigger of the setting condition and displaying the setting content on the display equipment;
the receiving module is used for receiving feedback of a civil aviation controller for the set content;
the determining module is used for determining the fatigue value of the civil aviation controller according to the feedback;
and the output module is used for outputting reminding information according to the fatigue value.
9. An electronic device, characterized in that the electronic device comprises:
a processor;
a memory for storing the processor-executable instructions;
the processor is configured to read the executable instructions from the memory and execute the instructions to implement the method of any one of claims 1-7.
10. A computer-readable storage medium, the storage medium storing a computer program for performing the method of any of the preceding claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110541505.9A CN113243917B (en) | 2021-05-18 | 2021-05-18 | Fatigue detection method and device for civil aviation controller, electronic equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110541505.9A CN113243917B (en) | 2021-05-18 | 2021-05-18 | Fatigue detection method and device for civil aviation controller, electronic equipment and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113243917A true CN113243917A (en) | 2021-08-13 |
| CN113243917B CN113243917B (en) | 2023-05-12 |
Family
ID=77182665
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110541505.9A Active CN113243917B (en) | 2021-05-18 | 2021-05-18 | Fatigue detection method and device for civil aviation controller, electronic equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113243917B (en) |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006106408A2 (en) * | 2005-04-04 | 2006-10-12 | Icon Orbital Technologies Corporation | System and method for estimation of human activity and mood states based on rapid eye movements and galvanic skin response |
| US20090161827A1 (en) * | 2007-12-23 | 2009-06-25 | Oraya Therapeutics, Inc. | Methods and devices for detecting, controlling, and predicting radiation delivery |
| CN105260011A (en) * | 2014-07-09 | 2016-01-20 | 霍尼韦尔国际公司 | Visual search assistance for an occupant of a vehicle |
| CN105261152A (en) * | 2015-09-30 | 2016-01-20 | 中国民用航空总局第二研究所 | Air traffic controller fatigue detection method based on clustering analysis, device and system |
| US20170135577A1 (en) * | 2014-04-25 | 2017-05-18 | Texas State University | Health Assessment via Eye Movement Biometrics |
| US20170293356A1 (en) * | 2016-04-08 | 2017-10-12 | Vizzario, Inc. | Methods and Systems for Obtaining, Analyzing, and Generating Vision Performance Data and Modifying Media Based on the Vision Performance Data |
| US20180125356A1 (en) * | 2016-11-08 | 2018-05-10 | International Business Machines Corporation | Age estimation using feature of eye movement |
| CN109498040A (en) * | 2018-01-30 | 2019-03-22 | 中国民用航空总局第二研究所 | Alertness detection method and its system |
| CN109700472A (en) * | 2019-02-21 | 2019-05-03 | 北京七鑫易维信息技术有限公司 | A kind of fatigue detection method, device, equipment and storage medium |
| CN110753514A (en) * | 2017-06-14 | 2020-02-04 | 微软技术许可有限责任公司 | Sleep monitoring based on implicit acquisition for computer interaction |
| CN111052127A (en) * | 2018-09-12 | 2020-04-21 | 北京嘀嘀无限科技发展有限公司 | System and method for fatigue detection |
| CN111096741A (en) * | 2019-12-10 | 2020-05-05 | 中国航天员科研训练中心 | Mental load detection method and system and related equipment |
| US20200151474A1 (en) * | 2017-07-31 | 2020-05-14 | Alcohol Countermeasure Systems (International) Inc. | Non-intrusive assessment of fatigue in drivers using eye tracking |
| US20200214559A1 (en) * | 2013-01-25 | 2020-07-09 | Wesley W.O. Krueger | Ocular-performance-based head impact measurement using a faceguard |
| CN111436001A (en) * | 2019-01-12 | 2020-07-21 | 北京字节跳动网络技术有限公司 | Method, device, equipment and storage medium for displaying information on video |
| CN112256122A (en) * | 2020-09-25 | 2021-01-22 | 北京师范大学 | Control work efficiency analysis method, device and system based on mental fatigue |
-
2021
- 2021-05-18 CN CN202110541505.9A patent/CN113243917B/en active Active
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006106408A2 (en) * | 2005-04-04 | 2006-10-12 | Icon Orbital Technologies Corporation | System and method for estimation of human activity and mood states based on rapid eye movements and galvanic skin response |
| US20090161827A1 (en) * | 2007-12-23 | 2009-06-25 | Oraya Therapeutics, Inc. | Methods and devices for detecting, controlling, and predicting radiation delivery |
| US20200214559A1 (en) * | 2013-01-25 | 2020-07-09 | Wesley W.O. Krueger | Ocular-performance-based head impact measurement using a faceguard |
| US20170135577A1 (en) * | 2014-04-25 | 2017-05-18 | Texas State University | Health Assessment via Eye Movement Biometrics |
| CN105260011A (en) * | 2014-07-09 | 2016-01-20 | 霍尼韦尔国际公司 | Visual search assistance for an occupant of a vehicle |
| CN105261152A (en) * | 2015-09-30 | 2016-01-20 | 中国民用航空总局第二研究所 | Air traffic controller fatigue detection method based on clustering analysis, device and system |
| US20170293356A1 (en) * | 2016-04-08 | 2017-10-12 | Vizzario, Inc. | Methods and Systems for Obtaining, Analyzing, and Generating Vision Performance Data and Modifying Media Based on the Vision Performance Data |
| US20180125356A1 (en) * | 2016-11-08 | 2018-05-10 | International Business Machines Corporation | Age estimation using feature of eye movement |
| CN110753514A (en) * | 2017-06-14 | 2020-02-04 | 微软技术许可有限责任公司 | Sleep monitoring based on implicit acquisition for computer interaction |
| US20200151474A1 (en) * | 2017-07-31 | 2020-05-14 | Alcohol Countermeasure Systems (International) Inc. | Non-intrusive assessment of fatigue in drivers using eye tracking |
| CN109498040A (en) * | 2018-01-30 | 2019-03-22 | 中国民用航空总局第二研究所 | Alertness detection method and its system |
| CN111052127A (en) * | 2018-09-12 | 2020-04-21 | 北京嘀嘀无限科技发展有限公司 | System and method for fatigue detection |
| CN111436001A (en) * | 2019-01-12 | 2020-07-21 | 北京字节跳动网络技术有限公司 | Method, device, equipment and storage medium for displaying information on video |
| CN109700472A (en) * | 2019-02-21 | 2019-05-03 | 北京七鑫易维信息技术有限公司 | A kind of fatigue detection method, device, equipment and storage medium |
| CN111096741A (en) * | 2019-12-10 | 2020-05-05 | 中国航天员科研训练中心 | Mental load detection method and system and related equipment |
| CN112256122A (en) * | 2020-09-25 | 2021-01-22 | 北京师范大学 | Control work efficiency analysis method, device and system based on mental fatigue |
Non-Patent Citations (1)
| Title |
|---|
| 李婷婷: "基于眼部图像特征的人体疲劳检测研究" * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113243917B (en) | 2023-05-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3270326B1 (en) | Indicia-reading systems having an interface with a user's nervous system | |
| CN102098955B (en) | Method and device for the detection of microsleep events | |
| Jeon et al. | Classification of construction hazard-related perceptions using: Wearable electroencephalogram and virtual reality | |
| CN103610447B (en) | A kind of Mental Workload online test method based on forehead EEG signal | |
| CN113415285B (en) | Driver alertness assessment method and system | |
| US9633168B2 (en) | Biometric identity validation for use with unattended tests for medical conditions | |
| CN111370113A (en) | Remote psychological counseling system and method based on Internet of things cloud | |
| WO2019232579A1 (en) | Technology adapted to enable improved collection of involuntary eyelid movement parameters, including collection of eyelid movement parameters to support analysis of neurological factors | |
| CN114237391A (en) | Urban rail transit dispatching virtual training test system and method thereof | |
| DE102017216328B3 (en) | A method for monitoring a state of attention of a person, processing device, storage medium, and motor vehicle | |
| Vasudevan et al. | Driver drowsiness monitoring by learning vehicle telemetry data | |
| Chen et al. | Revealing the" Invisible Gorilla" in Construction: Assessing Mental Workload through Time-frequency Analysis | |
| CN113243917A (en) | Fatigue detection method and device for civil aviation controller, electronic equipment and medium | |
| CN105282502B (en) | Air traffic controller's fatigue detection method based on confidence interval, device and system | |
| CN111714103A (en) | Health monitoring device for driving test examinees | |
| CN104706366A (en) | Distraction testing method, device and system | |
| CN111579001A (en) | Fault detection method and device for robot | |
| KR20130130538A (en) | Driving workload measurement and warning system based on electrocardiography | |
| EP3687377B1 (en) | Preclinical evaluation of skin condition and risk evaluation | |
| US11385884B2 (en) | Assessing cognitive reaction to over-the-air updates | |
| Zhou et al. | Driver fatigue tracking and detection method based on OpenMV | |
| Yu et al. | Air traffic controllers' mental fatigue recognition: A multi-sensor information fusion-based deep learning approach | |
| CN112336355A (en) | Safety supervision system, device and equipment based on electroencephalogram signal operating personnel | |
| CN113327404A (en) | Post fatigue state monitoring and warning system for air traffic controller | |
| Bin et al. | Research on fatigue driving assessment based on multi-source information fusion |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |