Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
It should be noted that, in the case of no conflict, the features in the following embodiments and examples may be combined with each other; moreover, all other embodiments that can be derived by one of ordinary skill in the art from the embodiments disclosed herein without making any creative effort fall within the scope of the present disclosure.
It is noted that various aspects of the embodiments are described below within the scope of the appended claims. It should be apparent that the aspects described herein may be embodied in a wide variety of forms and that any specific structure and/or function described herein is merely illustrative. Based on the disclosure, one skilled in the art should appreciate that one aspect described herein may be implemented independently of any other aspects and that two or more of these aspects may be combined in various ways. For example, an apparatus may be implemented and/or a method practiced using any number of the aspects set forth herein. Additionally, such an apparatus may be implemented and/or such a method may be practiced using other structure and/or functionality in addition to one or more of the aspects set forth herein.
The embodiment provides a fatigue detection method for a civil aviation controller, which can be applied to equipment driven by a driver, such as space equipment and driving equipment. Meanwhile, in order to avoid an influence on driving, it is recommended to use when driving is stopped.
Specifically, referring to fig. 1, the method includes the following steps:
step S100, responding to the trigger of the setting condition, and displaying the setting content on the display device.
And step S300, receiving feedback of the civil aviation controller for the set content.
And S500, determining the fatigue value of the civil aviation controller according to the feedback.
And S700, outputting reminding information according to the fatigue value.
The setting condition may be a preset trigger condition, for example, a set event is reached, a set time length is set at an interval, a set button is pressed, and the like. The display device can be a display or a vehicle window with a display function, glass and the like, the setting content can be preset content, such as patterns, characters, letters, shapes and the like, and can be selected according to requirements, and the letters are selected as the setting content in the embodiment.
The feedback of receiving the civil aviation controller can be the initiative feedback of receiving the civil aviation controller through input equipment, and can also be equipment such as camera, sensor, initiatively receive the information of civil aviation controller.
When fatigue is judged to be too high, prompts such as post adjustment or alternate rest can be pertinently performed on the civil aviation controller.
The utility model provides a fatigue detection method of civil aviation controller can be corresponding to the triggering of settlement condition and show the content of setting for on display device, and receive the feedback of civil aviation controller to setting for the content to confirm the fatigue value of civil aviation controller according to the feedback, whole automatic implementation and convenient effective. The method has the advantages of no contact and no harm to civil aviation controllers, can realize rapidness and convenience, and establishes a rapid, convenient and objective method for detecting the fatigue state of the controllers before duty by combining the control working characteristics.
In an exemplary embodiment of the present disclosure, the step S100 includes:
step S110, in response to the trigger of the setting condition, selecting N target items from M candidates, where M > N > 0.
And step S130, displaying the to-be-selected items on the display equipment according to the target sequence. At this time, the candidate item includes at least one target item, and may also include at least part or all of the candidate items.
Wherein the candidate item comprises the target item, and the target item appears at least 1 time.
In this embodiment, for example, 26 english letters are used, M (10) candidates are selected from the 26 english letters, and then N (2) target items are selected from the M candidates.
After the selection is finished, the 10 letter busbars are arranged into a target sequence according to a preset rule, the sequence can be random, the occurrence frequency of each letter is not hard regulated, and only at least one target item is ensured to appear. Before displaying the candidate items according to the target sequence, the civil aviation controller needs to be informed of what the target items are in a display mode, a sound mode or the like. When the waiting items are displayed according to the target sequence, the display time of each waiting item can be set to be the same fixed value, and the display time length can also be changed according to the requirement, for example, the display time length is gradually shortened along with the increase of the correct times of civil aviation controllers. The selection of the set content is carried out according to the method, the method is simple and convenient, external personnel are not needed to intervene, the selection is carried out only according to the set rule, the displayed content is simple, and the understanding of civil aviation controllers is facilitated.
In an exemplary embodiment of the present disclosure, the feedback includes a decision force parameter;
the step S300 includes:
step S310, receiving confirmation operation of the civil aviation controller on an input device;
step S320, determining the decision force parameter according to the time when the confirmation operation is received and the content displayed on the display device at the time.
The civil aviation controller can input confirmation operation through clicking of an input device such as a keyboard. Specifically, the confirmation operation may be input by clicking a setting case (for example, a space bar) of the keyboard when the target item is displayed. The judgment rule at this moment is that whether the civil aviation controller can accurately select the correct target item or not, so as to judge the decision force parameter of the civil aviation controller, the higher the accuracy is, the higher the decision force parameter is, and the decision force parameter is negatively correlated in fatigue, namely, the higher the decision force parameter is, the lower the fatigue is, and the method also conforms to the rule that the decision force of a human body is reduced in fatigue.
In an exemplary embodiment of the present disclosure, step S320 includes:
and if the content displayed on the display equipment is the target item when the confirmation operation is received, the record is correct.
If the content displayed on the display equipment is not the target item when the confirmation operation is received, recording as an error;
if the confirmation operation is not received during the period that the target item is displayed by the display equipment, recording as missing;
determining the decision force parameter according to the number of errors, the number of misses, and the number of occurrences of the target item.
Specifically, the calculation of the decision force parameter may be performed using the following parameters:
wherein E is a decision force parameter, NoIs the number of misses, NeNumber of times of error, NtThe number of occurrences of the target item.
In an exemplary embodiment of the present disclosure, the feedback further includes: a reaction force parameter;
the step S300 further includes:
step S330, determining the reaction force parameter according to the time of receiving the confirmation operation and the appearance time of the target item.
Specifically, under the condition of correct judgment, the reaction force parameter is determined according to the interval between the time when the civil aviation controller inputs the confirmation operation and the occurrence time of the target item, and the reaction force parameter is lower as the interval time is longer.
The calculated reaction force parameter can be confirmed by the following formula:
wherein R is a reaction force parameter, t is a reaction measurement, tTIs reaction time threshold (ms), the size of the reaction time threshold is related to the display time and the detection time of the target item, and the value range is generally [300,500]](unit: ms).
In an exemplary embodiment of the present disclosure, the feedback further comprises an eye movement parameter;
the step S300 further includes:
step S340, collecting at least two images including the civil aviation controller, and determining the eye movement parameter according to the at least two images.
It can be understood that the acquisition of at least two images of the civil aviation controller can be understood as fast photo shooting, and can also be understood as video recording of the civil aviation controller, and only because the photo is processed substantially regardless of the processing and identification of the photo or the video recording, the image is described in this embodiment, and is not limited to the photo shooting.
In actual implementation, the images or videos of the civil aviation controller need to be acquired by using acquisition equipment such as a camera, and specifically, the images or videos of the civil aviation controller during the period of displaying the set content by the display equipment can be acquired. The processing system can perform face recognition according to the collected pictures or videos to obtain eye movement parameters of the civil aviation controller, wherein the eye movement parameters can be specifically parameters such as eye rotation speed, blink frequency and eye opening and closing size. And judging the fatigue value of the civil aviation controller according to the detected eye movement parameters.
In an exemplary embodiment of the present disclosure, the step S500 includes:
and determining the fatigue value of the civil aviation controller according to at least one of the decision force parameter, the reaction force parameter and the eye movement parameter.
In specific implementation, the fatigue value can be calculated according to the following formula:
F=A1F1+A2F2+A3F3 (1)
wherein F is a fatigue value and consists of three parts, and the first item is an eye movement information item; the second item is a reaction force information item; the third item is a judgment decision power information item;
specifically, F1 is the eye movement parameter, F2 is the reaction force parameter, and F3 is the decision force parameter, the equation is further expressed as follows:
F=A1f(P)+A2g(R)+A3h(E) (2)
further:
F=A1f(P)+A2g(R)+A3tan(EX) (3)
setting the weight coefficient A according to the sensitivity of three variables1、A2、A3The variable with high sensitivity is endowed with a larger weight coefficient, and the value ranges are all [1,10 ]]And the relationship of the three meets the following constraint requirements:
A1+A2+A3=10
and substituting the three indexes and the weight coefficients into the formula (3), and calculating and outputting the fatigue value of the tested person when the test is finished.
In order to further explain the fatigue detection method for civil aviation controllers provided by the embodiment, the embodiment provides a practical implementation case for reference and understanding.
The specific description is as follows:
the invention researches and develops a rapid detection method for fatigue states capable of acquiring reaction time, judgment and decision force of a tested person and eyelid closure degree based on control working characteristics, wherein the fatigue values output by the detection method are comprehensive reactions of the reaction force, the judgment and decision force of the tested person and the fatigue states of oculomotor parasympathetic nerves.
The invention comprises the following parts:
1. fatigue values are defined as shown in the following equation:
F=A1F1+A2F2+A3F3 (1)
wherein F is a fatigue value and consists of three parts, and the first item is an eye movement information item; the second item is a reaction force information item; the third item is a judgment decision power information item;
specifically, F1 is the eye movement variable, F2 is the reaction force variable, and F3 is the judgment decision force variable, and the equation is further expressed as follows:
F=A1F(P)+A2g(R)+A3h(E) (2)
further:
F=A1f(P)+A2g(R)+A3tan(EX) (3)
wherein the eye movement variable is measured by:
F(P):
wherein the reaction force variable is measured by the following formula:
g(R):
wherein the decision force variable is measured by the following formula:
h(E)=tan(E×π/2):
where a (i ═ 1,2,3) is a weight coefficient of the first to third terms, and is set according to each item of sensitivity and importance.
2. Rapid and objective detection method
The method comprises four modules, namely an eye movement detection module, a reaction judgment decision power detection module, a fatigue value calculation output module and a measurement and data acquisition module
(1) Eye movement detection module: the eye movement detection module comprises an eye movement state capture system and an instant data analysis system
The eye movement state capturing system includes: image acquisition precision setting (24 frames per second), image acquisition start and end instructions;
the instant data processing system comprises: face recognition, eye region recognition, gray level conversion, and P70 real-time calculation function;
(2) a reaction judgment decision power detection module: comprises a task setting system and a detection system
The task setting system includes: randomly drawing 10 letters from the 26 letters, and drawing 2 letters from the 10 letters as target objects; the continuous appearance of target letters is a target signal and needs to be confirmed by trying to knock the space key.
In the test, one letter of 10 letters appears on the screen at random each time, the screen stops for 100 milliseconds and disappears, and the interval between the letters is 300-1000 millimeters; in the test sequence, the occurrence frequency of the target signal is 25% -35%;
setting task guide words and setting task practice programs.
The detection system comprises: detecting the reaction time of the tested person knocking the space key every time when the target signal appears; and (4) whether the target signal identification is correctly detected by the tested person.
(3) Measuring module
The tested person faces the screen, completes task operation according to the task requirement of the reaction judgment decision-making power detection module, collects the original data of eye movement, reaction time and error operation in the process, and calculates the P70 and reaction time index error rate index in real time in the background.
(4) Fatigue value calculation output module
Eye movement variable detection and calculation:
the eyelid closure degree is selected as the detection index of the eye movement variable, the eyelid closure degree P80 index is often adopted by road drivers such as highway truck drivers, high-speed rail drivers and other documents, but the control work requires that a controller keeps high alertness, and in the invention, a stricter P70 index is selected as a measurement value by combining the control work characteristic, so that the eye movement variable can be obtained by measuring the P70 index according to the following formula:
where FPs is the frame rate (frames/second), n is the number of blinks in the t period (second), sign is a variable from 0 to 1,
reaction force variable detection and calculation:
when the detection index of the reaction variable is a reaction, which is the time t (millisecond) between the occurrence of the target signal and the key pressing of the tested person, the reaction variable can be obtained by measuring the reaction index according to the following formula:
where t is the response time measurement and tT is the response time threshold (ms), the magnitude of which is related to the signal stimulation interval and the detection time, and is typically in the range of 300,500 (units: ms).
The values are given according to the following table:
duration of test
|
3min
|
5min
|
10min
|
20min
|
Time interval between signals
|
300-700ms
|
800-1200ms
|
1s-1.5s
|
1s-1.5s
|
Threshold of reaction time
|
300-500ms
|
300-500ms
|
500ms
|
500ms |
Judging and calculating decision variables:
and judging whether the detection index of the decision variable is an error rate and is an error response to the target signal, wherein the error response comprises omission of the target signal and error identification of a non-target signal, and the decision variable can be obtained by measuring the error response index of the tested person to the target signal according to the following formula:
wherein N isoIs the number of missing target signals, NeFor the number of signals selected by mistake, NtIs the number of target signals.
Calculation of the weight coefficients:
setting the weight coefficient A according to the sensitivity of three variables1、A2、A3The variable with high sensitivity is endowed with a larger weight coefficient, and the value ranges are all [1,10 ]]And the relationship of the three meets the following constraint requirements:
A1+A2+A3=10
and substituting the three indexes and the weight coefficients into the formula (3), and calculating and outputting the fatigue value of the tested person when the test is finished.
3. Parameter optimization
(1) Optimization of fatigue detection duration
In a regional control center in China, 4 volunteers of controllers were recruited to perform pretests in a 10-minute test period. The results show that the fatigue values of the volunteers greatly fluctuate at the beginning of the test, then fluctuate little and tend to be stable and stable. The time series single-factor analysis method is adopted to respectively test the change trend of the fatigue values of each controller along with the measurement time, the result shows that when the measurement time reaches 3 minutes, the average value of the fatigue values of the controllers begins to stabilize, the average value is respectively 0.98, 0.56, 0.77 and 0.62, and the variance is respectively 0.72, 0.67, 0.95 and 0.83, and the detection time is determined to be 3-5 minutes in consideration of the adaptability of a detection object.
(2) Sensitivity and effectiveness of the detection method
In order to verify the effectiveness of the method, 5 volunteers of airport controllers are recruited in a certain large international airport in China, and the fatigue state of the volunteers is detected before and after 1.5 hours of duty. Testing time of each controller for 5 minutes, signal occurrence interval time of 1000 milliseconds, eyelid closure degree variable adopting P70 index, reaction time variable threshold value of 500 millimeters, judging decision variable adopting error rate index, and variable weight coefficient as follows:
A1=8.0,A2=1.0,A3=1.0
the measurement results were as follows:
TABLE 1 fatigue Change before and after 1.5 hours of duty of apron controller
The detection result shows that the fatigue value of the controller shows an increasing trend after the controller is on duty for 1.5 hours. The results show that the fatigue detection results before the duty are obviously lower than those of the fatigue control group after the duty. During busy hours, air traffic control personnel are under high workload and duty safety pressure and are prone to fatigue. The greater standard deviation of fatigue values after the policer's duty may be due to different workloads. The field test result shows that the established fatigue detection method for the civil aviation controller can sensitively and effectively detect the change of the fatigue state of the controller.
According to an aspect of the present disclosure, there is provided a fatigue detecting device including:
the display module is used for responding to the trigger of the setting condition and displaying the setting content on the display equipment;
the receiving module is used for receiving feedback of a civil aviation controller for the set content;
the determining module is used for determining the fatigue value of the civil aviation controller according to the feedback;
and the output module is used for outputting reminding information according to the fatigue value.
Moreover, although the steps of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that the steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions, etc.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.
In an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
An electronic device according to this embodiment of the invention. The electronic device is only an example and should not bring any limitation to the function and the scope of use of the embodiments of the present invention.
The electronic device is in the form of a general purpose computing device. Components of the electronic device may include, but are not limited to: the at least one processor, the at least one memory, and a bus connecting the various system components (including the memory and the processor).
Wherein the storage stores program code executable by the processor to cause the processor to perform steps according to various exemplary embodiments of the present invention as described in the "exemplary methods" section above.
The memory may include readable media in the form of volatile memory, such as Random Access Memory (RAM) and/or cache memory, and may further include Read Only Memory (ROM).
The storage may also include a program/utility having a set (at least one) of program modules including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
The bus may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures.
The electronic device may also communicate with one or more external devices (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface. Also, the electronic device may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via a network adapter. As shown, the network adapter communicates with other modules of the electronic device over a bus. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.
In an exemplary embodiment of the present disclosure, there is also provided a computer-readable storage medium having stored thereon a program product capable of implementing the above-described method of the present specification. In some possible embodiments, aspects of the invention may also be implemented in the form of a program product comprising program code means for causing a terminal device to carry out the steps according to various exemplary embodiments of the invention described in the above section "exemplary methods" of the present description, when said program product is run on the terminal device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
Furthermore, the above-described figures are merely schematic illustrations of processes involved in methods according to exemplary embodiments of the invention, and are not intended to be limiting. It will be readily understood that the processes shown in the above figures are not intended to indicate or limit the chronological order of the processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, e.g., in multiple modules.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
The above description is only for the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.