CN115331142A - Portable human-computer interaction evaluation system - Google Patents

Abstract

The invention relates to the field of human-computer interaction measurement and evaluation, in particular to a portable human-computer interaction evaluation system. Various acquisition devices are integrated, and different types of required contents such as data, video files, texts and the like can be obtained; various display interfaces and hardware systems are universal, and the non-invasive design characteristics meet the human-computer interaction evaluation requirements of all kinds and all elements; the method supports a plurality of display control platforms to operate simultaneously, can perform collaborative evaluation on tasks requiring collaborative cooperation of a plurality of control platforms, and considers collaborative efficiency measurement; the human-computer work efficiency level of the human-computer interaction interface can be comprehensively evaluated according to the evaluation index by combining human physiological data.

Description

A Portable Human-Computer Interaction Evaluation System

technical field

The invention relates to the field of human-computer interaction measurement and evaluation, in particular to a portable human-computer interaction evaluation system.

Background technique

In the traditional way, when human-computer interaction evaluation is performed under normal exercise training conditions, more equipment is required, the wear time is too long, and the work performance of the operator is affected, so the sensitivity and accuracy of the evaluation cannot be guaranteed.

Equipment such as EEG will also seriously affect the operator's actual senses, which is too intrusive, and it is impossible to judge whether the cause of EEG fluctuations is task factors or equipment factors, resulting in inaccurate evaluation results.

The calculation of EEG, eye movement and other signals requires high theoretical level and practical technical level, which makes the universality of the evaluation not meet the requirements; at the same time, the information collection of EEG and eye movement signals requires computer equipment, which is considered confidential , can not carry the computer without authorization, and can not plug the device into the computer used for operation.

Contents of the invention

In view of the problems existing in the prior art, the purpose of the present invention is to provide a convenient human-computer interaction evaluation system.

In order to achieve the above object, the present invention adopts the following technical solutions to achieve.

A portable human-computer interaction evaluation system, including an information collection module, an information processing module, an interaction evaluation module and an information transmission module;

The information collection module includes a collection device and an information storage unit;

The acquisition equipment includes a camera, a physiological bracelet, an eye tracker, a displacement sensor, a force sensor and a rotation sensor; the camera is used to collect video information; the physiological bracelet is used to collect heart rate and respiratory rate; the eye tracker is used to collect eye movement data; The displacement sensor is used to collect displacement data; the force sensor is used to collect force data; the rotation sensor is used to collect rotation amplitude data; the information storage unit is used to store the data collected by the collection device;

The information processing module includes a subjective data analysis unit, a video stream analysis unit, a task data analysis unit, and a physiological index analysis unit;

The subjective data analysis unit is used to calculate and obtain the task load index based on the subjective data; wherein, the subjective data is the questionnaire filled out by the evaluation personnel according to the evaluation content, such as the NASA-NLX scale;

The video stream analysis unit is used to obtain abnormal operation indicators based on video information; use video key frame extraction technology and improved Mask-RCNN algorithm for video information to identify abnormal operations, obtain the number of abnormal operations, and realize abnormal operation behaviors. Quantify;

The task data analysis unit is used to obtain the time utilization rate according to the ratio of the normal operation time to the total time for completing tasks, and obtain the task accuracy rate according to the ratio of the number of correctly completed tasks to the total number of tasks;

The physiological index analysis unit is used to obtain the eye movement load index according to the eye movement data;

The interactive evaluation module includes task frame evaluation unit, cognitive load evaluation unit, man-machine interface evaluation unit, operation comfort evaluation unit and output unit;

The task frame evaluation unit is used to quantitatively evaluate the task frame according to the task load index, time utilization rate, and task accuracy combined with the improved FAHP-TOPSIS method, and obtain the quantitative evaluation value of the task frame;

The cognitive burden evaluation unit is used to quantitatively evaluate the cognitive burden according to the heart rate, respiratory rate, abnormal operation index and eye movement load index combined with the improved FAHP-TOPSIS method, and obtain the quantitative evaluation value of the cognitive burden;

The man-machine interface evaluation unit is used to quantitatively evaluate the man-machine interface according to the pre-stored expert evaluation scores of the four indicators of practicability, functionality, fluency, and coordination, combined with the improved FAHP-TOPSIS method, to obtain the man-machine interface Quantitative evaluation value;

The operating comfort evaluation unit is used to quantitatively evaluate the operating comfort based on the displacement data, force data and rotation amplitude data of the human body combined with the improved FAHP-TOPSIS method, and obtain the quantitative evaluation value of the operating comfort;

The output unit is used to obtain the numerical solution of human-computer interaction and the distribution map of related indicators according to the quantitative evaluation value of the task frame, the quantitative evaluation value of cognitive burden, the quantitative evaluation value of human-computer interface and the quantitative evaluation value of operation comfort, and complete the human-computer interaction system. Evaluate;

The information transmission module is used to transmit the data collected by the information collection module to the information processing module, and is also used to transmit the index data obtained by the information processing module to the interactive evaluation module.

Further, the displacement sensor, the force sensor and the rotation sensor are all arranged on the hands, upper limbs and lower back of the operator.

Compared with the prior art, the beneficial effects of the present invention are: integrating various acquisition devices, can obtain different types of required content such as data, video files, texts, etc.; common various display interfaces and hardware systems, and non-invasive design Features meet the human-computer interaction evaluation requirements of all types and elements; support multiple display control platforms to operate at the same time, and can perform collaborative evaluation on tasks that require the cooperation of multiple consoles, and consider the measurement of collaborative efficiency; can combine human physiology The data is used to comprehensively evaluate the ergonomics level of the human-computer interface according to the evaluation indicators.

Description of drawings

The present invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments.

Fig. 1 is a schematic structural diagram of a portable human-computer interaction evaluation system of the present invention;

Fig. 2 is a functional block diagram of the interactive evaluation module of the present invention;

Fig. 3 is the improved Mask-RCNN algorithm flowchart of the present invention;

Fig. 4 is a flowchart of the improved FAHP-TOPSIS method of the present invention.

Detailed ways

Embodiments of the present invention will be described in detail below in conjunction with examples, but those skilled in the art will understand that the following examples are only used to illustrate the present invention, and should not be considered as limiting the scope of the present invention.

Referring to Figure 1, a portable human-computer interaction evaluation system includes an information collection module, an information processing module, an interactive evaluation module and an information transmission module;

The information collection module includes a collection device and an information storage unit;

The acquisition equipment includes a camera, a physiological bracelet, an eye tracker, a displacement sensor, a force sensor and a rotation sensor; the camera is used to collect video information; the physiological bracelet is used to collect heart rate and respiratory rate; the eye tracker is used to collect eye movement data; The displacement sensor is used to collect displacement data; the force sensor is used to collect force data; the rotation sensor is used to collect rotation amplitude data; the information storage unit is used to store the data collected by the collection device;

The information processing module includes a subjective data analysis unit, a video stream analysis unit, a task data analysis unit, and a physiological index analysis unit;

The subjective data analysis unit is used to calculate and obtain the task load index based on the subjective data; wherein, the subjective data is the questionnaire filled out by the evaluation personnel according to the evaluation content, such as the NASA-NLX scale;

The video stream analysis unit is used to obtain abnormal operation indicators based on video information; for video information, use video key frame extraction technology and the improved Mask-RCNN algorithm as shown in Figure 3 to identify abnormal operations, obtain the number of abnormal operations, and realize Quantification of abnormal operational behavior;

The task data analysis unit is used to obtain the time utilization rate according to the ratio of the normal operation time to the total time for completing tasks, and obtain the task accuracy rate according to the ratio of the number of correctly completed tasks to the total number of tasks;

The physiological index analysis unit is used to obtain the eye movement load index according to the eye movement data;

The interactive evaluation module includes task frame evaluation unit, cognitive load evaluation unit, man-machine interface evaluation unit, operation comfort evaluation unit and output unit;

Referring to Figure 2 and Figure 4, the task frame evaluation unit is used to quantitatively evaluate the task frame according to the task load index, time utilization rate, and task accuracy combined with the improved FAHP-TOPSIS method, and obtain the quantitative evaluation value of the task frame;

Referring to Figure 2 and Figure 4, the cognitive burden evaluation unit is used to quantitatively evaluate the cognitive burden based on heart rate, respiratory rate, abnormal operation indicators and eye movement load indicators combined with the improved FAHP-TOPSIS method to obtain a quantitative evaluation value of cognitive burden;

Referring to Figure 2 and Figure 4, the man-machine interface evaluation unit is used to evaluate the man-machine interface based on the pre-stored expert evaluation scores of the four indicators of practicability, functionality, fluency, and coordination, combined with the improved FAHP-TOPSIS method. Quantitative evaluation to obtain the quantitative evaluation value of the human-machine interface;

Referring to Figure 2 and Figure 4, the operating comfort evaluation unit is used to quantitatively evaluate the operating comfort based on the human body's displacement data, force data and rotation amplitude data combined with the improved FAHP-TOPSIS method, and obtain the quantitative evaluation value of operating comfort;

Referring to Figure 2, the output unit is used to obtain the numerical solution of human-computer interaction and the distribution map of related indicators according to the quantitative evaluation value of the task frame, the quantitative evaluation value of cognitive burden, the quantitative evaluation value of human-machine interface and the quantitative evaluation value of operation comfort, and complete the human-computer interaction analysis. Evaluation of computer-interactive systems;

The information transmission module is used to transmit the data collected by the information collection module to the information processing module, and is also used to transmit the index data obtained by the information processing module to the interactive evaluation module.

Further, the displacement sensor, the force sensor and the rotation sensor are all arranged on the hands, upper limbs and lower back of the operator.

Further, the subjective data input unit, information storage unit, information processing module, and interactive evaluation module of the information collection module use computers as carriers.

Although the present invention has been described in detail with general descriptions and specific embodiments in this specification, it is obvious to those skilled in the art that some modifications or improvements can be made on the basis of the present invention. Therefore, the modifications or improvements made on the basis of not departing from the spirit of the present invention all belong to the protection scope of the present invention.

Claims (3)

1. A portable human-computer interaction evaluation system, characterized in that it includes an information collection module, an information processing module, an interactive evaluation module and an information transmission module; The information collection module includes a collection device and an information storage unit; The acquisition equipment includes a camera, a physiological bracelet, an eye tracker, a displacement sensor, a force sensor and a rotation sensor; the camera is used to collect video information; the physiological bracelet is used to collect heart rate and respiratory rate; the eye tracker is used to collect eye movement data; The displacement sensor is used to collect displacement data; the force sensor is used to collect force data; the rotation sensor is used to collect rotation amplitude data; the information storage unit is used to store the data collected by the collection device; The information processing module includes a subjective data analysis unit, a video stream analysis unit, a task data analysis unit, and a physiological index analysis unit; The subjective data analysis unit is used to calculate the task load index based on the subjective data; wherein, the subjective data is the questionnaire filled out by the evaluation personnel according to the evaluation content; The video stream analysis unit is used to obtain abnormal operation indicators according to the video information; The task data analysis unit is used to obtain the time utilization rate according to the ratio of the normal operation time to the total time for completing tasks, and obtain the task accuracy rate according to the ratio of the number of correctly completed tasks to the total number of tasks; The physiological index analysis unit is used to obtain the eye movement load index according to the eye movement data; The interactive evaluation module includes task frame evaluation unit, cognitive load evaluation unit, man-machine interface evaluation unit, operation comfort evaluation unit and output unit; The task frame evaluation unit is used to quantitatively evaluate the task frame according to the task load index, time utilization rate, and task accuracy combined with the improved FAHP-TOPSIS method, and obtain the quantitative evaluation value of the task frame; The cognitive burden evaluation unit is used to quantitatively evaluate the cognitive burden according to the heart rate, respiratory rate, abnormal operation index and eye movement load index combined with the improved FAHP-TOPSIS method, and obtain the quantitative evaluation value of the cognitive burden; The man-machine interface evaluation unit is used to quantitatively evaluate the man-machine interface according to the pre-stored expert evaluation scores of the four indicators of practicability, functionality, fluency, and coordination, combined with the improved FAHP-TOPSIS method, to obtain the man-machine interface Quantitative evaluation value; The operating comfort evaluation unit is used to quantitatively evaluate the operating comfort based on the displacement data, force data and rotation amplitude data of the human body combined with the improved FAHP-TOPSIS method, and obtain the quantitative evaluation value of the operating comfort; The output unit is used to obtain the numerical solution of human-computer interaction and the distribution map of related indicators according to the quantitative evaluation value of the task frame, the quantitative evaluation value of cognitive burden, the quantitative evaluation value of human-computer interface and the quantitative evaluation value of operation comfort, and complete the human-computer interaction system. Evaluate; The information transmission module is used to transmit the data collected by the information collection module to the information processing module, and is also used to transmit the index data obtained by the information processing module to the interactive evaluation module. 2. The portable human-computer interaction evaluation system according to claim 1, characterized in that the displacement sensor, the force sensor and the rotation sensor are all arranged on the operator's hands, upper limbs and lower back. 3. The portable human-computer interaction evaluation system according to claim 1, characterized in that the subjective data input unit, information storage unit, information processing module, and interactive evaluation module of the information collection module use a computer as a carrier.

Images