CN111067549A - Immersive hand and foot mixing-based attention training device and system - Google Patents

Abstract

The invention belongs to the technical field of testing and training devices, and in particular relates to an attention testing and training device and a system thereof based on immersive hand and foot mixing. It includes: at least one hand force travel collection module and at least one foot force travel collection module, the hand force travel collection module and foot force travel collection module are respectively connected with the force travel AD conversion module, the force travel The AD conversion module is connected with the force travel data processing module, the hand force travel acquisition module, the force travel AD conversion module and the force travel data processing module are respectively connected to the power supply module, and the force travel data processing module is connected through wireless and/or Or wired communication to connect with the main control module with built-in attention testing/training software. Compared with the prior art, the advantages of the attention testing and training device and system based on the immersive hand and foot mixing are as follows: 1. The design is reasonable, which is convenient for training attention.

Description

An attention training device and system based on immersive hand and foot mixing

technical field

The invention belongs to the technical field of testing and training devices, and in particular relates to an attention testing and training device and system based on immersive hand and foot mixing.

Background technique

Human cognitive abilities include orientation, perception, language, computation, memory, and attention. Attention is the foundation of all cognitive abilities and the most critical factor in human learning, work and life. With the rapid development of modern society, various study and work tasks require increasing attention. For children, only children who pay attention can acquire more knowledge in the same time, or acquire knowledge more efficiently. A child’s lack of concentration will lead to a series of consequences, such as: easy distraction, lack of focus on learning tasks, low efficiency in class attendance, declining grades, carelessness, procrastination in homework, and more and more lack of self-confidence and easy dependence on others in the long run. It is even prone to extreme temperament such as irritability. For adults, the nature of certain jobs, such as pilots, drivers, athletes, etc., requires a high degree of attention control to ensure smooth implementation and development of the work and accuracy of time. Therefore, the test and training of attention ability will help parents and teachers to understand the attention level of children, carry out intervention and training for children with lower attention levels, or develop adaptive education and teaching methods, so as to better care for children, Love their growth. The test of attention ability helps the human resources department to assess the competence of employees in jobs that require attention ability, and helps adults to self-assess the attention level. On this basis, effective targeted training can improve the Attention, and then improve cognitive ability, more in line with the requirements of modern society for talent concentration.

For example, Chinese patent documents disclose an attention training system combining immersive vision and discrete force control tasks [application number: CN106128201B]. Automatically adjust the difficulty of training tasks to adapt to the user's increasing control ability or individual differences of different people. At the same time, the user's enthusiasm for training tasks and attention input are always maintained at the highest level, so as to improve the target group's attention. With finger force control purpose. However, there are still technical problems such as inconvenience in training attention.

SUMMARY OF THE INVENTION

The purpose of the present invention is to address the above problems, to provide a visual and auditory-based immersive hand-foot-mixed attention training device and system that is reasonably designed and is convenient for training attention.

In order to achieve the above object, the present invention adopts the following technical solutions: this immersive hand-foot-mixed attention training device is characterized in that it includes: at least one hand force stroke collection module and at least one foot force stroke collection module module, the hand force travel acquisition module and the foot force travel acquisition module are respectively connected with the force travel AD conversion module, the force travel AD conversion module is connected with the force travel data processing module, the hand force travel The acquisition module, the force travel AD conversion module and the force travel data processing module are respectively connected to the power supply module, and the force travel data processing module is connected to the main control module with built-in attention measurement/training software through wireless and/or wired communication .

In the above-mentioned immersive hand-foot-mixed attention training device, the hand force and stroke collection module includes a hand-held body, and at least one button is connected to the hand-held body, and each button is connected to a hand-held device. The hand force stroke variable voltage output mechanism in the body is connected and the output voltage of the hand force stroke variable voltage output mechanism changes with the button stroke when the button is actuated.

In the above-mentioned attention training device based on immersive hand and foot mixing, the foot force and stroke acquisition module includes a base, on which a pedal is hinged, the pedal is inclined, and the base is provided with a The foot force stroke variable voltage output mechanism below the upper end of the pedal, the pedal upper end acts on the foot force stroke variable voltage output mechanism, and when the pedal acts, the output voltage of the foot force stroke variable voltage output mechanism follows the pedal. Itinerary changes.

In the above-mentioned immersive hand-foot-mixed attention training device, the force-stroke AD conversion module includes an analog-to-digital converter in Arduino based on Mega2560, mini or Nano architecture, or an analog-to-digital converter in stm32 core circuit board A digital converter, the force-stroke AD conversion module is used to convert the analog signal of the voltage change of the hand force-stroke variable voltage output mechanism and/or the foot force-stroke variable voltage output mechanism into a digital signal, and the analog-to-digital conversion accuracy It is 10-16 bits, and the sampling rate is 500Hz; the force-stroke data processing module performs Kalman filtering on the current digital signal caused by the voltage change to remove the interference and noise signals in the acquisition process, and uses the USB data cable or wireless Bluetooth protocol. The force travel data is sent to the main control module; the power supply module is a 3.3-5V DC power supply, and the power supply module is an external DC power supply or a USB interface connected to the main control module.

In the above-mentioned immersive hand-foot-mixed attention testing and training device, the main control module includes any one of a desktop computer, a notebook computer, an all-in-one computer, and a single-chip computer, and the main control module is connected with a A speaker or an earphone, the main control module is self-contained or externally connected with any one of a display screen, a digital TV screen, an all-in-one screen, and a flat screen.

In the above-mentioned immersive hand-foot-mixed attention training device, the number of the hand force and stroke acquisition modules is two and is arranged in parallel, one of which is used for the left hand and the other is used for the right hand.

In the above-mentioned immersive hand-foot-mixed attention training device, the number of the foot force and stroke acquisition modules is two and is arranged in parallel, one of which is used for the left foot and the other is used for the right foot.

In the above-mentioned immersive hand-foot-mixed attention testing and training system, it is characterized in that: the attention testing/training software includes a virtual reality audio-visual cognitive task presentation module, a norm database module, and an attention testing data analysis module. module, report generation module, attention training scheme generation module, attention training process control module and main control module, the main control module is connected with the virtual reality visual and auditory cognitive task presentation module; the main control module is connected with the attention The force test data analysis module, the norm database module and the report generation module are connected with the output end of the force stroke data processing module; the main control module is connected with the attention training scheme generation module and the attention training process control module; the main control module is connected with the output end of the force travel data processing module; the described norm database module, the attention test data analysis module, the report generation module and the output end of the force travel data processing module are connected; wherein,

Described main control module is configured to complete including audiovisual cognitive task flow control, audiovisual cognitive task presentation control, access norm database module control, attention test data analysis module control and report generation module control;

The virtual reality visual and auditory cognitive task presentation module is configured to complete the presentation of immersive visual and auditory information;

The attention test data analysis module is configured to automatically analyze the force travel data generated by the user's foot operation hand force travel acquisition module (1) under the environment of visual and auditory cognitive tasks, and obtain a series of reaction attention by solving. The parameters of the force are compared with the data of the same age and gender in the norm database module, and the attention level parameters of the users relative to the norm data are obtained;

The report generation module is configured to automatically display the user's attention level parameters in the form of graphs and texts, word or PDF documents according to a certain graphic and text structure, and automatically further analyze and explain the meaning and score of the main parameters. ;

The norm database module is configured to store the attention parameters collected and counted by people with normal attention using the attention training device based on the visual and auditory pathway-based hand force travel;

The described attention training scheme generation module is configured to be graded according to the attention level result according to the result of the attention test data analysis module, and the attention training scheme is divided into different schemes according to the classification;

The attention training process control module is configured to save the user's training program, record the situation of program development, record the historical achievements of the completed training, and query functions.

In the above-mentioned immersive hand-foot-mixed attention testing and training system, the norm data in the norm database module is divided according to age and gender, and each year from 6 years old to 18 years old is a statistical data segment ; from 19 to 24 years old is a statistic data segment every two years; from 25 to 50 years old is a statistic data segment every five years; from 51 to 60 years old is a statistic data segment; from 61 years old is a statistic data segment Data segment; contains a total quotient (parameter) related to attention and control and four total quotients (parameters) related to attention and control of visual and auditory channels: auditory response control quotient, visual response control quotient There are four parameters: auditory attention quotient, auditory attention quotient, and visual attention quotient; it also includes a number of specific quotients (parameters) about the attention and control of visual and auditory channels: auditory retention ability Speed quotient, visual speed quotient, visual and auditory balance quotient, auditory responsiveness quotient, visual responsiveness quotient, auditory consistency quotient, visual consistency quotient, auditory concentration quotient, visual attention Quotient, auditory discrimination ability quotient, visual discrimination ability quotient, and standard deviation parameters of the above quotients.

In the above-mentioned immersive hand-foot-mixed-based attention training system, the comprehensive quotient (parameter) related to the attention and control is based on the auditory response control quotient, the visual response control quotient, and the auditory attention Quotient and visual attention quotient are obtained by weighted calculation; the specific quotient (parameter) is obtained by standardized calculation; the auditory response control quotient, visual response control quotient, auditory attention quotient, visual attention Quotient, auditory retention quotient, visual retention quotient, auditory speed quotient, visual speed quotient, visual and auditory balance quotient, auditory responsiveness quotient, visual responsiveness quotient, auditory consistency quotient, visual Consistency quotient, auditory attention concentration quotient, visual attention concentration quotient, auditory discrimination ability quotient, and visual discrimination ability quotient are obtained by analyzing the data collected by the hand force travel acquisition module (1).

Compared with the existing technology, the advantages of the attention testing and training device and system based on immersive hand and foot mixing are as follows: 1. The design is reasonable, which is convenient for training attention. 2. The combination of force and hand stroke is in line with tactile perception, which can maximize the activation of tactile perception function. 3. The operation is to increase the proportion of attention in the cognitive activities of the brain under the environment of visual and auditory information processing, so as to avoid the interference and influence of other cognitive activities existing in the brain function on attention, so that the attention in the present invention can be avoided. Ability to train more efficiently.

Description of drawings

Fig. 1 is a schematic diagram of the composition mechanism of an attention testing system of the hand and foot force travel based on the immersive virtual reality audio-visual sensory pathway of the present invention.

FIG. 2 is a schematic structural diagram of an immersive virtual reality head-mounted device of the present invention.

FIG. 3 is a schematic structural diagram of a hand force stroke collection module of the present invention.

FIG. 4 is a schematic diagram of the design principle of the hand force stroke collection module of the present invention.

FIG. 5 is a schematic structural diagram of a foot force stroke collection module of the present invention.

FIG. 6 is a schematic diagram of the design principle of the foot force stroke collection module of the present invention.

FIG. 7 is a schematic diagram of the visual response operation in the attention test stage of the present invention.

FIG. 8 is a schematic diagram of the auditory response operation in the attention test stage of the present invention.

FIG. 9 is a flow chart of the visual and auditory attention test of the present invention.

FIG. 10 is a schematic diagram of the visual response operation in the attention training stage of the present invention.

FIG. 11 is a schematic diagram of the auditory response operation in the attention training stage of the present invention.

Fig. 12 is a flow chart of the training of visual and auditory attention (80 times) of the present invention.

In the figure, hand force travel acquisition module 1, foot force travel acquisition module 2, force travel AD conversion module 3, force travel data processing module 4, power supply module 5, main control module 6, handheld body 1a, button 1b, hand Part force and stroke variable voltage output mechanism 7, second resistive element 72, first resistive element 71, first spring 73, first connecting rod 74, second varistor conductive reed 75, base 2a, pedal 2b, third resistor 82, second spring 84, second connecting rod 85, second varistor conductive reed 86, connecting ring 87, virtual reality visual and auditory cognitive task presentation module 9, norm database module 10, attention test data analysis module 11. A report generation module 12 , an attention training scheme generation module 13 , and an attention training process control module 14 .

Detailed ways

As shown in Figure 1-12, the immersive hand-foot-mixed attention testing and training device includes: at least one hand force stroke collection module 1 and at least one foot force stroke collection module 2. The module 1 and the foot force travel acquisition module 2 are respectively connected with the force travel AD conversion module 3, the force travel AD conversion module 3 is connected with the force travel data processing module 4, the hand force travel acquisition module 1, the force travel AD conversion module 3 and The force travel data processing module 4 is respectively connected to the power supply module 5, and the force travel data processing module 4 is connected to the main control module 6 with built-in attention measurement/training software through wireless and/or wired communication.

More specifically, the hand force and stroke acquisition module 1 includes a hand-held body 1a, and at least one button 1b is connected to the hand-held body 1a, and each button 1b is connected to a hand force and stroke variable voltage output mechanism 7 arranged in the hand-held body 1a. And when the button 1b is actuated, the output voltage of the hand force and stroke variable voltage output mechanism 7 changes with the stroke of the button 1b.

The hand force and stroke variable voltage output mechanism 7 includes a first resistance member 71 and a second resistance member 72 that are parallel to each other. The connecting rod 74 between 73, the inner end of the first connecting rod 74 is provided with a varistor conductive reed 75, and the two sides of the second varistor conductive reed 75 are respectively in electrical contact with the first resistance member 71 and the second resistance member 72 , the first resistive element 71 and the second resistive element 72 are respectively connected to the positive and negative electrodes of the power supply module 4, the second resistive element 72 and the negative electrode of the power supply module 4 are connected with a first constant value resistor, and the second resistive element 72 is connected to the power supply module 4. A fixed-value resistor is connected between the modules 5, and the outer end of the first connecting rod 74 extends out of the hand-held body 1 and is connected with the button 1b fixed thereon.

Preferably, the handheld body 1a is connected with five keys 1b, and the five keys 1b are adapted to the distribution of fingers on the same hand.

Preferably, the hand-held body 1a is also provided with a wearing structure which is convenient to be fixed on the hand, and the wearing structure includes any one of a Y-shaped belt or a fingerless glove.

The foot force stroke acquisition module 2 includes a base 2a, a pedal 2b is hinged on the base 2a, the pedal 2b is arranged obliquely, and a foot force stroke variable voltage output mechanism 8 located below the upper end of the pedal 2b is arranged on the base 2a, and the upper end of the pedal 2b is provided. The output voltage of the foot force and stroke variable voltage output mechanism 8 acting on the foot force and stroke variable voltage output mechanism 8 and when the pedal 2b is actuated varies with the stroke of the pedal 2b.

The foot force and stroke variable voltage output mechanism 8 includes a third resistance member 82 and a fourth resistance member 83 vertically fixed on the base 2a, and the third resistance member 82 and the fourth resistance member 83 are arranged parallel to each other and between them. A second spring 84 and a second connecting rod 85 pressed between the second springs 84 are provided. The lower end of the second connecting rod 85 is provided with a second varistor conductive reed 86, and both ends of the second varistor conductive reed 86 are provided. They are in electrical contact with the third resistance element 82 and the fourth resistance element 83 respectively, the third resistance element 82 and the fourth resistance element 83 are respectively connected to the positive and negative electrodes of the power supply module 4 , and between the fourth resistance element 83 and the negative electrode of the power supply module 4 A second fixed-value resistor is connected, a fixed-value resistor 14 is connected between each fourth resistance member 83 and the power supply module 4, the upper end of the second connecting rod 85 is connected with the upper end of the pedal 2b; the upper end of the second connecting rod 85 is provided with a spherical connection A connecting ring 87 is provided on the back of the upper end of the pedal 2b.

The force stroke AD conversion module 3 includes an analog-to-digital converter in Arduino based on Mega2560, mini or Nano architecture or an analog-to-digital converter in the stm32 core circuit board. The force stroke AD conversion module 3 is used to convert the hand force stroke into voltage output The analog signal of the voltage change of the mechanism 7 and/or the foot force and stroke variable voltage output mechanism 8 is converted into a digital signal, the analog-to-digital conversion accuracy is 10-16 bits, and the sampling rate is 500Hz; The current digital signal is Kalman filtered to remove the interference and noise signals in the acquisition process, and the force travel data is sent to the main control module 6 through the USB data cable or wireless Bluetooth protocol; the power supply module 5 is a 3.3-5V DC power supply, and the power supply module 5 is an external DC power supply or a USB interface connected to the main control module 6 .

The main control module 6 includes any one of a desktop computer, a notebook computer, an all-in-one computer, and a single-chip computer. The main control module 6 is connected with a speaker or an earphone. Either screen or tablet screen.

Preferably, the number of hand force and stroke collection modules 1 is two and they are arranged in parallel, one of which is used for the left hand and the other for the right hand.

Preferably, the number of the foot force stroke collection modules 2 is two and is arranged in parallel, one of which is used for the left foot and the other is used for the right foot;

The attention test/training software includes a virtual reality audiovisual cognitive task presentation module 9, a norm database module 10, an attention test data analysis module 11, a report generation module 12, an attention training program generation module 13, and an attention training process control The module 14 is connected with the main control module 6, the main control module 6 is connected with the virtual reality audio-visual cognitive task presentation module 9; the main control module 6 is connected with the attention test data analysis module 11, the norm database module 10 and the report generation module 12 and the force The output end of the travel data processing module 4 is connected; the main control module 6 is connected with the attention training scheme generation module 13 and the attention training process control module 14; the main control module 6 is connected with the output end of the force travel data processing module 4; The norm database module 10, the attention test data analysis module 11, the report generation module 12 and the output end of the force stroke data processing module 4 are connected; wherein,

The main control module 6 is configured to complete the control of the visual and auditory cognitive task flow control, the control of the visual and auditory cognitive task presentation, the control of the access norm database module 10, the control of the attention test data analysis module 11 and the control of the report generation module 12;

The virtual reality visual and auditory cognitive task presentation module 9 is configured to complete the presentation of immersive visual and auditory information; the specific device for visual information presentation is a virtual reality headset, such as desktop-level HTC vive series headsets, Oculus system headsets; Mobile-level bird watching and other equipment. The presentation of auditory information is mainly realized by high-fidelity headphones.

The attention test data analysis module 11 is configured to automatically analyze the force travel data generated by the user's foot operation hand force travel acquisition module 1 under the environment of visual and auditory cognitive tasks, and obtain a series of parameters reflecting attention by solving. Comparing with the norm database module 10 data of the same age and gender, to obtain the attention level parameter relative to the norm data user;

The report generation module 12 is configured to automatically display the user's attention level parameters in the form of charts and texts, word or PDF documents according to a certain graphic and text structure, and automatically further analyze and explain the meaning and score of the main parameters;

The norm database module 10 is configured to store the attention parameters collected and counted by people with normal attention using the attention training device based on the visual and auditory pathway-based hand force travel;

The attention training scheme generation module 13 is configured to be graded according to the attention level result according to the result of the attention test data analysis module, and the attention training scheme is divided into different schemes according to the classification;

The attention training process control module 14 is configured to realize the saving of the user's training program, the record of the situation of the program development, the historical record of the completed training, and the query function.

The norm data in the norm database module 8 are divided according to age and gender. From 6 years old to 18 years old, each year is a statistical data segment; from 19 years old to 24 years old, each two years is a statistical data segment; from 25 years old to 25 years old. 50 years old is a statistical data section every five years; from 51 to 60 years old is a statistical data section; from 61 years old is a statistical data section; it contains a comprehensive quotient parameter related to attention and control and four The total quotient parameters of attention and control of the visual and auditory channels: auditory response control quotient, visual response control quotient, auditory attention quotient, visual attention quotient four parameters; Specific quotient parameters of force and control: auditory retention quotient, visual retention quotient, auditory speed quotient, visual speed quotient, visual and auditory balance quotient, auditory responsiveness quotient, visual response quotient, auditory consistency Sex quotient, visual consistency quotient, auditory concentration quotient, visual attention concentration quotient, auditory discrimination ability quotient, visual discrimination ability quotient, and standard deviation parameters of the above quotients.

The comprehensive quotient parameters related to attention and control are obtained by weighted calculation of auditory response control quotient, visual response control quotient, auditory attention quotient, and visual attention quotient; specific quotient parameters are obtained by standardized calculation; auditory response control quotient number, visual response control quotient, auditory attention quotient, visual attention quotient, auditory retention quotient, visual retention quotient, auditory speed quotient, visual speed quotient, visual and auditory balance quotient, auditory response Ability quotient, visual response ability quotient, auditory consistency quotient, visual consistency quotient, auditory concentration quotient, visual attention concentration quotient, auditory discrimination ability quotient, and visual discrimination ability quotient were analyzed separately The data collected by the hand force stroke collection module 1 is obtained.

Each handheld device includes five buttons and corresponds to the position of the fingers when held. When each button is applied with 0-10 Newtons, the displacement distance is 0-20 milliseconds. The inside of the button is a small sliding rheostat. Depending on the test scene and accuracy, the resistance of the rheostat can be one of the following, 1K ohm-50K ohm. (image 3)

Its hand force travel module structure is divided into: buttons, connecting rods, resistance contact pieces, varistor sliding pieces, springs, DC power supply, fixed value resistors and other specific components. The working principle is that the hand holds the handheld device, and a finger presses the button to generate a certain displacement distance, which changes the position of the varistor sliding piece, thereby changing the output resistance value of the sliding varistor. Each varistor circuit is in a voltage divider circuit. Due to the change of the resistance value, the voltage change on the fixed-value resistor is generated, and the voltage change is the output of the force stroke voltage (analog parameter). (Figure 4)

The foot force travel acquisition module: mainly has an ABS plastic structure and is pedal type. When the pedal is applied with 10-40 Newtons, the displacement distance is 0-50 milliseconds. The inside of the pedal is a small sliding rheostat. Depending on the test scene and accuracy, the resistance of the rheostat can be one of the following, 1K ohm-100K ohm. (Figure 5)

The core structure of the foot force travel module is divided into: pedal, pedal connecting ring, pedal connecting shaft, base, pedal base connecting part, connecting rod, resistance contact piece, varistor sliding piece, spring, DC power supply, constant value resistance, etc. The specific components are integrated. The working principle is that the foot is naturally placed on the pedal device, and the pedal is stepped on to generate a certain displacement distance, which changes the position of the varistor sliding piece, thereby changing the output resistance value of the sliding rheostat. Each varistor circuit is in a voltage divider circuit. Due to the change of the resistance value, the voltage change on the fixed-value resistor is generated, and the voltage change is the output of the force stroke voltage (analog parameter). (Image 6)

The visual response operation in the attention test stage: first, the user uses his own sharp hand (left or right hand) to hold the force stroke module, and can use one of the five fingers of one hand to press the button as an operation. The visual environment created by the immersive virtual reality device is a classroom during the daytime. The classroom is quiet, with a certain number of desks and chairs, but no other characters. The user's perspective is in a sitting position, facing the blackboard in front of the classroom. A blackboard appears in the center of the blackboard. Numbers, such as '1' or '2', disappear after 200 milliseconds of display. However, the center of the blackboard continues to display two square boxes arranged one above the other. When you see '1', press the button quickly to make the small ball under the blackboard move vertically from bottom to top to the top frame. When you see '2', quickly press the button to make the small ball under the blackboard move vertically from bottom to top to the bottom frame. The stroke increase caused by pressing the button by hand corresponds to the height of the vertical movement of the small ball from bottom to top. The lowest height (the bottom of the blackboard) is no key travel, and the highest height (the top of the blackboard) is the maximum travel of the keys. When the small ball enters the positive box and ensure that it is in the box for at least 100 milliseconds. The blackboard is cleared, and the user releases the key to enter the next operation. If the user does not make the ball enter the box within 2 seconds, the blackboard is cleared and the next operation is entered. (Figure 7)

The auditory response operation in the attention test stage: first, the user uses his own sharp foot (left or right foot), the foot naturally rests on the force travel module, and the foot pedal is used as the operation. The visual environment created by the immersive virtual reality device is a classroom in the daytime. The classroom is quiet, there are a certain number of desks and chairs, but there are no other characters. The user's perspective is sitting, facing the blackboard in front of the classroom, and it sounds in the headphones , such as '1' or '2', after 500 milliseconds, two square boxes arranged up and down are displayed continuously in the center of the blackboard. When you hear '1', you need to quickly press the pedal to make the small ball under the blackboard move vertically from bottom to top to the top frame. When you hear '2', press the pedal quickly to make the small ball under the blackboard move vertically from bottom to top to the bottom frame. The increase in travel caused by stepping on the pedal corresponds to the height of the vertical movement of the ball from bottom to top. The lowest height (the bottom of the blackboard) is no pedal travel, and the highest height (the top of the blackboard) is the maximum travel of the pedals. When the small ball enters the square and ensures that it is in the box for at least 100 milliseconds. The blackboard is emptied, the user releases the pedal, and goes to the next operation. If the user does not make the ball enter the box within 2 seconds, the blackboard is cleared and the next operation is entered. Figure 8.

The visual and auditory attention test:

The attention test consists of two parts. The first part is the practice phase, which is mainly to be familiar with the operation methods of the hand and foot force travel equipment in the context of visual and auditory cognitive tasks. In the practice stage, the numbers '1' and '2' are arranged 8 times each, a total of 16 visual response operations, and the numbers '1' and '2' are arranged 8 times each, a total of 16 auditory response operations and 16 (number' The visual and auditory ratio of 1' and the number '2' is 4:4:4:4, and the arrangement order is pseudo-random, that is, the same operation of the number '1' and the number '2' will not appear consecutively.) Mixed visual and auditory response operate. Especially in the practice stage, if the user does not make the ball enter the box within 2 seconds, the system will use a voice prompt to operate too slowly.

The second part is the formal test stage, with a total of 200 operations, including 50 visual operations and 50 auditory operations for the number '1', and 50 visual operations and 50 auditory operations for the number '2'. These operations are arranged in a pseudo-random order, that is, the same operation for the number '1' and the number '2' does not appear consecutively. Figure 9.

The visual response operation in the attention training phase:

First, the user holds a hand force stroke module with both hands, and can use one of the five fingers of one hand to press the button as an operation.

The vision scheme contains about 20 cognitive tasks of different types and levels of difficulty. So that the training is carried out step by step. A low-difficulty cognitive task designed as the following example:

A number such as '0'-'9' appears at the center of the blackboard but at any height. After 200ms of display, the number disappears. However, a square box is continuously displayed in the original position of the blackboard. When you see '0'-'4', quickly press the left-hand button to make the small ball under the blackboard move vertically from bottom to top into the square. When you see '5'-'9', quickly press the right button to make the small ball under the blackboard move vertically from bottom to top into the square. The stroke increase caused by pressing the button by hand corresponds to the height of the vertical movement of the small ball from bottom to top. The lowest height (the bottom of the blackboard) means that there is no button travel, and the highest height (the top of the blackboard) is the maximum travel of the keys. When the small ball enters the square and ensures that it is in the box for at least 100 milliseconds. The blackboard is cleared, and the user releases the key to enter the next operation. If the user does not make the ball enter the box within 2 seconds, the blackboard is cleared and the next operation is entered. Figure 10.

The auditory response operation in the attention training phase:

First of all, the user steps on a force travel module with his own feet, which can be operated by stepping on the pedal.

The auditory program contains about 20 cognitive tasks of different types and levels of difficulty. So that the training is carried out step by step. A low-difficulty cognitive task designed as the following example:

In the center of the blackboard, two columns of numbers are displayed first, the numbers '0'-'4' are from top to bottom, and the numbers '5'-'9' are from top to bottom. After displaying for 500ms, the numbers disappear. However, ten square boxes are continuously displayed in the original position of the blackboard. The speaker or speaker plays a number from '0'-'9' for 500 milliseconds, if it is one of '0'-'4'. Quickly step on the left foot pedal to make the small ball under the blackboard move vertically from bottom to top to the corresponding square. If it is one of '5'-'9'. Quickly step on the right foot pedal to make the small ball under the blackboard move vertically from bottom to top to the corresponding square. When the small ball enters the square and ensures that it is in the box for at least 100 milliseconds. The blackboard is cleared, and the user releases the pedal to proceed to the next operation. If the user does not make the ball enter the box within 2 seconds, the blackboard is cleared and the next operation is entered. Figure 11.

The visual and auditory attention training:

According to the attention test data analysis module results, according to the attention level results of 'poor', 'average', 'good', 'excellent' and 'superior', etc. The attention training programs are divided into five programs: 100, 80, 60, 40 and 20 times. Each training consists of 4 sub-training items, 2 sub-sections are visual training sub-items, 2 sub-sections are auditory training sub-items, arranged in the order of 'audio-visual-audio-visual', each section is 10 minutes, each section rests for about 5 minutes, one training session The time is about 1 hour. Figure 12.

There are still the following problems for various attention training or testing methods, especially the methods and systems for improving attention that use hand force as an operational control.

The first is the mechanism of information processing. Humans mainly use visual, auditory, tactile and olfactory pathways to perceive the world. Among them, the visual and auditory pathways receive and perceive information about 94%, and the sense of touch is about 4%. Therefore, visual and auditory is the main information processing pathway of human beings, and related research in brain science believes that visual and auditory functions are not independent, and the visual and auditory functions of healthy people are interconnected. According to the form of information processing pathway, it can be divided into visual and auditory single pathway processing or audio-visual mixed dual pathway processing. Therefore, attention to information is mainly reflected in the form of these three audio-visual sensory pathways. However, the cognitive function of the human brain is extremely complex, and the processing of information by humans in cognitive activities is not a single task or single information. External visual and auditory information can easily affect and interfere with the completion of a single cognitive task. Therefore, it is important to isolate the external audio-visual noise information and create an audio-visual scene related to the test to reflect the user's true attention level.

Secondly, in terms of operation control mechanism, force operation can activate tactile perception, but the magnitude of the force is not directly related to the degree of activation of tactile function. It's not that the greater the force, the greater the tactile perception. And for a period of time, monotonous operation of a single part of the limb can easily cause people to fall into fatigue, but will greatly affect the concentration. Therefore, such a design is not the best method for attention testing or attention training. However, the present invention innovatively proposes to use hand finger pressing and foot pedal as the operation control mode. The hand force is combined with the stroke caused by the operation, and the activation degree of the tactile perception of the force is amplified. Compared with the hand movement, the foot movement is more special. The foot completes the more precise force movement, which requires brain motor function control and related leg and foot muscles. Group coordination is higher. The present invention designs cognitive tasks under the visual and auditory channel, using appropriate force, under the action of force and pressure, the hand presses the button to complete a certain distance of stroke training, and the foot pedal is used to complete a certain distance of stroke movement. The operation of the hand and foot force and the resulting stroke movement require the coordination of maximum attention, that is, the precision of the operation of the hand and foot force leads to the precision of the stroke movement, and these precise operations and attention investment are positive related. The way this force is combined with hand and foot travel is consistent with tactile perception and maximizes the activation of tactile perception capabilities. In addition, the operation is in an audio-visual information processing environment. Under such conditions, the joint action of the three sensory pathways greatly increases the proportion of attention in the cognitive activity of the brain. Therefore, the interference and influence on attention from other cognitive activities simultaneously existing in the brain function are avoided, so that the attention ability in the present invention can be trained more efficiently.

Although this paper mostly uses the hand force travel acquisition module 1, the foot force travel acquisition module 2, the force travel AD conversion module 3, the force travel data processing module 4, the power supply module 5, the main control module 6, the hand-held body 1a, Button 1b, hand force and stroke variable voltage output mechanism 7, second resistance element 72, first resistance element 71, first spring 73, first connecting rod 74, second varistor conductive reed 75, base 2a, pedal 2b , the third resistance element 82, the second spring 84, the second connecting rod 85, the second varistor conductive reed 86, the connecting ring 87, the virtual reality visual and auditory cognitive task presentation module 9, the norm database module 10, the attention The terms test data analysis module 11 , report generation module 12 , attention training scheme generation module 13 , attention training process control module 14 and other terms are used, but the possibility of using other terms is not excluded. These terms are only used to describe and explain the essence of the present invention more conveniently, and it is contrary to the spirit of the present invention to interpret them as any kind of additional limitation.

Claims (10)

1. An immersive hand and foot mixing based attention training device, comprising: at least one hand power stroke collection module (1) and at least one foot power stroke collection module (2), hand power stroke collection module (1) and foot power stroke collection module (2) link to each other with power stroke AD conversion module (3) respectively, power stroke AD conversion module (3) link to each other with power stroke data processing module (4), hand power stroke collection module (1), power stroke AD conversion module (3) and power stroke data processing module (4) connect respectively in power module (5), power stroke data processing module (4) link to each other through wireless and/or wired communication mode with main control module (6) that built-in has attention measurement/training software.

2. The immersive hand and foot mixing-based attention training device according to claim 1, wherein the hand force stroke acquisition module (1) comprises a handheld body (1a), the handheld body (1a) is connected with at least one key (1b), each key (1b) is connected with a hand force stroke variable voltage output mechanism (7) arranged in the handheld body (1a), and when the key (1b) is operated, the output voltage of the hand force stroke variable voltage output mechanism (7) is changed along with the stroke of the key (1 b).

3. The immersive mixed hand and foot attention training device according to claim 2, wherein the foot force stroke acquisition module (2) comprises a base (2a), a pedal (2b) is hinged to the base (2a), the pedal (2b) is arranged obliquely, a foot force stroke variable voltage output mechanism (8) is arranged on the base (2a) and located below the upper end of the pedal (2b), the upper end of the pedal (2b) acts on the foot force stroke variable voltage output mechanism (8), and the output voltage of the foot force stroke variable voltage output mechanism (8) varies with the stroke of the pedal (2b) when the pedal (2b) is actuated.

4. The immersive hand and foot mixing-based attention training device according to claim 3, wherein the force stroke AD conversion module (3) comprises an analog-to-digital converter in Arduino based on Mega2560, mini or Nano architecture or an analog-to-digital converter in stm32 core circuit board, the force stroke AD conversion module (3) is used for converting the voltage-varying analog signals of the hand force stroke variable voltage output mechanism (7) and/or the foot force stroke variable voltage output mechanism (8) into digital signals, the analog-to-digital conversion precision is 10-16 bits, and the sampling rate is 500 Hz; the force stroke data processing module (4) carries out Kalman filtering on a current digital signal caused by voltage change, interference and noise signals in the acquisition process are removed, and the force stroke data are sent to the main control module (6) through a USB (universal serial bus) data line or a wireless Bluetooth protocol; the power supply module (5) is a 3.3-5V direct current power supply, and the power supply module (5) is an external direct current power supply or a USB interface connected to the main control module (6).

5. The immersive hands and feet mixing attention training device according to claim 1, 2, 3 or 4, wherein the main control module (6) comprises any one of a desktop computer, a notebook computer, a one-piece computer and a single-chip microcomputer, the main control module (6) is connected with a speaker or an earphone, and the main control module (6) is provided with or externally connected with any one of a display screen, a digital television screen, a one-piece computer screen and a flat screen.

6. The immersive hand-foot mixing-based attention training device of claim 4, wherein the number of the hand force stroke collecting modules (1) is two and the hand force stroke collecting modules are arranged in parallel, wherein one is used by a left hand and the other is used by a right hand.

7. The immersive hand and foot mixing-based attention training device according to claim 4, wherein the number of the foot force stroke acquisition modules (2) is two and the foot force stroke acquisition modules are arranged in parallel, wherein one foot force stroke acquisition module is used for the left foot and the other foot force stroke acquisition module is used for the right foot.

8. An immersive hand and foot mixing based attentiveness training system using the immersive hand and foot mixing based attentiveness training apparatus of any one of claims 1 to 7, wherein: the attention testing/training software comprises a virtual reality visual-auditory perception task presenting module (9), a normal mode database module (10), an attention testing data analysis module (11), a report generation module (12), an attention training scheme generation module (13), an attention training progress control module (14) and a main control module (6), wherein the main control module (6) is connected with the virtual reality visual-auditory perception task presenting module (9); the main control module (6) is connected with the output ends of the attention test data analysis module (11), the normal mode database module (10), the report generation module (12) and the force stroke data processing module (4); the main control module (6) is connected with the attention training scheme generation module (13) and the attention training process control module (14); the main control module (6) is connected with the output end of the force stroke data processing module (4); the normal mode database module (10), the attention test data analysis module (11), the report generation module (12) and the force stroke data processing module (4) are connected with each other; wherein,

the main control module (6) is configured to complete the flow control of visual and auditory cognitive tasks, the control of visual and auditory cognitive task presentation, the control of accessing a normal mode database module (10), the control of an attention test data analysis module (11) and the control of a report generation module (12);

the virtual reality visual-auditory cognitive task presentation module (9) is configured to complete immersive visual and auditory information presentation;

the attention test data analysis module (11) is configured to automatically analyze force travel data generated by the user foot operation hand force travel acquisition module (1) under the visual and auditory cognitive task environment, solve to obtain a series of attention reaction parameters, compare the parameters with age-identical sex data of the normal model database module (10), and solve attention level parameters of the user relative to the normal model data;

the report generation module (12) is configured to automatically display the attention level parameters of the user in a chart and text form, a word or PDF document according to a certain graph and text structure, and automatically further analyze and explain the meaning and the score condition of the main parameters;

the normative database module (10) is configured to store attention parameters collected and counted by an attention training device based on the hand power stroke of the visual and auditory roads for normal attention people;

the attention training scheme generation module (13) is configured to grade results according to attention levels according to results of the attention test data analysis module, and divide the attention training scheme into different schemes according to the grades;

the attention training process control module (14) is configured to realize the functions of saving a training scheme of a user, recording the condition of scheme development, recording the historical achievement of finished training and inquiring.

9. The immersive hands and feet mixing attention training system of claim 8, wherein the normative data in said normative database module (8) is divided by age and gender into a statistical data segment from 6 to 18 years per year; two years from age 19 to age 24 as a statistical data segment; every five years from 25 to 50 years is a statistical data segment; one statistical data segment from age 51 to age 60; one statistical data segment from age 61 and above; the total number of the comprehensive quotient (parameter) related to attention and control and the total quotient (parameter) of four attention and control related to the visual and auditory channels are included: four parameters of an auditory response control quotient, a visual response control quotient, an auditory attention quotient and a visual attention quotient; also included are a number of specific quotients (parameters) regarding the attention and control of the visual-auditory channels: the number of the auditory sense retention ability quotient, the number of the visual sense retention ability quotient, the number of the auditory sense velocity quotient, the number of the visual sense and auditory sense balance quotient, the number of the auditory sense response ability quotient, the number of the visual sense response ability quotient, the number of the auditory sense consistency quotient, the number of the auditory sense concentration quotient, the number of the visual sense concentration quotient, the number of the auditory sense resolving ability quotient, the number of the visual sense resolving ability quotient, and the standard difference parameter of the above-mentioned quotient.

10. The immersive hand-foot mixing based attention training system of claim 9, wherein said attention and control related parameters are obtained by weighted calculation based on auditory response control quotient, visual response control quotient, auditory attention quotient, and visual attention quotient; the specific quotient (parameter) is obtained by standardized calculation; the auditory response control quotient, the visual response control quotient, the auditory attention quotient, the visual attention quotient, the auditory retention capacity quotient, the visual retention capacity quotient, the auditory speed quotient, the visual-auditory balance quotient, the auditory response capacity quotient, the visual response capacity quotient, the auditory consistency quotient, the visual consistency quotient, the auditory attention concentration quotient, the visual attention concentration quotient, the auditory resolution capacity quotient and the visual resolution capacity quotient are respectively obtained by analyzing the data acquired by the hand power stroke acquisition module (1).

Images