CN110478593A - Brain electricity attention training system based on VR technology - Google Patents

Abstract

The present invention relates to the technical field of biomedical signal processing, specifically, an EEG attention training system based on VR technology and a method for using the same. The system includes an EEG acquisition module, a CPU module, a data storage module, and a visualized man-machine The interactive module and the EEG acquisition module are used to receive the response signal sent by the single-chip microcomputer in the CPU module, collect the data after receiving the response signal, and transmit the EEG signal collected from the scalp to the host computer through serial port communication , the data storage module is used for the collection information received by the host computer, and the attention value is shared with the dynamic link library. The form of indirect adjuvant treatment for patients will not cause tension, anxiety and other uneasy emotions, and can provide real-time feedback on the patient's attention training situation, providing a certain reference for subsequent clinical treatment.

Description

EEG attention training system based on VR technology

technical field

The invention relates to the technical field of biomedical signal processing, in particular, it is an EEG attention training system based on VR technology.

Background technique

Brain waves mainly reflect the activity of the human brain, and EEG signals contain a large amount of biological information, which is of great reference value for the study of human physical and mental health. At present, it has been applied to many fields such as automatic control and biomedicine. EEG signals change with the process of human brain recognizing objective things. When people feel different stimuli from outside the body, EEG (Electroencephalogram) signals can respond to them immediately, which provides a basis for feedback training treatment.

Brain-computer interface is a human-computer interaction mode that has emerged in recent years. It analyzes the collected EEG signals according to the corresponding needs and makes corresponding processing, and provides the connection between the user and the peripheral device, which is used for both The communication between the brain and the device realizes the interaction of information.

At present, the prevalence of attention deficit in children worldwide is about 3% to 6%, and 15% to 65% of childhood patients will continue their symptoms into adulthood.

Contents of the invention

The technical problem to be solved by the invention is how to train children with attention deficits more effectively and intuitively.

The present invention provides auxiliary training and treatment to patients from the perspective of auxiliary training, and designs a VR (Virtual Reality)-based EEG attention training system and its use method. The system can train patients to pay attention, and Collect and process EEG signals in real time, and dynamically display the value of attention in the interface.

The concrete technical scheme that the present invention adopts is as follows:

An EEG attention training system based on VR technology, the system includes an EEG acquisition module, a CPU module, a data storage module, a visualized human-computer interaction module, and the EEG acquisition module is used to receive responses from the single-chip microcomputer in the CPU module After receiving the response signal, the data is collected, and the EEG signal collected from the scalp is transmitted to the host computer through serial communication. The data storage module is used for the collected information received by the host computer, and the attention value is shared. In the dynamic link library, the visual human-computer interaction module is used for the interaction between Unity3D and the host computer, and the exploration of the underwater world scene is completed by reading the attention value in the dynamic link in real time.

The human-computer interaction module is divided into Unity3D software and host computer software interaction part and head-mounted VR glasses display part. Unity3D interacts with the upper computer software through the dynamic link library technology, and the attention value is written in the dynamic link library from the upper computer in real time, and then Unity3D reads it in real time. Control the scene of the underwater world. Head-mounted VR glasses are used to display the underwater world scene in Unity3D. Users are placed in the virtual underwater world scene, and according to the level of attention, they can explore the entire virtual scene and achieve the purpose of attention training.

As a further improvement of the present invention, the EEG acquisition module adopts an eight-lead EEG acquisition module, and the amplification acquisition chip adopts a highly integrated ADS1299 chip. Among them, the eight-lead self-made EEG signal acquisition module does not use traditional multiple differential amplifiers to amplify the signal. From the perspective of portability and integration, the present invention uses an integrated A/D conversion amplifier chip ADS1299 to adjust the EEG voltage. The acquisition is carried out. The chip is a 24-bit digital-to-analog converter, up to 8 low-noise programmable gain amplifiers, and can perform A/D conversion. The ATMEGA328P chip is used as the main control chip to control the acquisition of signals. The VR display device is a head-mounted display of HTCVIVE Company.

A further improvement of the present invention, the CPU module adopts the ATMEGA328P chip as the main control chip, and has 14 digital input/output pins (6 of which can be used for PWM output), 6 analog inputs, a 16MHz ceramic resonator, and a USB interface, a power socket, an ICSP header, and a reset button.

As a further improvement of the present invention, the data storage module adopts the technology of real-time data storage and dynamic link library sharing technology, and the collected EEG data are in the form of several groups, and are arranged sequentially according to the arrangement of one column as a group of lead columns It is recorded in a text file; the attention value is recorded and read in real time through the dynamic link library.

The present invention also discloses a method for using an EEG attention training system based on VR technology, comprising the following steps:

Step1: Put the sensor on the head of the measured part and wear the VR, the host computer sends a signal, wait for 8 seconds, during which the single-chip microcomputer controls the A/D conversion chip to collect and amplify the signal;

Step2: The host computer digitally filters the collected AD signal, estimates the power spectrum of the data, and calculates the attention value;

Step3: After the data processing is completed, the upper computer displays the measured attention value through the monitoring window, and writes it into the dynamic link library in real time so that Unity3D can call it;

Step4: Repeat Setp1-Setp3, the measured attention value will be continuously refreshed;

Step5: Open Unity3D and connect with the VR glasses. At this time, the value of attention is read from the dynamic link library in real time, and the interface shows that the subject is placed in the underwater world of the entire virtual environment. According to the degree of concentration, complete the pairing Exploration of the underwater world.

The attention index in the above steps uses the Gamma/Theta power ratio index. After filtering, the power spectrum is estimated, and the Gamma/Theta band power ratio quantized in the [0,100] range is selected as the attention index.

The calculation method of the Gamma/Theta band power ratio is as follows:

The frequency range of the Gamma band is above 30 Hz, which is selected as 30-60 Hz; the frequency range of the Theta band is 4-8 Hz, and the expression of the power ratio (R) between the two is:

Among them, Pgamma(i) and Ptheta(i) respectively represent the power of Gamma wave and Theta wave when the frequency is i;

The quantization algorithm is as follows:

Among them, MAX=100, MIN=0, the two are the upper and lower limits of quantization; R is the ratio of raw power; max and min are the upper and lower limits of experience, representing the normal range of the original power ratio, which form a mapping relationship with the upper and lower limits of quantization, and calculate Get the final attention value.

Beneficial effects of the present invention: the present invention can realize auxiliary rehabilitation training for attention-deficit patients, place patients in a virtual environment, and indirectly perform auxiliary treatment for patients in the form of exploration, without causing anxiety, anxiety, etc. emotions, and can provide real-time feedback on the patient's attention training, providing a certain reference for subsequent clinical treatment.

Description of drawings

Fig. 1 is a block diagram of the EEG attention training system of the present invention.

Fig. 2 is a flowchart of the acquisition software of the present invention.

Fig. 3 is a flowchart of the human-computer interaction of the present invention.

Detailed ways

In order to deepen the understanding of the present invention, the present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments, which are only used to explain the present invention and do not limit the protection scope of the present invention.

Embodiment: as shown in Figure 1, a kind of EEG attention training system based on VR technology, this system comprises EEG acquisition module, CPU module, data storage module, visualization human-computer interaction module, EEG acquisition module is used to receive The response signal sent by the single-chip microcomputer in the CPU module, after receiving the response signal, collects the data, and transmits the EEG signal collected from the scalp to the host computer through serial port communication, and the data storage module is used for the host computer to receive The collected information, the attention value is shared with the dynamic link library, the visual human-computer interaction module is used for the interaction between Unity3D and the host computer, and the exploration of the underwater world scene is completed by reading the attention value in the dynamic link in real time. The specific execution process of the system is to place the sensor on the head of the measured part and wait for 8 seconds, during which the single-chip microcomputer controls the data collection and transmission, and the electrical signal is converted into a binary signal through the AD conversion chip, and then sent to the host computer for voltage conversion and Filter, process the data, calculate the value of attention, and share the value of attention to the dynamic link library. At this time, read the shared attention value in Unity3d, and apply the attention to the rising or falling of the lens.

As shown in Figure 2, the data acquisition module and storage are processed as follows:

(1) Initialize the single-chip microcomputer, and the upper computer is ready to send a response character;

(2) After receiving the response signal, the single-chip microcomputer amplifies the collected signal through the A/D conversion chip of ADS1299, and transmits the collected binary data to the upper computer.

(3) The upper computer receives the data and converts it into a voltage signal, and filters it, and converts the attention value into the dynamic link library.

As shown in Figure 3, the visual human-computer interaction module performs the following processing:

(1) Start the human-computer interaction program and initialize it.

(2) Read the data in the shared dynamic link library, compare it with the built-in attention value, and the value corresponding to the range is reflected as the rise and fall of the character.

(3) The value of attention is displayed on the human-computer interaction interface in real time, and feedback is given in real time.

The specific usage method of this embodiment includes the following steps:

Step1: Put the sensor on the head of the measured part and wear the VR, the host computer sends a signal, wait for 8 seconds, during which the single-chip microcomputer controls the A/D conversion chip to collect and amplify the signal;

Step2: The host computer digitally filters the collected AD signal, estimates the power spectrum of the data, and calculates the attention value;

Step3: After the data processing is completed, the upper computer displays the measured attention value through the monitoring window, and writes it into the dynamic link library in real time so that Unity3D can call it;

Step4: Repeat Setp1-Setp3, the measured attention value will be continuously refreshed;

Step5: Open Unity3D and connect with the VR glasses. At this time, the value of attention is read from the dynamic link library in real time, and the interface shows that the subject is placed in the underwater world of the entire virtual environment. According to the degree of concentration, complete the pairing Exploration of the underwater world.

The attention index in the above steps uses the Gamma/Theta power ratio index. After filtering, the power spectrum is estimated, and the Gamma/Theta band power ratio quantized in the [0,100] range is selected as the attention index.

The calculation method of the Gamma/Theta band power ratio is as follows:

The frequency range of the Gamma band is above 30 Hz, which is selected as 30-60 Hz; the frequency range of the Theta band is 4-8 Hz, and the expression of the power ratio (R) between the two is:

Among them, Pgamma(i) and Ptheta(i) respectively represent the power of Gamma wave and Theta wave when the frequency is i;

The quantization algorithm is as follows:

Among them, MAX=100, MIN=0, the two are the upper and lower limits of quantization; R is the ratio of raw power; max and min are the upper and lower limits of experience, representing the normal range of the original power ratio, which form a mapping relationship with the upper and lower limits of quantization, and calculate Get the final attention value.

The basic principles, main features and advantages of the present invention have been shown and described above. Those skilled in the industry should understand that the present invention is not limited by the above-mentioned embodiments. What are described in the above-mentioned embodiments and the description only illustrate the principle of the present invention. Without departing from the spirit and scope of the present invention, the present invention will also have Variations and improvements are possible, which fall within the scope of the claimed invention. The protection scope of the present invention is defined by the appended claims and their equivalents.

Claims (7)

1. a kind of EEG attention training system based on VR technology, it is characterized in that, this system comprises EEG acquisition module, CPU module, data storage module, visualization human-computer interaction module, and described EEG acquisition module is used for receiving all The response signal sent by the single-chip microcomputer in the CPU module, data collection is carried out after receiving the response signal, and the EEG signal collected from the scalp is passed into the upper computer through serial port communication, and the data storage module is used for the upper computer. The collection information received by the machine will share the attention value with the dynamic link library. The visualized human-computer interaction module is used for the interaction between Unity3D and the host computer, and the seabed will be completed by reading the attention value in the dynamic link in real time. Exploration of the world scene. 2. the EEG attention training system based on VR technology according to claim 1, wherein said EEG acquisition module adopts eight-lead EEG acquisition module, and the amplification acquisition chip adopts highly integrated ADS1299 chip. 3. the brain electric attention training system based on VR technology according to claim 1, is characterized in that, described CPU module has adopted ATMEGA328P chip as main control chip. 4. the brain electric attention training system based on VR technology according to claim 1, is characterized in that, described data storage module adopts the technology of real-time storage data and dynamic link library sharing technology. 5. a method for using the EEG attention training system based on VR technology as described in any one of claim 1-4, it is characterized in that measurement and training comprise the following steps: Step1: Put the sensor on the head of the measured part and wear the VR, the host computer sends a signal, wait for 8 seconds, during which the single-chip microcomputer controls the A/D conversion chip to collect and amplify the signal; Step2: The host computer digitally filters the collected AD signal, estimates the power spectrum of the data, and calculates the attention value; Step3: After the data processing is completed, the upper computer displays the measured attention value through the monitoring window, and writes it into the dynamic link library in real time so that Unity3D can call it; Step4: Repeat Setp1-Setp3, the measured attention value will be continuously refreshed; Step5: Open Unity3D and connect with the VR glasses. At this time, the value of attention is read from the dynamic link library in real time, and the interface shows that the subject is placed in the underwater world of the entire virtual environment. According to the degree of concentration, complete the pairing Exploration of the underwater world. 6. the using method of a kind of EEG attention training system based on VR technology according to claim 5, is characterized in that, what the index of attention in the above-mentioned steps adopts is the power ratio index of Gamma/Theta, after filtering , to estimate the power spectrum, and select the Gamma/Theta band power ratio after quantization in the [0,100] range as the attention index. 7. the using method of a kind of EEG attention training system based on VR technology according to claim 6, is characterized in that, The calculation method of the Gamma/Theta band power ratio is as follows: The frequency range of the Gamma band is above 30 Hz, which is selected as 30-60 Hz; the frequency range of the Theta band is 4-8 Hz, and the expression of the power ratio (R) between the two is: Among them, Pgamma(i) and Ptheta(i) respectively represent the power of Gamma wave and Theta wave when the frequency is i; The quantization algorithm is as follows: Among them, MAX=100, MIN=0, the two are the upper and lower limits of quantization; R is the ratio of raw power; max and min are the upper and lower limits of experience, representing the normal range of the original power ratio, which form a mapping relationship with the upper and lower limits of quantization, and calculate Get the final attention value.