WO2019078323A1

WO2019078323A1 - Brain wave measurement system, brain wave measurement method, program, and non-transitory recording medium

Info

Publication number: WO2019078323A1
Application number: PCT/JP2018/038926
Authority: WO
Inventors: 洋介井澤; 幸治森川; 潤一牛場; 翔平土元; 美帆平本; 航平奥山
Original assignee: パナソニック株式会社; 学校法人慶應義塾
Priority date: 2017-10-20
Filing date: 2018-10-19
Publication date: 2019-04-25
Also published as: JP6888789B2; JPWO2019078323A1

Abstract

Provided are a brain wave measurement system, a brain wave measurement method, a program, and a non-transitory recording medium in which it is possible to suppress a reduction in the precision of brain wave measurement. This brain wave measurement system (10) comprises an acquisition unit (211), a memory (22), an input unit (216), and a processing unit (215). The acquisition unit (211) acquires brain wave information showing brain waves obtained by an electrode part (11) disposed in a measurement location, which is on a portion of the head (52) of a subject (5). The memory (22) stores a plurality of the brain wave information acquired by the acquisition unit (211). The input unit (216) receives, from an operation unit (24), a designation signal that designates one or more pieces of the brain wave information from among the plurality of brain wave information stored in the memory (22). The processing unit (215) executes a calibration process for determining a parameter for use in analyzing the brain wave information on the basis of the one or more pieces of brain wave information designated by the designation signal.

Description

Electroencephalogram measurement system, electroencephalogram measurement method, program, and non-temporary recording medium

The present disclosure relates generally to an electroencephalogram measurement system, an electroencephalogram measurement method, a program, and a non-temporary recording medium. More specifically, an electroencephalogram measurement system for acquiring electroencephalogram information representing an electroencephalogram collected by an electrode unit disposed at a measurement location which is a part of the subject's head, an electroencephalogram measurement method, a program, and nontemporary It relates to a recording medium.

Conventionally, techniques have been proposed that use brain wave information of a subject.

As an example, Patent Document 1 discloses a technique for estimating the listening experience of a music piece based on an electroencephalogram measured at the time of listening to the music piece in a subject (subject). In the technology described in Patent Document 1, the brain waves of a subject who is listening to music whose presence or absence of listening experience is unknown are measured to acquire brain wave information (subject brain wave data), and the first feature obtained from the brain wave information is The result of comparison with the model electroencephalogram pattern is used to estimate the presence or absence of music listening experience.

In Patent Document 1, parameters (model electroencephalogram patterns) used for analysis of electroencephalogram information are average powers calculated from the subject's brain waves at the time of listening to the known music and averages calculated from the subject's brain waves at the time of listening to the unknown music. It is determined based on the difference with the power.

However, in Patent Document 1, when any brain wave information used to determine a parameter includes, for example, an artifact (noise), a relatively large error occurs in the parameter, and the result is In some cases, the measurement accuracy of the electroencephalogram may be reduced.

JP, 2017-42562, A

The present disclosure has been made in view of the above, and it is an object of the present invention to provide an electroencephalogram measurement system, an electroencephalogram measurement method, a program, and a non-temporary recording medium capable of suppressing a decrease in the accuracy of electroencephalogram measurement.

An electroencephalogram measurement system according to an aspect of the present disclosure includes an acquisition unit, a storage unit, an input unit, and a processing unit. The acquisition unit acquires electroencephalogram information representing an electroencephalogram collected by an electrode unit disposed at a measurement location that is a part of the subject's head. The storage unit stores a plurality of the brain wave information acquired by the acquisition unit. The input unit receives, from the operation unit, a designation signal that designates one or more brain wave information items out of the plurality of brain wave information items stored in the storage unit. The processing unit executes a calibration process for determining a parameter used for analysis of the brain wave information based on the one or more brain wave information specified by the designation signal.

An electroencephalogram measurement method according to an aspect of the present disclosure acquires electroencephalogram information representing an electroencephalogram collected by an electrode unit disposed at a measurement location that is a part of the head of a subject, and stores a plurality of Store brain wave information. Furthermore, in the electroencephalogram measurement method, a designation signal for designating one or more pieces of brain wave information from among the plurality of pieces of brain wave information stored in the storage unit is received from the operation unit. Furthermore, in this electroencephalogram measurement method, calibration processing for determining parameters used for analysis of the electroencephalogram information is executed based on the one or more electroencephalogram information designated by the designation signal.

A program according to an aspect of the present disclosure is a program for causing a computer system to execute the electroencephalogram measurement method.

The non-temporary recording medium according to an aspect of the present disclosure is a computer system-readable non-temporary recording medium in which a program for causing the computer system to execute the electroencephalogram measurement method is recorded.

An electroencephalogram measurement system according to an aspect of the present disclosure includes a display control unit, an input unit, and a processing unit. The display control unit causes the display unit to display a plurality of brain wave information. The input unit receives, from the operation unit, a designation signal that designates one or more pieces of brain wave information from among the plurality of pieces of brain wave information. The processing unit executes a calibration process for determining a parameter used for analysis of the brain wave information based on the one or more brain wave information specified by the designation signal.

FIG. 1 is a schematic view showing a state of use of an electroencephalogram measurement system according to a first embodiment and a rehabilitation support system including the same. FIG. 2 is a schematic front view showing the use state of the headset of the above-mentioned electroencephalogram measurement system. FIG. 3 is a block diagram showing the configuration of the above-mentioned electroencephalogram measurement system and rehabilitation support system. FIG. 4 is an explanatory view showing an example of a training screen of the above-mentioned electroencephalogram measurement system. FIG. 5 is an explanatory view showing an example of a setting screen of the above-mentioned electroencephalogram measurement system. FIG. 6 is a graph for explaining the method of determining the threshold for the activation level of the above-mentioned electroencephalogram measurement system. FIG. 7 is an explanatory view showing an example of a calibration screen of the above-mentioned electroencephalogram measurement system. FIG. 8 is an explanatory view showing an example of a selection screen of the above-mentioned electroencephalogram measurement system. FIG. 9 is an explanatory view showing an example of a calibration result screen of the above-mentioned electroencephalogram measurement system. FIG. 10 is a flowchart showing a calibration process of the above-mentioned electroencephalogram measurement system.

(Embodiment 1)
(1) Overview An overview of an electroencephalogram measurement system 10 according to the present embodiment will be described with reference to FIGS. 1 and 2.

The electroencephalogram measurement system 10 according to the present embodiment is a system for measuring the electroencephalogram of the subject 5, and the electrode unit 11 disposed at a measurement point 51 which is a part of the head 52 of the subject 5 Brain wave information representing the collected brain waves is acquired. The term “electroencephalogram (EEG)” as referred to in the present disclosure means a waveform obtained by extruding an electrical signal (action potential) emitted from a cerebral nerve cell (group) and recording it. In the present disclosure, unless otherwise noted, an on-scalp electroencephalogram that records general action potentials of a large number of neuron groups (neural networks) in the cerebral cortex using the electrode unit 11 attached to the body surface. Is called "brain wave".

The electroencephalogram measurement system 10 includes a headset 1 having an electrode unit 11 and an information processing device 2. The headset 1 is mounted on the head 52 of the subject 5 with the electrode unit 11 in contact with the surface (scalp) of the head 52 of the subject 5. In the present disclosure, the electrode unit 11 contacts the surface of the head 52 by being placed on the paste (electrode paste) applied to the surface of the head 52. At this time, the electrode unit 11 contacts the surface of the head 52 without the hair by scraping the hair. Of course, the electrode unit 11 may be in direct contact with the surface of the head 52 without applying a paste. That is, in the present disclosure, “contacting the electrode unit 11 with the surface of the head 52” refers to bringing the electrode unit 11 into contact with the surface of the head 52 directly or through an intermediate. Indirect contact with the surface of the head 52 is also included. The intermediate is not limited to the paste, and may be, for example, a gel having conductivity.

The headset 1 measures the brain waves of the subject 5 by measuring the action potential of the brain of the subject 5 with the electrode unit 11, and generates brain wave information representing the brain waves. The headset 1 transmits brain wave information to the information processing apparatus 2 by wireless communication, for example. The information processing apparatus 2 performs various processes on the electroencephalogram information acquired from the headset 1 and displays the electroencephalogram information.

In the present embodiment, a case where the electroencephalogram measurement system 10 is used for a rehabilitation support system 100 for supporting the rehabilitation of the subject 5 will be described. That is, the rehabilitation support system 100 includes the electroencephalogram measurement system 10 according to the present embodiment. The rehabilitation support system 100 further includes an exercise assisting device 3 and a control device 4. The exercise assisting device 3 is a device that assists the exercise of the subject 5 by adding at least one of a mechanical stimulation and an electrical stimulation to the subject 5. The control device 4 controls the exercise assistance device 3 based on the electroencephalogram information acquired by the electroencephalogram measurement system 10.

The rehabilitation support system 100 supports rehabilitation by exercise therapy, with a person who has exercise paralysis or a decrease in motor function or the like in a part of the body as a subject 5, for example, by a brain disease such as a stroke or an accident. In such a subject 5, a voluntary movement (voluntary movement), which is a movement performed by the subject 5 based on the intention or intention of the subject 5, may not be satisfactory due to the inability or the deterioration of its function. The “exercise therapy” referred to in the present disclosure is a disorder caused by exercising the inability part of such a voluntary exercise or a part where a decrease in function has occurred (hereinafter referred to as “disability site”) in the body of the subject 5 It means a method to restore the function of voluntary movement for the part.

In the present embodiment, a case where the rehabilitation support system 100 is used for rehabilitation of the left finger 53 (left finger) of the subject 5 is exemplified. That is, in the target person 5 in this case, the left finger is the failure site. However, the present invention is not limited to this example, and the rehabilitation support system 100 may be used, for example, for rehabilitation of the right finger of the subject 5.

In the rehabilitation support system 100, when the subject 5 performs a voluntary exercise with the left finger 53, mechanical stimulation and electricity are applied to the left hand of the subject 5 with the exercise assisting device 3 attached to the left hand of the subject 5. Support voluntary exercise by adding at least one of Thus, for example, in the same manner as in the case where a medical staff such as a physical therapist or occupational therapist holds the finger 53 of the subject 5 to assist the voluntary exercise of the subject 5, the rehabilitation support system 100 performs voluntary exercise Assistance of Therefore, according to the rehabilitation support system 100, as in the case where the medical staff assists, rehabilitation by exercise therapy can be realized more effectively than when the subject 5 performs voluntary exercise alone.

By the way, in order to support the above-mentioned rehabilitation, the rehabilitation support system 100 can support the voluntary exercise of the subject 5 with the exercise assisting device 3 when the subject 5 tries to do voluntary exercise. desirable. The rehabilitation support system 100 links the exercise assistance device 3 to the brain waves (brain wave information) of the subject 5 measured by the brain wave measurement system 10, thereby providing exercise assistance when the subject 5 performs voluntary exercise. The assistance of the voluntary movement in the device 3 is realized. In other words, the rehabilitation support system 100 uses a brain-machine interface (BMI) technology to operate a machine (exercise assistance device 3) using brain activity (brain waves) to exercise Realize rehabilitation by therapy.

When the subject 5 performs a voluntary exercise (that is, in the process of the subject 5 performing a voluntary exercise), characteristic changes in the electroencephalogram may occur. That is, when the subject 5 intends to perform voluntary exercise, activation of a brain region corresponding to a site targeted for voluntary exercise may occur. An example of such a brain region is the somatosensory motor cortex. A more effective rehabilitation can be expected if the exercise assist device 3 assists the voluntary exercise of the subject 5 according to the timing at which such activation of the brain region occurs. Such activation of the brain region can be detected as a characteristic change of the electroencephalogram. Therefore, the rehabilitation support system 100 executes the assistance of the voluntary exercise of the subject 5 with the exercise assistance device 3 in accordance with the timing at which this characteristic change occurs in the electroencephalogram of the subject 5. Such characteristic changes of the electroencephalogram may occur when the subject 5 images voluntary exercise (that is, while attempting to exercise) even if the voluntary exercise is not actually performed. That is, such characteristic changes of the electroencephalogram can be activated if the corresponding brain region is activated by the intention of the subject 5 to perform the voluntary exercise, even though the voluntary movement is not actually performed. It can occur. Therefore, even for the subject 5 in a state in which voluntary exercise is impossible, the rehabilitation support system 100 can support voluntary exercise.

According to the rehabilitation support system 100 having such a configuration, it is possible to realize effective rehabilitation by exercise therapy in the target person 5 while reducing the burden on the medical staff. Moreover, according to the rehabilitation support system 100, for example, there is no variation in the timing of assisting voluntary exercise due to human factors such as the skill of the medical staff who assists the voluntary exercise of the subject 5, and the variation of the effect of rehabilitation Is reduced. In particular, in the rehabilitation support system 100, the voluntary movement of the subject 5 can be assisted at the timing at which the characteristic change in the electroencephalogram (that is, the timing at which the brain region was actually activated). As described above, in the rehabilitation support system 100, since training can be performed according to the timing of brain activity, contribution to learning and establishment of correct brain activity can be expected. In particular, it is difficult for the subject 5 and the medical staff alone to determine whether or not a characteristic change has occurred in the electroencephalogram. Therefore, by using the rehabilitation support system 100, effective rehabilitation that is difficult to realize only by the target person 5 or the medical staff is possible.

In the present embodiment, when the target person 5 uses the rehabilitation support system 100, medical staff such as a physical therapist or occupational therapist accompany the target person 5, and the medical staff performs the operation of the rehabilitation support system 100, etc. Suppose that. However, it is not essential for the medical staff to accompany the target person 5 who uses the rehabilitation support system 100. For example, the target person 5 or a family of the target person 5 may operate the rehabilitation support system 100.

By the way, the electroencephalogram measurement system 10 according to the present embodiment occurs in the rehabilitation support system 100 described above when the subject 5 performs a voluntary exercise (that is, may occur when the subject 5 intends to perform a voluntary exercise) ) It is used to detect electroencephalograms that contain characteristic changes. Specifically, the electroencephalogram measurement system 10, as described in the section "(2) Rehabilitation support system", changes in intensity of a specific frequency band that occurs in the electroencephalogram due to occurrence of event-related desynchronization (ERD). , As a characteristic change. The “event-related desynchronization” in the present disclosure means a phenomenon in which the power of a specific frequency band decreases in an electroencephalogram measured in the vicinity of the motor area during voluntary exercise (including recall of voluntary exercise). In the present disclosure, “at the time of voluntary exercise” means a process from the intention of the subject 5 to voluntary exercise (recollection) to the success or failure of the voluntary exercise. The "event-related desynchronization" can occur at the time of this voluntary movement, triggered by the intention (recollection) of the voluntary movement. Frequency bands in which the power decreases due to event-related desynchronization are mainly α waves (for example, a frequency band of 8 Hz to less than 13 Hz) and β waves (for example, a frequency band of 13 Hz to less than 30 Hz).

However, the frequency band in which the power decreases due to event-related desynchronization, and the amount of reduction of power are not uniform, and, for example, the attributes of the subject 5 (such as age and gender), the failure site, the status of the failure, and individual differences It fluctuates with the like. Therefore, the electroencephalogram to be detected by the electroencephalogram measurement system 10 (an electroencephalogram including characteristic changes that may occur when the subject 5 intends to perform a voluntary exercise) is not uniformly determined, and various subjects 5 vary. It can take a form. Therefore, the electroencephalogram measurement system 10 is configured to perform analysis of electroencephalogram information, that is, calibration processing for determining various parameters used to detect an electroencephalogram to be detected.

Here, if an artifact is included in the electroencephalogram information, a reduction in measurement accuracy of the electroencephalogram may occur. The “artifact” in the present disclosure means a phenomenon other than the electroencephalogram mixed in the electroencephalogram information acquired by the electroencephalogram measurement system 10 and is a noise component to the electroencephalogram. Examples of artifacts mixed in brain wave information include components resulting from eye movement such as blinks, and components resulting from body movement such as tooth biting or neck movement, and expression muscle movement. If calibration processing is performed using electroencephalogram information mixed with this type of artifact, calibration processing will be performed in a state in which the measurement accuracy of the electroencephalogram is lowered due to the artifact, and the accuracy of the parameter is lowered. Do. Therefore, in order to determine the parameters with high accuracy, it is preferable that the electroencephalogram measurement system 10 execute the calibration process using the electroencephalogram information that does not include an artifact.

The electroencephalogram measurement system 10 according to the present embodiment has a function of determining the presence or absence of an artifact based on the electroencephalogram information acquired from the electrode unit 11 and outputting the determination result. Examples of the output mode of the determination result include display, voice output, printout (printing), writing to a non-temporary recording medium, and transmission to an information terminal. Therefore, the presence or absence of an artifact can be determined based on the output determination result. For example, by excluding the brain wave information mixed with the artifact, it is possible to suppress a decrease in the accuracy of the brain wave measurement due to the artifact. As described above, in the electroencephalogram measurement system 10, a calibration process using only electroencephalogram information not including an artifact becomes possible by outputting a determination result of the presence or absence of an artifact. Thereby, in the electroencephalogram measurement system 10, the processing load of the processing unit 215 that executes the calibration processing can be reduced.

(2) Rehabilitation Support System Hereinafter, the rehabilitation support system 100 according to the present embodiment will be described in more detail.

As shown in FIG. 1, the rehabilitation support system 100 includes an electroencephalogram measurement system 10, an exercise assisting device 3, and a control device 4.

As described above, in the present embodiment, the electroencephalogram measurement system 10 includes the headset 1 and the information processing device 2.

The headset 1 is mounted on the head 52 of the subject 5 as shown in FIG. The headset 1 has an electrode portion 11. The electrode unit 11 is disposed at a measurement point 51 which is a part of the head 52 of the subject 5. Specifically, in the state in which the electrode unit 11 is in contact with the measurement portion 51 set on a part of the surface (scalp) of the head 52 of the subject 5, the headset 1 5. Measure the electroencephalogram of 5 and generate electroencephalogram information representing the electroencephalogram.

The information processing apparatus 2 mainly includes, for example, a computer system such as a personal computer. The information processing device 2 receives brain wave information from the headset 1 by wireless communication, for example, and executes various processes on the brain wave information. In the present embodiment, the information processing apparatus 2 performs detection of an electroencephalogram including a characteristic change that may occur when the subject 5 intends to perform voluntary exercise (remembering), a calibration process, and the like.

When the subject 5 intends to perform a voluntary exercise (remembering), an electroencephalogram including a characteristic change is usually generated in an exercise area corresponding to a site where the voluntary exercise of the body is to be performed. Therefore, the electroencephalogram measurement system 10 measures an electroencephalogram collected from the vicinity of the motor area corresponding to the injury site that is the target of rehabilitation. Here, the motor area corresponding to the left finger is on the right side of the brain, and the motor area corresponding to the right finger is on the left side of the brain. Therefore, in the case where the left finger 53 of the subject 5 is targeted for rehabilitation as in the present embodiment, an electroencephalogram acquired by the electrode unit 11 brought into contact with the right side of the head 52 of the subject 5 is It becomes the measurement object in the electroencephalogram measurement system 10. That is, the electrode part 11 is arrange | positioned on the measurement location 51 which consists of a part of right side surface of the head 52 of the subject 5 as shown in FIG. As an example, the electrode portion 11 is disposed at a position represented by the electrode symbol "C4" in the international 10-20 method. When the right finger of the subject 5 is targeted for rehabilitation, the measurement site consisting of a part of the left surface of the head 52 of the subject 5, for example, the electrode symbol "C3" in the international 10-20 method The electrode part 11 is arrange | positioned in the position represented.

The electroencephalogram measurement system 10 outputs a control signal for controlling the exercise assisting device 3 when it detects an electroencephalogram including a characteristic change that may occur when the subject 5 intends to perform a voluntary exercise. That is, the rehabilitation support system 100 is triggered by the detection of an electroencephalogram including characteristic changes that may occur when the subject 5 intends to perform voluntary exercise, as a trigger for the exercise assisting device 3. A control signal for control is generated. Thereby, in the rehabilitation support system 100, it is possible to assist the voluntary exercise of the subject 5 with the exercise assisting device 3 in accordance with the voluntary exercise of the subject 5. The electroencephalogram measurement system 10 will be described in detail in the section “(3) electroencephalogram measurement system”.

The exercise assisting device 3 is a device that assists the exercise of the subject 5 by adding at least one of a mechanical stimulation and an electrical stimulation to the subject 5. In the present embodiment, since the rehabilitation support system 100 is used for rehabilitation of the left finger of the subject 5, the exercise assisting apparatus 3 is mounted on the left hand of the subject 5 as shown in FIG.

In the present embodiment, a case where the rehabilitation support system 100 is used for the rehabilitation of the grasping motion and the extension motion by the left finger of the subject 5 is exemplified. The “gripping operation” in the present disclosure means an operation of holding an object. That is, in the subject 5, the left finger is the injury site, and the rehabilitation support system 100 is used for the rehabilitation of the voluntary movement of the grasping motion and the extension motion by the left finger. However, in reality, the rehabilitation support system 100 indirectly assists in the rehabilitation of the grasping motion by assisting the extension motion of the finger of the subject 5, instead of directly assisting the grasping motion of the subject 5. Do. The “extension operation” in the present disclosure is a state in which the hand is held open by the extension of four fingers 53 (second to fifth fingers) except the first finger (thumb), that is, in a state of being grasped by a grasping operation. It means the action of releasing the "thing".

Therefore, in the rehabilitation support system 100, when the subject 5 performs the extension motion as a voluntary exercise, the exercise assisting device 3 attached to the left hand of the subject 5 mechanically stimulates the left finger 53 of the subject 5 And at least one of electrical stimulation and electrical stimulation to assist voluntary movement. Specifically, as shown in FIG. 3, the exercise assisting device 3 includes a finger driving device 31 and an electrical stimulation generating device 32.

The finger driving device 31 holds four fingers 53 (second to fifth fingers) except the first finger (thumb) and applies mechanical stimulation (external force) to the four fingers 53. , Is a device to move the four fingers 53. The finger driving device 31 includes, for example, a power source such as a motor or a solenoid, and moves the four fingers 53 by transmitting the force generated by the power source to the four fingers 53. In the finger driving device 31, an “opening operation” for moving the held four fingers 53 in a direction away from the first finger (that is, extending operation) and a movement (in other words, a gripping operation) for approaching the first finger “ Two types of operations are possible: a closing operation. The opening operation of the finger driving device 31 assists the extension operation of the subject 5, and the closing operation of the finger driving device 31 assists the gripping operation of the subject 5.

The electrical stimulation generator 32 is a device that applies an electrical stimulation to a site for moving the finger 53 of the subject 5. Here, the site for moving the finger 53 of the subject 5 includes a site corresponding to at least one of the muscle and the nerve of the finger 53 of the subject 5. For example, the part for moving the finger 53 of the subject 5 is a part of the arm of the subject 5. The electrical stimulation generator 32 includes, for example, a pad attached to the body (for example, an arm) of the subject 5. The electrical stimulation generator 32 stimulates a site for moving the finger 53 by applying an electrical stimulation (electric current) to the body of the subject 5 from the pad.

The control device 4 controls the exercise assistance device 3 based on the electroencephalogram information acquired by the electroencephalogram measurement system 10. In the present embodiment, the control device 4 is electrically connected to the information processing device 2 of the electroencephalogram measurement system 10 and the exercise assisting device 3. The control device 4 is connected to a power cable for supplying operation power for the exercise assisting device 3 and the control device 4. The control device 4 includes a drive circuit for driving the finger drive device 31 of the exercise assisting device 3 and an oscillation circuit for driving the electrical stimulation generator 32. The control device 4 receives a control signal from the information processing device 2 by, for example, wired communication.

When the control device 4 receives the first control signal from the information processing device 2, the drive circuit drives the finger drive device 31 of the exercise assisting device 3 and the finger drive device 31 performs an “open operation”. Control the exercise assisting device 3; Further, when the control device 4 receives the second control signal from the information processing device 2, the drive circuit drives the finger drive device 31 of the exercise assisting device 3 and the finger drive device 31 performs the “closing operation”. Control the exercise assistance device 3 to be controlled. In addition, when the control device 4 receives the third control signal from the information processing device 2, the control device 4 drives the electric stimulation generator 32 of the exercise assisting device 3 by the oscillation circuit, and the body of the subject 5 is electrically stimulated. The exercise assist device 3 is controlled to be given.

As described above, the control device 4 controls the exercise assistance device 3 based on the control signal output from the electroencephalogram measurement system 10 to thereby provide the exercise assistance device based on the electroencephalogram information acquired by the electroencephalogram measurement system 10. It is possible to control three. In addition, the control device 4 controls the exercise assisting device 3 so that the “opening operation” and the “closing operation” are performed by the finger drive device 31 according to the operation of the operation switch provided in the control device 4 You can also.

Next, how to use the rehabilitation support system 100 will be described. In the present embodiment, from the posture in which the subject 5 holds the peg 101 (see FIG. 1) with the left finger, the voluntary movement (extension movement) at the time of releasing the peg 101 by the extension movement of the fingers 53 is shown in FIG. The case where assistance is given by will be described.

First, as a preparation process, the subject 5 wears the headset 1 on the head 52 and wears the exercise assisting device 3 on the left hand. At this time, the headset 1 is attached to the head 52 of the subject 5 so that at least the electrode portion 11 is in contact with a part of the right side surface of the head 52 of the subject 5 to be the measurement point 51. The exercise assisting device 3 holds at least four fingers 53 (second to fifth fingers) except the first finger (thumb) of the left hand of the subject 5 and sticks the pad to the arm of the subject 5 It is worn on the subject 5 in a state of The headset 1 and the exercise assisting device 3 are appropriately fixed so as not to be displaced or detached during rehabilitation. In the preparation process, the four fingers 53 of the object person 5 are held by the finger driving device 31 of the exercise assisting device 3, whereby the posture in which the object person 5 holds the peg 101 with the left hand finger is maintained. . The work of attaching the headset 1 and the exercise assisting device 3 to the subject 5 may be performed by the subject 5 itself or by medical staff.

When the preparation is completed and the headset 1 and the information processing apparatus 2 can communicate with each other, electroencephalogram information generated by the headset 1 can be acquired by the information processing apparatus 2. That is, the electroencephalogram measurement system 10 acquires electroencephalogram information representing an electroencephalogram collected by the electrode unit 11 disposed at the measurement location 51 which is a part of the head 52 of the subject 5 by the information processing apparatus 2. be able to. Although described in detail in the section “(3) Electroencephalogram measurement system”, the information processing apparatus 2 stores (accumulates) the acquired electroencephalogram information in the memory 22 (see FIG. 3) in time series. Furthermore, the information processing device 2 generates a power spectrum of an electroencephalogram, for example, by performing time frequency analysis on the stored electroencephalogram information. The electroencephalogram measurement system 10 is capable of detecting electroencephalograms including characteristic changes that may occur when the subject 5 tries to perform voluntary exercise by constantly monitoring power spectrum data in the information processing apparatus 2. Become.

Here, before the subject 5 starts the rehabilitation, the electroencephalogram measurement system 10 executes a calibration process for determining various parameters used for detection of the electroencephalogram to be detected. As a result, the electroencephalogram measurement system 10 improves the detection accuracy of the electroencephalogram to be detected, taking into consideration the frequency band in which the power decreases due to event-related desynchronization and the variation for each subject 5 such as the power reduction amount. Can be The calibration process will be described in detail in the section "(3) electroencephalogram measurement system".

After completing the preparation process including the calibration process, the rehabilitation support system 100 starts a training process to support the rehabilitation of the subject 5. In the training process, rehabilitation of the subject 5 is supported based on the electroencephalogram measured by the electroencephalogram measurement system 10 during the training time. Specifically, the training time is divided into a resting period and an exercise period, and the subject 5 performs rehabilitation according to the instruction of the rehabilitation support system 100 in each of the resting period and the exercise period. In this embodiment, as an example, it is assumed that the training time is "10 seconds", and the first half "5 seconds" when the training time is equally divided is the resting period and the second half "5 seconds" is the exercise period. Do.

During the resting period, the subject 5 puts the body in a resting state, that is, does not intend to perform voluntary exercise (reminding), and maintains a relaxed state. At this time, the electroencephalogram measurement system 10 does not detect an electroencephalogram including a characteristic change due to event-related desynchronization which may occur when the subject 5 intends to perform voluntary exercise.

On the other hand, in the exercise period, the subject 5 intends to perform extension movement of the fingers 53, that is, to perform a voluntary exercise. At this time, the electroencephalogram measurement system 10 can detect an electroencephalogram including a characteristic change due to event-related desynchronization that can occur when the subject 5 intends to perform a voluntary exercise. In the present embodiment, the characteristic change of the electroencephalogram is detected by comparing the activation level with the threshold and detecting whether the activation level exceeds the threshold. The “activation level” in the present disclosure is a value representing a decrease in power (power spectrum) of a specific frequency band. Since the activation level exceeds the threshold by the occurrence of event-related desynchronization and the power of the specific frequency band decreases, the electroencephalogram measurement system 10 changes the characteristic of the electroencephalogram by the activation level exceeding the threshold. To detect

In the electroencephalogram measurement system 10, a control signal for controlling the exercise assisting device 3 is generated, triggered by detection of an electroencephalogram including such characteristic changes. Therefore, in the rehabilitation support system 100, when the subject 5 intends to perform a voluntary exercise, the exercise assisting device is adjusted to the timing at which the activation of the brain region corresponding to the region targeted for the voluntary exercise actually occurs. At 3, it is possible to assist the subject 5's voluntary movement.

The operation of the electroencephalogram measurement system 10 in the training process will be described in detail in the section “(3) electroencephalogram measurement system”.

(3) Electroencephalogram Measurement System (3.1) Configuration Hereinafter, the electroencephalogram measurement system 10 according to the present embodiment will be described in more detail.

As shown in FIG. 3, the electroencephalogram measurement system 10 includes a headset 1 mounted on the head 52 of the subject 5 and an information processing apparatus 2 mainly composed of a computer system such as a personal computer. .

The headset 1 includes an electrode unit 11, a signal processing unit 12, and a first communication unit 13. The headset 1 is, for example, battery-powered, and power for operation of the signal processing unit 12 and the first communication unit 13 is supplied from the battery.

The electrode unit 11 is an electrode for collecting the brain wave (brain wave signal) of the subject 5 and is, for example, a silver-silver chloride electrode. The electrode portion 11 may be gold, silver, platinum or the like. The electrode unit 11 has a first electrode 111 and a second electrode 112. In the present embodiment, as shown in FIG. 2, the measurement point 51 set on the surface of the head 52 of the subject 5 includes a first measurement point 511 and a second measurement point 512. The first electrode 111 is an electrode corresponding to the first measurement point 511, and is disposed on the first measurement point 511. The second electrode 112 is an electrode corresponding to the second measurement point 512, and is disposed on the second measurement point 512. Specifically, the first measurement point 511 and the second measurement point 512 are the first measurement point 511, the second measurement point 511 from the middle center side (upper side) on the line connecting the middle center of the head 52 and the right ear. The measurement points 512 are arranged in order.

Further, in the present embodiment, the headset 1 further includes the reference electrode 113 and the ground electrode 114. The reference electrode 113 is an electrode for measuring a reference potential of an electroencephalogram signal measured by each of the first electrode 111 and the second electrode 112. The reference electrode 113 is disposed at a rear position of either the right ear or the left ear on the head 52. Specifically, the reference electrode 113 is disposed at the head 52 at a position behind the ear on which the first electrode 111 and the second electrode 112 are disposed. In the present embodiment, since the first electrode 111 and the second electrode 112 are disposed on the right surface of the head 52, the reference electrode 113 is disposed at the rear position of the right ear. The earth electrode 114 is disposed at the rear of the right ear or the left ear of the head 52 where the reference electrode 113 is not disposed. In the present embodiment, since the reference electrode 113 is disposed at the rear position of the right ear, the ground electrode 114 is disposed at the rear position of the left ear. Each of the reference electrode 113 and the ground electrode 114 is electrically connected to the main body 15 of the headset 1 by the electric wire 16 (see FIG. 2), and is attached to the surface (scalp) of the head 52. The position where the reference electrode 113 and the ground electrode 114 are disposed may be the earlobe instead of the position behind the ear as described above. The posterior position of the ear and the earlobe are places in the head that are less susceptible to biopotentials from brain activity. That is, it is preferable that the reference electrode 113 and the ground electrode 114 be disposed at a position on the head that is not easily influenced by bioelectric potential derived from brain activity.

The signal processing unit 12 is electrically connected to the electrode unit 11, the reference electrode 113, and the earth electrode 114, and performs signal processing on an electroencephalogram signal (electric signal) input from the electrode unit 11, Generate That is, the headset 1 measures the brain waves of the subject 5 by measuring the action potential of the brain of the subject 5 by the electrode unit 11, and generates the brain wave information representing the brain waves by the signal processing unit 12. The signal processing unit 12 includes at least an amplifier for amplifying an electroencephalogram signal and an A / D converter for A / D conversion, and outputs an electroencephalogram signal in digital form after amplification as electroencephalogram information.

The first communication unit 13 has a communication function with the information processing device 2. The first communication unit 13 transmits at least the electroencephalogram information generated by the signal processing unit 12 to the information processing device 2. In the present embodiment, the first communication unit 13 can communicate bi-directionally with the information processing apparatus 2. The communication method of the first communication unit 13 is, for example, wireless communication compliant with Bluetooth (registered trademark) or the like. From the first communication unit 13, electroencephalogram information is transmitted to the information processing device 2 as needed.

The information processing apparatus 2 mainly includes a computer system including a processor 21 and a memory 22. The information processing apparatus 2 further includes a second communication unit 23, an operation unit 24, a third communication unit 25, and a display unit 26.

The second communication unit 23 has a communication function with the headset 1 (first communication unit 13). The second communication unit 23 receives at least brain wave information from the headset 1. In the present embodiment, the second communication unit 23 can communicate bi-directionally with the headset 1. For example, as an example, the second communication unit 23 receives brain wave information sampled at a sampling frequency of about 200 Hz from the headset 1 as needed.

The third communication unit 25 has a communication function with the control device 4. The third communication unit 25 transmits at least a control signal to the control device 4. The communication method of the third communication unit 25 is, for example, wired communication conforming to USB (Universal Serial Bus).

In the present embodiment, the information processing apparatus 2 includes a touch panel display, and the touch panel display functions as the operation unit 24 and the display unit 26. Therefore, in the information processing apparatus 2, when the operation unit 24 detects an operation (tap, swipe, drag, etc.) of an object such as a button on each screen displayed on the display unit 26, an object such as a button is displayed. Judge that it has been operated. That is, in addition to various displays, the operation unit 24 and the display unit 26 function as a user interface that receives operation input from the subject 5 or medical staff. However, the operation unit 24 is not limited to the touch panel display, and may be, for example, a keyboard, a pointing device, or a mechanical switch.

The processor 21 has functions of an acquisition unit 211, an analysis unit 212, a detection unit 213, a determination unit 214, a processing unit 215, an input unit 216, an output unit 217, a display control unit 218, a selection unit 219, a presentation unit 220, and a deletion unit 221. have. The processor 21 executes the program stored in the memory 22 to obtain the acquisition unit 211, the analysis unit 212, the detection unit 213, the determination unit 214, the processing unit 215, the input unit 216, the output unit 217, and the display control unit 218. Function is realized. Similarly, when the processor 21 executes the program stored in the memory 22, the functions of the selection unit 219, the presentation unit 220, and the deletion unit 221 are realized.

The acquisition unit 211 acquires electroencephalogram information representing an electroencephalogram collected by the electrode unit 11 disposed at the measurement point 51 which is a part of the head 52 of the subject 5. That is, the acquisition unit 211 acquires brain wave information representing brain waves collected by the electrode unit 11 of the headset 1 from the headset 1 via the second communication unit 23. Here, the acquisition unit 211 acquires first brain wave information representing the brain waves collected by the first electrode 111 and second brain wave information representing the brain waves collected by the second electrode 112. That is, in the present embodiment, since the electrode unit 11 includes the first electrode 111 and the second electrode 112, in the acquisition unit 211, the electroencephalogram information collected by the first electrode 111 is the first electroencephalogram information, the second electrode The brain wave information collected at 112 is distinguished as second brain wave information. In the present embodiment, the acquisition unit 211 acquires brain wave information in digital form, and stores the acquired brain wave information in the memory 22. At this time, the memory 22 stores time-series data of electroencephalogram information measured by the electroencephalogram measurement system 10 from the start to the end of the training time. The memory 22 can store a plurality of brain wave information. That is, the memory 22 functions as a storage unit that stores a plurality of brain wave information acquired by the acquisition unit 211.

The analysis unit 212 analyzes the electroencephalogram information acquired by the acquisition unit 211. The analysis unit 212 performs frequency analysis of brain wave information stored in the memory 22 and generates spectrum data indicating signal strength for each frequency band. Specifically, the analysis unit 212 reads out the electroencephalogram information stored in the memory 22 for a predetermined time, and performs frequency analysis such as short-time Fourier transform (STFT), for example. Thereby, power of each frequency band is calculated for an electroencephalogram signal that changes with time. "Power" in the present disclosure is an integrated value of intensities (spectral intensities) for each frequency band.

The detection unit 213 detects an electroencephalogram including a characteristic change that may occur when the subject 5 intends to perform a voluntary exercise based on the power of each frequency band analyzed by the analysis unit 212. Specifically, the detection unit 213 determines the presence or absence of an electroencephalogram including a characteristic change depending on whether the power of the specific frequency band is in the resting range or the motion range. The “resting area” referred to in the present disclosure is the brain wave of the subject 5 when the subject 5 is in a resting state, that is, does not intend to perform voluntary exercise (remembering) and maintains a relaxed state. It means the range that the power of the specific frequency band of can take. The “movement range” in the present disclosure means a range in which the power of a specific frequency band of the electroencephalogram can be taken when the subject 5 intends to perform a voluntary exercise. That is, the detection unit 213 generates an electroencephalogram including a characteristic change that may occur when the subject 5 intends to perform voluntary exercise when the power of the specific frequency band transitions from the resting range to the exercise range. I will judge.

More specifically, in the present embodiment, as an example, the detection unit 213 first calculates an activation level representing a decrease in power of a specific frequency band from the power of each frequency band analyzed by the analysis unit 212. Then, the detection unit 213 compares the calculated activation level with the threshold stored in the memory 22, and determines that the characteristic change of the electroencephalogram has occurred when the activation level exceeds the threshold. That is, the threshold for the activation level is a value corresponding to the boundary line (straight line Lth1) between the resting range A1 and the motion range A2 in the graph representing the power of the specific frequency band (see FIG. 6). Therefore, event-related desynchronization occurs and the power of a particular frequency band decreases, and when the power of a particular frequency band transitions from the resting range to the motion range, the activation level exceeds the threshold. Although the details will be described in the section of “(3.3) Calibration process”, the threshold is set in the calibration process.

The determination unit 214 determines the presence or absence of an artifact based on the brain wave information acquired by the acquisition unit 211. Since the artifact is a noise component to the electroencephalogram as described above, when the determination unit 214 determines that the artifact is included, the measurement accuracy of the electroencephalogram may be degraded. The operation of the determination unit 214 will be described in detail in the section “(3.3) Calibration process”.

The processing unit 215 executes a calibration process for determining parameters used for analysis of electroencephalogram information. That is, in the processing unit 215, calibration processing for determining various parameters including at least a threshold for the activation level is performed. The calibration process by the processing unit 215 is performed prior to the training process. The processing unit 215 stores various parameters determined in the calibration process in the memory 22.

The input unit 216 receives, from the operation unit 24, a designation signal for designating one or more brain wave information to be used for the calibration process among the plurality of brain wave information stored in the memory 22. That is, in the calibration process, one or more brain wave information designated by the designation signal among the plurality of brain wave information stored in the memory 22 is used. In other words, the designation signal received by the input unit 216 from the operation unit 24 is a signal for designating one or more brain wave information to be used for calibration processing among a plurality of brain wave information stored in the memory 22. is there.

Furthermore, the input unit 216 has a function of executing a re-designation process of accepting a designation signal after the processing unit 215 executes the calibration process. Then, the processing unit 215 has a function to execute the calibration processing again based on the one or more brain wave information designated by the designation signal received by the input unit 216 in the redesignation processing. That is, the processing unit 215 is configured to be able to repeatedly execute the calibration process a plurality of times. The input unit 216 is configured to be able to receive the designation signal in the re-designating process before the start of the “N + 1” -th calibration process after the “N” -th calibration process ends (N is a natural number) . The re-designation process will be described in detail in the section “(3.4) Re-designation process”.

In addition, the acquisition unit 211 performs additional processing to further acquire brain wave information and add it to the memory 22 in a period from when the processing unit 215 executes calibration processing until the input unit 216 executes re-designation processing. It has a function to execute. That is, when the processing unit 215 repeatedly executes the calibration process a plurality of times, the acquiring unit 211 additionally acquires brain wave information and adds it to the memory 22 before the input unit 216 executes the re-designating process. Processing is configured to be executable. Therefore, after the end of the “N” -th calibration process, in a period before the start of the “N + 1” -th calibration process, the brain wave information is added to the memory 22 by the additional process of the acquisition unit 211, and then the input unit 216 A designation signal can be received in the re-designation process of. The addition process will be described in detail in the section “(3.3) Calibration process”.

The output unit 217 outputs the determination result of the determination unit 214. That is, when the determination unit 214 determines the presence or absence of an artifact, the determination result is output from the output unit 217. Examples of the output mode of the determination result by the output unit 217 include display, voice output, printout (printing), writing to a non-temporary recording medium, and transmission to an information terminal. In the present embodiment, the output unit 217 outputs the determination result to the display control unit 218 so that the determination result is displayed on the display unit 26.

The display control unit 218 causes the display unit 26 to display a plurality of brain wave information stored in the memory 22. Further, the display control unit 218 causes the display unit 26 to display the determination result output by the output unit 217. The display control unit 218 has a function of controlling the display unit 26, and can display various contents on the display unit 26. The display control unit 218 causes the display unit 26 to display at least the plurality of brain wave information stored in the memory 22 and the determination result of the determination unit 214.

The selection unit 219 receives a selection signal from the operation unit 24 after the processing unit 215 executes the calibration process until the input unit 216 executes the re-designation process. The “selection signal” in the present disclosure is a signal for selecting whether or not to execute the additional process by the acquisition unit 211. That is, the acquisition unit 211 does not necessarily execute the addition process before the execution of the re-designation process, and whether or not the acquisition unit 211 performs the addition process can be selected by the selection signal. Therefore, only when the execution of the additional processing is selected in the selection processing, the additional processing by the acquiring unit 211 is executed before the execution of the re-designation processing.

The presentation unit 220 presents the result of the calibration process. That is, when the calibration process is performed in the processing unit 215, the result is presented from the presentation unit 220. Examples of modes of presentation by the presentation unit 220 include display, audio output, printout (printing), writing to a non-temporary recording medium, and transmission to an information terminal. In the present embodiment, the presentation unit 220 outputs the result of the calibration process to the display control unit 218 such that the result of the calibration process is displayed on the display unit 26.

The deletion unit 221 deletes at least one brain wave information from among the plurality of brain wave information stored in the memory 22. Specifically, the deletion unit 221 deletes (deletes) at least one electroencephalogram information not designated by the designation signal received by the input unit 216 from the storage area of the electroencephalogram information in the memory 22.

(3.2) Training Process Next, the operation of the electroencephalogram measurement system 10 in the training process will be described in detail.

In the training process, the operation mode of the rehabilitation support system 100 is a training mode. If the operation mode of the rehabilitation support system 100 is in the training mode, for example, a training screen 200 as shown in FIG. 4 is displayed on the display unit 26 of the information processing device 2. In the example of FIG. 4, the dashed-dotted line indicating the region and the reference numeral are only shown for the sake of explanation, and in fact, the dashed-dotted line and the reference numeral are not displayed on the display unit 26.

The training screen 200 includes an activation level display area G1, an electroencephalogram display area G2, a training start button G3, a brace operation button G4, a count display area G5, a sensing state display area G6, an apparatus state display area G7, a status display area G8 and an end. It has a button G9. The training screen 200 further includes an operation guide area G10, a check box G11, a training information output button G12, a history button G13, and a setting button G14.

The activation level display area G1 is an area for displaying a graph of the activation level. The activation level graph displays a waveform representing a time change of the activation level, with the horizontal axis representing time (seconds) and the vertical axis representing the activation level. In the activation level display area G1, a straight line L1 represents a threshold (a set value). Further, in a period in which the activation level exceeds the threshold, a band of judgment marks M1 is displayed above the graph of the activation level. Also, the background color of the activation level graph may be different between the resting period (0-5 seconds period) in the first half of the training time and the exercise period (5-10 seconds period) in the second half of the training time preferable.

The electroencephalogram display area G2 is an area for displaying the electroencephalogram measured by the headset 1. The brain waves in the brain wave display area G2 are displayed in real time according to the brain wave information transmitted from the headset 1 to the information processing device 2. The graph of the electroencephalogram has a horizontal axis representing time (seconds) and a vertical axis representing potential, and displays a waveform representing time change of the electroencephalogram.

The training start button G3 is a button for starting training. By the training start button G3 being tapped, the training by the rehabilitation support system 100 is started, and the measurement of the electroencephalogram in the electroencephalogram measurement system 10 is started.

The brace operation button G4 is a button for operating the exercise assisting device 3. By tapping the device operation button G4, a control signal is output from the electroencephalogram measurement system 10, and the closing operation or the opening operation of the exercise assisting apparatus 3 is performed. Here, text information such as "apparatus closed" or "apparatus open" is displayed on the appliance operation button G4. When the brace operation button G4 is tapped in a state in which "the brace is closed", the closing operation of the exercise assisting device 3 is performed, and the brace operation button G4 is tapped in a state in which "the brace is opened" Then, the opening operation of the exercise assisting device 3 is performed.

The number display area G5 is an area for displaying the number of successes and the number of trials. In the present disclosure, the “number of successes” refers to an exercise period of training time in which an electroencephalogram measurement system 10 includes characteristic changes due to event-related desynchronization that may occur when the subject 5 intends to perform voluntary exercise. This is the number of times detected inside. The “number of trials” in the present disclosure is the number of times training is performed by the rehabilitation support system 100.

The sensing state display area G6 is an area for displaying the sensing state of the electroencephalogram. In the present embodiment, the electroencephalogram measurement system 10 measures, for each of the first electrode 111 and the second electrode 112, an impedance value with respect to the body (scalp) of the subject 5 according to the measured impedance value. It is judged whether the sensing state is good or bad. In the example of FIG. 4, a text display of an impedance value (“80 or more in FIG. 4”) and a marker display indicating the quality of the sensing state of each of the first electrode 111 and the second electrode 112 are displayed in the sensing state display area G6. , Has been done. Specifically, depending on whether the sensing state of each of the first electrode 111 and the second electrode 112 is good or bad, for example, the color of the marker on the illustration imitating the head of a person changes.

The device state display area G7 is an area for displaying the state of each device in the rehabilitation support system 100. In the device state display area G7, for example, the state of connection of the information processing device 2 to the headset 1, the state of the remaining battery capacity of the headset 1, and the like are displayed as icons such as “o” or “x”.

The status display area G8 is an area for displaying the identification information (subject ID) and name of the subject 5 and the identification information (examiner ID) and name of the medical staff. Further, in the status display area G8, a target icon G81 indicating “rehabilitation target”, that is, whether the target of rehabilitation is “left hand” or “right hand” is further displayed. In the example of FIG. 4, the target icon G <b> 81 indicates in text information that the target of rehabilitation is the “left hand”.

The end button G9 is a button for ending the training. By tapping the end button G9, the training by the rehabilitation support system 100 ends, and the measurement of the electroencephalogram in the electroencephalogram measurement system 10 ends.

The operation guide area G10 is an area for displaying text information for guiding the operation of the rehabilitation support system 100. In the example of FIG. 4, text information “Please press the [Start training] button to start trial” is displayed in the operation guide area G10. The display content of the operation guide area G10 changes in accordance with the operation state of the rehabilitation support system 100.

The check box G11 is an icon for switching whether to display an electroencephalogram in the electroencephalogram display area G2. By tapping the check box G11, a state in which an electroencephalogram is displayed in the electroencephalogram display area G2 and a state in which the electroencephalogram is not displayed are alternately switched. In the state where the display of the check box G11 is active, the electroencephalogram is displayed in the electroencephalogram display area G2.

The training information output button G12 is a button for outputting training information including the result of rehabilitation. By tapping the training information output button G12, training information is output in a desired manner. Examples of the output mode of the training information include display, voice output, printout (printing), writing to a non-temporary recording medium, and transmission to an information terminal.

The history button G13 is a button for referring to the history of training information including the result of rehabilitation. By tapping the history button G13, the screen displayed on the display unit 26 of the information processing device 2 changes from the training screen 200 to the history reference screen. The history reference screen displays at least the result of rehabilitation performed by the subject 5 in the past.

The setting button G14 is a button for shifting the operation mode of the rehabilitation support system 100 to a setting mode for performing various settings regarding the rehabilitation support system 100. By tapping the setting button G14, the screen displayed on the display unit 26 of the information processing device 2 changes from the training screen 200 to a setting screen 201 described later (see FIG. 5).

In the training process, in a state where the training screen 200 as described above is displayed on the display unit 26 of the information processing device 2, the subject person 5 performs rehabilitation. That is, when the training start button G3 is tapped, training by the rehabilitation support system 100 is started.

At the start of training, counting of training time starts, and the electroencephalogram measurement system 10 measures the brain waves of the subject 5. Then, in a resting period (a period of 0 to 5 seconds) in the first half of the training time, the subject 5 puts the body in a resting state in accordance with the display of the operation guide area G10 or the instruction of the medical staff. At this time, the activation level and the electroencephalogram are displayed on the training screen 200 in real time. However, in the resting period, the electroencephalogram measurement system 10 does not compare the activation level with the threshold, and does not detect the electroencephalogram including the characteristic change due to the event-related desynchronization.

On the other hand, in the second exercise period of the training time (period of 5 to 10 seconds), the subject 5 performs the extension operation of the fingers 53, that is, the voluntary exercise according to the display of the operation guide region G10 or the instruction of the medical staff. Make an attempt (remembering) to try. At this time, the activation level and the electroencephalogram are displayed on the training screen 200 in real time. Furthermore, during the exercise period, the electroencephalogram measurement system 10 compares the activation level with the threshold to detect an electroencephalogram including a characteristic change due to event-related desynchronization. Here, when the activation level exceeds the threshold (see the straight line L1 in FIG. 4) due to the occurrence of event-related desynchronization, a band-shaped judgment mark M1 is displayed above the graph of the activation level in the training screen 200. .

More specifically, the electroencephalogram measurement system 10 analyzes the electroencephalogram information acquired by the acquisition unit 211 at an analysis unit 212 as needed. Furthermore, the electroencephalogram measurement system 10 calculates the activation level in the detection unit 213 based on the power of each frequency band analyzed by the analysis unit 212, and compares the activation level with the threshold. In the electroencephalogram measurement system 10, it is determined that the activation level exceeds the threshold when the event related desynchronization occurs and the power of the specific frequency band decreases and the power of the specific frequency band transitions from the resting range to the exercise range Be done.

Here, the specific frequency band may be a single frequency band (as an example, a band of α waves or a band of β waves), or a plurality of frequency bands (as an example, a band of α waves and a band of β waves) It may be If the specific frequency band is, for example, two frequency bands, the activation level exceeds the threshold value when the coordinate value defined by the power of these two frequency bands transitions from the resting range to the motion range .

Moreover, in the present embodiment, the electroencephalogram measurement system 10 has a function of measuring the duration of the state in which the activation level exceeds the threshold. In the training screen 200 illustrated in FIG. 4, the length of the determination mark M1 corresponds to the length of the duration. The electroencephalogram measurement system 10 transmits a third control signal to the exercise assistance device 3 when the activation level rises (changes) to a value exceeding the threshold value from the value below the threshold value. Furthermore, when the duration time reaches a prescribed time (for example, “1 second”), the electroencephalogram measurement system 10 transmits a first control signal to the exercise assistance device 3.

From the above, when the activation level exceeds the threshold value, the electrical stimulation generator 32 of the motion assist device 3 is driven, and the motion assist device 3 applies an electrical stimulus to the body of the subject 5, The voluntary movement (extension movement) of the subject 5 is assisted. Furthermore, when the state where the activation level exceeds the threshold continues for a prescribed time, the finger drive device 31 of the exercise assisting device 3 is driven, and the movement assisting device 3 performs the “opening operation” of the finger drive device 31. Thus, the voluntary movement (extension movement) of the subject 5 is assisted.

As a result, when the subject 5 intends to perform voluntary exercise (remembering), according to the timing at which activation of the brain region corresponding to the site to be subjected to voluntary exercise actually occurs, Thus, the voluntary movement of the subject 5 (the extension operation of the left finger 53) is assisted. At this time, the muscles and sensory nerves of the subject 5 are activated, and the information is transmitted to the brain, whereby the nerves are reconstructed and the effect of rehabilitation is obtained. Therefore, according to the rehabilitation support system 100, for the subject 5 in various states, exercise therapy is more effective than in the case where the subject 5 performs voluntary exercise alone, as in the case where medical staff assists. It is possible to realize rehabilitation.

By the way, when the operation mode of the rehabilitation support system 100 is in the setting mode, the setting screen 201 as shown in FIG. 5 is displayed on the display unit 26 of the information processing device 2. In the example of FIG. 5, the dashed-dotted line indicating the region and the reference numeral are only shown for the sake of explanation, and in fact, the dashed-dotted line and the reference numeral are not displayed on the display unit 26.

The setting screen 201 includes first to fifth setting areas G21 to G25 and an update button G26 in addition to the sensing state display area G6, the apparatus state display area G7, the status display area G8 and the end button G9 similar to the training screen 200. It contains.

In the first setting area G21, a slide bar for adjusting the intensity (neurostimulation level) of the electrical stimulation by the electrical stimulation generator 32 is displayed. In the second setting area G22, a slide bar for adjusting the volume is displayed. In the third setting area G23, a slide bar for adjusting a threshold for the activation level is displayed. In the fourth setting area G24, an upper slide bar G27 for adjusting the operation speed of the finger drive device 31 and a lower slide bar G28 for adjusting the movable range of the finger drive device 31 are displayed.

In the fifth setting area G25, a slide bar for setting a prescribed time is displayed. The “specified time” referred to in the present disclosure is a time for determining whether or not the extension operation of the subject 5 is assisted by the opening operation of the finger drive device 31 and is 1.0 seconds by default as an example. It is set. The electroencephalogram measurement system 10 outputs the first control signal to drive the finger drive device 31 when the activation level exceeds the threshold value for a prescribed time period.

Here, with respect to the movable range of the finger drive device 31, an "open angle" defining the end point of the opening operation and a "closing angle" defining the end point of the closing operation can be set individually. Specifically, the lower slide bar G28 includes a first slider G281 for adjusting the opening angle and a second slider G282 for adjusting the closing angle. Furthermore, the display color (for example, light blue) of the first slider G281, the illustration indicating the action of the opening operation and the text information indicating the opening angle is set so that the movable range of the finger drive 31 can be sensibly adjusted. It is unified. Similarly, the display color (for example, red) is unified in the second slider G282 and the illustration indicating the action of the closing operation and the text information indicating the closing angle.

The update button G26 is a button for shifting the operation mode of the rehabilitation support system 100 to the training mode. By tapping the update button G26, the screen displayed on the display unit 26 of the information processing device 2 changes from the setting screen 201 to the training screen 200. At this time, various setting values set on the setting screen 201 are written to the memory 22, and the setting values are updated.

(3.3) Calibration Process Next, the operation of the electroencephalogram measurement system 10 in the calibration process performed in the preparation process prior to the training process will be described in detail.

(3.3.1) Outline of Process The calibration process is performed when the operation mode of the rehabilitation support system 100 is the calibration mode. The calibration process is a process for determining various parameters including at least a threshold for the activation level. That is, as described above, the frequency band in which the power decreases due to event-related desynchronization, and the reduction amount of the power are, for example, the attributes of the subject 5 (such as age and gender), the failure site, the failure status, and the individual. It fluctuates by the difference etc. Therefore, in the electroencephalogram measurement system 10, in order to enhance the detection accuracy of the electroencephalogram to be detected, various parameters used for analysis of the electroencephalogram information are determined for each subject 5 in the calibration process.

The calibration process is performed by the electroencephalogram measurement system 10 according to the measurement process of actually measuring the electroencephalogram of the subject 5 in the same procedure as the training course, and various kinds of adjustment based on the measured electroencephalogram. Calculation processing in which the parameter is determined.

In the measurement process, as in the training time, a calibration time divided into a resting period and an exercise period is set, and an electroencephalogram is measured by the electroencephalogram measurement system 10 during this calibration time. The subject 5 performs rehabilitation according to the instruction of the rehabilitation support system 100 in each of the resting period and the exercise period in the calibration time. In this embodiment, as an example, the calibration time is "10 seconds", and the first half "5 seconds" when the calibration time is divided into two is the resting period, and the second half "5 seconds" is the exercise period. Suppose.

That is, in the resting period, the subject 5 puts the body in a resting state, that is, does not intend to perform voluntary exercise (reminds), and maintains a relaxed state. On the other hand, in the exercise period, the subject 5 intends to perform extension movement of the fingers 53, that is, to perform a voluntary exercise. The electroencephalogram measurement system 10 measures the brain waves of the subject 5 in both the resting period and the exercise period. The electroencephalogram measurement system 10 stores the electroencephalogram information measured during the calibration time (rest period and exercise period) in the memory 22 as a record. That is, the “record” in the present disclosure is time-series data of electroencephalogram information measured by the electroencephalogram measurement system 10 during the measurement process from the start to the end of the calibration time. However, in the calibration time of the measurement process, unlike the training process, the electroencephalogram measurement system 10 does not perform the process of detecting the characteristic change of the electroencephalogram.

Here, the electroencephalogram measurement system 10 can perform the above-described measurement process multiple times in the calibration process. The memory 22 can store a plurality of records with a predetermined number (for example, “30”) as an upper limit. Thus, at the end of one or more measurement processes, the memory 22 stores one or more records representing the electroencephalogram of the subject 5 in the resting period and the exercise period.

In the calculation process, various parameters tailored to the object person 5 are determined using one or more records stored in the memory 22 in one or more measurement processes. Specifically, the electroencephalogram measurement system 10 analyzes the electroencephalogram information acquired by the acquisition unit 211 at any time by the analysis unit 212, and based on the power for each frequency band analyzed by the analysis unit 212, various parameters Decide. The parameters determined at this time include at least a threshold for the activation level, and frequency bands of each of the alpha wave and the beta wave.

Here, it is not essential that one or more records stored in the memory 22 be all used to determine various parameters. For example, when five records are stored in the memory 22, at least one of the five records may be used for calculation processing for determining a parameter. Therefore, in the present embodiment, as described above, the input unit 216 uses the operation unit 24 to designate a designation signal that designates one or more brain wave information (record) from among the plurality of brain wave information stored in the memory 22. Accept. Then, the processing unit 215 executes calibration processing for determining a parameter used for analysis of brain wave information based on one or more brain wave information (record) specified by the designation signal. As a result, which one of the one or more records stored in the memory 22 is used for the calculation process is specified by the subject 5 or the medical staff.

Below, the method of determining the threshold for the activation level is briefly described with reference to FIG. FIG. 6 is a graph in which the powers of the resting period and the exercise period are plotted for a plurality of (five in this example) records, focusing on two frequency bands of α wave and β wave. In FIG. 6, the horizontal axis represents the power of the alpha wave, and the vertical axis represents the power of the beta wave, and representative values (for example, average values) of power in the resting period are indicated by "o". For example, the average value is indicated by "x" mark. In FIG. 6, it is assumed that the frequency bands of the alpha wave and the beta wave in the subject 5 have already been determined.

That is, in FIG. 6, the range in which the “o” mark exists is the resting range A1 and the range in which the “x” mark exists corresponds to the movement range A2 for the two frequency bands of the α wave and the β wave. As described above, the electroencephalogram measurement system 10 includes an electroencephalogram including a characteristic change that may occur when the subject 5 tries to perform voluntary exercise when the power of a specific frequency band transitions from the resting range to the exercise range. It is judged that Therefore, the boundary line (straight line Lth1) between the resting range A1 and the motion range A2 in FIG. 6 corresponds to the threshold value for the activation level. Thus, the threshold for the activation level can be determined based on one or more records measured in the measurement process.

Various parameters determined by the calibration process are stored in the memory 22. In the subsequent training course, the rehabilitation support system 100 uses various parameters determined in the calibration process. Further, in the third setting area G23 of the setting screen 201 (see FIG. 5), as described above, it is possible to adjust the threshold with respect to the activation level with the slide bar. However, on the setting screen 201, the threshold determined in the calibration processing is only adjusted to shift in the positive direction or the negative direction, and the threshold serving as the reference is determined in the calibration processing.

The method of determining the threshold is not limited to the method described above, and various methods such as Linear Discriminant Analysis (LDA) or Support Vector Machine (SVM) can be applied.

(3.3.2) Description of Screen Next, regarding the screen displayed on the display unit 26 of the information processing device 2 at the time of the calibration process, a screen displayed on the display unit 26 of the information processing device 2 is shown in FIG. This will be described with reference to FIG. In the example of FIGS. 7 to 9, the dashed-dotted line indicating the region and the reference numeral are only shown for the sake of explanation, and in fact, the dashed-dotted line and the reference numeral are not displayed on the display unit 26.

That is, in the calibration process, first, during the measurement process, a calibration screen 202 as shown in, for example, FIG. 7 is displayed on the display unit 26 of the information processing device 2. When the measurement process ends, for example, a selection screen 203 as shown in FIG. 8 is displayed on the display unit 26 of the information processing device 2. In the selection screen 203, a record to be used for the calculation process is selected. When the calculation process is completed, a calibration result screen 204 as shown in FIG. 9, for example, is displayed on the display unit 26 of the information processing device 2.

The calibration screen 202 is, as shown in FIG. 7, an activation level display area G1, an electroencephalogram display area G2, a frequency display area G5, a sensing state display area G6, an apparatus state display area G7, and a status display similar to the training screen 200. A region G8 and an end button G9 are included. Furthermore, the calibration screen 202 includes a measurement start button G31, a transition button G32, and a back button G33 in addition to the operation guide area G10 and the check box G11 similar to the training screen 200. The activation level display area G1 of the calibration screen 202 is basically the same as the training screen 200, but differs from the training screen 200 in that the respective graphs of the alpha wave and the beta wave are displayed. Moreover, although the frequency | count display area G5 of the calibration screen 202 is fundamentally the same as the training screen 200, it differs from the training screen 200 by the point in which "the number of successes" is not displayed.

In the activation level display area G1 of the calibration screen 202, a graph of the activation level for the alpha wave and a graph of the activation level for the beta wave are simultaneously displayed. However, as the graph of the α wave and the graph of the β wave can be distinguished, the display mode (for example, display color) is different between the graph of the α wave and the graph of the β wave. Further, in the calibration process, since the threshold for the activation level is not set yet, the activation level display area G1 does not display the straight line L1 representing the threshold (set value), and the graph above the activation level is displayed. The judgment mark M1 is not displayed either. The background color of the activation level graph may be different between the resting period (0-5 seconds period) in the first half of the calibration time and the resting period (5-10 seconds period) in the second half of the calibration time preferable.

The measurement start button G31 is a button for starting the measurement process. Measurement of the electroencephalogram in the electroencephalogram measurement system 10 is started by tapping the measurement start button G31.

The transition button G32 is a button for shifting to calculation processing. By tapping the transition button G32, the electroencephalogram measurement system 10 ends the measurement processing, and the screen displayed on the display unit 26 of the information processing device 2 changes from the calibration screen 202 to the selection screen 203 (see FIG. 8). Transition.

The return button G33 is a button for returning the electroencephalogram measurement system 10 to the state before the start of the calibration process. By tapping the back button G33, the electroencephalogram measurement system 10 ends the calibration process, and returns to the state before the start of the calibration process.

As shown in FIG. 8, the selection screen 203 includes a record display area G41, an operation guide area G42, a legend display area G43, a follow button G44, a selection number display area G45, and a calculation button G46.

The record display area G41 is an area for displaying an electroencephalogram stored in the memory 22 as a record. Here, in the graph of the electroencephalogram in the record display area G41, similarly to the electroencephalogram display area G2, the horizontal axis represents time (seconds) and the vertical axis represents potential, and a waveform representing time change of the electroencephalogram is displayed. In the example of FIG. 8, electroencephalograms are vertically arranged and displayed for a plurality of (two in this case) records stored in the memory 22. Furthermore, in the record display area G41, a check box G411 is displayed on the right side of the electroencephalogram of each record in association with the record. The check box G411 is an icon for selecting a record used for the calculation process. By tapping the check box G411, the state where the corresponding record is used for the calculation process and the state where it is not used are alternately switched. In the state where the display of the check box G411 is active, the corresponding record is used for the calculation process.

Here, when the number of records displayed in the record display area G41 is large and the list can not be displayed, the records displayed in the record display area G41 can be scrolled in the vertical direction. As a result, a large number of records can be displayed in the record display area G41 beyond the number that can be displayed in a list in the record display area G41.

By the way, below the electroencephalogram of each record in the record display area G41, a band-shaped artifact mark M2 is displayed corresponding to each record. The artifact mark M2 is displayed only in a period in which it is determined that brain wave information includes an artifact. As described above, since the electroencephalogram measurement system 10 according to the present embodiment has a function (determination unit 214) for determining whether or not an artifact is included in the electroencephalogram information, the determination result in the determination unit 214 is an artifact mark It will be reflected in M2.

That is, there is a high possibility that an artifact is included in the brain wave information in a period in which the artifact mark M2 is displayed for certain brain wave information, and an artifact is included in the brain wave information in a period in which the artifact mark M2 is not displayed. There is a high possibility that In the electroencephalogram measurement system 10 according to the present embodiment, by displaying such an artifact mark M2 in the record display area G41, it is possible to easily select a record to be used for calculation processing from among records not including an artifact. Become. That is, when the object person 5 or the medical staff selects the record to be used for the calculation process in the check box G411, only the record not including the artifact mark is selected by selecting only the record in which the artifact mark M2 is not displayed. It can be selected. As a result, it is possible to accurately determine the parameters by using the electroencephalogram information which does not include an artifact.

At this time, in the input unit 216, the target person 5 or the medical staff receives from the operation unit 24 a designation signal representing the record selected in the check box G411. That is, the target person 5 or the medical staff selects the record to be used for the calculation process in the check box G411, and is used for the calibration process (calculation process) from among the plurality of electroencephalogram information acquired by the acquisition unit 211. One or more brain wave information is specified.

The operation guide area G42 is an area for displaying text information for guiding the operation of the electroencephalogram measurement system 10. In the example in Fig. 8, select "Select the waveform to be used for analysis. Select two or more and press" Calculation "to display the calculation result here. The waveform which has been deselected can be redone. If you want to try again, the text information "Please try again" is displayed. The display content of the operation guide area G42 changes in accordance with the operation state of the electroencephalogram measurement system 10.

The legend display area G43 is an area for displaying the description of the display mode of the artifact mark M2. The electroencephalogram measurement system 10 according to the present embodiment has a function of further determining the type of artifact if it is determined that there is an artifact as well as the presence or absence of an artifact. Then, the display mode of the artifact mark M2 differs depending on the type of the determined artifact. The types of artifacts include at least an artifact caused by eye movement (hereinafter also referred to as "eye-derived artifact") and an artifact caused by body movement / expression muscle movement (hereinafter referred to as "body movement-derived artifact" There are two types: The display aspect (for example, display color) of artifact mark M2 differs in the artifact derived from eyeballs and the artifact derived from body movement. Therefore, in the legend display area G43, these two types of display modes are displayed together with their respective descriptions.

The retry button G44 is a button for starting a retry. The “retry” in the present disclosure is a process of adding a record by performing the measurement process again. That is, each time the retrial is performed, the measurement process is performed again, and the acquisition unit 211 performs an additional process of further acquiring brain wave information and adding it to the memory 22. By tapping the retry button G44, the transition from the selection screen 203 to the calibration screen 202 is made.

The selection number display area G45 is an area for displaying the number of records (waveforms) selected on the selection screen 203. Specifically, the number of records displayed in the record display area G41 (that is, the number of records stored in the memory 22) is used as a denominator, and the number of records selected as records used for the calculation process is a numerator. The number of records is displayed in fractional notation. For example, as shown in FIG. 8, when all of the two records displayed in the record display area G41 are selected (that is, the display of the check box G411 is active), the number of selections is displayed. In the area G45, "2/2" is displayed.

The calculation button G46 is a button for starting the calculation process. By tapping the calculation button G46, the electroencephalogram measurement system 10 starts the calculation process using the record selected on the selection screen 203 at that time.

The calibration result screen 204 includes, as shown in FIG. 9, a record display area G41 similar to the selection screen 203, a legend display area G43, a retrial button G44, a selection number display area G45, and a calculation button G46. The calibration result screen 204 further includes a time frequency map G51, an information display area G52, an analysis result display area G53, and an end button G54.

The time frequency map G51 is a graph representing the tendency of change in power of a specific frequency band at the calibration time used in the calculation process. In the time frequency map G51, the power of each coordinate position is represented by "color" in a two-dimensional map in which the horizontal axis is a time axis and the vertical axis is a frequency. That is, according to the time frequency map G51, the frequency band in which the change of power occurs from the resting period to the exercise period is visually displayed. Further, in the time frequency map G51, straight lines G511 and G512 indicating the respective frequency bands of the α wave and the β wave calculated by the calculation process are displayed. The straight line G511 represents the lower limit value and the upper limit value of the frequency band (range) of the α wave, and the straight line G512 represents the lower limit value and the upper limit value of the frequency band (range) of the β wave.

The information display area G52 is an area for displaying information related to measurement processing. In the example of FIG. 9, text information representing the number of times of measurement processing execution (the number of analysis trials), the length of time of a resting period (relaxation period), and the length of time of an exercise period (image period) It is displayed.

The analysis result display area G53 is an area for displaying the analysis result in the calculation process. In the example of FIG. 9, the ratio of occurrence of brain waves including characteristic changes due to the frequency band of alpha wave (alpha wave frequency range), the frequency band of beta wave (beta wave frequency range), and event-related desynchronization (accuracy rate) The text information representing H is displayed in the analysis result display area G53.

The end button G54 is a button for ending the calibration process. The electroencephalogram measurement system 10 ends the calibration process by tapping the end button G54.

(3.3.3) Details of Process Next, the details of the calibration process will be described with reference to the flowchart shown in FIG.

First, the electroencephalogram measurement system 10 displays a calibration screen 202 (see FIG. 7) on the display unit 26 of the information processing device 2 (S1). Measurement of an electroencephalogram in the electroencephalogram measurement system 10, that is, measurement processing is started by tapping the measurement start button G31 on the calibration screen 202 (S2). Thereby, the electroencephalogram information in the acquisition unit 211 is acquired, and the acquired electroencephalogram information is stored as a record in the memory 22 (S3).

Thereafter, the electroencephalogram measurement system 10 displays the selection screen 203 (see FIG. 8) on the display unit 26 of the information processing device 2 (S4). In the selection screen 203, a designation signal for designating one or more brain wave information from among a plurality of brain wave information (records) stored in the memory 22 is received (S5). Specifically, as described above, the input unit 216 receives, from the operation unit 24, a specification signal indicating the record selected by the subject 5 or the medical staff in the check box G411 of the record display area G41.

Thereafter, it is determined whether or not the calculation button G46 of the selection screen 203 is operated, that is, whether the calculation button G46 is tapped (S6). If it is determined that the operation of the calculation button G46 on the selection screen 203 is not performed (S6: No), subsequently, the presence or absence of the operation on the follow-up button G44 on the selection screen 203, that is, whether or not the follow-up button G44 is tapped It is determined (S7). If it is determined that there is no operation of the follow-up button G44 of the selection screen 203 (S7: No), the electroencephalogram measurement system 10 returns to step S4 and continues the display of the selection screen 203.

On the other hand, if it is determined that there is an operation of the retrial button G44 on the selection screen 203 (S7: Yes), the electroencephalogram measurement system 10 returns to step S1. Therefore, the screen of the display unit 26 is switched from the selection screen 203 to the calibration screen 202. That is, when the follow-up button G44 is tapped on the selection screen 203 (S7: Yes), the measurement process (S2) is performed again, and the acquisition unit 211 further acquires brain wave information and adds it to the memory 22. An additional process is to be performed (S3). Here, since the display control unit 218 causes the display unit 26 to display a plurality of brain wave information stored in the memory 22, the brain wave information is added to the memory 22, and the display control unit 218 executes additional processing. It will be done. The addition process performed by the display control unit 218 is a process of adding another brain wave information to the plurality of brain wave information to be displayed on the display unit 26.

If it is determined that the calculation button G46 of the selection screen 203 is operated (S6: Yes), calculation processing for determining various parameters used for analysis of electroencephalogram information is executed (S8). In the calculation process, among the plurality of electroencephalogram information (records) stored in the memory 22, various parameters used for analysis of the electroencephalogram information are determined using the electroencephalogram information designated by the designation signal in step S5. .

After the end of the calculation process, the electroencephalogram measurement system 10 displays the calibration result screen 204 (see FIG. 9) on the display unit 26 of the information processing device 2 (S9). That is, on the calibration result screen 204, the presentation unit 220 presents (displays) the result of the calibration process. In the calibration result screen 204, a record display area G41 similar to the selection screen 203 is displayed, and designation for designating one or more brain wave information from among a plurality of brain wave information (records) stored in the memory 22. A signal is received (S10). Specifically, as described above, the input unit 216 receives, from the operation unit 24, a specification signal indicating the record selected by the subject 5 or the medical staff in the check box G411 of the record display area G41.

Thereafter, it is determined whether or not the calculation button G46 of the calibration result screen 204 is operated, that is, whether the calculation button G46 is tapped (S11). If it is determined that the calculation button G46 of the calibration result screen 204 is not operated (S11: No), then the presence or absence of the operation of the retry button G44 of the calibration result screen 204, that is, the retry button G44 is tapped. It is determined whether or not it is (S12). If it is determined that the follow-up button G44 of the calibration result screen 204 is not operated (S12: No), the electroencephalogram measurement system 10 ends the calibration process. At this time, in practice, the electroencephalogram measurement system 10 ends the calibration process by tapping the end button G54 as described above.

On the other hand, if it is determined that there is an operation of the follow-up button G44 of the calibration result screen 204 (S12: Yes), the electroencephalogram measurement system 10 returns to step S1. Therefore, the screen of the display unit 26 is switched from the calibration result screen 204 to the calibration screen 202. That is, when the follow-up button G44 is tapped on the calibration result screen 204 (S12: Yes), the measurement process (S2) is performed again, and the acquiring unit 211 further acquires brain wave information and the memory 22. An additional process to be added to is executed (S3).

If it is determined that the calculation button G46 of the calibration result screen 204 is operated (S11: Yes), calculation processing for determining various parameters used for analysis of brain wave information is executed again (S8) . In the calculation processing, among the plurality of electroencephalogram information (records) stored in the memory 22, various parameters used for analysis of the electroencephalogram information are determined using the electroencephalogram information designated by the designation signal in step S10. .

Furthermore, in the present embodiment, when it is determined that the follow button G44 is operated (S7: Yes or S12: Yes), the brain wave information (record) not designated by the designation signal is deleted by the deletion unit 221. It is deleted from the memory 22. Specifically, when the follow-up button G44 is tapped, the display of the check box G411 is inactive, that is, the electroencephalogram information (record) whose check box G411 is unchecked is deleted. Therefore, after the retry button G44 is tapped and the addition process is executed, the electroencephalogram information deleted from the memory 22 by the deletion unit 221 will deviate from the options of the electroencephalogram information specified by the specification signal. .

As described above, in the present embodiment, in each of the selection screen 203 and the calibration result screen 204, it is possible to designate the electroencephalogram information used for the calibration process by the designation signal (S5 or S10). In addition, in step S5 after passing through step S10 or step S11 and step S12, after the processing unit 215 performs the calibration process, the re-designation process of accepting the designation signal is performed.

Here, after the calibration process and before the re-designation process, which of the calculation button G46 and the follow-up button G44 is operated on the calibration result screen 204 as to whether or not the additional process is executed Determined by In other words, the selection unit 219 receives, from the operation unit 24, a selection signal indicating which of the calculation button G46 and the follow-up button G44 has been operated on the calibration result screen 204. That is, when the calculation button G46 of the calibration result screen 204 is tapped (S11: Yes), after the calculation process (S8), the re-designating process in step S10 is performed without performing the additional process. Be done. On the other hand, when the follow-up button G44 of the calibration result screen 204 is tapped (S12: Yes), after the addition process (S3) is executed after the calculation process (S8), re-designation in step S5 Processing is performed.

(Modification)
Embodiment 1 is only one of various embodiments of the present disclosure. The first embodiment can be variously modified according to the design and the like as long as the object of the present disclosure can be achieved. The same function as that of the electroencephalogram measurement system 10 may be embodied by an electroencephalogram measurement method, a (computer) program, or a non-temporary recording medium recording the program. The electroencephalogram measurement method according to one aspect acquires brain wave information representing an electroencephalogram collected by the electrode unit 11 disposed at the measurement point 51 which is a part of the head 52 of the subject 5, and stores the memory unit (memory 22) store a plurality of electroencephalogram information. Furthermore, in the electroencephalogram measurement method, a designation signal for designating one or more pieces of brain wave information from among a plurality of pieces of brain wave information stored in the storage unit (memory 22) is received from the operation unit 24. Furthermore, in the electroencephalogram measurement method, calibration processing for determining parameters used for analysis of electroencephalogram information is executed based on one or more electroencephalogram information designated by the designation signal. A (computer) program according to an aspect is a program for causing a computer system to execute the above-described electroencephalogram measurement method.

Hereinafter, modifications of the first embodiment will be listed. The modifications described below can be applied in combination as appropriate.

The electroencephalogram measurement system 10 in the present disclosure includes a computer system. The computer system mainly includes a processor and memory as hardware. The processor executes the program stored in the memory of the computer system to implement the function as the electroencephalogram measurement system 10 in the present disclosure. The program may be pre-recorded in the memory of the computer system, may be provided through a telecommunication line, and recorded in a non-transitory recording medium such as a computer system-readable memory card, an optical disc, a hard disk drive, etc. It may be provided. A processor of a computer system is configured of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large scale integrated circuit (LSI). The term “integrated circuit such as IC or LSI” as used herein varies depending on the degree of integration, and includes integrated circuits called system LSI, very large scale integration (VLSI), or ultra large scale integration (ULSI). Furthermore, use as a processor also a field-programmable gate array (FPGA) or a logic device capable of reconfiguring junction relations inside the LSI or reconfiguring circuit sections inside the LSI, which are programmed after the LSI is manufactured. Can. The plurality of electronic circuits may be integrated into one chip or may be distributed to a plurality of chips. The plurality of chips may be integrated into one device or may be distributed to a plurality of devices.

Further, for example, it is not an essential configuration for the electroencephalogram measurement system 10 that a plurality of components of the information processing device 2 are integrated in one case, and a plurality of components of the information processing device 2 are a plurality of It may be provided separately in the case. Even when a plurality of components are distributed in a plurality of cases, for example, the plurality of components are connected via a network such as the Internet to realize the electroencephalogram measurement system 10 in cooperation. can do. Furthermore, at least a part of the functions of the electroencephalogram measurement system 10 may be realized by, for example, a server or a cloud (cloud computing). On the contrary, for example, as in the case of the headset 1 and the information processing device 2, the functions distributed to a plurality of devices are one case together with other components of the electroencephalogram measurement system 10 as a part of the electroencephalogram measurement system 10. It may be integrated in the body.

Moreover, the electrode part 11 is not limited to the structure which contacts the surface (scalp) of the head 52 of the subject 5, for example, the electrode part 11 is comprised so that the electrode part 11 may contact the surface (brain surface) of a brain. It may be done.

In addition, the rehabilitation support system 100 is not limited to the rehabilitation of the fingers of the subject 5, but is used for rehabilitation of any part of the body of the subject 5, such as the shoulder, elbow, upper arm, waist, lower extremity, or upper extremity. It is also good. The manner of characteristic changes of the electroencephalogram that may occur when the subject 5 intends to perform voluntary exercise may differ depending on the target site of rehabilitation, exercise content and the like. For example, if event-related synchronization (ERS) occurs when the subject 5 intends to perform a voluntary exercise, in the electroencephalogram measured in the vicinity of the motor area at the time of voluntary exercise, a specific frequency band Power increases. In this case, the electroencephalogram measurement system 10 detects the characteristic change of the electroencephalogram by the increase of the power of the specific frequency band.

Further, the rehabilitation support system 100 is not limited to the configuration that gives the subject 5 electrical or mechanical (mechanical) stimulation, and for example, the configuration that gives the subject 5 a visual stimulus by displaying an image. It may be In this case, for example, when the subject 5 intends to perform a voluntary exercise, the rehabilitation support system 100 is timed to the timing at which the activation of the brain region corresponding to the target area of the voluntary exercise actually occurs. The subject 5 is shown an image in which the failure site is moving normally. Even in this way, the rehabilitation support system 100 can assist the voluntary exercise of the subject 5.

Moreover, the movement assistance device 3 and the control device 4 are not limited to separate bodies, and for example, the movement assistance device 3 and the control device 4 may be accommodated and integrated in one case.

The communication method between the headset 1 and the information processing apparatus 2 is wireless communication in the first embodiment, but the present invention is not limited to this example. For example, wired communication may be used. A communication method may be used. The communication method between the control device 4 and the information processing device 2 is wired communication in the first embodiment, but the present invention is not limited to this example. For example, wireless communication may be used, and communication via relays etc. It may be a method.

The headset 1 is not limited to the battery drive type, and the operation power of the signal processing unit 12 and the first communication unit 13 may be supplied from, for example, the information processing apparatus 2.

Further, the information processing apparatus 2 is not limited to the configuration for acquiring brain wave information from the dedicated headset 1, and may be configured to acquire brain wave information from, for example, a general-purpose electroencephalograph.

In the first embodiment, although the case where the determination result of the artifact is used for the calibration process has been described, the present invention is not limited to this example. For example, the determination result of the artifact may be output in the training process. Thereby, the subject 5 and the medical staff can easily confirm the state of the artifact in the training process.

In the first embodiment, the subject 5 or medical staff selects the electroencephalogram information to be used for the calibration process with reference to the determination result of the artifact, but the present invention is not limited to this example. EEG information may be automatically selected. That is, when the output unit 217 outputs the determination result of the artifact to, for example, the processing unit 215, the processing unit 215 automatically selects the electroencephalogram information to be used for the calibration process based on the determination result of the artifact. It is also good. In this case, it is preferable that the processing unit 215 select, for example, only brain wave information determined not to contain an artifact.

In addition, the storage unit that stores a plurality of brain wave information acquired by the acquisition unit 211 is not limited to the memory 22 of the information processing device 2, for example, a non-temporary recording medium accessible by the information processing device 2, a server, or a cloud (Cloud computing) may be realized.

The configuration in which the electroencephalogram information stored in the memory 22 is displayed as a record in the record display area G41 when the input unit 216 receives a designation signal from the operation unit 24 is not an essential configuration of the electroencephalogram measurement system 10. For example, the brain wave information stored in the memory 22 is presented to the subject 5 or medical staff in a mode such as voice output, printout (writing), writing to a non-temporary recording medium, and transmission to an information terminal. It may be done.

Further, the deletion unit 221 is not limited to the configuration in which the brain wave information not designated by the designation signal is deleted from the memory 22. For example, the memory 102 automatically stores old brain wave information by leaving the latest predetermined number of records (brain wave information). You may delete it from 22.

In addition, in comparisons between binary values such as activation level and threshold value, places where "exceed" are not included when the binary values are equal but include only when one of the binary values exceeds the other. However, not only this but "more than" here may be synonymous with "or more" including both when the binary value is equal and when one of the binary values exceeds the other. In other words, whether or not the binary values are equal can be arbitrarily changed depending on the setting of the threshold value or the like, so there is no technical difference in "over" or "above". Similarly, "less than" may be synonymous with "less than".

(Summary)
As described above, the electroencephalogram measurement system (10) according to the first aspect includes the acquisition unit (211), the storage unit (memory 22), the input unit (216), and the processing unit (215). Prepare. An acquisition unit (211) acquires brain wave information. The electroencephalogram information is information representing an electroencephalogram collected by the electrode unit (11). The electrode unit (11) is disposed at a measurement point (51) which is a part of the head (52) of the subject (5). The storage unit stores a plurality of brain wave information acquired by the acquisition unit (211). The input unit (216) receives, from the operation unit (24), a designation signal for designating one or more pieces of brain wave information from among the plurality of pieces of brain wave information stored in the storage unit. The processing unit (215) executes a calibration process for determining a parameter used for analysis of brain wave information, based on the one or more brain wave information specified by the designation signal.

According to this aspect, it is possible to specify one or more brain wave information to be used for the calibration process from among the plurality of brain wave information stored in the storage unit (memory 22). Therefore, in the calibration process, for example, it is possible to accurately determine the parameters using only brain wave information that is less affected by an artifact. As a result, it is possible to suppress the error generated in the parameter to a small value, and to suppress the decrease in the accuracy of the electroencephalogram measurement.

The electroencephalogram measurement system (10) according to the second aspect is, in the first aspect, a display control part (218) that causes the display part (26) to display a plurality of electroencephalogram information stored in the storage part (memory 22). Further comprising

According to this aspect, it is possible to designate one or more brain wave information to be used in the calibration process with reference to the plurality of brain wave information displayed on the display unit (26). Therefore, the designation (selection) operation of the brain wave information used for the calibration process becomes relatively easy.

In the electroencephalogram measurement system (10) according to the third aspect, in the first or second aspect, the input unit (216) re-specifies the designation signal to be accepted after the processing unit (215) executes the calibration processing. Execute the process The processing unit (215) executes the calibration processing again based on the one or more brain wave information designated by the designation signal received by the input unit (216) in the re-designation processing.

According to this aspect, the calibration process can be executed again in the state where one or more brain wave information used for the calibration process is redesignated by the re-designation process. Therefore, compared with the case where the acquired electroencephalogram information is discarded and retried from acquisition of the electroencephalogram information by the acquisition unit (211), the time required for the calibration process again can be shortened, and the target person (5) and medical staff It is possible to reduce the burden of

In the electroencephalogram measurement system (10) according to the fourth aspect, in the third aspect, the acquisition unit (211) executes an additional process. In the addition processing, brain wave information is further acquired and stored in the storage unit (memory 22) in a period from when the processing unit (215) executes calibration processing until the input unit (216) executes re-designation processing. It is a process to add.

According to this aspect, when the choice of the electroencephalogram information by the designation signal is not sufficient, the re-designation process can be executed in a state where the choice of the electroencephalogram information is increased by the addition process. Therefore, compared with the case where the acquired electroencephalogram information is discarded and retried from acquisition of the electroencephalogram information by the acquisition unit (211), the time required for the calibration process again can be shortened, and the target person (5) and medical staff It is possible to reduce the burden of

The electroencephalogram measurement system (10) according to the fifth aspect further includes a selection unit (219) in the fourth aspect. The selection unit (219) performs additional processing by the acquisition unit (211) from when the processing unit (215) executes calibration processing until the input unit (216) executes re-designation processing. A selection signal for selecting whether or not to be received is received from the operation unit (24).

According to this aspect, for example, by executing the additional process only when the option of the electroencephalogram information by the designated signal is not sufficient, the time required for the calibration process again can be shortened, and the subject (5) and The burden on medical staff etc. can be reduced.

The electroencephalogram measurement system (10) according to the sixth aspect further includes a presentation unit (220) for presenting the result of the calibration process in any of the first to fifth aspects.

According to this aspect, for example, the calibration process is retried so that the result of the calibration process presented by the presentation unit (220) satisfies a certain standard, thereby lowering the accuracy of the electroencephalogram measurement. It can be further suppressed.

In the electroencephalogram measurement system (10) according to the seventh aspect, in any one of the first to sixth aspects, at least one electroencephalogram information is deleted from the plurality of electroencephalogram information stored in the storage unit (memory 22). And a deletion unit (221).

According to this aspect, for example, the brain wave information inappropriate for the brain wave information used in the calibration process is deleted from the choice of the brain wave information according to the designation signal, thereby specifying the brain wave information used in the calibration process. (Selection) work is relatively easy.

A rehabilitation support system (100) according to an eighth aspect includes an electroencephalogram measurement system (10), an exercise support device (3), and a control device (4). The exercise assisting device (3) applies at least one of mechanical stimulation and electrical stimulation to the subject (5). The control device (4) controls the exercise assistance device (3) based on the brain wave information acquired by the acquisition unit (211).

An electroencephalogram measurement method according to a ninth aspect is an electroencephalogram representing an electroencephalogram collected by an electrode unit (11) disposed at a measurement location (51) which is a part of a head (52) of a subject (5). Information is acquired, and a plurality of brain wave information is stored in the storage unit (memory 22). Furthermore, in this electroencephalogram measurement method, a designation signal for designating one or more brain wave information from among a plurality of brain wave information stored in the storage unit is received from the operation unit (24). Furthermore, in this electroencephalogram measurement method, calibration processing for determining parameters used for analysis of electroencephalogram information is executed based on one or more electroencephalogram information designated by the designation signal.

A program according to a tenth aspect is a program for causing a computer system to execute the electroencephalogram measurement method according to the ninth aspect.

The non-temporary recording medium according to the eleventh aspect is a non-transitory recording medium readable by a computer system in which a program for causing a computer system to execute the electroencephalogram measurement method according to the ninth aspect is recorded.

Not limited to the above aspect, various configurations (including modified examples) of the electroencephalogram measurement system (10) according to the first embodiment may be an electroencephalogram measurement method, a (computer) program, or a non-temporary recording medium recording the program. It can be embodied.

An electroencephalogram measurement system (10) according to a twelfth aspect includes a display control unit (218), an input unit (216), and a processing unit (215). The display control unit (218) causes the display unit (26) to display a plurality of brain wave information. The input unit (216) receives, from the operation unit (24), a designation signal for designating one or more pieces of brain wave information from among a plurality of pieces of brain wave information. The processing unit (215) executes a calibration process for determining a parameter used for analysis of brain wave information, based on the one or more brain wave information specified by the designation signal.

According to this aspect, it is possible to specify one or more brain wave information to be used for the calibration process from among the plurality of brain wave information. Therefore, in the calibration process, for example, it is possible to accurately determine the parameters using only brain wave information that is less affected by an artifact. As a result, it is possible to suppress the error generated in the parameter to a small value, and to suppress the decrease in the accuracy of the electroencephalogram measurement.

In the electroencephalogram measurement system (10) according to the thirteenth aspect, in the twelfth aspect, the input unit (216) performs re-designation processing for accepting a designation signal after the processing unit (215) executes calibration processing. Run. The processing unit (215) executes the calibration processing again based on the one or more brain wave information designated by the designation signal received by the input unit (216) in the re-designation processing.

According to this aspect, the calibration process can be executed again in the state where one or more brain wave information used for the calibration process is redesignated by the re-designation process. Therefore, compared to the case where the acquired brain wave information is discarded and the brain wave information is acquired again, the time required for the calibration process again can be shortened, and the burden on the subject (5) and medical staff can be reduced. .

In the electroencephalogram measurement system (10) according to the fourteenth aspect, in the thirteenth aspect, the display control unit (218) executes an additional process. The addition process is different from the plurality of electroencephalogram information to be displayed on the display unit (26) after the processing unit (215) performs the calibration process and the input unit (216) performs the re-designation process. Processing to add brain wave information of

According to this aspect, when the choice of the electroencephalogram information by the designation signal is not sufficient, the re-designation process can be executed in a state where the choice of the electroencephalogram information is increased by the addition process. Therefore, compared to the case where the acquired brain wave information is discarded and the brain wave information is acquired again, the time required for the calibration process again can be shortened, and the burden on the subject (5) and medical staff can be reduced. .

The configurations according to the second to seventh, thirteenth, and fourteenth aspects are not essential components of the electroencephalogram measurement system (10), and can be omitted as appropriate.

DESCRIPTION OF SYMBOLS 5 object person 10 electroencephalogram measurement system 11 electrode part 24 operation part 26 display part 51 measurement part 52 head 211 acquisition part 215 processing part 216 input part 218 display control part 219 selection part 220 presentation part 221 deletion part

Claims

An acquisition unit for acquiring electroencephalogram information representing an electroencephalogram collected by an electrode unit disposed at a measurement location which is a part of the head of the subject;
A storage unit that stores a plurality of the brain wave information acquired by the acquisition unit;
An input unit that receives, from an operation unit, a designation signal that designates one or more brain wave information from among the plurality of brain wave information stored in the storage unit;
A processing unit configured to execute a calibration process for determining a parameter used for analysis of the brain wave information based on the one or more brain wave information specified by the designation signal.
The electroencephalogram measurement system according to claim 1, further comprising a display control unit that causes the display unit to display the plurality of brain wave information stored in the storage unit.
The input unit executes re-designation processing for receiving the designation signal after the processing unit executes the calibration processing,
The brain wave according to claim 1 or 2, wherein the processing unit executes the calibration process again based on one or more brain wave information specified by the designation signal received by the input unit in the re-designation process. Measurement system.
The acquisition unit additionally acquires the brain wave information and adds the brain wave information to the storage unit after the processing unit executes the calibration process and the input unit executes the re-designation process. The electroencephalogram measurement system according to claim 3, which executes a process.
A selection signal for selecting whether or not to execute the additional process by the acquisition unit after the processing unit executes the calibration process and before the input unit executes the re-designation process, The electroencephalogram measurement system according to claim 4, further comprising a selection unit received from the operation unit.
The electroencephalogram measurement system according to any one of claims 1 to 5, further comprising a presentation unit that presents a result of the calibration process.
The electroencephalogram measurement system according to any one of claims 1 to 6, further comprising a deletion unit configured to delete at least one brain wave information from the plurality of brain wave information stored in the storage unit.
Acquiring electroencephalogram information representing electroencephalograms collected by an electrode unit disposed at a measurement location which is a part of the subject's head, and storing a plurality of electroencephalogram information in a storage unit;
A designation signal for designating one or more brain wave information from among the plurality of brain wave information stored in the storage unit is accepted from the operation unit,
A calibration process for determining a parameter used for analysis of the brain wave information based on the one or more brain wave information specified by the designation signal.
Computer system,
A program for executing the electroencephalogram measurement method according to claim 8.
Computer system,
A non-transitory recording medium readable by a computer system, wherein a program for executing the electroencephalogram measurement method according to claim 8 is recorded.
A display control unit for displaying a plurality of brain wave information on a display unit;
An input unit that receives, from an operation unit, a designation signal that designates one or more pieces of brain wave information from among the plurality of pieces of brain wave information;
A processing unit configured to execute a calibration process for determining a parameter used for analysis of the brain wave information based on the one or more brain wave information specified by the designation signal.
The input unit executes re-designation processing for receiving the designation signal after the processing unit executes the calibration processing,
The electroencephalogram measurement according to claim 11, wherein the processing unit executes the calibration process again based on the one or more brain wave information specified by the designation signal received by the input unit in the re-designation process. system.
The display control unit is configured to display the plurality of electroencephalogram information to be displayed on the display unit after the processing unit performs the calibration process and the input unit performs the re-designating process. The electroencephalogram measurement system according to claim 12, which performs additional processing of adding electroencephalogram information.