CN113426007B - A closed-loop epidural electrical stimulation system for upper limb function recovery - Google Patents
A closed-loop epidural electrical stimulation system for upper limb function recovery Download PDFInfo
- Publication number
- CN113426007B CN113426007B CN202110534939.6A CN202110534939A CN113426007B CN 113426007 B CN113426007 B CN 113426007B CN 202110534939 A CN202110534939 A CN 202110534939A CN 113426007 B CN113426007 B CN 113426007B
- Authority
- CN
- China
- Prior art keywords
- electrical stimulation
- human
- eeg
- spinal cord
- control device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N1/00—Electrotherapy; Circuits therefor
- A61N1/02—Details
- A61N1/04—Electrodes
- A61N1/05—Electrodes for implantation or insertion into the body, e.g. heart electrode
- A61N1/0551—Spinal or peripheral nerve electrodes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
- A61B5/1116—Determining posture transitions
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
- A61B5/1121—Determining geometric values, e.g. centre of rotation or angular range of movement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
- A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb using a particular sensing technique
- A61B5/1128—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb using a particular sensing technique using image analysis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
- A61B5/372—Analysis of electroencephalograms
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4836—Diagnosis combined with treatment in closed-loop systems or methods
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N1/00—Electrotherapy; Circuits therefor
- A61N1/18—Applying electric currents by contact electrodes
- A61N1/32—Applying electric currents by contact electrodes alternating or intermittent currents
- A61N1/36—Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
- A61N1/3605—Implantable neurostimulators for stimulating central or peripheral nerve system
- A61N1/3606—Implantable neurostimulators for stimulating central or peripheral nerve system adapted for a particular treatment
- A61N1/36062—Spinal stimulation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N1/00—Electrotherapy; Circuits therefor
- A61N1/18—Applying electric currents by contact electrodes
- A61N1/32—Applying electric currents by contact electrodes alternating or intermittent currents
- A61N1/36—Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
- A61N1/3605—Implantable neurostimulators for stimulating central or peripheral nerve system
- A61N1/36128—Control systems
- A61N1/36135—Control systems using physiological parameters
- A61N1/36139—Control systems using physiological parameters with automatic adjustment
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Veterinary Medicine (AREA)
- Biomedical Technology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Biophysics (AREA)
- Heart & Thoracic Surgery (AREA)
- Physics & Mathematics (AREA)
- Surgery (AREA)
- Molecular Biology (AREA)
- Medical Informatics (AREA)
- Pathology (AREA)
- Physiology (AREA)
- Neurology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Neurosurgery (AREA)
- Dentistry (AREA)
- Orthopedic Medicine & Surgery (AREA)
- Psychiatry (AREA)
- Psychology (AREA)
- Cardiology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Geometry (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- Electrotherapy Devices (AREA)
- Rehabilitation Tools (AREA)
Abstract
本发明公开了一种用于上肢功能恢复的闭环硬脊膜外电刺激系统。动作捕捉装置,实时获取多角度人体姿态图像并发送控制装置;脑电采集装置,实时获取脑电信号,脑电信号经放大和滤波发送控制装置;控制装置,接收人体姿态图像和脑电信号获得上肢姿态数据和脑电信号特征,生成电刺激指令并发送脊髓电刺激装置;脊髓电刺激装置,接收指令向人体脊髓发电刺激脉冲。本发明系统能够基于人体自身意志,主动调制支配人体上肢功能的神经活动,更有效地协助康复训练,促进人体上肢相关的神经环路的功能恢复。
The present invention discloses a closed-loop epidural electrical stimulation system for upper limb function recovery. A motion capture device acquires multi-angle human posture images in real time and sends them to a control device; an electroencephalogram acquisition device acquires electroencephalogram signals in real time, and the electroencephalogram signals are amplified and filtered and sent to a control device; a control device receives human posture images and electroencephalogram signals to obtain upper limb posture data and electroencephalogram signal characteristics, generates electrical stimulation instructions and sends them to a spinal cord electrical stimulation device; a spinal cord electrical stimulation device receives instructions and generates electrical stimulation pulses to the human spinal cord. The system of the present invention can actively modulate the neural activities that control the upper limb functions of the human body based on the human body's own will, more effectively assist rehabilitation training, and promote the functional recovery of neural circuits related to the human upper limbs.
Description
技术领域Technical Field
本发明涉及医疗领域的一种脊髓电刺激系统,尤其涉及一种用于脊髓损伤或脑卒中后的上肢功能恢复的闭环硬脊膜外电刺激系统。The present invention relates to a spinal cord electrical stimulation system in the medical field, and in particular to a closed-loop epidural electrical stimulation system for recovering upper limb function after spinal cord injury or stroke.
背景技术Background technique
脑卒中或脊髓损伤引起的中枢神经系统的受损会导致人体无法正常产生控制运动的中枢神经系统指令或无法将这些指令传输给骨骼肌,引发上肢运动功能障碍,目前常用的一类解决方案是功能性电刺激,这种方法通过在人体上肢皮肤表面固定一组或多组电极来对相关肌肉进行电刺激,帮助人体进行手臂和手掌的运动,但缺点是容易引发肌肉疲劳,无法长时间工作。硬脊膜外电刺激能够在脊髓背侧硬脊膜上施加刺激电流,激发位于人脊髓上的中枢模式发生网络,增强脊髓回路的兴奋性,从而调动骨骼肌进行收缩,能够有效减轻肌肉疲劳现象,促进损伤的神经环路的重塑,但目前其在实际应用中时空分辨率有限,无法像功能性电刺激一样实现对上肢的精确控制。Damage to the central nervous system caused by stroke or spinal cord injury can cause the human body to be unable to normally generate central nervous system commands to control movement or be unable to transmit these commands to skeletal muscles, causing upper limb motor dysfunction. Currently, a commonly used solution is functional electrical stimulation, which fixes one or more sets of electrodes on the surface of the skin of the upper limbs of the human body to electrically stimulate the relevant muscles to help the human body move the arms and palms, but the disadvantage is that it is easy to cause muscle fatigue and cannot work for a long time. Epidural electrical stimulation can apply a stimulating current to the dorsal dura mater of the spinal cord, stimulate the central pattern generating network located on the human spinal cord, enhance the excitability of the spinal cord circuit, and thus mobilize skeletal muscles to contract. It can effectively reduce muscle fatigue and promote the remodeling of damaged neural circuits. However, its temporal and spatial resolution is limited in actual applications, and it cannot achieve precise control of the upper limbs like functional electrical stimulation.
发明内容Summary of the invention
本发明的目的针对现有上肢功能性电刺激容易引起肌肉疲劳和上肢硬脊膜外电刺激技术时空分辨率不足的情况,开发一种闭环硬脊膜外电刺激技术,以人体实时的脑电信号和运动状态为依据实时改变电刺激策略,诱发相应神经环路的活动,补偿目标骨骼肌的运动。The purpose of the present invention is to develop a closed-loop epidural electrical stimulation technology to address the problems that existing upper limb functional electrical stimulation easily causes muscle fatigue and the upper limb epidural electrical stimulation technology has insufficient temporal and spatial resolution. The technology changes the electrical stimulation strategy in real time based on the real-time EEG signals and movement state of the human body, induces the activity of the corresponding neural circuits, and compensates for the movement of the target skeletal muscles.
为实现上述目的,本发明所采用的技术方案是:To achieve the above object, the technical solution adopted by the present invention is:
所述闭环硬脊膜外电刺激系统包括动作捕捉装置、脑电采集装置、控制装置、脊髓电刺激装置,其中:The closed-loop epidural electrical stimulation system includes a motion capture device, an electroencephalogram acquisition device, a control device, and a spinal cord electrical stimulation device, wherein:
所述动作捕捉装置,用于实时获取多角度的人体姿态图像,并将所述人体姿态图像发送给所述控制装置;The motion capture device is used to acquire multi-angle human posture images in real time and send the human posture images to the control device;
所述脑电采集装置,用于实时获取人体的脑电信号,脑电信号经过放大和滤波后发送给所述控制装置;The EEG acquisition device is used to acquire the EEG signals of the human body in real time, and the EEG signals are sent to the control device after being amplified and filtered;
所述控制装置,接收来自动作捕捉装置的人体姿态图像和来自脑电采集装置的脑电信号,进而实时处理和分析人体姿态图像中的上肢姿态数据和脑电信号中的脑电信号特征,生成包含电刺激参数的指令并发送给所述脊髓电刺激装置;The control device receives the human posture image from the motion capture device and the EEG signal from the EEG acquisition device, and then processes and analyzes the upper limb posture data in the human posture image and the EEG signal features in the EEG signal in real time, generates an instruction containing electrical stimulation parameters and sends it to the spinal cord electrical stimulation device;
所述脊髓电刺激装置,接收所述控制装置发来的包含电刺激参数的指令,向人体脊髓发送电刺激脉冲。The spinal cord electrical stimulation device receives instructions containing electrical stimulation parameters from the control device and sends electrical stimulation pulses to the human spinal cord.
所述动作捕捉装置主要由至少两台摄像头组成,摄像头从多视角采集人体上肢的图像作为人体姿态图像。The motion capture device is mainly composed of at least two cameras, which collect images of human upper limbs from multiple viewing angles as human posture images.
所述脑电采集装置至少包括多个采集通道、一个参考通道和脑电电极阵列,脑电电极阵列包含了多个布置在人体头部大脑的电极,每个采集通道分别连接各自的一个电极,参考通道连接一个电极并接地,采集通道的各个电极布置在不同的脑区上,采集脑区的脑电变化。The EEG acquisition device includes at least multiple acquisition channels, a reference channel and an EEG electrode array. The EEG electrode array includes multiple electrodes arranged on the human brain. Each acquisition channel is connected to its own electrode, and the reference channel is connected to an electrode and grounded. The electrodes of the acquisition channel are arranged on different brain regions to acquire EEG changes in the brain regions.
所述脑电采集装置包含用于对各个通道所采集的原始电信号进行处理的前置放大器、差分放大器和模拟滤波器,各个通道所采集的原始电信号依次经前置放大、差分放大和滤波处理后输出到控制装置。The EEG acquisition device includes a preamplifier, a differential amplifier and an analog filter for processing the original electrical signals collected by each channel. The original electrical signals collected by each channel are sequentially processed by preamplification, differential amplification and filtering and then output to the control device.
所述控制装置接收人体实时的姿态数据和原始脑电信号并进行预处理,生成处理后的上肢姿态数据和脑电信号特征,再根据上肢姿态数据和脑电信号特征获得人体的当前运动状态和目标状态的差异,生成电刺激指令,发送给所述脊髓电刺激装置。The control device receives the real-time posture data and original EEG signals of the human body and performs preprocessing to generate processed upper limb posture data and EEG signal features, then obtains the difference between the current movement state and the target state of the human body based on the upper limb posture data and EEG signal features, generates electrical stimulation instructions, and sends them to the spinal cord electrical stimulation device.
所述控制装置存储有基于深度学习的人体姿态估计程序,能够通过深度学习模型根据所述动作捕捉装置传输的多视角的人体姿态图像标注出人体上肢的关键点,并三维重建出各个关键点的空间坐标,生成人体上肢的运动学数据作为上肢姿态数据;The control device stores a human posture estimation program based on deep learning, which can mark the key points of the upper limbs of the human body according to the multi-view human posture images transmitted by the motion capture device through the deep learning model, and three-dimensionally reconstruct the spatial coordinates of each key point to generate kinematic data of the upper limbs of the human body as the upper limb posture data;
所述控制装置存储有脑电信号处理程序,脑电信号处理程序对所述脑电采集装置传输的原始脑电信号进行带通滤波和空间滤波后,获得脑电信号特征;The control device stores an EEG signal processing program, which performs band-pass filtering and spatial filtering on the original EEG signal transmitted by the EEG acquisition device to obtain EEG signal characteristics;
所述控制装置存储有基于神经网络构造的运动状态分类程序,所述运动状态分类程序根据运动学数据和脑电信号特征判定人体当前的运动状态,进而获得运动状态和目标状态之间的差异;The control device stores a motion state classification program based on a neural network structure, and the motion state classification program determines the current motion state of the human body according to kinematic data and EEG signal characteristics, and then obtains the difference between the motion state and the target state;
所述控制装置存储有电刺激控制程序,电刺激控制程序内置了根据人上肢各肌肉的运动学功能和支配上肢各肌肉的运动神经元在脊髓第二颈段到第一胸段之间的分布情况所预定义解剖学映射,电刺激控制程序首先根据所述预定义的解剖学映射确定电刺激位点,然后根据当前运动状态和目标状态之间的差异处理获得具体的电刺激参数,包括电刺激脉冲的频率、幅度、宽度和个数等参数,最后将所述电刺激位点和电刺激参数共同编码为电刺激指令发送给所述脊髓电刺激装置。The control device stores an electrical stimulation control program, which has a predefined anatomical mapping built in according to the kinematic functions of the muscles of the upper limbs and the distribution of the motor neurons that control the muscles of the upper limbs between the second cervical segment and the first thoracic segment of the spinal cord. The electrical stimulation control program first determines the electrical stimulation site according to the predefined anatomical mapping, and then obtains specific electrical stimulation parameters according to the difference between the current motion state and the target state, including parameters such as the frequency, amplitude, width and number of electrical stimulation pulses. Finally, the electrical stimulation site and electrical stimulation parameters are jointly encoded into an electrical stimulation instruction and sent to the spinal cord electrical stimulation device.
所述脊髓电刺激装置接收来自所述控制装置的电刺激指令,对电刺激指令中脊髓的硬脊膜上电刺激位点施加对应参数的电刺激脉冲序列,位于所述电刺激位点的运动神经元被激活,进而支配肌肉进行收缩,使上肢做出对应动作,再被动作捕捉装置和动作捕捉装置采集反馈到控制装置,不断循环往复闭环控制进行电刺激。The spinal cord electrical stimulation device receives electrical stimulation instructions from the control device, and applies an electrical stimulation pulse sequence with corresponding parameters to the electrical stimulation site on the dura mater of the spinal cord in the electrical stimulation instruction. The motor neurons located at the electrical stimulation site are activated, which in turn control the muscles to contract, causing the upper limbs to make corresponding movements. The movements are then collected by the motion capture device and fed back to the control device, and the closed-loop control is continuously repeated to perform electrical stimulation.
本发明的有益效果是:The beneficial effects of the present invention are:
本发明系统能够基于人体自身意志,主动调制支配人体上肢功能的神经活动,更有效地协助康复训练,促进人体上肢相关的神经环路的功能恢复。The system of the present invention can actively modulate the neural activities that control the functions of the upper limbs of the human body based on the human body's own will, more effectively assist rehabilitation training, and promote the functional recovery of the neural circuits related to the upper limbs of the human body.
本发明既能够避免电刺激造成的较快肌肉疲劳,又能够结合人体实时脑电信号和运动状态对脊髓相应区域施加电刺激来调动相应骨骼肌,提升电刺激策略的时空分辨率。The present invention can not only avoid rapid muscle fatigue caused by electrical stimulation, but also combine the real-time EEG signals and movement state of the human body to apply electrical stimulation to the corresponding area of the spinal cord to mobilize the corresponding skeletal muscles, thereby improving the spatiotemporal resolution of the electrical stimulation strategy.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
下面结合附图和实施例对本发明进一步说明;The present invention is further described below in conjunction with the accompanying drawings and embodiments;
图1是根据本发明一实施方式的闭环硬脊膜外电刺激系统的结构示意图。FIG1 is a schematic structural diagram of a closed-loop epidural electrical stimulation system according to an embodiment of the present invention.
图2是根据本发明一实施方式的闭环硬脊膜外电刺激系统的控制方法流程图。FIG2 is a flow chart of a control method of a closed-loop epidural electrical stimulation system according to an embodiment of the present invention.
图3是根据本发明一实施方式的姿态估计系统数据处理流程图。FIG. 3 is a data processing flow chart of a posture estimation system according to an embodiment of the present invention.
图4是根据本发明一实施方式的人肢体关键点结构示意图。FIG. 4 is a schematic diagram of a key point structure of a human limb according to an embodiment of the present invention.
图5是根据本发明一实施方式的特征提取及融合与运动状态分类的神经网络结构示意图。FIG5 is a schematic diagram of a neural network structure for feature extraction and fusion and motion state classification according to an embodiment of the present invention.
图6是根据本发明一实施方式的人执行抓握动作时的脑电信号特征和姿态特征示意图。FIG6 is a schematic diagram of EEG signal characteristics and posture characteristics when a person performs a grasping action according to an embodiment of the present invention.
图7是根据本发明一实施方式的人执行抓握动作时电刺激控制程序的对应于图6的电刺激参数。FIG. 7 is an electrical stimulation parameter corresponding to FIG. 6 of an electrical stimulation control program when a person performs a grasping action according to an embodiment of the present invention.
图8是根据本发明一实施方式的预定义解剖学映射。FIG. 8 is a predefined anatomical map according to an embodiment of the present invention.
图9是根据本发明一实施方式的闭环控制逻辑示意图。FIG. 9 is a schematic diagram of closed-loop control logic according to an embodiment of the present invention.
图中:一对摄像头1、脑电电极阵列2、计算机3、上肢姿态数据4、脑电信号特征5、神经网络6、脊髓刺激装置7;面部中心8,颈部中心9,肩关节10,肘关节11,腕关节12,手掌关节集合13。In the figure: a pair of cameras 1, EEG electrode array 2, computer 3, upper limb posture data 4, EEG signal features 5, neural network 6, spinal cord stimulation device 7; face center 8, neck center 9, shoulder joint 10, elbow joint 11, wrist joint 12, palm joint collection 13.
具体实施方式Detailed ways
以下参考说明书结合附图介绍本发明的一实施示例,对本发明进行进一步详细说明,并不限制本发明的范围。The following description is made with reference to the accompanying drawings to introduce an implementation example of the present invention, and the present invention is further described in detail, but the scope of the present invention is not limited.
附图中的内容并非按照实际比例绘制,为了结构清晰的目的,省略或放大了部分细节。The contents in the drawings are not drawn according to the actual scale, and some details are omitted or enlarged for the purpose of structural clarity.
如图1所示,具体实施的系统包括:As shown in Figure 1, the specific implementation system includes:
闭环硬脊膜外电刺激系统包括动作捕捉装置、脑电采集装置、控制装置、脊髓电刺激装置,其中:The closed-loop epidural electrical stimulation system includes a motion capture device, an electroencephalogram acquisition device, a control device, and a spinal cord electrical stimulation device, wherein:
动作捕捉装置,用于实时获取多角度的人体姿态图像,并将人体姿态图像发送给控制装置;A motion capture device, used to obtain human posture images from multiple angles in real time and send the human posture images to a control device;
脑电采集装置,用于实时获取人体的脑电信号(EEG,electroencephalo-graph),脑电信号经过前置放大和滤波后发送给控制装置;The EEG acquisition device is used to obtain the human body's EEG signals (EEG, electroencephalo-graph) in real time. The EEG signals are sent to the control device after pre-amplification and filtering;
控制装置,接收来自动作捕捉装置的人体姿态图像和来自脑电采集装置的脑电信号,进而实时处理和分析人体姿态图像中的上肢姿态数据4和脑电信号中的脑电信号特征5,计算电刺激参数,生成包含电刺激参数的指令并发送给脊髓电刺激装置;A control device receives a human posture image from a motion capture device and an EEG signal from an EEG acquisition device, and then processes and analyzes upper limb posture data 4 in the human posture image and EEG signal features 5 in the EEG signal in real time, calculates electrical stimulation parameters, generates instructions containing the electrical stimulation parameters, and sends the instructions to a spinal cord electrical stimulation device;
脊髓电刺激装置7,接收控制装置发来的包含电刺激参数的指令,向人体脊髓的硬脊膜发送电刺激脉冲,以实现上肢功能恢复。The spinal cord electrical stimulation device 7 receives instructions containing electrical stimulation parameters from the control device, and sends electrical stimulation pulses to the dura mater of the human spinal cord to achieve upper limb function recovery.
本发明上肢功能恢复为脊髓损伤或脑卒中后的上肢功能恢复。The upper limb function recovery of the present invention is upper limb function recovery after spinal cord injury or cerebral stroke.
动作捕捉装置主要由至少两台摄像头1组成,摄像头1从多视角采集人体上肢的图像作为人体姿态图像,并根据人体姿态图像恢复获得人体上肢各个关节的空间坐标。The motion capture device is mainly composed of at least two cameras 1. The cameras 1 collect images of human upper limbs from multiple perspectives as human posture images, and restore the spatial coordinates of various joints of the human upper limbs based on the human posture images.
脑电采集装置至少包括多个采集通道、一个参考通道和脑电电极阵列2,脑电电极阵列2包含了多个布置在人体头部大脑的电极,电极的数量与采集通道和参考通道的总数相同,每个采集通道分别连接各自的一个电极,参考通道连接一个电极并接地,采集通道的各个电极布置在不同的脑区上,采集脑区的脑电变化。具体实施中,设置八个采集通道,可以由目前临床上常用的一个或多个镇痛电极组成。The EEG acquisition device includes at least a plurality of acquisition channels, a reference channel and an EEG electrode array 2. The EEG electrode array 2 includes a plurality of electrodes arranged on the human head and brain. The number of electrodes is the same as the total number of acquisition channels and reference channels. Each acquisition channel is connected to an electrode of its own. The reference channel is connected to an electrode and grounded. The electrodes of the acquisition channels are arranged on different brain regions to acquire EEG changes in the brain regions. In a specific implementation, eight acquisition channels are set, which can be composed of one or more analgesic electrodes currently commonly used in clinical practice.
脑电采集装置包含用于对各个通道所采集的原始电信号进行处理的前置放大器、差分放大器和模拟滤波器,各个通道所采集的原始电信号依次经前置放大、差分放大和滤波处理后输出到控制装置。The EEG acquisition device includes a preamplifier, a differential amplifier and an analog filter for processing the original electrical signals collected by each channel. The original electrical signals collected by each channel are sequentially processed by preamplification, differential amplification and filtering and then output to the control device.
脑电采集装置是通过脑电电极阵列2的电极阵列采集到原始的头部电生理信号作为脑电信号。The EEG acquisition device acquires original head electrophysiological signals as EEG signals through the electrode array of the EEG electrode array 2.
控制装置可以采用计算机3,控制装置接收人体实时的姿态数据和原始脑电信号并进行预处理,生成处理后的带运动学数据的上肢姿态数据4和脑电信号特征5,再根据上肢姿态数据4和脑电信号特征5获得人体的当前运动状态和目标状态的差异,生成电刺激指令,发送给脊髓电刺激装置7。The control device can adopt a computer 3, which receives the real-time posture data and original EEG signals of the human body and performs pre-processing to generate processed upper limb posture data 4 and EEG signal characteristics 5 with kinematic data, and then obtains the difference between the current motion state and the target state of the human body based on the upper limb posture data 4 and the EEG signal characteristics 5, generates an electrical stimulation instruction, and sends it to the spinal cord electrical stimulation device 7.
上肢姿态数据指人体上肢各个关节的三维空间坐标,运动学数据指根据三维空间坐标计算的人体上肢各个关节的角度、角速度和角加速度等物理量。运动状态是指预定义的关于人体上肢执行各种动作的状态,例如手臂伸展、手掌握紧等,一系列连续的运动状态组成一个运动状态序列,进行康复训练的患者每刻都处于序列中的一个运动状态,定义为当前运动状态,序列中的下一个运动状态定义为目标运动状态。Upper limb posture data refers to the three-dimensional spatial coordinates of each joint of the human upper limb, and kinematic data refers to the physical quantities such as angle, angular velocity and angular acceleration of each joint of the human upper limb calculated based on the three-dimensional spatial coordinates. Motion state refers to the predefined state of the human upper limb performing various actions, such as arm extension, hand clenching, etc. A series of continuous motion states constitute a motion state sequence. Patients undergoing rehabilitation training are in a motion state in the sequence at every moment, which is defined as the current motion state, and the next motion state in the sequence is defined as the target motion state.
控制装置存储有基于深度学习的人体姿态估计程序,能够通过深度学习模型根据动作捕捉装置传输的多视角的人体姿态图像标注出人体上肢的关键点,并三维重建出各个关键点的空间坐标,生成人体上肢的运动学数据作为上肢姿态数据4;The control device stores a human posture estimation program based on deep learning, which can mark the key points of the upper limbs of the human body according to the multi-view human posture images transmitted by the motion capture device through the deep learning model, and three-dimensionally reconstruct the spatial coordinates of each key point to generate kinematic data of the upper limbs of the human body as the upper limb posture data 4;
控制装置存储有脑电信号处理程序,脑电信号处理程序对脑电采集装置传输的原始脑电信号进行带通滤波和空间滤波后,获得脑电信号特征5;具体是采集原始的头部电生理信号进行数字带通滤波,去除肌电信号,并用空间滤波器进行预处理。The control device stores an EEG signal processing program, which performs bandpass filtering and spatial filtering on the original EEG signal transmitted by the EEG acquisition device to obtain EEG signal feature 5; specifically, the original head electrophysiological signal is collected for digital bandpass filtering, the electromyography signal is removed, and the spatial filter is used for preprocessing.
控制装置存储有基于神经网络6构造的运动状态分类程序,运动状态分类程序根据运动学数据和脑电信号特征5判定人体当前的运动状态,进而获得运动状态和目标状态之间的差异;目标状态为预先设定的人体运动状态。The control device stores a motion state classification program constructed based on a neural network 6. The motion state classification program determines the current motion state of the human body according to kinematic data and EEG signal characteristics 5, and then obtains the difference between the motion state and the target state; the target state is a pre-set human motion state.
控制装置存储有电刺激控制程序,电刺激控制程序内置了根据人上肢各肌肉的运动学功能和支配上肢各肌肉的运动神经元在脊髓第二颈段到第一胸段之间的分布情况所预定义解剖学映射,电刺激控制程序首先根据预定义的解剖学映射确定电刺激位点,电刺激位点是在脊髓的硬脊膜上然后根据当前运动状态和目标状态之间的差异处理获得具体的电刺激参数,包括电刺激脉冲的频率、幅度、宽度和个数等参数,最后将电刺激位点和电刺激参数共同编码为电刺激指令发送给脊髓电刺激装置。The control device stores an electrical stimulation control program, which has a built-in anatomical mapping predefined according to the kinematic functions of the muscles of the upper limbs and the distribution of the motor neurons that control the muscles of the upper limbs between the second cervical segment and the first thoracic segment of the spinal cord. The electrical stimulation control program first determines the electrical stimulation site based on the predefined anatomical mapping. The electrical stimulation site is on the dura mater of the spinal cord. Then, based on the difference between the current motion state and the target state, specific electrical stimulation parameters are obtained, including parameters such as the frequency, amplitude, width and number of electrical stimulation pulses. Finally, the electrical stimulation site and the electrical stimulation parameters are encoded together as an electrical stimulation instruction and sent to the spinal cord electrical stimulation device.
具体地,电刺激控制程序中,将当前运动状态和目标状态之间的差异信息同时输入到PID控制器和动态逆动力学模型中,将PID控制器和动态逆动力学模型的输出结果相加后限幅处理获得电刺激脉冲的设置参数,进而输入到脊髓电刺激装置7中。电刺激控制程序不断重复上述过程,更新当前运动状态和目标状态,直到协助人体完成训练动作。Specifically, in the electrical stimulation control program, the difference information between the current motion state and the target state is simultaneously input into the PID controller and the dynamic inverse dynamics model, and the output results of the PID controller and the dynamic inverse dynamics model are added and then limited to obtain the setting parameters of the electrical stimulation pulse, which are then input into the spinal cord electrical stimulation device 7. The electrical stimulation control program continuously repeats the above process, updates the current motion state and the target state, until the training action is completed by assisting the human body.
脊髓电刺激装置7接收来自控制装置的电刺激指令,对电刺激指令中脊髓的硬脊膜上电刺激位点施加对应参数的电刺激脉冲序列,位于电刺激位点的运动神经元被激活,进而支配肌肉进行收缩,使上肢做出对应动作,再被动作捕捉装置和动作捕捉装置采集反馈到控制装置,新的姿态数据和原始脑电信号被监测到,不断循环往复闭环控制进行电刺激。The spinal cord electrical stimulation device 7 receives the electrical stimulation instruction from the control device, and applies an electrical stimulation pulse sequence with corresponding parameters to the electrical stimulation site on the dura mater of the spinal cord in the electrical stimulation instruction. The motor neurons located at the electrical stimulation site are activated, which in turn control the muscles to contract, causing the upper limbs to make corresponding movements. The movements are then collected by the motion capture device and fed back to the control device. The new posture data and the original EEG signal are monitored, and the closed-loop control is continuously repeated to perform electrical stimulation.
例如:For example:
A)在当前运动状态为前屈上举,目标状态为手臂伸展时,则生成电刺激指令,具体是在脊髓上的C5外侧,以20Hz频率,0.5mA幅度,0.2ms宽度。A) When the current movement state is forward flexion and the target state is arm extension, an electrical stimulation command is generated, specifically on the outside of C5 on the spinal cord, with a frequency of 20 Hz, an amplitude of 0.5 mA, and a width of 0.2 ms.
B)在当前运动状态为手臂伸展,目标状态为手掌张开时,则生成电刺激指令,具体是在脊髓上的C5中央和外侧,以20Hz频率,0.5mA幅度,0.2ms宽度。B) When the current movement state is arm extension and the target state is palm opening, an electrical stimulation command is generated, specifically at the center and outside of C5 on the spinal cord, with a frequency of 20 Hz, an amplitude of 0.5 mA, and a width of 0.2 ms.
C)在运当前动状态为手掌张开,目标状态为手掌握紧时,则生成电刺激指令,具体是在脊髓上的C5外侧和C6外侧,以30Hz频率,0.3mA幅度,0.2ms宽度。C) When the pre-exercise state is an open palm and the target state is a clenched palm, an electrical stimulation command is generated, specifically to the outside of C5 and C6 on the spinal cord, with a frequency of 30 Hz, an amplitude of 0.3 mA, and a width of 0.2 ms.
D)在当前运动状态为手掌握紧,目标状态为手臂收回时,则生成电刺激指令,具体是在脊髓上的C5外侧和C8外侧,以20Hz频率,0.3mA幅度,0.2ms宽度。D) When the current movement state is clenched hand and the target state is retracted arm, an electrical stimulation command is generated, specifically on the outside of C5 and C8 on the spinal cord, with a frequency of 20 Hz, an amplitude of 0.3 mA, and a width of 0.2 ms.
E)在当前运动状态为手臂内收,目标状态为手臂放松时,则生成电刺激指令,具体是在脊髓上的C2中央和外侧及C8外侧,以20Hz频率,0.5mA幅度,0.2ms宽度。E) When the current movement state is arm adduction and the target state is arm relaxation, an electrical stimulation command is generated, specifically at the center and lateral sides of C2 and the lateral sides of C8 on the spinal cord, with a frequency of 20 Hz, an amplitude of 0.5 mA, and a width of 0.2 ms.
具体实施例如可在人体康复训练时人体执行例如抓握物体的任务,但不限于此。In a specific implementation, for example, the human body can perform tasks such as grasping an object during human rehabilitation training, but the present invention is not limited thereto.
具体实施中,人体上肢分为面部中心8、颈部中心9、肩关节10、肘关节11、腕关节12和手掌关节集合13。In a specific implementation, the upper limbs of the human body are divided into a facial center 8, a neck center 9, a shoulder joint 10, an elbow joint 11, a wrist joint 12 and a palm joint set 13.
具体实施中,在脊髓设置多个位点,从脊椎的关节C2~T1之间的人体背部设置多个阵列排布的位点,位点阵列的列方向平行于脊椎方向,位点阵列的行方向垂直于脊椎方向。具体实施中,设置三列六行的18个位点,中间列的位点位于脊椎中心线所在的背部。In a specific implementation, multiple sites are set in the spinal cord, and multiple arrayed sites are set on the back of the human body between the spine joints C2 to T1. The column direction of the site array is parallel to the spine direction, and the row direction of the site array is perpendicular to the spine direction. In a specific implementation, 18 sites are set in three columns and six rows, and the sites in the middle column are located on the back where the center line of the spine is located.
具体实施中,闭环电刺激系统由摄像头1、脑电采集装置、计算机3和脊髓电刺激装置7组成。摄像头1通过网络与计算机3通讯,脑电采集装置通过蓝牙与计算机3通讯,计算机3上有人体姿态估计程序、脑电信号处理程序、电刺激控制程序和人机交互界面,脊髓电刺激装置7各通道的电流参数由脊髓电刺激装置7的控制模块控制,脊髓电刺激装置7的控制模块通过蓝牙与计算机3通讯。有多种无线通讯方式可以选择,如Zig-Bee、蓝牙或wifi等。脊髓刺激装置7的锂电池通过近距离无线充电器进行充电。In a specific implementation, the closed-loop electrical stimulation system is composed of a camera 1, an EEG acquisition device, a computer 3 and a spinal cord electrical stimulation device 7. The camera 1 communicates with the computer 3 through the network, the EEG acquisition device communicates with the computer 3 through Bluetooth, the computer 3 has a human posture estimation program, an EEG signal processing program, an electrical stimulation control program and a human-computer interaction interface, and the current parameters of each channel of the spinal cord electrical stimulation device 7 are controlled by the control module of the spinal cord electrical stimulation device 7, and the control module of the spinal cord electrical stimulation device 7 communicates with the computer 3 through Bluetooth. There are a variety of wireless communication methods to choose from, such as Zig-Bee, Bluetooth or wifi. The lithium battery of the spinal cord stimulation device 7 is charged by a close-range wireless charger.
摄像头1由1-3台摄像头组成,通过本地网络向计算机传输实时的人体运动图像。可选用2台普通的720P 30FPS办公用摄像头,通过局域网与计算机通讯。Camera 1 is composed of 1-3 cameras, which transmit real-time human motion images to the computer through the local network. Two ordinary 720P 30FPS office cameras can be selected to communicate with the computer through the local area network.
计算机3内装有的人体姿态估计程序,能够加载预训练的深度学习模型,实时对人体姿态图像进行分析,确定电刺激的参数,包括电刺激的区域、电流的强度和波形,通过蓝牙通讯装置发送给脊髓电刺激装置7。人体姿态估计程序采用卷积神经网络模型,使用公开的多视角人体姿态数据集进行训练并保存训练的模型。The human posture estimation program installed in the computer 3 can load the pre-trained deep learning model, analyze the human posture image in real time, determine the parameters of electrical stimulation, including the area of electrical stimulation, the intensity and waveform of the current, and send them to the spinal cord electrical stimulation device 7 through the Bluetooth communication device. The human posture estimation program adopts a convolutional neural network model, uses a public multi-view human posture data set for training and saves the trained model.
计算机3上的人机交互界面提供了人体当前姿态数据和运动状态的可视化监测窗口,并有调整电刺激策略的控制接口。The human-computer interaction interface on the computer 3 provides a visual monitoring window for the current posture data and motion state of the human body, and has a control interface for adjusting the electrical stimulation strategy.
脊髓刺激装置7通过外科手术植入到人体颈段椎板下方,脊髓硬脊膜上方,由内置的锂电池进行供电。The spinal cord stimulation device 7 is surgically implanted below the cervical vertebral lamina and above the spinal dura mater of the human body and is powered by a built-in lithium battery.
如图2所示,系统工作时,患者通过残存的感觉运动功能自主控制手臂做出小幅度的动作,相应地,运动意图有关的脑电信号发送给计算机3,同时患者人体形态被摄像头1捕捉并将图像发送给计算机3,计算机3上的人体姿态估计程序分析出人体当前的姿态信息,并计算人体上肢肘关节和各个指关节的坐标,角速度和角加速度传递给所述运动状态分类程序。As shown in FIG2 , when the system is working, the patient autonomously controls the arm to make small movements through the remaining sensory motor functions. Accordingly, the EEG signal related to the movement intention is sent to the computer 3. At the same time, the patient's body shape is captured by the camera 1 and the image is sent to the computer 3. The body posture estimation program on the computer 3 analyzes the current posture information of the human body, and calculates the coordinates of the elbow joint and each finger joint of the upper limb of the human body, and the angular velocity and angular acceleration are transmitted to the motion state classification program.
所述运动状态分类程序根据脑电信号和关节运动学数据判定当前运动状态及其目标状态,包括前屈上举、手臂伸展、手掌张开、手掌握紧、手臂内收和手臂放松。所述电刺激控制程序根据当前运动状态和目标状态制定电刺激策略,包括刺激的区域,电流的波形、频率和幅度,所述通讯程序将电刺激策略编码为指令发送给脊髓刺激装置7,执行相应的电刺激。The motion state classification program determines the current motion state and its target state according to the EEG signal and the joint kinematics data, including forward flexion and raising, arm extension, open palm, clenched palm, arm adduction and arm relaxation. The electrical stimulation control program formulates an electrical stimulation strategy according to the current motion state and the target state, including the stimulation area, the waveform, frequency and amplitude of the current. The communication program encodes the electrical stimulation strategy into instructions and sends them to the spinal cord stimulation device 7 to perform the corresponding electrical stimulation.
如图3所示,在康复训练准备阶段,首先应对摄像头进行标定,确定摄像头的内参和外参,包括相机相对位置、焦距等。同时使用公开的多视角人体姿态数据集训练基于卷积神经网络的姿态估计程序,在人体做出抓握训练动作时验证其有效性。As shown in Figure 3, in the preparation stage of rehabilitation training, the camera should be calibrated first to determine the camera's internal and external parameters, including the camera's relative position, focal length, etc. At the same time, a public multi-view human posture dataset is used to train a posture estimation program based on a convolutional neural network, and its effectiveness is verified when the human body performs grasping training movements.
在康复训练进行阶段,摄像头通过网络向计算机实时传输患者躯体图像数据流,姿态估计程序对上人体关键点进行标注,并根据摄像头的内外参数利用多视角图像进行三维重建,计算出人体上肢关节点的三维坐标传输给电刺激控制程序。During the rehabilitation training stage, the camera transmits the patient's body image data stream to the computer in real time through the network. The posture estimation program marks the key points of the upper body and uses multi-view images for three-dimensional reconstruction based on the internal and external parameters of the camera. The three-dimensional coordinates of the upper limb joints are calculated and transmitted to the electrical stimulation control program.
如图4所示,常见的人体关键点集合主要由基本的解剖学关节位置组成,本系统主要使用以下关键点:面部中心8,颈部中心9,肩关节10,肘关节11,腕关节12,手掌关节集合13。As shown in FIG4 , a common human body key point set is mainly composed of basic anatomical joint positions. This system mainly uses the following key points: face center 8 , neck center 9 , shoulder joint 10 , elbow joint 11 , wrist joint 12 , and palm joint set 13 .
可选地,手掌关节集合可根据运动状态的精细程度调整大小。例如,当设定有关手掌的运动状态仅关注手掌的张开和握紧时,手掌关节集合可只包含手掌中心和手指末端的关节;当设定有关手掌的运动状态还关注手掌闭合的形状时,手掌关节集合应包含人手指的全部关节。Optionally, the palm joint set can be resized according to the level of detail of the motion state. For example, when the motion state of the palm is set to focus only on the opening and closing of the palm, the palm joint set can only include the joints at the center of the palm and the ends of the fingers; when the motion state of the palm is set to focus on the closed shape of the palm, the palm joint set should include all the joints of the human fingers.
如图5所示是基于深度学习的运动状态分类程序的网络结构示意图,脑电信号和运动学数据作为神经网络的输入经过初步的特征提取和融合,传递给基于全连接网络的分类器,最终输出当前运动状态及其目标状态。基于端到端的学习框架,将收集到的脑电信号与运动学数据通过预处理后,分别输入两个一维卷积神经网络中进行特征提取,再将分别对两种信号提取的特征向量经过单层神经网络合并为一个兼容的向量空间,并通过三层全连接网络进行传递,最终通过训练数据得到一个运动分类器,能够根据相应输入数据,判定并输出运动状态及对应的目标状态。As shown in Figure 5, it is a schematic diagram of the network structure of the motion state classification program based on deep learning. EEG signals and kinematic data are used as inputs of the neural network, and after preliminary feature extraction and fusion, they are passed to the classifier based on the fully connected network, and finally the current motion state and its target state are output. Based on the end-to-end learning framework, the collected EEG signals and kinematic data are preprocessed and respectively input into two one-dimensional convolutional neural networks for feature extraction. The feature vectors extracted from the two signals are then merged into a compatible vector space through a single-layer neural network, and transmitted through a three-layer fully connected network. Finally, a motion classifier is obtained through training data, which can determine and output the motion state and the corresponding target state according to the corresponding input data.
如图6所示,被试正在执行一次抓握动作,脑电信号特征由具有特定位置的空间热点表示,被试者处于S1状态时,脑电信号特征表示被试者产生运动意图,此时身体姿态特征不明显;被试者处于S2状态时,产生伸出前臂的运动意图和相应的姿态特征;被试者处于S3状态时,产生张开手掌的运动意图和相应的姿态特征;被试者处于S4状态时,被试者产生抓握的运动意图和相应的姿态特征;被试者处于S5状态时,产生收回前臂的运动意图和相应的姿态特征;被试者处于S6状态时,无运动意图和关于抓握的姿态特征。使多名被试重复进行这样的抓握动作,收集对应的脑电信号和人体姿态数据,训练如图5所示的神经网络,即可用于在康复训练中根据人体的脑电信号特征和姿态特征判断人体的当前运动状态和目标状态,作为电刺激策略制定的依据。As shown in Figure 6, the subject is performing a grasping action, and the EEG signal features are represented by spatial hot spots with specific positions. When the subject is in the S1 state, the EEG signal features indicate that the subject has a movement intention, and the body posture features are not obvious at this time; when the subject is in the S2 state, the subject has a movement intention to extend the forearm and the corresponding posture features; when the subject is in the S3 state, the subject has a movement intention to open the palm and the corresponding posture features; when the subject is in the S4 state, the subject has a movement intention to grasp and the corresponding posture features; when the subject is in the S5 state, the subject has a movement intention to retract the forearm and the corresponding posture features; when the subject is in the S6 state, there is no movement intention and posture features about grasping. Make multiple subjects repeat such grasping actions, collect corresponding EEG signals and human posture data, and train the neural network shown in Figure 5, which can be used to judge the current movement state and target state of the human body according to the EEG signal features and posture features of the human body in rehabilitation training as the basis for formulating electrical stimulation strategies.
如图7所示,被试在执行如图6所示的抓握动作的6个状态的过程中,电刺激控制程序制定了对应于6种状态的电刺激策略S1、S2、S3、S4、S5、S6,电刺激位点表示为图中电极阵列中具有特定位置的带有阴影的矩形,电刺激的波形、脉宽、幅值和频率表示为图中上方的折现和频率值。As shown in Figure 7, when the subjects were performing the six states of the grasping action shown in Figure 6, the electrical stimulation control program formulated electrical stimulation strategies S1, S2, S3, S4, S5, and S6 corresponding to the six states. The electrical stimulation sites were represented by shaded rectangles with specific positions in the electrode array in the figure, and the waveform, pulse width, amplitude, and frequency of the electrical stimulation were represented by the discounted and frequency values at the top of the figure.
图中C2,C3,C5,C6,C7,C8,T1表示脊髓的对应节段,支配前肢各个肌肉的运动神经元集中分布在不同的节段上,当电刺激对应节段时,激活该区域的运动神经元支配相应骨骼肌运动,驱动前臂和手掌做出相应的动作。In the figure, C2, C3, C5, C6, C7, C8, and T1 represent the corresponding segments of the spinal cord. The motor neurons that control the muscles of the forelimbs are concentrated in different segments. When the corresponding segments are electrically stimulated, the motor neurons in this area are activated to control the movement of the corresponding skeletal muscles, driving the forearms and palms to make corresponding movements.
如图8所示,根据人上肢各肌肉的功能和支配这些肌肉的运动神经元在脊髓第二颈段到第一胸段之间的分布情况预定义了解剖学映射,所述解剖学映射内置于所述电刺激控制程序中。As shown in FIG8 , an anatomical map is predefined according to the functions of the muscles of the upper limbs of a person and the distribution of the motor neurons that control these muscles between the second cervical segment and the first thoracic segment of the spinal cord, and the anatomical map is built into the electrical stimulation control program.
电刺激策略由一组电刺激参数决定,电刺激参数包括位点、波形、脉宽、频率、幅值,其中波形和脉宽通过已知的临床研究和预实验确定,位点由如图8所示的解剖学映射确定,频率和幅值和时间由如图9所示的闭环控制回路计算和更新,图中的特征融合模块由如图5所示的运动状态分类程序实现,根据脑电与运动学特征判断的人体当前运动状态和目标运动状态,计算机3执行闭环脊髓电刺激控制。。The electrical stimulation strategy is determined by a set of electrical stimulation parameters, including site, waveform, pulse width, frequency, and amplitude. The waveform and pulse width are determined by known clinical studies and pre-experiments, the site is determined by the anatomical mapping shown in FIG8 , and the frequency, amplitude, and time are calculated and updated by the closed-loop control loop shown in FIG9 . The feature fusion module in the figure is implemented by the motion state classification program shown in FIG5 . According to the current motion state and target motion state of the human body determined by the EEG and kinematic features, the computer 3 performs closed-loop spinal cord electrical stimulation control. .
电刺激时间长短与运动状态的持续时间相关;电刺激频率与目标动作关节角度相关,可以在每次康复训练前几轮根据人体情况标定,所述标定者优选是临床医生或物理治疗师。在本实施方案中,选择电刺激频率和幅值为闭环控制自整定参数,采用PID与逆动力学模型相结合的控制方法,实际运动状态与根据脑电与运动学特征判断的目标运动状态相比较得到运动状态偏差,通过PID计算出电刺激频率和幅值偏差,作为逆动力学模型的输出误差,同时使用实时的关节运动的角速度等运动学数据作为负反馈输入,然后如图中虚线所示使用误差传播的方法更新逆动力学模型的连接权系数,最后将逆动力学模型输出与PID输出之和作限幅,输出到所述脊髓刺激装置。在康复训练时,经过几轮模型更新后,逆动力学模型连接权系数将达到稳定状态。其中,动态逆动力学模型可以使用神经网络搭建,该模型建立的是电刺激频率和幅值与目标运动状态的关系。The duration of the electrical stimulation is related to the duration of the motion state; the electrical stimulation frequency is related to the target action joint angle, and can be calibrated according to the human body condition in the first few rounds of each rehabilitation training. The calibrator is preferably a clinician or a physical therapist. In this embodiment, the electrical stimulation frequency and amplitude are selected as closed-loop control self-tuning parameters, and a control method combining PID and an inverse dynamics model is adopted. The actual motion state is compared with the target motion state judged according to the EEG and kinematic characteristics to obtain the motion state deviation. The electrical stimulation frequency and amplitude deviation are calculated by PID as the output error of the inverse dynamics model, and the real-time kinematic data such as the angular velocity of the joint motion are used as negative feedback input. Then, as shown in the dotted line in the figure, the error propagation method is used to update the connection weight coefficient of the inverse dynamics model, and finally the sum of the inverse dynamics model output and the PID output is limited and output to the spinal cord stimulation device. During rehabilitation training, after several rounds of model updating, the connection weight coefficient of the inverse dynamics model will reach a stable state. Among them, the dynamic inverse dynamics model can be built using a neural network, which establishes the relationship between the electrical stimulation frequency and amplitude and the target motion state.
对于动态逆动力学模型参数,通过设置不同的数值进行系统仿真实验,比较其实验效果来确定。在PID反馈控制部分,PID参数可采用Cohen-Coon法、CHR法来确定。For the parameters of the dynamic inverse dynamics model, the system simulation experiments are performed by setting different values and comparing the experimental results. In the PID feedback control part, the PID parameters can be determined by the Cohen-Coon method and the CHR method.
Claims (5)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110534939.6A CN113426007B (en) | 2021-05-17 | 2021-05-17 | A closed-loop epidural electrical stimulation system for upper limb function recovery |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110534939.6A CN113426007B (en) | 2021-05-17 | 2021-05-17 | A closed-loop epidural electrical stimulation system for upper limb function recovery |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113426007A CN113426007A (en) | 2021-09-24 |
CN113426007B true CN113426007B (en) | 2024-04-19 |
Family
ID=77802419
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110534939.6A Active CN113426007B (en) | 2021-05-17 | 2021-05-17 | A closed-loop epidural electrical stimulation system for upper limb function recovery |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113426007B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113926083A (en) * | 2021-10-25 | 2022-01-14 | 韦朗(上海)医疗科技有限公司 | Functional rehabilitation device and control system and method thereof |
CN117618777A (en) * | 2024-01-24 | 2024-03-01 | 北京析芒医疗科技有限公司 | Exercise function recovery system and stimulation scheme determining method thereof |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109453462A (en) * | 2018-11-06 | 2019-03-12 | 苏州大学 | A kind of functional electrostimulation device and system |
CN111973874A (en) * | 2020-08-14 | 2020-11-24 | 北京航空航天大学 | Photoelectric combined stimulation device and method |
CN112754499A (en) * | 2021-01-25 | 2021-05-07 | 中国科学院心理研究所 | System and method for synchronously recording electrophysiological signals of brain and spinal cord |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP4378520A1 (en) * | 2015-12-22 | 2024-06-05 | Ecole Polytechnique Fédérale de Lausanne (EPFL) | System for selective spatiotemporal stimulation of the spinal cord |
-
2021
- 2021-05-17 CN CN202110534939.6A patent/CN113426007B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109453462A (en) * | 2018-11-06 | 2019-03-12 | 苏州大学 | A kind of functional electrostimulation device and system |
CN111973874A (en) * | 2020-08-14 | 2020-11-24 | 北京航空航天大学 | Photoelectric combined stimulation device and method |
CN112754499A (en) * | 2021-01-25 | 2021-05-07 | 中国科学院心理研究所 | System and method for synchronously recording electrophysiological signals of brain and spinal cord |
Non-Patent Citations (1)
Title |
---|
王永骥等.《 硬脊膜外脊髓电刺激器的实验设计》.《中国临床康复》.2006,第10卷(第29期),118-120. * |
Also Published As
Publication number | Publication date |
---|---|
CN113426007A (en) | 2021-09-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109394476B (en) | Method and system for automatic intention recognition of brain muscle information and intelligent control of upper limbs | |
Lebedev et al. | Brain-machine interfaces: from basic science to neuroprostheses and neurorehabilitation | |
CN111584030A (en) | Idea control intelligent rehabilitation system based on deep learning and complex network and application | |
Loconsole et al. | An EMG-based approach for on-line predicted torque control in robotic-assisted rehabilitation | |
CN113426007B (en) | A closed-loop epidural electrical stimulation system for upper limb function recovery | |
CN111584031B (en) | Brain-controlled intelligent limb rehabilitation system based on portable electroencephalogram acquisition equipment and application | |
JP2023516309A (en) | Systems and methods for determining user intent from limb or body motion or trajectory for use in controlling neuromuscular stimulation or prosthetic vessel motion | |
Abougarair et al. | Real time classification for robotic arm control based electromyographic signal | |
TWI762313B (en) | Immersive and multi-posture rehabilitation training system with active/passive physical coordination | |
CN106345055A (en) | Gait recognition-based functional electrical muscular stimulation walking aid | |
Chen et al. | Neucuberehab: A pilot study for eeg classification in rehabilitation practice based on spiking neural networks | |
Hu et al. | EEG-based classification of upper-limb ADL using SNN for active robotic rehabilitation | |
DE102020210676A1 (en) | CLOSED-LOOP COMPUTER-BRAIN INTERFACE DEVICE | |
CN115177864A (en) | Functional electrical stimulation closed-loop regulation and control method based on muscle activation degree and LSTM | |
Kibleur et al. | Spatiotemporal maps of proprioceptive inputs to the cervical spinal cord during three-dimensional reaching and grasping | |
CN104971433B (en) | The functional electrostimulation athletic rehabilitation system and method manually merged with autonomous control | |
Wang et al. | Lower limb motion recognition based on surface electromyography signals and its experimental verification on a novel multi-posture lower limb rehabilitation robots☆ | |
CN110908506B (en) | Bionic intelligent algorithm-driven active and passive integrated rehabilitation method, device, storage medium and equipment | |
CN113995956B (en) | Stroke electrical stimulation training intention recognition device based on myoelectricity expected posture adjustment | |
CN110400618A (en) | A 3D gait generation method based on human motion structure features | |
CN114767463A (en) | Consciousness control exercise rehabilitation system and method based on surface myoelectricity | |
CN113730190A (en) | Upper limb rehabilitation robot system with three-dimensional space motion | |
Kawase et al. | Estimating joint angles from biological signals for multi-joint exoskeletons | |
CN117563135A (en) | Multi-mode information visual functional electric stimulation closed-loop regulation and control system and method | |
Younessi Heravi et al. | Application of a neural interface for restoration of leg movements: Intra-spinal stimulation using the brain electrical activity in spinally injured rabbits. |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |