CN109009586B - A method for continuous decoding of electromyography based on the natural driving angle of artificial wrist joint - Google Patents
A method for continuous decoding of electromyography based on the natural driving angle of artificial wrist joint Download PDFInfo
- Publication number
- CN109009586B CN109009586B CN201810664049.5A CN201810664049A CN109009586B CN 109009586 B CN109009586 B CN 109009586B CN 201810664049 A CN201810664049 A CN 201810664049A CN 109009586 B CN109009586 B CN 109009586B
- Authority
- CN
- China
- Prior art keywords
- angle
- wrist joint
- joint
- wrist
- axis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 210000003857 wrist joint Anatomy 0.000 title claims abstract description 85
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000002567 electromyography Methods 0.000 title description 66
- 210000000245 forearm Anatomy 0.000 claims abstract description 18
- 210000003205 muscle Anatomy 0.000 claims abstract description 13
- 230000008859 change Effects 0.000 claims abstract description 7
- 238000005070 sampling Methods 0.000 claims abstract description 7
- 238000013528 artificial neural network Methods 0.000 claims description 31
- 210000000707 wrist Anatomy 0.000 claims description 26
- 238000005452 bending Methods 0.000 claims description 23
- 239000013598 vector Substances 0.000 claims description 18
- 210000002310 elbow joint Anatomy 0.000 claims description 15
- 210000002569 neuron Anatomy 0.000 claims description 14
- 230000000694 effects Effects 0.000 claims description 12
- 230000006870 function Effects 0.000 claims description 11
- 238000004364 calculation method Methods 0.000 claims description 8
- 230000009471 action Effects 0.000 claims description 7
- 230000003183 myoelectrical effect Effects 0.000 claims description 6
- 238000007781 pre-processing Methods 0.000 claims description 6
- 238000001914 filtration Methods 0.000 claims description 5
- 238000012360 testing method Methods 0.000 claims description 4
- 238000012549 training Methods 0.000 claims description 4
- 238000010801 machine learning Methods 0.000 claims description 3
- 239000011159 matrix material Substances 0.000 claims description 3
- 210000000811 metacarpophalangeal joint Anatomy 0.000 claims description 3
- 230000009466 transformation Effects 0.000 claims description 3
- 238000010276 construction Methods 0.000 claims description 2
- 238000011478 gradient descent method Methods 0.000 claims description 2
- 101800004637 Communis Proteins 0.000 claims 1
- 238000012952 Resampling Methods 0.000 claims 1
- 230000006835 compression Effects 0.000 abstract 1
- 238000007906 compression Methods 0.000 abstract 1
- 230000008569 process Effects 0.000 description 5
- 238000000605 extraction Methods 0.000 description 4
- 210000004247 hand Anatomy 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 210000001364 upper extremity Anatomy 0.000 description 2
- LFQSCWFLJHTTHZ-UHFFFAOYSA-N Ethanol Chemical compound CCO LFQSCWFLJHTTHZ-UHFFFAOYSA-N 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000008602 contraction Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 210000003414 extremity Anatomy 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004118 muscle contraction Effects 0.000 description 1
- 210000001087 myotubule Anatomy 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 210000002027 skeletal muscle Anatomy 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
- A61F2/50—Prostheses not implantable in the body
- A61F2/68—Operating or control means
- A61F2/70—Operating or control means electrical
- A61F2/72—Bioelectric control, e.g. myoelectric
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/389—Electromyography [EMG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Public Health (AREA)
- Biomedical Technology (AREA)
- Veterinary Medicine (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Artificial Intelligence (AREA)
- Surgery (AREA)
- Physiology (AREA)
- Cardiology (AREA)
- Psychiatry (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Computation (AREA)
- Mathematical Physics (AREA)
- Fuzzy Systems (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Transplantation (AREA)
- Vascular Medicine (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Prostheses (AREA)
Abstract
Description
技术领域technical field
本发明属于智能假手与生机电一体化技术领域,涉及一种假手腕关节人机自然驱动角度的肌电连续解码方法。The invention belongs to the technical field of intelligent prosthetic hand and biomechanical integration, and relates to an electromyographic continuous decoding method for the natural driving angle of a prosthetic wrist joint of a human and a machine.
背景技术Background technique
根据中国残联最新统计资料显示,我国现今肢体残疾人数约为2472万人,其中手部残疾患者达上千万。手部功能的缺失不仅影响残疾人的生活与工作,更给其心理带来沉重打击。传统假手只起到修饰功能,不能满足其日常生活所需。智能假手的出现弥补了传统假手功能的不足,其中肌电控制假手因穿戴方便、控制准确、功能强大而成为研究的热点。According to the latest statistics from the China Disabled Persons' Federation, there are about 24.72 million people with physical disabilities in my country, including tens of millions of people with hand disabilities. The lack of hand function not only affects the life and work of the disabled, but also brings a heavy blow to their psychology. The traditional prosthetic hand only has the function of modification and cannot meet the needs of its daily life. The emergence of intelligent prosthetic hands makes up for the deficiencies of traditional prosthetic hands. Among them, myoelectric-controlled prosthetic hands have become a research hotspot because of their convenient wearing, accurate control and powerful functions.
人体表面肌电信号是一种生物电信号,能够客观的反应人体的运动状态并且会超前实际动作产生,具有预见性,可以实现人体运动意图的感知。现有的肌电假手,大部分将研究重点放在利用表面肌电信号识别人手动作分类从而实现假手抓取动作预测,然而在假手运动过程中,腕关节的驱动角度很大程度上决定了假手操作的灵活性,所以为了实现假手更好的拟人化,利用手臂残存的表面肌电信号解码假手腕关节人机自然驱动角度显得极其重要。基于此,利用手臂表面肌电信号连续解码手腕关节运动角度从而提供合适的假手腕关节人机自然驱动角度是当前研究的关键点。Human surface EMG is a kind of bioelectric signal, which can objectively reflect the movement state of the human body and will be generated ahead of the actual action. It is predictable and can realize the perception of human movement intention. Most of the existing EMG prosthetic hands focus on the use of surface EMG signals to identify human hand movements and predict the grasping action of the prosthetic hand. However, during the prosthetic hand movement, the driving angle of the wrist joint largely determines the prosthetic hand. Therefore, in order to achieve better anthropomorphism of the prosthetic hand, it is extremely important to use the residual surface EMG signal of the arm to decode the natural driving angle of the artificial wrist joint. Based on this, it is the key point of current research to continuously decode the motion angle of the wrist joint by using the EMG signal on the arm surface to provide a suitable natural driving angle of the artificial wrist joint.
发明内容SUMMARY OF THE INVENTION
本发明的目的在于克服上述现有技术的缺点,提供一种假手腕关节人机自然驱动角度的肌电连续解码方法,该方法让残疾人想象其缺失手与健全手做相同角度的腕关节运动,此时采集残疾人残肢前臂的表面肌电信号与健侧腕关节运动角度,从而建立表面肌电信号连续解码假手腕关节人机自然驱动角度模型。实现利用残肢前臂表面肌电信号连续解码假手腕关节人机自然驱动角度,从而满足手部残疾患者日常生活所需。The purpose of the present invention is to overcome the above-mentioned shortcomings of the prior art, and to provide a method for continuous decoding of myoelectricity of a prosthetic wrist joint man-machine natural drive angle, which allows the disabled to imagine that his missing hand and his healthy hand make wrist joint movements of the same angle. , at this time, the surface EMG signal of the forearm of the disabled residual limb and the movement angle of the unaffected wrist joint are collected, so as to establish the surface EMG signal to continuously decode the human-machine natural driving angle model of the artificial wrist joint. Realize the continuous decoding of the human-machine natural driving angle of the artificial wrist joint by using the surface electromyographic signal of the residual limb forearm, so as to meet the daily needs of patients with hand disabilities.
为达到上述目的,本发明采用以下技术方案予以实现:To achieve the above object, the present invention adopts the following technical solutions to realize:
一种人手臂表面肌电信号连续解码假手腕关节人机自然驱动角度的方法,包括下述步骤:A method for continuously decoding the human-machine natural driving angle of a false wrist joint by an electromyogram signal on the surface of a human arm, comprising the following steps:
第一步:利用动作捕捉系统记录健侧手腕关节运动三维坐标,通过人手腕关节运动学建模方法计算手腕弯曲/伸展角度。The first step: use the motion capture system to record the three-dimensional coordinates of the unaffected wrist joint movement, and calculate the wrist bending/extension angle through the kinematics modeling method of the human wrist joint.
上述方法中,选取合理的腕关节运动捕捉方案并建立腕关节局部坐标系,建立腕关节运动模型,利用运动学方法计算出腕关节在弯曲伸展过程中的角度变化。最终得到腕关节弯曲伸展角度公式如下:In the above method, a reasonable wrist motion capture scheme is selected, a local coordinate system of the wrist joint is established, a wrist joint motion model is established, and a kinematic method is used to calculate the angle change of the wrist joint during the bending and extension process. Finally, the formula for the flexion and extension angle of the wrist joint is obtained as follows:
θ=arccos(T·i2·i1)θ=arccos(T·i 2 ·i 1 )
式中,T为腕关节局部坐标系到肘关节局部坐标系的转换矩阵,i1、i2分别为肘关节和腕关节矢状轴方向的单位矢量。In the formula, T is the transformation matrix from the local coordinate system of the wrist joint to the local coordinate system of the elbow joint, and i 1 and i 2 are the unit vectors of the sagittal axis direction of the elbow joint and the wrist joint, respectively.
第二步:利用肌电采集仪同步采集前臂残存侧六块肌肉的表面肌电信号。所述六块残存肌肉分别为桡侧腕长伸肌、桡侧腕屈肌、尺侧腕长伸肌、尺侧腕屈肌、指总伸肌、指浅屈肌。Step 2: Use the EMG acquisition instrument to simultaneously collect the surface EMG signals of the six muscles on the remaining side of the forearm. The six remaining muscles are extensor carpi radialis longus, flexor carpi radialis longus, extensor carpi ulnaris longus, flexor carpi ulnaris, extensor digitorum common, and flexor digitorum superficialis.
第三步:对采集到的六通道表面肌电信号进行预处理与特征提取。由于表面肌电仪采样频率为2048Hz,三维运动捕捉系统采样频率为100Hz,所以对表面肌电信号特征值进行重采样,实现表面肌电信号与腕关节运动学数据具有相同的采样频率。The third step: preprocessing and feature extraction on the collected six-channel surface EMG signals. Since the sampling frequency of the surface EMG is 2048Hz and the sampling frequency of the 3D motion capture system is 100Hz, the eigenvalues of the surface EMG signal are resampled to achieve the same sampling frequency of the surface EMG signal and the wrist kinematics data.
第四步:采用机器学习的方法,建立BP神经网络,实现人手臂表面肌电信号连续解码腕关节弯曲/伸展的角度。首先设置BP神经网络的网络参数,其次对BP神经网络进行训练,最后对其进行测试。Step 4: Using the method of machine learning, a BP neural network is established to realize the continuous decoding of the bending/extending angle of the wrist joint by the surface EMG signal of the human arm. First set the network parameters of the BP neural network, secondly train the BP neural network, and finally test it.
上述方法中,构建三层BP神经网络,提取表面肌电信号的肌电活跃强度特征值作为网络输入,由腕关节运动学模型计算的关节角度作为网络输出,中间层设置10个神经元,每个神经元采用Sigmoid作用函数。In the above method, a three-layer BP neural network is constructed, the EMG activity intensity characteristic value of the surface EMG signal is extracted as the network input, the joint angle calculated by the wrist joint kinematics model is used as the network output, and 10 neurons are set in the middle layer. Each neuron uses a sigmoid action function.
第五步:采集残侧前臂表面肌电信号,将采集到的表面肌电信号进行预处理与特征提取。将肌电活跃强度特征值输入手腕关节角度连续解码模型,输出连续变化的手腕关节运动角度,并计算网络预测关节角度与运动学计算出的关节角度之间的线性相关系数,判断人手臂表面肌电信号连续解码假手腕关节人机自然驱动角度的准确性。Step 5: Collect the surface EMG signal of the residual forearm, and perform preprocessing and feature extraction on the collected surface EMG signal. Input the EMG activity intensity feature value into the wrist joint angle continuous decoding model, output the continuously changing wrist joint motion angle, and calculate the linear correlation coefficient between the joint angle predicted by the network and the joint angle calculated by kinematics, and determine the surface muscle of the human arm. Accuracy of electrical signals for continuous decoding of human-machine natural actuation angles of a prosthetic wrist joint.
与现有技术相比,本发明具有以下有益效果:Compared with the prior art, the present invention has the following beneficial effects:
本发明操作简单且精确度高。三维运动捕捉系统可以同时实现高分辨率与高捕捉频率,由此计算的关节角度具有高精确性;与传统佩戴式角度传感器相比,不会对表面肌电信号造成压迫式干扰;具有与肌电仪同步采集的接口,能够实现三维运动捕捉角度与表面肌电信号采集同时进行。此外,肌电仪的采样频率为2048Hz,可以实时采集表面肌电信号变化情况。The present invention has simple operation and high precision. The three-dimensional motion capture system can achieve high resolution and high capture frequency at the same time, and the calculated joint angle has high accuracy; compared with traditional wearable angle sensors, it does not cause compressive interference to surface EMG signals; The interface for synchronous acquisition of electrical instruments can realize the simultaneous acquisition of three-dimensional motion capture angle and surface EMG signal acquisition. In addition, the sampling frequency of the EMG instrument is 2048Hz, which can collect the changes of surface EMG signals in real time.
本发明建立了表面肌电信号连续解码假手腕关节驱动角度的预测模型。骨骼肌的拉伸与收缩带动腕关节运动,在肌肉收缩过程中,与之对应的表面肌电信号幅值会有不同的变化,所以可以利用表面肌电信号的肌电活跃强度连续解码假手腕关节人机自然驱动角度。让残疾人想象着缺失手与健全手的腕关节同步进行相同的运动,经过运动想象训练之后,利用健全侧腕关节运动角度作为残侧假手的腕关节人机自然驱动角度。模型输入为残侧前臂表面肌电信号,避免了由健全人建模到残疾人建模带来的个体性差异,从而实现了表面肌电信号连续解码假手腕关节人机自然驱动角度,在生物医疗、人机工程等领域具有潜在的应用价值。The invention establishes a prediction model for continuously decoding the driving angle of the artificial wrist joint by the surface electromyography signal. The stretching and contraction of the skeletal muscle drives the movement of the wrist joint. During the muscle contraction process, the amplitude of the surface EMG signal corresponding to it will change differently, so the EMG activity intensity of the surface EMG signal can be used to continuously decode the artificial wrist. Joint man-machine natural drive angle. Let the disabled imagine the wrist joint of the missing hand and the healthy hand to perform the same movement synchronously. After the motor imagery training, the movement angle of the wrist joint on the sound side is used as the natural driving angle of the wrist joint of the prosthetic hand on the residual side. The input of the model is the surface EMG signal of the residual forearm, which avoids the individual differences caused by the modeling of the healthy person and the disabled person, so that the surface EMG signal can continuously decode the natural driving angle of the artificial wrist joint. It has potential application value in medical, ergonomics and other fields.
附图说明Description of drawings
图1是手臂表面肌电信号连续解码假手腕关节人机自然驱动角度的方法框图;Fig. 1 is a block diagram of the method for continuously decoding the natural driving angle of artificial wrist joint by the EMG signal on the arm surface;
图2是右侧上肢标记点位置和坐标系设置示意图;其中P1为肘关节处,P2为前臂桡侧处,P3为手腕外侧处,P4为手腕内侧处,P5为右手中指掌指关节处;Figure 2 is a schematic diagram of the position of the right upper limb marker point and the setting of the coordinate system; wherein P1 is the elbow joint, P2 is the radial side of the forearm, P3 is the outer side of the wrist, P4 is the inner side of the wrist, and P5 is the middle finger of the right hand metacarpophalangeal joint;
图3是腕关节弯曲伸展角度计算结果示意图;Fig. 3 is the schematic diagram of the calculation result of wrist flexion and extension angle;
图4是手臂六通道表面肌电信号肌电活跃强度特征值;Figure 4 is the characteristic value of the EMG activity intensity of the arm's six-channel surface EMG signal;
图5是BP神经网络算法基本流程图;Fig. 5 is the basic flow chart of BP neural network algorithm;
图6是手臂表面肌电信号连续解码假手腕关节人机自然驱动角度结果图。Figure 6 is the result of continuous decoding of the artificial wrist joint's natural driving angle of the artificial wrist joint by the EMG signal on the arm surface.
具体实施方式Detailed ways
下面结合附图对本发明做进一步详细描述:Below in conjunction with accompanying drawing, the present invention is described in further detail:
参见图1,本发明利用三维运动捕捉系统记录健侧手腕关节弯曲伸展过程运动学数据,计算出腕关节弯曲伸展的角度;肌电仪同步采集残侧前臂肌肉的表面肌电信号,经预处理和特征提取得到肌电活跃强度特征;将肌电活跃强度特征作为BP神经网络的输入,腕关节弯曲伸展角度作为BP神经网络的输出,对BP神经网络进行训练,设定误差范围,满足误差条件后停止迭代,得到稳定的手臂解码假手腕关节人机自然驱动角度模型;最后输入测试的残侧表面肌电信号活跃强度,输出预测的假手腕关节人机自然驱动角度。具体实施方案如下:Referring to Fig. 1, the present invention uses a three-dimensional motion capture system to record the kinematic data of the unaffected wrist joint bending and stretching process, and calculates the angle of the wrist joint bending and stretching; the electromyography instrument synchronously collects the surface electromyographic signal of the residual side forearm muscle, and is preprocessed. and feature extraction to obtain the EMG activity intensity feature; the EMG activity intensity feature is used as the input of the BP neural network, and the wrist flexion and extension angle is used as the output of the BP neural network, and the BP neural network is trained, and the error range is set to meet the error conditions. After stopping the iteration, a stable arm decoding artificial wrist joint man-machine natural driving angle model was obtained; finally, the active strength of the tested residual surface EMG signal was input, and the predicted artificial wrist joint man-machine natural driving angle was output. The specific implementation is as follows:
第一步:由运动学数据计算腕关节弯曲伸展角度,具体方法如下:Step 1: Calculate the flexion and extension angle of the wrist joint from the kinematic data. The specific method is as follows:
(1)手腕关节运动捕捉mark点标记位置选取与关节局部坐标系建立:(1) Wrist joint motion capture mark position selection and joint local coordinate system establishment:
图2给出了右侧上肢mark点的粘贴方案,为了保证mark点不被遮挡,受试者采取坐姿状态,右侧大臂和前臂水平抬起并保持静止,手背向上做腕关节弯曲伸展。根据运动学原理,每个刚体3维空间中具有6个自由度,要确定运动刚体在三维空间中的位姿,需要知道刚体上非共线3个点的位置坐标。所以,在肘关节处设置一个mark点,记为P1,前臂桡侧设置一个mark点,记为P2,在手腕外侧和内侧分别设置一个mark点,记为P3和P4,再在右手中指掌指关节处设置一个mark点,记为P5。Figure 2 shows the sticking scheme of the mark points on the right upper limb. In order to ensure that the mark points are not blocked, the subjects took a sitting position, the right forearm and forearm were raised horizontally and kept still, and the wrist joint was bent and stretched with the back of the hand upward. According to the principle of kinematics, each rigid body has 6 degrees of freedom in the 3-dimensional space. To determine the pose of the moving rigid body in the 3-dimensional space, it is necessary to know the position coordinates of three non-collinear points on the rigid body. Therefore, set a mark point at the elbow joint, denoted as P 1 , set a mark point on the radial side of the forearm, denoted as P 2 , set a mark point at the outer and inner side of the wrist, denoted as P 3 and P 4 , A mark point is set at the metacarpophalangeal joint of the middle finger of the right hand, denoted as P 5 .
肘关节局部坐标系如图2所示:The local coordinate system of the elbow joint is shown in Figure 2:
肘关节局部坐标原点为P1,P1与P2连线为x轴,方向指向P2;由P1、P2、P3三点构成平面的法线为y轴,方向指向身体内侧;由右手规则可知,x轴与y轴构成平面的法向量为z轴,方向向上。x、y、z轴的单位矢量计算公式分别为:The local coordinate origin of the elbow joint is P 1 , the line connecting P 1 and P 2 is the x-axis, and the direction points to P 2 ; the normal line of the plane formed by the three points P 1 , P 2 and P 3 is the y-axis, and the direction points to the inside of the body; It can be seen from the right-hand rule that the normal vector of the plane formed by the x-axis and the y-axis is the z-axis, and the direction is upward. The unit vector calculation formulas for the x, y, and z axes are:
k1=i1×j1 k 1 =i 1 ×j 1
腕关节局部坐标系如图2所示:The local coordinate system of the wrist joint is shown in Figure 2:
腕关节局部坐标原点为P3与P4连线中点,原点与P5连线为x轴,方向指向P5;由P3、P4、P5三点构成平面的法向量为z轴,方向向下;由右手规则可知,x轴与z轴构成平面的法向量为y轴,方向指向身体内侧。x、y、z轴的单位矢量计算公式为:The origin of the local coordinates of the wrist joint is the midpoint of the line connecting P3 and P4, the line connecting the origin and P5 is the x - axis, and the direction points to P5 ; the normal vector of the plane formed by the three points P3 , P4, and P5 is the z-axis , the direction is downward; according to the right-hand rule, the normal vector of the plane formed by the x-axis and the z-axis is the y-axis, and the direction points to the inside of the body. The unit vector calculation formula for the x, y, and z axes is:
k2=i2×j2 k 2 =i 2 ×j 2
(2)手腕关节运动角度计算:(2) Calculation of wrist joint movement angle:
在肘关节与腕关节局部坐标系基础上进行腕关节在人体矢状面内的弯曲/伸展角的求解,以θ表示手腕的弯曲/伸展角。Based on the local coordinate system of the elbow joint and the wrist joint, the flexion/extension angle of the wrist joint in the sagittal plane of the human body is solved, and the flexion/extension angle of the wrist is represented by θ.
θ=arccos(T·i2·i1)θ=arccos(T·i 2 ·i 1 )
式中,T为腕关节局部坐标系到肘关节局部坐标系的转换矩阵,i1、i2分别为肘关节和腕关节矢状轴方向的单位矢量。In the formula, T is the transformation matrix from the local coordinate system of the wrist joint to the local coordinate system of the elbow joint, and i 1 and i 2 are the unit vectors of the sagittal axis direction of the elbow joint and the wrist joint, respectively.
图3给出了由此方法计算出的腕关节弯曲/伸展角度变化。定义手掌手平位置时为0度,弯曲角度为正、伸展角度为负,且手腕关节弯曲伸展运动范围为-60°~75°,可以看出此方法计算出的手腕弯曲/伸展角度合理并在人手弯曲/伸展运动范围内。Figure 3 presents the change in wrist flexion/extension angle calculated by this method. The palm-hand level position is defined as 0 degrees, the bending angle is positive, the extension angle is negative, and the wrist joint bending and extension range of motion is -60° to 75°. It can be seen that the wrist bending/extending angle calculated by this method is reasonable and consistent. within the human hand's range of motion in flexion/extension.
第二步:利用肌电仪同步采集前臂残侧相关六块肌肉的表面肌电信号。具体方法如下:The second step: use the electromyography instrument to simultaneously collect the surface electromyography signals of the six muscles related to the forearm stump. The specific method is as follows:
分析人手前臂肌肉发现,桡侧腕长伸肌、尺侧腕长伸肌和指总伸肌与手腕伸展动作关系紧密,桡侧腕屈肌、尺侧腕屈肌和指浅屈肌与腕关节弯曲动作关系紧密,所以选取以上六块肌肉作为表面肌电信号信号源。首先用酒精对受试者前臂进行消毒,降低皮肤表面油脂对表面肌电信号的干扰;其次将差分式电极分别沿肌肉纤维方向粘贴在六块肌肉表面,肌电信号零点设置在肘关节处;最后使用触发器实现肌电仪与三维运动捕捉系统同步采集。Analyzing the muscles of the forearm of the human hand, it was found that the extensor carpi radialis longus longus, the extensor carpi ulnaris longus and the extensor digitorum generalis were closely related to the wrist extension, and the flexor carpi radialis, flexor carpi ulnaris and flexor digitorum superficialis were closely related to the wrist joint. The bending action is closely related, so the above six muscles are selected as the surface EMG signal source. First, the subject's forearm was disinfected with alcohol to reduce the interference of the skin surface oil on the surface EMG signal; secondly, the differential electrodes were pasted on the surface of the six muscles along the direction of the muscle fibers, and the EMG signal zero point was set at the elbow joint; Finally, the trigger is used to realize the synchronous acquisition of the EMG and the 3D motion capture system.
第三步:将采集到的六通道手臂表面肌电信号进行预处理,提取肌电活跃强度特征,最后对手臂表面肌电信号活跃强度进行重采样,统一表面肌电信号与腕关节角度值采样频率。具体方法如下:Step 3: Preprocess the collected six-channel arm surface EMG signal, extract the EMG activity intensity feature, and finally resample the arm surface EMG signal activity intensity to unify the surface EMG signal and wrist joint angle value sampling frequency. The specific method is as follows:
(1)手臂表面肌电信号预处理:(1) Preprocessing of the EMG signal on the arm surface:
采集到的手臂表面肌电信号通常会混有噪声和干扰,包括设备固有噪声、周围噪声干扰、50Hz工频干扰以及伪迹噪声等。表面肌电信号有效频率范围为20-500Hz,为了降低噪声信号的干扰,采用4阶巴特沃斯滤波器对表面肌电信号进行20-500Hz带通滤波,再利用陷波滤波去除50Hz工频干扰。The collected EMG signals on the arm surface are usually mixed with noise and interference, including inherent noise of the device, surrounding noise interference, 50Hz power frequency interference, and artifact noise. The effective frequency range of the surface EMG signal is 20-500Hz. In order to reduce the interference of the noise signal, a 4th-order Butterworth filter is used to perform 20-500Hz band-pass filtering on the surface EMG signal, and then the notch filter is used to remove the 50Hz power frequency interference. .
(2)手臂表面肌电信号特征提取:(2) Feature extraction of arm surface EMG signal:
为了实现手臂表面肌电信号连续解码假手腕关节人机自然驱动角度,需要找到手臂表面肌电信号强度与假手人机自然驱动关节角度之间联系,可以提取表面肌电信号的肌电活跃强度特征。采用包络线法,对滤波之后的表面肌电信号进行全波整理,再进行低通滤波,选择截止频率为4~10Hz,得到表面肌电信号峰值变化,如图4所示。In order to continuously decode the natural driving angle of the artificial wrist joint by the surface EMG signal of the arm, it is necessary to find the relationship between the strength of the surface EMG signal of the arm and the natural driving joint angle of the artificial hand, and the EMG activity intensity feature of the surface EMG signal can be extracted. . Using the envelope method, the filtered surface EMG signal is subjected to full-wave sorting, and then low-pass filtering is performed.
第四步:采取机器学习的方法,建立BP神经网络,实现手臂表面肌电信号连续解码假手腕关节人机自然驱动角度。具体方法如下:The fourth step: adopt the method of machine learning, establish a BP neural network, and realize the continuous decoding of the human-machine natural driving angle of the artificial wrist joint by the EMG signal on the surface of the arm. The specific method is as follows:
(1)BP神经网络的构建:(1) Construction of BP neural network:
通常情况下,三层的BP神经网络能够解决多数模式识别问题,所以这里构建三层的BP神经网络。输入层为表面肌电强度特征值,这里取b=6,即输入层有6个神经元节点;输出层为手腕弯曲伸展角度,即输出层有1个神经元节点;中间层神经元节点个数由以下经验公示确定:Usually, a three-layer BP neural network can solve most pattern recognition problems, so a three-layer BP neural network is constructed here. The input layer is the characteristic value of surface EMG, where b=6, that is, the input layer has 6 neuron nodes; the output layer is the wrist bending and stretching angle, that is, the output layer has 1 neuron node; the middle layer has 1 neuron node The number is determined by the following empirical publicity:
其中,g为中间层节点个数,b为输入层节点个数,c为输出层节点个数,d=1~10为调节常数。这里取d=8,即g=10。Among them, g is the number of nodes in the middle layer, b is the number of nodes in the input layer, c is the number of nodes in the output layer, and d=1-10 is an adjustment constant. Here, d=8 is taken, that is, g=10.
(2)BP神经网络的训练:(2) Training of BP neural network:
图5中,设网络输入向量为X=[x1 x2 x3 x4 x5 x6]T,网络输出向量为Y=[y]T,中间层网络的神经元输出为:In Figure 5, let the network input vector be X=[x 1 x 2 x 3 x 4 x 5 x 6 ] T , the network output vector be Y=[y] T , and the neuron output of the middle layer network is:
输出层输出为:The output layer output is:
其中,神经元作用函数为:Among them, the neuron action function is:
定义误差函数:Define the error function:
其中,in,
N为样本数,m为每个样本中样本点数,dpi为由运动学数据计算出的腕关节弯曲伸展角度,ypi为由BP神经网络估算出的腕关节弯曲伸展角度,q为网络层数。N is the number of samples, m is the number of sample points in each sample, d pi is the bending and extending angle of the wrist joint calculated from the kinematic data, y pi is the bending and extending angle of the wrist joint estimated by the BP neural network, and q is the network layer. number.
利用梯度下降法寻找E的局部最小值,每个连接权值均需沿着E对连接权值导数的反方向修正。若误差函数在理想范围内,则停止迭代,否则继续对连接权值进行修正直到误差足够小。Using the gradient descent method to find the local minimum of E, each connection weight needs to be corrected along the opposite direction of the derivative of E to the connection weight. If the error function is within the ideal range, stop the iteration, otherwise continue to correct the connection weights until the error is small enough.
(3)BP神经网络的测试:(3) Test of BP neural network:
输入3组手臂表面肌电信号特征值到训练完成的BP神经网络,则会输出3组手腕弯曲伸展角度预测值。计算BP神经网络输入的手腕弯曲伸展角度与真实的经三维运动捕捉系统捕捉的运动学数据解算得到的角度之间的相关系数,来反应两者之间线性相关程度。相关系数计算公式如下:
其中,Cov(X,Y)为X与Y的协方差,Var[X]和Var[Y]分别为X和Y的方差。相关系数|ρxy|≤1,|ρxy|越接近1表示X与Y相关程度越高,|ρxy|越接近于0表示X与Y相关程度越低。Among them, Cov(X, Y) is the covariance of X and Y, and Var[X] and Var[Y] are the variances of X and Y, respectively. The correlation coefficient |ρ xy |≤1, the closer |ρ xy | is to 1, the higher the correlation between X and Y, the closer |ρ xy | is to 0, the lower the correlation between X and Y.
提取手臂表面肌电信号肌电活跃强度特征,采用BP神经网络方法预测假手腕关节人机自然驱动角度的解码结果如图6所示。由图可知,此方法能够稳定有效地实现手臂表面肌电信号连续解码腕关节弯曲伸展角度,可用于肌电智能假手的人机自然驱动控制。Extracting the EMG activity intensity feature of the surface EMG signal of the arm, and using the BP neural network method to predict the decoding result of the natural driving angle of the artificial wrist joint is shown in Figure 6. It can be seen from the figure that this method can stably and effectively realize the continuous decoding of the wrist flexion and extension angle by the EMG signal on the arm surface, which can be used for the natural human-machine drive control of the EMG intelligent prosthetic hand.
本发明是一种手臂表面肌电信号连续解码假手腕关节人机自然驱动角度的方法,以实现通过前臂表面肌电信号幅值变化识别假手腕关节弯曲伸展驱动角度,增加智能假手的拟人化自然操作。该方法提取桡侧腕长伸肌、桡侧腕屈肌、尺侧腕长伸肌、尺侧腕屈肌、指总伸肌、指浅屈肌六块肌肉在手腕弯曲伸展过程中的表面肌电信号,结合腕关节弯曲伸展过程中角度变化值,利用BP神经网络建立非线性映射模型,达到手臂表面肌电信号连续解码假手腕关节人机自然驱动角度,灵活控制假手腕关节动作的目的。该发明所建模型可靠,角度预测正确率高,利于手部残疾患者更好的使用智能假手进行自然操作,满足其生活和工作中的假手功能需求,具有良好的社会效益和经济效益。The invention is a method for continuously decoding the natural driving angle of artificial wrist joint by the electromyographic signal on the arm surface, so as to realize the recognition of the bending and stretching driving angle of the artificial wrist joint through the amplitude change of the electromyographic signal on the surface of the forearm, and increase the anthropomorphic nature of the intelligent artificial hand. operate. This method extracts the superficial muscles of the six muscles of the extensor carpi radialis longus, flexor carpi radialis longus, extensor carpi ulnaris longus, flexor carpi ulnaris, extensor digitorum common, and flexor digitorum superficialis in the process of wrist flexion and extension The electrical signal, combined with the angle change value during the bending and extension process of the wrist joint, uses the BP neural network to establish a nonlinear mapping model to achieve the purpose of continuously decoding the natural driving angle of the artificial wrist joint by the EMG signal on the arm surface and flexibly controlling the motion of the artificial wrist joint. The model established by the invention is reliable and has a high accuracy rate of angle prediction, which is beneficial for patients with hand disabilities to better use the intelligent prosthetic hand for natural operation, meets the functional requirements of the prosthetic hand in their life and work, and has good social and economic benefits.
以上内容仅为说明本发明的技术思想,不能以此限定本发明的保护范围,凡是按照本发明提出的技术思想,在技术方案基础上所做的任何改动,均落入本发明权利要求书的保护范围之内。The above content is only to illustrate the technical idea of the present invention, and cannot limit the protection scope of the present invention. Any changes made on the basis of the technical solution according to the technical idea proposed by the present invention all fall within the scope of the claims of the present invention. within the scope of protection.
Claims (4)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810664049.5A CN109009586B (en) | 2018-06-25 | 2018-06-25 | A method for continuous decoding of electromyography based on the natural driving angle of artificial wrist joint |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810664049.5A CN109009586B (en) | 2018-06-25 | 2018-06-25 | A method for continuous decoding of electromyography based on the natural driving angle of artificial wrist joint |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109009586A CN109009586A (en) | 2018-12-18 |
CN109009586B true CN109009586B (en) | 2020-07-28 |
Family
ID=64610702
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810664049.5A Active CN109009586B (en) | 2018-06-25 | 2018-06-25 | A method for continuous decoding of electromyography based on the natural driving angle of artificial wrist joint |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109009586B (en) |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109259739B (en) * | 2018-11-16 | 2020-08-18 | 西安交通大学 | An EMG estimation method for wrist joint motion torque |
CN110801226B (en) * | 2019-11-01 | 2024-11-08 | 西安交通大学 | A human knee joint torque test system method based on surface electromyography signal and its application |
CN110827987B (en) * | 2019-11-06 | 2021-03-23 | 西安交通大学 | A method and system for continuous electromyography prediction of wrist joint torque in multi-grasp mode |
CN111300413B (en) * | 2020-03-03 | 2022-10-14 | 东南大学 | Multi-degree-of-freedom myoelectric artificial hand control system and using method thereof |
CN111374808A (en) * | 2020-03-05 | 2020-07-07 | 北京海益同展信息科技有限公司 | Artificial limb control method and device, storage medium and electronic equipment |
CN111616848B (en) * | 2020-06-02 | 2021-06-08 | 中国科学技术大学先进技术研究院 | Five-degree-of-freedom upper arm prosthesis control system based on FSM |
CN111743667A (en) * | 2020-06-29 | 2020-10-09 | 北京海益同展信息科技有限公司 | Artificial limb control method, device, system and storage medium |
CN111920416B (en) * | 2020-07-13 | 2024-05-03 | 张艳 | Hand rehabilitation training effect measuring method, storage medium, terminal and system |
CN112587242B (en) * | 2020-12-11 | 2023-02-03 | 山东威高手术机器人有限公司 | Master hand simulation method of surgical robot, master hand and application |
CN114224577B (en) * | 2022-02-24 | 2022-05-17 | 深圳市心流科技有限公司 | Training method and device for intelligent artificial limb, electronic equipment, intelligent artificial limb and medium |
CN117953413B (en) * | 2024-03-27 | 2024-06-14 | 广东工业大学 | Electromyographic signal validity judging method, electromyographic signal validity judging device, electromyographic signal validity judging equipment and storage medium |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2163570B (en) * | 1984-08-24 | 1988-05-25 | Hanger & Co Ltd J E | Artificial hand |
KR101371359B1 (en) * | 2012-03-20 | 2014-03-19 | 한국과학기술연구원 | Peripheral Nerve Interface System and Method for Prosthetic Hand Control |
CN104665828A (en) * | 2013-11-27 | 2015-06-03 | 中国科学院深圳先进技术研究院 | System and method based on electromyographic signal controlling remote controller |
CN105615890B (en) * | 2015-12-24 | 2018-08-10 | 西安交通大学 | Human body lower limbs walking joint angles myoelectricity continuous decoding method |
CN105963100B (en) * | 2016-04-19 | 2018-07-17 | 西安交通大学 | By the lower limb rehabilitation robot self-adaptation control method assisted needed for patient motion |
CN106236336A (en) * | 2016-08-15 | 2016-12-21 | 中国科学院重庆绿色智能技术研究院 | A kind of myoelectric limb gesture and dynamics control method |
CN106923942B (en) * | 2017-02-15 | 2018-08-31 | 上海术理智能科技有限公司 | Upper and lower extremities motion assistant system based on the control of human body electromyography signal |
-
2018
- 2018-06-25 CN CN201810664049.5A patent/CN109009586B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN109009586A (en) | 2018-12-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109009586B (en) | A method for continuous decoding of electromyography based on the natural driving angle of artificial wrist joint | |
CN109259739B (en) | An EMG estimation method for wrist joint motion torque | |
CN106067178B (en) | A kind of continuous estimation method of hand joint movement based on muscle synergistic activation model | |
CN107378944B (en) | Multidimensional surface electromyographic signal artificial hand control method based on principal component analysis method | |
CN109549821B (en) | Exoskeleton robot power assist control system and method based on EMG and inertial navigation signal fusion | |
Lei | An upper limb movement estimation from electromyography by using BP neural network | |
CN112057040B (en) | Upper limb movement function rehabilitation evaluation method | |
CN103417218A (en) | System and method for collecting and evaluating parameters of upper limb movement | |
Ma et al. | Design on intelligent perception system for lower limb rehabilitation exoskeleton robot | |
Liu et al. | sEMG-based continuous estimation of knee joint angle using deep learning with convolutional neural network | |
CN111803099A (en) | Device and method for predicting human upper limb muscle strength based on radial basis neural network | |
CN110827987A (en) | A method and system for continuous electromyography prediction of wrist joint torque in multi-grasp mode | |
KR100994408B1 (en) | Finger force estimation method and estimation device, muscle discrimination method and muscle determination device for finger force estimation | |
Pan et al. | Musculoskeletal model for simultaneous and proportional control of 3-DOF hand and wrist movements from EMG signals | |
CN110400618B (en) | Three-dimensional gait generation method based on human motion structure characteristics | |
Hua et al. | An optimized selection method of channel numbers and electrode layouts for hand motion recognition | |
Pan et al. | A reliable multi-user EMG interface based on a generic-musculoskeletal model against loading weight changes | |
Guo et al. | Study on motion recognition for a hand rehabilitation robot based on sEMG signals | |
Han et al. | Continuous limb joint angle prediction from sEMG using SA-FAWT and Conv-BiLSTM | |
CN117547276A (en) | Device and method for automatic assessment of upper limb motor function integrating posture and force distribution | |
Yang et al. | Comparison of isometric force estimation methods for upper limb elbow joints | |
CN212415731U (en) | A device for evaluating hand motor function | |
Meng et al. | Estimation of ankle joint continuous motion based on electromyographic signals | |
Yang et al. | Gesture recognition method based on computer vision and surface electromyography: implementing intention recognition of the healthy side in the hand assessment process | |
Chen et al. | The classification of surface electromyographic for ankle eversion and inversion based on cerebellar model neural networks |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |