CN117805764A - Millimeter wave radar anti-interference fall detection method based on three-dimensional time-frequency information matrix - Google Patents
Millimeter wave radar anti-interference fall detection method based on three-dimensional time-frequency information matrix Download PDFInfo
- Publication number
- CN117805764A CN117805764A CN202311857109.2A CN202311857109A CN117805764A CN 117805764 A CN117805764 A CN 117805764A CN 202311857109 A CN202311857109 A CN 202311857109A CN 117805764 A CN117805764 A CN 117805764A
- Authority
- CN
- China
- Prior art keywords
- doppler
- signal
- matrix
- interference
- millimeter wave
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
- G01S7/41—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section
- G01S7/417—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section involving the use of neural networks
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
- A61B5/1116—Determining posture transitions
- A61B5/1117—Fall detection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
- G01S7/36—Means for anti-jamming, e.g. ECCM, i.e. electronic counter-counter measures
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Landscapes
- Engineering & Computer Science (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Life Sciences & Earth Sciences (AREA)
- Molecular Biology (AREA)
- Veterinary Medicine (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Pathology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Biomedical Technology (AREA)
- Electromagnetism (AREA)
- Biophysics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Dentistry (AREA)
- Physiology (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Radar Systems Or Details Thereof (AREA)
Abstract
Description
技术领域Technical field
本发明涉及雷达检测技术领域,具体为基于三维时频信息矩阵的毫米波雷达抗干扰跌倒检测方法。The invention relates to the technical field of radar detection, specifically a millimeter wave radar anti-interference fall detection method based on a three-dimensional time-frequency information matrix.
背景技术Background technique
随着老年人群体的不断扩大,他们的健康问题引起了社会的关注。跌倒在老年人群体中式尤为常见的致残甚至致死因素,因此对于老年人的跌倒监测是十分必要的。当前常见的跌倒监测方法主要有:(1)监控摄像头:在各个房间中安装监控摄像头,利用视频序列信息检测老人是否发生跌倒行为。(2)可穿戴设备:老人需穿戴智能手表等传感器设备,利用跌倒时的加速度和陀螺仪水平角信息变化,判断当前是否为跌倒状态。(3)毫米波雷达:在房间中安装雷达设备,根据老人跌倒时雷达回波信号中短时特征的显著变化,识别当前的跌倒行为。As the elderly population continues to grow, their health problems have attracted social attention. Falls are a particularly common cause of disability or even death among the elderly, so fall monitoring for the elderly is very necessary. The current common fall monitoring methods are: (1) Surveillance cameras: Install surveillance cameras in each room and use video sequence information to detect whether the elderly have fallen. (2) Wearable devices: The elderly need to wear sensor devices such as smart watches to use the changes in acceleration and gyroscope horizontal angle information when falling to determine whether they are currently in a fall state. (3) Millimeter wave radar: Install radar equipment in the room to identify the current fall behavior based on the significant changes in the short-term characteristics of the radar echo signal when the elderly fall.
在基于计算机视觉的监控视频跌倒检测方法中,存在着对于室内私密环境的老年人隐私保护,以及不同强弱光照环境下,检测效果不稳定、变差等问题;而在基于可穿戴传感设备的跌倒检测方法中,由于老年人记忆力与体力的衰退,存在设备遗忘穿戴,行动不方便等问题。故本发明中借助毫米波雷达的回波信号实现跌倒检测,由于雷达回波信号中,既包含了目标信息,也存在着室内环境中风扇、空调等干扰因素,其运动特征信息也会被雷达所采集,与人体目标信号混杂,极大地影响着跌倒检测的效果。干扰特征信息存在过多,会使跌倒识别网络更加注重于干扰信息,而忽视包含目标的时频信息,导致跌倒检测错误。In the fall detection method based on computer vision surveillance video, there are problems such as privacy protection for the elderly in private indoor environments, and unstable and deteriorating detection effects under different light environments; and in the fall detection method based on wearable sensor devices, due to the decline in memory and physical strength of the elderly, there are problems such as forgetting to wear the equipment and inconvenience in movement. Therefore, the present invention uses the echo signal of the millimeter-wave radar to achieve fall detection. Since the radar echo signal contains both target information and interference factors such as fans and air conditioners in the indoor environment, its motion feature information will also be collected by the radar and mixed with the human target signal, greatly affecting the effect of fall detection. If there is too much interference feature information, the fall recognition network will pay more attention to the interference information and ignore the time-frequency information containing the target, resulting in fall detection errors.
目前,在基于毫米波雷达的跌倒识别方法中,大多采用将短时特征图输入神经网络识别的方式。即将提取到的回波信号进行处理后,转换为时频图、距离多普勒谱等特征图的形式,将其共同输入进一个或若干网络中对当前人体动作提取到的特征信息进行综合的判别。但目前大多方法没有将人体运动过程中的微多普勒特征充分利用,利用多特征图的方式较为繁琐,且没有针对环境中的干扰问题进行有效的抑制,进而导致了跌倒检测准确率低的问题。At present, most of the fall recognition methods based on millimeter wave radar adopt the method of inputting short-term feature maps into neural network recognition. After the extracted echo signals are processed, they are converted into feature maps such as time-frequency diagrams and range Doppler spectra, and then they are jointly input into one or several networks to synthesize the feature information extracted from the current human action. Discrimination. However, most current methods do not make full use of the micro-Doppler features during human movement. The method of using multiple feature maps is cumbersome and does not effectively suppress interference problems in the environment, which leads to low fall detection accuracy. question.
发明内容Contents of the invention
本发明的目的是:针对目前大多方法没有将人体运动过程中的微多普勒特征充分利用,利用多特征图的方式较为繁琐,且没有针对环境中的干扰问题进行有效的抑制,进而导致了跌倒检测准确率低的问题,提出基于三维时频信息矩阵的毫米波雷达抗干扰跌倒检测方法The purpose of the present invention is to propose a millimeter wave radar anti-interference fall detection method based on a three-dimensional time-frequency information matrix to address the problem that most current methods do not fully utilize the micro-Doppler characteristics of human body movement, the method of using multiple feature maps is cumbersome, and there is no effective suppression of interference problems in the environment, which leads to low accuracy of fall detection.
本发明为了解决上述技术问题采取的技术方案是:The technical solution adopted by the present invention to solve the above technical problems is:
基于三维时频信息矩阵的毫米波雷达抗干扰跌倒检测方法,包括以下步骤:The millimeter wave radar anti-interference fall detection method based on the three-dimensional time-frequency information matrix includes the following steps:
步骤一:在同一室内环境下,利用毫米波雷达分别获取无人体运动时的发射信号及回波信号,以及有人体运动时的发射信号及回波信号;Step 1: In the same indoor environment, use the millimeter wave radar to obtain the transmission signal and echo signal when there is no human motion, and the transmission signal and echo signal when there is human motion;
步骤二:将无人体运动时的发射信号及回波信号进行混频后得到中频信号,并对中频信号进行采样,得到离散中频信号,并对离散中频信号进行加窗处理后,依次进行多普勒维与距离维的傅里叶变换,得到每一帧数据的距离多普勒矩阵,并在其中选取元素值最大的距离多普勒矩阵RDnoise;Step 2: Mix the transmit signal and the echo signal when there is no human body movement to obtain the intermediate frequency signal, sample the intermediate frequency signal to obtain the discrete intermediate frequency signal, and perform window processing on the discrete intermediate frequency signal, and then perform Doppler The Fourier transform of Levey and distance dimensions is used to obtain the distance Doppler matrix of each frame of data, and the distance Doppler matrix RD noise with the largest element value is selected;
步骤三:将有人体运动时的发射信号及回波信号通过步骤二的步骤进行处理,得到每一帧数据的距离多普勒矩阵RDk,将每一帧数据的距离多普勒矩阵RDk分别与RDnoise作差,得到每一帧去干扰的距离多普勒矩阵 Step 3: Process the transmit signal and echo signal when there is human body movement through the steps of step 2 to obtain the range Doppler matrix RD k of each frame of data, and convert the range Doppler matrix RD k of each frame of data into Difference with RD noise respectively to obtain the range Doppler matrix for interference removal in each frame.
步骤四:将每一帧去干扰的距离多普勒矩阵进行谱峰搜索,得到人体目标距雷达的距离,并将此距离与上一帧所得距离进行比较,判断当前帧与上一帧是否相差大于30个距离门,若相差大于30个距离门,则选取当前帧对应的距离多普勒矩阵,否则,选取上一帧对应的距离多普勒矩阵;Step 4: De-interference the range Doppler matrix of each frame Perform spectral peak search to obtain the distance between the human target and the radar, and compare this distance with the distance obtained in the previous frame to determine whether the difference between the current frame and the previous frame is greater than 30 range gates. If the difference is greater than 30 range gates, then Select the range Doppler matrix corresponding to the current frame, otherwise, select the range Doppler matrix corresponding to the previous frame;
步骤五:基于步骤四选取的距离多普勒矩阵,获取该距离多普勒矩阵中距离门数范围内的所有多普勒向量,以此构建矩阵,并将该矩阵经过逆傅里叶变换与短时傅里叶变换后,作为该帧的多普勒信息矩阵;Step 5: Based on the range Doppler matrix selected in step 4, obtain all the Doppler vectors within the range of the range gate number in the range Doppler matrix to construct a matrix, and then undergo the inverse Fourier transform and After short-time Fourier transform, it is used as the Doppler information matrix of the frame;
步骤六:根据步骤四和步骤五,得到所有帧对应的多普勒信息矩阵,并以此构建三维时频信息矩阵,之后将三维时频信息矩阵输入神经网络,进行动作识别,以此进行跌倒检测。Step 6: According to steps 4 and 5, obtain the Doppler information matrix corresponding to all frames, and use this to construct a three-dimensional time-frequency information matrix. Then input the three-dimensional time-frequency information matrix into the neural network for action recognition and fall detection. detection.
进一步的,所述发射信号表示为:Further, the transmission signal is expressed as:
其中,AT为发射信号幅度,fc为信号的中心斜率,t为发射时间,B为带宽,Tm为调频周期,τ为时间延迟,dτ为τ的微分,j为虚数单位。Among them, A T is the amplitude of the transmitted signal, f c is the central slope of the signal, t is the transmission time, B is the bandwidth, T m is the frequency modulation period, τ is the time delay, dτ is the differential of τ, and j is the imaginary unit.
进一步的,所述回波信号表示为:Further, the echo signal is expressed as:
其中,AR为回波信号幅度,Δt为回波信号相对于发射信号的时延,Δfd为多普勒频移。Among them, A R is the amplitude of the echo signal, Δt is the time delay of the echo signal relative to the transmitted signal, and Δf d is the Doppler frequency shift.
进一步的,所述中频信号表示为:Further, the intermediate frequency signal is expressed as:
SIF(t)=ST(t)SR(t)≈ATARexp{j2π[fcΔt+(fI-Δfd)t]}S IF (t)=S T (t)S R (t)≈A T A R exp{j2π[f c Δt+(f I -Δf d )t]}
其中,fI表示在t时刻中频信号的频率, Among them, f I represents the frequency of the intermediate frequency signal at time t,
进一步的,所述选取元素值最大的距离多普勒矩阵RDnoise表示为:Furthermore, the distance Doppler matrix RD noise with the largest element value is expressed as:
RDnoise(x,y)=max(RD1(x,y),RD2(x,y),...,RDn(x,y))RD noise (x,y) = max(RD 1 (x,y),RD 2 (x,y),...,RD n (x,y))
其中,RDnoise(x,y)为距离多普勒矩阵RDnoise中的第x行第y列的元素值,RDk(x,y)为第k帧无人环境距离多普勒矩阵的第x行第y列的元素值,n为总帧数,k=1,2,...,n。Wherein, RD noise (x, y) is the element value of the xth row and yth column in the range Doppler matrix RD noise , RD k (x, y) is the element value of the xth row and yth column in the kth frame unmanned environment range Doppler matrix, n is the total number of frames, k = 1, 2, ..., n.
进一步的,所述表示为:further, the Expressed as:
进一步的,所述离散中频信号表示为:Further, the discrete intermediate frequency signal is expressed as:
SI(n,m)=AIexp{j2π[fI(n)-Δfd(m)]/fs},(1≤n≤N),(1≤m≤M)S I (n,m)=A I exp{j2π[f I (n)-Δf d (m)]/f s }, (1≤n≤N), (1≤m≤M)
其中,SI(n,m)为第n个周期的第m个采样点的离散表达式,AI为中频信号幅度,fs为采样频率,N为每帧中重复周期数目,即发射信号中Chirp数量,M为一个调频周期内的采样点数。Among them, S I (n, m) is the discrete expression of the m-th sampling point of the n-th cycle, A I is the amplitude of the intermediate frequency signal, f s is the sampling frequency, and N is the number of repeated cycles in each frame, that is, the transmitted signal The number of Chirps in, M is the number of sampling points in one frequency modulation cycle.
进一步的,所述短时傅里叶变换表示为:Further, the short-time Fourier transform is expressed as:
其中,W(t)为窗函数,为目标在该时间范围内的运动回波信号,f为信号频率。Where W(t) is the window function, is the motion echo signal of the target within this time range, and f is the signal frequency.
进一步的,所述人体目标距雷达的距离表示为:Further, the distance between the human target and the radar is expressed as:
其中,c表示光速。Here, c represents the speed of light.
进一步的,所述神经网络AlexNet和Resnet34。Further, the neural networks AlexNet and Resnet34.
本发明的有益效果是:The beneficial effects of the present invention are:
本申请相较于输入多个二维短时特征图进入神经网络识别的方法,本申请中,首先对当前测试环境中的干扰信息进行采集,并在后续人体运动测试过程中,通过与干扰环境距离多普勒矩阵对消法,有效抑制了外界干扰对人体目标运动特征信息提取的影响。同时,为有效将人体运动过程中微多普勒信息融合,本申请将提取到的人体多普勒信息矩阵构造为三维的时频信息矩阵形式,避免了多网络多输入的繁杂性,有效提高了毫米波雷达在不同干扰环境下针对于跌倒检测的识别效果,提升了跌倒检测准确率。Compared with the method of inputting multiple two-dimensional short-time feature maps into neural network recognition, in this application, the interference information in the current test environment is first collected, and in the subsequent human motion test process, the distance Doppler matrix cancellation method with the interference environment is used to effectively suppress the influence of external interference on the extraction of human target motion feature information. At the same time, in order to effectively fuse the micro-Doppler information during human motion, this application constructs the extracted human Doppler information matrix into a three-dimensional time-frequency information matrix form, avoiding the complexity of multiple networks and multiple inputs, effectively improving the recognition effect of millimeter-wave radar for fall detection in different interference environments, and improving the accuracy of fall detection.
附图说明Description of drawings
图1为本申请流程图;Figure 1 is the flow chart of this application;
图2为干扰环境距离多普勒矩阵图;Figure 2 is the interference environment distance Doppler matrix diagram;
图3为去干扰距离多普勒矩阵图;FIG3 is a diagram of the interference-removing range-Doppler matrix;
图4为去干扰三维时频信息矩阵图。Figure 4 is a three-dimensional time-frequency information matrix diagram for interference removal.
具体实施方式Detailed ways
需要特别说明的是,在不冲突的情况下,本申请公开的各个实施方式之间可以相互组合。It should be particularly noted that, in the absence of conflict, the various embodiments disclosed in this application can be combined with each other.
具体实施方式一:参照图1具体说明本实施方式,本实施方式所述的基于三维时频信息矩阵的毫米波雷达抗干扰跌倒检测方法。Specific Embodiment 1: This embodiment will be described in detail with reference to Figure 1. The millimeter wave radar anti-interference fall detection method based on a three-dimensional time-frequency information matrix described in this embodiment.
步骤一:获取毫米波雷达的设定帧数内无人运动环境中干扰因素的发射回波信号。将发射信号及回波信号进行混频后得到中频信号,并对中频信号进行采样,得到离散中频信号。对离散中频信号加窗处理后分别进行多普勒维与距离维的傅里叶变换,得到每一帧数据的距离多普勒矩阵,则该段时间内,环境中包含干扰信息的距离多普勒矩阵RDnoise可以表示为:Step 1: Obtain the echo signals of interference factors in the unmanned moving environment within the set number of frames of the millimeter wave radar. The transmitted signal and the echo signal are mixed to obtain an intermediate frequency signal, and the intermediate frequency signal is sampled to obtain a discrete intermediate frequency signal. After windowing the discrete intermediate frequency signal, perform Fourier transform of Doppler dimension and range dimension respectively to obtain the range Doppler matrix of each frame of data. Then, within this period of time, the range Doppler of the environment containing interference information is The Le matrix RD noise can be expressed as:
RDnoise(x,y)=max(RD1(x,y),RD2(x,y),...,RDn(x,y))RD noise (x, y) = max (RD 1 (x, y), RD 2 (x, y),..., RD n (x, y))
其中,RDnoise(x,y)为距离多普勒矩阵RDnoise中的第x行第y列的元素值,RDk(x,y)为第k帧无人环境距离多普勒矩阵的第x行第y列的元素值,n为总帧数,k=1,2,...,n。Among them, RD noise (x, y) is the element value of the x-th row and y-th column in the distance Doppler matrix RD noise , and RD k (x, y) is the k-th frame of the uninhabited environment distance Doppler matrix. The element value of row x and column y, n is the total number of frames, k=1,2,...,n.
步骤二:在上述环境中,获取毫米波雷达的设定帧数内的包含人体运动的发射回波信号。同步骤一处理,得到每一帧数据的距离多普勒矩阵,将每帧中的距离多普勒矩阵与距离多普勒矩阵RDnoise相减得到去干扰的距离多普勒矩阵,则第k帧去干扰的距离多普勒矩阵可表示为:Step 2: In the above environment, obtain the transmitted echo signal containing human movement within the set number of frames of the millimeter wave radar. Process the same as step 1 to obtain the range Doppler matrix of each frame of data. Subtract the range Doppler matrix in each frame from the range Doppler matrix RD noise to obtain the interference-free range Doppler matrix, then the kth Range Doppler matrix for frame de-interference It can be expressed as:
其中,RDk为包含人体目标的第k帧距离多普勒矩阵;Among them, RD k is the range Doppler matrix of the kth frame containing the human target;
步骤三:对每一帧去干扰的距离多普勒矩阵进行谱峰搜索,得到目标距雷达所处的距离,并将此距离与上一帧中所得距离进行比较。因人体跌倒时的速度约为5m/s,本申请中所应用的雷达距离门分辨率为7.14cm,一帧采集时长为0.036s,假定目标身高1.8m,经计算可得,雷达谱峰搜索定位目标位置相差不大于30个距离门,若超出该距离门数则表明谱峰搜索算法可能误选中干扰目标。故在该帧人体目标距离估测中,仍按上一帧人体目标位置进行选取。Step 3: Perform a spectral peak search on the interference-free range Doppler matrix of each frame to obtain the distance between the target and the radar, and compare this distance with the distance obtained in the previous frame. Since the speed of the human body when falling is about 5m/s, the radar range gate resolution used in this application is 7.14cm, and the acquisition time of one frame is 0.036s. Assuming that the target height is 1.8m, it can be obtained by calculation that the radar spectrum peak search The positioning target position difference is no more than 30 distance gates. If this number of distance gates is exceeded, it indicates that the peak search algorithm may mistakenly select the interference target. Therefore, in the human target distance estimation in this frame, the human target position in the previous frame is still selected.
步骤四:因人体运动幅度大概为50cm,本申请中所应用的雷达距离门分辨率为7.14cm,故依据目标估测位置,将距离门数设置为7,将该帧距离多普勒矩阵中距离门数范围内的所有多普勒向量截取为一个矩阵,得到目标的除躯干外的四肢微多普勒信息。经过逆傅里叶变换与短时傅里叶变换后,作为该帧的多普勒信息矩阵;Step 4: Since the human body movement amplitude is approximately 50cm, the radar range gate resolution used in this application is 7.14cm. Therefore, based on the estimated position of the target, the number of range gates is set to 7, and the range Doppler matrix of the frame is All Doppler vectors within the range of the range gate number are intercepted into a matrix, and the micro-Doppler information of the target's limbs except the trunk is obtained. After inverse Fourier transform and short-time Fourier transform, it is used as the Doppler information matrix of the frame;
步骤五:将所有帧的多普勒信息矩阵叠加,构造为一个三维的时频信息矩阵,并输入至神经网络中进行动作的识别。这里的三维的时频信息矩阵利用任意一个可以输入三维矩阵的网络均可,输出为动作分类结果。本申请以神经网络AlexNet和Resnet34为例。Step 5: Superpose the Doppler information matrices of all frames to construct a three-dimensional time-frequency information matrix, and input it into the neural network for action recognition. The three-dimensional time-frequency information matrix here can use any network that can input a three-dimensional matrix, and the output is the action classification result. This application takes the neural networks AlexNet and Resnet34 as examples.
所述每一帧数据的距离多普勒矩阵的获取步骤为:The steps for obtaining the distance Doppler matrix of each frame of data are:
对分帧操作得到的信号依次进行加窗滤波、距离维快速傅里叶变换和多普勒维快速傅里叶变换,得到每一帧数据的距离多普勒矩阵。The signal obtained by the frame dividing operation is sequentially subjected to window filtering, range-dimensional fast Fourier transform and Doppler-dimensional fast Fourier transform to obtain the range Doppler matrix of each frame of data.
所述发射信号表示为:The transmitted signal is expressed as:
其中,AT为发射信号幅度,fc为信号的中心斜率,t为发射时间,B为带宽,Tm为调频周期,τ为时间延迟,dτ为τ的微分。Among them, A T is the amplitude of the transmitted signal, f c is the central slope of the signal, t is the transmission time, B is the bandwidth, T m is the frequency modulation period, τ is the time delay, and dτ is the differential of τ.
所述回波信号表示为:The echo signal is expressed as:
其中,AR为回波信号幅度,Δt为回波信号相对于发射信号的时延,Δfd为多普勒频移,j为虚数单位。Among them, A R is the amplitude of the echo signal, Δt is the time delay of the echo signal relative to the transmitted signal, Δf d is the Doppler frequency shift, and j is the imaginary unit.
所述中频信号表示为:The intermediate frequency signal is expressed as:
SIF(t)=ST(t)SR(t)≈ATARexp{j2π[fcΔt+(fI-Δfd)t]}S IF ( t ) = S T ( t ) S R ( t ) ≈ AT A R exp { j 2 π [ f c Δ t + ( f I - Δ f d ) t ] }
其中,表示在t时刻中频信号的频率。in, Indicates the frequency of the intermediate frequency signal at time t.
进一步的,所述对中频信号进行采样中,每个采样点的离散表达式为:Further, in the sampling of the intermediate frequency signal, the discrete expression of each sampling point is:
SI(n,m)=AIexp{j2π[fI(n)-Δfd(m)]/fs},(1≤n≤N),(1≤m≤M) SI (n, m) = AI exp{j2π[ fI (n) - Δfd (m)]/ fs }, (1≤n≤N), (1≤m≤M)
其中,SI(n,m)为第n个周期的第m个采样点的离散表达式,AI为中频信号幅度,fs为采样频率,N为每帧中重复周期数目,即发射信号中Chirp数量,M为一个调频周期内的采样点数。Where S I (n,m) is the discrete expression of the mth sampling point in the nth cycle, A I is the intermediate frequency signal amplitude, fs is the sampling frequency, N is the number of repeated cycles in each frame, that is, the number of chirps in the transmitted signal, and M is the number of sampling points in one frequency modulation cycle.
所述短时傅里叶变换STFT表示为:The short-time Fourier transform STFT is expressed as:
其中,W(t)为窗函数,x~(t)为目标在该时间范围内的运动回波信号,t为时间,f为信号频率。Among them, W(t) is the window function, x~(t) is the motion echo signal of the target within the time range, t is the time, and f is the signal frequency.
所述毫米波雷达发射信号为线性调频FMCW。The millimeter wave radar transmitting signal is linear frequency modulation FMCW.
本申请是一种基于三维时频信息矩阵的毫米波雷达抗干扰跌倒检测方法,相较于输入多个短时特征图网络识别的方法,本申请中,充分抑制了回波信号经快速傅里叶变换后的距离多普勒矩阵中环境中干扰信息,提取了人体运动的多普勒信息,并将人体运动整个过程中的时频信息构造成了三维时频信息矩阵,最终输入神经网络中进行识别,有效提高了毫米波雷达在不同干扰环境下针对于跌倒检测的识别效果。This application is a millimeter-wave radar anti-interference fall detection method based on a three-dimensional time-frequency information matrix. Compared with the method of inputting multiple short-term feature map network recognition, this application fully suppresses the echo signal after fast Fourier The interference information in the environment in the range Doppler matrix after leaf transformation is used to extract the Doppler information of human movement, and the time-frequency information in the entire process of human movement is constructed into a three-dimensional time-frequency information matrix, which is finally input into the neural network. The identification effectively improves the recognition effect of millimeter wave radar for fall detection in different interference environments.
本申请目的是为解决不同的室内环境下,由于存在着风扇、空调等运动目标产生的干扰信号,使提取到的人体目标运动特征混杂干扰信息,导致跌倒检测效果不稳定的问题。The purpose of this application is to solve the problem that in different indoor environments, due to the existence of interference signals generated by moving targets such as fans and air conditioners, the extracted human target motion characteristics are mixed with interference information, resulting in unstable fall detection results.
实施例:Example:
参照图1具体说明本实施方式,本实施方式所述的基于三维时频信息矩阵的毫米波雷达抗干扰跌倒检测方法,包括:This embodiment will be described in detail with reference to Figure 1. The millimeter wave radar anti-interference fall detection method based on a three-dimensional time-frequency information matrix described in this embodiment includes:
阶段一、确定测试环境距离多普勒矩阵Stage 1: Determine the test environment distance Doppler matrix
线性调频(FMCW)毫米波雷达的一个调频周期内的发射信号可以表示为:The transmitted signal within one frequency modulation cycle of linear frequency modulation (FMCW) millimeter wave radar can be expressed as:
其中,AT为发射信号幅度,fc为信号的中心斜率,t为发射时间,B为带宽,Tm为调频周期。Among them, A T is the amplitude of the transmitted signal, f c is the central slope of the signal, t is the transmission time, B is the bandwidth, and T m is the frequency modulation period.
经过目标和环境反射后,毫米波雷达接受天线得到的回波信号为:After reflection from the target and the environment, the echo signal obtained by the millimeter wave radar receiving antenna is:
其中,AR为回波信号幅度,Δt为回波信号相对于发射信号的时延,Δfd为多普勒频移。Among them, A R is the amplitude of the echo signal, Δt is the time delay of the echo signal relative to the transmitted signal, and Δf d is the Doppler frequency shift.
步骤一、计算回波信号距离多普勒矩阵Step 1. Calculate the echo signal range Doppler matrix
经发射信号与回波信号混频后得到中频信号的表达式为:The expression of the intermediate frequency signal obtained after mixing the transmitted signal and the echo signal is:
SIF(t)=ST(t)SR(t)≈ATARexp{j2π[fcΔt+(fI-Δfd)t]} (3)S IF (t)=S T (t)S R (t)≈A T A R exp{j2π[f c Δt+(f I -Δf d )t]} (3)
其中,表示在t时刻中频信号的频率,此时目标的距离可以表示为:in, represents the frequency of the intermediate frequency signal at time t. At this time, the distance of the target can be expressed as:
式中,c表示光速,即3×108m/s。In the formula, c represents the speed of light, which is 3×10 8 m/s.
当对中频信号进行采样,则在其第n个周期的第m个采样点的离散表达式为:When the intermediate frequency signal is sampled, the discrete expression of the mth sampling point in its nth cycle is:
SI(n,m)=AIexp{j2π[fI(n)-Δfd(m)]/fs},(1≤n≤N),(1≤m≤M) (5)S I (n,m)=A I exp{j2π[f I (n)-Δf d (m)]/f s }, (1≤n≤N), (1≤m≤M) (5)
其中,AR为中频信号幅度,fs为采样频率,N为每帧中重复周期数目,即发射信号中Chirp数量,M为一个调频周期内的采样点数,Among them, AR is the amplitude of the intermediate frequency signal, fs is the sampling frequency, N is the number of repeated cycles in each frame, that is, the number of chirps in the transmitted signal, and M is the number of sampling points in one frequency modulation cycle.
此时,若对每帧中具有N个线性调频周期的M个经采样后的离散中频信号,首先进行加窗滤波,除去高频干扰分量,然后分别对其做距离维FFT和多普勒维FFT即可得到该帧数据的距离多普勒矩阵。At this time, if the M sampled discrete intermediate frequency signals with N linear frequency modulation periods in each frame are firstly subjected to window filtering to remove the high-frequency interference components, and then the range dimension FFT and Doppler dimension FFT are performed on them respectively, the range Doppler matrix of the frame data can be obtained.
步骤二、估计测试环境干扰矩阵Step 2: Estimate the test environment interference matrix
将每一帧中所求得的距离多普勒矩阵求最大值,则雷达设定帧数内,环境中包含干扰信息的距离多普勒矩阵RDnoise可以表示为:The maximum value of the range Doppler matrix obtained in each frame is calculated. The range Doppler matrix RD noise containing interference information in the environment within the radar set frame number can be expressed as:
RDnoise(x,y)=max(RD1(x,y),RD2(x,y),...,RDn(x,y)) (6)RD noise (x, y) = max (RD 1 (x, y), RD 2 (x, y),..., RD n (x, y)) (6)
其中,RDnoise(x,y)为距离多普勒矩阵RDnoise中的第x行第y列的元素值,RDk(x,y)为第k帧无人环境距离多普勒矩阵的第x行第y列的元素值,n为总帧数,k=1,2,...,n。Among them, RD noise (x, y) is the element value of the x-th row and y-th column in the distance Doppler matrix RD noise , and RD k (x, y) is the k-th frame of the uninhabited environment distance Doppler matrix. The element value of row x and column y, n is the total number of frames, k=1,2,...,n.
根据以上步骤,可以计算出在含有干扰的测试环境中的距离多普勒矩阵RDnoise。According to the above steps, the range Doppler matrix RD noise in the test environment containing interference can be calculated.
阶段二、距离多普勒矩阵对消Stage 2: Range Doppler Matrix Cancellation
步骤一、确定去干扰距离多普勒矩阵Step 1. Determine the interference removal range Doppler matrix
在上述环境中,获取毫米波雷达的设定帧数内的包含人体运动的发射回波信号。同阶段一处理,得到每一帧数据的距离多普勒矩阵,将每帧中的距离多普勒矩阵与距离多普勒矩阵RDnoise相减得到去干扰的距离多普勒矩阵,则第k帧去干扰的距离多普勒矩阵可表示为:In the above environment, the transmitted echo signal containing human movement within the set number of frames of the millimeter wave radar is acquired. In the same stage of processing, the range Doppler matrix of each frame of data is obtained. The range Doppler matrix in each frame is subtracted from the range Doppler matrix RD noise to obtain the interference-free range Doppler matrix, then the kth Range Doppler matrix for frame de-interference It can be expressed as:
其中,RDk为包含人体目标的第k帧距离多普勒矩阵;Among them, RD k is the range Doppler matrix of the kth frame containing the human target;
步骤二、目标锁Step 2. Target lock
对每一帧去干扰的距离多普勒矩阵进行谱峰搜索,得到目标距雷达所处的距离,并将此距离与上一帧中所得距离进行比较,若相差大于30个距离门,则表明谱峰搜索算法可能误选中干扰目标。故在该帧人体目标距离估测中,仍按上一帧人体目标位置进行选取。Perform a spectral peak search on the range Doppler matrix to remove interference in each frame to obtain the distance between the target and the radar, and compare this distance with the distance obtained in the previous frame. If the difference is greater than 30 range gates, it means The spectral peak search algorithm may mistakenly select interference targets. Therefore, in the human target distance estimation in this frame, the human target position in the previous frame is still selected.
阶段三、构造三维时频信息矩阵Stage 3: Construct a three-dimensional time-frequency information matrix
步骤一、微多普勒信息融合Step 1. Micro-Doppler information fusion
依据目标估测位置,将距离门数设置为7,将该帧距离多普勒矩阵中距离门数范围内的所有多普勒向量截取为一个矩阵,得到目标的除躯干外的四肢微多普勒信息(多普勒分量主要由躯干多普勒分量和四肢多普勒分量构成),作为该帧的多普勒信息矩阵。Based on the estimated position of the target, set the number of range gates to 7, intercept all the Doppler vectors within the range of the range gate number in the range Doppler matrix of this frame into a matrix, and obtain the micro-Doppler of the target's limbs except the trunk. Doppler information (Doppler component mainly consists of trunk Doppler component and limb Doppler component), as the Doppler information matrix of the frame.
为了能够处理连续输入的时间信号的时频信息,通过短时傅里叶变换将整个信号的时间域,分为等长的时间序列,并在每小段的时间序列进行快速傅里叶操作。因为信号在短时间范围内被视作是有限长的,故短时傅里叶变换能够在每个时间周期内有效的提取微多普勒信息的变化,其表达式为:In order to process the time-frequency information of the continuously input time signal, the time domain of the entire signal is divided into time series of equal length through short-time Fourier transform, and fast Fourier operation is performed on each small time series. Because the signal is considered to be of finite length in a short time range, the short-time Fourier transform can effectively extract the changes in micro-Doppler information in each time period, and its expression is:
其中,W(t)为窗函数,为目标在该时间范围内的运动回波信号。Where W(t) is the window function, It is the motion echo signal of the target within this time range.
根据以上步骤,可以计算出单帧毫米波雷达回波信号中的目标多普勒信息。According to the above steps, the target Doppler information in the single-frame millimeter wave radar echo signal can be calculated.
步骤二、构造三维时频信息矩阵Step 2: Construct a three-dimensional time-frequency information matrix
将所有帧的多普勒信息矩阵叠加,构造为一个三维的时频信息矩阵,并输入至神经网络中进行动作的识别。The Doppler information matrices of all frames are superimposed to construct a three-dimensional time-frequency information matrix, which is input into the neural network for action recognition.
以一次环境干扰数据与跌倒数据得到去干扰的三维时频信息矩阵展示本申请跌倒检测效果:A deinterferenced three-dimensional time-frequency information matrix is obtained using primary environmental interference data and fall data to demonstrate the fall detection effect of this application:
设定雷达工作参数:雷达起始频率60GHZ,调频带宽2.1GHZ,每帧时间36ms,重复周期数目255个,共120帧数据。Set the radar working parameters: radar starting frequency 60GHZ, FM bandwidth 2.1GHZ, each frame time 36ms, number of repetition cycles 255, a total of 120 frames of data.
具体流程:specific process:
(1)确定干扰环境距离多普勒矩阵RDnoise,大小为256×255;(1) Determine the interference environment distance Doppler matrix RD noise , with a size of 256×255;
(2)将跌倒数据中每帧的距离多普勒矩阵与干扰环境距离多普勒矩阵RDnoise相减,得到去干扰的距离多普勒矩阵大小为256×255;(2) Subtract the distance Doppler matrix of each frame in the fall data from the interference environment distance Doppler matrix RD noise to obtain the interference-free distance Doppler matrix The size is 256×255;
(3)对去干扰的距离多普勒矩阵进行谱峰搜索,并应用目标锁算法,防止搜索算法误选中干扰目标,确定目标位置为57;(3) Range Doppler matrix for interference removal Conduct spectral peak search and apply target lock algorithm to prevent the search algorithm from mistakenly selecting interference targets, and determine the target position to be 57;
(4)截取目标位置前后7个距离门的多普勒向量,大小为7×255,作为该帧的多普勒信息矩阵;(4) Intercept the Doppler vectors of the seven range gates before and after the target position, with a size of 7×255, as the Doppler information matrix of the frame;
(5)将每帧的多普勒信息矩阵经过逆傅里叶变换与短时傅里叶变换后,进行叠加,构造出大小为7×255×120的三维时频信息矩阵;(5) The Doppler information matrix of each frame is superimposed after inverse Fourier transform and short-time Fourier transform to construct a three-dimensional time-frequency information matrix with a size of 7×255×120;
(6)将去干扰后的三维时频信息矩阵输入神经网络进行识别,得到识别结果;(6) Input the de-interferenced three-dimensional time-frequency information matrix into the neural network for recognition and obtain the recognition result;
效果比较:相比于以往输入多二维短时特征图,本申请适用于不同干扰环境下的室内跌倒检测任务;可以有效抑制室内各干扰对于人体运动特征信息提取的影响,并同时有效融合了人体目标运动微多普勒信息。Effect comparison: Compared with the previous input of multiple two-dimensional short-time feature maps, this application is suitable for indoor fall detection tasks under different interference environments; it can effectively suppress the influence of various indoor interferences on the extraction of human motion feature information, and at the same time effectively integrate the micro-Doppler information of human target motion.
需要注意的是,具体实施方式仅仅是对本发明技术方案的解释和说明,不能以此限定权利保护范围。凡根据本发明权利要求书和说明书所做的仅仅是局部改变的,仍应落入本发明的保护范围内。It should be noted that the specific implementation is only an explanation and description of the technical solution of the present invention, and cannot be used to limit the scope of protection of the rights. Any partial changes made according to the claims and description of the present invention should still fall within the scope of protection of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202311857109.2A CN117805764A (en) | 2023-12-29 | 2023-12-29 | Millimeter wave radar anti-interference fall detection method based on three-dimensional time-frequency information matrix |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202311857109.2A CN117805764A (en) | 2023-12-29 | 2023-12-29 | Millimeter wave radar anti-interference fall detection method based on three-dimensional time-frequency information matrix |
Publications (1)
Publication Number | Publication Date |
---|---|
CN117805764A true CN117805764A (en) | 2024-04-02 |
Family
ID=90423081
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202311857109.2A Pending CN117805764A (en) | 2023-12-29 | 2023-12-29 | Millimeter wave radar anti-interference fall detection method based on three-dimensional time-frequency information matrix |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN117805764A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN118731940A (en) * | 2024-08-30 | 2024-10-01 | 北京中成康富科技股份有限公司 | Intelligent fall detection method and system based on millimeter wave radar |
CN118924262A (en) * | 2024-08-15 | 2024-11-12 | 中国人民解放军陆军工程大学 | Micro-Doppler vital sign detection method and system for noise suppression |
-
2023
- 2023-12-29 CN CN202311857109.2A patent/CN117805764A/en active Pending
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN118924262A (en) * | 2024-08-15 | 2024-11-12 | 中国人民解放军陆军工程大学 | Micro-Doppler vital sign detection method and system for noise suppression |
CN118731940A (en) * | 2024-08-30 | 2024-10-01 | 北京中成康富科技股份有限公司 | Intelligent fall detection method and system based on millimeter wave radar |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111856422B (en) | Lip language identification method based on broadband multichannel millimeter wave radar | |
CN117805764A (en) | Millimeter wave radar anti-interference fall detection method based on three-dimensional time-frequency information matrix | |
CN112630768B (en) | Noise reduction method for improving frequency modulation continuous wave radar target detection | |
CN103837863B (en) | Cheating interference identification is towed apart from speed sync based on gradient projection | |
CN113447905A (en) | Double-millimeter-wave radar human body falling detection device and detection method | |
CN106707258A (en) | Multi-parameter estimation method for micro-motion target under non-Gaussian background | |
CN113963441A (en) | A method and system for gesture recognition of millimeter wave radar based on cross-domain enhancement | |
CN111142086B (en) | A PD radar amplitude jitter suppression method, time jitter detection method and system | |
CN107561509B (en) | Airborne millimeter wave radar power line detection method | |
Andrić et al. | Analysis of radar Doppler signature from human data | |
Wang et al. | Through-wall human activity classification using complex-valued convolutional neural network | |
CN116687392A (en) | Clutter elimination method for millimeter wave radar fall detection based on time-frequency information matrix | |
CN111580063B (en) | Radar Target Detection Method Based on Generalized Demodulation Frequency-Wedge Transform | |
CN109061626A (en) | A kind of method that Step Frequency coherent processing detects low signal to noise ratio moving-target | |
CN109521411A (en) | A kind of detection method of range extension target | |
CN102830394B (en) | Weak target detection method based on multispectral accumulation | |
EP4291925A1 (en) | Dnn-based human face classificati0n | |
Kim et al. | Extraction of micro‐doppler characteristics of drones using high‐resolution time‐frequency transforms | |
CN108196238A (en) | Clutter map detection method based on adaptive matched filter under Gaussian background | |
Willetts et al. | Optimal time-frequency distribution selection for LPI radar pulse classification | |
Wang et al. | Research on hand gesture recognition based on millimeter wave radar | |
Erdogan et al. | Deinterleaving radar pulse train using neural networks | |
Ganveer et al. | SAR implementation using LFM signal | |
Li et al. | Deep learning for interference mitigation in time-frequency maps of FMCW radars | |
CN114325599B (en) | Automatic threshold detection method for different environments |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |