CN104599290B - Video sensing node-oriented target detection method - Google Patents
Video sensing node-oriented target detection method Download PDFInfo
- Publication number
- CN104599290B CN104599290B CN201510023864.XA CN201510023864A CN104599290B CN 104599290 B CN104599290 B CN 104599290B CN 201510023864 A CN201510023864 A CN 201510023864A CN 104599290 B CN104599290 B CN 104599290B
- Authority
- CN
- China
- Prior art keywords
- background
- pixel
- image
- gaussian
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 41
- 238000009826 distribution Methods 0.000 claims abstract description 53
- 238000005070 sampling Methods 0.000 claims abstract description 12
- 238000012805 post-processing Methods 0.000 claims abstract description 7
- 239000011159 matrix material Substances 0.000 claims description 54
- 238000005259 measurement Methods 0.000 claims description 33
- 238000000034 method Methods 0.000 claims description 22
- 239000013598 vector Substances 0.000 claims description 10
- 230000003044 adaptive effect Effects 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 4
- 230000008859 change Effects 0.000 claims description 3
- 238000006243 chemical reaction Methods 0.000 claims 2
- 230000006835 compression Effects 0.000 claims 1
- 238000007906 compression Methods 0.000 claims 1
- 239000004744 fabric Substances 0.000 claims 1
- 238000004422 calculation algorithm Methods 0.000 description 25
- 238000004364 calculation method Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 8
- 239000000203 mixture Substances 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 238000012544 monitoring process Methods 0.000 description 5
- 230000008447 perception Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000000875 corresponding effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000000877 morphologic effect Effects 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 238000011410 subtraction method Methods 0.000 description 2
- 206010044565 Tremor Diseases 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000002902 bimodal effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000007797 corrosion Effects 0.000 description 1
- 238000005260 corrosion Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000011423 initialization method Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000002156 mixing Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Landscapes
- Image Analysis (AREA)
Abstract
本发明公开了一种面向视频感知节点的目标检测方法,包括压缩感知步骤、背景建模步骤、更新步骤以及后处理步骤,根据兴趣区域设置不同的采样值M,在前一帧的目标块1.2倍区域提高采样率,而在背景区域降低采样率;以及,当背景亮度变化较小,降低建模的高斯分布个数,以降低学习速率;当亮度变化较大,提高高斯分布个数,以提高学习速率。
The invention discloses a target detection method oriented to video sensing nodes, including compressed sensing steps, background modeling steps, update steps and post-processing steps, setting different sampling values M according to the interest area, and the target block 1.2 in the previous frame Double the area to increase the sampling rate, and reduce the sampling rate in the background area; and, when the background brightness changes small, reduce the number of Gaussian distributions modeled to reduce the learning rate; when the brightness changes greatly, increase the number of Gaussian distributions to reduce the learning rate. Increase the learning rate.
Description
技术领域technical field
本发明涉及目标检测技术领域,特别涉及一种面向视频感知节点的目标检测方法。The invention relates to the technical field of target detection, in particular to a target detection method for video perception nodes.
背景技术Background technique
无线视频传感器网络由大量具有通信和计算能力的视频节点按特定的方式或者随机地布置在监控区域内构成的“智能”自治测控无线网络系统。视频传感器节点间具有很强的协同能力,通过局部的图像数据采集、处理以及节点间的数据交互完成全局任务。与传统监控模式相比,采用无线视频传感器网络构建分布式智能监控系统具有无人值守、覆盖率广、性能稳定、灵活性高、监控场景可以实现任意组合的优点,特别适合在交通路口、机场和地铁站等关键区域或恶劣环境下的目标跟踪和事件监测。The wireless video sensor network is an "intelligent" autonomous measurement and control wireless network system composed of a large number of video nodes with communication and computing capabilities arranged in a specific way or randomly in the monitoring area. The video sensor nodes have a strong collaborative ability, and complete the global task through local image data collection, processing and data interaction between nodes. Compared with the traditional monitoring mode, the use of wireless video sensor networks to build a distributed intelligent monitoring system has the advantages of unattended, wide coverage, stable performance, high flexibility, and any combination of monitoring scenarios, especially suitable for traffic intersections, airports, etc. Target tracking and event monitoring in critical areas such as subway stations or harsh environments.
在计算机视觉和无线视频传感器网络相关应用领域,对获取的视频图像中目标的检测是首要的步骤。目标检测算法的好坏影响到对后续跟踪与行为识别等进一步的视觉处理。由于实际场景的复杂多变导致现有的目标检测算法普遍比较复杂,计算量大,内存容量要求高,不适合资源有限的视频感知节点。In computer vision and wireless video sensor network-related applications, the detection of objects in acquired video images is the first step. The quality of the target detection algorithm affects further visual processing such as follow-up tracking and behavior recognition. Due to the complexity and changeability of the actual scene, the existing target detection algorithms are generally complex, with a large amount of calculation and high memory capacity requirements, and are not suitable for video perception nodes with limited resources.
因此,针对于视频感知节点的目标检测算法必须首先考虑算法效能的问题,要尽可能减少计算量和存储容量。压缩感知理论突破了传统拉奎斯特理论下对样本数的要求。只要信号是可压缩的或是稀疏的,就可以通过满足一定条件的观测矩阵将变换后的高维信号进行采样,得到一个采样后的低维信号。然后求解一个优化问题就可以从少量的采样值中完美的重构出原始信号。将压缩感知理论应用到基于背景减除法的目标检测算法中,在保留原始图像信息的同时,可大幅减少参与背景建模的像素数量,从而提高算法效率。因此,在研究现如今几种常用的背景建模方法基础上,提出一种基于结构化压缩感知的自适应混合高斯(Structured Compressive Sensing Adaptive Gaussian Mixture Model,SCS-AGMM)背景建模算法,构建结构化随机测量矩阵来减少参与背景建模的数据量,并从多个方面优化了算法的效能。Therefore, the target detection algorithm for video perception nodes must first consider the problem of algorithm efficiency, and reduce the amount of calculation and storage capacity as much as possible. The compressed sensing theory breaks through the requirement of the number of samples under the traditional Laquist theory. As long as the signal is compressible or sparse, the transformed high-dimensional signal can be sampled through an observation matrix that meets certain conditions to obtain a sampled low-dimensional signal. Then solving an optimization problem can perfectly reconstruct the original signal from a small number of sampled values. Applying the compressive sensing theory to the target detection algorithm based on the background subtraction method can greatly reduce the number of pixels involved in the background modeling while retaining the original image information, thereby improving the efficiency of the algorithm. Therefore, on the basis of studying several commonly used background modeling methods today, a Structured Compressive Sensing Adaptive Gaussian Mixture Model (SCS-AGMM) background modeling algorithm based on structured compressed sensing is proposed to construct the structure The stochastic measurement matrix is used to reduce the amount of data involved in background modeling, and the performance of the algorithm is optimized from many aspects.
背景减除方法是一种在目标检测领域技术比较成熟的方法,应用十分广泛。该方法通过对视频图像当前帧和背景模型对应位置像素值相减,当差的绝对值值大于某个阈值时,判定该像素为目标像素,否则为背景像素。并通过后期图像处理,得到完整的目标图像。The background subtraction method is a relatively mature method in the field of target detection and is widely used. This method subtracts the pixel value of the current frame of the video image from the corresponding position of the background model, and when the absolute value of the difference is greater than a certain threshold, it is determined that the pixel is a target pixel, otherwise it is a background pixel. And through post-image processing, a complete target image is obtained.
对于比较复杂并且呈现动态变化的背景,比如场景中存在波动水面、摇动的树木、摄像头的颤抖等,像素值的概率密度分布图往往呈现双峰或多峰状态。这是就需要采用多个高斯分布的线性组合才能对背景准确建模,该方法称为混合高斯模型(GMM)。利用GMM对图像中的每个像素建立背景模型能适应视频图像中光照变化、运动背景的干扰等情况。For complex and dynamically changing backgrounds, such as fluctuating water surfaces, shaking trees, trembling cameras, etc. in the scene, the probability density distribution map of pixel values often shows a bimodal or multimodal state. This requires the use of a linear combination of multiple Gaussian distributions to accurately model the background, which is called a Gaussian mixture model (GMM). Using GMM to build a background model for each pixel in the image can adapt to the changes in illumination and the interference of moving backgrounds in video images.
近年来出现大量基于混合高斯背景建模改进算法,这些方法的优点在于检测效果较好,可以去掉复杂背景情况下的运动干扰;不足在于计算量和存储量较大,运行速度较慢,不适于资源有限的视频感知节点。In recent years, a large number of improved algorithms based on mixed Gaussian background modeling have emerged. The advantages of these methods are that they have better detection effects and can remove motion interference in complex background situations; the disadvantages are that they have a large amount of calculation and storage, and the running speed is slow, so they are not suitable for Resource-constrained video-aware nodes.
发明内容Contents of the invention
本发明针对现有技术存在的上述不足,提供了一种面向视频感知节点的目标检测方法。本发明通过以下技术方案实现:Aiming at the above-mentioned deficiencies in the prior art, the present invention provides a target detection method oriented to video perception nodes. The present invention is realized through the following technical solutions:
一种面向视频感知节点的目标检测方法,包括步骤:A target detection method for video perception nodes, comprising steps:
图像重构步骤:根据采集到的图像尺寸大小对图像进行分块,将采得到的图像块转换为N×1的向量;Image reconstruction step: divide the image into blocks according to the size of the collected images, and convert the collected image blocks into N×1 vectors;
压缩感知步骤:构建结构化随机测量矩阵对转化后的向量进行采样压缩;Compressive sensing step: construct a structured random measurement matrix to sample and compress the converted vector;
背景建模步骤:利用自适应混合高斯模型对每一个测量后的矩阵块进行高斯建模,采用最少像素法则进行目标块和背景块检测;通过混合高斯模型对各候选节点的各像素建立至少一个背景模型,用第一帧图像数据对背景模型进行初始化,对每个背景模型设定统一的背景阈值,像素点权值大于该背景阈值的背景模型描述的为背景分布,像素点权值小于等于该背景阈值的背景模型描述的为前景分布,用图像中判断为背景的像素重新初始化权值小于初始化阈值的背景模型;背景模型的分布参数按优先级从大到小与对应的当前像素值逐一匹配检测,判定背景模型均与当前像素值不匹配的像素点为目标区域内的点,对匹配成功的背景模型更新分布参数,对各背景模型更新权重;Background modeling step: use the adaptive mixed Gaussian model to perform Gaussian modeling on each measured matrix block, and use the least pixel rule to detect the target block and background block; use the mixed Gaussian model to establish at least one pixel for each pixel of each candidate node. Background model, initialize the background model with the first frame of image data, set a uniform background threshold for each background model, the background model whose pixel weight is greater than the background threshold describes the background distribution, and the pixel weight is less than or equal to The background model of the background threshold describes the foreground distribution. Use the pixels judged as the background in the image to reinitialize the background model whose weight is less than the initialization threshold; Matching detection, determine that the pixel points whose background models do not match the current pixel values are points in the target area, update the distribution parameters for the successfully matched background models, and update the weights for each background model;
更新步骤:采用不同的策略对目标块和背景块进行更新,并根据检测的结果对结构化随机测量矩阵进行参数调节;Update step: use different strategies to update the target block and background block, and adjust the parameters of the structured random measurement matrix according to the detection results;
后处理步骤:对检测到的目标图像进行后期处理得到最终的目标图像;Post-processing step: performing post-processing on the detected target image to obtain the final target image;
其中,不同的策略包括根据兴趣区域设置不同的采样值M,在前一帧的目标块1.2倍区域提高采样率,而在背景区域降低采样率;以及,当背景亮度变化较小,降低建模的高斯分布个数,以降低学习速率;当亮度变化较大,提高高斯分布个数,以提高学习速率。Among them, different strategies include setting different sampling values M according to the region of interest, increasing the sampling rate in the area of 1.2 times the target block in the previous frame, and reducing the sampling rate in the background area; and, when the background brightness changes little, reduce the modeling The number of Gaussian distributions is used to reduce the learning rate; when the brightness changes greatly, the number of Gaussian distributions is increased to increase the learning rate.
较佳的,分布参数按优先级与当前像素值进行逐一匹配检测,即判别是否满足|μi,t-xt|<max(Wσi,t,τ),式中i=1,2,…,K,K为各像素高斯分布的个数,μi,t和σi,t分别为在t时刻第i个高斯分布的均值和标准方差,xt为前像素值,W和τ均为阈值常量。Preferably, the distribution parameters are matched and detected one by one with the current pixel value according to the priority, that is, to judge whether | μ i, t -x t |<max ( Wσ i, t , τ), where i=1, 2, ..., K, K is the number of Gaussian distributions of each pixel, μ i, t and σ i, t are the mean value and standard deviation of the i-th Gaussian distribution at time t, x t is the previous pixel value, W and τ mean is the threshold constant.
较佳的,将上一帧检测出的目标区域经过扩展后作为当前帧的目标区域进行匹配检测,在目标区域外的像素点采用紧的匹配准则,即τ与W均取较大值;在目标区域内的像素点采用松的匹配准则,即τ与W均取较小值,其中,0.5<=W<=3.5,3<=τ<=20。Preferably, the target area detected in the previous frame is expanded and used as the target area of the current frame for matching detection, and the pixels outside the target area adopt a tight matching criterion, that is, both τ and W take larger values; The pixel points in the target area adopt a loose matching criterion, that is, both τ and W take smaller values, among which, 0.5<=W<=3.5, 3<=τ<=20.
较佳的,将上一帧目标区域扩展10%作为当前帧的目标区域,在目标区域外的像素点取W=2.5,τ=15,在目标区域内的像素点取W=1.5,τ=6。Preferably, expand the target area of the previous frame by 10% as the target area of the current frame, take W=2.5, τ=15 for pixels outside the target area, and W=1.5, τ=15 for pixels inside the target area 6.
较佳的,初始化至少一个背景模型时,通过第一帧各点像素值用来初始化高斯分布均值μK,0,第一帧各点像素值的标准方差σK,0取15<=σK,0<=25,权重为1/Kmax,Kmax为每个像素点的最大高斯分布个数。Preferably, when initializing at least one background model, the pixel values of each point in the first frame are used to initialize the mean value μ K,0 of the Gaussian distribution, and the standard deviation σ K,0 of the pixel values of each point in the first frame is set to 15<=σ K , 0 <= 25, the weight is 1/Kmax, and Kmax is the maximum number of Gaussian distributions for each pixel.
本发明采取的方法构建结构化随机测量矩阵通过对图像进行采样压缩,减少了高斯统计建模的计算数据量,并对算法进行两个方面的效能优化。一是根据背景亮度的变化来自适应调整高斯模型个数以及学习速率,减少平均计算时间;二是根据分割提取目标的兴趣区域采用不同测量值,整体减少参与建模的像素个数,有效地减少了背景建模的时间。通过算法仿真和节点实测的实验结果证明,该方法可获得较好的目标检测结果并且具有较强的抗干扰性,相对于传统的混合高斯算法,内存容量减少约四分之三,处理时间可减少50%以上。The method adopted in the present invention constructs a structured random measurement matrix by sampling and compressing images, reduces the amount of calculation data for Gaussian statistical modeling, and optimizes the efficiency of the algorithm in two aspects. One is to adaptively adjust the number of Gaussian models and the learning rate according to the change of the background brightness, and reduce the average calculation time; the other is to use different measurement values according to the segmentation and extraction of the target area of interest, and reduce the number of pixels involved in the modeling as a whole, effectively reducing the time for background modeling. The experimental results of algorithm simulation and node measurement prove that this method can obtain better target detection results and has strong anti-interference performance. Compared with the traditional mixed Gaussian algorithm, the memory capacity is reduced by about three-quarters, and the processing time can be reduced Reduced by more than 50%.
附图说明Description of drawings
图1所示的是本发明的流程图;What Fig. 1 shows is flow chart of the present invention;
图2所示的是本发明与不同建模方法的每帧平均处理时间比较示意图;What Fig. 2 shows is the comparison schematic diagram of the average processing time per frame of the present invention and different modeling methods;
图3所示的是本发明与不同建模方法的误检率比较示意图;What Fig. 3 shows is the comparison schematic diagram of false detection rate of the present invention and different modeling methods;
图4所示的是本发明与不同建模方法的漏检率比较示意图;What Fig. 4 shows is the comparison schematic diagram of the missed detection rate of the present invention and different modeling methods;
图5所示的是本发明与不同建模方法的性能及平均每帧处理时间比较示意图;What Fig. 5 shows is the performance of the present invention and different modeling methods and the comparison schematic diagram of average processing time per frame;
图6所示的是本发明与不同建模方法的处理时间和内存容量比较示意图。Fig. 6 is a schematic diagram showing the comparison of processing time and memory capacity between the present invention and different modeling methods.
具体实施方式detailed description
以下将结合本发明的附图,对本发明实施例中的技术方案进行清楚、完整的描述和讨论,显然,这里所描述的仅仅是本发明的一部分实例,并不是全部的实例,基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例,都属于本发明的保护范围。The technical solutions in the embodiments of the present invention will be clearly and completely described and discussed below in conjunction with the accompanying drawings of the present invention. Obviously, what is described here is only a part of the examples of the present invention, not all examples. Based on the present invention All other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.
为了便于对本发明实施例的理解,下面将结合附图以具体实施例为例作进一步的解释说明,且各个实施例不构成对本发明实施例的限定。In order to facilitate the understanding of the embodiments of the present invention, specific embodiments will be taken as examples for further explanation below in conjunction with the accompanying drawings, and each embodiment does not constitute a limitation to the embodiments of the present invention.
对于复杂的动态背景,可采用多个高斯分布的线性组合来实现对背景的准确建模。混合高斯模型将图像中各个像素点的概率分布特性表示为K个(一般取值3~5)高斯模型。各高斯分布具有不同的权值ωi,t(∑ωi,t=1,i=1,2,……,K)和优先级(ω/σ),并按照优先级从高到低进行排序。在确定背景分布时,对单个分布取某个阈值T(T<1),当该分布的权值大于或等于该阈值的时候,认为这个高斯模型是背景分布,否则认为这个高斯模型是前景分布。For complex dynamic backgrounds, a linear combination of multiple Gaussian distributions can be used to accurately model the background. The mixed Gaussian model expresses the probability distribution characteristics of each pixel in the image as K (generally 3-5) Gaussian models. Each Gaussian distribution has different weights ωi, t (∑ωi, t=1, i=1, 2, . . . , K) and priorities (ω/σ), and are sorted from high to low in priority. When determining the background distribution, a certain threshold T (T<1) is taken for a single distribution. When the weight of the distribution is greater than or equal to the threshold, the Gaussian model is considered to be the background distribution, otherwise the Gaussian model is considered to be the foreground distribution. .
设xt为t时刻的某一像素值,可用K个高斯分布的线性组合来描述其概率密度函数:Let xt be a certain pixel value at time t, and its probability density function can be described by a linear combination of K Gaussian distributions:
其中ωi,t、μi,t和∑i,t分别为在t时刻第i个高斯分布的权值、均值以及协方差距阵。假定各像素颜色分量相互独立,其协方差矩阵可表示为:Among them, ωi, t, μi, t and ∑i, t are the weight, mean and covariance gap matrix of the i-th Gaussian distribution at time t, respectively. Assuming that the color components of each pixel are independent of each other, the covariance matrix can be expressed as:
K个高斯分布按ω/σ降序排列,取权值大于某一阈值的高斯分布表示背景分布,即:The K Gaussian distributions are arranged in descending order of ω/σ, and the Gaussian distribution whose weight is greater than a certain threshold represents the background distribution, namely:
fi(x|μ,σ2)∈Bg,如果ωi>TH (3)f i (x|μ, σ 2 )∈Bg, if ω i >TH (3)
其中,TH为背景阈值。Among them, TH is the background threshold.
1、背景初始化方法1. Background initialization method
一般情况下由视频节点采集到的图像序列,在一段时间内,背景的变化是不大的,因此可认为每一像素点灰度值服从均值μ和标准方差σ的高斯分布,且每一个象素点的高斯分布是独立的。首先初始化背景,为降低计算复杂度和存储容量,采用3个高斯模型对每个像素点进行建模(K=3)。高斯分布期望μ用第一帧图像中各点的像素值进行初始化,标准方差σ取较大的值(σ=20),权值初始设置为1/(2i+1)(i=0,1,2)。In general, the image sequence collected by the video node does not change much in a period of time, so it can be considered that the gray value of each pixel obeys the Gaussian distribution of mean value μ and standard deviation σ, and each image The Gaussian distributions of prime points are independent. Firstly, the background is initialized. In order to reduce the computational complexity and storage capacity, three Gaussian models are used to model each pixel (K=3). The Gaussian distribution expectation μ is initialized with the pixel values of each point in the first frame of the image, the standard deviation σ takes a larger value (σ=20), and the weight is initially set to 1/(2i+1) (i=0,1 ,2).
2、背景模型的学习与更新方法2. Background model learning and updating method
在进行目标检测时候按照优先级次序ω/σ从大到小将xt与各高斯分布逐一匹配。如果没有检测到表示背景分布的高斯分布与xt匹配,则认为该点为目标否则为背景。背景模型算法的具体执行步骤如下:When performing target detection, match xt with each Gaussian distribution one by one according to the priority order ω/σ from large to small. If no Gaussian distribution representing the background distribution is detected that matches xt, the point is considered to be the target otherwise it is the background. The specific execution steps of the background model algorithm are as follows:
(1)匹配准则(1) Matching criteria
将K个高斯分布按优先级与当前像素值xt进行比较看是否满足条件|μi,t-xt|<max(W*σ,λ),(i=1,2,……,K),式中W和λ是系数。对目标区域和非目标区域的像素采用不同条件来进行目标和背景的判定。具体操作是将上一帧图像中检测到的目标框的大小放大1.1倍作为当前帧的目标框。Compare K Gaussian distributions with the current pixel value xt according to priority to see if the condition |μ i,t -x t |<max(W*σ,λ), (i=1,2,...,K) , where W and λ are coefficients. Different conditions are used for the pixels in the target area and non-target area to determine the target and background. The specific operation is to enlarge the size of the target frame detected in the previous frame image by 1.1 times as the target frame of the current frame.
对属于目标区域像素点采用以下条件进行判断:The following conditions are used to judge the pixels belonging to the target area:
|x-μi|<max(1.5*σ,6) (4)|x- μi |<max(1.5*σ, 6) (4)
非目标区域像素点的判断条件为:The judgment conditions for the pixels in the non-target area are:
|x-μi|<max(2.5*σ,15) (5)|x- μi |<max(2.5*σ, 15) (5)
另外根据像素点的位置采用不同的取值策略:对于目标区域外的像素,取W=2.5,λ=15;对于目标区域内的像素,取W=1.5,λ=6。这样,在目标区域的像素更容易被检测为目标,增加了目标检测的形状完整性。In addition, different value strategies are adopted according to the position of the pixel: for pixels outside the target area, W=2.5, λ=15; for pixels inside the target area, W=1.5, λ=6. In this way, the pixels in the object area are more likely to be detected as objects, increasing the shape integrity of object detection.
(2)背景学习与更新(2) Background learning and updating
用获得的像素值与已知的第i个高斯模型匹配,如果匹配成功,则按式(6)更新匹配的第i个高斯模型分布参数:Use the obtained pixel value to match with the known i-th Gaussian model, if the matching is successful, then update the matching i-th Gaussian model distribution parameters according to formula (6):
等式(2.16)中其中β用来控制背景和前景更新的速度(根据模型是否描述背景而取不同的值)。大多数情况下前景更新比背景要慢些。K个高斯分布的权值按下式更新:In equation (2.16) Among them, β is used to control the update speed of background and foreground (different values are taken according to whether the model describes the background). Foreground updates will be slower than background in most cases. The weights of the K Gaussian distributions are updated as follows:
ωi,t+1=(1-αi)ωi,t+αiMi,t (7)ω i,t+1 = (1-α i )ω i,t +α i M i,t (7)
等式(7)中α的大小确定其在背景中的优先级并决定各高斯成分权值的更新速度,α越小背景图像越稳定;β大小决定背景的更新速度,β越大背景图像收敛速度越快。In equation (7) The size of α determines its priority in the background and determines the update speed of the weights of each Gaussian component. The smaller α is, the more stable the background image is; the size of β determines the update speed of the background, and the larger the β, the faster the convergence speed of the background image.
自适应高斯混合模型(AGMM)算法步骤如下:The adaptive Gaussian mixture model (AGMM) algorithm steps are as follows:
1)用第一帧图像进行高斯分布初始化(权值、期望、方差),k=0;1) Initialize the Gaussian distribution (weight, expectation, variance) with the first frame image, k=0;
2)对于t时刻的新像素2) For the new pixel at time t
根据式(4)(5)判断是否匹配;Judge whether to match according to formula (4) (5);
是则执行步骤3)、否则执行步骤4);If yes, go to step 3), otherwise go to step 4);
3)对匹配的高斯模型,利用式(6)(7)进行更新;3) For the matched Gaussian model, use formula (6) (7) to update;
4)如果不匹配,用当前值初始化新的高斯模型(小权值,大方差);4) If it does not match, initialize a new Gaussian model with the current value (small weight, large variance);
5)计算权值方差比ω/σ,降序排列,替换最小值;5) Calculate the weight variance ratio ω/σ, arrange in descending order, and replace the minimum value;
6)根据|Xt+1,i-Bi,t|<T判断像素是前景还是背景,输出结果;6) According to |X t+1, i -B i, t |<T, judge whether the pixel is foreground or background, and output the result;
转到步骤2);Go to step 2);
7)结束,下一帧图像。7) End, the next frame of image.
3、后处理方法3. Post-processing method
按照上面所述方法可得到目标的二值图像模板Morg。对二值模板Morg进行3×3形态学开运算,得到结果为Ms,再经过3×3腐蚀运算去除孤立的点后得到结果为M。该过程导致了部分目标像素的丢失,采取如下基于形态学目标重构的处理方法可以尽可能保留更多的目标图像:According to the method described above, the binary image template Morg of the target can be obtained. Perform 3×3 morphological opening operation on the binary template Morg to obtain the result Ms, and then remove isolated points through 3×3 corrosion operation to obtain the result M. This process leads to the loss of some target pixels, and the following processing method based on morphological target reconstruction can retain as many target images as possible:
等式(8)中F是经过前景提取、噪声滤除后的最终结果。等式中的结构元素SE的尺寸大小取决于检测的目标尺寸。实验发现采用3×3的结构元素可以达到较好的目标检测结果。利用结构元素结合同化填充对分割出的前景目标F进行空洞填充能使目标更加完整。最后通过目标大小统计的结果去除小于40个像素的小块,以达到消除噪声的目的。F in equation (8) is the final result after foreground extraction and noise filtering. The size of the structural element SE in the equation depends on the size of the detected object. Experiments show that the use of 3×3 structural elements can achieve better target detection results. Filling holes in the segmented foreground object F by using structural elements combined with assimilative filling can make the object more complete. Finally, the small blocks smaller than 40 pixels are removed through the statistical results of the target size to achieve the purpose of eliminating noise.
混合高斯模型参数不断进行更新以适应背景的逐渐变化。另外,该算法由于对图像中每一个像素点进行3到5个混合高斯建模,整体计算量和存储容量较大。The Gaussian mixture model parameters are continuously updated to accommodate gradual changes in the background. In addition, because the algorithm performs 3 to 5 mixed Gaussian modeling for each pixel in the image, the overall calculation and storage capacity are relatively large.
4、结构化压缩感知算法4. Structured compressed sensing algorithm
目前,常用的建模方法是采用混合高斯背景模型描述动态背景。由于对每个像素建立3到5个高斯模型,混合高斯模型的方法消耗摄像头节点大量的计算和存储资源,影响算法的实时应用。为了提高算法的效率,引入了压缩感知算法对图像数据进行随机采样,从而减少背景建模算法的计算量和存储量。然而随机采样矩阵的完全随机特性导致硬件电路实现起来比较复杂并且目标检测结果存在不确定性。针对这种情况,本发明将结构化压缩感知算法引入到混合高斯建模当中,在此基础上研究一种采用结构化随机测量矩阵,对图像进行采样的自适应混合高斯背景建模方法,并对算法进行全局效能优化,提高整体运行效率。At present, the commonly used modeling method is to describe the dynamic background by using the mixed Gaussian background model. Since 3 to 5 Gaussian models are established for each pixel, the method of mixing Gaussian models consumes a large amount of computing and storage resources of the camera node, which affects the real-time application of the algorithm. In order to improve the efficiency of the algorithm, the compressed sensing algorithm is introduced to randomly sample the image data, thereby reducing the amount of calculation and storage of the background modeling algorithm. However, the completely random nature of the random sampling matrix makes the implementation of the hardware circuit more complex and the target detection results are uncertain. In view of this situation, the present invention introduces the structured compressed sensing algorithm into the mixed Gaussian modeling, and on this basis, studies an adaptive mixed Gaussian background modeling method that uses a structured random measurement matrix to sample images, and Optimize the overall performance of the algorithm to improve the overall operating efficiency.
压缩感知是以M行N列(M<<N)大小的测量矩阵Φ对信号x(N维)进行测量,可得到压缩后的测量值y(M维),该过程可由等式(9)实现。Compressed sensing uses a measurement matrix Φ of M rows and N columns (M<<N) to measure the signal x (N dimension), and the compressed measurement value y (M dimension) can be obtained. This process can be expressed by equation (9) accomplish.
y=φx=φΨα=Θα (9)y=φx=φΨα=Θα (9)
如果信号x在某个变化域具有稀疏性,如等式(10)所示:If the signal x has sparsity in a certain variation domain, as shown in equation (10):
α=ΨTx (10)α= ΨT x (10)
并且测量矩阵Φ满足约束等距性条件,即指对于任意的K稀疏信号f以及常数δk∈(0,1)满足:那么就可以通过等式(11)来完美恢复该信号:And the measurement matrix Φ satisfies the constrained isometric condition, that is, for any K-sparse signal f and the constant δ k ∈ (0, 1) satisfies: Then the signal can be perfectly restored by equation (11):
该过程称之为重构,其中的0范数指的就是0元素的个数。This process is called reconstruction, where the 0 norm refers to the number of 0 elements.
目前提出的满足约束等距性条件的测量矩阵主要分三类。第一类包括矩阵元素独立地服从某一分布的高斯随机测量矩阵、贝努利随机矩阵等。第二类包括部分正交矩阵、部分哈达玛矩阵和非相关测量矩阵。这类矩阵仅与在时域或频域稀疏的信号不相关。第三类包括托普利兹(Toeplitz)矩阵、结构化随机测量矩阵、Chirps测量矩阵、循环矩阵、随机卷积形成的感知矩阵。There are three types of measurement matrices proposed so far that satisfy the condition of constrained equidistantness. The first category includes Gaussian random measurement matrices, Bernoulli random matrices, etc. whose matrix elements independently obey a certain distribution. The second category includes partially orthogonal matrices, partially Hadamard matrices, and uncorrelated measurement matrices. Such matrices are only uncorrelated with signals that are sparse in the time or frequency domain. The third category includes Toeplitz matrix, structured random measurement matrix, Chirps measurement matrix, circular matrix, and perceptual matrix formed by random convolution.
1)随机高斯矩阵:如式(12)所示,测量矩阵每个元素独立地服从均值为0,方差为1/M的高斯分布,等概率取值为1或0。高斯测量矩阵的优点在于所需的测量行数较小而且它几乎与任意稀疏信号都不相关。1) Random Gaussian matrix: As shown in formula (12), each element of the measurement matrix independently obeys a Gaussian distribution with a mean value of 0 and a variance of 1/M, and the value is 1 or 0 with equal probability. The advantage of a Gaussian measurement matrix is that the number of measurement rows required is small and it is almost uncorrelated to arbitrarily sparse signals.
2)随机贝努利矩阵;如式(13)所示,测量矩阵的每个元素独立地服从对称的贝努利分布,等概率取值为1或-1。该矩阵随机性很强,具有与高斯矩阵类似的性质。2) Random Bernoulli matrix; as shown in formula (13), each element of the measurement matrix independently obeys a symmetric Bernoulli distribution, and the value is 1 or -1 with equal probability. This matrix is very random and has properties similar to Gaussian matrices.
3)部分正交矩阵;构建该矩阵的步骤是首先生成N×N的正交矩阵U,然后在矩阵U中随机地选取M行向量并对M×N矩阵的列向量进行单位化,即可得到部分正交矩阵。3) Partially orthogonal matrix; the step of constructing the matrix is to first generate an N×N orthogonal matrix U, then randomly select M row vectors in the matrix U and unitize the column vectors of the M×N matrix, then Get a partially orthogonal matrix.
4)Toeplitz矩阵;构建该矩阵的步骤是首先生成测量矩阵Φ,在矩阵Φ的每一个行向量中,按照等式(14)元素的概率分布随机地选取位置,然后在所对应的位置赋值0、1、-1,其中 4) Toeplitz matrix; the step of constructing the matrix is to first generate the measurement matrix Φ, in each row vector of the matrix Φ, randomly select the position according to the probability distribution of the elements of equation (14), and then assign 0 to the corresponding position , 1, -1, where
5)部分哈达玛矩阵;构建该矩阵的步骤是首先生成大小为N×N的哈达玛矩阵,然后在生成矩阵中随机地选取M行向量即可构成一个M×N的哈达玛测量矩阵。5) Partial Hadamard matrix; the step of constructing this matrix is to first generate a Hadamard matrix with a size of N×N, and then randomly select M row vectors in the generated matrix to form an M×N Hadamard measurement matrix.
6)结构化随机测量矩阵;随机高斯和随机贝努利矩阵虽然对许多稀疏信号具有非相关性,但由于其完全随机的特性导致计算比较复杂,内存容量要求高。因此许多研究提出了结构化随机测量矩阵的概念。这类矩阵的构建采用随机高斯、伯努利矩阵和部分傅里叶变换矩阵的混合模型,从N×N的混合矩阵中随机抽取M行,再对每一列进行归一化处理。结构化随机测量矩阵几乎与所有其他正交矩阵不相关,并保持了各种矩阵的优点。6) Structured random measurement matrix; Although random Gaussian and random Bernoulli matrices are non-correlated to many sparse signals, due to their completely random characteristics, calculations are more complicated and memory capacity requirements are high. Therefore, many studies have proposed the concept of structured random measurement matrix. The construction of this type of matrix adopts the mixed model of random Gaussian, Bernoulli matrix and partial Fourier transform matrix, randomly selects M rows from the N×N mixed matrix, and then normalizes each column. The structured random measurement matrix is almost independent of all other orthogonal matrices and maintains the advantages of various matrices.
7)确定性矩阵;完全随机矩阵具有不确定因素和硬件电路难以实现等缺点,为克服其在压缩感知应用中的不足,许多研究提出了确定性测量矩阵,包括多项式确定性矩阵和轮换测量矩阵等。7) Deterministic matrix; completely random matrix has the disadvantages of uncertain factors and difficult implementation of hardware circuits. In order to overcome its shortcomings in compressed sensing applications, many studies have proposed deterministic measurement matrices, including polynomial deterministic matrices and rotation measurement matrices. Wait.
本发明包括步骤:The present invention comprises steps:
图像重构步骤:根据采集到的图像尺寸大小对图像进行分块,将采得到的图像块转换为N×1的向量;Image reconstruction step: divide the image into blocks according to the size of the collected images, and convert the collected image blocks into N×1 vectors;
压缩感知步骤:构建结构化随机测量矩阵对转化后的向量进行采样压缩;Compressive sensing step: construct a structured random measurement matrix to sample and compress the converted vector;
背景建模步骤:利用自适应混合高斯模型对每一个测量后的矩阵块进行高斯建模,采用最少像素法则进行目标块和背景块检测;通过混合高斯模型对各候选节点的各像素建立至少一个背景模型,用第一帧图像数据对背景模型进行初始化,对每个背景模型设定统一的背景阈值,像素点权值大于该背景阈值的背景模型描述的为背景分布,像素点权值小于等于该背景阈值的背景模型描述的为前景分布,用图像中判断为背景的像素重新初始化权值小于初始化阈值的背景模型;背景模型的分布参数按优先级从大到小与对应的当前像素值逐一匹配检测,判定背景模型均与当前像素值不匹配的像素点为目标区域内的点,对匹配成功的背景模型更新分布参数,对各背景模型更新权重;Background modeling step: use the adaptive mixed Gaussian model to perform Gaussian modeling on each measured matrix block, and use the least pixel rule to detect the target block and background block; use the mixed Gaussian model to establish at least one pixel for each pixel of each candidate node. Background model, initialize the background model with the first frame of image data, set a uniform background threshold for each background model, the background model whose pixel weight is greater than the background threshold describes the background distribution, and the pixel weight is less than or equal to The background model of the background threshold describes the foreground distribution. Use the pixels judged as the background in the image to reinitialize the background model whose weight is less than the initialization threshold; Matching detection, determine that the pixel points whose background models do not match the current pixel values are points in the target area, update the distribution parameters for the successfully matched background models, and update the weights for each background model;
更新步骤:采用不同的策略对目标块和背景块进行更新,并根据检测的结果对结构化随机测量矩阵进行参数调节;Update step: use different strategies to update the target block and background block, and adjust the parameters of the structured random measurement matrix according to the detection results;
后处理步骤:对检测到的目标图像进行后期处理得到最终的目标图像;Post-processing step: performing post-processing on the detected target image to obtain the final target image;
其中,不同的策略包括根据兴趣区域设置不同的采样值M,在前一帧的目标块1.2倍区域提高采样率,而在背景区域降低采样率;以及,当背景亮度变化较小,降低建模的高斯分布个数,以降低学习速率;当亮度变化较大,提高高斯分布个数,以提高学习速率。Among them, different strategies include setting different sampling values M according to the region of interest, increasing the sampling rate in the area of 1.2 times the target block in the previous frame, and reducing the sampling rate in the background area; and, when the background brightness changes little, reduce the modeling The number of Gaussian distributions is used to reduce the learning rate; when the brightness changes greatly, the number of Gaussian distributions is increased to increase the learning rate.
分布参数按优先级与当前像素值进行逐一匹配检测,即判别是否满足|μi,t-xt|<max(Wσi,t,τ),式中i=1,2,…,K,K为各像素高斯分布的个数,μi,t和σi,t分别为在t时刻第i个高斯分布的均值和标准方差,xt为前像素值,W和τ均为阈值常量。The distribution parameters are matched and detected one by one with the current pixel value according to the priority, that is, to judge whether |μ i, t -x t |<max(Wσ i, t , τ), where i=1, 2, ..., K, K is the number of Gaussian distributions of each pixel, μ i, t and σ i, t are the mean and standard deviation of the i-th Gaussian distribution at time t, respectively, x t is the previous pixel value, W and τ are threshold constants.
将上一帧检测出的目标区域经过扩展后作为当前帧的目标区域进行匹配检测,在目标区域外的像素点采用紧的匹配准则,即τ与W均取较大值;在目标区域内的像素点采用松的匹配准则,即τ与W均取较小值,其中,0.5<=W<=3.5,3<=τ<=20。将上一帧目标区域扩展10%作为当前帧的目标区域,在目标区域外的像素点取W=2.5,τ=15,在目标区域内的像素点取W=1.5,τ=6。The target area detected in the previous frame is expanded and used as the target area of the current frame for matching detection. The pixels outside the target area adopt a tight matching criterion, that is, both τ and W take larger values; The pixel points adopt a loose matching criterion, that is, both τ and W take smaller values, among which, 0.5<=W<=3.5, 3<=τ<=20. Expand the target area of the previous frame by 10% as the target area of the current frame, set W=2.5, τ=15 for pixels outside the target area, and W=1.5, τ=6 for pixels inside the target area.
初始化至少一个背景模型时,通过第一帧各点像素值用来初始化高斯分布均值μK,0,第一帧各点像素值的标准方差σK,0取15<=σK,0<=25,权重为1/Kmax,Kmax为每个像素点的最大高斯分布个数。When initializing at least one background model, the pixel value of each point in the first frame is used to initialize the mean value of the Gaussian distribution μ K, 0 , and the standard deviation σ K, 0 of the pixel value of each point in the first frame is 15<=σ K, 0 <= 25, the weight is 1/Kmax, and Kmax is the maximum number of Gaussian distributions for each pixel.
本发明的目标检测算法首先对视频节点采集到的图像xt进行4×4或8×8分块,然后构建结构化随机测量矩阵Φ在空间域直接对图像采样后的得到压缩图像yt。由压缩感知理论可知yt包含了原始图像绝大部分信息,通过自适应混合高斯模型(AGMM)构建背景模型,通过背景减法获得前景图像,然后对前景图像进行形态学处理。The object detection algorithm of the present invention first divides the image xt collected by the video node into 4×4 or 8×8 blocks, and then constructs a structured random measurement matrix Φ to directly sample the image in the space domain to obtain a compressed image yt. According to the compressed sensing theory, yt contains most of the information of the original image. The background model is constructed through the adaptive Gaussian mixture model (AGMM), and the foreground image is obtained through background subtraction, and then the foreground image is morphologically processed.
本申请先选择激活节点进行目标检测,目标跟踪,再通过效能函数f(i)来选择当前的最优节点进行目标跟踪,如图1中所示的过程,目标检测采用自适应高斯混合背景建模,实现运动目标的检测与分割;通过分布式Mean shift与目标关联实现节点的目标跟踪与状态估计,结合传感器节点的检测效果、通信能耗等因素确定传感器网络效能评估函数,选择最优传感器节点进行目标跟踪。综合考虑计算复杂度、数据的传输、存储需求,实现了对大范围内复杂场景下运动目标的准确跟踪。如图2至图6所示,根据与现有其他算法的比较,本发明可获得较好的目标检测结果并且具有较强的抗干扰性.相对于传统的混合高斯算法,内存容量减少约四分之三,处理时间可减少50%以上。This application first selects the active node for target detection and target tracking, and then selects the current optimal node for target tracking through the performance function f(i), as shown in Figure 1. The target detection adopts adaptive Gaussian mixture background construction Realize the detection and segmentation of moving targets; implement target tracking and state estimation of nodes through distributed mean shift and target association, combine the detection effect of sensor nodes, communication energy consumption and other factors to determine the sensor network performance evaluation function, and select the optimal sensor Nodes for object tracking. Comprehensive consideration of computational complexity, data transmission, and storage requirements enables accurate tracking of moving targets in complex scenes in a wide range. As shown in Figure 2 to Figure 6, according to comparison with other existing algorithms, the present invention can obtain better target detection results and has stronger anti-interference. Compared with the traditional mixed Gaussian algorithm, the memory capacity is reduced by about four Three-thirds, the processing time can be reduced by more than 50%.
以上所述,仅为本发明较佳的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到的变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应该以权利要求的保护范围为准。The above is only a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed in the present invention can easily think of changes or Replacement should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be determined by the protection scope of the claims.
Claims (5)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510023864.XA CN104599290B (en) | 2015-01-19 | 2015-01-19 | Video sensing node-oriented target detection method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510023864.XA CN104599290B (en) | 2015-01-19 | 2015-01-19 | Video sensing node-oriented target detection method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104599290A CN104599290A (en) | 2015-05-06 |
| CN104599290B true CN104599290B (en) | 2017-05-10 |
Family
ID=53125040
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510023864.XA Active CN104599290B (en) | 2015-01-19 | 2015-01-19 | Video sensing node-oriented target detection method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104599290B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105095898B (en) * | 2015-09-06 | 2019-03-08 | 苏州经贸职业技术学院 | A target compressed sensing method for real-time vision system |
| CN105551014A (en) * | 2015-11-27 | 2016-05-04 | 江南大学 | Image sequence change detection method based on belief propagation algorithm with time-space joint information |
| CN105761215B (en) * | 2016-01-27 | 2018-11-30 | 京东方科技集团股份有限公司 | A kind of method for compressing image, image reconstructing method, apparatus and system |
| CN106297653B (en) * | 2016-10-28 | 2018-08-31 | 重庆工商职业学院 | A kind of LED screen pixel brightness correcting method and its system based on image procossing |
| CN107423709A (en) * | 2017-07-27 | 2017-12-01 | 苏州经贸职业技术学院 | A kind of object detection method for merging visible ray and far infrared |
| CN107423433B (en) * | 2017-08-03 | 2020-07-10 | 聚好看科技股份有限公司 | Data sampling rate control method and device |
| CN107529061B (en) * | 2017-08-06 | 2019-09-06 | 西南交通大学 | Video Error Concealment Method Based on Compressed Sensing and Information Hiding |
| CN109903308B (en) * | 2017-12-08 | 2021-02-26 | 百度在线网络技术(北京)有限公司 | Method and device for acquiring information |
| CN108038872B (en) * | 2017-12-22 | 2021-08-31 | 中国海洋大学 | A research method based on dynamic and static target detection and real-time compressed sensing tracking |
| CN109087267B (en) * | 2018-08-15 | 2021-08-31 | 苏州蛟视智能科技有限公司 | Target detection method based on compressed sensing |
| CN115297288B (en) * | 2022-09-30 | 2023-03-07 | 汉达科技发展集团有限公司 | Monitoring data storage method for driving simulator |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8326240B1 (en) * | 2010-09-27 | 2012-12-04 | Rockwell Collins, Inc. | System for specific emitter identification |
| CN103473792A (en) * | 2013-09-11 | 2013-12-25 | 清华大学深圳研究生院 | Method for detecting moving target |
| CN103810722A (en) * | 2014-02-27 | 2014-05-21 | 云南大学 | Moving target detection method combining improved LBP (Local Binary Pattern) texture and chrominance information |
| CN103903242A (en) * | 2014-04-14 | 2014-07-02 | 苏州经贸职业技术学院 | Self-adaption target compression sensing, fusing and tracking method based on video sensor network |
| CN103996207A (en) * | 2014-04-28 | 2014-08-20 | 清华大学深圳研究生院 | Object tracking method |
| CN104010168A (en) * | 2014-06-13 | 2014-08-27 | 东南大学 | A non-overlapping multi-camera surveillance network topology adaptive learning method |
-
2015
- 2015-01-19 CN CN201510023864.XA patent/CN104599290B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8326240B1 (en) * | 2010-09-27 | 2012-12-04 | Rockwell Collins, Inc. | System for specific emitter identification |
| CN103473792A (en) * | 2013-09-11 | 2013-12-25 | 清华大学深圳研究生院 | Method for detecting moving target |
| CN103810722A (en) * | 2014-02-27 | 2014-05-21 | 云南大学 | Moving target detection method combining improved LBP (Local Binary Pattern) texture and chrominance information |
| CN103903242A (en) * | 2014-04-14 | 2014-07-02 | 苏州经贸职业技术学院 | Self-adaption target compression sensing, fusing and tracking method based on video sensor network |
| CN103996207A (en) * | 2014-04-28 | 2014-08-20 | 清华大学深圳研究生院 | Object tracking method |
| CN104010168A (en) * | 2014-06-13 | 2014-08-27 | 东南大学 | A non-overlapping multi-camera surveillance network topology adaptive learning method |
Non-Patent Citations (2)
| Title |
|---|
| 应用改进混合高斯模型的运动目标检测;张燕平;《计算机工程与应用》;20101201;第46卷(第34期);第155-158页 * |
| 改进混合高斯模型的运动目标检测算法;华媛蕾 等;《计算机应用》;20140210;第34卷(第2期);第580-584页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104599290A (en) | 2015-05-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104599290B (en) | Video sensing node-oriented target detection method | |
| Bakkay et al. | BSCGAN: Deep background subtraction with conditional generative adversarial networks | |
| WO2020199831A1 (en) | Method for training image processing model, image processing method, network device, and storage medium | |
| CN102054270A (en) | Method and device for extracting foreground from video image | |
| JP2009048240A (en) | Detection method, detection apparatus, monitoring method, and monitoring system for moving object in moving image | |
| CN105469428B (en) | A kind of detection method of small target based on morphologic filtering and SVD | |
| CN104715480A (en) | Statistical background model based target detection method | |
| Liu et al. | Scene background estimation based on temporal median filter with Gaussian filtering | |
| CN105095898A (en) | Real-time vision system oriented target compression sensing method | |
| Djerida et al. | Background subtraction in dynamic scenes using the dynamic principal component analysis | |
| CN103500456B (en) | A kind of method for tracing object based on dynamic Bayesian network network and equipment | |
| CN111582091A (en) | Pedestrian identification method based on multi-branch convolutional neural network | |
| Krungkaew et al. | Foreground segmentation in a video by using a novel dynamic codebook | |
| CN107423709A (en) | A kind of object detection method for merging visible ray and far infrared | |
| Zeng et al. | A moving object detection method based on graph neural network | |
| CN112733584A (en) | Intelligent alarm method and device for communication optical cable | |
| CN119135955B (en) | Time-varying environment-aware video analysis task unloading method based on region of interest | |
| CN120164256A (en) | Human action recognition method and system based on skeleton spatiotemporal feature fusion graph convolutional network | |
| Li et al. | Image object detection algorithm based on improved Gaussian mixture model | |
| He et al. | Research on digital image intelligent recognition method for industrial Internet of Things production data acquisition. | |
| JP7205628B2 (en) | Information processing device, control method, and program | |
| CN108009984B (en) | Water environment monitoring-oriented water surface saliency area detection method | |
| Shallari et al. | Background modelling, analysis and implementation for thermographic images | |
| Geng et al. | Real time foreground-background segmentation using two-layer codebook model | |
| Zuo et al. | A novel binary image filtering algorithm based on information entropy |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20201028 Address after: 870 Binhe Road, Suzhou hi tech Zone, Suzhou, Jiangsu Province Patentee after: NOVA ELECTRONICS Co.,Ltd. Address before: 215009 No. 287, Xuefu Road, Suzhou, Jiangsu Patentee before: SUZHOU INSTITUTE OF TRADE & COMMERCE |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220331 Address after: Room 107, No. 56, Jinzhai Road, Yangchenghu Town, Xiangcheng District, Suzhou, Jiangsu 215000 Patentee after: Jiangsu yingshida Electric Technology Co.,Ltd. Address before: 215011 No. 870 Binhe Road, Suzhou high tech Zone, Suzhou, Jiangsu Patentee before: NOVA ELECTRONICS Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240227 Address after: 472000, No. 6, West Intersection of Jing'er Road and Weiliu Road, Yuwang Road Street, Urban Rural Integration Demonstration Zone, Sanmenxia City, Henan Province Patentee after: Sanmenxia Yunshuo Intelligent Technology Co.,Ltd. Country or region after: China Address before: Room 107, No. 56, Jinzhai Road, Yangchenghu Town, Xiangcheng District, Suzhou, Jiangsu 215000 Patentee before: Jiangsu yingshida Electric Technology Co.,Ltd. Country or region before: China |
|
| TR01 | Transfer of patent right |