CN104881847A - Match video image enhancement method based on wavelet analysis and pseudo-color processing - Google Patents
Match video image enhancement method based on wavelet analysis and pseudo-color processing Download PDFInfo
- Publication number
- CN104881847A CN104881847A CN201510186348.9A CN201510186348A CN104881847A CN 104881847 A CN104881847 A CN 104881847A CN 201510186348 A CN201510186348 A CN 201510186348A CN 104881847 A CN104881847 A CN 104881847A
- Authority
- CN
- China
- Prior art keywords
- mrow
- msubsup
- video image
- msup
- pseudo
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 70
- 238000012545 processing Methods 0.000 title claims abstract description 62
- 238000004458 analytical method Methods 0.000 title claims abstract description 37
- 238000004422 calculation algorithm Methods 0.000 claims description 26
- 230000000694 effects Effects 0.000 claims description 10
- 238000000354 decomposition reaction Methods 0.000 claims description 8
- 230000002708 enhancing effect Effects 0.000 claims description 6
- 230000008859 change Effects 0.000 claims description 3
- 230000001131 transforming effect Effects 0.000 claims 2
- 230000005540 biological transmission Effects 0.000 claims 1
- 239000002131 composite material Substances 0.000 claims 1
- 230000004807 localization Effects 0.000 claims 1
- 230000003313 weakening effect Effects 0.000 claims 1
- 230000008569 process Effects 0.000 abstract description 18
- 230000007547 defect Effects 0.000 abstract description 10
- 230000009466 transformation Effects 0.000 abstract description 10
- 238000010586 diagram Methods 0.000 description 7
- 238000012937 correction Methods 0.000 description 6
- 238000001914 filtration Methods 0.000 description 5
- 230000003044 adaptive effect Effects 0.000 description 2
- 230000002238 attenuated effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 238000013179 statistical model Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 101100173586 Schizosaccharomyces pombe (strain 972 / ATCC 24843) fft2 gene Proteins 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000003707 image sharpening Methods 0.000 description 1
- 238000003706 image smoothing Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
Landscapes
- Image Processing (AREA)
Abstract
Description
技术领域technical field
本发明涉及视频处理技术领域,具体地,涉及一种基于小波分析和伪彩色处理的比赛视频图像增强方法。The invention relates to the technical field of video processing, in particular to a game video image enhancement method based on wavelet analysis and pseudo-color processing.
背景技术Background technique
常用的足球比赛视频图像增强方法及其缺陷Commonly used football game video image enhancement methods and their defects
足球比赛视频图像增强是指针对给定图像的应用场合,有目的地增强足球比赛视频图像的整体或局部特性,将原来不清晰的图像变得清晰或强调某些感兴趣的特征,扩大足球比赛视频图像中不同物体特征之间的差别,抑制不感兴趣的特征,使图像与视觉响应特性相匹配,改善图像质量、丰富信息量,加强图像判读和识别效果,满足某些图像分析的需要。Football game video image enhancement refers to the purposeful enhancement of the overall or local characteristics of the football game video image for a given image application, making the original unclear image clear or emphasizing some interesting features, expanding the football game The difference between different object features in the video image, suppressing uninteresting features, matching the image with the visual response characteristics, improving image quality, enriching the amount of information, enhancing image interpretation and recognition effects, and meeting the needs of some image analysis.
常用的足球比赛视频图像增强方法可分为频率域法和空间域法。基于频率域的算法是在足球比赛视频图像的某种变换域内对图像的变换系数值进行某种修正,是一种间接增强算法。频率域法把足球比赛视频图像看成一种二维信号,对其进行基于二维傅里叶变换的信号增强方法,其处理过程如图1所示。频率域法先根据具体的增强要求设计适当的修正函数H(x,y),然后利用傅里叶变换将足球比赛视频图像变换到频率域F(x,y),再对足球比赛视频图像的频谱进行某种滤波修正,即进行F(x,y)·H(x,y)运算得到G(x,y),最后将修正后的图像进行傅里叶反变换到空间域,以此得到增强图像g(x,y)。在此过程中采用低通滤波法去除图中的噪声;采用高通滤波法增强边缘等高频信号,使模糊的图像变得清晰。利用频率域法进行足球比赛视频图像增强结果如图2所示。Commonly used football game video image enhancement methods can be divided into frequency domain methods and space domain methods. The algorithm based on the frequency domain is to modify the transformation coefficient value of the image in a certain transformation domain of the football game video image, and it is an indirect enhancement algorithm. The frequency domain method regards the football game video image as a two-dimensional signal, and performs a signal enhancement method based on two-dimensional Fourier transform on it. The processing process is shown in Figure 1. The frequency domain method first designs an appropriate correction function H(x, y) according to the specific enhancement requirements, and then uses Fourier transform to transform the football game video image into the frequency domain F(x, y), and then adjusts the football game video image Some kind of filter correction is performed on the spectrum, that is, F(x,y)·H(x,y) operation is performed to obtain G(x,y), and finally the corrected image is inversely Fourier transformed into the space domain to obtain Augment the image g(x,y). In this process, the low-pass filtering method is used to remove the noise in the picture; the high-pass filtering method is used to enhance high-frequency signals such as edges, so that the blurred image becomes clear. Figure 2 shows the results of video image enhancement of football games using the frequency domain method.
基于空域的算法分为点运算算法和邻域增强算法。点运算算法即灰度级校正、灰度变换和直方图修正等,目的是使足球比赛视频图像成像均匀,或扩大足球比赛视频图像动态范围,扩展对比度。邻域增强算法分为图像平滑和锐化两种。平滑一般用于消除图像噪声,但是也容易引起边缘的模糊。锐化的目的是为了突出物体的边缘轮廓,有利于目标识别。具有代表性的空间域算法有局部求平均值法和中值滤波法等,它们可用于去除或减弱噪声。常用算法有梯度法、算子、高通滤波、掩模匹配法、统计差值法等。空间域法是对图像中的像素点进行卷积运算操作,用公式描述如下:Algorithms based on airspace are divided into point operation algorithm and neighborhood enhancement algorithm. Point calculation algorithms are gray level correction, gray level transformation and histogram correction, etc. The purpose is to make the football game video image uniform, or expand the football game video image dynamic range and expand the contrast. Neighborhood enhancement algorithms are divided into image smoothing and sharpening. Smoothing is generally used to eliminate image noise, but it is also easy to cause blurring of edges. The purpose of sharpening is to highlight the edge contour of the object, which is beneficial to target recognition. Representative spatial domain algorithms include local averaging and median filtering, which can be used to remove or attenuate noise. Commonly used algorithms include gradient method, operator, high-pass filter, mask matching method, statistical difference method, etc. The spatial domain method is to perform convolution operations on the pixels in the image, and the formula is described as follows:
g(x,y)=f(x,y)*h(x,y) (4)g(x,y)=f(x,y)*h(x,y)
其中,f(x,y)表示原始足球比赛视频图像函数;h(x,y)表示(低通或高通滤波)滤波器脉冲响应空间转换函数;g(x,y)表示处理后的足球比赛视频图像函数。利用直方图修正进行足球比赛视频图像增强结果如图3所示,利用灰度变换进行足球比赛视频图像增强结果如图4所示。Among them, f(x, y) represents the original football game video image function; h(x, y) represents the (low-pass or high-pass filtering) filter impulse response space conversion function; g(x, y) represents the processed football game Video image function. Figure 3 shows the result of football game video image enhancement using histogram correction, and Figure 4 shows the result of football game video image enhancement using grayscale transformation.
传统的足球比赛视频图像增强算法是基于整幅图像的统计量,因此,在计算整幅图像的变换时,同时对图像中的低频信息、高频信息以及噪声信息进行了变换,因而增强图像的同时增强了图像中的噪声,降低了图像的信噪比,导致图像的信息熵下降。不利于对感兴趣的目标进行后续分析处理,未达到预期的增强目的。The traditional football game video image enhancement algorithm is based on the statistics of the entire image. Therefore, when calculating the transformation of the entire image, the low-frequency information, high-frequency information and noise information in the image are transformed at the same time, thus enhancing the image. At the same time, the noise in the image is enhanced, the signal-to-noise ratio of the image is reduced, and the information entropy of the image is reduced. It is not conducive to the subsequent analysis and processing of the target of interest, and the expected enhancement purpose has not been achieved.
在实现本发明的过程中,发明人发现现有技术中至少存在操作过程复杂、花费时间长和可靠性低等缺陷。In the process of realizing the present invention, the inventors found that the prior art at least has defects such as complicated operation process, long time-consuming and low reliability.
发明内容Contents of the invention
本发明的目的在于,针对上述问题,提出一种基于小波分析和伪彩色处理的比赛视频图像增强方法,以实现操作过程简单、花费时间短和可靠性高的优点。The object of the present invention is to address the above-mentioned problems and propose a game video image enhancement method based on wavelet analysis and pseudo-color processing, so as to realize the advantages of simple operation process, short time consumption and high reliability.
为实现上述目的,本发明采用的技术方案是:一种基于小波分析和伪彩色处理的比赛视频图像增强方法,包括:In order to achieve the above object, the technical solution adopted in the present invention is: a method for enhancing game video images based on wavelet analysis and pseudo-color processing, comprising:
a、利用图像的正交小波变换对足球比赛视频图像进行变换处理;a, using the orthogonal wavelet transform of the image to transform the football game video image;
b、基于正交小波变换的足球比赛视频图像增强处理;b. Video image enhancement processing of football matches based on orthogonal wavelet transform;
c、图像的伪彩色足球比赛视频增强处理。c. Pseudo-color football game video enhancement processing of the image.
进一步地,所述步骤a,具体包括:Further, said step a specifically includes:
假设为尺度空间任意尺度系数系列,h0和h1分别为正交小波函数的低通滤波器和高通滤波器系数,这两组系数对任意尺度而言都是恒定的,正交小波变换各系数之间的关系用(1)表示:suppose is a series of coefficients of any scale in the scale space, h 0 and h 1 are the low-pass filter and high-pass filter coefficients of the orthogonal wavelet function respectively, these two sets of coefficients are constant for any scale, and the coefficients of the orthogonal wavelet transform The relationship between them is represented by (1):
原始足球比赛视频图像在一个尺度下的边缘轮廓能够分解为更小尺度下的低频分量、水平高频分量、垂直高频分量和对角分量四个部分,它们是分别经过四个不同滤波器得到的代表原始足球比赛视频图像的不同信息,其中是经过行与列两个方向上的低通滤波器获得的,它对应于在下一尺度上的边缘轮廓信息;是经过行方向上的高通滤波器和列方向上的低通滤波器获得的,它对应于水平方向上的细节信息在垂直方向上的概貌;同理,表示垂直方向上的细节信息在水平方向上的概貌;表示对角方向上的细节信息;The edge profile of the original football game video image at one scale can be decomposed into four parts: low-frequency components, horizontal high-frequency components, vertical high-frequency components and diagonal components at smaller scales, which are obtained through four different filters respectively different information representing the original football game video image, where yes Obtained by the low-pass filter in the row and column directions, it corresponds to Edge profile information on the next scale; yes Obtained by a high-pass filter in the row direction and a low-pass filter in the column direction, it corresponds to The overview of the detailed information in the horizontal direction in the vertical direction; similarly, express The overview of the detail information in the vertical direction in the horizontal direction; express Details in the diagonal direction;
足球比赛视频图像经二维正交小波变换分解之后,分别得到图像的低频分量、水平高频分量、垂直高频分量和对角分量。After the football game video image is decomposed by two-dimensional orthogonal wavelet transform, the low-frequency component, horizontal high-frequency component, vertical high-frequency component and diagonal component of the image are obtained respectively.
进一步地,所述步骤b,具体包括:Further, the step b specifically includes:
首先利用小波分形插值对足球比赛视频图像信号进行去噪处理,得到较好去除噪声的效果;Firstly, the wavelet fractal interpolation is used to denoise the video image signal of the football game, and a better effect of noise removal is obtained;
然后运用正交小波变换将一幅足球比赛视频图像分解为大小、位置和方向都不同的分量,在进行逆变换之前可以改变小波变换域中某些系数的大小,放大对足球比赛视频图像中感兴趣的分量而衰减对图像处理结果影响不大的分量;Then use the orthogonal wavelet transform to decompose a football game video image into components with different sizes, positions and directions. The component of interest and the attenuation of the component that has little effect on the image processing result;
正交小波分析方法是一种空间窗和频率窗都可作自适应改变、空频局部化分析方法,二维多尺度离散正交小波分析定义为:Orthogonal wavelet analysis method is a kind of spatial window and frequency window can be used for adaptive change, space-frequency localized analysis method, two-dimensional multi-scale discrete orthogonal wavelet analysis is defined as:
式中f(x,y)为图像信号;Sjf(n,m)是f(x,y)的低频分量; 分别代表f(x,y)的垂直、对角和水平高频分量;Where f(x,y) is the image signal; S j f(n,m) is the low frequency component of f(x,y); Represent the vertical, diagonal and horizontal high-frequency components of f(x,y), respectively;
当式(3)成立时,即高频分量权重较大时,足球比赛视频图像看起来较清晰:When the formula (3) is established, that is, when the weight of the high-frequency component is large, the video image of the football game looks clearer:
其中,为高频小波系数;为低频小波系数;k为高频分量权重;j为小波分解层数。in, is the high-frequency wavelet coefficient; is the low-frequency wavelet coefficient; k is the weight of the high-frequency component; j is the number of wavelet decomposition layers.
进一步地,所述步骤c,具体包括:Further, the step c specifically includes:
采用频率域伪彩色处理增强法对足球比赛视频图像进行伪彩色处理;Using frequency domain pseudo-color processing enhancement method to perform pseudo-color processing on football game video images;
基于小波分析和伪彩色处理的足球比赛视频图像增强。Video Image Enhancement of Football Match Based on Wavelet Analysis and Pseudo-color Processing.
进一步地,所述采用频率域伪彩色处理增强法对足球比赛视频图像进行伪彩色处理的操作,进一步包括:Further, the operation of performing pseudo-color processing on football game video images by using the frequency-domain pseudo-color processing enhancement method further includes:
先把足球比赛视频图像经傅立叶变换到频率域,在频率域内三个不同传递特性的滤波器分离成三个独立分量;First, the football game video image is transformed into the frequency domain by Fourier transform, and three filters with different transfer characteristics are separated into three independent components in the frequency domain;
然后对它们进行逆傅立叶变换,便得到三幅代表不同频率分量的单色图像,接着对这三幅图像作进一步的处理;Then perform an inverse Fourier transform on them to obtain three monochrome images representing different frequency components, and then further process these three images;
最后将它们作为三基色分量分别加到彩色显示器的红、绿、蓝显示通道,实现频率域分段的伪彩色增强。Finally, they are respectively added to the red, green, and blue display channels of the color display as three primary color components to realize the pseudo-color enhancement of frequency domain segmentation.
进一步地,所述基于小波分析和伪彩色处理的足球比赛视频图像增强的操作,进一步包括:Further, the operation of the football game video image enhancement based on wavelet analysis and pseudo-color processing further includes:
Step 1:使用正交分形小波变换处理足球比赛视频图像,得到去噪后的图像;Step 1: Use the orthogonal fractal wavelet transform to process the football game video image to obtain the image after denoising;
Step 2:利用正交小波变换将足球比赛视频图像分解为更小尺度下的低频分量、水平高频分量、垂直高频分量和对角分量四个部分;Step 2: Use orthogonal wavelet transform to decompose the football game video image into four parts: low-frequency component, horizontal high-frequency component, vertical high-frequency component and diagonal component;
Step 3:对图像中感兴趣的部分进行放大,同时对图像中不重要的信息进行弱化处理;Step 3: Enlarge the part of interest in the image, and at the same time weaken the unimportant information in the image;
Step 4:采用正交小波变换足球比赛视频图像增强算法得到结果图像后,将其转化为频率域,采用伪彩色处理的图像增强方法对不同频率部分进行处理,获得更好的足球比赛视频图像增强效果。Step 4: After using the orthogonal wavelet transform football game video image enhancement algorithm to obtain the result image, convert it into the frequency domain, and use the image enhancement method of pseudo-color processing to process different frequency parts to obtain better football game video image enhancement Effect.
本发明各实施例的基于小波分析和伪彩色处理的比赛视频图像增强方法,由于包括:a、利用图像的正交小波变换对足球比赛视频图像进行变换处理;b、基于正交小波变换的足球比赛视频图像增强处理;c、图像的伪彩色足球比赛视频增强处理;从而可以克服现有技术中操作过程复杂、花费时间长和可靠性低的缺陷,以实现操作过程简单、花费时间短和可靠性高的优点。The game video image enhancement method based on wavelet analysis and pseudo-color processing in each embodiment of the present invention, owing to comprise: a, utilize the orthogonal wavelet transform of image to carry out transform processing to football match video image; B, football game video image based on orthogonal wavelet transform Game video image enhancement processing; c, pseudo-color football game video enhancement processing of images; thereby can overcome the defects of complex operation process, long time-consuming and low reliability in the prior art, so as to realize simple operation process, short time-consuming and reliable operation Advantages of high sex.
本发明的其它特征和优点将在随后的说明书中阐述,并且,部分地从说明书中变得显而易见,或者通过实施本发明而了解。Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention.
下面通过附图和实施例,对本发明的技术方案做进一步的详细描述。The technical solutions of the present invention will be described in further detail below with reference to the accompanying drawings and embodiments.
附图说明Description of drawings
附图用来提供对本发明的进一步理解,并且构成说明书的一部分,与本发明的实施例一起用于解释本发明,并不构成对本发明的限制。在附图中:The accompanying drawings are used to provide a further understanding of the present invention, and constitute a part of the description, and are used together with the embodiments of the present invention to explain the present invention, and do not constitute a limitation to the present invention. In the attached picture:
图1为本发明中频率域法足球比赛视频图像增强原理图;Fig. 1 is frequency domain method football game video image enhancement schematic diagram in the present invention;
图2为本发明中频率域法足球比赛视频图像增强,(a)、(b)、(c)依次为原图像、FFT2变换图像和增强图像;Fig. 2 is frequency domain method football game video image enhancement among the present invention, (a), (b), (c) are successively original image, FFT2 transformed image and enhanced image;
图3为本发明中直方图修正图像增强,(a)为原图像,(b)为(a)的直方图,(c)为增强图像,(d)为(c)的直方图;Fig. 3 is the histogram correction image enhancement in the present invention, (a) is the original image, (b) is the histogram of (a), (c) is the enhanced image, (d) is the histogram of (c);
图4为本发明中灰度线性变换图像增强,(a)为原图像,(b)为增强图像;Fig. 4 is gray scale linear transformation image enhancement among the present invention, (a) is original image, (b) is enhanced image;
图5为本发明中基本小波分解示意图(多级分解示意图);Fig. 5 is a schematic diagram of basic wavelet decomposition (multilevel decomposition schematic diagram) in the present invention;
图6为本发明中三层小波分解示意图;Fig. 6 is a schematic diagram of three-layer wavelet decomposition in the present invention;
图7为本发明中正交小波变换足球比赛视频图像增强,(a)为原图像,(b)为增强图像;Fig. 7 is orthogonal wavelet transform football game video image enhancement among the present invention, (a) is original image, (b) is enhanced image;
图8为本发明中频域滤波法实现伪彩色处理的示意图;FIG. 8 is a schematic diagram of realizing false color processing by the mid-frequency domain filtering method of the present invention;
图9为本发明技术方案提出方法的图像增强,(a)为原图像的低灰度级增强图像,(b)为原图像的高灰度级增强图像;Fig. 9 is the image enhancement of the method proposed by the technical solution of the present invention, (a) is the low grayscale enhanced image of the original image, and (b) is the high grayscale enhanced image of the original image;
图10为本发明中模糊足球比赛视频图像增强,(a)为模糊图像,(b)为增强图像。Fig. 10 is the fuzzy football game video image enhancement in the present invention, (a) is a fuzzy image, (b) is an enhanced image.
具体实施方式Detailed ways
以下结合附图对本发明的优选实施例进行说明,应当理解,此处所描述的优选实施例仅用于说明和解释本发明,并不用于限定本发明。The preferred embodiments of the present invention will be described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described here are only used to illustrate and explain the present invention, and are not intended to limit the present invention.
根据本发明实施例,如图1-图10所示,提供了一种基于小波分析和伪彩色处理的比赛视频图像增强方法。According to an embodiment of the present invention, as shown in FIGS. 1-10 , a game video image enhancement method based on wavelet analysis and pseudo-color processing is provided.
基于小波分析和伪彩色处理的足球比赛视频图像增强Video Image Enhancement of Football Match Based on Wavelet Analysis and Pseudo-color Processing
2.2.2.1足球比赛视频图像的正交小波变换2.2.2.1 Orthogonal wavelet transform of football game video images
本发明技术方案为了实现足球比赛视频图像增强,利用图像的正交小波变换对足球比赛视频图像进行变换处理。In order to realize the enhancement of the video image of the football match, the technical scheme of the present invention uses the orthogonal wavelet transform of the image to transform the video image of the football match.
假设为尺度空间任意尺度系数系列,h0和h1分别为正交小波函数的低通滤波器和高通滤波器系数,这两组系数对任意尺度而言都是恒定的,这样,正交小波变换的快速分解可用图5来表示。正交小波变换各系数之间的关系用(1)表示。suppose is a series of coefficients of any scale in the scale space, h 0 and h 1 are the coefficients of the low-pass filter and high-pass filter of the orthogonal wavelet function respectively, these two sets of coefficients are constant for any scale, thus, the orthogonal wavelet transform The quick decomposition of can be shown in Figure 5. The relationship between the coefficients of the orthogonal wavelet transform is represented by (1).
由图4可知,原始足球比赛视频图像在一个尺度下的边缘轮廓可以分解为更小尺度下的低频分量、水平高频分量、垂直高频分量和对角分量四个部分,它们是分别经过四个不同滤波器得到的代表原始足球比赛视频图像的不同信息,其中是经过行与列两个方向上的低通滤波器获得的,它对应于在下一尺度上的边缘轮廓信息;是经过行方向上的高通滤波器和列方向上的低通滤波器获得的,它对应于水平方向上的细节信息在垂直方向上的概貌;同理,表示垂直方向上的细节信息在水平方向上的概貌;表示对角方向上的细节信息。足球比赛视频图像经二维正交小波变换分解之后,分别得到图像的低频分量、水平高频分量、垂直高频分量和对角分量。图6为足球比赛视频图像经过三层正交小波分解图,其中C3为图像的低频部分,图像的大部分能量都集中在这一区域,分别为水平、垂直与对角分量,它们都是图像的细节信息部分。It can be seen from Figure 4 that the edge profile of the original football game video image at one scale can be decomposed into four parts at a smaller scale: low-frequency components, horizontal high-frequency components, vertical high-frequency components and diagonal components. Different information representing the original football game video image obtained by different filters, where yes Obtained by the low-pass filter in the row and column directions, it corresponds to Edge profile information on the next scale; yes Obtained by a high-pass filter in the row direction and a low-pass filter in the column direction, it corresponds to The overview of the detailed information in the horizontal direction in the vertical direction; similarly, express The overview of the detail information in the vertical direction in the horizontal direction; express Diagonally detailed information. After the football game video image is decomposed by two-dimensional orthogonal wavelet transform, the low-frequency component, horizontal high-frequency component, vertical high-frequency component and diagonal component of the image are obtained respectively. Figure 6 is a three-layer orthogonal wavelet decomposition diagram of a football game video image, where C 3 is the low-frequency part of the image, and most of the energy of the image is concentrated in this area. They are the horizontal, vertical and diagonal components, which are the detailed information of the image.
2.2.2.2基于正交小波变换的足球比赛视频图像增强处理2.2.2.2 Video Image Enhancement Processing of Football Match Based on Orthogonal Wavelet Transform
由于图像信号在各层相应位置上的小波系数之间往往具有很强的相关性,而噪声的小波系数则具有弱相关或不相关的特点。首先利用小波分形插值对足球比赛视频图像信号进行去噪处理,可以得到较好去除噪声的效果。然后运用正交小波变换将一幅足球比赛视频图像分解为大小、位置和方向都不同的分量,在进行逆变换之前可以改变小波变换域中某些系数的大小,这样就可以有选择地放大对足球比赛视频图像中感兴趣的分量而衰减对图像处理结果影响不大的分量。正交小波分析方法是一种空间窗和频率窗都可作自适应改变、空频局部化分析方法,它与传统的傅里叶分析方法相比,具有更好的空频窗口特性。The wavelet coefficients of image signals in the corresponding positions of each layer often have a strong correlation, while the wavelet coefficients of noise have the characteristics of weak correlation or no correlation. Firstly, the wavelet fractal interpolation is used to denoise the football game video image signal, which can get a better effect of removing noise. Then use the orthogonal wavelet transform to decompose a football game video image into components with different sizes, positions and directions. Before the inverse transform, you can change the size of some coefficients in the wavelet transform domain, so that you can selectively enlarge the image. The components of interest in the football game video image are attenuated and the components that have little influence on the image processing result are attenuated. Orthogonal wavelet analysis method is a space-frequency localized analysis method that both the space window and the frequency window can be changed adaptively. Compared with the traditional Fourier analysis method, it has better space-frequency window characteristics.
二维多尺度离散正交小波分析定义为:Two-dimensional multiscale discrete orthogonal wavelet analysis is defined as:
式中f(x,y)为图像信号;Sjf(n,m)是f(x,y)的低频分量; 分别代表f(x,y)的垂直、对角和水平高频分量。Where f(x,y) is the image signal; S j f(n,m) is the low frequency component of f(x,y); Represent the vertical, diagonal and horizontal high-frequency components of f(x,y), respectively.
由此可见,经过二维离散正交小波分析后,足球比赛视频图像被分为低频分量和垂直、对角和水平三个高频分量。由于低对比度图像主要表现在三个高频分量偏小,造成图像细节模糊,因此适当增加三个高频分量,可以增强图像细节信息。于是,当式(3)成立时,即高频分量权重较大时,足球比赛视频图像看起来较清晰。It can be seen that after two-dimensional discrete orthogonal wavelet analysis, the video image of the football game is divided into low-frequency components and three high-frequency components: vertical, diagonal and horizontal. Since the low-contrast image mainly shows that the three high-frequency components are too small, resulting in blurred image details, so appropriately increasing the three high-frequency components can enhance image detail information. Therefore, when formula (3) holds true, that is, when the weight of the high-frequency component is relatively large, the video image of the football game looks clearer.
其中,为高频小波系数;为低频小波系数;k为高频分量权重;j为小波分解层数。利用正交小波变换足球比赛视频图像增强方法得到的实验结果如图7所示。但采用本方法后,由于增强了高频分量,因而所得足球比赛视频图像常常会偏亮,其对比度较差,所以还需用伪彩色处理来进一步增加足球比赛视频图像的分辨率。in, is the high-frequency wavelet coefficient; is the low-frequency wavelet coefficient; k is the weight of the high-frequency component; j is the number of wavelet decomposition layers. The experimental results obtained by using the orthogonal wavelet transform football game video image enhancement method are shown in Figure 7. However, after adopting this method, due to the enhanced high-frequency components, the resulting football game video image is often brighter and its contrast is poor, so it is necessary to use pseudo-color processing to further increase the resolution of the football game video image.
2.2.2.3图像的伪彩色足球比赛视频增强处理2.2.2.3 Pseudo-color football game video enhancement processing of images
本发明技术方案采用频率域伪彩色处理增强法对足球比赛视频图像进行伪彩色处理,先把足球比赛视频图像经傅立叶变换到频率域,在频率域内三个不同传递特性的滤波器分离成三个独立分量,然后对它们进行逆傅立叶变换,便得到三幅代表不同频率分量的单色图像,接着对这三幅图像作进一步的处理(如直方图均衡化),最后将它们作为三基色分量分别加到彩色显示器的红、绿、蓝显示通道,从而实现频率域分段的伪彩色增强。其框图如图8。The technical scheme of the present invention adopts the frequency domain pseudo-color processing enhancement method to perform pseudo-color processing on the football game video image, first transform the football game video image into the frequency domain through Fourier transform, and separate the three filters with different transfer characteristics into three in the frequency domain. Independent components, and then perform inverse Fourier transform on them to obtain three monochrome images representing different frequency components, then further process these three images (such as histogram equalization), and finally use them as three primary color components respectively Added to the red, green, and blue display channels of the color display, thereby realizing the false color enhancement of the frequency domain segmentation. Its block diagram is shown in Figure 8.
2.2.2.4基于小波分析和伪彩色处理的足球比赛视频图像增强2.2.2.4 Football game video image enhancement based on wavelet analysis and pseudo-color processing
为了克服基于正交小波分析足球比赛视频图像增强算法及伪彩色处理的足球比赛视频图像增强算法的缺陷,本发明技术方案提出了基于正交小波分析和伪彩色处理的足球比赛视频图像增强算法。该算法既可以克服采用正交小波分析足球比赛视频图像增强算法处理的图像偏亮及对比度较差等缺陷,又可克服伪彩色处理的足球比赛视频图像增强算法不能够充分处理图像中某些细节信息的缺陷。算法的具体实施步骤如下:In order to overcome the defects of the soccer match video image enhancement algorithm based on orthogonal wavelet analysis and pseudo-color processing, the technical scheme of the present invention proposes a football match video image enhancement algorithm based on orthogonal wavelet analysis and pseudo-color processing. This algorithm can not only overcome the defects of brighter and poorer contrast of the image processed by the orthogonal wavelet analysis football match video image enhancement algorithm, but also overcome the inability of the pseudo-color processing football match video image enhancement algorithm to fully process some details in the image Information Defects. The specific implementation steps of the algorithm are as follows:
Step 1:使用正交分形小波变换处理足球比赛视频图像,得到去噪后的图像。Step 1: Use the orthogonal fractal wavelet transform to process the football game video image to obtain the denoised image.
Step 2:利用正交小波变换将足球比赛视频图像分解为更小尺度下的低频分量、水平高频分量、垂直高频分量和对角分量四个部分。Step 2: Use the orthogonal wavelet transform to decompose the football game video image into four parts: low frequency component, horizontal high frequency component, vertical high frequency component and diagonal component at a smaller scale.
Step 3:为了达到足球比赛视频图像增强的目的,有选择性地对图像中感兴趣的部分进行放大,同时对图像中不重要的信息进行弱化处理。Step 3: In order to achieve the purpose of image enhancement of football game video, the part of interest in the image is selectively enlarged, and the unimportant information in the image is weakened.
Step 4:采用正交小波变换足球比赛视频图像增强算法得到结果图像后,将其转化为频率域,采用伪彩色处理的图像增强方法对不同频率部分进行处理,获得更好的足球比赛视频图像增强效果。Step 4: After using the orthogonal wavelet transform football game video image enhancement algorithm to obtain the result image, convert it into the frequency domain, and use the image enhancement method of pseudo-color processing to process different frequency parts to obtain better football game video image enhancement Effect.
利用本发明技术方案提出的基于正交小波分析和伪彩色处理的足球比赛视频图像增强方法处理的结果如图9所示。由于视频图像在摄制及播放的过程中可能会产生模糊图像,可以利用本发明技术方案提出的方法来增强模糊图像,如图10所示。Figure 9 shows the processing result of the football game video image enhancement method based on orthogonal wavelet analysis and pseudo-color processing proposed by the technical solution of the present invention. Since blurred images may be generated during the process of filming and playing video images, the method proposed by the technical solution of the present invention can be used to enhance the blurred images, as shown in FIG. 10 .
实验对比Experimental comparison
本发明技术方案通过计算增强后的足球比赛视频图像的均值、信息熵和清晰度来对足球比赛视频图像增强效果进行定量方面评价。利用式(5)来计算图像的均值。The technical scheme of the invention evaluates the enhancement effect of the football match video image quantitatively by calculating the average value, information entropy and definition of the enhanced football match video image. Use formula (5) to calculate the mean value of the image.
其中,Ie为增强后的结果图像,(X,Y)为图像大小。对于一幅图像来说,均值反映了图像的平均亮度。如果均值适中(灰度值128在附近),则表明视觉效果良好。Among them, I e is the enhanced result image, and (X, Y) is the image size. For an image, the mean reflects the average brightness of the image. If the mean is moderate (with a grayscale value of 128 in the vicinity), then the visuals are good.
信息熵的计算定义如下:The calculation of information entropy is defined as follows:
其中,pi为图像的灰度级GNLi对应的概率;L为灰度级总数;i∈(0,1,...L-2,L-1)。熵值越大,反映了图像携带的信息量越多,因此信息熵是衡量图像信息丰富程度的一个重要指标。Among them, p i is the probability corresponding to the gray level GNL i of the image; L is the total number of gray levels; i∈(0,1,...L-2,L-1). The larger the entropy value, the more information the image carries, so information entropy is an important indicator to measure the richness of image information.
足球比赛视频图像的清晰度可以用式(7)来计算:The sharpness of football game video images can be calculated by formula (7):
清晰度可以反映出足球比赛视频图像中的微小细节反差和纹理变换特征。清晰度值越大,说明对应的足球比赛视频图像越清晰。3种算法增强后足球比赛视频图像的均值,信息熵和清晰度如表1所示。3种算法增强后足球比赛视频图像的RGB各个通道的均值,信息熵和清晰度如表2所示。Clarity can reflect the small detail contrast and texture transformation characteristics in football game video images. The larger the sharpness value, the clearer the corresponding football game video image. Table 1 shows the mean value, information entropy and clarity of football game video images enhanced by the three algorithms. Table 2 shows the mean value, information entropy and clarity of each RGB channel of the football game video image enhanced by the three algorithms.
表1 增强后的图像的均值、信息熵和清晰度Table 1 Mean value, information entropy and sharpness of enhanced image
表2 增强后的图像的均值、信息熵和清晰度Table 2 Mean value, information entropy and sharpness of the enhanced image
本部分介绍了足球比赛视频图像预处理技术。首先介绍了均值滤波去噪、中值滤波去噪、基于PDE的图像去噪、全变分图像去噪和分形小波变换去噪五种常用图像去噪方法及其缺陷。提出了基于多元统计模型的分形小波自适应图像去噪算法。在去噪过程中,首先建立了一个多元统计模型,该模型能够更准确地估计各种相关信息,且模型参数改善比较灵活。然后通过与分形小波去噪方法结合可以选择高品质的图像空间。在适度的噪声方差下可以根据拼贴距离在最好的子树域中找到近优父子树。最后通过从噪声图像中预测出无噪声的图像分形小波编码,从而达到优化去噪的目的。该方法在去除噪声的同时,能有效地保持图像的边缘及纹理特征,很好地保留图像的精细结构,取得了良好的去噪效果。由于采用了预测小波分形编码,优化了算法结构,算法的处理速度比较快。其次介绍了常用的频率域足球比赛视频图像增强和空间域足球比赛视频图像增强方法及其缺陷。提出了基于正交小波分析和伪彩色处理的足球比赛视频图像增强算法,该算法既可以克服采用正交小波分析足球比赛视频图像增强算法处理的图像偏亮及对比度较差等缺陷,又可克服伪彩色处理的足球比赛视频图像增强算法不能够充分处理图像中某些细节信息的缺陷。This part introduces the football game video image preprocessing technology. Firstly, five commonly used image denoising methods, namely mean filter denoising, median filter denoising, PDE-based image denoising, full variation image denoising and fractal wavelet transform denoising, and their defects are introduced. A fractal wavelet adaptive image denoising algorithm based on multivariate statistical model is proposed. In the process of denoising, a multivariate statistical model is first established, which can estimate various relevant information more accurately, and the model parameters can be improved more flexibly. Then by combining with fractal wavelet denoising method can select high quality image space. Under moderate noise variance, the near-optimal parent-child tree can be found in the best subtree domain according to the tile distance. Finally, the noise-free image fractal wavelet code is predicted from the noisy image, so as to achieve the purpose of optimizing denoising. This method can effectively maintain the edge and texture features of the image while removing the noise, and preserve the fine structure of the image well, achieving a good denoising effect. Due to the use of predictive wavelet fractal coding, the algorithm structure is optimized, and the processing speed of the algorithm is relatively fast. Secondly, the commonly used frequency domain football match video image enhancement methods and space domain football match video image enhancement methods and their defects are introduced. A football game video image enhancement algorithm based on orthogonal wavelet analysis and pseudo-color processing is proposed. The football game video image enhancement algorithm with pseudo-color processing cannot fully deal with the defects of some detailed information in the image.
最后应说明的是:以上所述仅为本发明的优选实施例而已,并不用于限制本发明,尽管参照前述实施例对本发明进行了详细的说明,对于本领域的技术人员来说,其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。Finally, it should be noted that: the above is only a preferred embodiment of the present invention, and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the foregoing embodiments, for those skilled in the art, it still The technical solutions recorded in the foregoing embodiments may be modified, or some technical features thereof may be equivalently replaced. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.
Claims (6)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510186348.9A CN104881847A (en) | 2015-04-17 | 2015-04-17 | Match video image enhancement method based on wavelet analysis and pseudo-color processing |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510186348.9A CN104881847A (en) | 2015-04-17 | 2015-04-17 | Match video image enhancement method based on wavelet analysis and pseudo-color processing |
Publications (1)
Publication Number | Publication Date |
---|---|
CN104881847A true CN104881847A (en) | 2015-09-02 |
Family
ID=53949332
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510186348.9A Pending CN104881847A (en) | 2015-04-17 | 2015-04-17 | Match video image enhancement method based on wavelet analysis and pseudo-color processing |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104881847A (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106097274A (en) * | 2016-06-20 | 2016-11-09 | 陕西理工学院 | A kind of adaptive fractional rank differential algorithm for image enhancement |
CN108596075A (en) * | 2018-04-20 | 2018-09-28 | 上海华羽文化发展有限公司 | A kind of badminton game tactical analysis method of the multi-modal feature of fusion |
CN110033417A (en) * | 2019-04-12 | 2019-07-19 | 江西财经大学 | A kind of image enchancing method based on deep learning |
CN111476725A (en) * | 2020-03-24 | 2020-07-31 | 广西科技大学 | Image defogging enhancement algorithm based on gradient domain oriented filtering and multi-scale Retinex theory |
CN111667426A (en) * | 2020-06-04 | 2020-09-15 | 四川轻化工大学 | Medical image enhancement method based on frequency domain variation |
CN112288662A (en) * | 2019-08-12 | 2021-01-29 | 中北大学 | A kind of wheel hub X-ray image enhancement method and system |
US11556896B2 (en) | 2019-09-26 | 2023-01-17 | Fulian Precision Electronics (Tianjin) Co., Ltd. | Employment recruitment method based on face recognition and terminal device using same |
CN117274117A (en) * | 2023-11-23 | 2023-12-22 | 合肥工业大学 | Frequency domain pseudo-color enhanced cardiomagnetic signal characteristic image generation method and storage medium |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102063699A (en) * | 2010-08-10 | 2011-05-18 | 东莞环亚高科电子有限公司 | A Method of Video Image Scaling Based on Interpolation Orthogonal Multiwavelet |
CN103020915A (en) * | 2012-12-21 | 2013-04-03 | 清华大学 | Video data based objective image enhancement method |
CN103955905A (en) * | 2014-05-13 | 2014-07-30 | 北京邮电大学 | Rapid wavelet transformation and weighted image fusion single-image defogging method |
-
2015
- 2015-04-17 CN CN201510186348.9A patent/CN104881847A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102063699A (en) * | 2010-08-10 | 2011-05-18 | 东莞环亚高科电子有限公司 | A Method of Video Image Scaling Based on Interpolation Orthogonal Multiwavelet |
CN103020915A (en) * | 2012-12-21 | 2013-04-03 | 清华大学 | Video data based objective image enhancement method |
CN103955905A (en) * | 2014-05-13 | 2014-07-30 | 北京邮电大学 | Rapid wavelet transformation and weighted image fusion single-image defogging method |
Non-Patent Citations (4)
Title |
---|
张代英 等: "基于小波分析和伪彩色处理的低对比度图像增强", 《光学技术》 * |
王智文 等: "基于小波分析和伪彩色的遥感图像增强", 《计算机工程与设计》 * |
王智文 等: "基于正交小波变换和伪彩色的遥感图像增强", 《计算机测量与控制》 * |
郭朋 等: "一种改进的全局Retinex监控视频图像增强方法", 《四川理工学院学报(自然科学版)》 * |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106097274A (en) * | 2016-06-20 | 2016-11-09 | 陕西理工学院 | A kind of adaptive fractional rank differential algorithm for image enhancement |
CN108596075A (en) * | 2018-04-20 | 2018-09-28 | 上海华羽文化发展有限公司 | A kind of badminton game tactical analysis method of the multi-modal feature of fusion |
CN110033417A (en) * | 2019-04-12 | 2019-07-19 | 江西财经大学 | A kind of image enchancing method based on deep learning |
CN110033417B (en) * | 2019-04-12 | 2023-06-13 | 江西财经大学 | An Image Enhancement Method Based on Deep Learning |
CN112288662A (en) * | 2019-08-12 | 2021-01-29 | 中北大学 | A kind of wheel hub X-ray image enhancement method and system |
US11556896B2 (en) | 2019-09-26 | 2023-01-17 | Fulian Precision Electronics (Tianjin) Co., Ltd. | Employment recruitment method based on face recognition and terminal device using same |
TWI804696B (en) * | 2019-09-26 | 2023-06-11 | 新加坡商鴻運科股份有限公司 | A talent recruitment method, a terminal server and a storage medium based on face recognition |
CN111476725A (en) * | 2020-03-24 | 2020-07-31 | 广西科技大学 | Image defogging enhancement algorithm based on gradient domain oriented filtering and multi-scale Retinex theory |
CN111667426A (en) * | 2020-06-04 | 2020-09-15 | 四川轻化工大学 | Medical image enhancement method based on frequency domain variation |
CN111667426B (en) * | 2020-06-04 | 2023-10-13 | 四川轻化工大学 | Medical image enhancement method based on frequency domain variation |
CN117274117A (en) * | 2023-11-23 | 2023-12-22 | 合肥工业大学 | Frequency domain pseudo-color enhanced cardiomagnetic signal characteristic image generation method and storage medium |
CN117274117B (en) * | 2023-11-23 | 2024-02-02 | 合肥工业大学 | Frequency domain pseudo-color enhanced magnetocardiogram signal characteristic image generation method and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Liu et al. | Efficient single image dehazing and denoising: An efficient multi-scale correlated wavelet approach | |
CN110175964B (en) | Retinex image enhancement method based on Laplacian pyramid | |
CN104881847A (en) | Match video image enhancement method based on wavelet analysis and pseudo-color processing | |
CN103440630B (en) | Show and detail enhancing method based on the Larger Dynamic scope infrared image guiding wave filter | |
CN100550978C (en) | A kind of self-adapting method for filtering image that keeps the edge | |
CN104715461B (en) | Image de-noising method | |
CN109242799B (en) | Variable-threshold wavelet denoising method | |
CN111583123A (en) | Wavelet transform-based image enhancement algorithm for fusing high-frequency and low-frequency information | |
Jun et al. | Image defogging algorithm of single color image based on wavelet transform and histogram equalization | |
CN111489303A (en) | Maritime affairs image enhancement method under low-illumination environment | |
CN105303532A (en) | Wavelet domain Retinex image defogging method | |
CN106709891A (en) | Image processing method based on combination of wavelet transform and self-adaptive transform | |
CN108109123B (en) | Image denoising method | |
CN104574293A (en) | Multiscale Retinex image sharpening algorithm based on bounded operation | |
CN105243641B (en) | A kind of low light image Enhancement Method based on dual-tree complex wavelet transform | |
Wen et al. | Medical X-ray image enhancement based on wavelet domain homomorphic filtering and CLAHE | |
Mu et al. | Low and non-uniform illumination color image enhancement using weighted guided image filtering | |
CN104616259B (en) | A kind of adaptive non-local mean image de-noising method of noise intensity | |
CN103020918A (en) | Shape-adaptive neighborhood mean value based non-local mean value denoising method | |
CN107203977A (en) | A kind of underwater image restoration method based on dark primary priori and rarefaction representation | |
CN111242854A (en) | Image denoising method | |
CN103971345A (en) | Image denoising method based on improved bilateral filtering | |
CN104182939A (en) | Medical image detail enhancement method | |
CN108492268A (en) | Enhancement algorithm for low-illumination image based on wavelet coefficient fusion | |
CN106067164B (en) | Color Image Contrast Enhancement Algorithm Based on Adaptive Wavelet Domain Processing |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
EXSB | Decision made by sipo to initiate substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150902 |
|
RJ01 | Rejection of invention patent application after publication |