CN102457696B - Image processing device and image processing method - Google Patents
Image processing device and image processing method Download PDFInfo
- Publication number
- CN102457696B CN102457696B CN2010105138715A CN201010513871A CN102457696B CN 102457696 B CN102457696 B CN 102457696B CN 2010105138715 A CN2010105138715 A CN 2010105138715A CN 201010513871 A CN201010513871 A CN 201010513871A CN 102457696 B CN102457696 B CN 102457696B
- Authority
- CN
- China
- Prior art keywords
- image frame
- pixel
- field
- image
- value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Image Processing (AREA)
- Image Analysis (AREA)
Abstract
Description
技术领域 technical field
本发明涉及一种多媒体处理装置及多媒体处理方法,且特别涉及一种影像处理装置及影像处理方法。The invention relates to a multimedia processing device and a multimedia processing method, and in particular to an image processing device and an image processing method.
背景技术 Background technique
近年来,电脑运算能力快速地成长,数字的媒介成了人类表达创意和想象的最佳工具。其中,数字影像处理的运用以及相关影像产品的发展,让人们得以利用数字的方式纪录、保存生活中的浮光掠影。In recent years, computer computing power has grown rapidly, and digital media has become the best tool for human beings to express their creativity and imagination. Among them, the application of digital image processing and the development of related image products allow people to use digital methods to record and preserve the glimpses of life.
然而,数字影像的资料量都十分地庞大,因此许多数字储存或压缩标准都采用YUV_4:2:0色彩格式,以降低数字影像的资料量。之后,在欲播放数字影像时,再由影像输出装置将数字影像资料由YUV_4:2:0色彩格式转为YUV_4:2:2色彩格式。在YUV_4:2:0色彩格式下,数字影像垂直的色彩资讯只有原本减少取样(down-sampling)前的一半。如果再加上以交错模式(interlaced)来产生数字影像,则颜色掉线的情况会更加严重,尤其是在垂直方向有高频的颜色变化时,还原的影像会有很明显的颜色锯齿,甚至是梳形现象(combing)。However, the amount of data in digital images is very large, so many digital storage or compression standards adopt the YUV_4:2:0 color format to reduce the amount of data in digital images. Afterwards, when the digital image is to be played, the image output device converts the digital image data from the YUV_4:2:0 color format to the YUV_4:2:2 color format. In the YUV_4:2:0 color format, the vertical color information of the digital image is only half of the original before down-sampling. If the interlaced mode (interlaced) is used to generate digital images, the color drop will be more serious, especially when there are high-frequency color changes in the vertical direction, the restored image will have obvious color aliasing, and even It is a comb phenomenon (combing).
此外,在数字影像资料由YUV_4:2:0色彩格式转为YUV_4:2:2色彩格式时,影像输出装置通常都是使用高阶数的滤波器。但高阶数垂直滤波需要大量的资料储存,严重提高成本,而若使用低阶数的滤波器,则数字影像相对比较模糊。In addition, when the digital image data is converted from the YUV_4:2:0 color format to the YUV_4:2:2 color format, the image output device usually uses a high-order filter. However, high-order vertical filtering requires a large amount of data storage, which seriously increases the cost, and if a low-order filter is used, the digital image is relatively blurred.
在MPEG(Motion Picture Experts Group,动画专家群组)或其他压缩标准下的YUV_4:2:0色彩格式转YUV_4:2:2色彩格式,可以在交错模式(interlaced)或循序模式(progressive)下执行。在解压缩时,前端压缩电路会将压缩时所使用的方式以旗标(flag)形式提供给后端影像输出装置进行解压缩。依照旗标(flag)资讯,影像输出装置可以降低YUV_4:2:0色彩格式所产生的视觉副作用。YUV_4:2:0 color format to YUV_4:2:2 color format under MPEG (Motion Picture Experts Group, animation expert group) or other compression standards can be executed in interlaced mode (interlaced) or sequential mode (progressive) . When decompressing, the front-end compression circuit will provide the mode used in the compression to the back-end image output device in the form of a flag for decompression. According to the flag information, the video output device can reduce the visual side effects produced by the YUV_4:2:0 color format.
然而,部份前端压缩电路可能没有正确地设定旗标(flag)资讯,因此后端影像输出装置进行解压缩时,会以较差的解压缩方式将YUV_4:2:0色彩格式还原成YUV_4:2:2色彩格式,进而产生更严重的视觉副作用。However, some front-end compression circuits may not correctly set the flag information, so when the back-end image output device decompresses, it will restore the YUV_4:2:0 color format to YUV_4 in a poor decompression method :2:2 color format, which in turn produces more severe visual side effects.
发明内容 Contents of the invention
本发明提供一种影像处理装置,其以移动侦测方式(motion detection)决定欲还原的目标影像与其前后张影像的相关性,来还原色彩格式,以有效降低压缩时所产生的视觉副作用。The present invention provides an image processing device, which uses motion detection to determine the correlation between the target image to be restored and its preceding and following images, to restore the color format, so as to effectively reduce the visual side effects generated during compression.
本发明提供一种影像处理装置,其包括一影像侦测单元、一影像补插单元及一影像混合单元。影像侦测单元用以侦测一影像画面与其前张影像画面或其后张影像画面的一像素差值(pixel difference value),并依据像素差值输出一权重值。影像补插单元以一场内补插法(itntra-field interpolation)及一场间补插法(inter-field interpolation),补插影像画面的像素值。影像混合单元依据权重值混合以场内补插法所补插的像素值及以场间补插法所补插的像素值,以还原影像画面。The invention provides an image processing device, which includes an image detection unit, an image interpolation unit and an image mixing unit. The image detection unit is used for detecting a pixel difference value (pixel difference value) between an image frame and its previous image frame or subsequent image frame, and outputting a weight value according to the pixel difference value. The image interpolation unit uses itntra-field interpolation and inter-field interpolation to interpolate the pixel values of the image frame. The image mixing unit mixes the pixel values interpolated by the intra-field interpolation method and the pixel values interpolated by the inter-field interpolation method according to the weight value to restore the image frame.
在本发明的一实施例中,上述的影像补插单元包括一场内补插单元及一场间补插单元。场内补插单元以场内补插法补插影像画面的像素值。场间补插单元以场间补插法补插影像画面的像素值。In an embodiment of the present invention, the above-mentioned image interpolation unit includes an intra-field interpolation unit and an inter-field interpolation unit. The intra-field interpolation unit interpolates the pixel values of the image frame by an intra-field interpolation method. The inter-field interpolation unit interpolates the pixel values of the image frame by an inter-field interpolation method.
在本发明的一实施例中,上述的场内补插单元以场内补插法补插影像画面的像素值时,依据影像画面的一目标像素点周围邻近的像素点的像素值补插目标像素点的像素值。In an embodiment of the present invention, when the above-mentioned intra-field interpolation unit interpolates the pixel value of the image frame by the intra-field interpolation method, it interpolates the target according to the pixel values of adjacent pixel points around a target pixel point of the image frame. The pixel value of the pixel point.
在本发明的一实施例中,上述的场间补插单元以场间补插法补插影像画面的像素值时,是依据影像画面的一目标像素点在前张影像画面的一奇图场(odd field)或一偶图场(even field)或后张影像画面的一奇图场或一偶图场中所对应的像素点的像素值,补插目标像素点的像素值。In an embodiment of the present invention, when the above-mentioned inter-field interpolation unit interpolates the pixel value of the image frame by the inter-field interpolation method, it is based on a target pixel point of the image frame in an odd field of the previous image frame (odd field) or an even field (even field) or the pixel value of the corresponding pixel in an odd field or an even field of the next image frame, and interpolate the pixel value of the target pixel.
在本发明的一实施例中,上述的影像画面包括一奇图场及一偶图场。影像侦测单元分别比较影像画面的奇图场及偶图场与前张影像画面的一奇图场及一偶图场或后张影像画面的一奇图场及一偶图场,以获得像素差值。In an embodiment of the present invention, the above image frame includes an odd field and an even field. The image detection unit compares the odd field and the even field of the image frame with an odd field and an even field of the previous image frame or an odd field and an even field of the next image frame to obtain pixels difference.
在本发明的一实施例中,上述的影像画面的像素值包括灰阶值、色彩值或亮度值。In an embodiment of the present invention, the above-mentioned pixel values of the image frame include gray scale values, color values or brightness values.
本发明提供一种影像处理方法,其适于一影像处理装置。影像处理方法包括如下步骤。侦测一影像画面与其前张影像画面或其后张影像画面的一像素差值。依据像素差值输出一权重值。以一场内补插法及一场间补插法,补插影像画面的像素值。依据权重值混合以场内补插法所补插的像素值及以场间补插法所补插之像素值,以还原影像画面。The invention provides an image processing method, which is suitable for an image processing device. The image processing method includes the following steps. A pixel difference between an image frame and its previous image frame or its subsequent image frame is detected. Outputting a weight value according to the pixel difference. Interpolate the pixel values of the image frame by intra-field interpolation and inter-field interpolation. According to the weight value, the pixel values interpolated by the intra-field interpolation method and the pixel values interpolated by the inter-field interpolation method are mixed to restore the image picture.
在本发明的一实施例中,在以场内补插法及场间补插法,补插影像画面之像素值的步骤中,以场内补插法补插影像画面的像素值时,依据影像画面的一目标像素点周围邻近的像素点的像素值补插目标像素点的像素值。In one embodiment of the present invention, in the step of interpolating the pixel values of the image frame by the intra-field interpolation method and the inter-field interpolation method, when interpolating the pixel values of the image frame by the intra-field interpolation method, according to The pixel value of the target pixel is interpolated from the pixel values of adjacent pixels around a target pixel in the image frame.
在本发明的一实施例中,在以场内补插法及场间补插法,补插影像画面的像素值的步骤中,以场间补插法补插影像画面的像素值时,是依据影像画面的一目标像素点在前张影像画面的一奇图场或一偶图场或后张影像画面的一奇图场或一偶图场中所对应的像素点的像素值,补插目标像素点的像素值。In one embodiment of the present invention, in the step of interpolating the pixel values of the image frame by the intra-field interpolation method and the inter-field interpolation method, when interpolating the pixel values of the image frame by the inter-field interpolation method, it is According to the pixel value of a target pixel in the image frame corresponding to an odd field or an even field of the previous image frame or an odd field or an even field of the next image frame, interpolation The pixel value of the target pixel.
在本发明的一实施例中,上述的影像画面包括一奇图场及一偶图场。在侦测影像画面与其前张影像画面或其后张影像画面的像素差值的步骤中,分别比较影像画面的奇图场及偶图场与前张影像画面的一奇图场及一偶图场或后张影像画面的一奇图场及一偶图场,以获得像素差值。In an embodiment of the present invention, the above image frame includes an odd field and an even field. In the step of detecting the pixel difference between an image frame and its previous image frame or its subsequent image frame, comparing an odd field and an even field of the image frame with an odd field and an even image of the previous image frame respectively An odd field and an even field of a field or a subsequent image frame to obtain pixel difference values.
基于上述,在本发明的实施例中,影像处理装置及其影像处理方法以移动侦测方式来决定欲还原的目标影像与其前后张影像的像素差值,进而决定还原目标影像画面时的权重值。Based on the above, in an embodiment of the present invention, the image processing device and its image processing method determine the pixel difference between the target image to be restored and its previous and subsequent images by means of motion detection, and then determine the weight value when restoring the target image frame .
为让本发明的上述特征和优点能更明显易懂,下文特举实施例,并配合附图作详细说明如下。In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail with reference to the accompanying drawings.
附图说明 Description of drawings
图1为本发明一实施例的影像处理装置的方块示意图。FIG. 1 is a schematic block diagram of an image processing device according to an embodiment of the present invention.
图2为本发明一实施例的移动侦测方式的示意图。FIG. 2 is a schematic diagram of a motion detection method according to an embodiment of the present invention.
图3为本发明一实施例的像素差值与权重值的映射关系图。FIG. 3 is a mapping relationship diagram between pixel difference values and weight values according to an embodiment of the present invention.
图4为本发明一实施例的场内补插法的像素示意图。FIG. 4 is a schematic diagram of pixels of an intra-field interpolation method according to an embodiment of the present invention.
图5为本发明一实施例的影像处理方法的步骤流程图。FIG. 5 is a flowchart of steps of an image processing method according to an embodiment of the present invention.
附图标记:Reference signs:
100:影像处理装置; 110:影像侦测单元;100: image processing device; 110: image detection unit;
120:影像补插单元; 122:场内补插单元;120: Image interpolation unit; 122: In-field interpolation unit;
124:场间补插单元; 130:影像混合单元;124: Interpolation unit between fields; 130: Image mixing unit;
S、S’:影像讯号; α:权重值;S, S’: image signal; α: weight value;
I1、I2:影像画面; f0、f2:偶图场;I 1 , I 2 : image screen; f 0 , f 2 : even image field;
f1、f3:奇图场; D1、D2:像素差值;f 1 , f 3 : odd image field; D1, D2: pixel difference;
C_intra、C_inter:补插后的像素值;C_intra, C_inter: pixel value after interpolation;
P0~P7、P0’~P7’、T、B、L、R、Pi”、P3”、P4”、P5”:像素点。P 0 ~P 7 , P 0 ′~P 7 ′, T, B, L, R, P i ”, P 3 ”, P 4 ”, P 5 ”: pixel points.
具体实施方式 Detailed ways
在本发明的范例实施例中,影像处理装置在把影像画面的色彩格式由YUV_4:2:0还原到YUV_4:2:2时,会参考灰阶梯度及色彩资讯(空间域)。同时,在交错模式下,影像处理装置也会考虑像素的移动量,以求在时间域寻找最有效的参考点。之后,影像处理装置再以得到的参考点及相关的权重值补插出色彩高垂直解析度,并有效降低压缩时所产生的视觉副作用。In an exemplary embodiment of the present invention, when the image processing device restores the color format of the image frame from YUV_4:2:0 to YUV_4:2:2, it will refer to the grayscale gradient and color information (spatial domain). At the same time, in the interlaced mode, the image processing device will also consider the moving amount of the pixels in order to find the most effective reference point in the time domain. After that, the image processing device uses the obtained reference points and related weight values to interpolate the high vertical resolution of the color, and effectively reduce the visual side effects generated during compression.
在下文的范例实施例中,是以补插目标像素点的色度值(chroma)为例,但本发明并不限于此。In the following exemplary embodiments, the interpolation of the chroma value (chroma) of the target pixel is taken as an example, but the present invention is not limited thereto.
图1为本发明一实施例的影像处理装置的方块示意图。请参考图1,在本实施例中,影像处理装置100包括一影像侦测单元110、一影像补插单元120及一影像混合单元130。在此,影像补插单元120包括一场内补插单元122及一场间补插单元124。FIG. 1 is a schematic block diagram of an image processing device according to an embodiment of the present invention. Please refer to FIG. 1 , in this embodiment, the image processing device 100 includes an
在本实施例中,影像侦测单元110在接收影像讯号S后,会侦测所欲补插的目标影像画面(即本张影像画面)与其前张影像画面或其后张影像画面的像素差值,并依据该像素差值输出一权重值α至影像混合单元130。In this embodiment, after receiving the image signal S, the
另一方面,影像补插单元120也会接收影像讯号S,以补插目标影像画面。在本实施例中,场内补插单元122以场内补插法补插目标影像画面的像素值,并输出补插后的像素值C_intra至影像混合单元130。同时,场间补插单元124以场间补插法补插目标影像画面的像素值,并输出补插后的像素值C_inter至影像混合单元130。On the other hand, the
接着,影像混合单元130再依据影像侦测单元110所决定的权重值α,混合影像补插单元120所补插后的像素值C_intra、C_inter,以还原影像画面,输出影像讯号S’。在此,影像补插单元120所补插后的像素值C_intra、C_inter例如是目标影像画面中的像素点的色度值。Next, the
因此,本实施例的影像处理装置100不需倚赖前端压缩电路所提供的旗标来进行影像还原。即使前端压缩电路没有正确地设定旗标资讯,影像处理装置100仍可补插出色彩高垂直解析度,以有效提升影像输出品质。Therefore, the image processing device 100 of this embodiment does not need to rely on the flag provided by the front-end compression circuit to perform image restoration. Even if the front-end compression circuit does not correctly set the flag information, the image processing device 100 can still interpolate the high vertical resolution of the color, so as to effectively improve the image output quality.
详细而言,影像侦测单元110例如是一动态影像侦测器(motion detector),其以移动侦测方式来决定目标影像画面与其前张或后张影像画面的像素值的像素差值,进而决定影像混合单元130在还原影像画面时所依据的权重值α。Specifically, the
图2为本发明一实施例的移动侦测方式的示意图。请参考图1及图2,在本实施例中,影像画面压缩时例如是在交错模式下执行。因此,影像侦测单元110所接收的影像画面I1、I2例如分别包含有偶图场f0、f2及奇图场f1、f3,其中符号○代表像素点的灰阶值,符号●代表像素点的色度值,而符号代表本实施例中所欲补插的目标像素点的灰阶值。FIG. 2 is a schematic diagram of a motion detection method according to an embodiment of the present invention. Please refer to FIG. 1 and FIG. 2 , in this embodiment, image frame compression is performed in an interlaced mode, for example. Therefore, the image frames I 1 and I 2 received by the
在交错模式中,偶图场与奇图场仅分别包含有原始影像画面内隔行的资料。偶图场会显示偶数扫描线的影像讯号,而奇图场会显示奇数扫描线的影像讯号,而且两者是交错显示的。由于偶图场与奇图场仅分别包含有原始影像画面内隔行的资料,因此就同一个图场而言,垂直方向上的色彩资讯只有原本的一半,而相邻像素点是共同参考一个色度值。所以,在还原影像画面时,影像处理装置100必需补插缺乏色度值的像素点的色度值。In the interlaced mode, the even field and the odd field only contain interlaced data in the original image frame respectively. The even field will display the image signal of the even scanning line, and the odd field will display the image signal of the odd scanning line, and the two are displayed alternately. Since the even image field and the odd image field only contain interlaced data in the original image frame, the color information in the vertical direction is only half of the original for the same image field, and adjacent pixels refer to a common color information. degree value. Therefore, when restoring an image frame, the image processing device 100 must interpolate the chroma values of pixels lacking chroma values.
例如,在偶图场f2中,垂直方向上的像素点P0、P2是共同参考像素点P0的色度值;像素点P4、P6是共同参考像素点P4的色度值,以此类推。所以,影像补插单元120必需补插像素点P2、P6的色度值,以还原影像画面。For example, in the even image field f2 , the pixel points P 0 and P 2 in the vertical direction are the chromaticity values of the common reference pixel point P 0 ; the pixel points P 4 and P 6 are the chromaticity values of the common reference pixel point P 4 value, and so on. Therefore, the
在图2中,若影像补插单元120的补插目标为影像画面I2,则就时间关系上而言,影像画面I1为其前张影像画面。相反地,若影像补插单元120的补插目标为影像画面I1,则就时间关系上而言,影像画面I2为其后张影像画面。在本实施例中,影像补插单元120的补插目标例如是影像画面I2的像素点P2(在图2中以表示),因此影像画面I1为影像画面I2的前张影像画面。In FIG. 2 , if the interpolation target of the
当前张影像画面I1上的物件移动时,在其后的影像画面I2上所对应的像素点,其像素值也会产生显著的变化差值。举例而言,在奇图场f1中,当对应像素点P3’位置的物件移动时,奇图场f3的像素点P3的灰阶值及色度值与像素点P3’的灰阶值及色度值相较,即会存在一变化显著的像素差值(即两者间的灰阶差值或色度差值)。类似地,在偶图场f0中,当对应像素点P4’位置的物件移动时,偶图场f2上的像素点P4的灰阶值及色度值与像素点P4’的灰阶值及色度值相较也存在一像素差值(即两者间的灰阶差值或色度差值)。When the object on the previous image frame I1 moves, the pixel value of the corresponding pixel on the subsequent image frame I2 will also have a significant change difference. For example, in the odd image field f1 , when the object corresponding to the pixel point P3 ' moves, the gray scale value and chromaticity value of the pixel point P3 in the odd image field f3 are the same as those of the pixel point P3 ' Compared with the grayscale value and the chrominance value, there will be a significant pixel difference (that is, the grayscale difference or the chrominance difference between the two). Similarly, in the even image field f0 , when the object corresponding to the pixel point P4 ' moves, the grayscale value and chromaticity value of the pixel point P4 on the even image field f2 are the same as those of the pixel point P4 ' There is also a pixel difference between the grayscale value and the chrominance value (that is, the grayscale difference or the chrominance difference between the two).
因此,在本实施例中,当前张影像画面I1上的物件移动时,影像侦测单元110例如是比较像素点P3’及P3或P4’及P4的像素值,以获得像素差值。在本实施例中,影像侦测单元110是以比较前张影像画面与目标影像画面为例,本发明并不限于此。在其他实施例中,影像侦测单元110也可比较后张影像画面与目标影像画面,或同时比较前张及后张影像画面与目标影像画面,而获得像素差值。Therefore, in this embodiment, when the object on the previous image frame I1 moves, the
因此,影像侦测单元110以上述侦测影像画面上的物件是否有移动的移动侦测方式,来决定目标影像画面与其前张或后张影像画面的像素值的像素差值,进而决定影像混合单元130还原影像画面时所参考的权重值α。Therefore, the
换句话说,影像侦测单元分别比较影像画面的奇图场及偶图场与前张影像画面的奇图场及偶图场或后张影像画面的奇图场及偶图场,以获得像素差值。进而在获得像素差值后,影像侦测单元再据此产生权重值,并输出至影像混合单元。In other words, the image detection unit compares the odd field and the even field of the image frame with the odd field and the even field of the previous image frame or the odd field and the even field of the next image frame to obtain the pixel difference. Furthermore, after obtaining the pixel difference value, the image detection unit generates a weight value based on it, and outputs it to the image mixing unit.
图3为本发明一实施例的像素差值与权重值的映射关系图。请参考图1至图3,在本实施例中,影像侦测单元110在通过上述移动侦测方式决定像素差值后,可依据图3的映射关系图,产生权重值α。接着,影像混合单元130再以例如是C_intra×α+C_inter×(1-α)的比例关系来还原影像画面。FIG. 3 is a mapping relationship diagram between pixel difference values and weight values according to an embodiment of the present invention. Please refer to FIG. 1 to FIG. 3 . In this embodiment, the
举例而言,以动态影像为例,其影像画面上的物件常有明显的变动,因此影像侦测单元110侦测所得的像素差值D1较大。依据图3,此像素差值D1例如是映射于α=1。所以,当影像混合单元130还原影像画面时,例如是以C_intra×1+C_inter×0的比例关系来还原影像画面。即此时的影像混合单元130仅依据场内补插单元122的补插结果,来还原影像画面。For example, taking a dynamic image as an example, the objects on the image screen often have obvious changes, so the pixel difference D1 detected by the
另外,以静态影像为例,其影像画面上的物件通常没有明显的变动,因此影像侦测单元110侦测所得的像素差值D2较小。依据图3,此像素差值D2例如是映射于α=0。所以,当影像混合单元130还原影像画面时,例如是以C_intra×0+C_inter×1的比例关系来还原影像画面。即此时的影像混合单元130仅依据场间补插单元124的补插结果,来还原影像画面。In addition, taking a still image as an example, the objects on the image screen generally do not change significantly, so the pixel difference D2 detected by the
因此,依据影像画面变化程度的不同,影像侦测单元110依据图3所映射的权重值α也有程度上的差异。是以,在本发明的范例实施例中,影像处理装置100可依据影像画面的变化程度,适应性地调整以场内补插法所补插后的像素值C_intra与以场间补插法所补插后的像素值C_inter之间的比例关系,来还原影像画面,不需倚赖前端压缩电路所提供的旗标来进行影像还原。所以,即使前端压缩电路没有正确地设定旗标资讯,影像处理装置100仍可补插出色彩高垂直解析度,以有效提升影像输出品质。Therefore, according to the different degree of change of the image frame, the weight value α mapped by the
就场间补插单元124而言,以补插色度值为例,其是以场间补插法来补插目标像素点的色度值,其中场间补插法在本实施例中例如是场间补插单元124以前张或后张相同位置像素的色度值,来补插出目标像素点的色度值。As far as the
换句话说,场间补插单元124以场间补插法补插影像画面的像素值时,是依据目标像素点在前张影像画面的奇图场或偶图场或后张影像画面的奇图场或偶图场中所对应的像素点的像素值,补插目标像素点的像素值。In other words, when the
就场内补插单元122而言,以补插色度值为例,其是以场内补插法来补插目标像素点的色度值。场内补插单元以场内补插法补插影像画面的像素值时,是依据影像画面的目标像素点周围邻近的像素点的像素值补插目标像素点的像素值。As far as the
详细而言,图4为本发明一实施例的场内补插法的像素示意图。请参考图1至图4,图4所示的是在影像画面I2的偶图场f2中,场内补插单元122所欲补插的目标像素点P2及其周围邻近的8个像素点T、B、L、R、P1”、P3”、P4”及P5”。In detail, FIG. 4 is a schematic diagram of pixels of an intra-field interpolation method according to an embodiment of the present invention. Please refer to FIG. 1 to FIG. 4. FIG. 4 shows the target pixel point P2 to be interpolated by the
在图4中,像素点P1”、T、P3”所在的第一条线及像素点P4”、B、P5”所在的第三条线,其灰阶值及色度值均存在,而像素点L、P2、R所在的第二条线则只有灰阶值。因此,在本实施例中,场内补插单元122将通过下文的场内补插法补插目标像素点P2的色度值。In Figure 4, the first line where the pixel points P 1 ″, T, P 3 ″ and the third line where the pixel points P 4 ″, B, P 5 ″ are located have the same gray scale value and chromaticity value. exists, but the second line where the pixel points L, P 2 , and R are located has only grayscale values. Therefore, in this embodiment, the
首先,在补插像素点P2的色度值前,场内补插单元122会先确定像素点P2的灰阶值与其周围邻近的8个像素点的灰阶值之间的灰阶差值是否大于一灰阶临界值。例如,场内补插单元122会计算像素点P2的灰阶值与其周围邻近的8个像素点的灰阶值的平均值的差值,再与灰阶临界值作比较,取两者较大者作为有效灰阶临界值。Firstly, before interpolating the chroma value of pixel P2 , the
上述判断方式,其程式码例示如下:The code example of the above judgment method is as follows:
valid_th=max((yP2-(yP1”+yT+yP3”+yL+yR+yP4”+yB+yP5”)/8),valid_th=max((y P2 -(y P1 "+y T +y P3" +y L +y R +y P4" +y B +y P5" )/8),
coring_th)coring_th)
其中valid_th为有效灰阶临界值,coring_th为灰阶临界值,而yP2、yP1”、yT、yP3”、yL、yR、yP4”、yB、yP5”分别为像素点P2的灰阶值与其周围邻近的8个像素点的灰阶值。Among them, valid_th is the valid gray-scale critical value, coring_th is the gray-scale critical value, and y P2 , y P1” , y T , y P3” , y L , y R , y P4” , y B , and y P5” are pixels respectively The grayscale value of the point P2 and the grayscale values of the surrounding 8 adjacent pixels.
接着,场内补插单元122再依据像素点T、B、P1”、P3”、P4”、p5”的色度值之间的关系来决定补插目标像素点P2的色度值时,像素点T的权重值ω。Next, the
例如,若像素点P1”的色度值较接近像素点T的色度值时,则像素点T可获得两个权重数(vote)。相反地,若像素点P1”的色度值较接近像素点B的色度值时,则像素点B可获得两个权重数。若像素点P1”的色度值与像素点T、B的色度值差值相近(例如相差小于有效灰阶临界值valid_th)时,则像素点T、B各可获得一个权重数。类似地,像素点T、B由像素点P3”、P4”、P5”的所获得的权重数也可以由上述方式决定。For example, if the chromaticity value of pixel P 1 ″ is closer to the chromaticity value of pixel T, then pixel T can get two weights (votes). Conversely, if the chromaticity value of pixel P 1 ″ When the chroma value is closer to the pixel point B, the pixel point B can obtain two weights. If the chromaticity value of the pixel point P 1 ″ is similar to the difference between the chromaticity values of the pixel points T and B (for example, the difference is smaller than the effective gray scale critical value valid_th), then the pixel points T and B can each obtain a weight. Similar Similarly, the weights obtained from the pixel points T and B from the pixel points P 3 ″, P 4 ″, and P 5 ″ can also be determined in the above manner.
举例而言,假设像素点T、B、P1”、P3”、P4”、P5”的色度值分别为100、200、120、120、150、150,则像素点T分别由像素点P1”、P3”、P4”、P5”获得的权重数例如是2、2、1、1(总和权重数为6),而像素点B分别由像素点P1”、P3”、P4”、P5”获得的权重数例如是0、0、1、1(总和权重数为2)。For example, assuming that the chromaticity values of pixels T, B, P 1 ″, P 3 ″, P 4 ″, and P 5 ″ are 100, 200, 120, 120, 150, and 150 respectively, then the pixel point T is represented by The weights obtained by pixels P 1 ”, P 3 ”, P 4 ”, and P 5 ” are, for example, 2, 2, 1, 1 (the total weight is 6), and pixel B is composed of pixels P 1 ”, The weights obtained by P 3 ″, P 4 ″, and P 5 ″ are, for example, 0, 0, 1, 1 (the total weight is 2).
因此,场内补插单元122会依据像素点T、B的总和权重数的比例来决定补插目标像素点P2的色度值时,像素点T的权重值ω。Therefore, the
上述判断方式,其程式码例示如下:The code example of the above judgment method is as follows:
For(P”=P1”,P3”,P4”,P5”)For(P"=P 1 ", P 3 ", P 4 ", P 5 ")
if(chromaP”closer to chromaT than chromaB by more than valid_th)voteT+=2if(chroma P” closer to chroma T than chroma B by more than valid_th) vote T +=2
else if(chromaP”closer to chromaB than chromaT by more than valid_th)voteB+=2else if(chroma P” closer to chroma B than chroma T by more than valid_th) vote B +=2
else{voteT+=1,voteB+=1}else{vote T +=1, vote B +=1}
其中chromaP”代表每一像素点(P1”、P3”、P4”、P5”)的色度值,chromaT、chromaB分别为像素点T、B的色度值,而voteT、voteB为所获得的权重数。Among them, chroma P” represents the chromaticity value of each pixel (P 1 ”, P 3 ”, P 4 ”, P 5 ”), chroma T and chroma B are the chromaticity values of pixel T and B respectively, and vote T and vote B are the obtained weights.
在决定像素点T的权重值ω之后,场内补插单元122依据底下的公式对目标像素点P2的色度值进行补插:After determining the weight value ω of the pixel point T, the
x=ω×t+(1-ω)×bx=ω×t+(1-ω)×b
其中x、t、b分别为像素点P2、T、B的色度值。Wherein, x, t, and b are the chromaticity values of the pixel points P 2 , T, and B, respectively.
因此,在本实施例中,场内补插单元122是通过上述的场内补插法补插目标像素点P2的色度值。Therefore, in this embodiment, the
图5为本发明一实施例的影像处理方法的步骤流程图。请参照图1及图5,本实施例的影像调整方法包括如下步骤。FIG. 5 is a flowchart of steps of an image processing method according to an embodiment of the present invention. Referring to FIG. 1 and FIG. 5 , the image adjustment method of this embodiment includes the following steps.
首先,在步骤S500中,通过影像侦测单元110,侦测目标影像画面与其前张影像画面或其后张影像画面的像素差值,并依据像素差值输出权重值。First, in step S500 , the
另一方面,在步骤S502中,通过影像补插单元120,以场内补插法及场间补插法,补插影像画面的像素值。On the other hand, in step S502 , the
接着,在步骤S504中,通过影像混合单元130,依据权重值混合以场内补插法所补插的像素值及以场间补插法所补插的像素值,以还原影像画面。Next, in step S504 , the
应注意的是,在本实施例中,虽然图5示出的步骤S500在步骤S502之前,但本发明不限于此。在实际进行补插时,步骤S500、S502可同时进行。It should be noted that, in this embodiment, although step S500 shown in FIG. 5 is before step S502, the present invention is not limited thereto. When interpolation is actually performed, steps S500 and S502 can be performed simultaneously.
另外,本发明的实施例的影像调整方法可以由图1~图4的范例实施例的叙述中获致足够的教示、建议与实施说明,因此不再赘述。In addition, the image adjustment method of the embodiment of the present invention can obtain sufficient teachings, suggestions and implementation descriptions from the descriptions of the exemplary embodiments in FIGS. 1 to 4 , so details are not repeated here.
综上所述,在本发明的范例实施例中,影像处理装置及其影像处理方法以移动侦测方式来决定欲还原的目标影像与其前张或后张影像的像素差值,进而决定还原目标影像画面时的权重值。因此,影像处理装置不需倚赖前端压缩电路所提供的旗标来进行影像还原。即使前端压缩电路没有正确地设定旗标资讯,影像处理装置仍可补插出色彩高垂直解析度,以有效提升影像输出品质。To sum up, in the exemplary embodiment of the present invention, the image processing device and its image processing method determine the pixel difference between the target image to be restored and its previous or subsequent image by means of motion detection, and then determine the restoration target The weight value of video frame. Therefore, the image processing device does not need to rely on the flag provided by the front-end compression circuit to restore the image. Even if the front-end compression circuit does not correctly set the flag information, the image processing device can still interpolate the high vertical resolution of the color to effectively improve the image output quality.
虽然本发明已以实施例揭示如上,但其并非用以限定本发明,任何所属技术领域的技术人员,在不脱离本发明的精神和范围内,当可作些许更动与润饰,故本发明的保护范围当视所附权利要求所界定的范围为准。Although the present invention has been disclosed above with the embodiments, it is not intended to limit the present invention. Any person skilled in the art may make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the present invention The scope of protection shall prevail as defined by the appended claims.
Claims (11)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2010105138715A CN102457696B (en) | 2010-10-14 | 2010-10-14 | Image processing device and image processing method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2010105138715A CN102457696B (en) | 2010-10-14 | 2010-10-14 | Image processing device and image processing method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN102457696A CN102457696A (en) | 2012-05-16 |
CN102457696B true CN102457696B (en) | 2013-12-04 |
Family
ID=46040300
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN2010105138715A Expired - Fee Related CN102457696B (en) | 2010-10-14 | 2010-10-14 | Image processing device and image processing method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN102457696B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104754266B (en) * | 2013-12-30 | 2018-11-13 | 杭州海康威视数字技术股份有限公司 | Intelligent FTP backups kinescope method and system |
CN108093302B (en) * | 2017-12-25 | 2020-05-12 | 北京新片场传媒股份有限公司 | Method and system for compressing and transmitting video stream file |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW200634721A (en) * | 2005-03-31 | 2006-10-01 | Asustek Comp Inc | A color clone technology for video color enhancement |
CN101031029A (en) * | 2007-04-04 | 2007-09-05 | 华为技术有限公司 | Method and apparatus for processing video image |
CN101232597A (en) * | 2007-01-25 | 2008-07-30 | 佳能株式会社 | Motion estimation apparatus and control method thereof |
-
2010
- 2010-10-14 CN CN2010105138715A patent/CN102457696B/en not_active Expired - Fee Related
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW200634721A (en) * | 2005-03-31 | 2006-10-01 | Asustek Comp Inc | A color clone technology for video color enhancement |
CN101232597A (en) * | 2007-01-25 | 2008-07-30 | 佳能株式会社 | Motion estimation apparatus and control method thereof |
CN101031029A (en) * | 2007-04-04 | 2007-09-05 | 华为技术有限公司 | Method and apparatus for processing video image |
Also Published As
Publication number | Publication date |
---|---|
CN102457696A (en) | 2012-05-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9036939B2 (en) | Video acquisition with processing based on ancillary data | |
US7075993B2 (en) | Correction system and method for enhancing digital video | |
US8451284B2 (en) | Video acquisition with integrated GPU processing | |
US7596280B2 (en) | Video acquisition with integrated GPU processing | |
US8639050B2 (en) | Dynamic adjustment of noise filter strengths for use with dynamic range enhancement of images | |
CN101753838B (en) | Image processing apparatus, image processing method, and program | |
CN110545413A (en) | Method and apparatus for performing tone mapping of high dynamic range video | |
US20090040246A1 (en) | Image processing device, display device, image processing method, and program | |
US20080211959A1 (en) | Methods and systems for improving low-resolution video | |
CN106612386A (en) | Noise reduction method combined with spatio-temporal correlation | |
CN102572502B (en) | A Method for Selecting Key Frames for Video Quality Evaluation | |
US8447117B2 (en) | Block-edge detecting method and associated device | |
CN101647292A (en) | Motion adaptive upsampling of chroma video signals | |
CN111738951B (en) | Image processing method and device | |
Someya et al. | The suppression of noise on a dithering image in LCD overdrive | |
Parker et al. | Digital video processing for engineers: A foundation for embedded systems design | |
TWI384417B (en) | Image processing method and apparatus | |
CN102457696B (en) | Image processing device and image processing method | |
JP2012094936A5 (en) | ||
JPWO2017203941A1 (en) | IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND PROGRAM | |
US20120082394A1 (en) | Image processing apparatus and image processing method | |
TWI524773B (en) | Detection apparatus, detection method and computer program product thereof for detecting an object in real-time | |
CN101442680B (en) | Image Displacement Detection Method | |
CN102164228A (en) | Image processing method for enhancing image border resolution | |
CN102595022A (en) | Multimedia device and motion compensation method thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20131204 Termination date: 20141014 |
|
EXPY | Termination of patent right or utility model |