CN109756778A - frame rate conversion method based on self-adaptive motion compensation - Google Patents
frame rate conversion method based on self-adaptive motion compensation Download PDFInfo
- Publication number
- CN109756778A CN109756778A CN201811485019.4A CN201811485019A CN109756778A CN 109756778 A CN109756778 A CN 109756778A CN 201811485019 A CN201811485019 A CN 201811485019A CN 109756778 A CN109756778 A CN 109756778A
- Authority
- CN
- China
- Prior art keywords
- block
- projection
- motion vector
- interpolation
- distance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 238000006243 chemical reaction Methods 0.000 title claims abstract description 15
- 239000013598 vector Substances 0.000 claims abstract description 64
- 230000003044 adaptive effect Effects 0.000 claims abstract description 22
- 230000002457 bidirectional effect Effects 0.000 claims abstract description 15
- 238000004364 calculation method Methods 0.000 claims description 4
- 238000003672 processing method Methods 0.000 claims description 3
- 230000000717 retained effect Effects 0.000 claims description 2
- 238000001914 filtration Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000003780 insertion Methods 0.000 description 2
- 230000037431 insertion Effects 0.000 description 2
- 241000282414 Homo sapiens Species 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000007717 exclusion Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Landscapes
- Television Systems (AREA)
Abstract
本发明提供一种基于自适应运动补偿的帧率转换方法包括如下步骤：双向运动估计步骤：用于获得前向和后向运动矢量场，并将前向和后向运动矢量场投影到内插帧中来生成双向运动矢量场；基于距离的运动矢量投影步骤：在投影过程中，采用基于距离的运动矢量投影，所述距离是指投影块中心点到各重叠的内插块的中心点的距离；自适应运动补偿插值步骤：在运动矢量投影完毕之后，采用自适应运动补偿的方式进行插值。本发明提供的基于自适应运动补偿的帧率转换方法可以减弱单向运动估计带来的重叠和空洞问题，使后续的运动补偿插值更精确，插值效果更好。
The present invention provides a frame rate conversion method based on adaptive motion compensation, comprising the following steps: a bidirectional motion estimation step: for obtaining forward and backward motion vector fields, and projecting the forward and backward motion vector fields to interpolation The two-way motion vector field is generated in the frame; the distance-based motion vector projection step: in the projection process, the distance-based motion vector projection is adopted, and the distance refers to the distance from the center point of the projection block to the center point of each overlapping interpolation block. distance; adaptive motion compensation interpolation step: after the projection of the motion vector is completed, the interpolation is performed by means of adaptive motion compensation. The frame rate conversion method based on adaptive motion compensation provided by the present invention can reduce the overlapping and hole problems caused by one-way motion estimation, and make subsequent motion compensation interpolation more accurate and better.
Description
技术领域technical field
本发明属于视频处理技术领域，具体的涉及一种基于自适应运动补偿的帧率转换方法。The invention belongs to the technical field of video processing, and in particular relates to a frame rate conversion method based on adaptive motion compensation.
背景技术Background technique
视频信息是人类最重要的视频源之一，帧率转换是视频格式转换技术中重要的组成部分，同时也是当前视频格式转换研究领域的一个新的研究热点。Video information is one of the most important video sources for human beings. Frame rate conversion is an important part of video format conversion technology, and it is also a new research hotspot in the current research field of video format conversion.
现有的帧率转换算法主要有两类：(1)非运动补偿插帧算法；(2)运动补偿插帧算法。非运动补偿算法简单，速度快，但是非运动补偿插值算法在处理运动物体时会产生运动模糊，主要应用于对视频质量要求不高的情况。The existing frame rate conversion algorithms mainly fall into two categories: (1) non-motion compensation frame insertion algorithm; (2) motion compensation frame insertion algorithm. The non-motion compensation algorithm is simple and fast, but the non-motion compensation interpolation algorithm will produce motion blur when dealing with moving objects, and is mainly used in situations where video quality is not required.
随着科技的发展，人们对视频的要求越来越高，运动补偿算法有效改善了运动物体的模糊，使得视频播放更加流畅。因此，运动补偿插值算法也就成为了人们的研究新热点，其应用也愈发广泛。With the development of science and technology, people's requirements for video are getting higher and higher. The motion compensation algorithm effectively improves the blur of moving objects and makes the video playback smoother. Therefore, the motion compensation interpolation algorithm has become a new research hotspot, and its application has become more and more extensive.
发明内容SUMMARY OF THE INVENTION
针对于上述现有技术的不足，本发明的目的在于提供一种基于自适应运动补偿的帧率转换方法，克服了现有的单向运动补偿算法导致的重叠和空洞问题，能够使画质更加清晰。In view of the above-mentioned deficiencies of the prior art, the purpose of the present invention is to provide a frame rate conversion method based on adaptive motion compensation, which overcomes the problems of overlap and holes caused by the existing one-way motion compensation algorithm, and can improve the picture quality. clear.
为达成上述目的，本发明采用如下技术方案：一种基于自适应运动补偿的帧率转换方法包括如下步骤：双向运动估计步骤：用于获得前向和后向运动矢量场，并将前向和后向运动矢量场投影到内插帧中来生成双向运动矢量场；基于距离的运动矢量投影步骤：在投影过程中，采用基于距离的运动矢量投影，所述距离是指投影块中心点到各重叠的内插块的中心点的距离；自适应运动补偿插值步骤：在运动矢量投影完毕之后，采用自适应运动补偿的方式进行插值。In order to achieve the above object, the present invention adopts the following technical scheme: a frame rate conversion method based on adaptive motion compensation includes the following steps: a bidirectional motion estimation step: for obtaining forward and backward motion vector fields, and combining forward and backward motion vector fields; The backward motion vector field is projected into the interpolation frame to generate the bidirectional motion vector field; the distance-based motion vector projection step: in the projection process, the distance-based motion vector projection is adopted, and the distance refers to the distance from the center point of the projection block to each The distance between the center points of the overlapping interpolation blocks; the adaptive motion compensation interpolation step: after the motion vector projection is completed, the interpolation is performed by means of adaptive motion compensation.
优选地，基于距离的运动矢量投影步骤中距离的计算公式为：Preferably, the calculation formula of the distance in the distance-based motion vector projection step is:
其中，为距离，Projected block为投影块，Pinterpolated_block为内插块，且该距离可以表示为投影块与内插块之间重叠区域的百分比；in, is the distance, Projected block is the projection block, Pinterpolated_block is the interpolation block, and the distance can be expressed as the percentage of the overlapping area between the projected block and the interpolation block;
而且，为了得到最佳投影块，则有公式如下：Moreover, in order to get the best projection block, the formula is as follows:
其中，为最佳投影块；SAD为绝对差的总和，是图像块之间的相似度的量度，通过取原始块中的每个像素与用于比较的块中的相应像素之间的绝对差来计算。in, is the best projected block; SAD is the sum of absolute differences, a measure of similarity between image blocks, calculated by taking the absolute difference between each pixel in the original block and the corresponding pixel in the block used for comparison .
优选地，：自适应运动补偿插值步骤包括如下情形：Preferably, the adaptive motion compensation interpolation step includes the following situations:
情形1：一个内插块上有多个投影块；Case 1: There are multiple projection blocks on an interpolation block;
情形2：一个内插块只有一个投影块；Case 2: An interpolation block has only one projection block;
情形3：内插块上无投影块；Case 3: There is no projected block on the interpolation block;
其中，在情形1中，设置经验阈值T对运动矢量进行筛选，舍弃偏差较大的MV，保留偏差较小的：Among them, in case 1, set the empirical threshold T to screen the motion vector, discard the MV with large deviation, and keep the MV with small deviation:
当SAD>T时，舍弃该运动矢量；When SAD>T, discard the motion vector;
当SAD<T时，保留该运动矢量作为运动补偿插值阶段的候选双向运动矢量；When SAD<T, keep the motion vector as a candidate bidirectional motion vector in the motion compensation interpolation stage;
在情形2中，当一个内插块只有一个投影块时，所述投影块就是最佳投影块，运动估计阶段得到的运动矢量就是最佳运动矢量，利用所述运动矢量进行运动补偿插值；In case 2, when an interpolation block has only one projection block, the projection block is the best projection block, the motion vector obtained in the motion estimation stage is the best motion vector, and the motion vector is used for motion compensation interpolation;
在情形3中，内插块上无投影块，即投影过程中产生了空洞；对于空洞，采用的处理方法是利用与当前空洞块相邻的非空洞块的运动矢量中值滤波进行填充：In case 3, there is no projection block on the interpolation block, that is, a hole is generated during the projection process; for the hole, the processing method is to use the motion vector median filter of the non-hole block adjacent to the current hole block to fill:
其中，Vhole空洞块，Vj，Vi表示非空洞块，N表示可用的非空洞块的数量，即与该空洞块相邻的上下左右四个相邻块均为非空洞块。Among them, V hole block, V j , V i represent non-hole blocks, N represents the number of available non-hole blocks, that is, the four adjacent blocks adjacent to the hole block are all non-hole blocks.
相较于现有技术，本发明提供的技术方案具有如下有益效果：Compared with the prior art, the technical solution provided by the present invention has the following beneficial effects:
1、采用双向运动估计，可以减弱单向运动估计带来的重叠和空洞问题，使后续的运动补偿插值更精确，插值效果更好；1. The use of bidirectional motion estimation can reduce the overlap and hole problems caused by unidirectional motion estimation, so that the subsequent motion compensation interpolation is more accurate and the interpolation effect is better;
2、根据不同的情况采用不同的运动补偿插值方式可以改善视频的画质，使视频更加流畅。2. Using different motion compensation interpolation methods according to different situations can improve the quality of the video and make the video smoother.
附图说明Description of drawings
此处所说明的附图用来提供对本发明的进一步理解，构成本发明的一部分，本发明的示意性实施例及其说明用于解释本发明，并不构成对本发明的不当限定。在附图中：The accompanying drawings described herein are used to provide further understanding of the present invention and constitute a part of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the attached image:
图1是本发明基于自适应运动补偿的视频帧率转换算法的执行流程图；Fig. 1 is the execution flow chart of the video frame rate conversion algorithm based on adaptive motion compensation of the present invention;
图2是基于距离的运动矢量投影步骤中距离计算示意图；2 is a schematic diagram of distance calculation in a distance-based motion vector projection step;
图3是自适应运动补偿插值步骤中情形1的示意图；Fig. 3 is the schematic diagram of situation 1 in the adaptive motion compensation interpolation step;
图4是自适应运动补偿插值步骤中情形2的示意图；Fig. 4 is the schematic diagram of situation 2 in the adaptive motion compensation interpolation step;
图5是自适应运动补偿插值步骤中情形3的示意图。Figure 5 is a schematic diagram of scenario 3 in the adaptive motion compensation interpolation step.
具体实施方式Detailed ways
为了使本发明所要解决的技术问题、技术方案及有益效果更加清楚、明白，以下结合附图和实施例，对本发明进行进一步详细说明。应当理解，此处所描述的具体实施例仅用以解释本发明，并不用于限定本发明。In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention clearer and more comprehensible, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.
本发明的权利要求书、说明书及上述附图中，除非另有明确限定，如使用术语“第一”、“第二”或“第三”等，都是为了区别不同对象，而不是用于描述特定顺序。In the claims, description and the above drawings of the present invention, unless otherwise clearly defined, the terms "first", "second" or "third" are used to distinguish different objects, rather than used for Describe a specific order.
本发明的权利要求书、说明书及上述附图中，除非另有明确限定，对于方位词，如使用术语“中心”、“横向”、“纵向”、“水平”、“垂直”、“顶”、“底”、“内”、“外”、“上”、“下”、“前”、“后”、“左”、“右”、“顺时针”、“逆时针”等指示方位或位置关系乃基于附图所示的方位和位置关系，且仅是为了便于叙述本发明和简化描述，而不是指示或暗示所指的装置或元件必须具有特定的方位或以特定的方位构造和操作，所以也不能理解为限制本发明的具体保护范围。In the claims, description and the above drawings of the present invention, unless otherwise expressly defined, the terms "center", "horizontal", "longitudinal", "horizontal", "vertical" and "top" are used for directional words. , "bottom", "inside", "outside", "up", "down", "front", "rear", "left", "right", "clockwise", "counterclockwise", etc. The positional relationship is based on the orientation and positional relationship shown in the drawings, and is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a particular orientation or be constructed and operated in a particular orientation. , so it should not be construed as limiting the specific protection scope of the present invention.
本发明的权利要求书、说明书及上述附图中，除非另有明确限定，如使用术语“固接”或“固定连接”，应作广义理解，即两者之间没有位移关系和相对转动关系的任何连接方式，也就是说包括不可拆卸地固定连接、可拆卸地固定连接、连为一体以及通过其他装置或元件固定连接。In the claims, description and the above drawings of the present invention, unless otherwise expressly defined, the terms "fixed connection" or "fixed connection" should be used in a broad sense, that is, there is no displacement relationship and relative rotation relationship between the two. Any connection means, that is to say, including non-removable fixed connection, detachable fixed connection, integrated and fixed connection through other devices or elements.
本发明的权利要求书、说明书及上述附图中，如使用术语“包括”、“具有”以及它们的变形，意图在于“包含但不限于”。In the claims, description and the above-mentioned drawings of the present invention, if the terms "including", "having" and their modifications are used, it is intended to mean "including but not limited to".
实施例1：参见图1，本基于自适应运动补偿的帧率转换方法包括以下步骤：Embodiment 1: Referring to FIG. 1, the frame rate conversion method based on adaptive motion compensation includes the following steps:
双向运动估计步骤：用于获得前向和后向运动矢量场，并将前向和后向运动矢量场投影到内插帧中来生成双向运动矢量场；Bidirectional motion estimation step: used to obtain forward and backward motion vector fields, and project the forward and backward motion vector fields into the interpolation frame to generate a bidirectional motion vector field;
基于距离的运动矢量投影步骤：在投影过程中，采用基于距离的运动矢量投影，所述距离是指投影块中心点到各重叠的内插块的中心点的距离；Distance-based motion vector projection step: in the projection process, a distance-based motion vector projection is used, and the distance refers to the distance from the center point of the projection block to the center point of each overlapping interpolation block;
自适应运动补偿插值步骤：在运动矢量投影完毕之后，采用自适应运动补偿的方式进行插值。Adaptive motion compensation interpolation step: After the motion vector projection is completed, the interpolation is performed by means of adaptive motion compensation.
需要说明的是，在双向运动估计步骤中，传统的运动估计一般是前向运动估计或者后向运动估计。单向块匹配运动估计方法虽然具有较高的准确性和灵活性，但由于它是从参考帧平面的角度出发，在对中间待插帧进行运动补偿插值的过程中，并不能够保证中间帧平面内的每一个像素位置运动补偿值的存在性和唯一性，即会导致空洞和重叠问题。因此，为了削弱空洞和重叠问题对后续运动补偿插值阶段的影响，我们采用双向运动估计，获得前向和后向运动矢量场，然后将前向和后向运动矢量场投影到内插帧来生成双向运动矢量场。It should be noted that, in the bidirectional motion estimation step, the traditional motion estimation is generally forward motion estimation or backward motion estimation. Although the one-way block matching motion estimation method has high accuracy and flexibility, because it is based on the reference frame plane, it cannot guarantee the intermediate frame in the process of motion compensation interpolation for the intermediate frame to be inserted. The existence and uniqueness of the motion compensation value at each pixel position in the plane will lead to holes and overlapping problems. Therefore, in order to weaken the effect of holes and overlapping problems on the subsequent motion compensation interpolation stage, we employ bidirectional motion estimation, obtain forward and backward motion vector fields, and then project the forward and backward motion vector fields to the interpolation frame to generate Bidirectional motion vector field.
在基于距离的运动矢量投影步骤中，如图2所示，距离的计算公式为：In the distance-based motion vector projection step, as shown in Figure 2, the distance calculation formula is:
其中，为距离，Projected block为投影块，Pinterpolated_block为内插块，且该距离可以表示为投影块与内插块之间重叠区域的百分比；当重叠区域变大时，距离就会减小，当两中心点之间的距离很小时，则可以认为该投影块是最佳投影块。但是仅仅依靠距离来得到最佳投影块这样的结论是不可靠的，这时就需要添加约束项来得出最佳投影块。in, is the distance, Projected block is the projection block, Pinterpolated_block is the interpolation block, and the distance can be expressed as the percentage of the overlapping area between the projected block and the interpolation block; when the overlapping area becomes larger, the distance will decrease, when the two centers When the distance between the points is small, the projected block can be considered as the best projected block. However, it is unreliable to rely on the distance to get the best projection block, so it is necessary to add constraints to get the best projection block.
而且，为了得到最佳投影块，加入SAD值作为约束项，从而得到新的度量标准，则有公式如下：Moreover, in order to obtain the best projection block, the SAD value is added as a constraint item to obtain a new metric, the formula is as follows:
其中，为最佳投影块；SAD为绝对差的总和，是图像块之间的相似度的量度，通过取原始块中的每个像素与用于比较的块中的相应像素之间的绝对差来计算。in, is the best projected block; SAD is the sum of absolute differences, a measure of similarity between image blocks, calculated by taking the absolute difference between each pixel in the original block and the corresponding pixel in the block used for comparison .
在自适应运动补偿插值步骤中包括如下情形：The following situations are included in the adaptive motion compensation interpolation step:
情形1：一个内插块上有多个投影块；Case 1: There are multiple projection blocks on an interpolation block;
情形2：一个内插块只有一个投影块；Case 2: An interpolation block has only one projection block;
情形3：内插块上无投影块。Case 3: There is no projected block on the interpolation block.
具体地，如图3所示，在情形1中，运动矢量被投影到内插帧上时，可能会出现投影区域的重叠，造成一个内插块上有多个投影块的情况，具体如下图4所示：中心框为内插块，其他框为投影块。Specifically, as shown in Fig. 3, in case 1, when the motion vector is projected on the interpolation frame, the overlapping of the projection areas may occur, resulting in a situation where there are multiple projection blocks on one interpolation block, as shown in the following figure 4: the center box is the interpolation block, and the other boxes are the projection blocks.
在内插块具有多个投影块的情况下，传统的算法一般是根据某个匹配准则在候选运动矢量中选择最佳运动矢量进行补偿插值，这种方法其实会不同程度的丢失一些信息。若将投影块的所有运动矢量作为内插块的双向运动矢量，这样在进行运动补偿插值结果会非常精确，但是把所有的运动矢量都作为双向运动矢量会极大地增加运动补偿阶段的计算复杂度。所以在此处设置一个经验阈值T，对运动矢量进行筛选，舍弃偏差较大的MV，保留偏差较小的：When the interpolation block has multiple projection blocks, the traditional algorithm generally selects the best motion vector among the candidate motion vectors for compensation interpolation according to a certain matching criterion. In fact, this method will lose some information to varying degrees. If all motion vectors of the projection block are used as bidirectional motion vectors of the interpolation block, the result of motion compensation interpolation will be very accurate, but using all motion vectors as bidirectional motion vectors will greatly increase the computational complexity of the motion compensation stage . Therefore, an empirical threshold T is set here, the motion vectors are screened, the MVs with larger deviations are discarded, and the smaller deviations are retained:
当SAD>T时，舍弃该运动矢量；When SAD>T, discard the motion vector;
当SAD<T时，保留该运动矢量作为运动补偿插值阶段的候选双向运动矢量。When SAD<T, this motion vector is reserved as a candidate bidirectional motion vector for the motion compensation interpolation stage.
这样计算复杂度会大大减小。然后每个投影块的候选运动矢量通过下述公式(3)计算加权系数，并将系数标准化，如式(4)所示：In this way, the computational complexity will be greatly reduced. Then the candidate motion vector of each projection block calculates the weighting coefficient by the following formula (3), and normalizes the coefficient, as shown in formula (4):
最后候选运动矢量的像素加权和是最终的内插像素，公式(5)如下：The pixel weighted sum of the final candidate motion vector is the final interpolated pixel, and formula (5) is as follows:
如图4所示，在情形2中，当一个内插块只有一个投影块时，所述投影块就是最佳投影块，运动估计阶段得到的运动矢量就是最佳运动矢量，利用所述运动矢量进行运动补偿插值。As shown in Figure 4, in case 2, when an interpolation block has only one projection block, the projection block is the optimal projection block, and the motion vector obtained in the motion estimation stage is the optimal motion vector. Perform motion-compensated interpolation.
如图5所示，在情形3中，内插块上无投影块，即投影过程中产生了空洞；对于空洞，As shown in Figure 5, in case 3, there is no projection block on the interpolation block, that is, a hole is generated during the projection process; for the hole,
采用的处理方法是利用与当前空洞块相邻的非空洞块的运动矢量中值滤波进行填充：The processing method adopted is to fill in the motion vector median filter of the non-hole block adjacent to the current hole block:
其中，Vhole空洞块，Vj，Vi表示非空洞块，N表示可用的非空洞块的数量，即与该空洞块相邻的上下左右四个相邻块均为非空洞块。Among them, V hole block, V j , V i represent non-hole blocks, N represents the number of available non-hole blocks, that is, the four adjacent blocks adjacent to the hole block are all non-hole blocks.
上述说明示出并描述了本发明的优选实施例，如前所述，应当理解本发明并非局限于本文所披露的形式，不应看作是对其他实施例的排除，而可用于各种其他组合、修改和环境，并能够在本文所述发明构想范围内，通过上述教导或相关领域的技术或知识进行改动。而本领域人员所进行的改动和变化不脱离本发明的精神和范围，则都应在本发明所附权利要求的保护范围内。The foregoing specification illustrates and describes preferred embodiments of the present invention, and as previously stated, it should be understood that the present invention is not limited to the form disclosed herein, and should not be construed as an exclusion of other embodiments, but may be used in a variety of other Combinations, modifications and environments are possible within the scope of the inventive concepts described herein, from the above teachings or from skill or knowledge in the relevant fields. However, modifications and changes made by those skilled in the art do not depart from the spirit and scope of the present invention, and should all fall within the protection scope of the appended claims of the present invention.
Claims (3)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811485019.4A CN109756778B (en) | 2018-12-06 | 2018-12-06 | Frame rate conversion method based on self-adaptive motion compensation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811485019.4A CN109756778B (en) | 2018-12-06 | 2018-12-06 | Frame rate conversion method based on self-adaptive motion compensation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109756778A true CN109756778A (en) | 2019-05-14 |
| CN109756778B CN109756778B (en) | 2021-09-14 |
Family
ID=66403543
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811485019.4A Active CN109756778B (en) | 2018-12-06 | 2018-12-06 | Frame rate conversion method based on self-adaptive motion compensation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109756778B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111541854A (en) * | 2020-04-17 | 2020-08-14 | Oppo广东移动通信有限公司 | Motion vector fitting, frame rate conversion method and device and electronic equipment |
| CN111541940A (en) * | 2020-04-30 | 2020-08-14 | 深圳创维－Rgb电子有限公司 | Motion compensation method and device for display equipment, television and storage medium |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060017843A1 (en) * | 2004-07-20 | 2006-01-26 | Fang Shi | Method and apparatus for frame rate up conversion with multiple reference frames and variable block sizes |
| CN101023662A (en) * | 2004-07-20 | 2007-08-22 | 高通股份有限公司 | Method and apparatus for motion vector processing |
| CN102055947A (en) * | 2009-11-09 | 2011-05-11 | 英特尔公司 | Frame rate convertor using motion estimation and pixel interpolation |
| CN102082896A (en) * | 2011-03-04 | 2011-06-01 | 中山大学 | Method for treating video of liquid crystal display device |
| CN102665061A (en) * | 2012-04-27 | 2012-09-12 | 中山大学 | Motion vector processing-based frame rate up-conversion method and device |
| CN102939751A (en) * | 2010-03-31 | 2013-02-20 | 法国电信 | Method and apparatus for encoding and decoding image sequences implementing prediction by forward motion compensation, corresponding streams and computer programs |
| CN103856782A (en) * | 2014-03-18 | 2014-06-11 | 天津大学 | Self-adaptation error concealment method based on multi-view video whole-frame loss |
| CN104219533A (en) * | 2014-09-24 | 2014-12-17 | 苏州科达科技股份有限公司 | Bidirectional motion estimating method and video frame rate up-converting method and system |
| CN105100807A (en) * | 2015-08-28 | 2015-11-25 | 山东大学 | A frame rate improvement method based on motion vector post-processing |
| CN106303546A (en) * | 2016-08-31 | 2017-01-04 | 四川长虹通信科技有限公司 | Conversion method and system in a kind of frame rate |
| CN106331723A (en) * | 2016-08-18 | 2017-01-11 | 上海交通大学 | A video frame rate up-conversion method and system based on motion region segmentation |
| US9654792B2 (en) * | 2009-07-03 | 2017-05-16 | Intel Corporation | Methods and systems for motion vector derivation at a video decoder |
| CN107483960A (en) * | 2017-09-15 | 2017-12-15 | 信阳师范学院 | A Motion Compensated Frame Rate Upconversion Method Based on Spatial Prediction |
| CN107749987A (en) * | 2017-09-30 | 2018-03-02 | 河海大学 | A kind of digital video digital image stabilization method based on block motion estimation |
| CN108282653A (en) * | 2018-02-06 | 2018-07-13 | 上海通途半导体科技有限公司 | The motion compensation deinterlacing method and system of estimation based on bipolarity field |
| CN108647350A (en) * | 2018-05-16 | 2018-10-12 | 中国人民解放军陆军工程大学 | Image-text associated retrieval method based on two-channel network |
-
2018
- 2018-12-06 CN CN201811485019.4A patent/CN109756778B/en active Active
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101023662A (en) * | 2004-07-20 | 2007-08-22 | 高通股份有限公司 | Method and apparatus for motion vector processing |
| US20060017843A1 (en) * | 2004-07-20 | 2006-01-26 | Fang Shi | Method and apparatus for frame rate up conversion with multiple reference frames and variable block sizes |
| US9654792B2 (en) * | 2009-07-03 | 2017-05-16 | Intel Corporation | Methods and systems for motion vector derivation at a video decoder |
| CN102055947A (en) * | 2009-11-09 | 2011-05-11 | 英特尔公司 | Frame rate convertor using motion estimation and pixel interpolation |
| CN102939751A (en) * | 2010-03-31 | 2013-02-20 | 法国电信 | Method and apparatus for encoding and decoding image sequences implementing prediction by forward motion compensation, corresponding streams and computer programs |
| CN102082896A (en) * | 2011-03-04 | 2011-06-01 | 中山大学 | Method for treating video of liquid crystal display device |
| CN102665061A (en) * | 2012-04-27 | 2012-09-12 | 中山大学 | Motion vector processing-based frame rate up-conversion method and device |
| CN103856782A (en) * | 2014-03-18 | 2014-06-11 | 天津大学 | Self-adaptation error concealment method based on multi-view video whole-frame loss |
| CN104219533A (en) * | 2014-09-24 | 2014-12-17 | 苏州科达科技股份有限公司 | Bidirectional motion estimating method and video frame rate up-converting method and system |
| CN105100807A (en) * | 2015-08-28 | 2015-11-25 | 山东大学 | A frame rate improvement method based on motion vector post-processing |
| CN106331723A (en) * | 2016-08-18 | 2017-01-11 | 上海交通大学 | A video frame rate up-conversion method and system based on motion region segmentation |
| CN106303546A (en) * | 2016-08-31 | 2017-01-04 | 四川长虹通信科技有限公司 | Conversion method and system in a kind of frame rate |
| CN107483960A (en) * | 2017-09-15 | 2017-12-15 | 信阳师范学院 | A Motion Compensated Frame Rate Upconversion Method Based on Spatial Prediction |
| CN107749987A (en) * | 2017-09-30 | 2018-03-02 | 河海大学 | A kind of digital video digital image stabilization method based on block motion estimation |
| CN108282653A (en) * | 2018-02-06 | 2018-07-13 | 上海通途半导体科技有限公司 | The motion compensation deinterlacing method and system of estimation based on bipolarity field |
| CN108647350A (en) * | 2018-05-16 | 2018-10-12 | 中国人民解放军陆军工程大学 | Image-text associated retrieval method based on two-channel network |
Non-Patent Citations (2)
| Title |
|---|
| XIANGLING DING, GAOBO YANG, RAN LI: "Identification of Motion-Compensated Frame Rate", 《IEEE》 * |
| 邓慧萍; 喻莉; 钟刚: "基于运动矢量处理的帧率上转换算法", 《中国图象图形学报》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111541854A (en) * | 2020-04-17 | 2020-08-14 | Oppo广东移动通信有限公司 | Motion vector fitting, frame rate conversion method and device and electronic equipment |
| CN111541854B (en) * | 2020-04-17 | 2021-07-27 | Oppo广东移动通信有限公司 | Motion vector fitting, frame rate conversion method and device and electronic equipment |
| CN111541940A (en) * | 2020-04-30 | 2020-08-14 | 深圳创维－Rgb电子有限公司 | Motion compensation method and device for display equipment, television and storage medium |
| CN111541940B (en) * | 2020-04-30 | 2022-04-08 | 深圳创维－Rgb电子有限公司 | Motion compensation method, device, television and storage medium for display device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109756778B (en) | 2021-09-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105100807B (en) | A kind of frame per second method for improving based on motion vector post-processing | |
| WO2018119807A1 (en) | Depth image sequence generation method based on convolutional neural network and spatiotemporal coherence | |
| CN103702128B (en) | An Interpolation Frame Generation Method Applied to Video Frame Rate Up-conversion | |
| US10311579B2 (en) | Apparatus and method for detecting foreground in image | |
| CN106210449B (en) | A frame rate up-conversion motion estimation method and system for multi-information fusion | |
| CN103339651B (en) | Image processing apparatus, camera head and image processing method | |
| CN104219533B (en) | A kind of bi-directional motion estimation method and up-conversion method of video frame rate and system | |
| CN106331723B (en) | Video frame rate up-conversion method and system based on motion region segmentation | |
| CN108805908A (en) | A kind of real time video image stabilization based on the superposition of sequential grid stream | |
| CN107483960B (en) | Motion compensation frame rate up-conversion method based on spatial prediction | |
| TWI408620B (en) | Image processing method for determining motion vector of interpolation picture and related device | |
| CN109756778B (en) | Frame rate conversion method based on self-adaptive motion compensation | |
| Kaviani et al. | Frame rate upconversion using optical flow and patch-based reconstruction | |
| CN107909643B (en) | Mixed scene reconstruction method and device based on model segmentation | |
| CN104079800A (en) | Shaking preventing method for video image in video surveillance | |
| CN101877790B (en) | Panoramic video coding-oriented quick global motion estimation method | |
| CN104202603B (en) | Motion vector field generation method applied to video frame rate up-conversion | |
| US20210407105A1 (en) | Motion estimation method, chip, electronic device, and storage medium | |
| CN110047091A (en) | One kind is based on the estimation of camera track and the matched digital image stabilization method of characteristic block | |
| CN102685371B (en) | Digital Video Image Stabilization Method Based on Multi-resolution Block Matching and PI Control | |
| CN104683783A (en) | An Adaptive Depth Image Filtering Method | |
| CN105635808B (en) | A kind of video-splicing method based on bayesian theory | |
| CN104123733B (en) | A kind of method of motion detection and reduction error rate based on Block- matching | |
| CN101945299B (en) | A Dynamic Scene Depth Restoration Method Based on Camera Array | |
| CN105872559A (en) | Frame rate up-conversion method based on mixed matching of chromaticity |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |