CN103338372A

CN103338372A - Method and device for processing video

Info

Publication number: CN103338372A
Application number: CN 201310240700
Authority: CN
Inventors: 虞露; 邵振江
Original assignee: Zhejiang University ZJU
Current assignee: Zhejiang University ZJU
Priority date: 2013-06-15
Filing date: 2013-06-15
Publication date: 2013-10-02
Also published as: CN104243982A; CN104243982B; CN107770524A; CN107770524B

Abstract

Embodiments of the present invention provide a video processing method and device. The video processing method includes: obtaining the prediction type of the current block, and deriving the motion vector or motion vector predictor or motion vector candidate or motion vector of the current block according to the prediction type of the current block. Vector predictor candidates. The video encoding and decoding method and device can make full use of the motion vector information in the adjacent blocks of the current block, improve the accuracy of prediction in inter-frame common and special modes, and improve the video encoding efficiency.

Description

A video processing method and device

技术领域technical field

本发明涉及视频处理技术，尤其涉及一种视频处理方法及装置。The present invention relates to video processing technology, in particular to a video processing method and device.

背景技术Background technique

在视频编码技术中，通过利用时间域和空间域的预测来消除视频信息在时间和空间上的冗余。帧间预测技术是一种普遍应用在视频编解码领域的技术。通过运动补偿，用已编码帧中的信息来预测当前帧的信息。在运动补偿过程中，视频码流中需要传输很多边信息，解码端利用这些边信息以及变换后的残差来重建出当前帧的像素信息。在普通的帧间预测模式中，主要通过块的编码模式信息，运动矢量差值信息这些边信息来重建图像。在特殊的帧间模式如跳过和直接模式，不用传输运动矢量差值信息。直接用预测得到的运动矢量作为当前块的运动矢量。In video coding technology, the redundancy of video information in time and space is eliminated by using prediction in time domain and space domain. Inter-frame prediction technology is a technology commonly used in the field of video coding and decoding. Through motion compensation, the information in the coded frame is used to predict the information of the current frame. During the motion compensation process, a lot of side information needs to be transmitted in the video code stream, and the decoder uses these side information and the transformed residual to reconstruct the pixel information of the current frame. In the common inter-frame prediction mode, the image is reconstructed mainly through side information such as block coding mode information and motion vector difference information. In special inter-frame modes such as skip and direct modes, no motion vector difference information is transmitted. Directly use the predicted motion vector as the motion vector of the current block.

在H.264中，普通的帧间模式，其预测方向可以是前向，后向以及双向。无论是哪种预测方向，其导出运动矢量预测值的方法都是一样的，即取三个相邻块中的运动矢量的中值为当前块的运动矢量预测值。而在特殊模式中，运动矢量导出较为复杂。对于P-SKIP（P帧跳过）模式，只导出前向运动矢量。对于B-SKIP（B帧跳过）和B-DIRECT（B帧直接）模式，按既定的规则导出前向运动矢量和后向运动矢量。In H.264, the normal inter-frame mode, its prediction direction can be forward, backward and bidirectional. Regardless of the prediction direction, the method for deriving the motion vector predictor is the same, that is, the median of the motion vectors in three adjacent blocks is taken as the motion vector predictor of the current block. In special mode, however, motion vector derivation is more complicated. For P-SKIP (P Frame Skip) mode, only forward motion vectors are exported. For the B-SKIP (B frame skip) and B-DIRECT (B frame direct) modes, the forward motion vector and backward motion vector are derived according to established rules.

在HEVC中，引入了AMVP（先进的运动矢量预测）技术。该技术通过构建运动矢量候选列表，通过在码流中传输选中的运动矢量预测值或运动矢量的序号，解码端根据序号以及按相同规则构建的运动矢量候选列表来导出运动矢量或运动矢量预测值。AMVP技术应用在特殊模式下被称为Merge模式。Merge模式在导出运动矢量时，不仅利用的相邻块中的运动矢量信息，同时也利用了相邻块的参考帧信息。Merge模式构建的候选列表中，存放了按优先级顺序得到的相邻块的运动信息，包括运动矢量信息和参考帧信息。也就是说，Merge模式在导出运动矢量的同时也导出了与该运动矢量相对应的参考帧。In HEVC, AMVP (Advanced Motion Vector Prediction) technology is introduced. This technology builds a motion vector candidate list and transmits the selected motion vector predictor or sequence number of the motion vector in the code stream, and the decoder derives the motion vector or motion vector predictor according to the sequence number and the motion vector candidate list constructed according to the same rules . The application of AMVP technology in a special mode is called Merge mode. When the Merge mode derives the motion vector, not only the motion vector information in the adjacent block is used, but also the reference frame information of the adjacent block is used. In the candidate list constructed by the Merge mode, the motion information of adjacent blocks obtained in order of priority is stored, including motion vector information and reference frame information. That is to say, the Merge mode also derives the reference frame corresponding to the motion vector while deriving the motion vector.

在AVS中，运动矢量导出与H.264类似。普通帧间模式下也是采用一套固定的AVS MEDIAN（AVS中值预测）的方法，特殊模式下P-SKIP只导出前向运动矢量。B-SKIP和B-DIRECT模式下导出前后向两个运动矢量。In AVS, motion vector derivation is similar to H.264. In normal inter-frame mode, a set of fixed AVS MEDIAN (AVS median prediction) methods are also used. In special mode, P-SKIP only exports forward motion vectors. In B-SKIP and B-DIRECT mode, two motion vectors are exported forward and backward.

在H.264和AVS中，普通帧间模式的运动矢量导出虽然在前向、后向以及双向的情况下导出的运动矢量不同或个数不同，但是它们并没有根据相邻块的预测方向类型的不同而特意挑选相邻块中有相同预测方向类型的块来预测运动矢量。而是只要相邻块中存在指向的参考帧方向与当前块相同的运动矢量，就拿来预测当前块的运动矢量。用于预测前向预测类型当前块的前向运动矢量的相邻块运动矢量可以是前向预测块的前向运动矢量，也可以是双向预测块的前向运动矢量。只要选定的块存在所需要的运动矢量即可，而该选定块的预测方向类型并不是必须考虑的。In H.264 and AVS, although the motion vector derivation of common inter-frame mode is different or the number of motion vectors is different in the case of forward, backward and bidirectional, they are not based on the prediction direction type of the adjacent block. The motion vector is predicted by deliberately selecting blocks with the same type of prediction direction in adjacent blocks. Instead, as long as there is a motion vector pointing to the same reference frame direction as the current block in the adjacent block, it is used to predict the motion vector of the current block. The motion vector of the adjacent block used to predict the forward motion vector of the current block of the forward prediction type may be the forward motion vector of the forward prediction block, or the forward motion vector of the bidirectional prediction block. As long as the required motion vector exists in the selected block, the prediction direction type of the selected block does not have to be considered.

在HEVC中，运动矢量导出决定于构建的运动矢量候选列表以及表明选择列表中哪个候选的序号。这种方式需要在码流中传输序号，增加了一定的码流开销。但它能够更准确地预测运动矢量。由于HEVC是直接根据候选运动矢量序号导出运动矢量，它不是一种根据预测方向类型来选择参考相邻块的运动矢量导出方法。在Merge模式中，当前块不仅运动矢量要和选定的相邻块相同，参考帧也要相同。如果相邻块中不存在后向或前向的预测块，则当前块就不能去尝试后向或前向的预测方式。这是Merge模式存在的一个不足。In HEVC, motion vector derivation is determined by constructing a list of motion vector candidates and an index indicating which candidate is in the selected list. This method needs to transmit the serial number in the code stream, which increases a certain code stream overhead. But it is able to predict motion vectors more accurately. Since HEVC derives the motion vector directly according to the sequence number of the candidate motion vector, it is not a motion vector derivation method that selects the reference adjacent block according to the prediction direction type. In the Merge mode, not only the motion vector of the current block must be the same as that of the selected adjacent block, but also the reference frame. If there is no backward or forward prediction block in the adjacent block, the current block cannot try the backward or forward prediction mode. This is a shortcoming of the Merge mode.

发明内容Contents of the invention

本发明的目的在于针对现有技术所存在的不足之处，提出了一种根据当前块预测类型，可以是预测方向类型来决定当前块运动矢量如何导出的方法。该方法能够充分利用视频编解码中像素块能够采用不同方向的预测的特性。可以使帧间特殊模式下的像素块尝试双向、后向、对称、前向等多种预测方向模式，每种模式分别对应导出运动矢量。该技术能够提升视频编码的效率。The object of the present invention is to address the shortcomings of the prior art, and propose a method for determining how to derive the motion vector of the current block according to the prediction type of the current block, which may be the type of prediction direction. The method can make full use of the feature that pixel blocks can adopt predictions in different directions in video coding and decoding. The pixel blocks in the inter-frame special mode can try multiple prediction direction modes such as bidirectional, backward, symmetric, and forward, and each mode corresponds to the derived motion vector. This technology can improve the efficiency of video encoding.

本发明的第一目的在于提供一种视频处理方法，其包括：使用与当前块预测类型相同的相邻块的与当前块运动矢量指向参考帧的方向相同的运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。The first object of the present invention is to provide a video processing method, which includes: deriving the motion vector of the current block by using the motion information of the adjacent blocks of the same prediction type as the current block and the direction in which the motion vector of the current block points to the reference frame or motion vector predictor or motion vector candidate or motion vector predictor candidate.

进一步的，本方法还包括从码流中获取所述当前块的预测类型的信息。Further, the method further includes acquiring the prediction type information of the current block from the code stream.

进一步的，本方法还包括将当前块的预测类型的信息写入到码流中。Further, the method also includes writing the prediction type information of the current block into the code stream.

进一步的，所述预测类型为以下预测方向类型中的一种：前向、后向、对称和双向。Further, the prediction type is one of the following prediction direction types: forward, backward, symmetric and bidirectional.

本发明的第二目的在于提供又一种视频处理方法，其包括：若存在与当前块预测类型相同的相邻块，则使用与当前块预测类型相同的相邻块的与当前块运动矢量指向参考帧的方向相同的运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选；The second object of the present invention is to provide yet another video processing method, which includes: if there is an adjacent block with the same prediction type as the current block, using the motion vector pointing to the current block of the adjacent block with the same prediction type as the current block Referring to the motion information of the same direction of the frame, deriving the motion vector or motion vector predictor or motion vector candidate or motion vector predictor candidate of the current block;

若不存在与当前块预测类型相同的相邻块，则使用与当前块预测类型不同的相邻块的与当前块运动矢量指向参考帧的方向相同的运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。If there is no adjacent block with the same prediction type as the current block, the motion vector or motion Vector predictor or motion vector candidate or motion vector predictor candidate.

本发明第三目的在于提供一种视频处理装置，其包括：The third object of the present invention is to provide a video processing device, which includes:

运动矢量导出单元，用于使用与当前块预测类型相同的相邻块的与当前块运动矢量指向参考帧的方向相同的运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。A motion vector deriving unit for deriving a motion vector or a motion vector predictor or a motion vector candidate for the current block using motion information of neighboring blocks of the same prediction type as the current block in the same direction as the motion vector of the current block points to the reference frame or Motion vector predictor candidates.

进一步的，还包括从码流中获取所述当前块的预测类型的信息的预测类型读取单元。Further, it also includes a prediction type reading unit for obtaining the prediction type information of the current block from the code stream.

进一步的，还包括将当前块的预测类型的信息写入到码流中的预测类型写入单元。Further, it also includes a prediction type writing unit for writing the prediction type information of the current block into the code stream.

本发明的第四目的在于提供一种视频处理装置，其包括：A fourth object of the present invention is to provide a video processing device, which includes:

若存在与当前块预测类型相同的相邻块，则使用从相同类型相邻块导出运动矢量的运动矢量导出单元，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选；If there is an adjacent block of the same prediction type as the current block, a motion vector or a motion vector predictor or a motion vector candidate or a motion vector predictor for the current block is derived using a motion vector derivation unit that derives a motion vector from an adjacent block of the same type Candidate;

若不存在与当前块预测类型相同的相邻块，则使用从不同类型相邻块导出运动矢量的不同类型相邻块运动矢量导出单元，由该不同类型相邻块运动矢量导出单元导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。If there is no adjacent block with the same prediction type as the current block, use a different type of adjacent block motion vector derivation unit that derives a motion vector from a different type of adjacent block, and use the different type of adjacent block motion vector derivation unit to derive the current block The motion vector or motion vector predictor or motion vector candidate or motion vector predictor candidate for .

本发明的有益效果是，本发明的视频编解码方法及装置，通过获得当前块的预测类型，根据当前块的预测类型导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。该视频编解码方法及装置能够充分利用当前块的相邻块中的运动矢量信息，提高在帧间特殊模式下预测的准确性，提高了视频编码效率。The beneficial effect of the present invention is that the video encoding and decoding method and device of the present invention derive the motion vector or motion vector predictor or motion vector candidate or motion vector prediction of the current block according to the prediction type of the current block by obtaining the prediction type of the current block value candidates. The video encoding and decoding method and device can make full use of the motion vector information in the adjacent blocks of the current block, improve the prediction accuracy in the inter-frame special mode, and improve the video encoding efficiency.

附图说明Description of drawings

为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍，显而易见地，下面描述中的附图是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained according to these drawings without any creative effort.

图1为本发明实施例提供的第一种当前块及其相邻块的示意图；FIG. 1 is a schematic diagram of a first type of current block and its adjacent blocks provided by an embodiment of the present invention;

图2为本发明实施例提供的一种视频处理中运动矢量导出装置结构示意图；FIG. 2 is a schematic structural diagram of a device for deriving motion vectors in video processing provided by an embodiment of the present invention;

图3为发明实施例提供的一种视频编码中运动矢量导出装置结构示意图；Fig. 3 is a schematic structural diagram of a device for deriving motion vectors in video coding provided by an embodiment of the invention;

图4为发明实施例提供的一种视频解码中运动矢量导出装置结构示意图；4 is a schematic structural diagram of a device for deriving motion vectors in video decoding provided by an embodiment of the invention;

图5为本发明实施例提供的另一种视频处理中运动矢量导出装置结构示意图；5 is a schematic structural diagram of another device for deriving motion vectors in video processing according to an embodiment of the present invention;

图6为发明实施例提供的另一种视频编码中运动矢量导出装置结构示意图；FIG. 6 is a schematic structural diagram of another device for deriving motion vectors in video coding provided by an embodiment of the invention;

图7为发明实施例提供的另一种视频解码中运动矢量导出装置结构示意图。Fig. 7 is a schematic structural diagram of another apparatus for deriving motion vectors in video decoding provided by an embodiment of the invention.

具体实施方式Detailed ways

为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

实施例1Example 1

图1为本发明实施例提供的一种当前块及其相邻块的示意图。本实施例提供的视频解码方法包括：FIG. 1 is a schematic diagram of a current block and its adjacent blocks provided by an embodiment of the present invention. The video decoding method provided in this embodiment includes:

步骤1，从码流中获取所述当前块的预测类型信息。Step 1: Obtain the prediction type information of the current block from the code stream.

具体地，通过解析视频码流中的预测类型信息，来获得当前块的预测类型。一种可能的情况为，当前块为B帧直接或跳过模式，在满足上述条件情况下，码流中还有语法元素表明了当期待处理像素块的预测类型，一种可能的情况是，该预测类型信息为当前块的预测方向类型，例如，当前块的预测方向类型可以是双向、后向、对称、前向中的一种。Specifically, the prediction type of the current block is obtained by parsing the prediction type information in the video code stream. One possible situation is that the current block is a B-frame direct or skip mode. If the above conditions are met, there are syntax elements in the code stream that indicate the prediction type of the pixel block that is expected to be processed. One possible situation is, The prediction type information is the prediction direction type of the current block, for example, the prediction direction type of the current block may be one of bidirectional, backward, symmetric, and forward.

步骤2，若存在与当前块预测类型相同的相邻块，则使用与当前块预测类型相同的相邻块的与当前块运动矢量指向参考帧的方向相同的运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。Step 2, if there is an adjacent block with the same prediction type as the current block, use the motion information of the adjacent block with the same prediction type as the current block in the same direction as the motion vector of the current block points to the reference frame to derive the motion vector of the current block or motion vector predictor or motion vector candidate or motion vector predictor candidate.

具体地，一种可能的情况为，在步骤1得到当前块预测方向类型后，根据预测方向类型来导出当前块的运动矢量。Specifically, a possible situation is that after the prediction direction type of the current block is obtained in step 1, the motion vector of the current block is derived according to the prediction direction type.

在按下述方法导出当前块的运动矢量前，一种可能的情况为，首先确定搜索相邻块的优先级顺序。例如，只考虑A1、AN、B1、BM、C1、C2共6个块，搜索的优先级顺序为AN>BM>C1>A1>B1>C2。Before deriving the motion vector of the current block according to the method described below, a possible situation is to first determine the order of priority for searching adjacent blocks. For example, only 6 blocks including A1, AN, B1, BM, C1, and C2 are considered, and the priority order of searching is AN>BM>C1>A1>B1>C2.

不论当前块的预测方向类型为哪种类型，第一步按如下方式导出运动矢量：Regardless of the type of prediction direction for the current block, the first step derives the motion vector as follows:

从当前块中的相邻块中按优先级顺序搜索与当前块预测类型相同的块，若存在与当前块预测类型相同的相邻块，则根据第一个搜索到的与当前块预测类型相同的相邻块的运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。From the adjacent blocks in the current block, search for blocks with the same prediction type as the current block in order of priority. If there is an adjacent block with the same prediction type as the current block, the first searched block with the same prediction type as the current block will be used. The motion information of the neighboring blocks of the current block is derived to derive the motion vector or the motion vector predictor or the motion vector candidate or the motion vector predictor candidate of the current block.

如果当前块的参考帧和搜索选中的相邻块的参考帧为同一个参考帧，则将搜索选中的相邻块的运动矢量直接作为当前块的运动矢量。如果当前块的参考帧和搜索选中的相邻块的参考帧不是同一个参考帧，则将相邻块运动矢量乘以“当前块与当前块参考的距离”，再除以“相邻块与相邻块的参考块之间的距离”，得到的运动矢量作为当前块的运动矢量。If the reference frame of the current block and the reference frame of the neighboring block selected by searching are the same reference frame, the motion vector of the neighboring block selected by searching is directly used as the motion vector of the current block. If the reference frame of the current block and the reference frame of the adjacent block selected by the search are not the same reference frame, multiply the motion vector of the adjacent block by the "distance between the current block and the reference of the current block", and then divide it by the "distance between the adjacent block and The distance between the reference blocks of adjacent blocks", and the obtained motion vector is used as the motion vector of the current block.

如果不存在与当前块预测类型相同的相邻块，则根据预测类型不同的相邻块中的运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。If there is no neighboring block with the same prediction type as the current block, then derive a motion vector or a motion vector predictor or a motion vector candidate or a motion vector predictor candidate for the current block based on motion information in neighboring blocks of a different prediction type.

具体地，按如下所述方式导出运动矢量：Specifically, the motion vectors are derived as follows:

若当前块的预测类型为双向预测类型，而相邻块中不存在双向预测类型的相邻块，存在前向预测类型和后向预测类型的相邻块，则根据前向预测类型相邻块的运动矢量，后向预测类型相邻块的运动矢量导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。If the prediction type of the current block is the bidirectional prediction type, and there are no adjacent blocks of the bidirectional prediction type in the adjacent blocks, but there are adjacent blocks of the forward prediction type and the backward prediction type, then the adjacent blocks of the forward prediction type are The motion vector of the backward prediction type adjacent block derives the motion vector or motion vector predictor or motion vector candidate or motion vector predictor candidate of the current block.

若当前块的预测类型为对称预测类型，而相邻块中不存在对称预测类型的相邻块，存在多于一个双向预测块，则根据按优先级顺序相反的顺序搜索到的第一个双向预测块的运动运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。If the prediction type of the current block is the symmetric prediction type, and there is no adjacent block of the symmetric prediction type in the adjacent block, and there are more than one bidirectional prediction block, the first bidirectional prediction block searched according to the reverse order of priority The motion information of the block is predicted, and the motion vector or the motion vector predictor or the motion vector candidate or the motion vector predictor candidate of the current block is derived.

若当前块的预测类型为对称预测类型，而相邻块中不存在对称预测类型的相邻块，不存在多于一个双向预测块，存在后向预测块，则根据按优先级顺序搜索到的第一个后向预测块的运动信息，导出后向运动矢量，以及由该运动矢量反向后得到前向运动矢量，将所述导出的前向和后向运动矢量作为当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。If the prediction type of the current block is the symmetric prediction type, and there is no adjacent block of the symmetric prediction type in the adjacent block, there is no more than one bidirectional prediction block, and there is a backward prediction block, then according to the order of priority searched The motion information of the first backward prediction block, deriving a backward motion vector, and obtaining a forward motion vector after inversion of the motion vector, using the derived forward motion vector and backward motion vector as the motion vector of the current block or Motion vector predictor or motion vector candidate or motion vector predictor candidate.

若当前块的预测类型为对称预测类型，而相邻块中不存在对称预测类型的相邻块，不存在多于一个双向预测块，不存在后向预测块，存在前向预测块，则根据按优先级顺序搜索得到的第一个前向预测块的运动信息，导出前向运动矢量，以及由该运动矢量反向后得到后向运动矢量，将所述导出的前向和后向运动矢量作为当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。If the prediction type of the current block is the symmetric prediction type, and there is no adjacent block of the symmetric prediction type in the adjacent block, there is no more than one bidirectional prediction block, there is no backward prediction block, and there is a forward prediction block, then according to Search the motion information of the first forward prediction block obtained in order of priority, derive the forward motion vector, and obtain the backward motion vector after being reversed by the motion vector, and combine the derived forward and backward motion vectors As a motion vector or a motion vector predictor or a motion vector candidate or a motion vector predictor candidate for the current block.

若当前块的预测类型为后向预测类型，而相邻块中不存在后向预测类型的相邻块，存在多于一个双向预测块，则根据按优先级顺序相反的顺序搜索得到的第一个双向预测块的后向运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。If the prediction type of the current block is the backward prediction type, but there is no adjacent block of the backward prediction type in the adjacent block, and there are more than one bidirectional prediction block, the first The backward motion information of two bidirectional prediction blocks is used to derive the motion vector or motion vector predictor or motion vector candidate or motion vector predictor candidate of the current block.

若当前块的预测类型为后向预测类型，而相邻块中不存在后向预测类型的相邻块，只存在一个双向预测块，则根据该双向预测块的后向运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。If the prediction type of the current block is the backward prediction type, and there is no adjacent block of the backward prediction type in the adjacent block, and there is only one bidirectional prediction block, then the current block is derived according to the backward motion information of the bidirectional prediction block The motion vector or motion vector predictor or motion vector candidate or motion vector predictor candidate for .

若当前块的预测类型为后向预测类型，而相邻块中不存在后向预测类型的相邻块，不存在双向预测块，存在对称预测块，则根据按优先级顺序搜索得到的第一个对称预测块的运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。If the prediction type of the current block is the backward prediction type, and there is no adjacent block of the backward prediction type in the adjacent block, there is no bidirectional prediction block, and there is a symmetric prediction block, then according to the first The motion information of a symmetric prediction block is used to derive the motion vector or motion vector predictor or motion vector candidate or motion vector predictor candidate of the current block.

若当前块的预测类型为前向预测类型，而相邻块中不存在前向预测类型的相邻块，存在多于一个双向预测块，则根据按优先级顺序相反的顺序搜索得到的第一个双向预测块的前向运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。If the prediction type of the current block is the forward prediction type, but there is no adjacent block of the forward prediction type in the adjacent block, and there are more than one bidirectional prediction block, the first The forward motion information of two bidirectional prediction blocks is used to derive the motion vector or motion vector predictor or motion vector candidate or motion vector predictor candidate of the current block.

若当前块的预测类型为前向预测类型，而相邻块中不存在前向预测类型的相邻块，只存在一个双向预测块，则根据该双向预测块的前向运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。If the prediction type of the current block is the forward prediction type, and there is no adjacent block of the forward prediction type in the adjacent block, and there is only one bidirectional prediction block, then the current block is derived according to the forward motion information of the bidirectional prediction block The motion vector or motion vector predictor or motion vector candidate or motion vector predictor candidate for .

若当前块的预测类型为前向预测类型，而相邻块中不存在前向预测类型的相邻块，不存在双向预测块，存在对称预测块，则根据按优先级顺序搜索得到的第一个对称预测块的前向运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。If the prediction type of the current block is the forward prediction type, and there is no adjacent block of the forward prediction type in the adjacent block, there is no bi-directional prediction block, and there is a symmetric prediction block, then according to the priority searched first The forward motion information of a symmetric prediction block is used to derive the motion vector or motion vector predictor or motion vector candidate or motion vector predictor candidate of the current block.

如同第一步，在导出运动矢量的过程中，如果当前块的参考帧和搜索选中的相邻块的参考帧为同一个参考帧，则将搜索选中的相邻块的运动矢量直接作为当前块的运动矢量。如果当前块的参考帧和搜索选中的相邻块的参考帧不是同一个参考帧，则将相邻块运动矢量乘以“当前块与当前块参考的距离”，再除以“相邻块与相邻块的参考块之间的距离”，得到的运动矢量作为当前块的运动矢量。As in the first step, in the process of deriving the motion vector, if the reference frame of the current block and the reference frame of the adjacent block selected by the search are the same reference frame, the motion vector of the adjacent block selected by the search is directly used as the current block motion vector. If the reference frame of the current block and the reference frame of the adjacent block selected by the search are not the same reference frame, multiply the motion vector of the adjacent block by the "distance between the current block and the reference of the current block", and then divide it by the "distance between the adjacent block and The distance between the reference blocks of adjacent blocks", and the obtained motion vector is used as the motion vector of the current block.

实施例2Example 2

图1为本发明实施例提供的第一种当前块及其相邻块的示意图。本实施例提供的视频解码方法包括：FIG. 1 is a schematic diagram of a first type of current block and its adjacent blocks provided by an embodiment of the present invention. The video decoding method provided in this embodiment includes:

步骤1，从码流中获取所述当前块的预测类型的信息。Step 1: Obtain the prediction type information of the current block from the code stream.

具体地，通过解析视频码流中的预测类型信息，来获得当前块的预测类型。一种可能的情况为，当前块为B帧普通模式，通过解析码流中的语法元素，得到当前块的预测方向类型为双向、后向、对称、前向中的一种。Specifically, the prediction type of the current block is obtained by parsing the prediction type information in the video code stream. One possible situation is that the current block is in the B-frame normal mode, and the prediction direction type of the current block is obtained by parsing the syntax elements in the code stream as one of bidirectional, backward, symmetric, and forward.

在按下述方法导出当前块的运动矢量前，一种可能的情况为，首先确定搜索相邻块的优先级顺序。一种可能的情况为，考虑A1～AN、B1～BM、C1、C2即当前块所有存在的相邻块，搜索的优先级顺序为AN>AN-1>……>A1>BM>BM-1>……>B1>C1>C2。Before deriving the motion vector of the current block according to the method described below, a possible situation is to first determine the order of priority for searching adjacent blocks. One possible situation is to consider A1～AN, B1～BM, C1, C2, that is, all existing adjacent blocks of the current block, and the search priority order is AN>AN-1>…>A1>BM>BM- 1>...>B1>C1>C2.

实施例3Example 3

图2为本发明实施例提供的一种视频处理中运动矢量导出装置结构示意图。如图2所示，本实施例中，所述视频处理中的运动矢量导出装置包括运动矢量导出单元210。Fig. 2 is a schematic structural diagram of an apparatus for deriving motion vectors in video processing according to an embodiment of the present invention. As shown in FIG. 2 , in this embodiment, the device for deriving motion vectors in video processing includes a motion vector deriving unit 210 .

本实施例提供的运动矢量导出单元210，具体用于：The motion vector deriving unit 210 provided in this embodiment is specifically used for:

使用与当前块预测类型相同的相邻块的与当前块运动矢量指向参考帧的方向相同的运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。具体为：A motion vector or motion vector predictor or motion vector candidate or motion vector predictor candidate for the current block is derived using motion information of neighboring blocks of the same prediction type as the current block in the same direction as the motion vector of the current block points to the reference frame. Specifically:

一种可能的情况为，在获得当前块预测方向类型后，根据预测方向类型来导出当前块的运动矢量。One possible situation is that after obtaining the prediction direction type of the current block, the motion vector of the current block is derived according to the prediction direction type.

在按下述方法导出当前块的运动矢量前，需要首先确定搜索相邻块的优先级顺序。如图1所示，一种可能的情况为，只考虑A1、AN、B1、BM、C1、C2共6个块，搜索的优先级顺序为AN>BM>C1>A1>B1>C2。Before deriving the motion vector of the current block according to the method described below, it is necessary to first determine the order of priority for searching adjacent blocks. As shown in Figure 1, a possible situation is that only 6 blocks A1, AN, B1, BM, C1, and C2 are considered, and the search priority order is AN>BM>C1>A1>B1>C2.

不论当前块的预测方向类型为哪种类型，按如下方式导出运动矢量：Regardless of the type of prediction direction for the current block, the motion vector is derived as follows:

实施例4Example 4

图3为本发明实施例提供的一种视频编码中运动矢量导出装置结构示意图。如图3所示，本实施例中，所述视频编码中的运动矢量导出装置包括运动矢量导出单元310，预测类型写入单元320。Fig. 3 is a schematic structural diagram of an apparatus for deriving motion vectors in video coding according to an embodiment of the present invention. As shown in FIG. 3 , in this embodiment, the apparatus for deriving motion vectors in video coding includes a motion vector deriving unit 310 and a prediction type writing unit 320 .

本实施例提供的运动矢量导出单元310，具体用于：The motion vector deriving unit 310 provided in this embodiment is specifically used for:

一种可能的情况为，如图1所示，只考虑A1、AN、B1、BM、C1、C2共6个块。搜索这些块中与当前块预测类型相同的相邻块。一种可能的情况为，当前块被设置为双向类型，相邻块中有A1和B1都是双向类型的相邻块。则将A1和B1运动矢量的平均值做为当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。One possible situation is that, as shown in FIG. 1 , only 6 blocks including A1, AN, B1, BM, C1, and C2 are considered. Neighboring blocks of the same prediction type as the current block are searched among these blocks. A possible situation is that the current block is set as a bidirectional type, and there are adjacent blocks in which both A1 and B1 are of the bidirectional type. Then the average value of motion vectors A1 and B1 is used as the motion vector or motion vector predictor or motion vector candidate or motion vector predictor candidate of the current block.

预测类型写入单元320，具体用于：Prediction type writing unit 320, specifically used for:

将当前块的预测类型写入到码流中。具体为：Write the prediction type of the current block into the code stream. Specifically:

在编码端，通过计算当前块各种类型下的率失真代价，得到一个率失真代价最小的预测方向类型。将该预测方向类型写入到码流中。At the encoding end, by calculating the rate-distortion cost of various types of the current block, a prediction direction type with the smallest rate-distortion cost is obtained. Write the prediction direction type into the code stream.

实施例5Example 5

图4为本发明实施例提供的一种视频解码中运动矢量导出装置结构示意图。如图4所示，本实施例中，所述视频解码中的运动矢量导出装置包括，预测类型信息读取单元410，运动矢量导出单元420。Fig. 4 is a schematic structural diagram of an apparatus for deriving motion vectors in video decoding according to an embodiment of the present invention. As shown in FIG. 4 , in this embodiment, the apparatus for deriving motion vectors in video decoding includes a prediction type information reading unit 410 and a motion vector deriving unit 420 .

本实施例提供的预测类型信息读取单元410，具体用于：The prediction type information reading unit 410 provided in this embodiment is specifically used for:

从码流中读取当前块的预测类型信息，具体为：Read the prediction type information of the current block from the code stream, specifically:

一种可能的情况为，当前块的预测信息为预测方向信息，该信息在编码端经熵编码写入到了码流中，在解码端，需要进行熵解码解析出当前块的预测方向信息。One possible situation is that the prediction information of the current block is the prediction direction information, which is written into the code stream through entropy coding at the encoding end, and at the decoding end, entropy decoding is required to analyze the prediction direction information of the current block.

运动矢量导出单元420，具体用于：The motion vector deriving unit 420 is specifically used for:

使用与当前块预测类型相同的相邻块的与当前块运动矢量指向参考帧的方向相同的运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。具体用于：A motion vector or motion vector predictor or motion vector candidate or motion vector predictor candidate for the current block is derived using motion information of neighboring blocks of the same prediction type as the current block in the same direction as the motion vector of the current block points to the reference frame. Specifically for:

一种可能的情况为，在预测类型设置单元设置好当前块预测方向类型后，根据预测方向类型来导出当前块的运动矢量。One possible situation is that after the prediction type setting unit sets the prediction direction type of the current block, the motion vector of the current block is derived according to the prediction direction type.

实施例6Example 6

图5为本发明实施例提供的一种视频处理中运动矢量导出装置结构示意图。如图5所示，本实施例中，所述视频处理中的运动矢量导出装置包括，判断相邻块中是否存在与当前块预测类型相同块的判断单元510，相同类型相邻块运动矢量导出单元520，不同类型相邻块运动矢量导出单元530。Fig. 5 is a schematic structural diagram of an apparatus for deriving motion vectors in video processing according to an embodiment of the present invention. As shown in Figure 5, in this embodiment, the motion vector derivation device in the video processing includes a judging unit 510 for judging whether there is a block with the same prediction type as the current block in the adjacent block, and the motion vector of the adjacent block of the same type is derived Unit 520, different types of adjacent block motion vector deriving unit 530.

本实施例提供的判断相邻块中是否存在与当前块预测类型相同块的判断单元510，具体用于：The judging unit 510 provided in this embodiment for judging whether there is a block of the same prediction type as the current block in adjacent blocks is specifically used for:

判断相邻块中是否存在于当前块预测类型相同的块。为下一步导出运动矢量做准备。It is judged whether there is a block with the same prediction type as the current block in the adjacent block. Prepare for the next step of exporting motion vectors.

相同类型相邻块运动矢量导出单元520，具体用于：The motion vector deriving unit 520 of the adjacent block of the same type is specifically used for:

若存在与当前块预测类型相同的相邻块，则使用与当前块预测类型相同的相邻块的与当前块运动矢量指向参考帧的方向相同的运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。If there is an adjacent block with the same prediction type as the current block, use the motion information of the adjacent block with the same prediction type as the current block to point to the reference frame in the same direction as the motion vector of the current block to derive the motion vector or motion vector of the current block Predictor or motion vector candidate or motion vector predictor candidate.

具体地，一种可能的情况为，在得到当前块预测方向类型后，根据预测方向类型来导出当前块的运动矢量。Specifically, a possible situation is that after obtaining the prediction direction type of the current block, the motion vector of the current block is derived according to the prediction direction type.

在按下述方法导出当前块的运动矢量前，需要首先确定搜索相邻块的优先级顺序。一种可能的情况为，如图1所示，只考虑A1、AN、B1、BM、C1、C2共6个块，搜索的优先级顺序为AN>BM>C1>A1>B1>C2。Before deriving the motion vector of the current block according to the method described below, it is necessary to first determine the order of priority for searching adjacent blocks. One possible situation is that, as shown in Figure 1, only 6 blocks A1, AN, B1, BM, C1, and C2 are considered, and the search priority order is AN>BM>C1>A1>B1>C2.

不同类型相邻块运动矢量导出单元530，具体用于：Different types of adjacent block motion vector deriving unit 530, specifically used for:

若不存在与当前块预测类型相同的相邻块，则使用于当前块预测类型不同的相邻块的与当前块运动矢量指向参考帧的方向相同的运动信息，导出当前块的运动矢量或运动矢量预测值或运动矢量候选或运动矢量预测值候选。If there is no adjacent block with the same prediction type as the current block, the motion vector or motion Vector predictor or motion vector candidate or motion vector predictor candidate.

在导出运动矢量的过程中，如果当前块的参考帧和搜索选中的相邻块的参考帧为同一个参考帧，则将搜索选中的相邻块的运动矢量直接作为当前块的运动矢量。如果当前块的参考帧和搜索选中的相邻块的参考帧不是同一个参考帧，则将相邻块运动矢量乘以“当前块与当前块参考的距离”，再除以“相邻块与相邻块的参考块之间的距离”，得到的运动矢量作为当前块的运动矢量。In the process of deriving the motion vector, if the reference frame of the current block and the reference frame of the adjacent block selected by searching are the same reference frame, the motion vector of the adjacent block selected by searching is directly used as the motion vector of the current block. If the reference frame of the current block and the reference frame of the adjacent block selected by the search are not the same reference frame, multiply the motion vector of the adjacent block by the "distance between the current block and the reference of the current block", and then divide it by the "distance between the adjacent block and The distance between the reference blocks of adjacent blocks", and the obtained motion vector is used as the motion vector of the current block.

实施例7Example 7

图6为本发明实施例提供的一种视频编码中运动矢量导出装置结构示意图。如图2所示，本实施例中，所述视频编码中的运动矢量导出装置包括判断相邻块中是否存在与当前块预测类型相同块的判断单元610，相同类型相邻块运动矢量导出单元620，不同类型相邻块运动矢量导出单元630，预测类型写入单元640。Fig. 6 is a schematic structural diagram of an apparatus for deriving motion vectors in video coding according to an embodiment of the present invention. As shown in Figure 2, in this embodiment, the motion vector derivation device in the video coding includes a judging unit 610 for judging whether there is a block with the same prediction type as the current block in the adjacent block, and the motion vector derivation unit for the same type adjacent block 620, different types of adjacent block motion vector deriving unit 630, prediction type writing unit 640.

本实施例提供的判断相邻块中是否存在与当前块预测类型相同块的判断单元610，具体用于：The judging unit 610 provided in this embodiment for judging whether there is a block of the same prediction type as the current block in adjacent blocks is specifically used for:

相同类型相邻块运动矢量导出单元620，具体用于：The motion vector deriving unit 620 of the adjacent block of the same type is specifically used for:

不同类型相邻块运动矢量导出单元630，具体用于：Different types of adjacent block motion vector deriving unit 630, specifically used for:

预测类型写入单元640，predictive type write unit 640,

实施例8Example 8

图7为本发明实施例提供的一种视频解码中运动矢量导出装置结构示意图。如图7所示，本实施例中，所述视频编码中的运动矢量导出装置包括，预测类型信息读取单元710，判断相邻块中是否存在与当前块预测类型相同块的判断单元720，相同类型相邻块运动矢量导出单元730，不同类型相邻块运动矢量导出单元740。FIG. 7 is a schematic structural diagram of an apparatus for deriving motion vectors in video decoding according to an embodiment of the present invention. As shown in FIG. 7 , in this embodiment, the device for deriving motion vectors in video coding includes a prediction type information reading unit 710, a judging unit 720 for judging whether there is a block of the same prediction type as the current block in an adjacent block, The motion vector deriving unit 730 for the same type of adjacent blocks, and the deriving unit 740 for the motion vector of different types of adjacent blocks.

本实施例提供的预测信息读取单元710，具体用于：The prediction information reading unit 710 provided in this embodiment is specifically used for:

一种可能的情况为，当前块的预测信息为预测方向信息，该信息在编码端经熵编码写入到了码流中，在解码端，需要进行熵解码解析出当前块的预测方向信息。将当前块的预测类型设置为码流中解析得到的当前块的预测类型信息。当前块的预测类型可能为预测方向类型，可能为前向、后向、双向、对称中的一种。One possible situation is that the prediction information of the current block is the prediction direction information, which is written into the code stream through entropy coding at the encoding end, and at the decoding end, entropy decoding is required to analyze the prediction direction information of the current block. Set the prediction type of the current block to the prediction type information of the current block analyzed in the code stream. The prediction type of the current block may be a prediction direction type, which may be one of forward, backward, bidirectional, and symmetric.

判断相邻块中是否存在与当前块预测类型相同块的判断单元720，具体用于：A judging unit 720 for judging whether there is a block of the same prediction type as the current block in an adjacent block, specifically for:

相同类型相邻块运动矢量导出单元730，具体用于：The motion vector deriving unit 730 of the adjacent block of the same type is specifically used for:

不同类型相邻块运动矢量导出单元740，具体用于：Different types of adjacent block motion vector deriving unit 740, specifically used for:

本领域普通技术人员可以理解：实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成，前述的程序可以存储于一计算机可读取存储介质中，该程序在执行时，执行包括上述方法实施例的步骤；而前述的存储介质包括：ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。Those of ordinary skill in the art can understand that all or part of the steps for realizing the above-mentioned method embodiments can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the It includes the steps of the above method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other various media that can store program codes.

最后应说明的是：以上实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. a method for processing video frequency is characterized in that, comprising:

Use the identical movable information of the direction with current block motion vector points reference frame of the adjacent block identical with the current block type of prediction, derive motion vector or motion vector predictor or motion vector candidates or the motion vector predictor candidate of current block.

2. the described method for processing video frequency of claim 1 is further characterized in that, obtains the information of the type of prediction of described current block from code stream.

3. the described method for processing video frequency of claim 1 is further characterized in that, the information of the type of prediction of current block is written in the code stream.

4. the described method for processing video frequency of claim 1 is characterized in that, described type of prediction is a kind of in the following prediction direction type: forward direction, back are to, symmetry and two-way.

5. a method for processing video frequency is characterized in that, comprising:

If there be the adjacent block identical with the current block type of prediction, then use the identical movable information of the direction with current block motion vector points reference frame of the adjacent block identical with the current block type of prediction, derive motion vector or motion vector predictor or motion vector candidates or the motion vector predictor candidate of current block;

If there be not the adjacent block identical with the current block type of prediction, then use the identical movable information of the direction with current block motion vector points reference frame of the adjacent block different with the current block type of prediction, derive motion vector or motion vector predictor or motion vector candidates or the motion vector predictor candidate of current block.

6. a video process apparatus is characterized in that, comprising:

The motion vector lead-out unit, be used for using the identical movable information of the direction with current block motion vector points reference frame of the adjacent block identical with the current block type of prediction, derive motion vector or motion vector predictor or motion vector candidates or the motion vector predictor candidate of current block.

7. the described video process apparatus of claim 6 is further characterized in that, obtains the type of prediction reading unit of information of the type of prediction of described current block from code stream.

8. the described video process apparatus of claim 6 is further characterized in that, the information of the type of prediction of current block is written to type of prediction writing unit in the code stream.

9. the described video process apparatus of claim 6 is characterized in that, described type of prediction is a kind of in the following prediction direction type: forward direction, back are to, symmetry and two-way.

10. a video process apparatus is characterized in that, comprising:

If there be the adjacent block identical with the current block type of prediction, then use the motion vector lead-out unit of deriving motion vector from the same type adjacent block, derive motion vector or motion vector predictor or motion vector candidates or the motion vector predictor candidate of current block;

If there be not the adjacent block identical with the current block type of prediction, then use the dissimilar adjacent block motion vector lead-out units of deriving motion vector from dissimilar adjacent blocks, derived motion vector or motion vector predictor or motion vector candidates or the motion vector predictor candidate of current block by these dissimilar adjacent block motion vector lead-out units.