CN113727119B - Inter-frame prediction method, encoder, decoder, and computer storage medium - Google Patents

Abstract

The embodiment of the present application discloses an inter-frame prediction method, an encoder, a decoder, and a computer storage medium, which are applied to the decoder. The method includes: parsing the code stream to obtain the prediction mode parameters of the current block; when the prediction mode parameters Indicates that when the preset inter prediction mode is used to determine the inter prediction value of the current block, at least one unidirectional motion information is determined from a plurality of known motion information of the current block; the at least one unidirectional motion information is determined based on the preset offset performing offset processing on one unidirectional motion information to obtain at least one new unidirectional motion information; wherein, the preset offset is based on the horizontal direction vector value and the vertical direction vector value corresponding to the at least one unidirectional motion information It is calculated; based on the at least one new unidirectional motion information, constructing a new motion information candidate list; according to the new motion information candidate list, determining an inter-frame prediction value of the current block.

Description

Inter-frame prediction method, encoder, decoder and computer storage medium

technical field

The present application relates to the technical field of video encoding and decoding, and in particular to an inter-frame prediction method, an encoder, a decoder, and a computer storage medium.

Background technique

In the field of video coding and decoding, in addition to the intra-frame prediction method, the inter-frame prediction method can also be used in the process of coding and decoding the current block. Among them, inter-frame prediction may include inter-frame geometric partitioning prediction mode (Geometric Partitioning Mode, GPM) and angle weighted prediction mode (Angular Weighted Prediction, AWP), etc., by dividing the current block between frames into two non-rectangular partitions (or Two blocks) are predicted separately and then weighted and fused to obtain the predicted value of the current block.

At present, in the prediction process of GPM or AWP, although the motion information of neighboring blocks in the spatial domain and the motion information of the co-located block in the time domain are used to construct the motion information candidate list, there is no guarantee that the motion information candidate list can be filled. . When the motion information candidate list is not full, the last effective motion information is usually used for copying and filling.

In this way, at the edge of two areas with different motions, such as some deformations, if the motion information of adjacent blocks in the space domain and the motion information of the same position block in the time domain do not contain the motion information of this deformation, GPM or AWP will not be able to function. . In addition, since there may be a deviation between the motion information selected by the encoder and the actual motion information, that is, there may be a deviation between the motion information in the currently constructed motion information candidate list and the actual motion information of the current block, which will also affect the encoding and decoding process. performance.

Contents of the invention

The present application proposes an inter-frame prediction method, an encoder, a decoder, and a computer storage medium, which can increase the diversity of motion information in a motion information candidate list, thereby improving encoding and decoding performance.

The technical scheme of the present application is realized like this:

In the first aspect, an embodiment of the present application provides an inter-frame prediction method, which is applied to a decoder, and the method includes:

Parse the code stream to obtain the prediction mode parameters of the current block;

When the prediction mode parameter indicates that a preset inter prediction mode is used to determine an inter prediction value of the current block, at least one unidirectional motion information is determined from a plurality of known motion information of the current block;

Perform offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information; wherein the preset offset corresponds to the at least one unidirectional motion information The horizontal direction vector value and the vertical direction vector value are calculated;

Constructing a new motion information candidate list based on the at least one new unidirectional motion information;

Determine an inter-frame prediction value of the current block according to the new motion information candidate list.

In the second aspect, the embodiment of the present application provides an inter-frame prediction method, which is applied to an encoder, and the method includes:

determining a prediction mode parameter for the current block;

When the prediction mode parameter indicates that a preset inter prediction mode is used to determine an inter prediction value of the current block, at least one unidirectional motion information is determined from a plurality of known motion information of the current block;

Perform offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information; wherein the preset offset corresponds to the at least one unidirectional motion information The horizontal direction vector value and the vertical direction vector value are calculated;

Constructing a new motion information candidate list based on the at least one new unidirectional motion information;

Determine an inter-frame prediction value of the current block according to the new motion information candidate list.

In a third aspect, the embodiment of the present application provides a decoder, which includes an analysis unit, a first determination unit, a first offset unit, a first construction unit, and a first prediction unit; wherein,

The parsing unit is configured to parse the code stream to obtain the prediction mode parameters of the current block;

The first determining unit is configured to determine at least one of the known motion information of the current block when the prediction mode parameter indicates that a preset inter-frame prediction mode is used to determine the inter-frame prediction value of the current block One-way motion information;

The first offset unit is configured to perform offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information; wherein the preset offset is Calculated according to the horizontal direction vector value and the vertical direction vector value corresponding to the at least one unidirectional motion information;

The first construction unit is configured to construct a new motion information candidate list based on the at least one new unidirectional motion information;

The first prediction unit is configured to determine an inter-prediction value of the current block according to the new motion information candidate list.

In a fourth aspect, an embodiment of the present application provides a decoder, where the decoder includes a first memory and a first processor; wherein,

The first memory is used to store a computer program capable of running on the first processor;

The first processor is configured to execute the method as described in the first aspect when running the computer program.

In the fifth aspect, the embodiment of the present application provides an encoder, which includes a second determination unit, a second offset unit, a second construction unit, and a second prediction unit; wherein,

The second determination unit is configured to determine a prediction mode parameter of the current block;

The second determining unit is further configured to determine at least A one-way motion message;

The second offset unit is configured to perform offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information; wherein the preset offset is Calculated according to the horizontal direction vector value and the vertical direction vector value corresponding to the at least one unidirectional motion information;

The second construction unit is configured to construct a new motion information candidate list based on the at least one new unidirectional motion information;

The second prediction unit is configured to determine an inter-prediction value of the current block according to the new motion information candidate list.

In a sixth aspect, the embodiment of the present application provides an encoder, the encoder includes a second memory and a second processor; wherein,

The second memory is used to store a computer program capable of running on the second processor;

The second processor is configured to execute the method as described in the second aspect when running the computer program.

In the seventh aspect, the embodiment of the present application provides a computer storage medium, the computer storage medium stores a computer program, and when the computer program is executed by the first processor, the method as described in the first aspect is implemented, or the computer program is executed by the second processor. The processor realizes the method described in the second aspect when executing.

An inter-frame prediction method, an encoder, a decoder, and a computer storage medium provided in the embodiments of the present application analyze the code stream to obtain the prediction mode parameters of the current block; when the prediction mode parameters indicate to use the preset inter-frame prediction When determining the inter-frame prediction value of the current block, at least one unidirectional motion information is determined from a plurality of known motion information of the current block; the at least one unidirectional motion information is offset based on a preset offset Processing, obtaining at least one new unidirectional motion information; wherein, the preset offset is calculated according to the horizontal direction vector value and the vertical direction vector value corresponding to the at least one unidirectional motion information; based on the at least one The new unidirectional motion information is used to construct a new motion information candidate list; and the inter-frame prediction value of the current block is determined according to the new motion information candidate list. In this way, after obtaining at least one new unidirectional motion information, the new unidirectional motion information can be filled in the motion information candidate list, which can increase the diversity of motion information in the motion information candidate list; in addition, for the current block , the initial motion information in the motion information candidate list may deviate from the actual motion information. At this time, constructing new unidirectional motion information will have a better effect than the initial motion information, thereby improving the encoding and decoding performance.

Description of drawings

FIG. 1 is a schematic block diagram of a video coding system provided by an embodiment of the present application;

FIG. 2 is a schematic block diagram of a video decoding system provided by an embodiment of the present application;

FIG. 3 is a schematic flowchart of an inter-frame prediction method provided by an embodiment of the present application;

FIG. 4 is a schematic structural diagram of a typical image group provided in the embodiment of the present application;

FIG. 5 is a schematic flowchart of another inter-frame prediction method provided by an embodiment of the present application;

FIG. 6A is a schematic diagram of the weight distribution of multiple division modes of a GPM on a 64×64 current block provided by an embodiment of the present application;

FIG. 6B is a schematic diagram of the weight distribution of various division modes of an AWP on a 64×64 current block provided by the embodiment of the present application;

FIG. 7 is a schematic diagram of a spatial position relationship between a current block and adjacent blocks provided by an embodiment of the present application;

FIG. 8 is a schematic flowchart of another inter-frame prediction method provided by an embodiment of the present application;

FIG. 9 is a schematic structural diagram of a decoder provided in an embodiment of the present application;

FIG. 10 is a schematic diagram of a hardware structure of a decoder provided in an embodiment of the present application;

FIG. 11 is a schematic diagram of the composition and structure of an encoder provided in an embodiment of the present application;

FIG. 12 is a schematic diagram of a hardware structure of an encoder provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It should be understood that the specific embodiments described here are only used to explain the related application, not to limit the application. It should also be noted that, for the convenience of description, only the parts related to the relevant application are shown in the drawings.

In a video image, the current block (Coding Block, CB) is generally represented by the first image component, the second image component and the third image component; where these three image components are a luminance component and a blue chrominance component respectively And a red chrominance component, specifically, the luminance component is usually represented by the symbol Y, the blue chrominance component is usually represented by the symbol Cb or U, and the red chrominance component is usually represented by the symbol Cr or V; thus, the video image can be expressed in the YCbCr format Indicates that it can also be expressed in YUV format.

Currently, common video codec standards are based on a block-based hybrid coding framework. Each frame in the video image is divided into square largest coding units (Largest Coding Unit, LCU) of the same size (such as 128×128, 64×64, etc.), and each largest coding unit can also be divided into rectangular coding units according to the rules. Unit (CodingUnit, CU); and the coding unit may be divided into smaller prediction units (Prediction Unit, PU). Specifically, the hybrid coding framework may include prediction, transformation (Transform), quantization (Quantization), entropy coding (EntropyCoding), loop filtering (In Loop Filter) and other modules; wherein, the prediction module may include intra prediction (intraprediction) And inter prediction (inter prediction), inter prediction can include motion estimation (motionestimation) and motion compensation (motion compensation). Due to the strong correlation between adjacent pixels in a video image, the use of intra-frame prediction in video coding and decoding technology can eliminate the spatial redundancy between adjacent pixels; however, due to the adjacent There is also a strong similarity between frames. In video coding and decoding technology, inter-frame prediction is used to eliminate time redundancy between adjacent frames, thereby improving coding efficiency. The following application will use inter-frame prediction for detailed description.

It should be understood that the embodiment of the present application provides a video coding system. As shown in FIG. , inter-frame prediction unit 115 (comprising: motion compensation and motion estimation), inverse quantization unit 116, inverse transformation unit 117, loop filter unit 118, encoding unit 119 and decoded image buffer unit 120; for the original video signal input, by A video reconstruction block can be obtained by dividing the coding tree block (Coding Tree Unit, CTU), and the coding mode is determined by the mode selection and coding control logic unit 113, and then, for the residual pixel information obtained after intra-frame or inter-frame prediction, The video reconstruction block is transformed by the transformation unit 111 and the quantization unit 112, including transforming the residual information from the pixel domain to the transformation domain, and quantizing the obtained transformation coefficients to further reduce the bit rate; the intra prediction unit 114 It is used to perform intra-frame prediction on the video reconstruction block; wherein, the intra-frame prediction unit 114 is used to determine the optimal intra-frame prediction mode (ie, the target prediction mode) of the video reconstruction block; the inter-frame prediction unit 115 is used to execute the received Inter-frame prediction coding of video reconstruction blocks relative to one or more blocks in one or more reference frames to provide temporal prediction information; where, motion estimation is the process of generating motion vectors, which can estimate the The video reconstructs the motion of the block, and then motion compensation performs motion compensation based on the motion vector determined by the motion estimation; after determining the inter prediction mode, the inter prediction unit 115 is also used to provide the selected inter prediction data to the encoding unit 119, and also send the calculated and determined motion vector data to the encoding unit 119; in addition, the inverse quantization unit 116 and the inverse transformation unit 117 are used for the reconstruction of the video reconstruction block, and reconstruct the residual block in the pixel domain , the reconstructed residual block is passed through the loop filter unit 118 to remove blockiness artifacts, and then the reconstructed residual block is added to a predictive block in the frame of the decoded image buffer unit 120 to generate a reconstructed The video reconstruction block; the encoding unit 119 is used to encode various encoding parameters and quantized transform coefficients. The decoded image buffer unit 120 is used to store reconstructed video reconstruction blocks for prediction reference. As the video image encoding progresses, new reconstructed video reconstruction blocks will be continuously generated, and these reconstructed video reconstruction blocks will be stored in the decoded image buffer unit 120 .

The embodiment of the present application also provides a video decoding system. As shown in FIG. 2, the video decoding system 12 may include: a decoding unit 121, an inverse transformation unit 127, an inverse quantization unit 122, an intra prediction unit 123, and a motion compensation unit 124 , loop filtering unit 125 and decoded image cache unit 126 unit; after the video signal of input is coded through video encoding system 11, output the code stream of this video signal; This code stream is input in video decoding system 12, first passes through decoding unit 121, used to obtain the decoded transform coefficient; the transform coefficient is processed by the inverse transform unit 127 and the inverse quantization unit 122, so as to generate a residual block in the pixel domain; the intra prediction unit 123 can be used to Intra-prediction direction and data from previously decoded blocks of the current frame or picture to generate prediction data for the current video decoding block; the motion compensation unit 124 determines the prediction information for the video decoding block by parsing motion vectors and other associated syntax elements , and use the prediction information to generate the predictive block of the video decoding block being decoded; The corresponding predictive blocks are summed to form a decoded video block; the decoded video signal is passed through the loop filter unit 125 in order to remove block artifacts, which can improve video quality; and then the decoded video block is stored in the decoded image buffer In unit 126, the decoded image buffer unit 126 stores reference images for subsequent intra-frame prediction or motion compensation, and is also used for outputting video signals to obtain restored original video signals.

An inter-frame prediction method provided by the embodiment of the present application mainly acts on the inter-frame prediction unit 215 of the video encoding system 11 and the inter-frame prediction unit of the video decoding system 12, that is, the motion compensation unit 124; The system 11 can obtain a better prediction effect through the inter-frame prediction method provided by the embodiment of the present application, and correspondingly, the video decoding system 12 can also improve the quality of video decoding and restoration.

Based on this, the technical solution of the present application will be further elaborated below in conjunction with the drawings and embodiments. Before elaborating in detail, it should be noted that the "first", "second", and "third" mentioned throughout the specification are only for distinguishing different features, and do not limit the priority or sequence , size relationship and other functions.

An embodiment of the present application provides an inter-frame prediction method, which is applied to a video decoding device, that is, a decoder. The functions realized by this method can be realized by calling the computer program by the first processor in the decoder. Of course, the computer program can be stored in the first memory. It can be seen that the decoder includes at least the first processor and the first memory.

Referring to FIG. 3 , it shows a schematic flowchart of an inter-frame prediction method according to an embodiment of the present application. As shown in Figure 3, the method may include:

S301: Parsing the code stream to obtain the prediction mode parameter of the current block.

It should be noted that the image to be decoded can be divided into multiple image blocks, and the current image block to be decoded can be called the current block (may be represented by CU), and the image blocks adjacent to the current block can be called adjacent blocks; That is, in the image to be decoded, there is an adjacent relationship between the current block and adjacent blocks. Here, each current block may include a first image component, a second image component, and a third image component, that is, the current block indicates that the first image component, the second image component, or the third image component are currently to be predicted in the image to be decoded. image blocks.

Wherein, assuming that the current block performs the first image component prediction, and the first image component is a brightness component, that is, the image component to be predicted is a brightness component, then the current block may also be called a brightness block; or, it is assumed that the current block performs the second image component prediction, and the second image component is a chroma component, that is, the image component to be predicted is a chroma component, then the current block may also be called a chroma block.

It should also be noted that the prediction mode parameter indicates the prediction mode adopted by the current block and parameters related to the prediction mode. Among them, the prediction mode usually includes an inter prediction mode, a traditional intra prediction mode, and a non-traditional intra prediction mode, and the inter prediction mode includes a common inter prediction mode, a GPM prediction mode, and an AWP prediction mode. That is to say, the encoder will select the optimal prediction mode to pre-encode the current block. During this process, the prediction mode of the current block can be determined, and the corresponding prediction mode parameters will be written into the code stream and transmitted by the encoder. to the decoder.

In this way, on the decoder side, the prediction mode parameters of the current block can be obtained directly by parsing the code stream, and the obtained prediction mode parameters are used to determine whether the current block uses a preset inter-frame prediction mode, such as GPM prediction mode or AWP prediction mode.

S302: When the prediction mode parameter indicates that a preset inter-frame prediction mode is used to determine an inter-prediction value of the current block, determine at least one piece of unidirectional motion information from a plurality of pieces of known motion information of the current block.

It should be noted that when the decoder parses the code stream and obtains the prediction mode parameter indicating that the preset inter prediction mode is used to determine the inter prediction value of the current block, the inter prediction provided by the embodiment of the present application can be used method.

It should also be noted that the motion information may include motion vector (Motion Vector, MV) information and reference frame information. Specifically, for a current block that uses inter-frame prediction, the current frame where the current block is located has one or more reference frames, and the current block can be a coding unit or a prediction unit, and a set of motion vectors and reference frames can be used. The motion information of the frame information indicates to a pixel area of the same size as the current block in a certain reference frame, which is called a reference block here, or a motion information containing two sets of motion vectors and reference frame information can be used to indicate to a certain two Two reference blocks in the same or different reference frame; then the motion compensation can obtain the inter-frame prediction value of the current block according to the reference block indicated by the motion information.

It should be understood that a P frame (Predictive Frame) is a frame that can only be predicted using a reference frame whose Picture Order Count (POC) is before the current frame. At this time, the current reference frame has only one reference frame list, represented by RefPicList0; and RefPicList0 is the reference frame of the POC before the current frame. A B frame (Bi-directional Interpolated Prediction Frame) is a frame that can be predicted using the reference frame of the POC before the current frame and the reference frame of the POC after the current frame. The B frame has two reference frame lists, which are respectively represented by RefPicList0 and RefPicList1; among them, RefPicList0 is the reference frame of POC before the current frame, and RefPicList1 is the reference frame of POC after the current frame. For the current block, you can only refer to the reference block of a certain frame in RefPicList0, which is called forward prediction; or you can only refer to the reference block of a certain frame in RefPicList1, which is called backward prediction prediction; or can also refer to a reference block of a certain frame in RefPicList0 and a reference block of a certain frame in RefPicList1 at the same time, and this situation can be called bidirectional prediction. A simple way to refer to two reference blocks at the same time is to average the pixels at each corresponding position in the two reference blocks to obtain an inter-frame prediction value (or may be called a prediction block) for each pixel in the current block. The later B frame is no longer limited to the reference frame of POC before the current frame in RefPicList0, and the reference frame of POC after the current frame in RefPicList1. In other words, RefPicList0 can also have a reference frame of POC after the current frame, and RefPicList1 can also have a reference frame of POC before the current frame, that is, the current block can refer to the reference frame of POC before the current frame or At the same time refer to the reference frame of the POC after the current frame. However, the reference frames used when the current block is bidirectionally predicted must come from RefPicList0 and RefPicList1; such B frames are also called generalized B frames.

Since the encoding and decoding order of the Random Access (RA) configuration is different from the POC order, the B frame can refer to the information before and after the current frame at the same time, which can significantly improve the encoding performance. Exemplarily, a classic group of pictures (Group Of Pictures, GOP) structure of RA is shown in Figure 4, in Figure 4, the arrow represents the reference relationship, since the I frame does not require a reference frame, then the POC is 0 After the I frame is decoded, the P frame with the POC of 4 will be decoded, and the I frame with the POC of 0 can be referred to when decoding the P frame with the POC of 4. After decoding the P frame with POC 4, then decode the B frame with POC 2, and when decoding the B frame with POC 2, you can refer to the I frame with POC 0 and the P frame with POC 4, and so on. In this way, according to FIG. 4, it can be obtained that when the POC sequence is {0 1 2 3 4 56 7 8}, its corresponding decoding sequence is {0 3 2 4 1 7 6 8 5}.

In addition, the codec sequence of the Low Delay (LD) configuration is the same as the POC sequence, and at this time, the current frame can only refer to the information before the current frame. Among them, the Low Delay configuration is divided into Low Delay P and Low Delay B. LowDelay P is the traditional Low Delay configuration. Its typical structure is IPPP..., that is, an I frame is coded and decoded first, and then the decoded frames are all P frames. The typical structure of Low Delay B is IBBB..., and the difference from Low Delay P is that each inter frame is a B frame, that is, two reference frame lists are used, and the current block can refer to the reference block of a certain frame in RefPicList0 at the same time and a reference block of a certain frame in RefPicList1. Here, a reference frame list of the current frame can have at most several reference frames, such as 2, 3 or 4 and so on. When encoding or decoding a current frame, the number of reference frames in RefPicList0 and RefPicList1 is determined by the preset configuration or algorithm, but the same reference frame can appear in RefPicList0 and RefPicList1 at the same time, that is, the encoder or decoder The filter allows the current block to refer to two reference blocks in the same reference frame at the same time.

In the embodiment of the present application, the encoder or the decoder can usually use the index value (indicated by index) in the reference frame list to correspond to the reference frame. If the length of a reference frame list is 4, then index has four values: 0, 1, 2, 3, etc. For example, if RefPicList0 of the current frame has 4 reference frames with POC of 5, 4, 3, and 0, then index0 of RefPicList0 is the reference frame of POC 5, index1 of RefPicList0 is the reference frame of POC 4, and index 2 of RefPicList0 is POC3 The reference frame of POC 0, index 3 of RefPicList0 is the reference frame of POC 0.

In the current VVC video codec standard, the preset inter-frame prediction mode may be a GPM prediction mode. In the current AVS3 video codec standard, the preset inter-frame prediction mode may be an AWP prediction mode. Although these two prediction modes have different names and different specific implementation forms, they are common in principle, that is, both prediction modes can be applied to the inter-frame prediction method of the embodiment of the present application.

Specifically, for the GPM prediction mode, if GPM is used, the prediction mode parameters under GPM will be transmitted in the code stream, such as the specific division mode of GPM; usually, GPM includes 64 division modes. For the AWP prediction mode, if AWP is used, the prediction mode parameters under AWP will be transmitted in the code stream, such as the specific division mode of AWP; usually, AWP includes 56 division modes.

In the preset prediction mode, for example, GPM and AWP need to use two unidirectional motion information to find two reference blocks. The current implementation method is to construct a unidirectional motion information candidate list on the encoder side by using the relevant information of the coded/decoded part before the current block, select unidirectional motion information from the unidirectional motion information candidate list, and combine the two unidirectional motion information Write the code stream to the index value (index) of the motion information in the unidirectional motion information candidate list. The same method is adopted on the decoder side, that is, a unidirectional motion information candidate list is constructed using the relevant information of the decoded part before the current block, and the unidirectional motion information candidate list must be the same as the candidate list constructed on the encoder side. In this way, the index values of the two unidirectional motion information are parsed from the code stream, and then the two unidirectional motion information are found out from the unidirectional motion information candidate list, which is the two unidirectional motion information to be used by the current block.

That is to say, the unidirectional motion information described in the embodiment of the present application may include: motion vector information, that is, the value of (x, y), and corresponding reference frame information, that is, the reference frame list and the reference frame in the reference frame list. index value. One representation is to record the reference index values of two reference frame lists, where the reference index values corresponding to one reference frame list are valid, such as 0, 1, 2, etc.; the reference index values corresponding to the other reference frame list are invalid, namely -1. The reference frame list with valid reference index value is the reference frame list used by the motion information of the current block, and the corresponding reference frame can be found from the reference frame list according to the reference index value. Each reference frame list has a corresponding motion vector, the motion vector corresponding to the valid reference frame list is valid, and the motion vector corresponding to the invalid reference frame list is invalid. The decoder can find the required reference frame through the reference frame information in the unidirectional motion information, and can find the reference block in the reference frame according to the position of the current block and the value of the motion vector (x, y), and then determine the current block The inter-frame prediction value of .

In practical applications, although the construction method of the unidirectional motion information candidate list uses the motion information of adjacent blocks in space and the motion information of co-located blocks in time domain, it cannot guarantee that the unidirectional motion information candidate list can be filled. If the motion of adjacent blocks in the spatial domain is single, and the motion information of the same position block in the time domain is the same as that of some adjacent blocks in the spatial domain, the number of unidirectional motion information in the candidate list of unidirectional motion information may be less than the preset number , which means that the one-way motion information candidate list is not full. More specifically, if the available unidirectional motion information found by the existing method is the same, then the unidirectional motion information candidate list will have the same situation in which all the unidirectional motion information is the same, mainly if the unidirectional motion information candidate list is not Filling, currently, the last effective unidirectional motion information is usually used for copying and filling. However, GPM or AWP needs to use two different reference blocks. If the two unidirectional motion information found are the same, that is, the two reference blocks are the same, then this will make the obtained inter-frame prediction value and The original unidirectional prediction uses the same reference block, but the overhead of GPM or AWP is larger, because it needs to transmit the index of two unidirectional motion information, and the prediction mode parameters of GPM or AWP, but only one unidirectional is effective The index of the motion information. In this case, GPM or AWP should not be used. Moreover, the fewer unidirectional motion information candidates in the unidirectional motion information candidate list, the fewer available combinations of unidirectional motion information candidates (for example, two unidirectional motion information candidates). But GPM or AWP is not only used at the boundary of two objects, but also at the edge of two different areas of motion, such as some deformations, GPM or AWP can sometimes achieve good results. However, if the motion information of adjacent blocks in the space domain and the motion information of the co-located block in the time domain do not contain the motion information of this deformation, then GPM or AWP cannot play a role. Or, for a certain current block, the motion information selected by the encoder may not be the most accurate motion information, but the motion information with the best balance between the code rate (rate) and distortion (distortion); thus the coded motion information and There may be deviations between the actual motion information, which is especially obvious in low bit rate configurations; that is, the one-way motion information constructed only through the current initial motion information candidate list and the actual motion information of the current block There may be a deviation, which will affect the performance of the codec.

At this time, in order to improve the performance of encoding and decoding, the embodiment of the present application needs to construct some new unidirectional motion information and add it to the unidirectional motion information candidate list. The construction here can refer to known motion information that is not directly obtained through the encoded/decoded part, such as the motion information of adjacent blocks in the spatial domain and the motion information of adjacent blocks of the current block in the current frame, or more generally, The motion information in the space domain is the motion information of the decoded part of the current frame, the motion information in the time domain is the motion information in other frames (reference frames), based on the historical motion information in the historical motion vector list, etc. It should be noted that before constructing at least one new unidirectional motion information, at least one unidirectional motion information needs to be determined from multiple known motion information of the current block; and each unidirectional motion information is based on the offset According to different information, one or more new one-way motion information can be constructed.

In some embodiments, the plurality of known motion information of the current block may at least include: motion information in the initial motion information candidate list, and/or, spatial domain motion information of the current block, and/or, the current block Time-domain motion information of the current block, and/or, historical motion information of the current block.

Here, for the initial motion information candidate list, in some embodiments, the method further includes: determining the initial motion information candidate list based on the motion information of adjacent blocks of the current block.

It should be noted that there is at least one piece of unidirectional motion information in the initial motion information candidate list. On the decoder side, when the initial motion information candidate list does not include repeated unidirectional motion information and the number of existing unidirectional motion information in the initial motion information candidate list is less than the preset number, it indicates that the unidirectional motion information candidate list is in the When the state is full, motion information can be selected from the initial motion information candidate list to obtain at least one unidirectional motion information; or, motion information can also be obtained from the decoded part, such as from the spatial domain motion information of the current block and/or the current The motion information is obtained from the time-domain motion information of the block and/or the historical motion information of the current block to obtain at least one piece of unidirectional motion information.

It should also be noted that since the known motion information of the current block may be one-way motion information or two-way motion information, it needs to be judged. Specifically, in some embodiments, the method may also include:

If motion information is selected from the initial motion information candidate list, then determining that the selected motion information is unidirectional motion information;

If motion information is selected from the spatial motion information of the current block and/or the temporal motion information of the current block and/or the historical motion information of the current block, then judging whether the selected motion information is bidirectional motion information;

When the selected motion information is bidirectional motion information, the selected motion information is split into two unidirectional motion information, so as to determine at least one unidirectional motion information from a plurality of known motion information of the current block. step.

That is to say, when at least one unidirectional motion information is determined, if the motion information is selected from the initial motion information candidate list, the selected motion information is unidirectional motion information. If it is based on spatial information, time domain information, historical motion information, etc., then it is necessary to determine whether the selected motion information is one-way; if the motion information is two-way motion information, that is, the reference index values of the two reference frame lists are valid. value, at this time it needs to be split into two one-way motion information to be processed separately.

It should be understood that the construction of new unidirectional motion information mainly involves the determination of at least one unidirectional motion information. Several possible implementations will be provided below to illustrate how to determine at least one piece of unidirectional motion information.

In a possible implementation manner, for S302, the determining at least one unidirectional motion information from multiple known motion information of the current block may include:

Selecting at least one initial unidirectional motion information from a plurality of known motion information of the current block;

determining a candidate reference frame, and scaling the selected at least one initial unidirectional motion information to the candidate reference frame to obtain at least one scaled unidirectional motion information;

The at least one scaled unidirectional motion information is determined as the at least one unidirectional motion information, and the reference frame information corresponding to the at least one unidirectional motion information is the candidate reference frame.

It should be noted that, taking a unidirectional motion information as an example, after arbitrarily selecting an initial unidirectional motion information from multiple known motion information of the current block, a candidate reference frame is first selected, and then the initial unidirectional motion information The motion information is scaled to the candidate reference frame. At this time, the determined one-way motion information is the scaled one-way motion information, and the corresponding reference frame information is the candidate reference frame; in this case, according to this one-way At least one new unidirectional motion information is obtained by offsetting the directional motion information, and the reference frame information corresponding to the at least one new unidirectional motion information is also a candidate reference frame. Here, the candidate reference frame is an arbitrarily selected reference frame in advance.

In another possible implementation manner, for S302, the determining at least one unidirectional motion information from multiple pieces of known motion information of the current block may include:

determining candidate reference frames;

Selecting the at least one unidirectional motion information from multiple pieces of known motion information of the current block, and the reference frame information corresponding to the at least one unidirectional motion information is the candidate reference frame.

It should be noted that, still taking a unidirectional motion information as an example, a candidate reference frame can be selected first, and then the reference frame information can be directly selected from multiple known motion information of the current block as the initial unidirectional motion of the candidate reference frame Information, the one-way motion information determined at this time is the selected one-way motion information, and the corresponding reference frame information is the candidate reference frame; in this case, according to this one-way motion information through the offset method At least one new unidirectional motion information is obtained, and the reference frame information corresponding to the at least one new unidirectional motion information is also a candidate reference frame.

In addition, the embodiment of the present application can also directly select an initial unidirectional motion information from a plurality of known motion information of the current block. At this time, there is no need to determine a candidate reference frame, but at least one new unidirectional motion information constructed subsequently The reference frame information corresponding to the motion information is the same as the reference frame information corresponding to the selected initial unidirectional motion information.

In this way, after at least one piece of unidirectional motion information is determined, at least one new piece of unidirectional motion information may be subsequently constructed in an offset manner.

S303: Perform offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information.

It should be noted that after at least one unidirectional motion information is obtained, offset processing can be performed on it to obtain at least one new unidirectional motion information; and each unidirectional motion information can be constructed according to the difference of offset information Generate one or more new unidirectional motion messages. Here, the preset offset may be calculated according to the horizontal direction vector value and the vertical direction vector value corresponding to the at least one piece of unidirectional motion information.

In some embodiments, for S303, performing offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information may include:

Based on at least one preset direction, perform offset processing on the at least one unidirectional motion information according to a preset offset to obtain the at least one new unidirectional motion information; wherein, the at least one new unidirectional motion information The information is the same as the reference frame information corresponding to the at least one piece of unidirectional motion information.

It should be noted that the preset direction may at least include: an upward direction, and/or, a downward direction, and/or, a leftward direction, and/or, a rightward direction; If the offset is used to offset at least one unidirectional motion information, different new unidirectional motion information can be obtained.

Generally speaking, new unidirectional motion information can be constructed according to the known motion information of the current block and added to the motion information candidate list. When there is motion information in the motion information candidate list, it can be constructed according to the motion information in the motion information candidate list; or it can be constructed according to the motion information obtained through the decoded part, such as according to spatial information, time domain information, history The motion information (that is, the motion information obtained based on the historical information) etc. is constructed to obtain at least one new unidirectional motion information. That is to say, an existing MV can be offset to obtain a new MV. Assume that the value of the existing MV is (x,y). The preset offset in the horizontal direction is represented by offsetx, and the preset offset in the vertical direction is represented by offsety, so the value of the new MV is (x+offsetx, y+offsety).

In a possible implementation manner, the existing MVs are respectively shifted upward, downward, leftward, and rightward to obtain different MVs. If an upward offset is performed for the existing MV, the absolute value of the preset offset is offset, then the constructed new MV is (x, y-offset); if a downward offset is performed for the existing MV, the preset The absolute value of the offset is offset, then the constructed new MV is (x, y+offset); if the existing MV is shifted to the left, the absolute value of the preset offset is offset, then the constructed The new MV is (x-offset, y); if the existing MV is shifted to the right, the absolute value of the default offset is offset, then the constructed new MV is (x+offset, y) .

Because each unidirectional motion information in the motion information candidate list includes not only MV, but also corresponding reference frame information. Usually, the way to determine the reference frame information is to use the reference frame list and the corresponding reference index value in the reference frame list. Specifically, for the newly constructed unidirectional motion information, the newly constructed unidirectional motion information may be the same as the reference frame information corresponding to the known motion information used for construction, or the newly constructed unidirectional motion information The list of reference frames corresponding to the known motion information used for construction is the same as the reference index value.

In another possible implementation manner, the known motion information is scaled to a reference frame different from the reference frame corresponding to the motion information, and then the MV is shifted to obtain new unidirectional motion information.

It should be noted that the embodiment of the present application is mainly applicable to unidirectional motion information, but is also applicable to bidirectional motion information. If the motion information is bidirectional, the MV offset directions in the two directions can be the same or opposite; the preset offsets can be determined separately or jointly.

It should also be noted that the preset offset may be a preset fixed value, or the preset offset may be obtained according to a preset algorithm, which is not specifically limited in this embodiment of the present application.

Here, for the preset offset, the following several implementation manners may be used to determine it.

In a possible implementation manner, the preset offset may be a preset fixed value, such as a fixed value of 1, 2, 3, 4, 5, 6, 7, 8, and the like.

In another possible implementation manner, the method may also include:

For the at least one unidirectional motion information, determine a horizontal direction vector value and a vertical direction vector value corresponding to each unidirectional motion information;

When the preset direction is an upward direction and/or a downward direction, it is judged whether the value of the vertical direction vector is equal to 0;

When the vector value in the vertical direction is not equal to 0, according to the division operation between the absolute value of the vector value in the vertical direction and the first preset value, the preset offset corresponding to each unidirectional motion information is obtained;

or,

When the preset direction is a leftward direction and/or a rightward direction, determine whether the horizontal direction vector value is equal to 0;

When the horizontal direction vector value is not equal to 0, the preset offset corresponding to each unidirectional motion information is obtained according to the division operation between the absolute value of the horizontal direction vector value and the second preset value.

It should be noted that the preset offset may be related to (x, y) of the existing MV used to construct the new MV. Among them, x represents the vector value in the horizontal direction, and y represents the vector value in the vertical direction.

In the case where the preset direction is the upward direction and/or the downward direction, if the existing MV is shifted upwards, the absolute value of the preset offset is offset, then one way of deriving the offset is if y is not equal to 0, then offset=|y|/N, N may be 2, 4, 8, etc.; if y is equal to 0, then offset can be a fixed value, and the new MV constructed at this time is (x, y-offset). If the existing MV is offset downward, the absolute value of the preset offset is offset, then one way of deriving offset is that if y is not equal to 0, then offset=|y|/N, N may be 2, 4, 8, etc.; if y is equal to 0, then offset can be a fixed value, and the new MV constructed at this time is (x, y+offset).

In the case where the preset direction is leftward and/or rightward, if the existing MV is offset to the left, the absolute value of the preset offset is offset, then a way to derive offset if x is not is equal to 0, then offset=|x|/N, N may be 2, 4, 8, etc.; if x is equal to 0, then offset can be a fixed value, and the new MV constructed at this time is (x-offset, y) . If the existing MV is offset to the right, the absolute value of the preset offset is offset, then one way of deriving offset is that if x is not equal to 0, then offset=|x|/N, N may be 2, 4, 8, etc.; if x is equal to 0, then the offset is a fixed value, and the new MV constructed at this time is (x+offset, y).

In yet another possible implementation manner, the method may also include:

For any preset direction, the absolute value of the vector value in the horizontal direction and the absolute value of the vector value in the vertical direction are added to obtain a calculation sum;

Judging whether the calculated sum value is equal to 0;

When the calculated sum value is not equal to 0, a preset offset corresponding to each unidirectional motion information is obtained according to a division operation between the calculated sum value and a third preset value.

It should be noted that, for any preset direction, the preset offset may be related to |x|+|y| of the existing MV used to construct the new MV. Among them, x represents the vector value in the horizontal direction, and y represents the vector value in the vertical direction.

That is to say, the absolute value of the preset offset is offset, if |x|+|y| is not equal to 0, then offset=(|x|+|y|)/N, N may be 2, 4, 8 etc.; if |x|+|y| is equal to 0, then offset can be a fixed value.

In yet another possible implementation manner, the method may also include:

For each unidirectional motion information, comparing the obtained preset offset with the minimum preset offset and the maximum preset offset respectively;

When the obtained preset offset is less than the minimum preset offset, determining the minimum preset offset as the preset offset;

When the obtained preset offset is greater than the minimum preset offset, the maximum preset offset is determined as the preset offset.

That is to say, the size of the preset offset (represented by offset) may conform to a certain preset value range, for example, between the minimum preset offset (represented by offset _min ) and the maximum preset offset (represented by offset _max indicates the range between), that is, offset needs to be greater than or equal to offset _min , and offset needs to be less than or equal to offset _max . If the offset calculated according to the above implementation manner is smaller than offset _min , then set offset to offset _min ; if the offset calculated according to the above implementation manner is greater than offset _max , then set offset to offset _max . Here, offset _max and offset _max may be some preset fixed values, but this embodiment of the present application does not limit it.

In this way, one or more pieces of one-way motion information can be constructed through the above several possible implementation manners. Then fill the constructed unidirectional motion information into the initial motion information candidate list to obtain a new motion information candidate list.

S304: Based on the at least one piece of new unidirectional motion information, construct a new motion information candidate list.

It should be noted that after obtaining at least one piece of new unidirectional motion information, it may be filled into the initial motion information candidate list to obtain a new motion information candidate list. Specifically, for S304, this step may include: filling at least one piece of new unidirectional motion information into the initial motion information candidate list to obtain the new motion information candidate list.

It should also be noted that only when the obtained new unidirectional motion information does not overlap with the original unidirectional motion information included in the initial motion information candidate list, can it be filled into the candidate list. That is to say, in some embodiments, the filling the at least one new unidirectional motion information into the initial motion information candidate list may include:

judging whether at least one new unidirectional motion information is duplicated with the motion information in the initial motion information candidate list;

If the at least one new unidirectional motion information does not overlap with the motion information in the initial motion information candidate list, filling the at least one new unidirectional motion information into the initial motion information candidate list .

In this way, in the construction method of the initial motion information candidate list, if the non-repetitive unidirectional motion information cannot fill the candidate list, the last unidirectional motion information in the candidate list is usually used to repeatedly fill the candidate list to fill the candidate list. However, in the embodiment of the present application, when there is no repeated unidirectional motion information and the candidate list cannot be filled, at this time, new unidirectional motion information can be constructed to fill the candidate list by constructing new unidirectional motion information; That is, the newly constructed one-way motion information can be filled into the candidate list only when it does not overlap with the original one-way motion information in the candidate list.

Further, when the initial motion information candidate list cannot be filled with non-repetitive motion information, the candidate list may be filled with constructed new unidirectional motion information to obtain a new motion information candidate list. In other words, in the inter-frame prediction method of the embodiment of the present application, the initial motion information candidate list does not include repeated unidirectional motion information and the number of existing unidirectional motion information in the initial motion information candidate list is less than the preset number (that is, the initial The motion information candidate list is not filled). Therefore, in some embodiments, the method may also include:

When the initial motion information candidate list does not include repeated unidirectional motion information and the number of unidirectional motion information in the initial motion information candidate list is less than a preset number, performing the multiple known from the current block Steps of determining at least one unidirectional motion information in the motion information; and performing motion vector calculation on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information.

Here, the preset quantity indicates the preset quantity of one-way motion information that can be filled in the initial motion information candidate list, and may also be referred to as the length of the initial motion information candidate list. In other words, the embodiment of the present application is mainly aimed at the construction of the motion information candidate list, or the situation that the current related technical solutions are used to search for non-repetitive motion information but the candidate list cannot be filled when the motion information candidate list is constructed; in this process , other processes remain unchanged.

It should also be noted that, in the process of constructing the motion information candidate list, for at least one new unidirectional motion information, it mainly involves how to determine at least one unidirectional motion information from the known motion information of the current block. For example, for the existing initial motion information candidate list, one motion information can be arbitrarily selected from the candidate list, such as the first motion information or the last motion information; it can also be sequentially selected from the candidate list, etc. . That is, in some embodiments, the method may also include:

Randomly select one piece of motion information from the initial motion information candidate list, and obtain the at least one new unidirectional motion information according to the offset processing of the one motion information; or,

Sequentially select at least one piece of motion information from the initial motion information candidate list, and obtain the at least one new unidirectional motion information according to offset processing of the at least one piece of motion information; or,

Sequentially select at least one piece of motion information from the spatial domain motion information of the current block and/or the time domain motion information of the current block and/or the historical motion information of the current block, according to the offset of the at least one motion information Processing, obtaining the at least one new unidirectional motion information.

In this way, motion information for constructing new unidirectional motion information can be selected from an existing initial motion information candidate list. One way is to use only one motion information in the initial motion information candidate list, such as the first motion information in the initial motion information candidate list, or the last motion information in the initial motion information candidate list; another way is The motion information in the initial motion information candidate list is sequentially used to construct new motion information; the end condition is that the initial motion information candidate list is filled or the traversal ends to obtain a new motion information candidate list.

In addition, the embodiment of the present application may also select the motion information according to the relative relationship with the current block. One way is to use only the motion information of a certain relative position, such as the motion information of a certain position in F, G, C, A, B, and D, or the motion information in the time domain as described above; the other The way is to set an order for these relative relationships, if the motion information of the previous relative relationship is not available, then select the next available motion information; another way is to set an order for these relative relationships, and use the motion of the relative relationship in order information to construct new motion information; the end condition is that the initial motion information candidate list is filled or the traversal ends to obtain a new motion information candidate list.

S305: Determine an inter-prediction value of the current block according to the new motion information candidate list.

It should be noted that when the prediction mode parameter indicates that GPM or AWP is used to determine the inter-frame prediction value of the current block, two partitions of the current block can be determined at this time; where the two partitions can include the first partition and the second partition .

In this way, after obtaining the new motion information candidate list, the motion information corresponding to the first partition of the current block and the motion information of the second partition can be determined; and then according to the motion information corresponding to the first partition and the second partition The motion information of the current block can be determined to determine the inter frame prediction value.

Specifically, as shown in FIG. 5 , it shows a schematic flowchart of another inter-frame prediction method provided by the embodiment of the present application. The method can include:

S501: Parse the code stream, and determine a first motion information index value corresponding to the first partition and a second motion information index value corresponding to the second partition;

S502: Based on the new motion information candidate list, determine the motion information in the new motion information candidate list indicated by the first motion information index value as the motion information of the first partition, and determine the motion information of the second motion information determining the motion information in the new motion information candidate list indicated by the information index value as the motion information of the second partition;

S503: Calculate a first predicted value of the first partition by using the motion information of the first partition, and calculate a second predicted value of the second partition by using the motion information of the second partition;

S504: Perform weighted fusion on the first predicted value and the second predicted value to obtain an inter-frame predicted value of the current block.

It should be noted that the traditional unidirectional prediction only finds a reference block with the same size as the current block, while the traditional bidirectional prediction uses two reference blocks with the same size as the current block, and the pixel value of each point in the predicted block is The average value of the corresponding positions of the two reference blocks, that is, all points of each reference block account for 50% of the proportion. Bidirectional weighted prediction makes the proportions of two reference blocks different, for example, all points in the first reference block account for 75% of the proportion, and all points in the second reference block account for 25% of the proportion. But all points in the same reference block have the same scale. Some other optimization methods, such as using Decoder side Motion Vector Refinement (DMVR) technology, bi-directional optical flow (Bi-directional Optical Flow, BIO), etc., will cause some changes in reference pixels or predicted pixels, and GPM or AWP Also use two reference blocks with the same size as the current block, but some pixel positions use 100% the pixel values of the corresponding positions of the first reference block, and some pixel positions use 100% of the pixel values of the corresponding positions of the second reference block, In the boundary area, the pixel values of the corresponding positions of the two reference blocks are used according to a certain ratio. How to allocate these weights is determined by the prediction mode of GPM or AWP, or it can also be considered that GPM or AWP uses two reference blocks that are different in size from the current block, that is, each takes a required part as a reference block.

Exemplarily, as shown in FIG. 6A , it shows a schematic diagram of weight distribution of multiple division modes of a GPM on a 64×64 current block provided by the embodiment of the present application. In FIG. 6A, there are 64 division patterns in GPM. As shown in FIG. 6B , it shows a schematic diagram of weight distribution of various division modes of an AWP on a 64×64 current block provided by the embodiment of the present application. In FIG. 6B, there are 56 division modes in AWP. Regardless of Figure 6A or Figure 6B, in each division mode, the black area indicates that the weight value of the corresponding position of the first reference block is 0%, the white area indicates that the weight value of the corresponding position of the first reference block is 100%, and the gray area indicates that the weight value of the corresponding position of the first reference block is 100%. The area indicates a weight value corresponding to the first reference block with a weight value greater than 0% and less than 100% according to the color depth, and the weight value corresponding to the second reference block is 100% minus the first The weight value of the corresponding position of a reference block.

It should be understood that there is only a rectangular division method in the early codec technology, whether it is division of CU, PU or transformation unit (Transform Unit, TU). Both GPM and AWP realize non-rectangular division, that is, a rectangular block can be divided into two partitions with a straight line. According to the position and angle of the straight line, the two partitions may be triangular, trapezoidal or rectangular, etc., thus It can make the division closer to the edge of the object or the edge of two regions with different motions. It should be noted that the division mentioned here is not a division in the true sense, but more like a division of prediction effects. Because this division only divides the weight of the two reference blocks when generating the prediction block, or it can be simply understood that part of the position of the prediction block comes from the first reference block, while the other part of the position comes from the second reference block, and The current block is not really divided into two CUs or PUs or TUs according to the dividing line. In this way, after the prediction, the transformation, quantization, inverse transformation, inverse quantization, etc. of the residual are all processed on the current block as a whole.

It should also be noted that GPM or AWP belongs to an inter-frame prediction technology. GPM or AWP needs to transmit a flag (flag) whether to use GPM or AWP in the code stream. The flag can indicate whether the current block uses GPM or AWP. If GPM or AWP is used, the encoder needs to transmit the specific mode used in the code stream, that is, one of the 64 division modes of GPM, or one of the 56 division modes of AWP; and the index value of two unidirectional motion information. That is to say, for the current block, the decoder can obtain information about whether GPM or AWP is used by parsing the code stream. If it is determined to use GPM or AWP, the decoder can parse out the prediction mode parameters of GPM or AWP and two motion information Index value, for example, the current block can be divided into two partitions, then the first motion information index value corresponding to the first partition and the second motion information index value corresponding to the second partition can be analyzed.

Before constructing a new motion information candidate list, it is first necessary to construct an initial motion information candidate list. The following takes the AWP in AVS as an example to introduce the construction method of the initial motion information candidate list.

As shown in FIG. 7 , block E is the current block, and block A, block B, block C, block D, block F, and block G are all adjacent blocks of block E. Among them, the adjacent block A of the block E is the block where the sample (x ₀ -1, y ₀ ) is located, the adjacent block B of the block E is the block where the sample (x ₀ , y ₀ -1) is located, and the adjacent block of the block E is the block where the sample (x 0 , y 0 -1) is located. The adjacent block C is the block where the sample (x ₀ +1, y ₀ -1) is located, the adjacent block D of the block E is the block where the sample (x ₀ -1, y ₀ -1) is located, and the adjacent block of the block E is F is the block where the sample (x ₀ -1, y ₁ ) is located, and the adjacent block G of the block E is the block where the sample (x ₁ , y ₀ -1) is located. where (x ₀ , y ₀ ) is the coordinates of the upper left sample of block E in the image, (x ₁ , y ₀ ) is the coordinates of the upper right sample of block E in the image, (x ₀ , y ₁ ) is the lower left of block E The coordinates of the corner samples in the image. That is to say, the spatial position relationship between block E and its adjacent blocks A, B, C, D, F and G is shown in Fig. 7 in detail.

For Fig. 7, the "existence" of adjacent block X (X is denoted as A, B, C, D, F or G) means that this block should be in the image to be decoded and this block should belong to the same spatial region as block E ; otherwise the adjacent block "does not exist". It follows that a block is "not available" if it "does not exist" or has not been decoded; otherwise it is "available". Alternatively, an image sample to be decoded is "not available" if the block in which it resides "does not exist" or the sample has not been decoded; otherwise the sample is "available".

Assume that the first unidirectional motion information is expressed as mvAwp0L0, mvAwp0L1, RefIdxAwp0L0, and RefIdxAwp0L1. Among them, mvAwp0L0 represents the corresponding motion vector in the first reference frame list RefPicList0, RefIdxAwp0L0 represents the reference index value of the corresponding reference frame in the first reference frame list RefPicList0; mvAwp0L1 represents the corresponding motion vector in the second reference frame list RefPicList1 The motion vector, RefIdxAwp0L1 represents the reference index value of the corresponding reference frame in the second reference frame list RefPicList1. The second one-way motion information and so on.

Since the motion information here is unidirectional, one of RefIdxAwp0L0 and RefIdxAwp0L1 must be a valid value, such as 0, 1, 2, etc.; the other must be an invalid value, such as -1. If RefIdxAwp0L0 is a valid value, then RefIdxAwp0L1 is -1; at this time, the corresponding mvAwp0L0 is the required motion vector, ie (x, y), and mvAwp0L1 does not need to be considered. vice versa.

Specifically, the steps for deriving mvAwp0L0, mvAwp0L1, RefIdxAwp0L0, RefIdxAwp0L1, mvAwp1L0, mvAwp1L1, RefIdxAwp1L0, and RefIdxAwp1L1 are as follows:

The first step, as shown in Figure 7, F, G, C, A, B and D are adjacent blocks of the current block E, determine the "availability" of F, G, C, A, B and D:

(a) If F exists and uses inter prediction mode, then F is "available"; otherwise F is "unavailable".

(b) G is "available" if it exists and uses inter prediction mode; otherwise, G is "unavailable".

(c) If C exists and uses inter prediction mode, then C is "available"; otherwise, C is "unavailable".

(d) If A exists and uses inter prediction mode, then A is "available"; otherwise, A is "unavailable".

(e) If B exists and uses inter prediction mode, then B is "available"; otherwise, B is "unavailable".

(f) If D exists and uses inter prediction mode, then D is "available"; otherwise, D is "unavailable".

In the second step, put the one-way available motion information into the one-way motion information candidate list (indicated by AwpUniArray) in the order of F, G, C, A, B, and D until the length of AwpUniArray is 3 (or 4) or traverse Finish.

The third step, if the length of AwpUniArray is less than 3 (or 4), in the order of F, G, C, A, B, and D, the bidirectionally available motion information is split into unidirectional motion information pointing to the reference frame list List0 and pointing to Referring to the unidirectional motion information of the frame list List1, first perform the duplication check operation of the unidirectional motion information, if not repeated, put it into AwpUniArray until the length is 3 (or 4) or the traversal ends.

The fourth step is to split the two-way motion information in the time domain into one-way motion information pointing to the reference frame list List0 and one-way motion information pointing to the reference frame list List1. Put into AwpUniArray until the length is 4 (or 5) or the traversal ends.

The fifth step, if the length of AwpUniArray is less than 4 (or 5), construct new unidirectional motion information, the specific construction method is as follows,

Take each unidirectional motion information in AwpUniArray in turn from front to back. The value corresponding to the motion information and the first reference frame list is represented by mvL0, and the value corresponding to the second reference frame list is represented by mvL1. The first The reference frame index corresponding to the reference frame list is represented by RefIdxL0, and the reference frame index corresponding to the second reference frame list is represented by RefIdxL1. Assume that the current unidirectional motion information is MI _org , the newly constructed motion information is MI _new , and the RefIdxL0 and RefIdxL1 of MI _new are the same as the RefIdxL0 and RefIdxL1 of MI _org . Suppose mvLX, if RefIdxL0 is a valid value, then mvLX is mvL0, otherwise mvLX is mvL1. The mvLX of MI _org is sequentially shifted to the right, left, down, and up by the preset offset (expressed by offset, such as 4 units, etc.) to construct the mvLX of MI _new . Specifically, assuming that the value of mvLX of MI _org is (x, y), if it is offset to the right, the value of mvLX of MI _new is (x+offset, y); if it is offset to the left, the value of mvLX of MI _new is (x-offset, y); if it is a downward offset, the value of mvLX of MI _new is (x, y+offset); if it is an upward offset, the value of mvLX of MI _new is (x, y -offset). Among them, the calculation of offset is as follows, if it is offset to the left or right, then offset=|x|/4; if it is offset upward or downward, then offset=|y|/4, if offset is greater than 16, then offset can be equal to 16; if offset is less than 4, then offset is equal to 4. At this time, if the constructed motion information does not overlap with each motion information in AwpUniArray, then add it to AwpUniArray until the length is 4 (or 5) or the traversal ends.

In the sixth step, if the length of AwpUniArray is less than 4 (or 5), then the last unidirectional motion information in AwpUniArray is repeatedly filled until the length of AwpUniArray is 4 (or 5).

The seventh step is to assign the AwpCandIdx0+1 movement information in AwpUniArray to mvAwp0L0, mvAwp0L1, RefIdxAwp0L0 and RefIdxAwp0L1, and assign the AwpCandIdx1+1 movement information in AwpUniArray to mvAwp1L0, mvAwp1L1, RefIdxAwp1L0 and RefLId.

That is to say, in the process of constructing AwpUniArray, compared with related technical solutions, a fifth step is newly added, that is, constructing new unidirectional motion information, and the newly constructed unidirectional motion information is compatible with each unidirectional motion information in AwpUniArray Motion information is not repeated, so it can be filled into AwpUniArray until the length is 4 (or 5) or the traversal ends.

In this way, two unidirectional motion information can be found in the newly constructed motion information candidate list according to the parsed two motion information index values, and then two reference blocks can be found by using the two unidirectional motion information, according to The specific prediction mode used by GPM or AWP can determine the weight of two reference blocks at each pixel position, and finally calculate the weight of the two reference blocks to obtain the prediction block of the current block.

Further, if the current mode is a skip mode, then the predicted block is a decoded block, which means that the decoding of the current block ends. If the current mode is not skip mode, entropy decoding analyzes the quantized coefficients, then inverse quantization and inverse transformation to obtain the residual block, and finally adds the residual block to the prediction block to obtain the decoded block, which means that the decoding of the current block is over.

In the embodiment of the present application, some new motion information is constructed and added to the motion information candidate list. The new motion information is constructed according to the existing motion information, and the new motion information can be obtained by offsetting the existing motion information based on the setting method of the preset offset. When the construction of the existing initial motion information candidate list cannot fill the candidate list with non-repetitive motion information, the candidate list may be filled with newly constructed motion information at this time. That is to say, by using the inter-frame prediction method of the embodiment of the present application to construct a new unidirectional motion vector and fill it into the motion information candidate list, the motion vectors in the motion vector candidate list can be made more diverse. Moreover, in view of the deformation of objects, constructing new motion information will play a certain role. Moreover, since the current block may be biased based on spatial motion information, temporal motion information, or historical motion information, constructing new unidirectional motion information may have a better effect than the original motion information. Especially when the candidate list cannot be filled with the motion information obtained according to the spatial domain information, the time domain information or the historical information, the advantages of the embodiments of the present application will be more obvious.

It should also be noted that the motion information candidate list in the embodiment of the present application generally refers to the unidirectional motion information candidate list, but the construction method of the unidirectional motion information in the embodiment of the present application can be extended to the construction of the bidirectional motion information, so that the unidirectional motion The construction of information candidate list can also be extended to the construction of two-way motion information candidate list.

This embodiment provides an inter-frame prediction method, which is applied to a decoder. Parsing the code stream to obtain the prediction mode parameter of the current block; when the prediction mode parameter indicates that the preset inter prediction mode is used to determine the inter prediction value of the current block, from a plurality of known motion information of the current block Determine at least one unidirectional motion information; perform offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information; wherein the preset offset is based on the preset offset The horizontal direction vector value and the vertical direction vector value corresponding to the at least one unidirectional motion information are calculated; based on the at least one new unidirectional motion information, a new motion information candidate list is constructed; according to the new motion information candidate list , to determine the inter-frame prediction value of the current block. In this way, after obtaining at least one new unidirectional motion information, the new unidirectional motion information can be filled in the motion information candidate list, which can increase the diversity of motion information in the motion information candidate list; in addition, for the current block , the initial motion information in the motion information candidate list may deviate from the actual motion information. At this time, constructing new unidirectional motion information will have a better effect than the initial motion information, thereby improving the encoding and decoding performance.

An embodiment of the present application provides an inter-frame prediction method, which is applied to a video encoding device, that is, an encoder. The functions realized by the method can be realized by calling the computer program by the second processor in the encoder, and of course the computer program can be stored in the second memory. It can be seen that the encoder includes at least the second processor and the second memory.

Referring to FIG. 8 , it shows a schematic flowchart of another inter-frame prediction method according to an embodiment of the present application. As shown in Figure 8, the method may include:

S801: Determine the prediction mode parameter of the current block;

It should be noted that the image to be encoded can be divided into multiple image blocks, the image block currently to be encoded can be called the current block, and the image blocks adjacent to the current block can be called adjacent blocks; that is, in the image to be encoded, There is an adjacency relationship between the current block and the adjacent blocks. Here, each current block may include a first image component, a second image component, and a third image component; that is, the current block is the first image component, the second image component, or the third image component to be predicted in the image to be encoded. image blocks.

Wherein, assuming that the current block performs the first image component prediction, and the first image component is a brightness component, that is, the image component to be predicted is a brightness component, then the current block may also be called a brightness block; or, it is assumed that the current block performs the second image component prediction, and the second image component is a chroma component, that is, the image component to be predicted is a chroma component, then the current block may also be called a chroma block.

It should also be noted that the prediction mode parameter indicates the prediction mode adopted by the current block and parameters related to the prediction mode. Here, for the determination of the prediction mode parameters, a simple decision-making strategy can be adopted, such as determining according to the magnitude of the distortion value; a complex decision-making strategy can also be adopted, such as determining according to the result of Rate Distortion Optimization (RDO). The application examples do not make any limitation. Generally speaking, the RDO method can be used to determine the prediction mode parameter of the current block.

Specifically, in some embodiments, for S801, the determining the prediction mode parameter of the current block may include:

Precoding the current block by using multiple prediction modes to obtain a rate-distortion cost value corresponding to each prediction mode;

Select the minimum rate-distortion cost value from the obtained multiple rate-distortion cost values, and determine the prediction mode corresponding to the minimum rate-distortion cost value as the prediction mode parameter of the current block.

That is to say, at the encoder side, multiple prediction modes may be used for the current block to respectively perform precoding processing on the current block. Here, multiple prediction modes usually include inter-frame prediction mode, traditional intra-frame prediction mode and non-traditional intra-frame prediction mode; wherein, the traditional intra-frame prediction mode may include direct current (Direct Current, DC) mode, planar (PLANAR) mode and angle mode, etc., non-traditional intra prediction modes can include matrix-based intra prediction (Matrix-based Intra Prediction, MIP) mode, cross-component linear model prediction (Cross-component Linear Model Prediction, CCLM) mode, intra Intra Block Copy (Intra Block Copy, IBC) mode and PLT (Palette) mode, etc., and the inter-frame prediction mode may include common inter-frame prediction mode, GPM prediction mode and AWP prediction mode, etc.

In this way, after precoding the current block using multiple prediction modes, the rate-distortion cost value corresponding to each prediction mode can be obtained; and then the minimum rate-distortion cost value is selected from the obtained multiple rate-distortion cost values, And the prediction mode corresponding to the minimum rate-distortion cost value is determined as the prediction mode parameter of the current block. In addition, after precoding the current block using multiple prediction modes, the distortion value corresponding to each prediction mode can be obtained; then the minimum distortion value is selected from the obtained multiple distortion values, and the The prediction mode corresponding to the minimum distortion value is determined as the prediction mode parameter of the current block. In this way, the current block is finally coded using the determined prediction mode parameters, and in this prediction mode, the prediction residual can be made smaller, and the coding efficiency can be improved.

S802: When the prediction mode parameter indicates that a preset inter-frame prediction mode is used to determine an inter-prediction value of the current block, determine at least one piece of unidirectional motion information from a plurality of pieces of known motion information of the current block.

It should be noted that if the prediction mode parameter indicates that a preset inter-frame prediction mode is used to determine the inter-frame prediction value of the current block, the inter-frame prediction method provided in the embodiment of the present application may be used. Here, the preset inter-frame prediction mode may be a GPM prediction mode or an AWP prediction mode or the like.

It should also be noted that the motion information may include motion vector (Motion Vector, MV) information and reference frame information. In addition, the reference frame information may jointly determine the corresponding reference frame by the reference frame list and the reference index value.

In some embodiments, the plurality of known motion information of the current block may at least include: motion information in the initial motion information candidate list, and/or, spatial domain motion information of the current block, and/or, the current block Time-domain motion information of the current block, and/or, historical motion information of the current block.

Here, for the initial motion information candidate list, in some embodiments, the method may further include: determining the initial motion information candidate list based on the motion information of adjacent blocks of the current block.

It should be noted that there is at least one unidirectional motion information in the initial motion information candidate list; when the initial motion information candidate list does not include repeated unidirectional motion information and the number of unidirectional motion information in the initial motion information candidate list is less than When the number is large, the motion information can be selected from the initial motion information candidate list to obtain at least one unidirectional motion information; or, the motion information can also be obtained from the encoded part, such as from the spatial motion information of the current block and/or the current block. The motion information is acquired from time-domain motion information and/or historical motion information of the current block to obtain at least one piece of unidirectional motion information.

It should also be noted that since the known motion information of the current block may be one-way motion information or two-way motion information, it needs to be judged. Specifically, in some embodiments, the method may also include:

If motion information is selected from the initial motion information candidate list, then determining that the selected motion information is unidirectional motion information;

If motion information is selected from the spatial motion information of the current block and/or the temporal motion information of the current block and/or the historical motion information of the current block, then judging whether the selected motion information is bidirectional motion information;

When the selected motion information is bidirectional motion information, the selected motion information is split into two unidirectional motion information, so as to determine at least one unidirectional motion information from a plurality of known motion information of the current block. step.

That is to say, when at least one unidirectional motion information is determined, if the motion information is selected from the initial motion information candidate list, the selected motion information is unidirectional motion information. If it is based on spatial information, time domain information, historical motion information, etc., then it is necessary to determine whether the selected motion information is one-way; if the motion information is two-way motion information, that is, the reference index values of the two reference frame lists are valid. value, at this time it needs to be split into two one-way motion information to be processed separately.

It should be understood that the construction of new unidirectional motion information mainly involves the determination of at least one unidirectional motion information. Several possible implementations will be provided below to illustrate how to determine at least one piece of unidirectional motion information.

In a possible implementation manner, for S802, the determining at least one unidirectional motion information from multiple known motion information of the current block may include:

Selecting at least one initial unidirectional motion information from a plurality of known motion information of the current block;

determining a candidate reference frame, and scaling the selected at least one initial unidirectional motion information to the candidate reference frame to obtain at least one scaled unidirectional motion information;

The at least one scaled unidirectional motion information is determined as the at least one unidirectional motion information, and the reference frame information corresponding to the at least one unidirectional motion information is the candidate reference frame.

It should be noted that, taking a unidirectional motion information as an example, after arbitrarily selecting an initial unidirectional motion information from multiple known motion information of the current block, a candidate reference frame is first selected, and then the initial unidirectional motion information The motion information is scaled to the candidate reference frame. At this time, the determined one-way motion information is the scaled one-way motion information, and the corresponding reference frame information is the candidate reference frame; in this case, according to this one-way At least one new unidirectional motion information is obtained by offsetting the directional motion information, and the reference frame information corresponding to the at least one new unidirectional motion information is also a candidate reference frame.

Here, the candidate reference frame is an arbitrarily selected reference frame in advance.

In another possible implementation manner, for S802, the determining at least one unidirectional motion information from multiple pieces of known motion information of the current block may include:

determining candidate reference frames;

Selecting the at least one unidirectional motion information from multiple pieces of known motion information of the current block, and the reference frame information corresponding to the at least one unidirectional motion information is the candidate reference frame.

It should be noted that, still taking a unidirectional motion information as an example, a candidate reference frame can be selected first, and then the reference frame information can be directly selected from multiple known motion information of the current block as the initial unidirectional motion of the candidate reference frame Information, the one-way motion information determined at this time is the selected one-way motion information, and the corresponding reference frame information is the candidate reference frame; in this case, according to this one-way motion information through the offset method At least one new unidirectional motion information is obtained, and the reference frame information corresponding to the at least one new unidirectional motion information is also a candidate reference frame.

In addition, the embodiment of the present application can also directly select an initial unidirectional motion information from a plurality of known motion information of the current block. At this time, there is no need to determine a candidate reference frame, but at least one new unidirectional motion information constructed subsequently The reference frame information corresponding to the motion information is the same as the reference frame information corresponding to the selected initial unidirectional motion information.

In this way, after at least one piece of unidirectional motion information is determined, at least one new piece of unidirectional motion information can be subsequently constructed in an offset manner.

S803: Perform offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information.

It should be noted that after at least one unidirectional motion information is obtained, offset processing can be performed on it to obtain at least one new unidirectional motion information; and each unidirectional motion information can be constructed according to the difference of offset information Generate one or more new unidirectional motion messages. Here, the preset offset may be calculated according to the horizontal direction vector value and the vertical direction vector value corresponding to the at least one piece of unidirectional motion information.

In some embodiments, for S803, performing offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information may include:

Based on at least one preset direction, perform offset processing on the at least one unidirectional motion information according to a preset offset to obtain the at least one new unidirectional motion information; wherein, the at least one new unidirectional motion information The information is the same as the reference frame information corresponding to the at least one piece of unidirectional motion information.

It should be noted that the preset direction may at least include: an upward direction, and/or, a downward direction, and/or, a leftward direction, and/or, a rightward direction; If the offset is used to offset at least one unidirectional motion information, different new unidirectional motion information can be obtained.

Generally speaking, new unidirectional motion information can be constructed according to the known motion information of the current block and added to the motion information candidate list. When there is motion information in the motion information candidate list, it can be constructed according to the motion information in the motion information candidate list; or it can be constructed according to the motion information obtained through the encoded part, such as according to spatial information, time domain information, history The motion information (that is, the motion information obtained based on the historical information) etc. is constructed to obtain at least one new unidirectional motion information. That is, an existing MV can be offset to obtain a new MV. Assume that the value of the existing MV is (x,y). The preset offset in the horizontal direction is represented by offsetx, and the preset offset in the vertical direction is represented by offsety, so the value of the new MV is (x+offsetx, y+offsety).

In a possible implementation manner, the existing MVs are respectively shifted upward, downward, leftward, and rightward to obtain different MVs. If an upward offset is performed for the existing MV, the absolute value of the preset offset is offset, then the constructed new MV is (x, y-offset); if a downward offset is performed for the existing MV, the preset The absolute value of the offset is offset, then the constructed new MV is (x, y+offset); if the existing MV is shifted to the left, the absolute value of the preset offset is offset, then the constructed The new MV is (x-offset, y); if the existing MV is shifted to the right, the absolute value of the default offset is offset, then the constructed new MV is (x+offset, y) .

In another possible implementation manner, the known motion information is scaled to a reference frame different from the reference frame corresponding to the motion information, and then the MV is shifted to obtain new unidirectional motion information.

It should be noted that the embodiment of the present application is mainly applicable to unidirectional motion information, but is also applicable to bidirectional motion information. If the motion information is bidirectional, the MV offset directions in the two directions can be the same or opposite; the preset offsets can be determined separately or jointly.

It should also be noted that the preset offset may be a preset fixed value, or the preset offset may be obtained according to a preset algorithm, which is not specifically limited in this embodiment of the present application.

Here, for the preset offset, the following several implementation manners may be used to determine it.

In a possible implementation manner, the preset offset may be a preset fixed value, such as a fixed value of 1, 2, 3, 4, 5, 6, 7, 8, and the like.

In another possible implementation manner, the method may also include:

For the at least one unidirectional motion information, determine a horizontal direction vector value and a vertical direction vector value corresponding to each unidirectional motion information;

When the preset direction is an upward direction and/or a downward direction, it is judged whether the value of the vertical direction vector is equal to 0;

When the vector value in the vertical direction is not equal to 0, according to the division operation between the absolute value of the vector value in the vertical direction and the first preset value, the preset offset corresponding to each unidirectional motion information is obtained;

or,

When the preset direction is a leftward direction and/or a rightward direction, determine whether the horizontal direction vector value is equal to 0;

When the horizontal direction vector value is not equal to 0, the preset offset corresponding to each unidirectional motion information is obtained according to the division operation between the absolute value of the horizontal direction vector value and the second preset value.

It should be noted that the preset offset may be related to (x, y) of the existing MV used to construct the new MV. Among them, x represents the vector value in the horizontal direction, and y represents the vector value in the vertical direction. Here, for the specific implementation manner, refer to the description on the decoder side.

In yet another possible implementation manner, the method may also include:

For any preset direction, the absolute value of the vector value in the horizontal direction and the absolute value of the vector value in the vertical direction are added to obtain a calculation sum;

Judging whether the calculated sum value is equal to 0;

When the calculated sum value is not equal to 0, a preset offset corresponding to each unidirectional motion information is obtained according to a division operation between the calculated sum value and a third preset value.

It should be noted that, for any preset direction, the preset offset may be related to |x|+|y| of the existing MV used to construct the new MV. Among them, x represents the vector value in the horizontal direction, and y represents the vector value in the vertical direction. Here, for the specific implementation manner, refer to the description on the decoder side.

In yet another possible implementation manner, the method may also include:

For each unidirectional motion information, comparing the obtained preset offset with the minimum preset offset and the maximum preset offset respectively;

When the obtained preset offset is less than the minimum preset offset, determining the minimum preset offset as the preset offset;

When the obtained preset offset is greater than the minimum preset offset, the maximum preset offset is determined as the preset offset.

That is to say, the size of the preset offset (represented by offset) may conform to a certain preset value range, for example, between the minimum preset offset (represented by offset _min ) and the maximum preset offset (represented by offset _max indicates the range between), that is, offset needs to be greater than or equal to offset _min , and offset needs to be less than or equal to offset _max . If the offset calculated according to the above implementation manner is smaller than offset _min , then set offset to offset _min ; if the offset calculated according to the above implementation manner is greater than offset _max , then set offset to offset _max . Here, offset _max and offset _max may be some preset fixed values, but this embodiment of the present application does not limit it.

In this way, one or more pieces of one-way motion information can be constructed through the above several possible implementation manners. Then fill the constructed unidirectional motion information into the initial motion information candidate list to obtain a new motion information candidate list.

S804: Based on the at least one piece of new unidirectional motion information, construct a new motion information candidate list.

It should be noted that after obtaining at least one piece of new unidirectional motion information, it may be filled into the initial motion information candidate list to obtain a new motion information candidate list. Specifically, for S804, this step may include: filling at least one piece of new unidirectional motion information into the initial motion information candidate list to obtain the new motion information candidate list.

It should also be noted that only when the obtained new unidirectional motion information does not overlap with the original unidirectional motion information included in the initial motion information candidate list, can it be filled into the candidate list. In some embodiments, the filling the at least one new unidirectional motion information into the initial motion information candidate list may include:

judging whether at least one new unidirectional motion information is duplicated with the motion information in the initial motion information candidate list;

If the at least one new unidirectional motion information does not overlap with the motion information in the initial motion information candidate list, filling the at least one new unidirectional motion information into the initial motion information candidate list .

In this way, in the construction method of the initial motion information candidate list, if the non-repetitive unidirectional motion information cannot fill the candidate list, the last unidirectional motion information in the candidate list is usually used to repeatedly fill the candidate list to fill the candidate list. However, in the embodiment of the present application, when there is no repeated unidirectional motion information and the candidate list cannot be filled, at this time, new unidirectional motion information can be constructed to fill the candidate list by constructing new unidirectional motion information; That is, the newly constructed one-way motion information can be filled into the candidate list only when it does not overlap with the original one-way motion information in the candidate list.

In other words, in the inter-frame prediction method of the embodiment of the present application, the initial motion information candidate list does not include repeated unidirectional motion information and the number of unidirectional motion information in the initial motion information candidate list is less than the preset number (that is, the initial motion information Candidate list is not filled). Therefore, in some embodiments, the method may also include:

When the initial motion information candidate list does not include repeated unidirectional motion information and the number of unidirectional motion information in the initial motion information candidate list is less than a preset number, performing the multiple known from the current block Steps of determining at least one unidirectional motion information in the motion information; and performing motion vector calculation on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information.

It should be noted that, in the process of constructing the motion information candidate list, for at least one new unidirectional motion information, it mainly involves how to determine at least one unidirectional motion information from known motion information of the current block. For example, for the existing initial motion information candidate list, one motion information can be arbitrarily selected from the candidate list, such as the first motion information or the last motion information; it can also be sequentially selected from the candidate list, etc. . That is, in some embodiments, the method may also include:

Randomly select one piece of motion information from the initial motion information candidate list, and obtain the at least one new unidirectional motion information according to the offset processing of the one motion information; or,

Sequentially select at least one piece of motion information from the initial motion information candidate list, and obtain the at least one new unidirectional motion information according to offset processing of the at least one piece of motion information; or,

Sequentially select at least one piece of motion information from the spatial domain motion information of the current block and/or the time domain motion information of the current block and/or the historical motion information of the current block, according to the offset of the at least one motion information Processing, obtaining the at least one new unidirectional motion information.

In this way, motion information for constructing new unidirectional motion information can be selected from an existing initial motion information candidate list. One way is to use only one motion information in the initial motion information candidate list, such as the first motion information in the initial motion information candidate list, or the last motion information in the initial motion information candidate list; another way is The motion information in the initial motion information candidate list is sequentially used to construct new motion information; the end condition is that the initial motion information candidate list is filled or the traversal ends to obtain a new motion information candidate list.

In addition, the embodiment of the present application may also select the motion information according to the relative relationship with the current block. One way is to use only the motion information of a certain relative position, such as the motion information of a certain position in F, G, C, A, B, and D, or the motion information in the time domain as described above; the other The way is to set an order for these relative relationships, if the motion information of the previous relative relationship is not available, then select the next available motion information; another way is to set an order for these relative relationships, and use the motion of the relative relationship in order information to construct new motion information; the end condition is that the initial motion information candidate list is filled or the traversal ends to obtain a new motion information candidate list.

S805: Determine an inter-prediction value of the current block according to the new motion information candidate list.

It should be noted that when the prediction mode parameter indicates that GPM or AWP is used to determine the inter-frame prediction value of the current block, two partitions of the current block can be determined at this time; where the two partitions can include the first partition and the second partition .

In this way, after obtaining the new motion information candidate list, the motion information corresponding to the first partition of the current block and the motion information of the second partition can be determined; and then according to the motion information corresponding to the first partition and the second partition The motion information of the current block can be determined to determine the inter frame prediction value.

Specifically, in some embodiments, for S805, the determining the inter-prediction value of the current block according to the new motion information candidate list may include:

Based on the new motion information candidate list, determine the motion information of the first partition and the motion information of the second partition, and set the first motion information index value as the motion information of the first partition in the The index number value in the new motion information candidate list, setting the second motion information index value as the index number value of the motion information of the second partition in the new motion information candidate list;

calculating a first predicted value of the first partition by using the motion information of the first partition, and calculating a second predicted value of the second partition by using the motion information of the second partition;

performing weighted fusion on the first predicted value and the second predicted value to obtain an inter-frame predicted value of the current block.

Further, in some embodiments, the method may also include:

Writing the first motion information index value and the second motion information index value into a code stream.

It should be noted that GPM or AWP belongs to an inter-frame prediction technology. On the encoder side, GPM or AWP needs to transmit a flag (flag) whether to use GPM or AWP and two motion information index values (such as The first motion information index value and the second motion information index value), so that the subsequent decoder side can directly obtain the flag of whether GPM or AWP is used and the two motion information index values by parsing the code stream.

That is to say, for the current block, you can try to use GPM or AWP for precoding and other available prediction modes for precoding to determine whether to use GPM or AWP. GPM or AWP can be used if the precoding cost of GPM or AWP is minimal. At the same time, when trying to use GPM or AWP, a motion information candidate list can also be constructed, and the construction method is the same as that described in the embodiment on the decoder side.

In this way, on the encoder side, two unidirectional motion information are selected from the motion information candidate list, and then one mode is selected from the GPM or AWP prediction mode for precoding to determine the GPM or AWP precoding cost. One possible way is to determine the cost of all possible combinations of unidirectional motion information candidates based on all possible GPM or AWP prediction modes, and then replace the two unidirectional motion information and GPM or AWP prediction modes with the smallest cost The combination of two unidirectional motion information and GPM or AWP prediction mode finally determined.

Finally, write the information whether GPM or AWP is used in the code stream. If it is determined to use GPM or AWP, write the prediction mode parameter of GPM or AWP and two unidirectional motion information index values in the code stream. In this way, if the current mode is the skip mode, then the prediction block is both a coding block, which means that the coding of the current block is completed. If the current mode is not skip mode, it is also necessary to write the quantization coefficient in the code stream; wherein, the quantization coefficient is a residual block composed of the residual obtained by subtracting the inter-frame prediction value from the actual value of the current block, and the residual The difference block is transformed and quantized, and the coding of the current block ends at this time.

That is to say, no matter the encoder or the decoder, use the two unidirectional motion information determined by the new motion information candidate list to find two reference blocks, and determine the two reference blocks according to the specific mode used by GPM or AWP in each The weight of the pixel position, and weight the two reference blocks to obtain the prediction block of the current block. The processing after the prediction block is obtained is the same as that of the related technical solutions. Specifically, on the encoder side, if the current mode is the skip mode, the encoding of the current block ends; if the current mode is not the skip mode, the current block is subtracted from the prediction block to obtain a residual block, and the residual block is transformed , quantization, entropy coding, etc.; on the decoder side, if the current mode is skip mode, the predicted block is the decoded block, and the decoding of the current block ends; if the current mode is not skip mode, entropy decoding analyzes the quantized coefficients, and then inversely The residual block is obtained by quantization and inverse transformation, and the residual block is added to the predicted block to obtain a decoded block. At this time, the encoding of the current block ends.

It should also be noted that the motion information candidate list in the embodiment of the present application generally refers to the unidirectional motion information candidate list, but the construction method of the unidirectional motion information in the embodiment of the present application can be extended to the construction of the bidirectional motion information, so that the unidirectional motion The construction of information candidate list can also be extended to the construction of two-way motion information candidate list.

This embodiment provides an inter-frame prediction method, which is applied to an encoder. Determine the prediction mode parameter of the current block; when the prediction mode parameter indicates that the inter-frame prediction value of the current block is determined using a preset inter-frame prediction mode, determine at least one unit from a plurality of known motion information of the current block One-way motion information; performing offset processing on the at least one one-way motion information based on a preset offset to obtain at least one new one-way motion information; wherein, the preset offset is based on the at least one one-way motion information The vector value in the horizontal direction and the vector value in the vertical direction corresponding to the motion information are calculated; based on the at least one new unidirectional motion information, a new motion information candidate list is constructed; according to the new motion information candidate list, the The inter predictor of the current block. In this way, after obtaining at least one new unidirectional motion information, the new unidirectional motion information can be filled in the motion information candidate list, which can increase the diversity of motion information in the motion information candidate list; in addition, for the current block , the initial motion information in the motion information candidate list may deviate from the actual motion information. At this time, constructing new unidirectional motion information will have a better effect than the initial motion information, thereby improving the encoding and decoding performance.

Based on the same inventive concept as the foregoing embodiments, refer to FIG. 9 , which shows a schematic structural diagram of a decoder 90 provided by an embodiment of the present application. As shown in FIG. 9, the decoder 90 may include: an analysis unit 901, a first determination unit 902, a first offset unit 903, a first construction unit 904, and a first prediction unit 905; wherein,

The parsing unit 901 is configured to parse the code stream to acquire the prediction mode parameters of the current block;

The first determining unit 902 is configured to determine at least one unit from a plurality of known motion information of the current block when the prediction mode parameter indicates that a preset inter-frame prediction mode is used to determine the inter-frame prediction value of the current block Sports information;

The first offset unit 903 is configured to perform offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information; wherein the preset offset is based on The horizontal direction vector value and the vertical direction vector value corresponding to the at least one unidirectional motion information are calculated;

The first construction unit 904 is configured to construct a new motion information candidate list based on the at least one new unidirectional motion information;

The first prediction unit 905 is configured to determine an inter-frame prediction value of the current block according to the new motion information candidate list.

In some embodiments, the motion information includes motion vector information and reference frame information.

In some embodiments, referring to FIG. 9, the decoder 90 may further include a first selection unit 906 and a first scaling unit 907; wherein,

The first selection unit 906 is configured to select at least one initial unidirectional motion information from a plurality of known motion information of the current block;

The first scaling unit 907 is configured to determine a candidate reference frame, and scale the selected at least one initial unidirectional motion information to the candidate reference frame to obtain at least one scaled unidirectional motion information;

The first determining unit 902 is further configured to determine the at least one scaled unidirectional motion information as the at least one unidirectional motion information, and the reference frame information corresponding to the at least one unidirectional motion information is the Candidate frame of reference.

In some embodiments, the first selection unit 906 is further configured to determine a candidate reference frame; select the at least one unidirectional motion information from a plurality of known motion information of the current block, and the at least one unidirectional The reference frame information corresponding to the motion information is the candidate reference frame.

In some embodiments, the first offset unit 903 is configured to perform offset processing on the at least one unidirectional motion information according to a preset offset amount based on at least one preset direction to obtain the at least one new unidirectional motion information. directional motion information; wherein, the at least one new unidirectional motion information is the same as the reference frame information corresponding to the at least one unidirectional motion information.

In some embodiments, the preset direction at least includes: an upward direction, and/or a downward direction, and/or a leftward direction, and/or a rightward direction.

In some embodiments, the first determining unit 902 is further configured to, for the at least one unidirectional motion information, determine a horizontal direction vector value and a vertical direction vector value corresponding to each unidirectional motion information;

The first offset unit 903 is further configured to judge whether the vector value of the vertical direction is equal to 0 when the preset direction is an upward direction and/or a downward direction; when the vector value of the vertical direction is not equal to 0 , according to the division operation between the absolute value of the vector value in the vertical direction and the first preset value, the preset offset corresponding to each unidirectional motion information is obtained; or, the preset direction is the left direction and /or in the case of the rightward direction, judge whether the vector value of the horizontal direction is equal to 0; when the vector value of the horizontal direction is not equal to 0, according to the division of the absolute value of the vector value of the horizontal direction and the second preset value operation to obtain the preset offset corresponding to each unidirectional motion information.

In some embodiments, the first offset unit 903 is further configured to add the absolute value of the vector value in the horizontal direction and the absolute value of the vector value in the vertical direction for any preset direction to obtain the calculated sum value; judging whether the calculation sum value is equal to 0; when the calculation sum value is not equal to 0, according to the division operation of the calculation sum value and the third preset value, the corresponding prediction value of each unidirectional motion information is obtained Set the offset.

In some embodiments, the first offset unit 903 is further configured to compare the obtained preset offset with the minimum preset offset and the maximum preset offset for each piece of unidirectional motion information; When the obtained preset offset is less than the minimum preset offset, the minimum preset offset is determined as the preset offset; when the obtained preset offset is greater than the minimum preset When the offset is specified, the maximum preset offset is determined as the preset offset.

In some embodiments, the first determining unit 902 is further configured to determine an initial motion information candidate list based on the motion information of adjacent blocks of the current block;

The first constructing unit 904 is configured to fill the at least one new unidirectional motion information into the initial motion information candidate list to obtain the new motion information candidate list.

In some embodiments, the first constructing unit 904 is further configured to judge whether the at least one new unidirectional motion information is duplicated with the motion information in the initial motion information candidate list; If the motion information does not overlap with the motion information in the initial motion information candidate list, filling the at least one new unidirectional motion information into the initial motion information candidate list.

In some embodiments, the first construction unit 904 is further configured to include no repeated unidirectional motion information in the initial motion information candidate list and the number of unidirectional motion information in the initial motion information candidate list is less than a preset number , performing the determining at least one unidirectional motion information from multiple known motion information of the current block; and performing offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one Steps for new unidirectional motion information.

In some embodiments, the multiple pieces of known motion information of the current block include at least: motion information in the initial motion information candidate list, and/or, spatial domain motion information of the current block, and/or, the Time-domain motion information of the current block, and/or historical motion information of the current block.

In some embodiments, the first offset unit 903 is further configured to arbitrarily select one piece of motion information from the initial motion information candidate list, and obtain the at least one new unit according to the offset processing of the one piece of motion information. direction motion information; or, sequentially select at least one motion information from the initial motion information candidate list, and obtain the at least one new unidirectional motion information according to the offset processing of the at least one motion information; or, from the Sequentially select at least one piece of motion information in the spatial domain motion information of the current block and/or the time domain motion information of the current block and/or the historical motion information of the current block, and according to the offset processing of the at least one motion information, The at least one new unidirectional motion information is obtained.

In some embodiments, the preset inter-frame prediction modes include: a geometric partition prediction mode GPM or an angle weighted prediction mode AWP.

In some embodiments, the first determining unit 902 is further configured to determine two partitions of the current block when the prediction mode parameter indicates that GPM or AWP is used to determine the inter-frame prediction value of the current block; wherein, the The two partitions include a first partition and a second partition;

The analysis unit 901 is further configured to analyze the code stream, and determine the first motion information index value corresponding to the first partition and the second motion information index value corresponding to the second partition;

The first determining unit 902 is further configured to determine, based on the new motion information candidate list, the motion information in the new motion information candidate list indicated by the first motion information index value as the motion information of the first partition Motion information, determining the motion information in the new motion information candidate list indicated by the second motion information index value as the motion information of the second partition;

The first prediction unit 905 is configured to use the motion information of the first partition to calculate a first prediction value of the first partition, and use the motion information of the second partition to calculate a second prediction value of the second partition; performing weighted fusion on the first predicted value and the second predicted value to obtain an inter-frame predicted value of the current block.

It can be understood that in the embodiments of the present application, a "unit" may be a part of a circuit, a part of a processor, a part of a program or software, etc., of course it may also be a module, or it may be non-modular. Moreover, each component in this embodiment may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software function modules.

If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment is essentially or It is said that the part that contributes to the prior art or the whole or part of the technical solution can be embodied in the form of a software product, the computer software product is stored in a storage medium, and includes several instructions to make a computer device (which can It is a personal computer, a server, or a network device, etc.) or a processor (processor) that executes all or part of the steps of the method described in this embodiment. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (Read Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk, and other media capable of storing program codes.

Therefore, the embodiment of the present application provides a computer storage medium, which is applied to the decoder 90. The computer storage medium stores an inter-frame prediction program. When the inter-frame prediction program is executed by the first processor, the decoding in the foregoing embodiments is implemented. method described on the device side.

Based on the above-mentioned composition of the decoder 90 and the computer storage medium, refer to FIG. 10 , which shows an example of a specific hardware structure of the decoder 90 provided in the embodiment of the present application, which may include: a first communication interface 1001, a first memory 1002 and a second A processor 1003; each component is coupled together through the first bus system 1004. It can be understood that the first bus system 1004 is used to realize connection and communication between these components. The first bus system 1004 includes not only a data bus, but also a power bus, a control bus and a status signal bus. However, for clarity of illustration, the various buses are labeled as first bus system 1004 in FIG. 10 . in,

The first communication interface 1001 is used for receiving and sending signals during the process of sending and receiving information with other external network elements;

The first memory 1002 is used to store computer programs that can run on the first processor 1003;

The first processor 1003 is configured to, when running the computer program, execute:

Parse the code stream to obtain the prediction mode parameters of the current block;

When the prediction mode parameter indicates that a preset inter prediction mode is used to determine an inter prediction value of the current block, at least one unidirectional motion information is determined from a plurality of known motion information of the current block;

Perform offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information; wherein the preset offset corresponds to the at least one unidirectional motion information The horizontal direction vector value and the vertical direction vector value are calculated;

Constructing a new motion information candidate list based on the at least one new unidirectional motion information;

Determine an inter-frame prediction value of the current block according to the new motion information candidate list.

It can be understood that the first memory 1002 in the embodiment of the present application may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memories. Wherein, the non-volatile memory may be a read-only memory (Read-Only Memory, ROM), a programmable read-only memory (Programmable ROM, PROM), an erasable programmable read-only memory (Erasable PROM, EPROM), an electronically programmable Erase Programmable Read-Only Memory (Electrically EPROM, EEPROM) or Flash. The volatile memory can be Random Access Memory (RAM), which acts as an external cache. By way of illustration and not limitation, many forms of RAM are available such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double DataRate SDRAM, DDRSDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous connection dynamic random access memory (Synchlink DRAM, SLDRAM) and Direct Memory Bus Random Access Memory (Direct Rambus RAM, DRRAM). The first memory 1002 of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

The first processor 1003 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method may be completed by an integrated logic circuit of hardware in the first processor 1003 or an instruction in the form of software. The above-mentioned first processor 1003 may be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), an off-the-shelf programmable gate array (Field Programmable Gate Array, FPGA) or Other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. Various methods, steps, and logic block diagrams disclosed in the embodiments of the present application may be implemented or executed. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, register. The storage medium is located in the first memory 1002, and the first processor 1003 reads the information in the first memory 1002, and completes the steps of the above method in combination with its hardware.

It should be understood that the embodiments described in this application may be implemented by hardware, software, firmware, middleware, microcode or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application specific integrated circuits (Application Specific Integrated Circuits, ASIC), digital signal processor (Digital Signal Processing, DSP), digital signal processing device (DSP Device, DSPD), programmable logic Device (Programmable Logic Device, PLD), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), general-purpose processor, controller, microcontroller, microprocessor, other electronic units for performing the functions described in this application or a combination thereof. For software implementation, the techniques described herein can be implemented through modules (eg, procedures, functions, and so on) that perform the functions described herein. Software codes can be stored in memory and executed by a processor. Memory can be implemented within the processor or external to the processor.

Optionally, as another embodiment, the first processor 1003 is further configured to execute the method described in any one of the foregoing embodiments when running the computer program.

This embodiment provides a decoder, and the decoder may include an analysis unit, a first determination unit, a first offset unit, a first construction unit, and a first prediction unit. In the decoder, after obtaining at least one new unidirectional motion information, the new unidirectional motion information can be filled in the motion information candidate list, which can increase the diversity of motion information in the motion information candidate list; in addition, for For the current block, there may be a deviation between the initial motion information in the motion information candidate list and the actual motion information. At this time, constructing new unidirectional motion information will have a better effect than the initial motion information, thereby improving the encoding and decoding performance.

Based on the same inventive concept as the foregoing embodiments, refer to FIG. 11 , which shows a schematic structural diagram of an encoder 110 provided by an embodiment of the present application. As shown in Figure 11, the encoder 110 may include: a second determination unit 1101, a second offset unit 1102, a second construction unit 1103, and a second prediction unit 1104; wherein,

The second determining unit 1101 is configured to determine the prediction mode parameter of the current block;

The second determination unit 1101 is further configured to determine at least one of the known motion information of the current block when the prediction mode parameter indicates that the inter prediction value of the current block is determined using a preset inter prediction mode. One-way motion information;

The second offset unit 1102 is configured to perform offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information; wherein the preset offset is based on The horizontal direction vector value and the vertical direction vector value corresponding to the at least one unidirectional motion information are calculated;

The second construction unit 1103 is configured to construct a new motion information candidate list based on the at least one new unidirectional motion information;

The second prediction unit 1104 is configured to determine an inter-frame prediction value of the current block according to the new motion information candidate list.

In some embodiments, the motion information includes motion vector information and reference frame information.

In some embodiments, referring to FIG. 11 , the encoder 110 may further include a precoding unit 1105 and a second selection unit 1106; wherein,

The precoding unit 1105 is configured to use multiple prediction modes to perform precoding processing on the current block, and obtain a rate-distortion cost value corresponding to each prediction mode;

The second selection unit 1106 is configured to select the minimum rate-distortion cost value from the obtained multiple rate-distortion cost values, and determine the prediction mode corresponding to the minimum rate-distortion cost value as the prediction mode parameter of the current block.

In some embodiments, referring to FIG. 11 , the encoder 110 may further include a second scaling unit 1107; wherein,

The second selection unit 1106 is further configured to select at least one initial unidirectional motion information from a plurality of known motion information of the current block;

The second scaling unit 1107 is configured to determine a candidate reference frame, and scale the selected at least one initial unidirectional motion information to the candidate reference frame to obtain at least one scaled unidirectional motion information;

The second determining unit 1101 is further configured to determine the at least one scaled unidirectional motion information as the at least one unidirectional motion information, and the reference frame information corresponding to the at least one unidirectional motion information is the Candidate frame of reference.

In some embodiments, the second selection unit 1106 is further configured to determine a candidate reference frame; select the at least one unidirectional motion information from a plurality of known motion information of the current block, and the at least one unidirectional The reference frame information corresponding to the motion information is the candidate reference frame.

In some embodiments, the second offset unit 1102 is configured to perform offset processing on the at least one unidirectional motion information according to a preset offset amount based on at least one preset direction, to obtain the at least one new unidirectional motion information. directional motion information; wherein, the at least one new unidirectional motion information is the same as the reference frame information corresponding to the at least one unidirectional motion information.

In some embodiments, the preset direction at least includes: an upward direction, and/or a downward direction, and/or a leftward direction, and/or a rightward direction.

In some embodiments, the second determining unit 1101 is further configured to, for the at least one unidirectional motion information, determine a horizontal direction vector value and a vertical direction vector value corresponding to each unidirectional motion information;

The second offset unit 1102 is further configured to determine whether the vector value of the vertical direction is equal to 0 when the preset direction is an upward direction and/or a downward direction; when the vector value of the vertical direction is not equal to 0 , according to the division operation between the absolute value of the vector value in the vertical direction and the first preset value, the preset offset corresponding to each unidirectional motion information is obtained; or, the preset direction is the left direction and /or in the case of the rightward direction, judge whether the vector value of the horizontal direction is equal to 0; when the vector value of the horizontal direction is not equal to 0, according to the division of the absolute value of the vector value of the horizontal direction and the second preset value operation to obtain the preset offset corresponding to each unidirectional motion information.

In some embodiments, the second offset unit 1102 is further configured to add the absolute value of the vector value in the horizontal direction and the absolute value of the vector value in the vertical direction for any preset direction to obtain the calculated sum value; judging whether the calculation sum value is equal to 0; when the calculation sum value is not equal to 0, according to the division operation of the calculation sum value and the third preset value, the corresponding prediction value of each unidirectional motion information is obtained Set the offset.

In some embodiments, the second offset unit 1102 is further configured to compare the obtained preset offset with the minimum preset offset and the maximum preset offset for each piece of unidirectional motion information; When the obtained preset offset is less than the minimum preset offset, the minimum preset offset is determined as the preset offset; when the obtained preset offset is greater than the minimum preset When the offset is specified, the maximum preset offset is determined as the preset offset.

In some embodiments, the second determining unit 1101 is further configured to determine an initial motion information candidate list based on the motion information of adjacent blocks of the current block;

The second constructing unit 1103 is configured to fill the at least one new unidirectional motion information into the initial motion information candidate list to obtain the new motion information candidate list.

In some embodiments, the second constructing unit 1103 is further configured to determine whether the at least one new unidirectional motion information is duplicated with the motion information in the initial motion information candidate list; If the motion information does not overlap with the motion information in the initial motion information candidate list, filling the at least one new unidirectional motion information into the initial motion information candidate list.

In some embodiments, the second construction unit 1103 is further configured to include no repeated unidirectional motion information in the initial motion information candidate list and the number of unidirectional motion information in the initial motion information candidate list is less than a preset number , performing the determining at least one unidirectional motion information from multiple known motion information of the current block; and performing offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one Steps for new unidirectional motion information.

In some embodiments, the multiple pieces of known motion information of the current block include at least: motion information in the initial motion information candidate list, and/or, spatial domain motion information of the current block, and/or, the Time-domain motion information of the current block, and/or historical motion information of the current block.

In some embodiments, the second offset unit 1102 is further configured to arbitrarily select one piece of motion information from the initial motion information candidate list, and obtain the at least one new unit according to the offset processing of the one piece of motion information. direction motion information; or, sequentially select at least one motion information from the initial motion information candidate list, and obtain the at least one new unidirectional motion information according to the offset processing of the at least one motion information; or, from the Sequentially select at least one piece of motion information in the spatial domain motion information of the current block and/or the time domain motion information of the current block and/or the historical motion information of the current block, and according to the offset processing of the at least one motion information, The at least one new unidirectional motion information is obtained.

In some embodiments, the preset inter-frame prediction modes include: a geometric partition prediction mode GPM or an angle weighted prediction mode AWP.

In some embodiments, the second determination unit 1101 is further configured to determine two partitions of the current block when the prediction mode parameter indicates that GPM or AWP is used to determine the inter-frame prediction value of the current block; wherein, the The two partitions include a first partition and a second partition; and based on the new motion information candidate list, determining the motion information of the first partition and the motion information of the second partition, and indexing the first motion information Set as the index number value of the motion information of the first partition in the new motion information candidate list, set the second motion information index value as the motion information of the second partition in the new motion information candidate The index number value in the list;

The second prediction unit 1104 is configured to use the motion information of the first partition to calculate a first prediction value of the first partition, and use the motion information of the second partition to calculate a second prediction value of the second partition; performing weighted fusion on the first predicted value and the second predicted value to obtain an inter-frame predicted value of the current block.

In some embodiments, referring to FIG. 11 , the encoder 110 may further include a writing unit 1108 configured to write the first motion information index value and the second motion information index value into a code stream.

It can be understood that, in this embodiment, a "unit" may be a part of a circuit, a part of a processor, a part of a program or software, etc., of course it may also be a module, or it may be non-modular. Moreover, each component in this embodiment may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software function modules.

If the integrated units are implemented in the form of software function modules and are not sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, this embodiment provides a computer storage The medium is applied to the encoder 110, and the computer storage medium stores an inter-frame prediction program, and when the inter-frame prediction program is executed by the second processor, the method described on the encoder side in the foregoing embodiments is implemented.

Based on the composition of the above-mentioned encoder 110 and the computer storage medium, refer to FIG. 12 , which shows an example of a specific hardware structure of the encoder 110 provided by the embodiment of the present application, which may include: a second communication interface 1201, a second memory 1202 and a second communication interface 1201. Two processors 1203; various components are coupled together through the second bus system 1204. It can be understood that the second bus system 1204 is used to realize connection and communication between these components. The second bus system 1204 includes not only a data bus, but also a power bus, a control bus and a status signal bus. However, for clarity of illustration, the various buses are labeled as the second bus system 1204 in FIG. 12 . in,

The second communication interface 1201 is used for receiving and sending signals during the process of sending and receiving information with other external network elements;

The second memory 1202 is used to store computer programs that can run on the second processor 1203;

The second processor 1203 is configured to, when running the computer program, execute:

determining prediction mode parameters for the current block;

When the prediction mode parameter indicates that a preset inter prediction mode is used to determine an inter prediction value of the current block, at least one unidirectional motion information is determined from a plurality of known motion information of the current block;

Perform offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information; wherein the preset offset corresponds to the at least one unidirectional motion information The horizontal direction vector value and the vertical direction vector value are calculated;

Constructing a new motion information candidate list based on the at least one new unidirectional motion information;

Determine an inter-frame prediction value of the current block according to the new motion information candidate list.

Optionally, as another embodiment, the second processor 1203 is further configured to execute the method described in any one of the foregoing embodiments when running the computer program.

It can be understood that the hardware function of the second memory 1202 is similar to that of the first memory 1002 , and the hardware function of the second processor 1203 is similar to that of the first processor 1003 ; details will not be described here.

This embodiment provides an encoder, and the encoder may include a second determination unit, a second offset unit, a second construction unit, and a second prediction unit. In the encoder, after obtaining at least one new unidirectional motion information, the new unidirectional motion information can be filled into the motion information candidate list, which can increase the diversity of motion information in the motion information candidate list; in addition, for For the current block, there may be a deviation between the initial motion information in the motion information candidate list and the actual motion information. At this time, constructing new unidirectional motion information will have a better effect than the initial motion information, thereby improving the encoding and decoding performance.

It should be noted that in this application, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements , but also includes other elements not expressly listed, or also includes elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.

The serial numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.

The methods disclosed in several method embodiments provided in this application can be combined arbitrarily to obtain new method embodiments under the condition of no conflict.

The features disclosed in several product embodiments provided in this application can be combined arbitrarily without conflict to obtain new product embodiments.

The features disclosed in several method or device embodiments provided in this application can be combined arbitrarily without conflict to obtain new method embodiments or device embodiments.

The above is only a specific implementation of the application, but the scope of protection of the application is not limited thereto. Anyone familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the application. Should be covered within the protection scope of this application. Therefore, the protection scope of the present application should be determined by the protection scope of the claims.

Claims (37)

1. An inter-prediction method applied to a decoder, the method comprising:

analyzing the code stream to obtain the prediction mode parameter of the current block;

determining at least one unidirectional motion information from a plurality of known motion information of a current block when the prediction mode parameter indicates that an inter prediction value of the current block is determined using a preset inter prediction mode;

based on at least one preset direction, carrying out offset processing on the at least one unidirectional motion information according to a preset offset to obtain at least one new unidirectional motion information; wherein the preset offset is calculated according to a horizontal direction vector value and a vertical direction vector value corresponding to the at least one unidirectional motion information;

constructing a new motion information candidate list based on the at least one new unidirectional motion information;

determining an inter prediction value of the current block according to the new motion information candidate list;

wherein the method further comprises:

adding the absolute value of the horizontal direction vector value and the absolute value of the vertical direction vector value corresponding to each unidirectional motion information aiming at any one preset direction to obtain a calculated sum value;

determining whether the calculated sum is equal to 0;

and when the calculated sum is not equal to 0, obtaining the preset offset corresponding to each unidirectional motion information according to the division operation of the calculated sum and a third preset value.

2. The method of claim 1, wherein the motion information comprises motion vector information and reference frame information.

3. The method of claim 1, wherein determining at least one uni-directional motion information from a plurality of known motion information for the current block comprises:

selecting at least one initial unidirectional motion information from a plurality of known motion information of the current block;

determining a candidate reference frame, and scaling the selected at least one piece of initial unidirectional motion information to the candidate reference frame to obtain at least one piece of scaled unidirectional motion information;

and determining the at least one piece of scaled unidirectional motion information as the at least one piece of unidirectional motion information, wherein the reference frame information corresponding to the at least one piece of unidirectional motion information is the candidate reference frame.

4. The method of claim 1, wherein determining at least one uni-directional motion information from a plurality of known motion information for the current block comprises:

determining candidate reference frames;

and selecting the at least one unidirectional motion information from a plurality of known motion information of the current block, wherein the reference frame information corresponding to the at least one unidirectional motion information is the candidate reference frame.

5. The method according to any of claims 1 to 4, wherein the at least one new unidirectional motion information is the same as the reference frame information corresponding to the at least one unidirectional motion information.

6. The method according to claim 1, characterized in that said preset direction comprises at least: an upward direction, and/or a downward direction, and/or a leftward direction, and/or a rightward direction.

7. The method of claim 6, further comprising:

determining a horizontal direction vector value and a vertical direction vector value corresponding to each unidirectional motion information aiming at the at least one unidirectional motion information;

judging whether the vector value in the vertical direction is equal to 0 or not under the condition that the preset direction is an upward direction and/or a downward direction;

when the vector value in the vertical direction is not equal to 0, obtaining a preset offset corresponding to each unidirectional motion information according to the division operation of the absolute value of the vector value in the vertical direction and a first preset value;

or,

judging whether the vector value in the horizontal direction is equal to 0 or not under the condition that the preset direction is the left direction and/or the right direction;

and when the horizontal direction vector value is not equal to 0, obtaining the preset offset corresponding to each unidirectional motion information according to the division operation of the absolute value of the horizontal direction vector value and a second preset value.

8. The method according to claim 1 or 7, wherein after obtaining the preset offset corresponding to each unidirectional motion information, the method further comprises:

respectively comparing the obtained preset offset with the minimum preset offset and the maximum preset offset aiming at each unidirectional motion information;

when the obtained preset offset is smaller than the minimum preset offset, determining the minimum preset offset as the preset offset;

and when the obtained preset offset is larger than the minimum preset offset, determining the maximum preset offset as the preset offset.

9. The method of claim 1, further comprising:

determining an initial motion information candidate list based on motion information of neighboring blocks of the current block;

accordingly, said constructing a new motion information candidate list based on said at least one new unidirectional motion information comprises:

and filling the at least one piece of new unidirectional motion information into the initial motion information candidate list to obtain the new motion information candidate list.

10. The method of claim 9, wherein populating the initial motion information candidate list with the at least one new uni-directional motion information comprises:

judging whether the at least one new unidirectional motion information is repeated with the motion information in the initial motion information candidate list;

and under the condition that the at least one piece of new unidirectional motion information is not repeated with the motion information in the initial motion information candidate list, filling the at least one piece of new unidirectional motion information into the initial motion information candidate list.

11. The method of claim 9, further comprising:

when the initial motion information candidate list does not include repeated unidirectional motion information and the number of unidirectional motion information in the initial motion information candidate list is less than a preset number, performing the determining of at least one unidirectional motion information from a plurality of known motion information of the current block; and performing offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information.

12. The method of claim 11, wherein the plurality of known motion information for the current block comprises at least: motion information in the initial motion information candidate list, and/or spatial motion information of the current block, and/or temporal motion information of the current block, and/or historical motion information of the current block.

13. The method of claim 12, further comprising:

randomly selecting one piece of motion information from the initial motion information candidate list, and obtaining the at least one piece of new unidirectional motion information according to the offset processing of the one piece of motion information; or,

sequentially selecting at least one piece of motion information from the initial motion information candidate list, and obtaining at least one piece of new unidirectional motion information according to the offset processing of the at least one piece of motion information; or,

and sequentially selecting at least one piece of motion information from the spatial motion information of the current block and/or the time domain motion information of the current block and/or the historical motion information of the current block, and obtaining the at least one piece of new unidirectional motion information according to the offset processing of the at least one piece of motion information.

14. The method of claim 1, wherein the preset inter prediction mode comprises: a geometrically partitioned prediction mode GPM or an angularly weighted prediction mode AWP.

15. The method of claim 10, further comprising:

determining two partitions of a current block when the prediction mode parameter indicates that an inter prediction value of the current block is determined using GPM or AWP; wherein the two partitions comprise a first partition and a second partition;

accordingly, the determining the inter prediction value of the current block according to the new motion information candidate list includes:

analyzing the code stream, and determining a first motion information index value corresponding to the first partition and a second motion information index value corresponding to the second partition;

determining, based on the new motion information candidate list, motion information in the new motion information candidate list indicated by the first motion information index value as motion information of the first partition, and determining motion information in the new motion information candidate list indicated by the second motion information index value as motion information of the second partition;

calculating a first prediction value of the first partition using the motion information of the first partition, and calculating a second prediction value of the second partition using the motion information of the second partition;

and performing weighted fusion on the first predicted value and the second predicted value to obtain the interframe predicted value of the current block.

16. An inter-prediction method applied to an encoder, the method comprising:

determining a prediction mode parameter of a current block;

determining at least one unidirectional motion information from a plurality of known motion information of a current block when the prediction mode parameter indicates that an inter prediction value of the current block is determined using a preset inter prediction mode;

based on at least one preset direction, carrying out offset processing on the at least one unidirectional motion information according to a preset offset to obtain at least one new unidirectional motion information; wherein the preset offset is calculated according to a horizontal direction vector value and a vertical direction vector value corresponding to the at least one unidirectional motion information;

constructing a new motion information candidate list based on the at least one new unidirectional motion information;

determining an inter prediction value of the current block according to the new motion information candidate list;

wherein the method further comprises:

adding the absolute value of the horizontal direction vector value and the absolute value of the vertical direction vector value corresponding to each unidirectional motion information to obtain a calculated sum value aiming at any one preset direction;

determining whether the calculated sum is equal to 0;

and when the calculated sum is not equal to 0, obtaining the preset offset corresponding to each unidirectional motion information according to the division operation of the calculated sum and a third preset value.

17. The method of claim 16, wherein the motion information comprises motion vector information and reference frame information.

18. The method of claim 16, wherein determining the prediction mode parameter for the current block comprises:

carrying out pre-coding processing on the current block by utilizing multiple prediction modes to obtain rate distortion cost values corresponding to each prediction mode;

and selecting a minimum rate distortion cost value from the obtained multiple rate distortion cost values, and determining the prediction mode corresponding to the minimum rate distortion cost value as the prediction mode parameter of the current block.

19. The method of claim 16, wherein determining at least one uni-directional motion information from a plurality of known motion information for the current block comprises:

selecting at least one initial unidirectional motion information from a plurality of known motion information for the current block;

determining a candidate reference frame, and zooming the selected at least one piece of initial unidirectional motion information to the candidate reference frame to obtain at least one piece of zoomed unidirectional motion information;

and determining the at least one piece of scaled unidirectional motion information as the at least one piece of unidirectional motion information, wherein the reference frame information corresponding to the at least one piece of unidirectional motion information is the candidate reference frame.

20. The method of claim 16, wherein determining at least one uni-directional motion information from a plurality of known motion information for the current block comprises:

determining candidate reference frames;

and selecting the at least one unidirectional motion information from a plurality of known motion information of the current block, wherein the reference frame information corresponding to the at least one unidirectional motion information is the candidate reference frame.

21. The method according to any one of claims 16 to 20,

the at least one new unidirectional motion information is the same as the reference frame information corresponding to the at least one unidirectional motion information.

22. The method according to claim 16, wherein the preset direction comprises at least: an upward direction, and/or a downward direction, and/or a leftward direction, and/or a rightward direction.

23. The method of claim 22, further comprising:

determining a horizontal direction vector value and a vertical direction vector value corresponding to each unidirectional motion information aiming at the at least one unidirectional motion information;

judging whether the vector value in the vertical direction is equal to 0 or not under the condition that the preset direction is an upward direction and/or a downward direction;

when the vector value in the vertical direction is not equal to 0, obtaining a preset offset corresponding to each unidirectional motion information according to the division operation of the absolute value of the vector value in the vertical direction and a first preset value;

or,

judging whether the vector value in the horizontal direction is equal to 0 or not under the condition that the preset direction is the left direction and/or the right direction;

and when the horizontal direction vector value is not equal to 0, obtaining the preset offset corresponding to each unidirectional motion information according to the division operation of the absolute value of the horizontal direction vector value and a second preset value.

24. The method according to claim 16 or 23, wherein after obtaining the preset offset corresponding to each unidirectional motion information, the method further comprises:

respectively comparing the obtained preset offset with the minimum preset offset and the maximum preset offset aiming at each unidirectional motion information;

when the obtained preset offset is smaller than the minimum preset offset, determining the minimum preset offset as the preset offset;

and when the obtained preset offset is larger than the minimum preset offset, determining the maximum preset offset as the preset offset.

25. The method of claim 16, further comprising:

determining an initial motion information candidate list based on motion information of neighboring blocks of the current block;

accordingly, said constructing a new motion information candidate list based on said at least one new unidirectional motion information comprises:

and filling the at least one piece of new unidirectional motion information into the initial motion information candidate list to obtain the new motion information candidate list.

26. The method of claim 25, wherein populating the initial motion information candidate list with the at least one new uni-directional motion information comprises:

judging whether the at least one new unidirectional motion information is repeated with the motion information in the initial motion information candidate list;

and filling the at least one new unidirectional motion information into the initial motion information candidate list under the condition that the at least one new unidirectional motion information does not overlap with the motion information in the initial motion information candidate list.

27. The method of claim 25, further comprising:

when the initial motion information candidate list does not include repeated unidirectional motion information and the number of unidirectional motion information in the initial motion information candidate list is less than a preset number, performing the determining of at least one unidirectional motion information from a plurality of known motion information of the current block; and performing offset processing on the at least one unidirectional motion information based on a preset offset to obtain at least one new unidirectional motion information.

28. The method of claim 27, wherein the plurality of known motion information for the current block comprises at least: motion information in the initial motion information candidate list, and/or spatial motion information of the current block, and/or temporal motion information of the current block, and/or historical motion information of the current block.

29. The method of claim 28, further comprising:

randomly selecting one piece of motion information from the initial motion information candidate list, and obtaining at least one piece of new unidirectional motion information according to the offset processing of the one piece of motion information; or,

sequentially selecting at least one piece of motion information from the initial motion information candidate list, and obtaining at least one piece of new unidirectional motion information according to the offset processing of the at least one piece of motion information; or,

and sequentially selecting at least one piece of motion information from the spatial motion information of the current block and/or the temporal motion information of the current block and/or the historical motion information of the current block, and obtaining the at least one piece of new unidirectional motion information according to the offset processing of the at least one piece of motion information.

30. The method according to claim 16, wherein the preset inter prediction modes comprise: a geometrically partitioned prediction mode GPM or an angularly weighted prediction mode AWP.

31. The method of claim 30, further comprising:

determining two partitions of a current block when the prediction mode parameter indicates that an inter prediction value of the current block is determined using GPM or AWP; wherein the two partitions comprise a first partition and a second partition;

accordingly, the determining the inter prediction value of the current block according to the new motion information candidate list includes:

determining the motion information of the first partition and the motion information of the second partition based on the new motion information candidate list, setting a first motion information index value as an index sequence number value of the motion information of the first partition in the new motion information candidate list, and setting a second motion information index value as an index sequence number value of the motion information of the second partition in the new motion information candidate list;

calculating a first prediction value of the first partition using the motion information of the first partition, and calculating a second prediction value of the second partition using the motion information of the second partition;

and performing weighted fusion on the first predicted value and the second predicted value to obtain the interframe predicted value of the current block.

32. The method of claim 31, further comprising:

and writing the first motion information index value and the second motion information index value into a code stream.

33. A decoder, characterized in that the decoder comprises a parsing unit, a first determining unit, a first shifting unit, a first constructing unit and a first predicting unit; wherein,

the analysis unit is configured to analyze the code stream and obtain a prediction mode parameter of the current block;

the first determination unit is configured to determine at least one unidirectional motion information from among a plurality of known motion information of the current block when the prediction mode parameter indicates that an inter prediction value of the current block is determined using a preset inter prediction mode;

the first migration unit is configured to perform migration processing on the at least one unidirectional motion information according to a preset migration amount based on at least one preset direction to obtain at least one new unidirectional motion information; wherein the preset offset is calculated according to a horizontal direction vector value and a vertical direction vector value corresponding to the at least one unidirectional motion information;

the first constructing unit is configured to construct a new motion information candidate list based on the at least one new unidirectional motion information;

the first prediction unit is configured to determine an inter prediction value of the current block according to the new motion information candidate list;

the first offset unit is further configured to add an absolute value of a horizontal direction vector value and an absolute value of a vertical direction vector value corresponding to each unidirectional motion information to obtain a calculated sum value for any one preset direction; determining whether the calculated sum is equal to 0; and when the calculated sum is not equal to 0, obtaining the preset offset corresponding to each unidirectional motion information according to the division operation of the calculated sum and a third preset value.

34. A decoder, comprising a first memory and a first processor; wherein,

the first memory for storing a computer program operable on the first processor;

the first processor, when executing the computer program, is configured to perform the method of any of claims 1 to 15.

35. An encoder, characterized in that the encoder comprises a second determination unit, a second offset unit, a second construction unit and a second prediction unit; wherein,

the second determining unit is configured to determine a prediction mode parameter of the current block;

the second determination unit is further configured to determine at least one unidirectional motion information from among a plurality of known motion information of the current block when the prediction mode parameter indicates that an inter prediction value of the current block is determined using a preset inter prediction mode;

the second migration unit is configured to perform migration processing on the at least one unidirectional motion information according to a preset migration amount based on at least one preset direction to obtain at least one new unidirectional motion information; wherein the preset offset is calculated according to a horizontal direction vector value and a vertical direction vector value corresponding to the at least one unidirectional motion information;

the second constructing unit is configured to construct a new motion information candidate list based on the at least one new unidirectional motion information;

the second prediction unit is configured to determine an inter prediction value of the current block according to the new motion information candidate list;

the second offset unit is further configured to add an absolute value of a horizontal direction vector value and an absolute value of a vertical direction vector value corresponding to each unidirectional motion information to obtain a calculated sum value for any one preset direction; determining whether the calculated sum is equal to 0; and when the calculated sum is not equal to 0, obtaining the preset offset corresponding to each unidirectional motion information according to the division operation of the calculated sum and a third preset value.

36. An encoder, characterized in that the encoder comprises a second memory and a second processor; wherein,

the second memory for storing a computer program operable on the second processor;

the second processor, when executing the computer program, is configured to perform the method of any of claims 16 to 32.

37. A computer storage medium, characterized in that it stores a computer program which, when executed by a first processor, implements the method of any one of claims 1 to 15, or which, when executed by a second processor, implements the method of any one of claims 16 to 32.

Images