CN119031144A - Angle mode inter-frame prediction method, encoder and storage medium - Google Patents

Abstract

The present application discloses an angle mode inter-frame prediction method and related devices. The method includes: constructing a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; setting motion information for unavailable neighbor blocks; checking for duplicate motion information of neighbor blocks in each angle direction, and the angle direction through which the duplicate checking is performed is the effective angle direction; using the motion information of the reference block of the unavailable neighbor block in the effective angle direction to modify the motion information of the unavailable neighbor block in the effective angle direction; using the motion information of the available neighbor block and/or the unavailable neighbor block in each effective angle direction to calculate the prediction value of the current block. In the above manner, the present application can reduce the computational overhead in the encoding process.

Description

Angle mode inter-frame prediction method, encoder and storage medium

Technical Field

The present application relates to the field of video coding technology, and in particular to an angle mode inter-frame prediction method, an encoder and a storage medium.

Background Art

Video encoding technology can be used to compress videos to reduce the amount of video data, reduce network bandwidth during video transmission, and reduce storage space. Among them, video encoding modes can include inter-frame prediction mode and intra-frame prediction mode prediction.

Taking the inter-frame prediction mode as an example, the inter-frame prediction uses a lot of highly correlated redundant information in the reference frame to predict the information of the current frame. Among them, the inter-frame prediction mode can be divided into many types, such as the inter-frame motion vector angle prediction mode (MVAP, Motion Vector Angle Prediction), the temporal motion vector prediction mode, the spatial motion vector prediction mode, the historical motion vector motion mode, etc.

Taking the inter-frame motion vector angle prediction mode as an example, the inter-frame motion vector angle prediction mode can also be called angle mode inter-frame prediction. The so-called inter-frame motion vector angle prediction is to use the motion information of the neighboring blocks in multiple angle directions of the current block (the block to be predicted in the current frame) as the motion information of the current block, and calculate the rate-distortion cost of the current block when the motion information of the neighboring blocks in different angle directions is used as the motion information of the current block, and finally use the motion information of the neighboring blocks in the angle direction with the smallest rate-distortion cost as the motion information of the current block, and then obtain the prediction value of the current block through the motion information of the current block.

However, the existing angle mode inter-frame prediction requires high computational overhead.

Summary of the invention

The present application provides an angle mode inter-frame prediction method, an encoder and a storage medium, which can solve the problem of high computational overhead required for existing angle mode inter-frame prediction.

To solve the above technical problems, a technical solution adopted in the present application is: to provide an angle mode inter-frame prediction method, the method comprising: constructing a candidate neighbor block list for a current block, the candidate neighbor block list comprising neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; setting motion information for unavailable neighbor blocks; performing motion information duplication check on neighbor blocks in each angle direction, and the angle direction through which the duplication is checked is the valid angle direction; using the motion information of the reference block of the unavailable neighbor block in the valid angle direction to modify the motion information of the unavailable neighbor block in the valid angle direction; and respectively using the motion information of the available neighbor blocks and/or the unavailable neighbor blocks in each valid angle direction to calculate the prediction value of the current block.

To solve the above technical problems, another technical solution adopted in the present application is: to provide an angle mode inter-frame prediction device, the device comprising: a construction module, used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; a setting module, used to set motion information for unavailable neighbor blocks; a duplicate checking module, used to check the motion information of neighbor blocks in each angle direction, and the angle direction through which the duplicate checking is performed is the effective angle direction; a modification module, used to modify the motion information of the unavailable neighbor blocks in the effective angle direction by using the motion information of the reference block of the unavailable neighbor blocks in the effective angle direction; a calculation module, used to calculate the prediction value of the current block by using the motion information of the available neighbor blocks and/or unavailable neighbor blocks in each effective angle direction respectively.

To solve the above technical problems, another technical solution adopted by the present application is: to provide an angle mode inter-frame prediction method, the method comprising: constructing a candidate neighbor block list for the current block, the candidate neighbor block list including neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; if the time domain co-located block of the unavailable neighbor block is available, the motion information of the unavailable neighbor block is set using the motion information of the time domain co-located block, otherwise the initial value is set to the motion information of the unavailable neighbor block; the neighbor blocks in each angle direction are checked for duplication of motion information, and the angle direction through duplication checking is the valid angle direction; the motion information of the available neighbor block whose motion information is the initial value is modified using the motion information of the reference block of the unavailable neighbor block whose motion information is the initial value; and the prediction value of the current block is calculated using the motion information of the available neighbor blocks and/or the unavailable neighbor blocks in each valid angle direction respectively.

To solve the above technical problems, another technical solution adopted by the present application is: to provide an angle mode inter-frame prediction device, the device comprising: a construction module, used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; a setting module, used to set motion information for the unavailable neighbor block using the motion information of the time domain co-located block when the time domain co-located block of the unavailable neighbor block is available, and used to set the initial value to the motion information of the unavailable neighbor block when the time domain co-located block of the unavailable neighbor block is unavailable; a duplicate checking module, used to check the motion information of the neighbor blocks in each angle direction for duplicate checking, and the angle direction through which the duplicate checking is performed is the valid angle direction; a modification module, used to modify the motion information of the available neighbor block whose motion information is the initial value using the motion information of the reference block of the unavailable neighbor block whose motion information is the initial value; a calculation module, used to calculate the prediction value of the current block using the motion information of the available neighbor blocks and/or the unavailable neighbor blocks in each valid angle direction respectively.

To solve the above technical problems, another technical solution adopted by the present application is: to provide an angle mode inter-frame prediction device, the device comprising: constructing a candidate neighbor block list for the current block, the candidate neighbor block list including neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; setting motion information for the unavailable neighbor blocks; selecting at least one pair of neighbor blocks in each angle direction according to the size of the current block to perform motion information duplication check, and the angle direction through duplication check is the valid angle direction; using the motion information of the reference block of the unavailable neighbor block to modify the motion information of the available neighbor block; and respectively using the motion information of the available neighbor blocks and/or the unavailable neighbor blocks in each valid angle direction to calculate the prediction value of the current block.

To solve the above technical problems, another technical solution adopted in the present application is: to provide an angle mode inter-frame prediction device, the device comprising: a construction module, used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes the neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; a setting module, used to set motion information for unavailable neighbor blocks; a duplicate checking module, used to select at least one pair of neighbor blocks in each angle direction according to the size of the current block to check the motion information for duplicate checking, and the angle direction through which the duplicate checking is performed is the effective angle direction; a modification module, used to modify the motion information of the available neighbor blocks by using the motion information of the reference block of the unavailable neighbor blocks; a calculation module, used to calculate the prediction value of the current block by using the motion information of the available neighbor blocks and/or the unavailable neighbor blocks in each effective angle direction respectively.

To solve the above technical problems, another technical solution adopted in the present application is: to provide an angle mode inter-frame prediction method, the method comprising: constructing a candidate neighbor block list for the current block, the candidate neighbor block list including neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; setting motion information for the unavailable neighbor blocks; performing motion information duplication check on the neighbor blocks in each angle direction, the angle direction through which the duplication check is performed is a valid angle direction, wherein if the angle direction satisfies the first condition, at least one duplication check is added; using the motion information of the reference block of the unavailable neighbor block to modify the motion information of the unavailable neighbor block; and respectively using the motion information of the available neighbor blocks and/or the unavailable neighbor blocks in each valid angle direction to calculate the prediction value of the current block.

To solve the above technical problems, another technical solution adopted in the present application is: to provide an angle mode inter-frame prediction device, the device comprising: a construction module, used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; a setting module, used to set motion information for unavailable neighbor blocks; a duplicate checking module, used to check the motion information of neighbor blocks in each angle direction, the angle direction through which the duplicate checking is performed is a valid angle direction, wherein if the angle direction satisfies the first condition, at least one duplicate checking is added; a modification module, used to modify the motion information of the unavailable neighbor block by using the motion information of the reference block of the unavailable neighbor block; a calculation module, used to calculate the prediction value of the current block by using the motion information of the available neighbor blocks and/or the unavailable neighbor blocks in each valid angle direction respectively.

To solve the above technical problems, another technical solution adopted by the present application is: to provide an angle mode inter-frame prediction method, the method comprising: constructing a candidate neighbor block list for the current block, the candidate neighbor block list including the neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; setting motion information for the unavailable neighbor blocks; performing motion information duplication check on the neighbor blocks in each angle direction, the angle direction through which the duplication check is performed is the valid angle direction, wherein if at least two of the horizontal, vertical and horizontal upward duplication check results meet the second condition, then at least one horizontal upward duplication check is reduced; using the motion information of the reference block of the unavailable neighbor block to modify the motion information of the unavailable neighbor block; and using the motion information of the available neighbor blocks and/or the unavailable neighbor blocks in each valid angle direction to calculate the prediction value of the current block.

To solve the above technical problems, another technical solution adopted by the present application is: to provide an angle mode inter-frame prediction device, the device comprising: a construction module, used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; a setting module, used to set motion information for unavailable neighbor blocks; a duplicate checking module, used to check the motion information of neighbor blocks in each angle direction, the angle direction through which the duplicate checking is performed is a valid angle direction, wherein if at least two of the horizontal, vertical and horizontal upward duplicate checking results meet the second condition, at least one horizontal upward duplicate checking is reduced; a modification module, used to modify the motion information of the unavailable neighbor block by using the motion information of the reference block of the unavailable neighbor block; a calculation module, used to calculate the prediction value of the current block by using the motion information of the available neighbor blocks and/or the unavailable neighbor blocks in each valid angle direction respectively.

To solve the above technical problems, another technical solution adopted by the present application is: to provide an angle mode inter-frame prediction method, the method comprising: constructing a candidate neighbor block list for the current block, the candidate neighbor block list comprising neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; setting motion information for the unavailable neighbor blocks; performing motion information duplication check on the neighbor blocks in each angle direction, the angle direction for duplication check being a valid angle direction, the duplication check comprising determining whether the image sequence index of the reference frame of at least one pair of selected neighbor blocks is the same and whether the motion is the same; using the motion information of the reference block of the unavailable neighbor block to modify the motion information of the unavailable neighbor block; and calculating the prediction value of the current block using the motion information of the available neighbor blocks and/or the unavailable neighbor blocks in each valid angle direction respectively.

To solve the above technical problems, another technical solution adopted by the present application is: to provide an angle mode inter-frame prediction device, the device comprising: a construction module, used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; a setting module, used to set motion information for unavailable neighbor blocks; a duplicate checking module, used to check the motion information of neighbor blocks in each angle direction, the angle direction of the duplicate checking is a valid angle direction, and the duplicate checking includes determining whether the image sequence index of the reference frame of at least one pair of selected neighbor blocks is the same and whether the motion is the same; a modification module, used to modify the motion information of the unavailable neighbor block by using the motion information of the reference block of the unavailable neighbor block; a calculation module, used to calculate the prediction value of the current block by using the motion information of the available neighbor blocks and/or the unavailable neighbor blocks in each valid angle direction respectively.

To solve the above technical problems, another technical solution adopted in the present application is: to provide an angle mode inter-frame prediction method, the method comprising: constructing a candidate neighbor block list for the current block, the candidate neighbor block list including neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; setting motion information for the unavailable neighbor blocks; performing motion information duplication check on the neighbor blocks in each angle direction, and the angle direction through which the duplication check is performed is the effective angle direction; using the motion information of the reference block of the unavailable neighbor block to modify the motion information of the unavailable neighbor block; the current block is divided into multiple sub-blocks, and motion compensation is performed using the motion information of the corresponding neighbor block of each sub-block in the effective angle direction to obtain a prediction value of each sub-block, and the prediction values of all sub-blocks constitute the prediction value of the current block, wherein the motion information of at least two corresponding neighbor blocks is used when performing motion compensation on the sub-block in at least one effective angle direction.

To solve the above technical problems, another technical solution adopted by the present application is: to provide an angle mode inter-frame prediction device, the device comprising: a construction module, used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; a setting module, used to set motion information for unavailable neighbor blocks; a duplicate checking module, used to check the motion information of neighbor blocks in each angle direction, and the angle direction through which the duplicate checking is performed is the effective angle direction; a modification module, used to modify the motion information of the unavailable neighbor block by using the motion information of the reference block of the unavailable neighbor block; a calculation module, used to perform motion compensation by using the motion information of the corresponding neighbor blocks of each sub-block in the effective angle direction when the current block is divided into multiple sub-blocks, to obtain the prediction value of each sub-block, the prediction values of all sub-blocks constitute the prediction value of the current block, wherein the motion information of at least two of the corresponding neighbor blocks is used when the sub-block is motion compensated in at least one effective angle direction.

To solve the above technical problems, another technical solution adopted in the present application is: to provide an angle mode inter-frame prediction method, the method comprising: constructing a candidate neighbor block list for the current block, the candidate neighbor block list including neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; setting motion information for the unavailable neighbor blocks; checking for duplicate motion information of the neighbor blocks in each angle direction, and the angle direction through the duplicate checking is the valid angle direction; filling the valid angle direction into the angle mode list to obtain the angle mode index of the valid angle direction; using the motion information of the reference block of the unavailable neighbor block to modify the motion information of the unavailable neighbor block; and using the motion information of the available and/or unavailable neighbor blocks in each valid angle direction to calculate the prediction value of the current block.

To solve the above technical problems, another technical solution adopted in the present application is: to provide an angle mode inter-frame prediction device, the device comprising: a construction module, used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; a setting module, used to set motion information for unavailable neighbor blocks; a duplicate checking module, used to check the motion information of neighbor blocks in each angle direction, and the angle direction checked for duplicates is the valid angle direction; a filling module, used to fill the valid angle direction into the angle mode list to obtain the angle mode index of the valid angle direction; a modification module, used to modify the motion information of the unavailable neighbor block by using the motion information of the reference block of the unavailable neighbor block; a calculation module, used to calculate the prediction value of the current block by using the motion information of the available and/or unavailable neighbor blocks in each valid angle direction respectively.

To solve the above technical problems, another technical solution adopted by the present application is: to provide an angle mode inter-frame prediction method, the method comprising: constructing a candidate neighbor block list for the current block, the candidate neighbor block list including neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; setting motion information for the unavailable neighbor blocks; checking for duplicate motion information of neighbor blocks in each angle direction, and the angle direction through which the duplicate checking is performed is the valid angle direction; determining the order of each valid angle direction using the texture direction of the current block; filling the valid angle directions into the mode list in order; using the motion information of the reference block of the unavailable neighbor block to modify the motion information of the unavailable neighbor block; and calculating the prediction value of the current block using the motion information of the available neighbor blocks and/or the unavailable neighbor blocks in each valid angle direction respectively.

To solve the above technical problems, another technical solution adopted by the present application is: to provide an angle mode inter-frame prediction device, the device comprising: a construction module, used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; a setting module, used to set motion information for unavailable neighbor blocks; a duplicate checking module, used to check the motion information of neighbor blocks in each angle direction, and the angle direction through the duplicate checking is the valid angle direction; a determination module, used to determine the order of each valid angle direction using the texture direction of the current block; a filling module, used to fill the valid angle directions into the mode list in order; a modification module, used to modify the motion information of the unavailable neighbor block using the motion information of the reference block of the unavailable neighbor block; a calculation module, used to calculate the prediction value of the current block using the motion information of the available neighbor blocks and/or the unavailable neighbor blocks in each valid angle direction respectively.

In order to solve the above technical problems, another technical solution adopted by the present application is: to provide an angle mode inter-frame prediction method, the method comprising: constructing a candidate neighbor block list for the current block, the candidate neighbor block list including neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; setting motion information for the unavailable neighbor blocks; performing motion information duplication check on the neighbor blocks in each angle direction, the angle direction of the duplication check is the effective angle direction; using the motion information of the reference block of the unavailable neighbor block to modify the motion information of the unavailable neighbor block; the current block is divided into multiple sub-blocks, and each sub-block is used in the effective angle direction to modify the motion information of the unavailable neighbor block; The motion information of the corresponding neighboring block is obtained to obtain the motion information of each sub-block, where the motion information includes a motion vector; the first prediction value of each sub-block is corrected by using multiple corrected motion vectors to obtain multiple second prediction values of each sub-block, where the first prediction value is obtained by motion compensation using the motion information; the corrected motion vector corresponding to the second prediction value with the smallest evaluation index is selected for each sub-block as the final corrected motion vector of the sub-block; the final corrected motion vectors of all sub-blocks are used for correction to obtain the corrected motion vector; the prediction value of each sub-block is obtained by using the motion information including the corrected motion vector, and the prediction values of all sub-blocks constitute the prediction value of the current block.

In order to solve the above technical problems, another technical solution adopted by the present application is: to provide an angle mode inter-frame prediction device, which includes: a construction module, used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks; a setting module, used to set motion information for unavailable neighbor blocks; a duplicate checking module, used to check the motion information of neighbor blocks in each angle direction, and the angle direction through which the duplicate checking is performed is the effective angle direction; a modification module, used to modify the motion information of the unavailable neighbor block by using the motion information of the reference block of the unavailable neighbor block; a first calculation module, used to, when the current block is divided into multiple sub-blocks, respectively use each sub-block in the effective angle direction to calculate the motion information of the unavailable neighbor block; The invention relates to a method for obtaining the motion information of each sub-block by using the motion information of the corresponding neighboring block in the degree direction, wherein the motion information includes a motion vector; a first correction module, which is used to respectively correct the first prediction value of each sub-block by using multiple corrected motion vectors to obtain multiple second prediction values of each sub-block, wherein the first prediction value is obtained by motion compensation using the motion information; a selection module, which is used to respectively select the corrected motion vector corresponding to the second prediction value with the smallest evaluation index for each sub-block as the final corrected motion vector of the sub-block; a second correction module, which is used to perform correction using the final corrected motion vectors of all sub-blocks to obtain the corrected motion vector; and a second calculation module, which is used to obtain the prediction value of each sub-block by using the motion information including the corrected motion vector, wherein the prediction values of all sub-blocks constitute the prediction value of the current block.

To solve the above technical problems, another technical solution adopted in the present application is: to provide an encoder, which includes a processor and a memory connected to the processor, wherein the memory stores program instructions; the processor is used to execute the program instructions stored in the memory to implement the above method.

In order to solve the above technical problem, another technical solution adopted by the present application is: providing a storage medium storing program instructions, which can implement the above method when executed.

Through the above method, the present application can only modify the motion information of the unavailable neighboring blocks in the valid angle direction after obtaining the valid angle direction through duplication checking. Compared with the method of modifying the unavailable neighboring blocks in each angle direction to fill the motion information, the computational overhead can be reduced.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic flow chart of a first embodiment of an angle mode inter-frame prediction method of the present invention;

FIG2 is a schematic diagram of neighboring blocks of the current block in five angular directions;

FIG3 is a schematic diagram of a flow chart of a second embodiment of the angle mode inter-frame prediction method of the present application;

FIG4 is a schematic flow chart of a third embodiment of the angle mode inter-frame prediction method of the present application;

FIG5 is a schematic flow chart of a fourth embodiment of the angle mode inter-frame prediction method of the present application;

FIG6 is a flowchart of a fifth embodiment of the angle mode inter-frame prediction method of the present application;

FIG7 is a flowchart of a sixth embodiment of the angle mode inter-frame prediction method of the present application;

FIG8 is a schematic diagram of a specific process of S630 in FIG7 ;

FIG9 is a schematic diagram of selecting a first number of neighboring blocks for duplication checking in the direction corresponding to width and height of the present application;

FIG10 is a schematic diagram of selecting a second number of neighboring blocks for duplicate checking in the direction corresponding to the width and height of the present application;

FIG11 is a flow chart of a seventh embodiment of the angle mode inter-frame prediction method of the present application;

FIG12 is a schematic diagram of adding a duplicate check under the first condition of the present application;

FIG13 is another schematic diagram of adding a duplicate check under the first condition of the present application;

FIG14 is another schematic diagram of adding a duplicate check under the first condition of the present application;

FIG15 is another schematic diagram of adding a duplicate check under the first condition of the present application;

FIG16 is a schematic flow chart of an eighth embodiment of the angle mode inter-frame prediction method of the present application;

FIG17 is a schematic diagram showing a reduction in one duplication check under the second condition of the present application;

FIG18 is another schematic diagram of reducing one duplicate check under the second condition of the present application;

FIG19 is another schematic diagram of reducing one duplicate check under the second condition of the present application;

FIG20 is a flowchart of a ninth embodiment of the angle mode inter-frame prediction method of the present application;

FIG21 is a flowchart of a tenth embodiment of the angle mode inter-frame prediction method of the present application;

FIG22 is a schematic diagram of calculating the motion vector of the first sub-block using two neighboring blocks in the horizontal and vertical directions respectively according to the present application;

FIG23 is a schematic flow chart of an eleventh embodiment of the angle mode inter-frame prediction method of the present application;

FIG24 is a schematic flow chart of a twelfth embodiment of the angle mode inter-frame prediction method of the present application;

FIG25 is a schematic diagram of a specific process of S1240 in FIG24 ;

FIG26 is a schematic diagram of a flow chart of a thirteenth embodiment of the angle mode inter-frame prediction method of the present application;

FIG27 is a schematic diagram of a specific flow chart of S1306 in FIG26 ;

FIG28 is a schematic diagram of searching for a forward corrected motion vector within a search range of a forward first prediction block according to the present application;

FIG29 is a schematic structural diagram of a first embodiment of an angle mode inter-frame prediction device of the present application;

FIG30 is a schematic diagram of the structure of a second embodiment of an angle mode inter-frame prediction device of the present application;

FIG31 is a schematic structural diagram of a third embodiment of an angle mode inter-frame prediction device of the present application;

FIG32 is a schematic structural diagram of a fourth embodiment of an angle mode inter-frame prediction device of the present application;

FIG33 is a schematic structural diagram of a fifth embodiment of an angle mode inter-frame prediction device of the present application;

FIG34 is a schematic structural diagram of a sixth embodiment of an angle mode inter-frame prediction device of the present application;

FIG35 is a schematic diagram of the structure of a seventh embodiment of an angle mode inter-frame prediction device of the present application;

FIG36 is a schematic structural diagram of an eighth embodiment of an angle mode inter-frame prediction device of the present application;

FIG37 is a schematic diagram of the structure of a ninth embodiment of an angle mode inter-frame prediction device of the present application;

FIG38 is a schematic structural diagram of a tenth embodiment of an angle mode inter-frame prediction device of the present application;

FIG39 is a schematic diagram of the structure of an encoder according to an embodiment of the present application;

FIG40 is a schematic diagram of the structure of a storage medium according to an embodiment of the present application;

FIG. 41 is a schematic diagram of the structure of an electronic device according to an embodiment of the present application.

DETAILED DESCRIPTION

The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

The terms "first", "second", and "third" in this application are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first", "second", and "third" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "multiple" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments without conflict.

FIG1 is a flowchart of the first embodiment of the angle mode inter-frame prediction method of the present application. It should be noted that if there is substantially the same result, the present embodiment is not limited to the flow sequence shown in FIG1. As shown in FIG1, the present embodiment may include:

S110: Construct a candidate neighbor block list for the current block.

The current block may also be referred to as the current coding block, that is, the block currently to be coded. In some cases, the coding block may be referred to as a coding unit (CU). The video frame in which the current block is located may be referred to as the current frame.

The candidate neighbor block list includes neighbor blocks of the current block in multiple angular directions. The current block and the neighbor block both belong to the current frame, and the neighbor block is located on the encoded side of the current block. For example, when the encoding direction is from left to right and from top to bottom, the neighbor block is located on the left and top of the current block. Referring to the concept of angle mode in intra-frame prediction, the current block can be projected to the encoded side at each angle direction to determine the neighbor block. Neighbor blocks in different angular directions may be repeated. The size of all neighbor blocks can be the same and smaller than the size of the current block.

According to the position of the current block, the neighboring block may be a real block in the current frame, or a non-existent block beyond the boundary of the current frame; for the real neighboring block, it may be a coded block or an uncoded block; the prediction mode adopted by the coded neighboring block may be inter-frame prediction, intra-frame prediction or intra-frame block copy (IBC), etc. In this application, the coded inter-frame predicted neighboring blocks may be referred to as available neighboring blocks, and the remaining neighboring blocks (such as non-existent blocks, uncoded blocks, intra-frame blocks, etc.) may be referred to as unavailable neighboring blocks.

Optionally, the multiple angle directions include at least two of horizontal, vertical, horizontal upward, horizontal downward, and vertical right. The following is an explanation of the situation including five directions (horizontal, vertical, horizontal upward, horizontal downward, and vertical right) in conjunction with FIG. 2:

Figure 2 is a schematic diagram of neighboring blocks of the current block in five angular directions. According to the relative position relationship between the neighboring blocks and the current block, A ₁ to A _N are neighboring blocks in the horizontal direction of the current block, which can be called horizontal neighboring blocks; B ₁ to B _N are neighboring blocks in the vertical direction of the current block, which can be called vertical neighboring blocks; E is a neighboring block in the horizontal upward direction of the current block, which can be called horizontal upward neighboring blocks; C ₁ to C _N are neighboring blocks in the horizontal downward direction of the current block, which can be called horizontal downward neighboring blocks; D ₁ to D _N are neighboring blocks in the vertical right direction of the current block, which can be called vertical right neighboring blocks. According to the projection results of the current block in each angle direction, the neighboring blocks of the current block in the horizontal angle direction 0 include at least part of the horizontal neighboring blocks, the neighboring blocks in the vertical direction 1 include at least part of the vertical neighboring blocks, the neighboring blocks in the horizontal upward direction 2 include horizontal upward neighboring blocks, at least part of the horizontal neighboring blocks and at least part of the vertical neighboring blocks, the neighboring blocks in the horizontal downward direction 3 include at least part of the horizontal neighboring blocks and at least part of the horizontal downward neighboring blocks, and the neighboring blocks in the vertical right direction 4 include at least part of the vertical neighboring blocks and at least part of the vertical right neighboring blocks. In this case, the candidate neighboring block list constructed for the current block can be {C ₁ ~C _N , A ₁ ~A _N , E, B ₁ ~B _N , D ₁ ~D _N }. In addition to recording the number/identification of each neighboring block, the candidate neighboring block list of the current block also records the motion information of the neighboring block. The motion information may include a motion vector and reference frame index information (forward reference frame index information and/or backward reference frame index information).

S120: Setting motion information for the unavailable neighboring blocks.

Since the available neighboring blocks have motion information and the unavailable neighboring blocks do not have motion information, it is necessary to set motion information for the unavailable neighboring blocks.

In a specific implementation, the initial value (motion vector is 0, forward/backward reference frame index is -1) can be directly set as the motion information of the unavailable neighboring block, wherein, if the reference frame index of the neighboring block is -1, it means that the reference frame of the neighboring block does not exist.

In another specific implementation, motion information may be set for the unavailable neighboring block based on motion information of the temporal co-located block of the current unavailable neighboring block. For the specific implementation process, please refer to the following embodiments. The temporal co-located block is a co-located block of the current unavailable neighboring block in a reference frame of the reference frame list of the current frame, for example, a co-located block in the first reference frame (reference frame index is 0).

S130: Check the motion information duplication of neighboring blocks in each angular direction, and the angular direction that passes the duplication check is the valid angular direction.

For specific methods of checking for duplicate content, please refer to the following examples.

S140: Using the motion information of the reference block of the unavailable neighboring block in the effective angle direction, modify the motion information of the unavailable neighboring block in the effective angle direction.

The reference block may be a previous neighboring block of the unavailable neighboring block, or a subsequent neighboring block of the unavailable neighboring block, or a time-domain co-located block of the unavailable neighboring block, etc.

S150: Calculate the prediction value of the current block using the motion information of the available neighboring blocks and/or the unavailable neighboring blocks in each valid angle direction respectively.

The current block can be divided into multiple sub-blocks. Referring to the concept of intra-frame prediction, for each valid angle direction, the motion information of each sub-block can be determined according to the motion information of the corresponding neighboring block in the direction, and then the motion information is used to perform motion compensation on the sub-block to obtain the prediction value of the sub-block. The prediction values of all sub-blocks constitute the prediction value of the current block. After obtaining the prediction value of the current block, the rate-distortion cost can also be calculated based on the prediction value and the original value of the current block. Performing the above process for each valid angle direction can obtain the prediction values and rate-distortion costs of all valid angle directions.

The corresponding neighboring block of a sub-block in an effective angle direction refers to the neighboring block determined by projecting the sub-block onto the encoded side of the current block according to the effective angle direction.

If the current valid angle direction includes available neighboring blocks and unavailable neighboring blocks, the motion information of the neighboring blocks includes the motion information of the available neighboring blocks and the motion information of the unavailable neighboring blocks; if the current valid angle direction only includes available neighboring blocks, the motion information of the neighboring blocks includes the motion information of the available neighboring blocks; if the current valid angle direction only includes unavailable neighboring blocks, the motion information of the neighboring blocks includes the motion information of the unavailable neighboring blocks.

In this embodiment, after the valid angle direction is obtained through duplication checking, only the motion information of the unavailable neighboring blocks in the valid angle direction is modified. Compared with the method of modifying the motion information of the unavailable neighboring blocks in each angle direction, the computational overhead can be reduced.

FIG3 is a flow chart of the second embodiment of the angle mode inter-frame prediction method of the present application. It should be noted that if there is substantially the same result, this embodiment is not limited to the flow sequence shown in FIG3. This embodiment is a further extension of the above S140. As shown in FIG3, this embodiment may include:

S210: Sort the neighboring blocks in the effective angle direction according to the modification order.

Neighboring blocks in different angles may be repeated. When sorting, they are not sorted independently according to each valid angle direction, but all neighboring blocks in valid angle directions are collected, the repeated parts are removed, and sorted according to their relative positions to the current block. The modification order can be clockwise, counterclockwise, etc.

It should be noted that the sorting order of the neighboring blocks in the effective angle direction is the same as the sorting order of the neighboring blocks in the candidate neighboring block list.

S220: Determine whether the first neighboring block after sorting is an unavailable neighboring block.

The first neighbor block after sorting the neighbor blocks in the effective angle direction may be different from the first neighbor block in the candidate list.

If yes, execute S230.

S230: Modify the motion information of the first neighboring block by using the motion information of the previous neighboring block and/or the next neighboring block of the sorted first neighboring block in the candidate neighboring block list.

In a specific implementation, if the previous neighboring block of the first neighboring block is an available neighboring block, the motion information of the first neighboring block is modified using the motion information of the previous neighboring block of the first neighboring block; otherwise, the motion information of the first neighboring block is set to an initial value.

In another specific implementation, if the next neighboring block of the first neighboring block is an available neighboring block, the motion information of the first neighboring block is modified using the motion information of the next neighboring block of the first neighboring block, otherwise the motion information of the first neighboring block is set to an initial value.

In another specific implementation, if the previous neighboring block of the first neighboring block is an available neighboring block, the motion information of the first neighboring block is modified by using the motion information of the previous neighboring block of the first neighboring block, otherwise, it is determined whether the next neighboring block of the first neighboring block is an available neighboring block, and if so, the motion information of the first neighboring block is modified by using the motion information of the next neighboring block of the first neighboring block, otherwise, the motion information of the first neighboring block is set to an initial value; or

In another specific implementation, if the previous neighboring block and the next neighboring block of the first neighboring block are both available neighboring blocks, the motion information of the first neighboring block is modified using the weighted average of the motion information of the previous neighboring block and the next neighboring block of the first neighboring block; if one of the previous neighboring block and the next neighboring block of the first neighboring block is an available neighboring block, the motion information of the first neighboring block is modified using the motion information of the available neighboring block in the previous neighboring block and the next neighboring block; if the previous neighboring block and the next neighboring block of the first neighboring block are both unavailable neighboring blocks, the motion information of the first neighboring block is set to an initial value.

In this embodiment, different motion information modification strategies are adopted for the first neighboring block according to whether the first neighboring block after sorting the neighboring blocks in the effective angle direction is an unavailable neighboring block, thereby improving the encoding accuracy.

FIG4 is a flow chart of the third embodiment of the angle mode inter-frame prediction method of the present application. It should be noted that if there is substantially the same result, this embodiment is not limited to the flow sequence shown in FIG4. This embodiment is a further extension of the above S140. As shown in FIG4, this embodiment may include:

S310: Sort the neighboring blocks in the effective angle direction according to the modification order.

S320: Determine whether the first neighboring block after sorting is an unavailable neighboring block.

If yes, execute S330.

S330: Determine whether the time-domain co-located block of the first neighboring block is available.

Optionally, the frame where the time-domain co-located block of the first neighboring block is located is a reference frame in the reference frame list of the current block, and the position and size of the time-domain co-located block in the reference frame are exactly the same as the position and size of the first neighboring block in the current frame.

Whether the time-domain co-located block is available can be understood as whether the time-domain co-located block has motion information, or can be understood as whether the time-domain co-located block adopts inter-frame prediction coding.

If yes, execute S340.

S340: Modify the motion information of the first neighboring block using the motion information of the time-domain co-located block of the first neighboring block.

For other detailed descriptions of the steps of this embodiment, please refer to the previous embodiments and will not be repeated here.

In this embodiment, different motion information modification strategies are adopted for the first neighboring block according to whether the first neighboring block after sorting the neighboring blocks in the effective angle direction is an unavailable neighboring block, thereby improving the encoding accuracy.

FIG5 is a flowchart of a fourth embodiment of the angle mode inter-frame prediction method of the present application. It should be noted that if there is substantially the same result, this embodiment is not limited to the flow sequence shown in FIG5. This embodiment is a further extension of the above S120. As shown in FIG5, this embodiment may include:

S410: Determine whether the time-domain co-located block of the unavailable neighboring block is available.

If yes, execute S420; if no, execute S430.

S420: Using the motion information of the time-domain co-located block to set motion information for the unavailable neighboring block.

In a specific implementation, the motion information of the time-domain co-located block may be used as the motion information of the unavailable neighboring block.

In another specific implementation, the forward motion information of the unavailable neighboring block may be set to the forward motion information or backward motion information of the forward co-located block, and the backward motion information of the unavailable neighboring block may be set to the backward motion information or forward motion information of the backward co-located block. The frame where the forward co-located block is located is the reference frame in the forward reference frame list of the current block, and the frame where the backward co-located block is located is the reference frame in the backward reference frame list of the current block.

When a forward reference frame of the forward co-located block exists, the forward motion information of the unavailable neighboring block can be set as the forward motion information of the forward co-located block; or, when a backward reference frame of the forward co-located block exists, the forward motion information of the unavailable neighboring block can be set as the backward motion information of the forward co-located block.

When a backward reference frame of a backward co-located block exists, the backward motion information of the unavailable neighboring block can be set as the backward motion information of the backward co-located block; or, when a forward reference frame of the backward co-located block exists, the backward motion information of the unavailable neighboring block can be set as the forward motion information of the backward co-located block.

In yet another specific implementation, the forward motion information or the backward motion information of the temporal co-located block may be scaled according to the image sequence index difference and used as the forward motion information and the backward motion information of the unavailable neighboring block.

It is understandable that each frame of image has a corresponding picture order index (POC, Picture Order Count), which can represent the order in which the images are played. The formula for scaling according to the difference in the picture order index can be as follows:

scale_MV＝MV/t0*t1，

t1＝POC0-POC1,

t0＝POC2-POC3，

Among them, scale_MV is the forward/backward motion information of the currently unavailable neighboring block, and MV is the forward/backward motion information of the co-located block in the time domain.

When the current frame is a B frame (bidirectional difference frame), it is necessary to calculate the forward motion information and backward motion information of the currently unavailable neighboring blocks.

If scale_MV is the forward motion information of the currently unavailable neighboring block, t1 is the difference (distance) between POC1 of the current frame and POC0 of the forward reference frame of the current frame, and t0 is the difference between POC2 of the frame where the temporal co-located block is located and POC3 of the forward/backward reference frame of the temporal co-located block.

If scale_MV is the backward motion information of the currently unavailable neighboring block, t1 is the difference between POC1 of the current frame and POC0 of the backward reference frame of the current frame, and t0 is the difference between POC2 of the frame where the temporal co-located block is located and POC3 of the forward/backward reference frame of the temporal co-located block.

When the current frame is a P frame (one-way difference frame), only the forward motion information of the currently unavailable neighboring block needs to be calculated. t1 is the difference between POC1 of the current frame and POC0 of the reference frame of the current frame, and t0 is the difference between POC2 of the frame where the temporal co-located block is located and POC3 of the forward/backward reference frame of the temporal co-located block.

S430: Setting the initial value to the motion information of the unavailable neighboring block.

As mentioned above, the initial value of the motion vector is set to 0, and the motion information of the reference frame index is set to -1.

Through the implementation of this embodiment, when the time domain co-located block of the unavailable neighboring block is available, the motion information of the unavailable neighboring block can be set based on the time domain co-located block, and when the time domain co-located block of the unavailable neighboring block is unavailable, the motion information of the unavailable neighboring block is considered to be set to the initial value. Compared with the method of directly setting the motion information of the unavailable neighboring block to the initial value, the error caused by the motion information set for the unavailable neighboring block can be reduced, and the accuracy of encoding can be improved.

FIG6 is a flowchart of the fifth embodiment of the angle mode inter-frame prediction method of the present application. It should be noted that if there is substantially the same result, this embodiment is not limited to the flow sequence shown in FIG6. As shown in FIG6, this embodiment may include:

S510: Construct a candidate neighbor block list for the current block.

The candidate neighbor block list includes neighbor blocks of the current block in multiple angular directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

S520: Determine whether the time-domain co-located block of the unavailable neighboring block is available.

The frame where the temporal co-located block is located is the first reference frame in the reference frame list of the current block.

If yes, execute S530; if no, execute S540.

S530: Use the motion information of the time-domain co-located block to set motion information for the unavailable neighboring block.

In a specific implementation, the motion information of the time-domain co-located block may be used as the motion information of the unavailable neighboring block.

In another specific implementation, the forward motion information of the unavailable neighboring block may be set to the forward motion information or backward motion information of the forward co-located block, and the backward motion information of the unavailable neighboring block may be set to the backward motion information or forward motion information of the backward co-located block. The frame where the forward co-located block is located is the reference frame in the forward reference frame list of the current block, and the frame where the backward co-located block is located is the reference frame in the backward reference frame list of the current block.

In yet another specific implementation, the forward motion information or the backward motion information of the temporal co-located block is scaled according to the image sequence index difference and used as the forward motion information and the backward motion information of the unavailable neighboring block.

After executing S530, jump to S550.

S540: Setting the initial value to the motion information of the unavailable neighboring block.

After executing S540, jump to S550.

S550: Check the motion information duplication of neighboring blocks in each angular direction, and the angular direction that passes the duplication check is a valid angular direction.

S560: Using the motion information of the reference block of the unavailable neighboring block whose motion information is the initial value, modify the motion information of the available neighboring block whose motion information is the initial value.

For specific modification methods, please refer to other embodiments in this application.

S570: Calculate the prediction value of the current block using the motion information of the available neighboring blocks and the unavailable neighboring blocks in each valid angle direction respectively.

For other detailed descriptions of the steps of this embodiment, please refer to the previous embodiments and will not be repeated here.

In the present embodiment, when it is determined that the time-domain co-located block of the unavailable neighboring block is available, the motion information of the unavailable neighboring block is configured using the motion information of the time-domain co-located block. When it is determined that the time-domain co-located block of the unavailable neighboring block is unavailable, the motion information of the unavailable neighboring block is set to the initial value. Compared with the method of directly setting the motion information of the unavailable neighboring block to the initial value, the error caused by the motion information configuration for the unavailable neighboring block can be reduced. Furthermore, after the motion information of the neighboring blocks in each angular direction is checked for duplication to obtain the valid angular direction, only the motion information of the unavailable neighboring block whose motion information is the initial value is modified. Compared with the method of directly modifying the motion information of each unavailable neighboring block, the computational overhead required to modify the motion information of the unavailable neighboring block can be reduced.

FIG7 is a flowchart of the sixth embodiment of the angle mode inter-frame prediction method of the present application. It should be noted that if there is substantially the same result, this embodiment is not limited to the flow sequence shown in FIG7. As shown in FIG7, this embodiment may include:

S610: Construct a candidate neighbor block list for the current block.

The candidate neighbor block list includes neighbor blocks of the current block in multiple angular directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

S620: Set motion information for the unavailable neighboring block.

S630: Select at least one pair of neighboring blocks in each angular direction according to the size of the current block to perform motion information duplication check, and the angular direction that passes the duplication check is a valid angular direction.

Optionally, the selected neighboring blocks in the same angular direction are arranged at equal distances. Of course, in other implementations, the neighboring blocks in the same angular direction may also be selected in other ways (such as randomly).

Generally speaking, the accuracy of the effective angle direction obtained from the duplicate check depends on the number of duplicate checks, the size of the current block, etc. Among them, when the size is consistent, the more duplicate checks are performed in each angle direction of the current block, the more accurate the effective angle direction obtained from the duplicate check result. When the number of duplicate checks is consistent, the effective angle direction of the current block with a smaller size is more accurate than that of the current block with a larger size.

Therefore, for a current block with a relatively large size, the number of neighboring blocks selected in each angle direction can be increased, that is, the number of duplicate checking times can be increased. Referring to FIG8 , the specific implementation process may include:

S631: Determine whether the width/height of the current block is greater than a first threshold.

A current block whose width/height is greater than the first threshold may be regarded as a current block of relatively large size, and a current block whose width/height is less than or equal to the first threshold may be regarded as a current block of relatively small size. For example, the first threshold may be set to 32.

If yes, execute S632; if no, execute S633.

S632: Select a first number of neighboring blocks in the direction corresponding to the width/height to check for duplication.

If the width is greater than the first threshold, a first number of neighboring blocks are selected in the direction corresponding to the width for duplication checking; if the height is greater than the first threshold, a first number of neighboring blocks are selected in the direction corresponding to the height for duplication checking. The direction corresponding to the width includes vertical and/or vertical to the right, and the direction corresponding to the height includes horizontal and/or horizontal downward.

In conjunction with FIG9 , an example is given of a case where both the width and the height are greater than the first threshold (32) (the current block size is 64×64).

As shown in Fig. 9, four equidistant neighboring blocks are selected in the direction corresponding to the width (vertical and vertical to the right) for duplicate checking. Among them, B1, _BK , _B2K and _B3K are selected from the neighboring blocks _B1 to _B2N in the vertical direction, N=64, K=N/4, and _D1 , _DK , _D2K and _D3K are selected from the neighboring blocks _D1 to _DN in the vertical right direction, _so that the neighboring block pairs that need to be checked for duplicates in the direction corresponding to the width include ( _B1 , _BK ), ( _BK , _B2K ), ( _B2K , _B3K ), ( _B3K , _D1 ), ( _D1 , _DK ) and ( _DK , _D2K ).

In the high corresponding direction (horizontally and horizontally downward), four equidistant neighboring blocks are selected for duplication checking. Among them, _A1 , _AK , _A2K and _A3K are selected from the neighboring blocks _A1 to _AN in the horizontal direction, and _C1 , _CK , _C2K and _C3K are selected from the neighboring blocks _C1 to _CN in the horizontal downward direction. Therefore, the neighboring block pairs that need to be checked for duplication in the high corresponding direction include ( _A1 , _AK ), ( _AK , _A2K ), ( _A2K , _A3K ), ( _A3K , _C1 ), ( _C1 , _CK ), ( _CK , _C2K ) and ( _C2K , _C3K ).

In addition, the neighboring block pairs that need to be checked for duplication in the horizontal upward direction include (A ₁ , E) and (E, B ₁ ).

S633: Select a second number of neighboring blocks in the direction corresponding to the width/height to check for duplication.

The first number is greater than the second number, and the second number is greater than 1.

In conjunction with FIG10 , an example is given of the case where both the width and the height are equal to the first threshold (32) (the current block size is 32×32).

As shown in Fig. 10, two equidistant neighboring blocks are selected in the direction corresponding to the width (vertical and vertical to the right) for duplication checking. Among them, _B1 and _BK are selected from the neighboring blocks _B1 to _BN in the vertical direction, N=32, K=N/2, and _D1 and _DK are selected from the neighboring blocks _D1 to _DN in the vertical right direction, so that the neighboring block pairs that need to be checked for duplication in the direction corresponding to the width include ( _B1 , _BK ), ( _BK , _D1 ) and ( _D1 , _DK ).

Two neighboring blocks are selected in the high corresponding direction (horizontally and horizontally downward) for duplication checking. Among them, _A1 and _AK are selected from the neighboring blocks _A1 to _AN in the horizontal direction, and _C1 and _CK are selected from the neighboring blocks _C1 to _CN in the horizontal downward direction. Therefore, the neighboring block pairs that need to be checked for duplication in the high corresponding direction include ( _A1 , _AK ), ( _AK , _C1 ) and ( _C1 , _CK ).

In addition, the neighboring block pairs that need to be checked for duplication in the horizontal upward direction include (A ₁ , E) and (E, B ₁ ).

S640: Modify the motion information of the available neighboring block by using the motion information of the reference block of the unavailable neighboring block.

The motion information of the unavailable neighboring blocks in the valid direction may be modified only, or the motion information of the unavailable neighboring blocks in all directions may be modified.

S650: Calculate the prediction value of the current block using the motion information of the available neighboring blocks and/or the unavailable neighboring blocks in each valid angle direction respectively.

For other detailed descriptions of the steps of this embodiment, please refer to the previous embodiments and will not be repeated here.

In this embodiment, the number of neighboring blocks selected for duplication checking in each angular direction is determined based on the size of the current block. Compared with the method of selecting the same number of neighboring blocks for duplication checking in each angular direction for current blocks of all sizes, the final selected effective angular direction can be more accurate.

FIG11 is a flowchart of the seventh embodiment of the angle mode inter-frame prediction method of the present application. It should be noted that if there is substantially the same result, this embodiment is not limited to the flow sequence shown in FIG11. As shown in FIG11, this embodiment may include:

S710: Construct a candidate neighbor block list for the current block.

The candidate neighbor block list includes neighbor blocks of the current block in multiple angular directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

S720: Set motion information for the unavailable neighboring block.

S730: Check the motion information duplication of neighboring blocks in each angular direction, and the angular direction that passes the duplication check is the valid angular direction.

If the angle direction meets the first condition, at least one duplicate check is added.

In a specific implementation, the first condition may be that the horizontal and/or vertical directions fail to pass the plagiarism check. If the horizontal and/or vertical directions fail to pass the plagiarism check, at least one additional plagiarism check is performed.

Taking adding a duplicate check as an example, the neighboring blocks include N horizontal neighboring blocks located in the horizontal direction of the current block and N vertical neighboring blocks located in the vertical direction of the current block. The duplicate check added in the horizontal direction is the duplicate check between the Kth and Nth horizontal neighboring blocks sorted from top to bottom, and the duplicate check added in the vertical direction is the duplicate check between the Kth and Nth vertical neighboring blocks sorted from left to right. K=N/i, i is the number of horizontal neighboring blocks or vertical neighboring blocks selected in the completed duplicate check.

In one specific embodiment, i can be 2.

The case where the horizontal and vertical directions fail to pass the plagiarism check is illustrated in combination with FIG12. As shown in FIG12, if the neighboring block pair ( _A1 , _AK ) in the horizontal direction fails to pass the plagiarism check, then the neighboring block pair ( _AK , _AN ) is additionally checked in the horizontal direction; if the neighboring block pair ( _B1 , _BK ) in the vertical direction fails to pass the plagiarism check, then the neighboring block pair ( _BK , _BN ) is additionally checked in the vertical direction.

If the duplicate check fails in the horizontal and/or vertical directions, at least one additional duplicate check is performed, so that a valid angle direction can be selected based on the results of multiple duplicate checks, thereby improving the accuracy of the duplicate check and further improving the accuracy of the valid angle direction finally selected.

In another specific embodiment, the first condition may be that the angle direction is horizontally downward or vertically rightward. If the angle direction is horizontally downward or vertically rightward, at least one duplicate check is added.

Since the neighboring blocks in the horizontal downward and vertical right directions are not completely checked for plagiarism during the plagiarism checking process, in order to improve the accuracy of the plagiarism checking, at least one plagiarism check can be added in the horizontal downward and vertical right directions.

Optionally, the neighboring blocks include N horizontal neighboring blocks located in the horizontal direction of the current block and N vertical neighboring blocks located in the vertical direction of the current block. The plagiarism check increased in the horizontal downward direction is the plagiarism check between two horizontal neighboring blocks, and the plagiarism check increased in the vertical rightward direction is the plagiarism check between two vertical neighboring blocks.

Taking adding a plagiarism check as an example, the plagiarism check added in the horizontal downward direction is the plagiarism check between the 3rd and Kth horizontal neighboring blocks sorted from top to bottom, and the plagiarism check added in the vertical rightward direction is the plagiarism check between the 3rd and Kth vertical neighboring blocks sorted from left to right. K=N/i, i is the number of horizontal/vertical neighboring blocks selected in the horizontal/vertical direction plagiarism check.

An example is given in conjunction with FIG13 . As shown in FIG13 , the duplication check for the adjacent block pair (A ₃ , _AK ) is increased in the horizontal downward direction, and the duplication check for the adjacent block pair (B ₃ , _BK ) is increased in the vertical rightward direction.

In another specific implementation, the first condition may be that the duplicate checking result of the angle direction that failed the duplicate checking includes that the reference frames of a pair of adjacent blocks do not exist. If the duplicate checking result of the angle direction that failed the duplicate checking includes that the reference frames of a pair of adjacent blocks do not exist, at least one duplicate checking is added for the angle direction that failed the duplicate checking.

Among them, the serial numbers of at least one pair of neighboring blocks that do not exist in any reference frame can be shifted, and each pair of neighboring blocks after the shift still belongs to an angle direction that has not passed the duplication check, which is different from the serial numbers of a pair of neighboring blocks that do not exist in any reference frame. The motion information of at least one pair of neighboring blocks after the shift is checked for duplication.

An example is given in conjunction with FIG14 . As shown in FIG14 , the reference frames of the two neighboring blocks in the neighboring block pair (A ₁ , _AK ) do not exist. The serial numbers of the two neighboring blocks in the neighboring block pair are shifted one position in the same direction to obtain the neighboring block pair (A ₂ , _AK+1 ). Then, motion information duplication is checked for (A ₂ , _AK+1 ).

And/or, a pair of neighboring blocks in which no reference frame exists and which are located in a direction away from the current block may be selected for motion information duplication checking.

An example is given in conjunction with FIG. 15 . As shown in FIG. 15 , the reference frames of the two neighboring blocks in the neighboring block pair (A ₁ , _AK ) do not exist, and the neighboring block pair (a ₁ , a _K ) consisting of the two neighboring blocks in the direction away from the current block is subjected to motion information duplication check.

S740: Modify the motion information of the unavailable neighboring block by using the motion information of the reference block of the unavailable neighboring block.

S750: Calculate the prediction value of the current block by using the motion information of the available neighboring blocks and/or unavailable neighboring blocks in each of the effective angle directions respectively.

For other detailed descriptions of the steps of this embodiment, please refer to the previous embodiments and will not be repeated here.

In this embodiment, when checking for duplicate motion information of neighboring blocks, if the angle direction satisfies the first condition, adding at least one duplication check can make the duplication check result more accurate, and thus the obtained effective angle direction more accurate.

FIG16 is a flowchart of the eighth embodiment of the angle mode inter-frame prediction method of the present application. It should be noted that if there is substantially the same result, this embodiment is not limited to the flow sequence shown in FIG16. As shown in FIG16, this embodiment may include:

S810: Construct a candidate neighbor block list for the current block.

The candidate neighbor block list includes neighbor blocks of the current block in multiple angular directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

S820: Set motion information for the unavailable neighboring block.

S830: Check the motion information duplication of neighboring blocks in each angular direction, and the angular direction that passes the duplication check is the valid angular direction.

If at least two of the horizontal, vertical and horizontal upward plagiarism checking results meet the second condition, then at least one horizontal upward plagiarism check is reduced.

Optionally, the horizontal upward plagiarism check includes a first plagiarism check and a second plagiarism check, the first plagiarism check is to check the motion information between the horizontal upward neighboring block and the first horizontal neighboring block, and the second plagiarism check is to check the motion information between the horizontal upward neighboring block and the first vertical neighboring block. The horizontal upward neighboring block is located in the horizontal upward direction of the current block, the first horizontal neighboring block is located in the horizontal direction of the current block and adjacent to the horizontal upward neighboring block, and the first vertical neighboring block is located in the vertical direction of the current block and adjacent to the horizontal upward neighboring block.

If at least two of the horizontal, vertical, and horizontal-upward duplicate checking results meet the second condition, reducing at least one horizontal-upward duplicate checking includes:

In a specific implementation, the second condition may be: both horizontal and vertical are valid angle directions.

If both horizontal and vertical are valid angle directions, there is no need to check for duplication in horizontal upward direction and horizontal upward direction can be determined as a valid angle direction.

Take Figure 17 for example. As shown in Figure 17, (A ₁ , _AK ) is a pair of neighboring blocks in the horizontal direction that pass the motion information duplication check, and (B ₁ , _BK ) is a pair of neighboring blocks in the vertical direction that pass the motion information duplication check, that is, both horizontal and vertical are valid angle directions, so there is no need to perform motion information duplication check on the horizontal neighboring block pairs (A ₁ , E) and (E, B ₁ ).

In another specific implementation, the second condition may be: horizontal is a valid angle direction and one of the first and second plagiarism checks is valid.

If horizontal is a valid angle direction and one of the first and second plagiarism checks is valid, there is no need to perform the other of the first and second plagiarism checks and it is determined that horizontal upward is a valid angle direction.

An example is given in conjunction with Figure 18. As shown in Figure 18, the neighboring block pair ( _A1 , _AK ) in the horizontal direction passes the motion information duplication check, that is, the horizontal direction is valid, and the neighboring block pair (E, _B1 ) in the horizontal upward direction passes the motion information duplication check, that is, the second duplication check result is valid, then there is no need to perform motion information duplication check on the neighboring block pair ( _A1 , E) in the horizontal upward direction, that is, there is no need to perform the first duplication check, and it can be determined that the horizontal upward direction is a valid angle direction.

In another specific implementation, the second condition may be: vertical is a valid angle direction and one of the first and second plagiarism checks is valid.

If vertical is a valid angle direction and one of the first and second plagiarism checks is valid, there is no need to perform the other of the first and second plagiarism checks and it is determined that horizontal upward is a valid angle direction.

An example is given in conjunction with Figure 19. As shown in Figure 19, the neighboring block pair (B ₁ , B _K ) in the vertical direction passes the motion information duplication check, that is, the vertical direction is valid, and the neighboring block pair (A ₁ , E) in the horizontal upward direction passes the motion information duplication check, that is, the result of the first duplication check is valid, then there is no need to perform motion information duplication check on the neighboring block pair (E, B ₁ ) in the horizontal upward direction, that is, there is no need to perform the second duplication check, and it can be determined that the horizontal upward direction is a valid angle direction.

S840: Modify the motion information of the unavailable neighboring block by using the motion information of the reference block of the unavailable neighboring block.

S850: Calculate the prediction value of the current block using the motion information of the available neighboring blocks and/or unavailable neighboring blocks in each valid angle direction respectively.

For other detailed descriptions of the steps of this embodiment, please refer to the previous embodiments and will not be repeated here.

In this embodiment, when checking for plagiarism on neighboring blocks, if at least two of the horizontal, vertical and horizontal upward plagiarism checking results meet the second condition, at least one horizontal upward plagiarism check is reduced. Compared with the method of checking for plagiarism twice for each horizontal upward, the computational overhead required in the plagiarism checking process can be reduced.

FIG20 is a flowchart of the ninth embodiment of the angle mode inter-frame prediction method of the present application. It should be noted that if there is substantially the same result, this embodiment is not limited to the flow sequence shown in FIG20. As shown in FIG20, this embodiment may include:

S910: Construct a candidate neighbor block list for the current block.

The candidate neighbor block list includes neighbor blocks of the current block in multiple angular directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

S920: Set motion information for the unavailable neighboring block.

S930: Check the motion information of neighboring blocks in each angular direction for duplication, and the angular direction for duplication checking is a valid angular direction. The duplication checking includes determining whether the image sequence indexes of the reference frames of at least one pair of selected neighboring blocks are the same and whether the motion vectors are the same.

When the image sequence index and motion vector of the reference frame of the neighboring block pair in an angle direction are the same, the angle direction is determined to be invalid.

In addition, the duplicate checking may also include determining whether the reference frame index of at least one pair of selected neighboring blocks is the same. When the duplicate checking includes determining whether the reference frame index, the motion vector and the image order index of the reference frame are the same, the determination order of the three may not be limited.

The following takes the example of first determining the reference frame index and motion vector, and then determining whether the image order index of the reference frame is the same, to illustrate the process of checking for duplicates of two neighboring blocks Nei_b1 and Nei_b2 in an angle direction:

(i) Determine whether the forward reference frame and the backward reference frame of Nei_b1 exist (whether the reference frame index is greater than or equal to 0). If one of them exists, proceed to (ii); otherwise, determine that the angle direction is invalid.

(ii) Determine whether the forward reference frame and backward reference frame of Nei_b2 exist. If one of them exists, proceed to (iii); otherwise, determine that the angle direction is invalid.

(iii) Determine whether the forward reference frame indexes of Nei_b1 and Nei_b2 are the same. If they are the same, proceed to (iv); otherwise, determine that the angle direction is invalid.

(iv) Determine whether the forward reference frame of Nei_b1 exists and whether the forward reference motion vectors of Nei_b1 and Nei_b2 are the same. If they exist and are not the same, determine that this angle direction is valid, otherwise proceed to (v).

(v) Determine whether the backward reference frame indexes of Nei_b1 and Nei_b2 are the same. If they are the same, proceed to (vi). Otherwise, determine that this angle direction is valid.

(vi) Determine whether the backward reference frame of Nei_b1 exists and whether the backward reference motion vectors of Nei_b1 and Nei_b2 are the same. If they exist and are not the same, determine that this angle direction is valid, otherwise proceed to (vii).

(vii) Determine whether the image order indexes of the reference frames of Nei_b1 and Nei_b2 are the same. If they are the same, determine that the angle direction is invalid; otherwise, determine that the angle direction is valid.

For reference frames with the same image sequence index, their reference frame indexes in the forward reference frame index list and/or backward reference frame index list of different neighboring blocks may be different. Therefore, if the judgment is only based on the reference frame index and the motion vector, there may be a situation where the reference frame indexes in the motion information of two neighboring blocks are different, so that the corresponding angle direction is judged to be valid. However, the image sequence indexes of the reference frames of the two neighboring blocks are the same, and the motion vectors are also the same. In fact, the motion information of the two neighboring blocks is the same, and the corresponding angle direction should be invalid. Therefore, it is possible to increase the judgment of whether the image sequence indexes of the reference frames are the same during the duplicate checking process, which can improve the accuracy of the judgment result.

S940: Modify the motion information of the unavailable neighboring block by using the motion information of the reference block of the unavailable neighboring block.

S950: Calculate the prediction value of the current block using the motion information of the available neighboring blocks and/or unavailable neighboring blocks in each valid angle direction respectively.

For other detailed descriptions of the steps of this embodiment, please refer to other embodiments in this application and will not be repeated here.

In this embodiment, the process of checking for duplicate motion information in neighboring blocks includes determining whether the image sequence indexes of the reference frames of at least one pair of selected neighboring blocks are the same and whether the motion vectors are the same. Only when the image sequence indexes of the reference frames are the same and the motion vectors are the same, is it determined that the angle direction is invalid, thereby making the determination result more accurate.

FIG21 is a flowchart of the tenth embodiment of the angle mode inter-frame prediction method of the present application. It should be noted that if there is substantially the same result, this embodiment is not limited to the flow sequence shown in FIG21. As shown in FIG21, this embodiment may include:

S1010: Construct a candidate neighbor block list for the current block.

The candidate neighbor block list includes neighbor blocks of the current block in multiple angular directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

S1020: Set motion information for the unavailable neighboring block.

S1030: Check the motion information duplication of neighboring blocks in each angular direction, and the angular direction that passes the duplication check is the valid angular direction.

S1040: Modify the motion information of the unavailable neighboring block by using the motion information of the reference block of the unavailable neighboring block.

S1050: The current block is divided into a plurality of sub-blocks, and motion compensation is performed using motion information of a corresponding neighboring block of each sub-block in a valid angle direction to obtain a prediction value of each sub-block.

The prediction values of all sub-blocks constitute the prediction value of the current block, wherein the motion information of at least two corresponding neighboring blocks is used when performing motion compensation on the sub-blocks in at least one valid angular direction.

In a specific embodiment, the current block is divided into multiple first sub-blocks of a first size, each first sub-block is composed of multiple second sub-blocks of a second size, and in at least one effective angle direction, the motion vector of at least one first sub-block is a weighted average of motion vectors of at least two corresponding neighboring blocks.

Optionally, the first size is 8*8 and the second size is 4*4.

The method for calculating the motion vector of a first sub-block (with a size of 8*8) in the horizontal and vertical directions is described in conjunction with FIG. 22 .

The weighted average of the motion vectors of the two corresponding horizontal neighboring blocks ( _AK-1 and _AK ) may be used as the motion vector of the first sub-block in the horizontal direction. The specific calculation formula may be as follows:

Wherein, MV_Hor is the motion vector of the first sub-block in the horizontal direction, MV(A _k ) is the motion vector of A _K , and MV(A _k-1 ) is the motion vector of A _k-1 .

The weighted average of the motion vectors of the two corresponding vertical neighboring blocks (B _K-1 and B _K ) may be used as the motion vector of the first sub-block in the vertical direction. The specific calculation formula may be as follows:

Wherein, MV_Ver is the motion vector of the first sub-block in the horizontal direction, MV(B _k ) is the motion vector of B _k , and MV(B _k-1 ) is the motion vector of B _k-1 .

When calculating the motion vector of the first sub-block, the above manner of calculating the motion vector of the first sub-block in the vertical and horizontal directions is also applicable when calculating the motion vector of the first sub-block in other directions.

For other detailed descriptions of the steps of this embodiment, please refer to the previous embodiments and will not be repeated here.

In this embodiment, motion information of at least two corresponding neighboring blocks is used when performing motion compensation for the first sub-block in the effective angle direction. Compared with the method of performing motion compensation for the first sub-block using only the motion information of one corresponding neighboring block, a more accurate prediction value of the first sub-block can be obtained, thereby improving the encoding accuracy.

FIG23 is a flow chart of the eleventh embodiment of the angle mode inter-frame prediction method of the present application. It should be noted that if there is substantially the same result, this embodiment is not limited to the flow sequence shown in FIG23. As shown in FIG23, this embodiment may include:

S1110: Construct a candidate neighbor block list for the current block.

The candidate neighbor block list includes neighbor blocks of the current block in multiple angular directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

S1120: Set motion information for the unavailable neighboring block.

S1130: Check the motion information duplication of neighboring blocks in each angular direction, and the angular direction that passes the duplication check is the valid angular direction.

S1140: Fill the valid angle direction into the angle mode list to obtain the angle mode index of the valid angle direction.

When the angle mode inter prediction and other inter prediction modes are put into one mode index list, the index value range of the angle mode index in the mode index list is 4-8.

A separate mode list (i.e., angle mode list) can be set for the valid angles selected by the angle mode inter-frame prediction. After the valid angle direction selected by the angle mode inter-frame prediction is filled into the angle mode list, the value range of the obtained angle mode index is 0 to 4. Compared with the direction sharing a mode index list with other modes, less bit overhead is required in the subsequent encoding process. In addition, after the angle mode index is separated, the number of indexes in the shared mode list can be reduced.

S1150: Modify the motion information of the unavailable neighboring block by using the motion information of the reference block of the unavailable neighboring block.

In addition, after obtaining the prediction value of the current block, it can also include:

S1160: Calculate the prediction value and rate-distortion cost of the current block using the motion information of the neighboring blocks in each valid angle direction.

After calculating the prediction value and rate distortion cost of the current block, the rate distortion cost can be optimized together with other inter-frame modes to select the best inter-frame prediction mode to encode the current block. Therefore, based on this embodiment, the following steps can also be included:

S1170: Encode the current block to obtain a code stream of the current block.

The bitstream of the current block includes an angle mode flag, and the angle mode flag is used to indicate whether the current block adopts angle mode inter-frame prediction.

For other detailed descriptions of the steps of this embodiment, please refer to the previous embodiments and will not be repeated here.

Since the mode list corresponding to the selected inter-frame prediction mode needs to be encoded during the encoding process, in this embodiment, an independent angle mode list is set for angle mode inter-frame prediction, which can reduce the number of index lists in the original mode list, thereby reducing the length of the mode list that needs to be encoded during the encoding process and reducing the bit overhead (code rate) required during the encoding process.

FIG24 is a flowchart of the twelfth embodiment of the angle mode inter-frame prediction method of the present application. It should be noted that if there is substantially the same result, this embodiment is not limited to the flow sequence shown in FIG24. As shown in FIG24, this embodiment may include:

S1210: Construct a candidate neighbor block list for the current block.

The candidate neighbor block list includes neighbor blocks of the current block in multiple angular directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

S1220: Set motion information for the unavailable neighboring block.

S1230: Check the motion information duplication of neighboring blocks in each angular direction, and the angular direction that passes the duplication check is a valid angular direction.

S1240: Determine the order of each valid angle direction using the texture direction of the current block.

The order of the effective angle directions may be determined based on the gradient direction of the current block from the reference pixel. Referring to FIG. 25 , S1240 may specifically include:

S1241: Calculate the gradient direction of the reference pixel of the current block using a gradient operator.

The reference pixel may be a reference pixel of the current block in the intra prediction mode. The reference pixel is located on the coded side (e.g., left and top) of the current block. The gradient operator may be, but is not limited to, Roberts, Prewitt, Sobel, Laplace, Canny operator, etc. The Sobel operator and Laplace operator are used as examples for explanation below:

(1) The formula for calculating the gradient direction of the reference pixel of the current block using the Sobel operator can be as follows:

S _x =-a ₁ f(x-1,y-1)-a ₂ f(x-1,y)-a ₃ f(x-1,y+1)+a ₁ f(x+1,y -1)+a ₂ f(x+1,y)+a ₃ f(x+1,y+1)

S _y =-a ₁ f(x-1,y+1)-a ₂ f(x,y+1)-a ₃ f(x+1,y+1)+a ₁ f(x-1,y -1)+a ₂ f(x,y-1)+a ₃ f(x+1,y-1)

(2) The formula for calculating the gradient direction of the reference pixel of the current block using the Laplacian operator can be as follows:

S _x =a ₁ (f(x-1,y)+f(x+1,y))-a ₂ f(x,y)

S _y =a ₁ (f(x,y-1)+f(x,y+1))-a ₂ f(x,y)

Wherein, a ₁ , a ₂ and a ₃ are constants, f(x, y) is the pixel value of the reference pixel, S _x is the horizontal gradient of the reference pixel, _Sy is the vertical gradient of the reference pixel, and Angle is the gradient direction of the reference pixel.

S1242: Count the number of reference pixels whose gradient directions fall within the angle range centered on each valid angle direction.

The angle range may be determined according to actual needs. For example, the angle range centered on the horizontal direction may be 0°±15°, the angle range centered on the vertical direction may be 90°±15°, the angle range centered on the horizontal upward direction may be 135°±15°, the angle range centered on the horizontal downward direction may be -135°±15°, and the angle range centered on the vertical right direction may be 45°±15°.

S1243: Sort the valid angle directions in descending order of the number of reference pixels.

The valid angle directions are sorted in descending order according to the number of reference pixels falling within the angle range.

S1250: Fill the valid angle directions into the mode list in order.

S1260: Modify the motion information of the unavailable neighboring block by using the motion information of the reference block of the unavailable neighboring block.

S1270: Calculate the prediction value of the current block using the motion information of the available neighboring blocks and/or unavailable neighboring blocks in each valid angle direction respectively.

For other detailed descriptions of the steps of this embodiment, please refer to the previous embodiments and will not be repeated here.

In this embodiment, on the basis of selecting effective angle directions from multiple angle directions through the duplication checking process, the order of each effective angle direction is further determined according to the texture direction, that is, the number of reference pixels in the current block whose gradient direction falls within the angle range centered on each effective angle direction is counted, and the effective angle directions are sorted in descending order according to the number of reference pixels that fall within. Since the effective angle direction with a larger number of corresponding reference pixels is closer to the texture direction of the current block, the effective angle directions are filled into the pattern list in order, so that the effective angle direction close to the texture direction of the current block is ranked higher in the pattern list, and is easier to be selected during the encoding process, thereby improving the accuracy of the encoding and reducing the bit rate required for the encoding process.

FIG26 is a flowchart of the thirteenth embodiment of the angle mode inter-frame prediction method of the present application. It should be noted that if there is substantially the same result, this embodiment is not limited to the flow sequence shown in FIG25. As shown in FIG26, this embodiment may include:

S1301: Construct a candidate neighbor block list for the current block.

The candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks;

S1302: Set motion information for unavailable neighboring blocks.

S1303: Check the motion information duplication of neighboring blocks in each angular direction, and the angular direction that passes the duplication check is a valid angular direction.

S1304: Modify the motion information of the unavailable neighboring block by using the motion information of the reference block of the unavailable neighboring block.

S1305: The current block is divided into a plurality of sub-blocks, and the motion information of each sub-block is obtained by using the motion information of the corresponding neighboring block of each sub-block in the effective angle direction.

The motion information includes a motion vector. The motion information may include forward motion information and backward motion information, the forward motion information may include a forward motion vector and a forward reference frame index, and the backward motion information may include a backward motion vector and a backward reference frame index.

Each piece of motion information of the current sub-block may be obtained by using the motion information of the corresponding neighboring block of the current sub-block in each effective angle direction.

S1306: Correct the first prediction value of each sub-block using the multiple corrected motion vectors respectively to obtain multiple second prediction values of each sub-block.

The first prediction value is obtained by performing motion compensation using the motion information.

When the image order index of the forward reference frame of the current block is the same as the image order index of the backward reference frame, the first prediction value of each sub-block can be modified by using the decoding end motion vector refinement (DMVR) technology to obtain multiple second prediction values of each sub-block. The details are as follows:

Referring to FIG. 27 , S1306 may include the following sub-steps:

S13061: Use the multiple corrected motion vectors to correct the motion vector of each sub-block respectively, to obtain multiple corrected motion vectors of each sub-block.

The first prediction value may also be referred to as a first prediction pixel value, and each motion information of the current sub-block may be used to perform compensation to obtain the corresponding first prediction value. The first prediction value may include a forward first prediction value and a backward first prediction value, the forward first prediction value may be obtained by performing motion compensation using the forward motion information, and the backward first prediction value may be obtained by performing motion compensation using the backward motion information.

The block corresponding to the forward first prediction value of the current sub-block may be called the forward first prediction block, and the block corresponding to the backward first prediction value of the current sub-block may be called the backward first prediction block. In other words, the block pointed to by the forward motion information of the current sub-block may be called the forward first prediction block, and the block pointed to by the backward motion information of the current sub-block may be called the backward first prediction block.

Multiple modified motion vectors of each sub-block can be searched within the search range of the forward/backward first prediction block.

The search range of the forward first prediction block can be an N*N pixel range centered on the vertex of the forward first prediction block (the point where the upper left corner pixel is located). During the search, all pixel points within the search range can be traversed in a predetermined order, for example, all pixel points are traversed in a raster scanning order from left to right and from top to bottom to obtain N ² forward corrected motion vectors ΔMV1, where ΔMV1 is the motion vector from the vertex pointing to the search pixel point, or in other words, ΔMV1 is the motion vector from the forward first prediction block to the forward second prediction block (refer to the following description).

The search range of the backward first prediction block can be an N*N pixel range centered on the vertex of the backward first prediction block (the point where the lower right corner pixel is located). During the search, all pixel points within the search range can be traversed in a predetermined order to obtain N ² backward corrected motion vectors. For example, all pixel points are traversed in a raster scanning order from right to left and from bottom to top to obtain multiple backward corrected motion vectors ΔMV2, where ΔMV2 is the motion vector from the vertex pointing to the search pixel point, or in other words, ΔMV1 is the motion vector from the backward first prediction block to the backward second prediction block.

To simplify the description, an example of obtaining a forward modified motion vector ΔMV1 by searching within the search range of the forward first prediction block is used as an example to illustrate:

After finding the search point C, the forward first prediction block is translated so that the vertex A coincides with the search point C to obtain the forward second prediction block. In other words, when traversing to point C, a forward second prediction block with the same size as the sub-block is formed with point C as the vertex, and the prediction value of the forward second prediction block is calculated. ΔMV1 is the motion vector from vertex A to search point C, or ΔMV1 is the motion vector from the forward first prediction block where vertex A is located to the forward second prediction block where search point C is located.

Each group of corresponding forward correction motion vectors and backward correction motion vectors are equal in magnitude and opposite in direction.

The forward corrected motion vector may be used to correct the forward motion vector of the sub-block to obtain a corrected forward motion vector, and the backward corrected motion vector may be used to correct the backward motion vector of the sub-block to obtain a corrected backward motion vector.

For example, the motion vector of the sub-block is (MV1, MV2), and the corrected motion vector of the sub-block is (MV1+ΔMV1, MV2+ΔMV2).

S13062: Perform motion compensation on each sub-block using multiple pieces of motion information including the corrected motion vector to obtain multiple second prediction values for each sub-block.

The second prediction value may be a pixel value of the second prediction block pointed to by the motion information including the modified motion vector.

S1307: Select, for each sub-block, a corrected motion vector corresponding to the second prediction value with the smallest evaluation index as the final corrected motion vector of the sub-block.

Based on the Sum of Absolute Difference (SAD) algorithm, an evaluation index (SAD) between N ² pairs of forward second prediction values and backward second prediction values of the sub-block can be obtained, and a corrected motion vector corresponding to a pair of forward second prediction values and backward second prediction values with the smallest SAD is selected as the final corrected motion vector of the sub-block.

S1308: Perform correction using the final corrected motion vectors of all sub-blocks to obtain corrected motion vectors.

S1309: Obtain the prediction value of each sub-block using the corrected motion vector, and the prediction values of all sub-blocks constitute the prediction value of the current block.

The predicted value of the sub-block is calculated using the modified motion vector, and the predicted value of the sub-block may be an average of the forward predicted value and the backward predicted value.

For other detailed descriptions of the steps of this embodiment, please refer to other embodiments and will not be repeated here.

In this embodiment, before performing motion compensation on the motion information of the current block to obtain a prediction value, the motion vector of the current block is first corrected using the DMWR technology, which can improve the accuracy of the prediction.

It should be noted that the embodiments of the present application can be combined under the premise of not conflicting with each other.

Fig. 29 is a schematic diagram of the structure of a first embodiment of an angle mode inter-frame prediction device of the present application. As shown in Fig. 29, the device may include: a construction module 11, a setting module 12, a duplicate checking module 13, a modification module 14 and a calculation module 15.

Among them, the construction module 11 can be used to construct a candidate neighbor block list for the current block, and the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

The setting module 12 may be configured to set motion information for unavailable neighboring blocks.

The duplication checking module 13 can be used to check the motion information duplication of neighboring blocks in each angular direction, and the angular direction that passes the duplication check is a valid angular direction.

The modification module 14 is used to modify the motion information of the unavailable neighboring block in the effective angle direction by using the motion information of the reference block of the unavailable neighboring block in the effective angle direction.

The calculation module 15 may be configured to calculate a prediction value of the current block using motion information of available neighboring blocks and/or unavailable neighboring blocks in each effective angle direction.

Figure 30 is a schematic diagram of the structure of the second embodiment of an angle mode inter-frame prediction device of the present application. As shown in Figure 30, the device may include: a construction module 21, a setting module 22, a duplicate checking module 23, a modification module 24 and a calculation module 25. The construction module 21 can be used to construct a candidate neighbor block list for the current block, and the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

The setting module 22 can be used to set motion information for the unavailable neighboring block using the motion information of the time domain co-located block when the time domain co-located block of the unavailable neighboring block is available, and to set an initial value to the motion information of the unavailable neighboring block when the time domain co-located block of the unavailable neighboring block is unavailable.

The duplication checking module 23 can be used to check the motion information duplication of neighboring blocks in each angular direction, and the angular direction that passes the duplication check is a valid angular direction.

The modification module 24 may be configured to modify the motion information of the available neighboring block whose motion information is the initial value by using the motion information of the reference block of the unavailable neighboring block whose motion information is the initial value.

The calculation module 25 may be configured to calculate a prediction value of the current block using motion information of available neighboring blocks and/or unavailable neighboring blocks in each effective angle direction.

Fig. 31 is a schematic diagram of the structure of a third embodiment of an angle mode inter-frame prediction device of the present application. As shown in Fig. 31, the device may include: a construction module 31, a setting module 32, a duplicate checking module 33, a modification module 34 and a calculation module 35.

The construction module 31 can be used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

The setting module 32 may be configured to set motion information for unavailable neighboring blocks.

The duplication checking module 33 is used to select at least one pair of neighboring blocks in each angular direction according to the size of the current block to perform motion information duplication checking, and the angular direction that passes the duplication checking is a valid angular direction.

The modification module 34 may be configured to modify the motion information of the available neighboring block by using the motion information of the reference block of the unavailable neighboring block.

The calculation module 35 may be configured to calculate a prediction value of the current block using motion information of available neighboring blocks and/or unavailable neighboring blocks in each effective angle direction.

Fig. 32 is a schematic diagram of the structure of a fourth embodiment of an angle mode inter-frame prediction device of the present application. As shown in Fig. 32, the device may include: a construction module 41, a setting module 42, a duplicate checking module 43, a modification module 44 and a calculation module 45.

The construction module 41 can be used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, wherein the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

The setting module 42 may be configured to set motion information for unavailable neighboring blocks.

The duplication checking module 43 can be used to check the motion information duplication of neighboring blocks in each angular direction. The angular direction that passes the duplication check is a valid angular direction. If the angular direction satisfies the first condition, at least one duplication check is added.

The modification module 44 may be used to modify the motion information of the unavailable neighboring block by using the motion information of the reference block of the unavailable neighboring block;

The calculation module 45 may be configured to calculate a prediction value of the current block using motion information of available neighboring blocks and/or unavailable neighboring blocks in each effective angle direction.

Fig. 33 is a schematic diagram of the structure of a fifth embodiment of an angle mode inter-frame prediction device of the present application. As shown in Fig. 33, the device may include: a construction module 51, a setting module 52, a duplicate checking module 53, a modification module 54 and a calculation module 55.

The construction module 51 can be used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

The setting module 52 may be configured to set motion information for unavailable neighboring blocks.

The duplication checking module 53 can be used to check the motion information of neighboring blocks in each angular direction. The angular direction of the duplication check is the valid angular direction. If at least two of the horizontal, vertical and horizontal upward duplication checking results meet the second condition, at least one horizontal upward duplication check is reduced.

The modification module 54 may be configured to modify the motion information of the unavailable neighboring block by using the motion information of the reference block of the unavailable neighboring block.

The calculation module 55 may be configured to calculate a prediction value of the current block using motion information of available neighboring blocks and/or unavailable neighboring blocks in each effective angle direction.

Fig. 34 is a schematic diagram of the structure of a sixth embodiment of an angle mode inter-frame prediction device of the present application. As shown in Fig. 34, the device may include: a construction module 61, a setting module 62, a duplicate checking module 63, a modification module 64 and a calculation module 65.

The construction module 61 is used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

The setting module 62 may be configured to set motion information for unavailable neighboring blocks.

The duplication checking module 63 can be used to check the motion information of neighboring blocks in each angular direction. The angular direction of the duplication check is a valid angular direction. The duplication check includes determining whether the image sequence index of the reference frame of at least one pair of selected neighboring blocks is the same and whether the motion is the same.

The modification module 64 may be configured to modify the motion information of the unavailable neighboring block by using the motion information of the reference block of the unavailable neighboring block.

The calculation module 65 may be configured to calculate a prediction value of the current block using motion information of available neighboring blocks and/or unavailable neighboring blocks in each effective angle direction.

Fig. 35 is a schematic diagram of the structure of the seventh embodiment of an angle mode inter-frame prediction device of the present application. As shown in Fig. 35, the device may include: a construction module 71, a setting module 72, a duplicate checking module 73, a modification module 74 and a calculation module 75.

The construction module 71 is used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

The setting module 72 may be configured to set motion information for unavailable neighboring blocks.

The duplication checking module 73 can be used to check the motion information duplication of neighboring blocks in each angular direction, and the angular direction that passes the duplication check is a valid angular direction.

The modification module 74 may be configured to modify the motion information of the unavailable neighboring block by using the motion information of the reference block of the unavailable neighboring block.

The calculation module 75 can be used to perform motion compensation using the motion information of the corresponding neighboring blocks of each sub-block in the effective angle direction when the current block is divided into multiple sub-blocks, so as to obtain a prediction value of each sub-block, and the prediction values of all sub-blocks constitute the prediction value of the current block, wherein the motion information of at least two corresponding neighboring blocks is used when performing motion compensation for the sub-block in at least one effective angle direction.

Fig. 36 is a schematic diagram of the structure of the eighth embodiment of an angle mode inter-frame prediction device of the present application. As shown in Fig. 36, the device may include: a construction module 81, a setting module 82, a duplicate checking module 83, a filling module 84, a modification module 85 and a calculation module 86.

The construction module 81 can be used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

The setting module 82 may be configured to set motion information for unavailable neighboring blocks.

The duplication checking module 83 can be used to check the motion information duplication of neighboring blocks in each angular direction, and the angular direction that passes the duplication check is a valid angular direction.

The filling module 84 can be used to fill the valid angle direction into the angle mode list to obtain the angle mode index of the valid angle direction.

The modification module 85 may be configured to modify the motion information of the unavailable neighboring block by using the motion information of the reference block of the unavailable neighboring block.

The calculation module 86 may be configured to calculate a prediction value of the current block using motion information of available and/or unavailable neighboring blocks in each valid angular direction.

FIG37 is a schematic diagram of the structure of a ninth embodiment of an angle mode inter-frame prediction device of the present application. As shown in FIG37 , the device may include: a construction module 91, a setting module 92, a duplicate checking module 93, a determination module 94, a filling module 95, a modification module 96 and a calculation module 97.

The construction module 91 can be used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

The setting module 92 may be configured to set motion information for unavailable neighboring blocks.

The duplication checking module 93 can be used to check the motion information duplication of neighboring blocks in each angular direction, and the angular direction that passes the duplication check is a valid angular direction.

The determination module 94 may be configured to determine the order of the valid angular directions using the texture direction of the current block.

The filling module 95 can be used to fill the valid angular directions into the mode list in sequence.

The modification module 96 may be configured to modify the motion information of the unavailable neighboring block by using the motion information of the reference block of the unavailable neighboring block.

The calculation module 97 may be configured to calculate a prediction value of the current block using motion information of available neighboring blocks and/or unavailable neighboring blocks in each effective angle direction.

FIG38 is a schematic diagram of the structure of the tenth embodiment of an angle mode inter-frame prediction device of the present application. As shown in FIG38 , the device may include: a construction module 101, a setting module 102, a duplicate checking module 103, a modification module 104, a first calculation module 105, a first correction module 106, a selection module 107, a second correction module 108, and a second calculation module 109.

The construction module 101 can be used to construct a candidate neighbor block list for the current block, the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, among which the encoded neighbor blocks using inter-frame prediction are available neighbor blocks, and the remaining neighbor blocks are unavailable neighbor blocks.

The setting module 102 may be configured to set motion information for unavailable neighboring blocks.

The duplication checking module 103 can be used to check the motion information duplication of neighboring blocks in each angular direction, and the angular direction that passes the duplication check is a valid angular direction.

The modification module 104 may be configured to modify the motion information of the unavailable neighboring block by using the motion information of the reference block of the unavailable neighboring block.

The first calculation module 105 can be used to obtain motion information of each sub-block by using motion information of a corresponding neighboring block of each sub-block in a valid angle direction when the current block is divided into multiple sub-blocks, where the motion information includes a motion vector.

The first correction module 106 can be used to correct the first prediction value of each sub-block using multiple correction motion vectors to obtain multiple second prediction values of each sub-block, where the first prediction value is obtained by performing motion compensation using motion information.

The selection module 107 may be used to select, for each sub-block, a modified motion vector corresponding to the second prediction value with the smallest evaluation index as the final modified motion vector of the sub-block;

The second correction module 108 may be used to perform correction using the final corrected motion vectors of all sub-blocks to obtain corrected motion vectors.

The second calculation module 109 may be configured to obtain a prediction value of each sub-block using the motion information including the modified motion vector, and the prediction values of all the sub-blocks constitute a prediction value of the current block.

Fig. 39 is a schematic diagram of the structure of an embodiment of an encoder of the present application. As shown in Fig. 39, the encoder includes a processor 111 and a memory 112 coupled to the processor.

The memory 112 stores program instructions for implementing the method of any of the above embodiments; the processor 111 is used to execute the program instructions stored in the memory 112 to implement the steps of the above method embodiments. The processor 111 may also be called a CPU (Central Processing Unit). The processor 111 may be an integrated circuit chip with signal processing capabilities. The processor 111 may also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

Figure 40 is a schematic diagram of the structure of an embodiment of the storage medium of the present application. As shown in Figure 40, the storage medium 120 of the embodiment of the present application stores a program instruction 121, and the program instruction 121 is executed to implement the method provided by the above embodiment of the present application. Among them, the program instruction 121 can form a program file and be stored in the above storage medium 120 in the form of a software product, so that a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor (processor) performs all or part of the steps of each implementation method of the present application. The aforementioned storage medium 1400 includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM, Read-ONly Memory), a random access memory (RAM, RandomAccess Memory), a disk or an optical disk, or a terminal device such as a computer, a server, a mobile phone, and a tablet.

Figure 41 is a schematic diagram of the structure of an embodiment of an electronic device of the present application. As shown in Figure 41, the electronic device 130 may include, but is not limited to, an encoder 131 (the encoder 121 mentioned above), or other encoders capable of implementing the above method steps, which are not specifically limited here.

In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units. The above is only an implementation method of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made by using the description and drawings of this application, or directly or indirectly used in other related technical fields, is also included in the patent protection scope of the present application.

Claims (17)

1. An angle mode inter-frame prediction method, comprising: Constructing a candidate neighbor block list for the current block, the candidate neighbor block list including neighbor blocks of the current block in multiple angle directions, wherein available neighbor blocks are the encoded neighbor blocks using inter-frame prediction, and the remaining neighbor blocks are unavailable neighbor blocks; Performing motion information duplication check on the neighboring blocks in each angular direction, and the angular directions that have passed the duplication check are valid angular directions; Using the motion information of the reference block of the unavailable neighboring block, the motion information of the unavailable neighboring block is set; The prediction value of the current block is calculated using motion information of available neighboring blocks and/or unavailable neighboring blocks in the effective angle direction. 2. The method according to claim 1, characterized in that The checking for duplicate motion information of the neighboring blocks in each angular direction comprises: At least one pair of the neighboring blocks is selected in each angular direction according to the size of the current block to perform motion information duplication checking. 3. The method according to claim 1, characterized in that after checking the motion information duplication of the neighboring blocks in each angle direction, further comprising: Fill the effective angle direction into the angle mode list to obtain the angle mode index of the effective angle direction. 4. The method according to claim 3, characterized in that The angle mode index ranges from 0 to 4. 5. The method according to claim 3 is characterized in that the code stream of the current block includes an angle mode flag, and the angle mode flag is used to indicate whether the current block adopts the angle mode inter-frame prediction. 6. The method according to claim 1, characterized in that calculating the prediction value of the current block using motion information of available neighboring blocks and/or unavailable neighboring blocks in the effective angle direction comprises: The current block is divided into multiple sub-blocks, and motion compensation is performed using motion information of a corresponding neighboring block of each sub-block in a valid angle direction to obtain a prediction value of each sub-block. The prediction values of all sub-blocks of the current block constitute the prediction value of the current block. 7. The method according to claim 6, characterized in that the step of performing motion compensation using motion information of a corresponding neighboring block of each sub-block in a valid angle direction to obtain a prediction value of each sub-block comprises: The first prediction value of each sub-block is corrected by using multiple corrected motion vectors to obtain multiple second prediction values of each sub-block; the first prediction value of each sub-block is obtained by performing motion compensation using motion information of each sub-block, and the motion information of each sub-block is obtained by using motion information of a corresponding neighboring block of each sub-block in a valid angle direction; Determine a final corrected motion vector for each sub-block based on the corrected motion vector corresponding to the second prediction value with the smallest evaluation index of each sub-block; Using the final corrected motion vector of each sub-block for correction, a corrected motion vector is obtained; The predicted value of each sub-block is determined using the modified motion vector. 8. The method according to claim 7, characterized in that the corrected motion vector includes a forward corrected motion vector and a backward corrected motion vector, the second prediction value includes a forward second prediction value and a backward second prediction value, the forward second prediction value is a pixel value of a second prediction block pointed to by motion information containing the corrected forward motion vector, the corrected forward motion vector is obtained by correcting a forward motion vector of a sub-block using the forward corrected motion vector, the backward second prediction value is a pixel value of a second prediction block pointed to by motion information containing the corrected backward motion vector, and the corrected backward motion vector is obtained by correcting a backward motion vector of a sub-block using the backward corrected motion vector; The method of taking the modified motion vector corresponding to the second prediction value having the smallest evaluation index of each sub-block as the final modified motion vector of each sub-block includes: Based on the absolute error sum algorithm, obtaining an evaluation index between the forward second prediction value and the backward second prediction value of each modified motion vector of each sub-block; Based on the modified motion vectors corresponding to a pair of forward second prediction values and backward second prediction values with the smallest evaluation index, a final modified motion vector of the sub-block is determined. 9. The method according to claim 8, characterized in that each group of corresponding forward correction motion vectors and backward correction motion vectors are equal in magnitude and opposite in direction; and/or, The prediction value of the sub-block is the average of the forward prediction value and the backward prediction value of the sub-block. 10. The method according to claim 1, characterized in that the reference block of the unavailable neighboring block includes a previous neighboring block, a next neighboring block or a time-domain co-located block of the unavailable neighboring block. 11. The method according to claim 1, characterized in that: The duplication check includes determining whether the reference frame indexes of at least one pair of selected neighboring blocks are the same. 12. The method according to claim 1, characterized in that the sizes of all the neighboring blocks are the same and smaller than the size of the current block; and/or the neighboring blocks are located on the left side or above the current block. 13. The method according to any one of claims 1-12, characterized in that the multiple angle directions include at least two of horizontal, vertical, horizontal upward, horizontal downward and vertical rightward. 14. An angle mode inter-frame prediction device, comprising: A construction module, configured to construct a candidate neighbor block list for the current block, wherein the candidate neighbor block list includes neighbor blocks of the current block in multiple angle directions, wherein available neighbor blocks are the encoded neighbor blocks using inter-frame prediction, and the remaining neighbor blocks are unavailable neighbor blocks; A duplication checking module, used for checking the motion information of the neighboring blocks in each angular direction, and the angular directions that have passed the duplication check are valid angular directions; A modification module, used for setting the motion information of the unavailable neighboring block by using the motion information of the reference block of the unavailable neighboring block; A calculation module is used to calculate the prediction value of the current block by using the motion information of the available neighboring blocks and/or the unavailable neighboring blocks in the effective angle direction. 15. An encoder, characterized in that the encoder comprises a processor and a memory connected to the processor, wherein: The memory stores program instructions; The processor is configured to execute program instructions stored in the memory to implement the method according to any one of claims 1 to 13. 16. A storage medium, characterized in that the storage medium stores program instructions, and when the program instructions are executed, the method according to any one of claims 1 to 13 is implemented. 17. An electronic device, comprising the encoder according to claim 15.