CN112291558B - Encoding and decoding method, device and equipment thereof - Google Patents

Abstract

The present application provides a codec method, device and equipment thereof, the method comprising: when it is determined to start sub-block-based joint prediction for the current block, acquiring block division information of the current block; Divide the current block into at least two sub-blocks; obtain prediction mode information corresponding to the at least two sub-blocks; obtain prediction values corresponding to the at least two sub-blocks according to the prediction mode information; obtain prediction values corresponding to the at least two sub-blocks according to the at least two sub-blocks The corresponding prediction values respectively obtain the prediction values of the current block. Through the technical solution of the present application, the prediction accuracy can be improved, and the prediction performance can be improved.

Description

A codec method, device and equipment thereof

technical field

The present application relates to the technical field of encoding and decoding, and in particular, relates to an encoding and decoding method, device and equipment thereof.

Background technique

In order to achieve the purpose of saving space, video images are transmitted after being coded, and a complete video coding method may include processes such as prediction, transformation, quantization, entropy coding, and filtering. Wherein, predictive coding may include intra-frame coding and inter-frame coding. Furthermore, inter-frame coding utilizes the correlation in the temporal domain of the video to predict the current pixel by using pixels adjacent to the coded image, so as to achieve the purpose of effectively removing redundancy in the temporal domain of the video. In addition, intra-frame coding refers to using the correlation of the video spatial domain to use the pixels of the coded block of the current frame image to predict the current pixel, so as to achieve the purpose of removing video spatial redundancy.

In inter-frame coding, a motion vector (Motion Vector, MV) may be used to represent a relative displacement between a current block of a current frame image and a reference block of a reference frame image. For example, there is a strong temporal correlation between the current frame image A and the reference frame image B. When the current block A1 of image A needs to be transmitted, motion search can be performed in image B to find the reference block that best matches the current block A1 B1, and determine the relative displacement between the current block A1 and the reference block B1, that is, the motion vector of the current block A1.

In the prior art, the current block is a rectangle, but the edge of an actual object is often not a rectangle. For the current block at the edge of the object, there are often two different objects (such as a foreground object and a background). In this case, only a single prediction mode is used to predict the current block, which has problems such as poor prediction effect, large coding residual, and poor coding performance.

Contents of the invention

The present application provides an encoding and decoding method, device and equipment thereof, which improve the accuracy of prediction.

The present application provides a codec method, the method comprising:

When determining to start sub-block-based joint prediction for the current block, acquiring block division information of the current block;

dividing the current block into at least two sub-blocks according to the block division information;

Obtain prediction mode information respectively corresponding to the at least two sub-blocks;

Acquiring prediction values respectively corresponding to the at least two sub-blocks according to the prediction mode information;

Acquiring the predicted value of the current block according to the predicted values respectively corresponding to the at least two sub-blocks.

The present application provides a codec method, the method comprising:

When it is determined that the current block starts target weighted prediction, the target prediction value of the current block is obtained through the following steps, and the target prediction value is used for encoding or decoding of the current block:

Obtain a first prediction mode and a second prediction mode corresponding to the current block;

determining a first prediction value corresponding to the current block according to the first prediction mode;

determining a second prediction value corresponding to the current block according to the second prediction mode;

Perform weighting processing according to the first predicted value and the second predicted value to obtain a target predicted value of the current block.

The present application provides a codec device, which includes:

An acquisition module, configured to acquire block division information of the current block when it is determined to start joint prediction based on sub-blocks for the current block;

a processing module, configured to divide the current block into at least two sub-blocks according to the block division information;

The acquiring module is further configured to acquire prediction mode information respectively corresponding to the at least two sub-blocks; acquire predicted values corresponding to the at least two sub-blocks according to the prediction mode information; The prediction value of the current block is obtained.

The present application provides a codec device, the device comprising: an acquisition module, configured to acquire a first prediction mode and a second prediction mode corresponding to the current block when it is determined that the current block starts target weighted prediction;

A determining module, configured to determine a first prediction value corresponding to the current block according to the first prediction mode; determine a second prediction value corresponding to the current block according to the second prediction mode;

A processing module, configured to perform weighting processing according to the first predictive value and the second predictive value to obtain a target predictive value of the current block, and the target predictive value is used for encoding or decoding of the current block.

The present application provides a decoding device, including: a processor and a machine-readable storage medium, where the machine-readable storage medium stores machine-executable instructions that can be executed by the processor;

The processor is used to execute machine-executable instructions to implement the following steps:

When it is determined to start sub-block-based joint prediction for the current block, acquire block division information of the current block; divide the current block into at least two sub-blocks according to the block division information; acquire the at least two sub-blocks respectively Corresponding prediction mode information; obtaining the prediction values corresponding to the at least two sub-blocks according to the prediction mode information; obtaining the prediction value of the current block according to the prediction values corresponding to the at least two sub-blocks; or,

When it is determined that the current block starts target weighted prediction, obtain the first prediction mode and the second prediction mode corresponding to the current block; determine the first prediction value corresponding to the current block according to the first prediction mode; The prediction mode determines the second prediction value corresponding to the current block; performs weighting processing according to the first prediction value and the second prediction value to obtain the target prediction value of the current block, and the target prediction value is used for the current block Describe the decoding of the current block.

The present application provides an encoding device, a processor, and a machine-readable storage medium, where the machine-readable storage medium stores machine-executable instructions that can be executed by the processor;

The processor is used to execute machine-executable instructions to implement the following steps:

When it is determined to start sub-block-based joint prediction for the current block, acquire block division information of the current block; divide the current block into at least two sub-blocks according to the block division information; acquire the at least two sub-blocks respectively Corresponding prediction mode information; obtaining the prediction values corresponding to the at least two sub-blocks according to the prediction mode information; obtaining the prediction value of the current block according to the prediction values corresponding to the at least two sub-blocks; or,

When it is determined that the current block starts target weighted prediction, obtain the first prediction mode and the second prediction mode corresponding to the current block; determine the first prediction value corresponding to the current block according to the first prediction mode; The prediction mode determines the second prediction value corresponding to the current block; performs weighting processing according to the first prediction value and the second prediction value to obtain the target prediction value of the current block, and the target prediction value is used for the current block Describe the encoding of the current block.

It can be seen from the above technical solutions that in the embodiment of the present application, when it is determined to start the sub-block-based joint prediction for the current block, the current block can be divided into at least two sub-blocks, and the prediction values corresponding to the at least two sub-blocks can be obtained respectively , and obtain the predicted value of the current block according to the predicted values respectively corresponding to the at least two sub-blocks. In the above manner, at least two sub-blocks can be predicted separately, which can improve prediction accuracy, improve prediction performance, improve coding performance, and reduce coding residual.

Description of drawings

FIG. 1 is a schematic diagram of a video coding framework in an embodiment of the present application;

FIG. 2 is a flow chart of an encoding and decoding method in an embodiment of the present application;

3A-3H are schematic diagrams of division of the current block in an embodiment of the present application;

4A-4D are schematic diagrams of an intra block copy prediction mode and an intra block copy prediction mode;

5A-5H are schematic diagrams of an intra block copy prediction mode and an inter prediction mode;

FIG. 5I-FIG. 5L are schematic diagrams of determining an intra block copy prediction mode and an inter prediction mode based on surrounding block prediction modes;

6A-6H are schematic diagrams of intra block copy prediction mode and intra prediction mode;

7A-7D are schematic diagrams of determining an intra block copy prediction mode and an intra prediction mode based on surrounding block prediction modes;

8A-8D are schematic diagrams of intra prediction mode and intra prediction mode;

9A-9D are schematic diagrams of intra prediction mode and inter prediction mode;

10A-10D are schematic diagrams of determining an intra prediction mode and an inter prediction mode based on surrounding block prediction modes;

11A-11D are schematic diagrams of inter prediction mode and inter prediction mode;

12A-12F are schematic diagrams of the process of obtaining the predicted value in an embodiment of the present application;

FIG. 13 is a flow chart of an encoding and decoding method in an embodiment of the present application;

FIG. 14 is a schematic structural diagram of a codec device in an embodiment of the present application;

FIG. 15 is a schematic structural diagram of a codec device in an embodiment of the present application;

FIG. 16 is a hardware structural diagram of a decoder device in an embodiment of the present application;

Fig. 17 is a hardware structural diagram of an encoding end device in an implementation manner of the present application.

Detailed ways

The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, rather than limiting the present application. The singular forms of "a", "said" and "the" used in the embodiments and claims of this application are also intended to include plural forms, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items. It should be understood that although the embodiments of the present application may use terms such as first, second, and third to describe various information, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of the embodiments of the present application, first information may also be called second information, and similarly, second information may also be called first information. Depending on the context, furthermore, the use of the word "if" could be interpreted as "at" or "when" or "in response to a determination."

In the embodiment of this application, a codec method, device and equipment are proposed, which may involve the following concepts:

Intra prediction, inter prediction (intra prediction and inter prediction) and IBC (intra block copy) prediction:

Intra-frame prediction refers to using the correlation of the video spatial domain to predict the current pixel using the pixels of the encoded block of the current image, so as to achieve the purpose of removing video spatial redundancy. A variety of prediction modes are specified in intra prediction, and each prediction mode corresponds to a texture direction (except DC mode), and the current block prediction pixel is generated from the boundary reconstructed pixel value of the adjacent block in the prediction direction. For example, if the texture of the image is arranged horizontally, the horizontal prediction mode can better predict the image information.

Inter-frame prediction means that based on the temporal correlation of the video, since the video sequence contains strong temporal correlation, using adjacent encoded image pixels to predict the pixels of the current image can achieve the purpose of effectively removing video temporal redundancy. . The inter-frame prediction part of the video coding standard uses block-based motion compensation technology. The main principle is to find a best matching block in the previously coded image for each pixel block of the current image. This process is called motion estimation (MotionEstimation, ME).

Intra Block Copy (IBC, Intra Block Copy) means that the same frame reference is allowed, the reference data of the current block comes from the same frame, and the intra block copy may also be called intra block copy. In the Screen Content Coding (Screen Content Coding) extension standard of HEVC (High Efficiency Video Coding, high-efficiency video coding), an intra-frame block copy technology is proposed, and a block vector is used to obtain a predictive value of a current block. Based on the feature that there are a large number of repeated textures in the same frame of the screen content, when the block vector is used to obtain the predicted value of the current block, the compression efficiency of the screen content sequence can be significantly improved. Subsequently, during the formulation of the VVC (Versatile Video Coding, universal video coding) standard, the intra-frame block copy technology is adopted again.

Motion Vector (Motion Vector, MV): In inter-frame coding, the motion vector can be used to represent the relative displacement between the current block of the current frame video image and the reference block of the reference frame video image. Each divided block has a corresponding motion vector transmitted to the decoding end. If the motion vector of each block is encoded and transmitted independently, especially if it is divided into a large number of small-sized blocks, quite a lot of bits will be consumed. In order to reduce the number of bits used to encode the motion vector, the spatial correlation between adjacent blocks can be used to predict the motion vector of the current block to be encoded according to the motion vector of the adjacent encoded block, and then encode the prediction difference, This can effectively reduce the number of bits representing the motion vector. Further, in the process of encoding the motion vector of the current block, the motion vector of the current block can be predicted by using the motion vector of the adjacent coded block, and then the prediction value (MVP, Motion Vector Prediction) of the motion vector and The difference (MVD, MotionVector Difference) between the real estimates of the motion vectors is encoded, thereby effectively reducing the number of encoding bits of the motion vectors.

Motion Information: Since the motion vector represents the position offset between the current block and a reference block, in order to accurately obtain the information pointing to the block, in addition to the motion vector, the index information of the reference frame image is also required to represent the current block Which reference frame image to use. In video coding technology, for the current frame image, a reference frame image list can usually be established, and the reference frame image index information indicates which reference frame image in the reference frame image list is used for the current block. In addition, many encoding technologies also support multiple reference picture lists, therefore, an index value can also be used to indicate which reference picture list is used, and this index value can be called a reference direction. To sum up, in the video coding technology, information related to motion, such as a motion vector, a reference frame index, and a reference direction, may be collectively referred to as motion information.

Block Vector (Block Vector, BV): The block vector is applied in the intra-frame block copy technology. The intra-frame block copy technology uses the block vector for motion compensation, that is, the block vector is used to obtain the prediction value of the current block. Unlike motion vectors, block vectors represent the relative displacement between the current block and the best matching block among the encoded blocks of the current frame. Based on the fact that there are a large number of repeated textures in the same frame, when the block vector is used to obtain the prediction value of the current block, the compression efficiency can be significantly improved.

Intra-frame prediction mode: In intra-frame coding, the intra-frame prediction mode can be used for motion compensation, that is, the intra-frame prediction mode is used to obtain the predicted value of the current block. For example, intra prediction modes may include Planar mode, DC mode and 33 angle modes. See Table 1 for an example of the intra prediction mode, the Planar mode corresponds to mode 0, the DC mode corresponds to mode 1, and the remaining 33 angle modes correspond to mode 1-mode 34. The Planar mode is suitable for areas where pixel values change slowly, using two linear filters in the horizontal and vertical directions, and using the average of the two as the predicted value of the current block pixel. The DC mode is suitable for a large flat area, and the average value of the surrounding pixels of the current block is used as the predicted pixel value of the current block. Angle mode can have 33 angles, mode 26 means vertical direction, mode 10 means horizontal direction. In the newly formulated new generation codec standard VVC, a more subdivided angle direction is adopted, for example, there are 67 angle modes in total.

Table 1

intra prediction mode intra prediction mode 0 Planar mode 1 DC mode 2…34 angular2...angular34

Rate-Distortion Optimized (Rate-Distortion Optimized): There are two indicators for evaluating coding efficiency: code rate and PSNR (Peak Signal to Noise Ratio, peak signal-to-noise ratio). The smaller the bit stream, the greater the compression rate and the greater the PSNR , the better the quality of the reconstructed image is, the discriminant formula is essentially a comprehensive evaluation of the two when selecting the mode. For example, the cost corresponding to the mode: J(mode)=D+λ*R, where D represents Distortion (distortion), which can usually be measured using the SSE index, and SSE refers to the average difference between the reconstructed image block and the source image Square sum; λ is the Lagrangian multiplier, and R is the actual number of bits required for image block coding in this mode, including the sum of bits required for coding mode information, motion information, residuals, etc.

Video coding framework: See Figure 1, the video coding framework can be used to implement the encoding end processing flow of the embodiment of the present application. In addition, the schematic diagram of the video decoding framework is similar to that of Figure 1, and will not be repeated here, and the video decoding framework can be used Realize the decoding end processing flow of the embodiment of the present application. Specifically, in the video coding framework and the video decoding framework, it may include intra prediction, motion estimation/motion compensation, reference image buffer, in-loop filtering, reconstruction, transformation, quantization, inverse transformation, inverse quantization, entropy encoder, etc. module. At the encoding end, through the cooperation between these modules, the processing flow at the encoding end can be realized, and at the decoding end, through the cooperation between these modules, the processing flow at the decoding end can be realized.

The codec method will be described in detail below in conjunction with several specific embodiments.

Embodiment 1: Referring to FIG. 2 , it is a schematic flow diagram of the encoding and decoding method in the embodiment of the present application. The encoding and decoding method can be applied to the decoding end or the encoding end. The encoding and decoding method can include the following steps:

Step 201, when it is determined to start sub-block-based joint prediction for the current block, obtain block division information of the current block.

Step 202, divide the current block into at least two sub-blocks according to the block division information.

For convenience of description, in this embodiment of the present application, the current block is divided into two sub-blocks as an example for illustration, that is, the current block is divided into a first sub-block and a second sub-block according to the block division information. For the case of dividing the current block into three or more sub-blocks, the implementation process is similar to the implementation process of two sub-blocks, and will not be repeated hereafter.

Step 203, obtaining prediction mode information corresponding to at least two sub-blocks respectively.

For example, the prediction mode information corresponding to the first sub-block is obtained, and the prediction mode information corresponding to the second sub-block is obtained.

Step 204, according to the prediction mode information respectively corresponding to the at least two sub-blocks, obtain the prediction values respectively corresponding to the at least two sub-blocks. For example, the prediction value corresponding to the first sub-block is obtained according to the prediction mode information corresponding to the first sub-block, and the prediction value corresponding to the second sub-block is obtained according to the prediction mode information corresponding to the second sub-block.

Step 205: Obtain the predicted value of the current block according to the predicted values respectively corresponding to at least two sub-blocks.

It can be seen from the above technical solutions that in this embodiment, when it is determined to start joint prediction based on sub-blocks for the current block, the current block may be divided into at least two sub-blocks, and the prediction values corresponding to the at least two sub-blocks are obtained respectively, And acquire the prediction value of the current block according to the prediction values respectively corresponding to the at least two sub-blocks. In the above manner, at least two sub-blocks can be predicted separately, which can improve prediction accuracy, improve prediction performance, improve coding performance, and reduce coding residual.

In step 201, the decoding end or the encoding end needs to determine whether to enable joint prediction based on sub-blocks for the current block. If the joint prediction based on the sub-block is started for the current block, the codec method of the embodiment of the present application can be adopted. If the sub-block-based joint prediction is not started for the current block, the encoding and decoding method of the embodiment of the present application may not be used.

Exemplarily, it may be judged whether the characteristic information of the current block satisfies a specific condition; if yes, it is determined to start the sub-block-based joint prediction for the current block; if not, it is determined not to start the sub-block-based joint prediction for the current block. The characteristic information may include but not limited to one or any combination of the following: frame type of the current frame where the current block is located, size information of the current block, and switch control information. Wherein, the switch control information may be SPS (sequence level) switch control information, or PPS (picture parameter level) switch control information, or TILE (tile level) switch control information.

For example, if the feature information is the frame type of the current frame where the current block is located, then the frame type of the current frame where the current block is located meets certain conditions, which may include but not limited to: if the frame type of the current frame where the current block is located is a B frame, then determine The frame type satisfies a specific condition; or, if the frame type of the current frame where the current block is located is an I frame, it is determined that the frame type satisfies a specific condition.

For example, if the characteristic information is the size information of the current block, and the size information includes the width of the current block and the height of the current block, then the size information of the current block satisfies certain conditions, which may include but not limited to: if the width of the current block is greater than or If it is equal to the first value and the height of the current block is greater than or equal to the second value, it is determined that the size information of the current block satisfies a specific condition. Or, if the width of the current block is greater than or equal to the third value, the height of the current block is greater than or equal to the fourth value, the width of the current block is less than or equal to the fifth value, and the height of the current block is less than or equal to the sixth value, determine the current block The dimension information for satisfies certain criteria.

Exemplarily, the above numerical values may be configured according to experience, such as 8, 16, 32, 64, 128, etc., without limitation. In a possible implementation manner, the first value may be 8, the second value may be 8, the third value may be 8, the fourth value may be 8, the fifth value may be 64, and the sixth value may be 64 . Of course, the above is just an example, without limitation. To sum up, if the width of the current block is greater than or equal to 8, and the height of the current block is greater than or equal to 8, it is determined that the size information of the current block satisfies a specific condition. Or, if the width of the current block is greater than or equal to 8, the height of the current block is greater than or equal to 8, the width of the current block is less than or equal to 64, and the height of the current block is less than or equal to 64, it is determined that the size information of the current block meets a specific condition.

For example, if the characteristic information is switch control information, then the switch control information satisfies a specific condition, which may include but not limited to: if the switch control information is enabled, then determining that the switch control information satisfies a specific condition. Exemplarily, a switch control information can be added for the geometric division mode. If the switch control information is enabled, it means that the geometric division mode is allowed to be enabled. At this time, the switch control information meets a specific condition, and the sub-block-based union can be started for the current block. predict.

For example, if the feature information is the frame type of the current frame where the current block is located and the size information of the current block, then the frame type meets a specific condition, and when the size information meets a specific condition, it is determined that the feature information of the current block satisfies a specific condition . If the feature information is the frame type and switch control information of the current frame where the current block is located, then the frame type satisfies a specific condition, and when the switch control information satisfies the specific condition, it is determined that the feature information of the current block satisfies the specific condition. If the characteristic information is size information and switch control information of the current block, then the size information satisfies a specific condition, and when the switch control information satisfies a specific condition, it is determined that the characteristic information of the current block satisfies the specific condition. If the characteristic information is the frame type of the current frame where the current block is located, the size information of the current block, and the switch control information, then the frame type satisfies a specific condition, and the size information satisfies a specific condition, and the switch control information satisfies a specific condition. condition, it is determined that the feature information of the current block satisfies a specific condition.

In steps 201 and 202, the decoding end or the encoding end needs to obtain the block division information of the current block, and divide the current block into at least two sub-blocks according to the block division information, and the at least two sub-blocks include the first sub-block and second sub-block. Exemplarily, the shape of the first sub-block may be the same as that of the second sub-block; or, the shape of the first sub-block may be different from that of the second sub-block. The first sub-block may include but not limited to one of the following sub-blocks: triangular sub-block, trapezoidal sub-block, pentagonal sub-block; the second sub-block may include but not limited to one of the following sub-blocks: triangular sub-block, Trapezoidal sub-block, pentagonal sub-block.

For example, in a triangular prediction mode (TPM, Triangle Partition Mode), the current block may be divided into two triangular sub-blocks. Referring to FIG. 3A , it is an example of dividing the current block into two triangular sub-blocks according to the main diagonal, that is, dividing the current block into two triangular sub-blocks according to the direction at an angle of 45 degrees to the horizontal right direction , that is to say, the first sub-block may be a triangular sub-block, and the second sub-block may also be a triangular sub-block. Referring to Fig. 3B, it is an example of dividing the current block into two triangular sub-blocks according to the sub-diagonal method, that is, dividing the current block into two triangular sub-blocks according to the direction with an angle of 135 degrees to the horizontal right direction , that is to say, the first sub-block may be a triangular sub-block, and the second sub-block may also be a triangular sub-block.

For another example, in the geometrical partitioning mode (GEO, Geometrical Partitioning), unlike the division of two triangular sub-blocks, GEO can support more directions of division, the current block can be divided into a triangular sub-block and a trapezoidal sub-block block, the current block can also be divided into two trapezoidal sub-blocks, and the current block can also be divided into a triangular sub-block and a pentagonal sub-block. Of course, the above are just a few examples of division in more directions, and the division direction is not limited. In the geometric partitioning mode, the current block can also be divided into two sub-blocks of any shape, this article only introduces some possibilities of partitioning.

Referring to FIG. 3C and FIG. 3D , the current block is divided into a triangular sub-block and a trapezoidal sub-block, that is, the first sub-block is a triangular sub-block, and the second sub-block is a trapezoidal sub-block. Referring to FIG. 3E and FIG. 3F , the current block is divided into two ladder-shaped sub-blocks, that is, the first sub-block is a ladder-shaped sub-block, and the second sub-block is a ladder-shaped sub-block. Referring to FIG. 3G and FIG. 3H , the current block is divided into a triangular sub-block and a pentagonal sub-block, that is, the first sub-block is a triangular sub-block, and the second sub-block is a pentagonal sub-block.

Exemplarily, a switch may be added to determine whether to use the triangular prediction mode or the geometric division mode.

To sum up, the decoding end or the encoding end can select a block division information from Figure 3A-Figure 3H, such as selecting Figure 3A, then use the block division information shown in Figure 3A to divide the current block into the first sub-block and the second subblock. Further, in order to obtain the block division information of the current block, the decoding end and the encoding end can obtain the block division information of the current block in the following manner:

Method 1: The encoding end uses a certain block division information by default through the agreement, and the decoding end uses the block division information by default through the agreement agreement. For example, the encoding end uses the block division information shown in Figure 3A by default through the protocol agreement, and the decoding end uses the block division information shown in Figure 3A by default through the agreement agreement, and the encoding end divides the current block according to the block division information shown in Figure 3A For the first triangular sub-block and the second triangular sub-block, the decoder divides the current block into the first triangular sub-block and the second triangular sub-block according to the block division information shown in FIG. 3A . As another example, the encoding end uses the block division information shown in Figure 3C by default through the protocol agreement, and the decoding end uses the block division information shown in Figure 3C by default through the agreement agreement, and the encoding end uses the block division information shown in Figure 3C to convert the current block Divided into the first triangular sub-block and the second trapezoidal sub-block, the decoder divides the current block into the first triangular sub-block and the second trapezoidal sub-block according to the block division information shown in FIG. 3A . Of course, the above is just an example, without limitation.

Method 2: Agree on several types of block division information through the agreement, such as partial block division information or all block division information in Figure 3A-3H, and the encoding end determines the rate-distortion cost corresponding to each block division information, for example, based on each block Partition information, each group of prediction mode information, and candidates in each group of prediction mode information, jointly predict the current block to obtain the prediction information of the current block, and determine the rate-distortion cost of the current block by using the rate-distortion principle and the prediction information , there is no restriction on this process. Then, the encoder selects the smallest rate-distortion cost from all rate-distortion costs, uses the block division information corresponding to the smallest rate-distortion cost as the target block division information, and divides the current block into at least two sub-blocks through the target block division information . For example, if the rate-distortion cost of the block division information shown in FIG. 3A is the smallest, the encoder divides the current block into the first triangular sub-block and the second triangular sub-block according to the block division information shown in FIG. 3A . If the rate-distortion cost of the block division information shown in FIG. 3C is the smallest, the encoder divides the current block into a first triangular sub-block and a second trapezoidal sub-block according to the block division information shown in FIG. 3C .

When the encoding end sends the encoded bit stream to the decoding end, the encoded bit stream may carry block division information indication information, and the indication information is used to indicate the block division information of the current block. After receiving the coded bit stream, the decoding end can obtain the indication information of the block division information from the coded bit stream, and determine the block division information of the current block according to the indication information. For example, if the indication information is used to indicate the block division information shown in FIG. 3A , the decoder divides the current block into the first triangular sub-block and the second triangular sub-block according to the block division information shown in FIG. 3A . If the indication information is used to indicate the block division information shown in FIG. 3C , the decoder divides the current block into the first triangular sub-block and the second trapezoidal sub-block according to the block division information shown in FIG. 3C .

In step 203, after the encoding end or the decoding end divides the current block into at least two sub-blocks, it can obtain the prediction mode information corresponding to the at least two sub-blocks respectively, and the prediction mode information may include but not limited to: intra block copy prediction mode (that is, IBC mode), intra prediction mode, and inter prediction mode. For example, after the current block is divided into the first sub-block and the second sub-block, the prediction mode information of the first sub-block may be obtained, and the prediction mode information of the second sub-block may be obtained.

For example, the prediction mode information of the first sub-block may be an intra block copy prediction mode, and the prediction mode information of the second sub-block may be an intra prediction mode. Alternatively, the prediction mode information of the first sub-block may be an intra block copy prediction mode, and the prediction mode information of the second sub-block may be an inter prediction mode. Alternatively, the prediction mode information of the first sub-block may be an intra block copy prediction mode, and the prediction mode information of the second sub-block may be an intra block copy prediction mode. Alternatively, the prediction mode information of the first sub-block may be an intra-frame prediction mode, and the prediction mode information of the second sub-block may be an intra-frame prediction mode. Alternatively, the prediction mode information of the first sub-block may be an intra-frame prediction mode, and the prediction mode information of the second sub-block may be an inter-frame prediction mode. Or, the prediction mode information of the first sub-block is an inter-frame prediction mode, and the prediction mode information of the second sub-block is an inter-frame prediction mode.

For another example, the prediction mode information of the first sub-block may be an intra prediction mode, and the prediction mode information of the second sub-block may be an intra block copy prediction mode. Alternatively, the prediction mode information of the first sub-block may be an inter-frame prediction mode, and the prediction mode information of the second sub-block may be an intra-block copy prediction mode. Alternatively, the prediction mode information of the first sub-block may be an intra block copy prediction mode, and the prediction mode information of the second sub-block may be an intra block copy prediction mode. Alternatively, the prediction mode information of the first sub-block may be an intra-frame prediction mode, and the prediction mode information of the second sub-block may be an intra-frame prediction mode. Alternatively, the prediction mode information of the first sub-block may be an inter-frame prediction mode, and the prediction mode information of the second sub-block may be an intra-frame prediction mode. Or, the prediction mode information of the first sub-block is an inter-frame prediction mode, and the prediction mode information of the second sub-block is an inter-frame prediction mode.

In summary, the prediction mode information of the first sub-block may be an intra block copy prediction mode, or an intra prediction mode, or an inter prediction mode, and the prediction mode information of a second sub block may be an intra block copy prediction mode , or intra prediction mode, or inter prediction mode, in order to obtain the prediction mode information of the first sub-block and the prediction mode information of the second sub-block, the following methods are adopted:

Method 1: The encoding end uses the prediction mode information A as the prediction mode information of the first sub-block by agreement by default, and uses the prediction mode information B (the same as or different from the prediction mode information A) as the prediction mode information of the second sub-block. By agreement, the decoding end uses the prediction mode information A as the prediction mode information of the first sub-block by default, and uses the prediction mode information B as the prediction mode information of the second sub-block. For example, the encoder agrees to use the intra block copy prediction mode by default as the prediction mode information of the first sub-block and the intra prediction mode as the prediction mode information of the second sub-block by default, and the decoder uses the intra block copy prediction mode as the default by agreement. The prediction mode is copied as the prediction mode information of the first sub-block, and the intra prediction mode is used as the prediction mode information of the second sub-block. Based on this, for the encoding end and the decoding end, the prediction mode information of the first sub-block may be an intra block copy prediction mode, and the prediction mode information of the second sub-block may be an intra prediction mode.

Method 2: Specify several sets of prediction mode information through the agreement, for example, specify the following 6 sets of prediction mode information: the prediction mode information of the first sub-block is the intra block copy prediction mode, and the prediction mode information of the second sub-block is intra prediction mode; the prediction mode information of the first sub-block is the intra block copy prediction mode, the prediction mode information of the second sub block is the inter prediction mode; the prediction mode information of the first sub block is the intra block copy prediction mode, and the second The prediction mode information of the sub-block is an intra-block copy prediction mode; the prediction mode information of the first sub-block is an intra-frame prediction mode, and the prediction mode information of the second sub-block is an intra-frame prediction mode; the prediction mode information of the first sub-block is an intra prediction mode, the prediction mode information of the second sub-block is an inter prediction mode; the prediction mode information of the first sub block is an inter prediction mode, and the prediction mode information of the second sub block is an inter prediction mode.

The encoder determines the rate-distortion cost corresponding to each set of prediction mode information, for example, based on each block division information, each set of prediction mode information, and candidates in each set of prediction mode information, jointly predict the current block to obtain the current block prediction information, and determine the rate-distortion cost of the current block by using the rate-distortion principle and the prediction information, and this process is not limited. Then, select the smallest rate-distortion cost from all the rate-distortion costs, use the prediction mode information corresponding to the smallest rate-distortion cost as the target prediction mode information, and obtain the prediction mode information and the second sub-block prediction mode information through the target prediction mode information. Prediction mode information of two sub-blocks. For example, if the rate-distortion cost of the first set of prediction mode information is the smallest, the encoder determines that the prediction mode information of the first sub-block is an intra block copy prediction mode, and the prediction mode information of the second sub-block is an intra prediction mode.

For example, it is assumed that the block division information A1 and the block division information A2 are included, and the above six sets of prediction mode information are included.

First, according to the block division information A1 and the first group of prediction mode information (intra block copy prediction mode+intra prediction mode), traverse a candidate of the intra block copy prediction mode (that is, the block vector, the acquisition method of the block vector refers to Subsequent embodiments, which will not be described in detail here) and a candidate for the intra-frame prediction mode (that is, the intra-frame sub-prediction mode, the acquisition method of the intra-frame sub-prediction mode refers to the subsequent embodiments, which will not be described in detail here), based on these two candidates or perform joint prediction on the current block to obtain the prediction information of the current block, and determine the rate-distortion cost of the current block by using the rate-distortion principle and the prediction information. By analogy, for each candidate of the intra block copy prediction mode and each candidate of the intra prediction mode, the current block can be jointly predicted to obtain the prediction information of the current block, and finally the current block is obtained based on the rate-distortion principle The rate-distortion cost of .

Then, for the block division information A1 and the second set of prediction mode information (intra block copy prediction mode + inter prediction mode), traverse a candidate for the intra block copy prediction mode (i.e. block vector) and the inter prediction mode One candidate (that is, motion information, see the subsequent embodiments for how to obtain motion information, and will not repeat it here), based on these two candidates, jointly predict the current block to obtain the prediction information of the current block, and use the rate-distortion principle and the prediction information to determine the rate-distortion cost of the current block. By analogy, for each candidate of the intra block copy prediction mode and each candidate of the inter prediction mode, the current block can be jointly predicted to obtain the prediction information of the current block, and finally obtain the rate-distortion cost of the current block .

For block division information A1 and the third group of prediction mode information, block division information A1 and the fourth group of prediction mode information, block division information A1 and the fifth group of prediction mode information, block division information A1 and the sixth group of prediction mode information, block Division information A2 and the first group of prediction mode information, block division information A2 and the second group of prediction mode information, block division information A2 and the third group of prediction mode information, block division information A2 and the fourth group of prediction mode information, block division information A2 and the fifth group of prediction mode information, block division information A2 and the sixth group of prediction mode information all perform the above-mentioned processing to obtain the rate-distortion cost of the current block.

After traversing all rate-distortion costs, the smallest rate-distortion cost can be selected from all rate-distortion costs, assuming that the smallest rate-distortion cost is block division information A1, the first group of prediction mode information, and the first group of intra block copy prediction modes The rate-distortion cost corresponding to one candidate and the second candidate of the intra prediction mode, the block division information corresponding to the smallest rate-distortion cost is the block division information A1, and based on the block division information A1, the current block is divided into the first sub-block and second sub-block. The prediction mode information corresponding to the minimum rate-distortion cost is the first set of prediction mode information, that is, the prediction mode information of the first sub-block is an intra block copy prediction mode, and the prediction mode information of the second sub-block is an intra prediction mode. The target candidates corresponding to the minimum rate-distortion cost are the first candidate of the intra block copy prediction mode (ie, the block vector) and the second candidate of the intra prediction mode (ie, the intra sub-prediction mode). Of course, the above is just an example of determining the rate-distortion cost, and there is no limitation to this.

When the encoding end sends the encoded bit stream to the decoding end, the encoded bit stream may carry indication information of prediction mode information. After receiving the coded bit stream, the decoder can obtain the indication information of the prediction mode information from the coded bit stream, and obtain the prediction mode information of the first sub-block and the prediction mode information of the second sub-block according to the indication information. For example, if the indication information is used to indicate the first group of prediction mode information in the above six groups of prediction mode information, the decoding end determines that the prediction mode information of the first sub-block is the intra block copy prediction mode, and the prediction of the second sub-block The mode information is an intra prediction mode.

Embodiment 2: For step 204 in Embodiment 1, if the prediction mode information of the first sub-block is the intra block copy prediction mode, and the prediction mode information of the second sub block is the intra block copy prediction mode, the implementation Example 2 is implemented, and other processes refer to Example 1. In Embodiment 2, a block vector candidate list is constructed, and the block vector candidate list includes a plurality of candidate block vectors; a candidate block vector is selected from the block vector candidate list as the first target block vector of the first sub-block, and from Select another candidate block vector from the block vector candidate list as the second target block vector of the second sub-block; then, obtain the predicted value corresponding to the first sub-block according to the first target block vector, and obtain The predicted value corresponding to the second sub-block.

For example, a block vector candidate list is constructed for the current block, and the candidate block vectors in the block vector candidate list include but are not limited to: block vectors of spatial adjacent blocks of the current block, HMVP (History-based motion vector prediction, history-based motion vector prediction) corresponding to the current block The history block vector, the default block vector, etc. in the motion vector prediction) list, and the construction process of this block vector candidate list is not limited. The historical block vectors in the HMVP list refer to: in the HMVP mode, multiple block vectors corresponding to the current block need to be obtained. For the convenience of distinction, the block vectors in the HMVP mode are called historical block vectors, and the number of historical block vectors is determined as needed , there is no restriction on this. The HMVP mode is a technology adopted in the new generation of video coding standards, and its principle is to use the block vector of the coded block to predict the block vector of the current block. For example, an HMVP list may be established for the current block, and the HMVP list is used to store block vectors of encoded blocks, and these block vectors may be called historical block vectors.

After constructing the block vector candidate list for the current block, one candidate block vector can be selected from the block vector candidate list as the first target block vector of the first sub-block, and another candidate block vector can be selected from the block vector candidate list as the first target block vector The second target block vectors of the two sub-blocks, for example, the first target block vector and the second target block vector may be different.

After the first target block vector of the first sub-block is determined, a predictive value corresponding to the first sub-block may be obtained according to the first target block vector, and there is no limitation on the process of obtaining the predictive value. After the second target block vector of the second sub-block is determined, a predicted value corresponding to the second sub-block may be obtained according to the second target block vector, and there is no limitation on the process of obtaining the predicted value.

Exemplarily, when the first sub-block/second sub-block adopts the MMVD sub-mode in the intra block copy prediction mode, the block vector candidate list may include the block vector candidate list of the MMVD sub-mode, that is, the block vector The candidate list includes the block vector obtained by offsetting the original block vector. The original block vector may include but not limited to: the block vector of the spatial adjacent block of the current block, the historical block vector in the HMVP list corresponding to the current block, the default block vector etc. For example, the block vector A1 of the spatial adjacent block A1, the block vector A2 of the spatial adjacent block A2, and the historical block vectors B1-B3 in the HMVP list can be obtained, and the block vector A1, block vector A2, historical block vector B1, The historical block vector B2 and the historical block vector B3' obtained by offsetting the historical block vector B3 are added to the block vector candidate list. Alternatively, block vector A1, block vector A2' obtained by offsetting block vector A2, historical block vector B1, historical block vector B2, and historical block vector B3' obtained by offsetting historical block vector B3 are added to Block vector candidate list. Of course, the above-mentioned manners are just two examples, and there is no limitation thereto, as long as the block vector candidate list includes at least one block vector obtained by offsetting the original block vector.

MMVD is to offset the original block vector with a fixed direction and a fixed vector difference to obtain a new block vector. For example, the new block vector can be obtained by the following method. The new block vector can be added to the block vector candidate list and participate in the target block Vector determination process. BV(new)=BV(original)+offset; or, BV(new)=BV(original)-offset.

BV(new) represents the new block vector obtained after offset, BV(original) represents the original block vector, offset represents the fixed vector difference, and the value of offset can be configured arbitrarily, such as +1, -1, +2, -2, etc. , there is no restriction on this.

The encoder/decoder selects a candidate block vector from the block vector candidate list as the first target block vector of the first sub-block, and selects another candidate block vector from the block vector candidate list as the second target block of the second sub-block vector, which can include:

Method 1: The encoder performs joint prediction on the current block based on each block division information, each group of prediction mode information, and candidates in each group of prediction mode information, to obtain the prediction information of the current block, and use the rate-distortion principle and the described The prediction information determines the rate-distortion cost of the current block. For a specific manner, refer to the foregoing embodiments, which will not be repeated here. It is assumed that the prediction mode information corresponding to the minimum rate-distortion cost includes: the prediction mode information of the first sub-block is the intra block copy prediction mode, the prediction mode information of the second sub-block is the intra block copy prediction mode, and for the block vector candidate list For each candidate block vector in , the candidate block vector with the smallest rate-distortion cost is used as the first target block vector of the first sub-block. On the basis of excluding the first target block vector, the candidate block vector with the smallest rate-distortion cost is used as the second target block vector of the second sub-block.

When the encoding end sends the encoded bit stream to the decoding end, the encoded bit stream carries indication information of the target block vector, and the indication information is used to indicate index information of the first target block vector and index information of the second target block vector. The index information of the first target block vector is used to indicate which candidate block vector the first target block vector is in the block vector candidate list, and the index information of the second target block vector is used to indicate that the second target block vector is a block vector candidate The number candidate block vector in the list.

The decoding end receives the encoded bit stream from the encoding end, and parses out the indication information from the encoded bit stream. Based on the index information of the first target block vector, a candidate block vector corresponding to the index information is selected from the block vector candidate list, and the candidate block vector is the first target block vector of the first sub-block. Based on the index information of the second target block vector, a candidate block vector corresponding to the index information is selected from the block vector candidate list, and the candidate block vector is the second target block vector of the second sub-block.

Method 2: The encoding end agrees to default the first target block vector and the second target block vector through the agreement, and the decoding end also agrees to use the first target block vector and the second target block vector through the agreement, so that the encoded bit stream does not need to carry The indication information of the target block vector can save the encoding overhead of transmitting the indication information of the target block vector.

For example, the encoding end agrees through the agreement that the first candidate block vector of the default block vector candidate list is used as the first target block vector of the first sub-block, and the second candidate block vector of the second sub-block is used as the second target block vector of the second sub-block. Two target block vectors. The decoding end agrees through the agreement that the first candidate block vector of the default block vector candidate list is used as the first target block vector of the first sub-block, and the second candidate block vector of the block vector candidate list is used as the second target of the second sub-block block vector.

Based on Embodiment 2, when the current frame where the current block is located is a B frame or an I frame, the current block can be divided into a first sub-block and a second sub-block according to a fixed direction, and the first sub-block and the second sub-block can be both Triangular sub-block, the first sub-block and the second sub-block can be triangular sub-block and ladder sub-block respectively, the first sub-block and the second sub-block can be both ladder-shaped sub-blocks, the first sub-block and the second sub-block can be They are triangular sub-blocks and pentagonal sub-blocks respectively, and there is no restriction on the division method of the current block. Exemplarily, the prediction mode information of the first sub-block may be an intra block copy prediction mode, and the prediction mode information of the second sub-block may be an intra block copy prediction mode. Referring to Fig. 4A-Fig. 4D, it is an example in which the first sub-block adopts the intra-frame block copy prediction mode and the second sub-block adopts the intra-frame block copy prediction mode, and the shapes of the first sub-block and the second sub-block are not changed. Limitations, Figures 4A-4D are just examples.

In Embodiment 2, it is assumed that there are two areas in the current block, one area 1 is the screen content, and the other area 2 is also the screen content. However, area 1 needs to refer to the reference block A in the current frame where the current block is located, and area 2 needs to refer to The reference block B in the current frame where the current block is located, in this application scenario, by dividing the current block into the first sub-block (ie, the sub-block of the area) and the second sub-block (ie, the sub-block of the area 2), and The prediction mode information of the first sub-block is the intra-block copy prediction mode, and the prediction mode information of the second sub-block is the intra-block copy prediction mode. Based on the characteristic that there are a large number of repeated textures in the same frame in the screen content, the second Both the first sub-block and the second sub-block adopt the intra block copy prediction mode, which can improve the coding effect.

Embodiment 3: For step 204 in Embodiment 1, if the prediction mode information of the first sub-block is the intra block copy prediction mode, and the prediction mode information of the second sub-block is the inter prediction mode, Embodiment 3 can be adopted Realize, refer to embodiment 1 for other processes. In Embodiment 3, a block vector candidate list is constructed, and the block vector candidate list includes multiple candidate block vectors; a candidate block vector is selected from the block vector candidate list as the target block vector of the first sub-block. A motion information candidate list is constructed, the motion information candidate list includes at least one candidate motion information; and one candidate motion information is selected from the motion information candidate list as the target motion information of the second sub-block. A predictive value corresponding to the first sub-block is obtained according to the target block vector; a predictive value corresponding to the second sub-block is obtained according to the target motion information.

For example, a block vector candidate list is constructed for the current block, and the candidate block vectors in the block vector candidate list include but are not limited to: block vectors of spatial adjacent blocks of the current block, historical block vectors in the HMVP list corresponding to the current block, default block vector, etc., there is no restriction on the construction process of this block vector candidate list. After the block vector candidate list is constructed for the current block, a candidate block vector is selected from the block vector candidate list as the target block vector of the first sub-block. After the target block vector of the first sub-block is determined, a predicted value corresponding to the first sub-block may be obtained according to the target block vector, and there is no limitation on the process of obtaining the predicted value.

Exemplarily, when the first sub-block adopts the MMVD sub-mode in the intra block copy prediction mode, the block vector candidate list may include the block vector candidate list of the MMVD sub-mode, that is, the block vector candidate list includes at least one The block vector obtained after offsetting the original block vector, which may include but not limited to: the block vector of the adjacent block in the space of the current block, the historical block vector in the HMVP list corresponding to the current block, the default block vector, etc. .

The encoding end/decoding end obtains the target block vector of the first sub-block from the block vector candidate list, which may include but not limited to:

Method 1: The encoder performs joint prediction on the current block based on each block division information, each group of prediction mode information, and candidates in each group of prediction mode information, to obtain the prediction information of the current block, and use the rate-distortion principle and the described The prediction information determines the rate-distortion cost for the current block. Assume that the prediction mode information corresponding to the minimum rate-distortion cost includes: the prediction mode information of the first sub-block is the intra block copy prediction mode, the prediction mode information of the second sub-block is the inter prediction mode, and for the block vector candidate list For each candidate block vector, the candidate block vector with the smallest rate-distortion cost is used as the target block vector of the first sub-block. When the encoding end sends the encoded bit stream to the decoding end, the encoded bit stream may carry indication information of the target block vector, the indication information is used to indicate the index information of the target block vector, and the index information is used to indicate that the target block vector is The number of candidate block vectors in the block vector candidate list. The decoding end receives the encoded bit stream from the encoding end, and parses out the indication information from the encoded bit stream. Based on the index information of the target block vector, a candidate block vector corresponding to the index information is selected from the block vector candidate list, and the candidate block vector is the target block vector of the first sub-block.

Method 2: The encoding end agrees on the default target block vector through the agreement, and the decoding end agrees on the default target block vector through the agreement, and the encoded bit stream does not carry the indication information of the target block vector, thereby saving encoding overhead. For example, the encoding end agrees that the first candidate block vector in the default block vector candidate list is used as the target block vector of the first sub-block through the agreement, and the decoding end agrees that the first candidate block vector in the default block vector candidate list is used as the first sub-block through the agreement. The block's target block vector.

For example, a candidate list of motion information is constructed for the current block, and the candidate list of motion information includes at least one piece of candidate motion information, and the construction process of the candidate list of motion information is not limited. After the motion information candidate list is constructed for the current block, a candidate motion information is selected from the motion information candidate list as the target motion information of the second sub-block. After the target motion information of the second sub-block is determined, a prediction value corresponding to the second sub-block may be obtained according to the target motion information, and this process is not limited.

Exemplarily, when the second sub-block adopts the normal merging sub-mode (that is, the Merge sub-mode) in the inter prediction mode, the motion information candidate list includes the motion information candidate list of the normal merging sub-mode. The conventional merging sub-mode can establish a motion information candidate list for the second sub-block. There are multiple candidate motion information (such as motion vectors and reference frame information) in the motion information candidate list, such as spatial candidate motion information, time domain candidate motion information, history Exercise information, default exercise information, etc.

Exemplarily, when the second sub-block adopts the MMVD sub-mode in the inter-frame prediction mode, the motion information candidate list may include the motion information candidate list of the MMVD sub-mode, that is, the motion information candidate list may include the original motion information The motion information obtained after the information is offset, the original motion information may include but not limited to: the motion information of the current block's spatial adjacent blocks, the motion information of the current block's time domain block, the default motion information, etc., the original motion information Information is not limited. For example, the motion information of multiple spatial adjacent blocks is obtained, such as motion information C1-motion information C4, and motion information C1, motion information C2, motion information C3' obtained by offsetting motion information C3, motion information The motion information C4' obtained after the offset of C4 is added to the motion information candidate list. Of course, the above manner is just an example, and there is no limitation thereto, as long as the motion information candidate list includes at least one piece of motion information obtained by offsetting the original motion information.

MMVD is to offset the original motion information with a fixed direction and a fixed vector difference, so as to obtain new running information. For example, by obtaining new motion information in the following manner, the new motion information can be added to the motion information candidate list.

MV(new)=MV(original)+offset; or, MV(new)=MV(original)-offset. MV(new) represents the new motion vector obtained after offset (based on this new motion vector, new motion information can be obtained), and MV(original) represents the original motion vector (that is, the original motion vector included in the original motion information) , offset represents a fixed vector difference, and the value of offset can be configured arbitrarily, such as +1, -1, +2, -2, etc. There is no limit to the value of this offset.

Exemplarily, when the second sub-block adopts the affine merging submode (affine merging submode) in the inter prediction mode, the motion information candidate list may include the motion information candidate list of the affine merging submode, that is to say , using the affine merging sub-mode to create a candidate list of motion information for the current block, the candidate motion information in the candidate list of motion information may include but not limited to: motion information constructed based on the motion information of the spatial adjacent blocks of the current block, based on the current The motion information constructed from the motion information of the time-domain block of the block, the motion information constructed using a fixed rule, the default motion information, etc., are not limited.

The affine merging sub-mode is a prediction technology based on sub-blocks, and the motion information of each sub-block can be deduced through the motion parameter model. Based on this, after selecting a candidate motion information from the motion information candidate list as the target motion information of the second sub-block, for each sub-block of the second sub-block, based on the target motion information and the motion parameter model, the second The motion information of each sub-block of the sub-block, and the prediction value of each sub-block is determined according to the motion information of each sub-block of the second sub-block, and then the prediction value of the second sub-block is obtained. For example, the second sub-block is divided into sub-block 1 and sub-block 2, the motion information of sub-block 1 and the motion information of sub-block 2 can be deduced based on the target motion information and motion parameter model of the second sub-block, and then, according to The motion information of sub-block 1 determines the predicted value of sub-block 1, the predicted value of sub-block 2 is determined according to the motion information of sub-block 2, and the predicted value of sub-block 1 and the predicted value of sub-block 2 form the second sub-block predicted value of .

Exemplarily, when the second sub-block adopts the ATMVP (Alternative TemporalMotion Vector Prediction, optional temporal motion vector prediction) sub-mode of the inter-frame prediction mode, the motion information candidate list may include the ATMVP sub-mode motion information candidate list, or That is, the candidate motion information is acquired using the ATMVP sub-mode. For example, determine the reference frame corresponding to the current block by specifying the motion information, and obtain the reference block corresponding to the current block from the reference frame, and then use the motion information of the reference block to determine the candidate motion information of the current block, such as the motion of the reference block The information is stretched and changed, and the changed motion information is used as the candidate motion information of the current block, which is not limited. After the candidate motion information of the current block is obtained, the candidate motion information may be added to the motion information candidate list of the ATMVP submode. If the motion information candidate list of the ATMVP sub-mode only includes one of the candidate motion information, then use the candidate motion information as the target motion information of the second sub-block; if the motion information candidate list of the ATMVP sub-mode includes one of the candidate motion information information, and includes other candidate motion information (there is no limitation on how to add other candidate motion information), then a candidate motion information can be selected from the motion information candidate list of the ATMVP sub-mode as the target motion information of the second sub-block.

Exemplarily, when the second sub-block adopts the ATMVP sub-mode of the inter-frame prediction mode, the reference frame corresponding to the current block can be determined by specifying the motion information, and the reference block corresponding to the current block can be obtained from the reference frame, and then, use The motion information of the reference block is used to determine the candidate motion information of the current block. For example, the motion information of the reference block is scaled and changed, and the changed motion information is used as the candidate motion information of the current block. This is not limited. After the candidate motion information of the current block is obtained, the candidate motion information may be directly used as the target motion information of the second sub-block.

In the foregoing embodiments, the ATMVP sub-mode may also be called an SBTMVP (sub-block TMVP) sub-mode.

The encoding end/decoding end obtains the target motion information of the second sub-block from the motion information candidate list, including but not limited to:

Method 1: The encoder performs joint prediction on the current block based on each block division information, each group of prediction mode information, and candidates in each group of prediction mode information, to obtain the prediction information of the current block, and use the rate-distortion principle and the described The prediction information determines the rate-distortion cost for the current block. It is assumed that the prediction mode information corresponding to the minimum rate-distortion cost includes: the prediction mode information of the first sub-block is an intra block copy prediction mode, the prediction mode information of the second sub-block is an inter prediction mode, and for For each candidate motion information, the candidate motion information with the smallest rate-distortion cost is used as the target motion information of the second sub-block. When the encoding end sends the encoded bit stream to the decoding end, the encoded bit stream carries the indication information of the target motion information, and the indication information is used to indicate the index information of the target motion information, and the index information is used to indicate that the target motion information is a motion The number candidate motion information in the information candidate list. The decoding end receives the encoded bit stream from the encoding end, and parses out the indication information from the encoded bit stream. Based on the index information of the target motion information, the candidate motion information corresponding to the index information is selected from the motion information candidate list, and the candidate motion information is the target motion information of the second sub-block.

Method 2: The encoding end specifies the default target motion information through the protocol, and the decoding end specifies the default target motion information through the protocol. In this way, the coded bit stream does not need to carry the indication information of the target motion information, thereby saving coding overhead.

For example, the encoding end can agree on the first candidate motion information of the default motion information candidate list as the target motion information of the second sub-block through the agreement, and the decoding end can agree on the first candidate motion information of the default motion information candidate list as the second sub-block through the agreement. The target motion information of the second sub-block. Of course, the above manner is only an example, and is not limited thereto.

Based on Embodiment 3, when the current frame where the current block is located is a B frame or an I frame, the current block can be divided into a first sub-block and a second sub-block according to a fixed direction, and the first sub-block and the second sub-block can be both Triangular sub-block, the first sub-block and the second sub-block can be triangular sub-block and ladder sub-block respectively, the first sub-block and the second sub-block can be both ladder-shaped sub-blocks, the first sub-block and the second sub-block can be They are triangular sub-blocks and pentagonal sub-blocks respectively, and there is no restriction on the division method of the current block. Exemplarily, the prediction mode information of the first sub-block may be an intra block copy prediction mode (IBC), and the prediction mode information of the second sub-block may be an inter prediction mode (Inter). Referring to FIG. 5A-FIG. 5H, it is an example in which the first sub-block adopts the intra-frame block copy prediction mode and the second sub-block adopts the inter-frame prediction mode, and there is no restriction on the shape of the first sub-block and the second sub-block. 5A-5H are just examples.

Exemplarily, when the first sub-block adopts the intra-frame block copy prediction mode and the second sub-block adopts the inter-frame prediction mode, the division direction and which sub-block adopts the prediction mode information of the surrounding blocks of the current block can also be determined. In the intra block copy prediction mode, which sub-block adopts the inter prediction mode, that is, which sub-block is the first sub-block and which sub-block is the second sub-block.

Referring to FIG. 5I, N0 and N1 are two surrounding blocks of the current block. Based on the prediction mode information of the two surrounding blocks, when both the first sub-block and the second sub-block are triangular sub-blocks, if N0 The prediction mode information is the intra block copy prediction mode, and the prediction mode information of N1 is the intra block copy prediction mode, then one of the three division directions shown in Figure 5I can be used, and Figure 5I shows which One sub-block adopts the intra block copy prediction mode, and which sub-block adopts the inter-frame prediction mode.

Referring to FIG. 5J, N0 and N1 are two surrounding blocks of the current block. Based on the prediction mode information of the two surrounding blocks, when the first sub-block and the second sub-block are both triangular sub-blocks, if the The prediction mode information is not the intra block copy prediction mode, and the prediction mode information of N1 is not the intra block copy prediction mode, then one of the three division directions shown in Figure 5J is adopted, and Figure 5J shows Which sub-block adopts the intra-block copy prediction mode, and which sub-block adopts the inter-frame prediction mode.

Referring to FIG. 5K, N0 and N1 are two surrounding blocks of the current block. Based on the prediction mode information of the two surrounding blocks, when both the first sub-block and the second sub-block are triangular sub-blocks, if N0 The prediction mode information is the intra block copy prediction mode, and the prediction mode information of N1 is not the intra block copy prediction mode, then one of the three division directions shown in Figure 5K is adopted, which one is shown in Figure 5K The sub-block adopts the intra-block copy prediction mode, and which sub-block adopts the inter-frame prediction mode.

Referring to FIG. 5L, N0 and N1 are two surrounding blocks of the current block. Based on the prediction mode information of the two surrounding blocks, when both the first sub-block and the second sub-block are triangular sub-blocks, if the The prediction mode information is not the intra block copy prediction mode, and the prediction mode information of N1 is the intra block copy prediction mode, then one of the three division directions shown in Figure 5L is adopted, which one is shown in Figure 5L The sub-block adopts the intra-block copy prediction mode, and which sub-block adopts the inter-frame prediction mode.

Certainly, Fig. 5I-Fig. 5L is just an example, when other shapes are adopted, such as the first sub-block and the second sub-block are triangular sub-blocks and trapezoidal sub-blocks respectively, or the first sub-block and the second sub-block are both trapezoidal sub-blocks The blocks, or the first sub-block and the second sub-block are triangular sub-blocks and pentagonal sub-blocks respectively, and the implementation thereof can be referred to as shown in Fig. 5I-Fig. 5L, and will not be repeated here.

In Embodiment 3, it is assumed that there are two areas in the current block, one area 1 is the screen content, and the other area 2 has a strong temporal correlation. In this application scenario, by dividing the current block into the first sub block (that is, the sub-block of region 1) and the second sub-block (that is, the sub-block of region 2), and the prediction mode information of the first sub-block is the intra block copy prediction mode, and the prediction mode information of the second sub-block is frame The inter-prediction mode is based on the fact that there are a large number of repeated textures in the same frame in the screen content. Since the first sub-block uses the intra-frame block copy prediction mode, the coding effect can be improved. Since the second sub-block uses an inter-frame prediction mode, the purpose of effectively removing redundancy in the video time domain can be achieved, and the coding effect can be improved.

Embodiment 4: For step 204 in Embodiment 1, if the prediction mode information of the first sub-block is the intra block copy prediction mode, and the prediction mode information of the second sub-block is the intra prediction mode, Embodiment 4 can be adopted Realize, refer to embodiment 1 for other processes. In Embodiment 3, a block vector candidate list is constructed, and the block vector candidate list includes multiple candidate block vectors; a candidate block vector is selected from the block vector candidate list as the target block vector of the first sub-block. A target intra-frame sub-prediction mode of the second sub-block is acquired. Acquiring a prediction value corresponding to the first sub-block according to the target block vector; obtaining a prediction value corresponding to the second sub-block according to the target intra-frame sub-prediction mode.

For example, a block vector candidate list is constructed for the current block, and the candidate block vectors in the block vector candidate list include but are not limited to: block vectors of spatial adjacent blocks of the current block, historical block vectors in the HMVP list corresponding to the current block, default block vector, etc., there is no restriction on the construction process of this block vector candidate list. After the block vector candidate list is constructed for the current block, a candidate block vector is selected from the block vector candidate list as the target block vector of the first sub-block. After the target block vector of the first sub-block is determined, a predicted value corresponding to the first sub-block may be obtained according to the target block vector, and there is no limitation on the process of obtaining the predicted value.

Exemplarily, when the first sub-block adopts the MMVD sub-mode in the intra block copy prediction mode, the block vector candidate list may include the block vector candidate list of the MMVD sub-mode, that is, the block vector candidate list includes at least one The block vector obtained after offsetting the original block vector, which may include but not limited to: the block vector of the adjacent block in the space of the current block, the historical block vector in the HMVP list corresponding to the current block, the default block vector, etc. .

For example, the target intra-frame sub-prediction mode of the second sub-block can be obtained. After the target intra-frame sub-prediction mode is obtained, the prediction value corresponding to the second sub-block can be obtained according to the target intra-frame sub-prediction mode. The method of obtaining the prediction value is different. Do limit. Exemplarily, obtaining the target intra-frame sub-prediction mode of the second sub-block may include but not limited to the following methods:

Manner 1: Determine the specified intra-frame sub-prediction mode as the target intra-frame sub-prediction mode of the second sub-block. That is to say, the encoding end determines the specified intra-frame sub-prediction mode as the target intra-frame sub-prediction mode of the second sub-block, and the decoding end determines the specified intra-frame sub-prediction mode as the target intra-frame sub-prediction mode of the second sub-block. For example, the encoding end determines the Planar mode as the target intra-frame sub-prediction mode of the second sub-block by default by agreement, and the decoder determines the Planar mode as the target intra-frame sub-prediction mode of the second sub-block by default by agreement. For another example, the encoding end determines the DC mode as the target intra-frame sub-prediction mode of the second sub-block by default by agreement, and the decoder determines the DC mode as the target intra-frame sub-prediction mode of the second sub-block by default by agreement. Of course, the above-mentioned Planar mode and DC mode are just examples, and various angle prediction modes may be determined by default as target intra-frame sub-prediction modes of the second sub-block by agreement, and there is no limitation on this.

Method 2. Constructing an intra-frame sub-prediction mode candidate list, the intra-frame sub-prediction mode candidate list may include multiple candidate intra-frame sub-prediction modes; select a candidate intra-frame sub-prediction mode from the intra-frame sub-prediction mode candidate list as the target of the second sub-block Intra sub-prediction mode. For example, a candidate list of intra-frame sub-prediction modes is constructed for the current block. The candidate intra-frame sub-prediction modes in the candidate list of intra-frame sub-prediction modes include but are not limited to: Planar mode, DC mode, vertical angle mode, horizontal angle mode, etc. For this intra-frame sub-prediction mode The construction process of the prediction mode candidate list is not limited, and the intra-frame sub-prediction mode candidate list may also include candidate intra-frame sub-prediction modes from other angles. After constructing the intra-frame sub-prediction mode candidate list for the current block, select a candidate intra-frame sub-prediction mode from the intra-frame sub-prediction mode candidate list as the target intra-frame sub-prediction mode of the second sub-block, and obtain the same value as the target intra-frame sub-prediction mode according to the target intra-frame sub-prediction mode The prediction value corresponding to the second sub-block is not restricted in the acquisition process.

The encoder/decoder obtains the target intra-frame sub-prediction mode from the intra-frame sub-prediction mode candidate list, including but not limited to:

Mode A. The encoding end jointly predicts the current block based on each block division information, each group of prediction mode information, and each group of candidates in the prediction mode information to obtain the prediction information of the current block, and uses the rate-distortion principle and the above-mentioned The prediction information determines the rate-distortion cost for the current block. It is assumed that the prediction mode information corresponding to the minimum rate-distortion cost includes: the prediction mode information of the first sub-block is the intra block copy prediction mode, the prediction mode information of the second sub-block is the intra prediction mode, and for the intra sub-prediction mode candidate list For each candidate intra-frame sub-prediction mode in , the candidate intra-frame sub-prediction mode with the smallest rate-distortion cost is used as the target intra-frame sub-prediction mode of the second sub-block. When the encoding end sends the encoded bit stream to the decoding end, the encoded bit stream carries indication information of the target intra-frame sub-prediction mode, and the indication information is used to indicate index information of the target intra-frame sub-prediction mode, and the index information is used to represent the target intra-frame sub-prediction The prediction mode is the number of candidate intra-frame sub-prediction modes in the intra-frame sub-prediction mode candidate list. The decoding end receives the encoded bit stream from the encoding end, and parses out the indication information from the encoded bit stream. Based on the index information of the target intra sub-prediction mode, a candidate intra-frame sub-prediction mode corresponding to the index information is selected from the intra-frame sub-prediction mode candidate list, and the candidate intra-frame sub-prediction mode is the target intra-frame sub-prediction mode of the second sub-block.

Method B: The encoding end specifies the default target intra-frame sub-prediction mode through the agreement, and the decoder specifies the default target intra-frame sub-prediction mode through the agreement. In this way, the coded bit stream does not carry the indication information of the target intra-frame sub-prediction mode, thereby saving coding overhead. For example, the encoding end agrees by agreement that the first candidate intra-frame sub-prediction mode in the default intra-frame sub-prediction mode candidate list is used as the target intra-frame sub-prediction mode of the second sub-block, and the decoding end agrees by agreement that the first candidate intra-frame sub-prediction mode in the candidate list is The first candidate intra-frame sub-prediction mode is used as the target intra-frame sub-prediction mode of the second sub-block.

Way 3: Determine the intra-frame sub-prediction mode of the adjacent blocks of the second sub-block as the target intra-frame sub-prediction mode of the second sub-block. For example, for the encoding end, if the adjacent blocks of the second sub-block are predicted using a certain intra-frame sub-prediction mode, the encoding end can obtain the intra-frame sub-prediction mode of the adjacent blocks of the second sub-block, and use the second The intra sub-prediction modes of neighboring blocks of the sub-block are determined as the target intra-sub-prediction mode of the second sub-block. For the decoding end, if the adjacent blocks of the second sub-block are predicted using a certain intra-frame sub-prediction mode, the decoding end can obtain the intra-frame sub-prediction mode of the adjacent blocks of the second sub-block, and use the second sub-block The intra-frame sub-prediction mode of the adjacent block of is determined as the target intra-frame sub-prediction mode of the second sub-block.

Based on embodiment 4, when the current frame where the current block is located is a B frame or an I frame, the current block can be divided into a first sub-block and a second sub-block according to a fixed direction, and the first sub-block and the second sub-block can be both Triangular sub-block, the first sub-block and the second sub-block can be triangular sub-block and ladder sub-block respectively, the first sub-block and the second sub-block can be both ladder-shaped sub-blocks, the first sub-block and the second sub-block can be They are triangular sub-blocks and pentagonal sub-blocks respectively, and there is no restriction on the division method of the current block. Exemplarily, the prediction mode information of the first sub-block may be an intra block copy prediction mode (IBC), and the prediction mode information of the second sub-block may be an intra prediction mode (Intra). Referring to Figures 6A-6H, it is an example in which the first sub-block adopts the intra-frame block copy prediction mode and the second sub-block adopts the intra-frame prediction mode, and there is no restriction on the shape of the first sub-block and the second sub-block, Figures 6A-6H are just examples.

Exemplarily, when the first sub-block adopts the intra-frame block copy prediction mode and the second sub-block adopts the intra-frame prediction mode, the division direction and which sub-block adopts the prediction mode information of the surrounding blocks of the current block can also be determined. In the intra block copy prediction mode, which sub-block adopts the intra prediction mode, that is, which sub-block is the first sub-block and which sub-block is the second sub-block.

Referring to FIG. 7A, N0 and N1 are two surrounding blocks of the current block. Based on the prediction mode information of the two surrounding blocks, when the first sub-block and the second sub-block are both triangular sub-blocks, if the The prediction mode information is an intra-frame prediction mode, and the prediction mode information of N1 is an intra-frame prediction mode, then one of the three division directions shown in Figure 7A can be used, and Figure 7A shows which sub-block adopts Intra block copy prediction mode, which sub-block adopts intra prediction mode.

Referring to FIG. 7B, N0 and N1 are two surrounding blocks of the current block. Based on the prediction mode information of the two surrounding blocks, when the first sub-block and the second sub-block are both triangular sub-blocks, if the The prediction mode information is not an intra prediction mode, and the prediction mode information of N1 is not an intra prediction mode, then one of the three division directions shown in Figure 7B can be used, and Figure 7B shows which subdivision direction The block adopts the intra block copy prediction mode, which sub-block adopts the intra prediction mode.

Referring to FIG. 7C, N0 and N1 are two surrounding blocks of the current block. Based on the prediction mode information of the two surrounding blocks, when the first sub-block and the second sub-block are both triangular sub-blocks, if N0 The prediction mode information is an intra-frame prediction mode, and the prediction mode information of N1 is not an intra-frame prediction mode, then one of the three division directions shown in Figure 7C can be used, and Figure 7C shows which sub-block The intra block copy prediction mode is used, which sub-block adopts the intra prediction mode.

Referring to FIG. 7D, N0 and N1 are two surrounding blocks of the current block. Based on the prediction mode information of the two surrounding blocks, when the first sub-block and the second sub-block are both triangular sub-blocks, if N0 The prediction mode information is not an intra-frame prediction mode, and the prediction mode information of N1 is an intra-frame prediction mode, then one of the three division directions shown in Figure 7D can be used, and Figure 7D shows which sub-block The intra block copy prediction mode is used, which sub-block adopts the intra prediction mode.

Of course, Fig. 7A-Fig. 7D are just examples, when adopting other shapes, such as the first sub-block and the second sub-block are triangular sub-block and trapezoidal sub-block respectively, or the first sub-block and the second sub-block are both trapezoidal sub-blocks The blocks, or the first sub-block and the second sub-block are triangular sub-blocks and pentagonal sub-blocks respectively, and the implementation thereof can be referred to as shown in FIG. 7A-FIG. 7D , and will not be repeated here.

In Embodiment 4, it is assumed that there are two areas in the current block, one area 1 is the screen content, and the other area 2 has natural texture. In this application scenario, by dividing the current block into the first sub-block (i.e. area 1 sub-block) and the second sub-block (that is, the sub-block of region 2), and the prediction mode information of the first sub-block is the intra block copy prediction mode, and the prediction mode information of the second sub-block is the intra prediction mode, based on In the screen content, there are a large number of repeated textures in the same frame. Since the first sub-block uses the intra-block copy prediction mode, the coding effect can be improved. Since the intra-frame prediction mode corresponds to the texture direction, when the second sub-block uses the intra-frame prediction mode, the purpose of effectively removing video redundancy can be achieved, and the coding effect can be improved.

Embodiment 5: For step 204 in Embodiment 1, if the prediction mode information of the first sub-block is an intra-frame prediction mode, and the prediction mode information of the second sub-block is an intra-frame prediction mode, Embodiment 5 can be used to implement, Refer to Example 1 for other processes. In Embodiment 5, the first target intra-frame sub-prediction mode of the first sub-block and the second target intra-frame sub-prediction mode of the second sub-block can be obtained, and the first target intra-frame sub-prediction mode and the second target intra-frame sub-prediction The modes are different; the prediction value corresponding to the first sub-block is obtained according to the first target intra-frame sub-prediction mode; the prediction value corresponding to the second sub-block is obtained according to the second target intra-frame sub-prediction mode.

For example, acquiring a first target intra-frame sub-prediction mode of the first sub-block and a second target intra-frame sub-prediction mode of the second sub-block, and acquiring a prediction value corresponding to the first sub-block according to the first target intra-frame sub-prediction mode, Acquire a predictive value corresponding to the second sub-block according to the second target intra-frame sub-prediction mode, and there is no limitation on the manner of obtaining the predictive value. Exemplarily, obtaining the first target intra-frame sub-prediction mode and the second target intra-frame sub-prediction mode may include but not limited to the following methods:

Manner 1: The first intra-frame sub-prediction mode is designated as the first target intra-frame sub-prediction mode of the first sub-block, and the second intra-frame sub-prediction mode is designated as the second target intra-frame sub-prediction mode of the second sub-block. That is to say, the encoder may determine the designated first intra-frame sub-prediction mode as the first target intra-frame sub-prediction mode of the first sub-block, and determine the designated second intra-frame sub-prediction mode as the second target frame of the second sub-block Intra sub-prediction mode, the decoding end may determine the designated first intra-frame sub-prediction mode as the first target intra-frame sub-prediction mode of the first sub-block, and determine the designated second intra-frame sub-prediction mode as the second target frame of the second sub-block Inner prediction mode. For example, the encoding end may determine the Planar mode as the first target intra-frame sub-prediction mode of the first sub-block by default by agreement, and determine the DC mode as the second target intra-frame sub-prediction mode of the second sub-block by default by agreement. The decoding end may determine the Planar mode as the first target intra-frame sub-prediction mode of the first sub-block by default by agreement, and determine the DC mode as the second target intra-frame sub-prediction mode of the second sub-block by default by agreement. Of course, the above manner is only an example, and other agreements can also be made, which is not limited.

Method 2: Constructing an intra-frame sub-prediction mode candidate list, the intra-frame sub-prediction mode candidate list may include multiple candidate intra-frame sub-prediction modes; select a candidate intra-frame sub-prediction mode from the intra-frame sub-prediction mode candidate list as the first sub-block A target intra-frame sub-prediction mode, and selecting another candidate intra-frame sub-prediction mode from the intra-frame sub-prediction mode candidate list as the second target intra-frame sub-prediction mode of the second sub-block. For example, a candidate list of intra-frame sub-prediction modes is constructed for the current block. The candidate intra-frame sub-prediction modes in the candidate list of intra-frame sub-prediction modes include but are not limited to: Planar mode, DC mode, vertical angle mode, horizontal angle mode, etc. For this intra-frame sub-prediction mode The construction process of the prediction mode candidate list is not limited, and the intra-frame sub-prediction mode candidate list may also include candidate intra-frame sub-prediction modes from other angles. After the intra-frame sub-prediction mode candidate list is constructed for the current block, a candidate intra-frame sub-prediction mode is selected from the intra-frame sub-prediction mode candidate list as the first target intra-frame sub-prediction mode of the first sub-block, and according to the first target intra-frame sub-prediction The mode obtains the prediction value corresponding to the first sub-block, and there is no limitation on the obtaining process. On the basis of excluding the first target intra-frame sub-prediction mode, select another candidate intra-frame sub-prediction mode from the intra-frame sub-prediction mode candidate list as the second target intra-frame sub-prediction mode of the second sub-block, and according to the second target intra-frame sub-prediction mode The prediction mode acquires the predicted value corresponding to the second sub-block, and there is no limitation on this acquisition process.

The encoder/decoder obtains the target intra-frame sub-prediction mode from the intra-frame sub-prediction mode candidate list, including but not limited to:

Mode A. The encoding end jointly predicts the current block based on each block division information, each group of prediction mode information, and each group of candidates in the prediction mode information to obtain the prediction information of the current block, and uses the rate-distortion principle and the above-mentioned The prediction information determines the rate-distortion cost for the current block. It is assumed that the prediction mode information corresponding to the minimum rate-distortion cost includes: the prediction mode information of the first sub-block is an intra-frame prediction mode, the prediction mode information of the second sub-block is an intra-frame prediction mode, and for the intra-frame sub-prediction mode candidate list For each candidate intra-frame sub-prediction mode, the candidate intra-frame sub-prediction mode with the smallest rate-distortion cost is used as the first target intra-frame sub-prediction mode of the first sub-block. On the basis of excluding the first target intra-frame sub-prediction mode, the candidate intra-frame sub-prediction mode with the smallest rate-distortion cost is used as the second target intra-frame sub-prediction mode of the second sub-block.

When the encoding end sends the encoded bit stream to the decoding end, the encoded bit stream carries indication information of the target intra-frame sub-prediction mode, and the indication information is used to indicate the index information of the first target intra-frame sub-prediction mode. A target intra-frame sub-prediction mode is the number of candidate intra-frame sub-prediction modes in the intra-frame sub-prediction mode candidate list. The indication information is also used to indicate index information of the second target intra sub-prediction mode, and the index information is used to indicate which candidate intra sub-prediction mode is the second target intra sub-prediction mode in the intra sub-prediction mode candidate list.

The decoding end receives the encoded bit stream from the encoding end, and parses out the indication information from the encoded bit stream. Based on the index information of the first target intra-frame sub-prediction mode, select a candidate intra-frame sub-prediction mode corresponding to the index information from the intra-frame sub-prediction mode candidate list, and the candidate intra-frame sub-prediction mode is the first target intra-frame sub-prediction mode of the first sub-block predictive mode. Based on the index information of the second target intra-frame sub-prediction mode, select a candidate intra-frame sub-prediction mode corresponding to the index information from the intra-frame sub-prediction mode candidate list, and the candidate intra-frame sub-prediction mode is the second target intra-frame sub-prediction mode of the second sub-block predictive mode.

Method B: The encoding end agrees to default the first target intra-frame sub-prediction mode and the second target intra-frame sub-prediction mode through the agreement, and the decoding end agrees to default the first target intra-frame sub-prediction mode and the second target intra-frame sub-prediction mode through the agreement. In this way, the encoding The bit stream does not carry indication information of the target intra-frame sub-prediction mode, thereby saving coding overhead. For example, the encoding end agrees through an agreement that the first candidate intra-frame sub-prediction mode in the default intra-frame sub-prediction mode candidate list is used as the first target intra-frame sub-prediction mode of the first sub-block, and the second candidate in the intra-frame sub-prediction mode candidate list The intra sub-prediction mode serves as a second target intra sub-prediction mode of the second sub-block. The decoding end agrees through the protocol that the first candidate intra sub-prediction mode in the default intra sub-prediction mode candidate list is used as the first target intra sub-prediction mode of the first sub-block, and the second candidate intra-sub-prediction mode in the candidate list of intra-frame sub-prediction modes The prediction mode serves as a second target intra sub-prediction mode of the second sub-block.

Method 3: If the intra-frame sub-prediction mode of the first adjacent block of the first sub-block is different from the intra-frame sub-prediction mode of the second adjacent block of the second sub-block, the intra-frame sub-prediction mode of the first adjacent block can be set to Determine as the first target intra-frame sub-prediction mode of the first sub-block, and determine the intra-frame sub-prediction mode of the second neighboring block as the second target intra-frame sub-prediction mode of the second sub-block. Or, if the intra-frame sub-prediction mode of the first adjacent block is the same as the intra-frame sub-prediction mode of the second adjacent block, the intra-frame sub-prediction mode of the first adjacent block may be determined as the first target frame of the first sub-block An intra sub-prediction mode, and another intra-frame sub-prediction mode different from the first target intra-frame sub-prediction mode is determined as a second target intra-frame sub-prediction mode of the second sub-block. Alternatively, if the intra-frame sub-prediction mode of the first adjacent block is the same as the intra-frame sub-prediction mode of the second adjacent block, the intra-frame sub-prediction mode of the second adjacent block may be determined as the second target frame of the second sub-block Intra sub-prediction mode, and another intra-frame sub-prediction mode different from the second target intra-frame sub-prediction mode is determined as the first target intra-frame sub-prediction mode of the first sub-block.

Exemplarily, for the encoding end or the decoding end, if the first adjacent block of the first sub-block is predicted using intra-frame sub-prediction mode A, the second adjacent block of the second sub-block is predicted using intra-frame sub-prediction mode B prediction, when the intra-frame sub-prediction mode A is different from the intra-frame sub-prediction mode B, the intra-frame sub-prediction mode A may be determined as the first target intra-frame sub-prediction mode of the first sub-block, and the intra-frame sub-prediction mode B may be determined as the first target intra-frame sub-prediction mode The second target intra-frame sub-prediction mode of the two sub-blocks.

When the intra-frame sub-prediction mode A is the same as the intra-frame sub-prediction mode B, the intra-frame sub-prediction mode A is determined as the first target intra-frame sub-prediction mode of the first sub-block, and another frame different from the intra-frame sub-prediction mode A The intra sub-prediction mode C is determined as the second target intra-sub-prediction mode of the second sub-block. For example, the intra-frame sub-prediction mode C may be the intra-frame sub-prediction mode of the adjacent block of the second adjacent block. For another example, if the intra-frame sub-prediction mode A is the Planar mode, the intra-frame sub-prediction mode C may be the DC mode. There are restrictions, as long as the intra-frame sub-prediction mode C is different from the intra-frame sub-prediction mode A.

When the intra-frame sub-prediction mode A is the same as the intra-frame sub-prediction mode B, the intra-frame sub-prediction mode B is determined as the second target intra-frame sub-prediction mode of the second sub-block, and another frame different from the intra-frame sub-prediction mode B The intra sub-prediction mode D is determined as the first target intra-sub-prediction mode of the first sub-block. For example, the intra-frame sub-prediction mode D may be the intra-frame sub-prediction mode of the adjacent block of the first adjacent block. For another example, if the intra-frame sub-prediction mode B is the Planar mode, the intra-frame sub-prediction mode D may be the DC mode. There is a limitation, as long as the intra sub-prediction mode D is different from the intra sub-prediction mode B.

Exemplarily, for the encoding end or the decoding end, if the first adjacent block of the first sub-block is predicted using the intra-frame sub-prediction mode A, the second adjacent block of the second sub-block is not predicted using the intra-frame prediction mode prediction, the intra-frame sub-prediction mode A is determined as the first target intra-frame sub-prediction mode of the first sub-block, and another intra-frame sub-prediction mode C different from the intra-frame sub-prediction mode A is determined as the second target of the second sub-block Intra sub-prediction mode. For example, the intra-frame sub-prediction mode C is the intra-frame sub-prediction mode of the adjacent block of the second adjacent block, and for example, if the intra-frame sub-prediction mode A is the Planar mode, the intra-frame sub-prediction mode C can be the DC mode, and this is not done As long as the intra-frame sub-prediction mode C is different from the intra-frame sub-prediction mode A.

Exemplarily, for the coding end or the decoding end, if the second adjacent block of the second sub-block is predicted using the intra-frame sub-prediction mode B, the first adjacent block of the first sub-block is not predicted using the intra-frame prediction mode prediction, the intra-frame sub-prediction mode B is determined as the second target intra-frame sub-prediction mode of the second sub-block, and another intra-frame sub-prediction mode D different from the intra-frame sub-prediction mode B is determined as the first target of the first sub-block Intra sub-prediction mode. For example, the intra-frame sub-prediction mode D is the intra-frame sub-prediction mode of the adjacent block of the first adjacent block, and for example, if the intra-frame sub-prediction mode B is Planar mode, the intra-frame sub-prediction mode D can be DC mode, and this is not done As long as the intra-frame sub-prediction mode D is different from the intra-frame sub-prediction mode B.

Based on Embodiment 5, when the current frame where the current block is located is a B frame or an I frame, the current block can be divided into a first sub-block and a second sub-block according to a fixed direction, and the first sub-block and the second sub-block can be both Triangular sub-block, the first sub-block and the second sub-block can be triangular sub-block and ladder sub-block respectively, the first sub-block and the second sub-block can be both ladder-shaped sub-blocks, the first sub-block and the second sub-block can be They are triangular sub-blocks and pentagonal sub-blocks respectively, and there is no restriction on the division method of the current block. Exemplarily, the prediction mode information of the first sub-block may be an intra prediction mode (Intra), and the prediction mode information of the second sub-block may be an intra prediction mode (Intra). However, the first target of the first sub-block The intra-frame sub-prediction mode is different from the second target intra-frame sub-prediction mode of the second sub-block. The first target intra-frame sub-prediction mode and the second target intra-frame sub-prediction mode may be fixed, or derived from surrounding blocks. Referring to Figure 8A-Figure 8D, it is an example in which the first sub-block adopts the intra-frame prediction mode and the second sub-block adopts the intra-frame prediction mode, and there is no restriction on the shapes of the first sub-block and the second sub-block, as shown in Figure 8A - Figure 8D is just an example.

In Embodiment 5, it is assumed that there are two regions in the current block, one region 1 has natural texture, and the other region 2 also has natural texture, but the natural texture of region 1 is different from the natural texture of region 2, and needs to correspond to different frames Intra-sub-prediction mode, in this application scenario, by dividing the current block into the first sub-block (ie, the sub-block of area 1) and the second sub-block (ie, the sub-block of area 2), and the prediction of the first sub-block The mode information is an intra prediction mode, and the prediction mode information of the second sub-block is an intra prediction mode. Since the first sub-block uses the intra-frame prediction mode and the second sub-block uses the intra-frame prediction mode, the purpose of effectively removing video redundancy can be achieved, and the coding effect can be improved.

Embodiment 6: For step 204 in Embodiment 1, if the prediction mode information of the first sub-block is an inter-frame prediction mode, and the prediction mode information of the second sub-block is an intra-frame prediction mode, Embodiment 6 can be used to implement, Refer to Example 1 for other processes. In embodiment 6, a motion information candidate list is constructed, and the motion information candidate list includes at least one candidate motion information; a candidate motion information is selected from the motion information candidate list as the target motion information of the first sub-block; and the target motion information of the second sub-block is acquired A target intra-frame sub-prediction mode; acquiring a predictive value corresponding to the first sub-block according to the target motion information; and acquiring a predictive value corresponding to the second sub-block according to the target intra-frame sub-prediction mode.

For example, a candidate list of motion information is constructed for the current block, and the candidate list of motion information includes at least one piece of candidate motion information, and the construction process of the candidate list of motion information is not limited. After the motion information candidate list is constructed for the current block, a candidate motion information is selected from the motion information candidate list as the target motion information of the first sub-block. After the target motion information of the first sub-block is determined, a prediction value corresponding to the first sub-block may be acquired according to the target motion information, and this process is not limited.

Exemplarily, when the first sub-block adopts the normal merging sub-mode in the inter prediction mode, the motion information candidate list includes the motion information candidate list of the normal merging sub-mode. When the first sub-block adopts the MMVD sub-mode in the inter-frame prediction mode, the motion information candidate list may include the motion information candidate list of the MMVD sub-mode. When the first sub-block adopts the affine merging sub-mode (affine merging sub-mode) in the inter-frame prediction mode, the motion information candidate list may include the motion information candidate list of the affine merging sub-mode. When the first sub-block adopts the ATMVP sub-mode in the inter-frame prediction mode, the motion information candidate list includes the motion information candidate list of the ATMVP sub-mode.

The encoder/decoder obtains the target motion information of the first sub-block from the motion information candidate list, including but not limited to:

Method 1: The encoder performs joint prediction on the current block based on each block division information, each group of prediction mode information, and candidates in each group of prediction mode information, to obtain the prediction information of the current block, and use the rate-distortion principle and the described The prediction information determines the rate-distortion cost for the current block. It is assumed that the prediction mode information corresponding to the minimum rate-distortion cost includes: the prediction mode information of the first sub-block is an inter-frame prediction mode, the prediction mode information of the second sub-block is an intra-frame prediction mode, and for each For the candidate motion information, the candidate motion information with the smallest rate-distortion cost is used as the target motion information of the first sub-block. When the encoding end sends the encoded bit stream to the decoding end, the encoded bit stream may carry indication information of target motion information, the indication information is used to indicate index information of the target motion information, and the index information is used to indicate that the target motion information is The number candidate motion information in the motion information candidate list. The decoding end receives the encoded bit stream from the encoding end, and parses out the indication information from the encoded bit stream. Based on the index information of the target motion information, the candidate motion information corresponding to the index information is selected from the motion information candidate list, and the candidate motion information is the target motion information of the first sub-block.

Method 2: The encoding end specifies the default target motion information through the protocol, and the decoding end specifies the default target motion information through the protocol. In this way, the coded bit stream does not need to carry the indication information of the target motion information, thereby saving coding overhead.

For example, the encoding end may specify the first motion information candidate in the default motion information candidate list as the target motion information of the first sub-block through an agreement, and the decoding end may specify the first candidate motion information in the default motion information candidate list as the first sub-block through an agreement. A sub-block of target motion information. Of course, the above manner is only an example, and is not limited thereto.

For example, the target intra-frame sub-prediction mode of the second sub-block can be obtained. After the target intra-frame sub-prediction mode is obtained, the prediction value corresponding to the second sub-block can be obtained according to the target intra-frame sub-prediction mode. The method of obtaining the prediction value is different. Do limit. Exemplarily, obtaining the target intra-frame sub-prediction mode of the second sub-block may include but not limited to the following methods:

Manner 1: Determine the specified intra-frame sub-prediction mode as the target intra-frame sub-prediction mode of the second sub-block.

Exemplarily, the encoding end determines the specified intra-frame sub-prediction mode as the target intra-frame sub-prediction mode of the second sub-block, and the decoding end determines the specified intra-frame sub-prediction mode as the target intra-frame sub-prediction mode of the second sub-block.

Method 2. Constructing an intra-frame sub-prediction mode candidate list, the intra-frame sub-prediction mode candidate list may include multiple candidate intra-frame sub-prediction modes; select a candidate intra-frame sub-prediction mode from the intra-frame sub-prediction mode candidate list as the target of the second sub-block Intra sub-prediction mode. For example, a candidate list of intra-frame sub-prediction modes is constructed for the current block. The candidate intra-frame sub-prediction modes in the candidate list of intra-frame sub-prediction modes include but are not limited to: Planar mode, DC mode, vertical angle mode, horizontal angle mode, etc. Select a candidate intra-frame sub-prediction mode from the intra-frame sub-prediction mode candidate list as the target intra-frame sub-prediction mode of the second sub-block, and obtain a prediction value corresponding to the second sub-block according to the target intra-frame sub-prediction mode.

The encoder/decoder obtains the target intra-frame sub-prediction mode from the intra-frame sub-prediction mode candidate list, including but not limited to:

Mode A. The encoding end jointly predicts the current block based on each block division information, each group of prediction mode information, and each group of candidates in the prediction mode information to obtain the prediction information of the current block, and uses the rate-distortion principle and the above-mentioned The prediction information determines the rate-distortion cost for the current block. It is assumed that the prediction mode information corresponding to the minimum rate-distortion cost includes: the prediction mode information of the first sub-block is an inter-frame prediction mode, the prediction mode information of the second sub-block is an intra-frame prediction mode, and for the intra-frame sub-prediction mode candidate list For each candidate intra-frame sub-prediction mode, the candidate intra-frame sub-prediction mode with the smallest rate-distortion cost is used as the target intra-frame sub-prediction mode of the second sub-block. When the encoding end sends the encoded bit stream to the decoding end, the encoded bit stream carries indication information of the target intra-frame sub-prediction mode, and the indication information is used to indicate index information of the target intra-frame sub-prediction mode, and the index information is used to represent the target intra-frame sub-prediction The prediction mode is the number of candidate intra-frame sub-prediction modes in the intra-frame sub-prediction mode candidate list. The decoding end receives the encoded bit stream from the encoding end, and parses out the indication information from the encoded bit stream. Based on the index information of the target intra sub-prediction mode, a candidate intra-frame sub-prediction mode corresponding to the index information is selected from the intra-frame sub-prediction mode candidate list, and the candidate intra-frame sub-prediction mode is the target intra-frame sub-prediction mode of the second sub-block.

Mode B: The encoding end specifies a default target intra-frame sub-prediction mode through a protocol, and the decoding end specifies a default target intra-frame sub-prediction mode through a protocol. For example, the encoding end agrees by agreement that the first candidate intra-frame sub-prediction mode in the default intra-frame sub-prediction mode candidate list is used as the target intra-frame sub-prediction mode of the second sub-block, and the decoding end agrees by agreement that the first candidate intra-frame sub-prediction mode in the candidate list is The first candidate intra-frame sub-prediction mode is used as the target intra-frame sub-prediction mode of the second sub-block.

Way 3: Determine the intra-frame sub-prediction mode of the adjacent blocks of the second sub-block as the target intra-frame sub-prediction mode of the second sub-block. For example, the encoder obtains the intra-frame sub-prediction mode of the adjacent blocks of the second sub-block, and determines the intra-frame sub-prediction mode of the adjacent blocks of the second sub-block as the target intra-frame sub-prediction mode of the second sub-block. The decoding end obtains the intra-frame sub-prediction mode of the adjacent blocks of the second sub-block, and determines the intra-frame sub-prediction mode of the adjacent blocks of the second sub-block as the target intra-frame sub-prediction mode of the second sub-block.

Based on Embodiment 6, when the current frame where the current block is located is a B frame or an I frame, the current block can be divided into a first sub-block and a second sub-block according to a fixed direction, and the first sub-block and the second sub-block can be both Triangular sub-block, the first sub-block and the second sub-block can be triangular sub-block and ladder sub-block respectively, the first sub-block and the second sub-block can be both ladder-shaped sub-blocks, the first sub-block and the second sub-block can be They are triangular sub-blocks and pentagonal sub-blocks respectively, and there is no restriction on the division method of the current block. Exemplarily, the prediction mode information of the first sub-block may be an inter-frame prediction mode (Inter), and the prediction mode information of the second sub-block may be an intra-frame prediction mode (Intra). Referring to Figures 9A-9D, it is an example in which the first sub-block adopts the inter-frame prediction mode and the second sub-block adopts the intra-frame prediction mode, and there is no restriction on the shape of the first sub-block and the second sub-block, as shown in Figure 9A - Figure 9D is just an example, showing an example in which the first sub-block and the second sub-block are both ladder-shaped sub-blocks, and does not show other cases such as the first sub-block and the second sub-block are both triangular sub-blocks.

Exemplarily, when the first sub-block adopts the inter-frame prediction mode and the second sub-block adopts the intra-frame prediction mode, the division direction and which sub-block adopts the inter-frame prediction mode can also be determined through the prediction mode information of the surrounding blocks of the current block. Prediction mode, which sub-block adopts the intra-frame prediction mode, that is, which sub-block is the first sub-block, and which sub-block is the second sub-block.

Referring to FIG. 10A, N0 and N1 are two surrounding blocks of the current block. Based on the prediction mode information of the two surrounding blocks, when the first sub-block and the second sub-block are both triangular sub-blocks, if the The prediction mode information is an intra-frame prediction mode, and the prediction mode information of N1 is an intra-frame prediction mode, then one of the three division directions shown in Figure 10A can be used, and Figure 10A shows which sub-block adopts Inter prediction mode, which sub-block adopts intra prediction mode.

Referring to FIG. 10B, N0 and N1 are two surrounding blocks of the current block. Based on the prediction mode information of the two surrounding blocks, when both the first sub-block and the second sub-block are triangular sub-blocks, if the The prediction mode information is not an intra prediction mode, and the prediction mode information of N1 is not an intra prediction mode, then one of the three division directions shown in Figure 10B can be used, and Figure 10B shows which subdivision direction The block adopts the inter prediction mode, which sub-block adopts the intra prediction mode.

Referring to FIG. 10C, N0 and N1 are two surrounding blocks of the current block. Based on the prediction mode information of the two surrounding blocks, when the first sub-block and the second sub-block are both triangular sub-blocks, if the The prediction mode information is an intra-frame prediction mode, and the prediction mode information of N1 is not an intra-frame prediction mode, then one of the three division directions shown in Figure 10C can be used, and Figure 10C shows which sub-block The inter prediction mode is adopted, which sub-block adopts the intra prediction mode.

Referring to FIG. 10D, N0 and N1 are two surrounding blocks of the current block. Based on the prediction mode information of the two surrounding blocks, when the first sub-block and the second sub-block are both triangular sub-blocks, if N0 The prediction mode information is not an intra prediction mode, and the prediction mode information of N1 is an intra prediction mode, then one of the three division directions shown in Figure 10D can be used, and Figure 10D shows which sub-block The inter prediction mode is adopted, which sub-block adopts the intra prediction mode.

Certainly, Fig. 10A-Fig. 10D are only examples, when other shapes are adopted, such as the first sub-block and the second sub-block are triangular sub-blocks and trapezoidal sub-blocks respectively, or the first sub-block and the second sub-block are both trapezoidal sub-blocks The blocks, or the first sub-block and the second sub-block are triangular sub-blocks and pentagonal sub-blocks respectively, and the implementation thereof can be referred to as shown in Fig. 10A- Fig. 10D , and will not be repeated here.

In Embodiment 6, it is assumed that there are two regions in the current block, one region 1 has strong temporal correlation, and the other region 2 has natural texture. In this application scenario, by dividing the current block into the first sub block (that is, the sub-block of region 1) and the second sub-block (that is, the sub-block of region 2), and the prediction mode information of the first sub-block is inter prediction mode, and the prediction mode information of the second sub-block is intra prediction model. Since the first sub-block uses an inter-frame prediction mode, the purpose of effectively removing redundancy in the video time domain can be achieved, and the coding effect can be improved. Since the second sub-block uses an intra-frame prediction mode, the coding effect can be improved.

Embodiment 7: For step 204 in Embodiment 1, if the prediction mode information of the first sub-block is an inter-frame prediction mode, and the prediction mode information of the second sub-block is an inter-frame prediction mode, it can be implemented by using Embodiment 7, Refer to Example 1 for other processes. In Embodiment 7, a first motion information candidate list of the first sub-mode in the inter-frame prediction mode is constructed, the first motion information candidate list includes at least one candidate motion information; a candidate motion is selected from the first motion information candidate list information as the target motion information of the first sub-block. Constructing a second motion information candidate list of the second sub-mode in the inter prediction mode, the second motion information candidate list includes at least one candidate motion information; selecting a candidate motion information from the second motion information candidate list as the second sub-block The target motion information; wherein, the first sub-mode and the second sub-mode may be different. A prediction value corresponding to the first sub-block is obtained according to the target motion information of the first sub-block; a prediction value corresponding to the second sub-block is obtained according to the target motion information of the second sub-block.

The first submode includes but not limited to one of the following submodes: conventional merge submode, MMVD submode, affine merge submode, ATMVP submode; the second submode includes but not limited to one of the following submodes: conventional Merge submode, MMVD submode, affine merge submode, ATMVP submode. Of course, the above are just a few examples, and there is no limitation to this, as long as it is a sub-mode in the inter-frame prediction mode. The first sub-mode and the second sub-mode can be different, for example, when the first sub-mode is a conventional merged sub-mode, the second sub-mode is not a conventional merged sub-mode, but an MMVD sub-mode, an affine merged sub-mode, an ATMVP sub-mode One of the modes. When the first sub-mode is the MMVD sub-mode, the second sub-mode is not the MMVD sub-mode, but is one of the conventional merge sub-mode, the affine merge sub-mode, the ATMVP sub-mode, and so on.

For example, a first motion information candidate list of a first sub-mode in an inter-frame prediction mode is constructed for the current block, and the first motion information candidate list includes at least one candidate motion information; this construction process is not limited. After constructing the first motion information candidate list for the current block, select a candidate motion information from the first motion information candidate list as the target motion information of the first sub-block, and obtain the target motion information corresponding to the first sub-block according to the target motion information Predicted values, no restrictions on this process.

Exemplarily, when the first submode is the normal merging submode, the first motion information candidate list includes the motion information candidate list of the normal merging submode. When the first submode is the MMVD submode, the first motion information candidate list includes the motion information candidate list of the MMVD submode. When the first submode is an affine merging submode (affine merging submode), the first motion information candidate list includes a motion information candidate list of the affine merging submode. When the first submode is the ATMVP submode, the first motion information candidate list includes the motion information candidate list of the ATMVP submode.

The encoding end/decoding end obtains the target motion information of the first sub-block from the first motion information candidate list, including but not limited to:

Method 1: The encoder performs joint prediction on the current block based on each block division information, each group of prediction mode information, and candidates in each group of prediction mode information, to obtain the prediction information of the current block, and use the rate-distortion principle and the described The prediction information determines the rate-distortion cost for the current block. It is assumed that the prediction mode information corresponding to the minimum rate-distortion cost includes: the prediction mode information of the first sub-block is an inter-frame prediction mode, the prediction mode information of the second sub-block is an inter-frame prediction mode, and for the first motion information candidate list For each candidate motion information, the candidate motion information with the smallest rate-distortion cost is used as the target motion information of the first sub-block. When the encoding end sends the encoded bit stream to the decoding end, the encoded bit stream may carry indication information of target motion information, the indication information is used to indicate index information of the target motion information of the first sub-block, and the index information is used for Indicates which candidate motion information the target motion information is in the first motion information candidate list. The decoding end receives the encoded bit stream from the encoding end, and parses out the indication information from the encoded bit stream. Based on the index information of the target motion information, the candidate motion information corresponding to the index information is selected from the first motion information candidate list, and the candidate motion information is the target motion information of the first sub-block.

Method 2: The encoding end agrees on the default target motion information through the agreement, and the decoding end agrees on the default target motion information through the agreement. For example, the encoding end may agree to default the first candidate motion information in the first motion information candidate list as the target motion information of the first sub-block through agreement, and the decoding end may agree to default the first candidate motion information in the first motion information candidate list through agreement. The motion information is used as the target motion information of the first sub-block. Of course, the above manner is only an example, and is not limited thereto.

For example, a second motion information candidate list of the second sub-mode in the inter-frame prediction mode is constructed for the current block, and the second motion information candidate list includes at least one candidate motion information; this construction process is not limited. After constructing the second motion information candidate list for the current block, select a candidate motion information from the second motion information candidate list as the target motion information of the second sub-block, and obtain the target motion information corresponding to the second sub-block according to the target motion information Predicted values, no restrictions on this process.

Exemplarily, when the second submode is the normal merging submode, the second motion information candidate list includes the motion information candidate list of the normal merging submode. When the second submode is the MMVD submode, the second motion information candidate list includes the motion information candidate list of the MMVD submode. When the second submode is an affine merging submode (affine merging submode), the second motion information candidate list includes the motion information candidate list of the affine merging submode. When the second submode is the ATMVP submode, the second motion information candidate list includes the motion information candidate list of the ATMVP submode.

The encoding end/decoding end obtains the target motion information of the second sub-block from the second motion information candidate list, including but not limited to:

Method 1: The encoder performs joint prediction on the current block based on each block division information, each group of prediction mode information, and candidates in each group of prediction mode information, to obtain the prediction information of the current block, and use the rate-distortion principle and the described The prediction information determines the rate-distortion cost for the current block. It is assumed that the prediction mode information corresponding to the minimum rate-distortion cost includes: the prediction mode information of the first sub-block is an inter-frame prediction mode, the prediction mode information of the second sub-block is an inter-frame prediction mode, and for the For each candidate motion information, the candidate motion information with the smallest rate-distortion cost is used as the target motion information of the second sub-block. When the encoding end sends the encoded bit stream to the decoding end, the encoded bit stream may carry indication information of the target motion information, the indication information is used to indicate index information of the target motion information of the second sub-block, and the index information is used for Indicates which candidate motion information the target motion information is in the second motion information candidate list. The decoding end receives the encoded bit stream from the encoding end, and parses out the indication information from the encoded bit stream. Based on the index information of the target motion information, the candidate motion information corresponding to the index information is selected from the second motion information candidate list, and the candidate motion information is the target motion information of the second sub-block.

Method 2: The encoding end agrees on the default target motion information through the agreement, and the decoding end agrees on the default target motion information through the agreement. For example, the encoding end may agree to default the second candidate motion information of the second motion information candidate list as the target motion information of the second sub-block through agreement, and the decoding end may agree to default the second candidate motion information of the second motion information candidate list through agreement. The motion information is used as the target motion information of the second sub-block. Of course, the above manner is only an example, and is not limited thereto.

Based on Embodiment 7, when the current frame where the current block is located is a B frame or an I frame, the current block can be divided into a first sub-block and a second sub-block according to a fixed direction, and the first sub-block and the second sub-block can be both Triangular sub-block, the first sub-block and the second sub-block can be triangular sub-block and ladder sub-block respectively, the first sub-block and the second sub-block can be both ladder-shaped sub-blocks, the first sub-block and the second sub-block can be They are triangular sub-blocks and pentagonal sub-blocks respectively, and there is no restriction on the division method of the current block. Exemplarily, the prediction mode information of the first sub-block may be an inter-frame prediction mode (Inter), and the prediction mode information of the second sub-block may be an inter-frame prediction mode (Inter). Referring to Figure 11A-Figure 11D, it is an example where the first sub-block adopts the inter-frame prediction mode and the second sub-block adopts the inter-frame prediction mode, and there is no restriction on the shapes of the first sub-block and the second sub-block, as shown in Figure 11A - Figure 11D is just an example, showing an example where the first sub-block and the second sub-block are both ladder-shaped sub-blocks, and does not show other cases such as the first sub-block and the second sub-block are both triangular sub-blocks. Exemplarily, when the first sub-block adopts the inter-frame prediction mode and the second sub-block adopts the inter-frame prediction mode, it can be selected from the conventional merging sub-mode, triangular prediction sub-mode, MMVD sub-mode, affine merging sub-mode, ATMVP sub-mode Select a sub-pattern in the pattern as the first sub-pattern of the first sub-block. One sub-mode may be selected from the regular merging sub-mode, the triangular prediction sub-mode, the MMVD sub-mode, the affine merging sub-mode, and the ATMVP sub-mode as the second sub-mode of the second sub-block.

Exemplarily, the first sub-pattern of the first sub-block may be different from the second sub-pattern of the second sub-block.

In Embodiment 7, it is assumed that there are two areas in the current block, one area 1 has a strong time-domain correlation, and the other area 2 also has a strong time-domain correlation, however, the reference block corresponding to area 1 and the area 2 The corresponding reference blocks are different and need to correspond to different motion information. In this application scenario, by dividing the current block into the first sub-block (ie, the sub-block of area 1) and the second sub-block (ie, the sub-block of area 2 block), and the prediction mode information of the first sub-block is an inter-frame prediction mode, and the prediction mode information of the second sub-block is an inter-frame prediction mode. Since the first sub-block uses the inter-frame prediction mode and the second sub-block uses the inter-frame prediction mode, the purpose of effectively removing video temporal redundancy can be achieved, and the coding effect can be improved.

Embodiment 8: For step 204 in Embodiment 1, if the prediction mode information of the first sub-block is an inter-frame prediction mode, and the prediction mode information of the second sub-block is an inter-frame prediction mode, Embodiment 3 can be used to implement, Refer to Example 1 for other processes. In Embodiment 8, a motion information candidate list of the inter-frame prediction mode is constructed for the current block, the motion information candidate list includes at least one candidate motion information, and there is no limitation on the construction process; a candidate motion information is selected from the motion information candidate list As the target motion information of the first sub-block, and select another candidate motion information from the motion information candidate list as the target motion information of the second sub-block, the target motion information of the first sub-block and the target motion information of the second sub-block different. A prediction value corresponding to the first sub-block is obtained according to the target motion information of the first sub-block; a prediction value corresponding to the second sub-block is obtained according to the target motion information of the second sub-block. The motion information candidate list may include, but not limited to, a motion information candidate list based on the following sub-modes: conventional merging sub-mode, MMVD sub-mode, affine merging sub-mode, ATMVP sub-mode; of course, the above are just a few examples of sub-modes. This sub-mode is not limited, as long as it is a sub-mode in the inter prediction mode.

For example, when both the first sub-block and the second sub-block adopt the normal merging sub-mode in the inter prediction mode, the motion information candidate list includes the motion information candidate list of the normal merging sub-mode. When both the first sub-block and the second sub-block adopt the MMVD sub-mode in the inter-frame prediction mode, the motion information candidate list includes the motion information candidate list of the MMVD sub-mode. When both the first sub-block and the second sub-block adopt the affine merging sub-mode in the inter-frame prediction mode, the motion information candidate list includes the motion information candidate list of the affine merging sub-mode. When both the first sub-block and the second sub-block adopt the ATMVP sub-mode in the inter-frame prediction mode, the motion information candidate list includes the motion information candidate list of the ATMVP sub-mode.

The encoder/decoder obtains the target motion information from the motion information candidate list, which may include but not limited to:

Method 1: The encoder performs joint prediction on the current block based on each block division information, each group of prediction mode information, and candidates in each group of prediction mode information, to obtain the prediction information of the current block, and use the rate-distortion principle and the described The prediction information determines the rate-distortion cost for the current block. It is assumed that the prediction mode information corresponding to the minimum rate-distortion cost includes: the prediction mode information of the first sub-block is an inter-frame prediction mode, the prediction mode information of the second sub-block is an inter-frame prediction mode, and for each For the candidate motion information, the candidate motion information with the smallest rate-distortion cost is used as the target motion information of the first sub-block. On the basis of excluding the target motion information of the first sub-block from the motion information candidate list, the candidate motion information with the smallest rate-distortion cost is used as the target motion information of the second sub-block. When the encoding end sends the encoded bit stream to the decoding end, the encoded bit stream may carry indication information of target motion information, and the indication information is used to indicate the index information of the target motion information of the first sub-block, the index information of the second sub-block The index information of the target motion information, the index information of the target motion information of the first sub-block is used to indicate that the target motion information of the first sub-block is the candidate motion information in the motion information candidate list, and the target motion information of the second sub-block The index information of the information is used to indicate which candidate motion information in the motion information candidate list the target motion information of the second sub-block is.

The decoding end receives the encoded bit stream from the encoding end, and parses out the indication information from the encoded bit stream. Based on the index information of the target motion information of the first sub-block, the decoding end selects the candidate motion information corresponding to the index information from the motion information candidate list, and the candidate motion information is the target motion information of the first sub-block.

Based on the index information of the target motion information of the second sub-block, the decoding end selects the candidate motion information corresponding to the index information from the motion information candidate list, and the candidate motion information is the target motion information of the second sub-block.

Method 2: The encoding end agrees on the default target motion information through the agreement, and the decoding end agrees on the default target motion information through the agreement. For example, the encoding end can agree that the first candidate motion information of the default motion information candidate list is used as the target motion information of the first sub-block, and the second candidate motion information of the motion information candidate list is used as the target motion information of the second sub-block. , the decoding end may agree through a protocol that the first candidate motion information in the default motion information candidate list is used as the target motion information of the first sub-block, and the second candidate motion information in the motion information candidate list is used as the target motion information of the second sub-block.

Based on Embodiment 8, when the current frame where the current block is located is a B frame or an I frame, the current block is divided into a first sub-block and a second sub-block according to a fixed direction, and the first sub-block and the second sub-block can be triangular Sub-block, the first sub-block and the second sub-block can be triangular sub-block and ladder-shaped sub-block respectively, the first sub-block and the second sub-block can be both ladder-shaped sub-blocks, the first sub-block and the second sub-block can be respectively It is a triangular sub-block and a pentagonal sub-block, and there is no restriction on the division method of this current block. Exemplarily, the prediction mode information of the first sub-block may be an inter-frame prediction mode (Inter), and the prediction mode information of the second sub-block may be an inter-frame prediction mode (Inter). Referring to Figure 11A-Figure 11D, it is an example where the first sub-block adopts the inter-frame prediction mode and the second sub-block adopts the inter-frame prediction mode, and there is no restriction on the shapes of the first sub-block and the second sub-block, as shown in Figure 11A - Figure 11D is just an example, showing an example where the first sub-block and the second sub-block are both ladder-shaped sub-blocks, and does not show other cases such as the first sub-block and the second sub-block are both triangular sub-blocks.

Exemplarily, when the first sub-block adopts the inter-frame prediction mode and the second sub-block adopts the inter-frame prediction mode, it can be selected from the conventional merging sub-mode, triangular prediction sub-mode, MMVD sub-mode, affine merging sub-mode, ATMVP sub-mode Select a sub-pattern in the pattern as the first sub-pattern of the first sub-block. One sub-mode may be selected from the regular merging sub-mode, the triangular prediction sub-mode, the MMVD sub-mode, the affine merging sub-mode, and the ATMVP sub-mode as the second sub-mode of the second sub-block.

Exemplarily, the first sub-pattern of the first sub-block may be the same as the second sub-pattern of the second sub-block. For example, the first sub-mode of the first sub-block and the second sub-mode of the second sub-block are both regular merging sub-modes, and the target motion information of the first sub-block is different from the target motion information of the second sub-block. For another example, the first sub-mode of the first sub-block and the second sub-mode of the second sub-block are both MMVD sub-modes, the target motion information of the first sub-block is different from the target motion information of the second sub-block, and so on .

In Embodiment 8, it is assumed that there are two areas in the current block, one area 1 has a strong time-domain correlation, and the other area 2 also has a strong time-domain correlation. However, the reference block corresponding to area 1 and the area 2 The corresponding reference blocks are different and need to correspond to different motion information. In this application scenario, by dividing the current block into the first sub-block (ie, the sub-block of area 1) and the second sub-block (ie, the sub-block of area 2 block), and the prediction mode information of the first sub-block is an inter-frame prediction mode, and the prediction mode information of the second sub-block is an inter-frame prediction mode. Since the first sub-block uses the inter-frame prediction mode and the second sub-block uses the inter-frame prediction mode, the purpose of effectively removing video temporal redundancy can be achieved, and the coding effect can be improved.

For each of the above embodiments, in order to obtain the predicted value of the first sub-block and the predicted value of the second sub-block, the current block may be divided into a first area block, a second area block, and a third area block, and the first area block is located at In the first sub-block, the second area block is located in the second sub-block, and the distance between the center of each sub-block in the third area block and the dividing line is smaller than a preset threshold, and the dividing line is based on the block division information definite. For example, referring to FIG. 12A , it is assumed that the first sub-block is a triangular sub-block and the second sub-block is also a triangular sub-block, and the division line determined based on the block division information is from the upper left corner to the lower right corner. The triangular sub-block in the upper right corner is the first sub-block, the triangular sub-block in the lower left corner is the second sub-block, the first area block is located in the first sub-block, the second area block is located in the second sub-block, and the third area block The distance between the center of each sub-block (such as the sub-blocks shown in Block 1, Block 2, Block 4, Block 6, and Block 7) and the dividing line is smaller than a preset threshold (can be configured according to experience).

The predicted value corresponding to the first sub-block is obtained according to the first prediction mode information corresponding to the first sub-block, and the predicted value corresponding to the second sub-block is obtained according to the second prediction mode information corresponding to the second sub-block. On this basis, in this embodiment, the target prediction value corresponding to the first region block is obtained according to the first prediction mode information; the target prediction value corresponding to the second region block is obtained according to the second prediction mode information; And/or the second prediction mode information acquires a target prediction value corresponding to the third area block. Exemplarily, obtaining the target prediction value corresponding to the third region block according to the first prediction mode information and/or the second prediction mode information includes: obtaining the target prediction value corresponding to the third region block according to the first prediction mode information; or, Obtain the target prediction value corresponding to the third region block according to the second prediction mode information; or obtain the first prediction value corresponding to the third region block according to the first prediction mode information, and obtain the target prediction value corresponding to the third region block according to the second prediction mode information second predictive value, and perform weighting processing on the first predictive value and the second predictive value to obtain the target predictive value corresponding to the third regional block.

For example, referring to FIG. 12A , the predicted value corresponding to the first sub-block may be obtained according to the first prediction mode information corresponding to the first sub-block. For the specific obtaining method, refer to the above-mentioned embodiments, which will not be repeated here. Since the first area block is located in the first sub-block, and the partial area in the third area block is located in the first sub-block, therefore, when the predicted value corresponding to the first sub-block is obtained according to the first prediction mode information, the second The predicted value corresponding to a regional block, that is, the predicted value of each pixel in the first regional block, for the convenience of distinction, the predicted value corresponding to the first regional block may be called the target predicted value corresponding to the first regional block. To sum up, the target prediction value corresponding to the first region block may be acquired according to the first prediction mode information.

For example, referring to FIG. 12A , the prediction value corresponding to the second sub-block may be acquired according to the second prediction mode information corresponding to the second sub-block. For the specific acquisition method, refer to the above-mentioned embodiments, and details are not repeated here. Since the second area block is located in the second sub-block, and part of the area in the third area block is located in the second sub-block, therefore, when the predicted value corresponding to the second sub-block is obtained according to the second prediction mode information, the first The predicted value corresponding to the second regional block, that is, the predicted value of each pixel in the second regional block, for the convenience of distinction, the predicted value corresponding to the second regional block may be called the target predicted value corresponding to the second regional block. To sum up, the target prediction value corresponding to the second region block may be acquired according to the second prediction mode information.

Exemplarily, as shown in FIG. 12A , for the third regional block (such as the sub-blocks shown in block 1, block 2, block 4, block 6, and block 7), in order to obtain the target prediction value corresponding to the third regional block, The following methods can be used:

Mode 1: Obtain the target prediction value corresponding to the third region block according to the first prediction mode information.

For example, the partial area in the third area block (such as the entire area of block 6 and block 7, the upper right corner area of block 4, for the convenience of description, hereinafter referred to as partial area A) is located in the first sub-block, according to the first When the prediction mode information obtains the predicted value corresponding to the first sub-block, the predicted value corresponding to the partial area A can be obtained, that is, the predicted value of each pixel in the partial area A. For the convenience of distinction, the predicted value corresponding to the partial area A can be The value is called the target predictor. The remaining area in the third area block (such as the entire area of block 1 and block 2, the lower left corner area of block 4, for the convenience of description, subsequently referred to as partial area B) is located in the second sub-block, therefore, it can also be based on the second sub-block The prediction mode information obtains the predicted value corresponding to the partial area B, that is, the predicted value of each pixel in the partial area B. For the convenience of distinction, the predicted value corresponding to the partial area B can be called the target predicted value. When obtaining the target prediction value corresponding to the partial region B according to the first prediction mode information, the implementation method refers to the method of "acquiring the prediction value corresponding to the first sub-block according to the first prediction mode information", and details will not be repeated here.

Mode 2: Obtain the target prediction value corresponding to the third region block according to the second prediction mode information.

For example, the partial area B in the third area block (such as the entire area of block 1 and block 2, and the area at the lower left corner of block 4) is located in the second sub-block. When predicting the value, the predicted value corresponding to the partial area B can be obtained, that is, the predicted value of each pixel in the partial area B. For the convenience of distinction, the predicted value corresponding to the partial area B is called the target predicted value. The remaining area A in the third area block (such as the entire area of block 6 and block 7, and the upper right corner area of block 4) is located in the first sub-block, and the predicted value corresponding to the partial area A can be obtained according to the second prediction mode information, That is, the predicted value of each pixel in the partial area A, for the convenience of distinction, the predicted value corresponding to the partial area A may be referred to as the target predicted value. When obtaining the target prediction value corresponding to the partial region A according to the second prediction mode information, the implementation method refers to the method of "acquiring the prediction value corresponding to the second sub-block according to the second prediction mode information", and details will not be repeated here.

Way 3: Obtain the first prediction value corresponding to the third region block according to the first prediction mode information (the prediction value of the third region block obtained according to the first prediction mode information is referred to as the first prediction value), and according to the second prediction mode The information acquires the second predicted value corresponding to the third area block (the predicted value of the third area block acquired according to the second prediction mode information is referred to as the second predicted value), and weights the first predicted value and the second predicted value processing to obtain the target prediction value corresponding to the third area block.

For example, the partial region A in the third region block is located in the first subblock, and the partial region B in the third region block is located in the second subblock, and the predicted value corresponding to the first subblock is obtained according to the first prediction mode information , the first predicted value corresponding to the partial region A can be obtained, that is, the first predicted value of each pixel in the partial region A, and when the predicted value corresponding to the second sub-block is obtained according to the second prediction mode information, it can be obtained The second predicted value corresponding to the partial area B is the second predicted value of each pixel in the partial area B. Then, the first predicted value corresponding to the partial area B can be obtained according to the first prediction mode information, that is, the first predicted value of each pixel in the partial area B. For the implementation method, see "According to the first prediction mode information to obtain the first sub-area block corresponding to the "predicted value", which will not be repeated here. The second prediction value corresponding to the partial area A can be obtained according to the second prediction mode information, that is, the second prediction value of each pixel in the partial area A. For the implementation method, see "According to the second prediction mode information to obtain the second sub-block corresponding The method of predicting value” will not be repeated here.

To sum up, the first prediction value of each pixel in the third area block (ie, partial area A and partial area B) can be obtained, and the second prediction value of each pixel point in the third area block can be obtained value, and perform weighting processing on the first predicted value and the second predicted value to obtain the target predicted value corresponding to the third area block. For example, for each pixel in the third area block, the first predicted value of the pixel and the second predicted value of the pixel may be weighted to obtain the target predicted value of the pixel. After the above-mentioned processing is performed on each pixel, the target prediction value corresponding to the third area block can be obtained.

Exemplarily, when weighting the first predicted value of a pixel point and the second predicted value of a pixel point, the weight value of the first predicted value and the weight value of the second predicted value may be the same or different. For example, if the pixel is located in the first sub-block, the weight value of the first predictor can be greater than the weight of the second predictor; if the pixel is located in the second sub-block, the weight of the first predictor can be less than The weight value of the second prediction value; if the pixel point is located on the dividing line, the weight value of the first prediction value may be equal to the weight value of the second prediction value. Of course, the above is just an example of the size of the weight value, which is not limited.

Exemplarily, each sub-block in the third area block may be a 1*1 sub-block, that is, a single pixel block, or an N*M sub-block, where N is greater than or equal to 1 and M is greater than or equal to 1. Referring to FIG. 12A , the third area block includes a sub-block marked as 1, a sub-block marked as 2, a sub-block marked as 4, a sub-block marked as 6, and a sub-block marked as 7.

For each sub-block marked as 7, subsequently referred to as sub-block 7, the predicted value P1 of sub-block 7 can be determined according to the first prediction mode information, and the predicted value P2 of sub-block 7 can be determined according to the second prediction mode information, assuming prediction The weight value of the value P1 is a, and the weight value of the predicted value P2 is b, then the target predicted value of the sub-block 7 is: P1*a+P2*b. Sub-block 7 is located in the first sub-block, and the weight value a is greater than the weight value b. Assuming that a is 7/8 and b is 1/8, the target prediction value is: P1*7/8+P2*1/8.

For each sub-block marked as 6, subsequently referred to as sub-block 6, the predicted value P1 of the sub-block 6 can be determined according to the first prediction mode information, and the predicted value P2 of the sub-block 6 can be determined according to the second prediction mode information, assuming the prediction The weight value of the value P1 is a, and the weight value of the predicted value P2 is b, then the target predicted value of the sub-block 6 is: P1*a+P2*b. Sub-block 6 is located in the first sub-block, and the weight value a is greater than the weight value b. Compared with sub-block 7, sub-block 6 is closer to the second sub-block, therefore, the weight value a of sub-block 6 can be smaller than sub-block 7 The weight value a of , assuming that a is 6/8 and b is 2/8, then the target prediction value is: P1*6/8+P2*2/8.

For each sub-block marked as 4, subsequently referred to as sub-block 4, the predicted value P1 of sub-block 4 can be determined according to the first prediction mode information, and the predicted value P2 of sub-block 4 can be determined according to the second prediction mode information, assuming prediction The weight value of the value P1 is a, and the weight value of the predicted value P2 is b, so the target predicted value of the sub-block 4 is: P1*a+P2*b. Sub-block 4 is located on the dividing line, and the weight value a is equal to the weight value b. Assuming that a is 4/8 and b is 4/8, the target prediction value is: P1*4/8+P2*4/8.

For each sub-block marked as 2, subsequently referred to as sub-block 2, the predicted value P1 of sub-block 2 can be determined according to the first prediction mode information, and the predicted value P2 of sub-block 2 can be determined according to the second prediction mode information, assuming prediction The weight value of the value P1 is a, and the weight value of the predicted value P2 is b, then the target predicted value of the sub-block 2 is: P1*a+P2*b. The sub-block 2 is located in the second sub-block, and the weight value a is smaller than the weight value b. Assuming that a is 2/8 and b is 6/8, the target prediction value is: P1*2/8+P2*6/8.

For each sub-block marked as 1, subsequently referred to as sub-block 1, the predicted value P1 of sub-block 1 can be determined according to the first prediction mode information, and the predicted value P2 of sub-block 1 can be determined according to the second prediction mode information, assuming prediction The weight value of the value P1 is a, and the weight value of the predicted value P2 is b, then the target predicted value of the sub-block 1 is: P1*a+P2*b. Sub-block 1 is located in the second sub-block, and the weight value a is smaller than the weight value b. Since sub-block 1 is closer to the first sub-block than sub-block 2, the weight value a of sub-block 1 is smaller than sub-block 2. The weight value a of block 2, assuming that a is 1/8 and b is 7/8, then the target prediction value is: P1*1/8+P2*7/8.

In the above embodiment, the sum of the weight value a and the weight value b of each sub-block may be 1. The closer to the first sub-block, the larger the weight value a, and the smaller the weight value b, and the closer to the second sub-block, the smaller the weight value a, and the larger weight value b.

Of course, the above weight value a and weight value b are just an example, and there is no limit to the weight value a and weight value b.

The above predicted value P1 and predicted value P2 may be a predicted value of brightness, and the predicted target value is a target predicted value of brightness. Referring to Fig. 12B, for each sub-block in the third area block, the chroma prediction value P3 of the sub-block can also be determined according to the first prediction mode information, and the chroma prediction value P3 of the sub-block can be determined according to the second prediction mode information. Predicted value P4. For each sub-block, the chroma target prediction value of the sub-block is P3*c+P4*d. For example, for example, the weight value c of sub-block 7 is 7/8, the weight value d of sub-block 7 is 1/8, the weight value c of sub-block 4 is 4/8, and the weight value d of sub-block 4 is 4/8. 8. The weight value c of sub-block 1 is 1/8, and the weight value d of sub-block 1 is 7/8. Of course, the above is just an example of the weight value c and the weight value d, which is not limited.

Exemplarily, the size relationship of the weight values may also be determined according to the prediction mode information of the adjacent blocks of the current block. For example, if the prediction mode information of the adjacent block of the current block is the same as the prediction mode information of the first sub-block (or the second sub-block), the prediction value corresponding to the first sub-block (or the second sub-block) may be increased. weight value.

For example, on the basis of the above weight values, that is, the manner of determining the weight value a and the weight value b can refer to the above embodiments. If the first sub-block adopts the intra-block copy prediction mode, the second sub-block adopts the intra-frame prediction mode, and if the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block both adopt the intra-block copy prediction mode, Then the weight value corresponding to the predicted value of the first sub-block may be increased. If both the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block adopt the intra prediction mode, the weight value corresponding to the predicted value of the second sub-block may be increased. If the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block adopt the intra block copy prediction mode and the inter prediction mode respectively, the weight value corresponding to the predicted value of the first sub-block may be increased. If the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block adopt the intra prediction mode and the inter prediction mode respectively, the weight value corresponding to the predicted value of the second sub-block may be increased. If the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block adopt the intra block copy prediction mode and the intra prediction mode respectively, the weight value can be kept unchanged. If the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block both adopt the inter-frame prediction mode, the weight value can be kept unchanged. Of course, the above are just a few examples, which are not limited.

If the first sub-block adopts the intra-block copy prediction mode, the second sub-block adopts the inter-frame prediction mode, and if the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block both adopt the intra-block copy prediction mode, Then the weight value corresponding to the predicted value of the first sub-block may be increased. If both the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block adopt the inter prediction mode, the weight value corresponding to the predicted value of the second sub-block may be increased. If the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block adopt the intra block copy prediction mode and the intra prediction mode respectively, the weight value corresponding to the predicted value of the first sub-block may be increased. If the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block adopt the intra prediction mode and the inter prediction mode respectively, the weight value corresponding to the predicted value of the second sub-block may be increased. If the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block respectively adopt the intra block copy prediction mode and the inter frame prediction mode, the weight value can be kept unchanged. If both the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block adopt intra-frame prediction mode, the weight value can be kept unchanged. Of course, the above are just a few examples, which are not limited.

If the first sub-block adopts the inter-frame prediction mode, the second sub-block adopts the intra-frame prediction mode, if the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block both adopt the inter-frame prediction mode, then the second sub-block can be added The weight value corresponding to the predicted value of a sub-block. If both the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block adopt the intra prediction mode, the weight value corresponding to the predicted value of the second sub-block may be increased. If the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block respectively adopt the inter prediction mode and the intra block copy prediction mode, the weight value corresponding to the prediction value of the first sub-block may be increased. If the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block adopt the intra prediction mode and the intra block copy prediction mode respectively, the weight value corresponding to the predicted value of the second sub-block may be increased. If the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block adopt inter-frame prediction mode and intra-frame prediction mode respectively, the weight value can be kept unchanged. If the adjacent blocks of the first sub-block and the adjacent blocks of the second sub-block both have intra-block copy prediction modes, the weight value can be kept unchanged. Of course, the above are just a few examples of the size of the weight value, which is not limited.

In summary, for each sub-block in the third area block (that is, each sub-block close to the dividing line, such as an N*N sub-block close to the dividing line, N is configured according to experience, such as 4, etc.) The target prediction value , can be weighted based on the predicted values obtained respectively from the two prediction mode information (namely the first prediction mode information and the second prediction mode information) to obtain the target prediction value, or the prediction value obtained by selecting a certain prediction mode information according to a fixed rule As target predictors, this is explained below:

Case 1, referring to FIG. 12C , assume that the current block is divided into a first sub-block and a second sub-block, and both the first sub-block and the second sub-block are triangular sub-blocks. For each sub-block (block 1, block 2, block 4, block 6, block 7) in the third area block, the first prediction value of the sub-block is determined according to the first prediction mode information, and the first prediction value of the sub-block is determined according to the second prediction mode information. The second predicted value of the sub-block is weighted by the first predicted value of the sub-block and the second predicted value of the sub-block to obtain a target predicted value of the sub-block.

Case 2, referring to FIG. 12D , assume that the current block is divided into a first sub-block and a second sub-block, and both the first sub-block and the second sub-block are triangular sub-blocks. For each sub-block in the third region block, the target predictive value of the sub-block can be determined according to the first prediction mode information. The sub-block marked as P2 in FIG. 12D is to determine the target prediction value of the sub-block according to the first prediction mode information. Predictive value. For each sub-block in the third area block, the target predictive value of the sub-block can be determined according to the second prediction mode information. The sub-block marked as P1 in FIG. 12D is to determine the target prediction value of the sub-block according to the second prediction mode information. Predictive value.

Case 3, referring to FIG. 12E , assume that the current block is divided into a first sub-block and a second sub-block, the first sub-block is a triangular sub-block, and the second sub-block is a pentagonal sub-block. For each sub-block (block 2, block 4, block 6, block 7) in the third area block, the first prediction value of the sub-block is determined according to the first prediction mode information, and the sub-block is determined according to the second prediction mode information The second predicted value of the sub-block is weighted by the first predicted value of the sub-block and the second predicted value of the sub-block to obtain the target predicted value of the sub-block.

Case 4, referring to FIG. 12F , assume that the current block is divided into a first sub-block and a second sub-block, the first sub-block is a triangular sub-block, and the second sub-block is a pentagonal sub-block. For each sub-block in the third region block, the target predictive value of the sub-block can be determined according to the first prediction mode information, and the sub-block marked as P2 in FIG. 12F is determined according to the first prediction mode information. Predictive value. For each sub-block in the third area block, the target predictive value of the sub-block can be determined according to the second prediction mode information, and the sub-block marked as P1 in FIG. 12F is determined according to the second prediction mode information. Predictive value.

Of course, the above cases 1 to 4 are just examples, and not the only process of predicting pixels.

In step 205, the prediction value of the current block may be acquired according to the prediction values corresponding to at least two sub-blocks respectively. For example, the encoding end/decoding end may combine the target prediction value of the first area block, the target prediction value of the second area block, and the target prediction value of the third area block to form the prediction value of the current block. Let me go into more detail.

Embodiment 9: Refer to FIG. 13 , which is a schematic flowchart of the encoding and decoding method in the embodiment of the present application. The encoding and decoding method can be applied to the decoding end or the encoding end. When determining that the current block starts target weighted prediction, the following steps are performed Obtaining a target predictive value of the current block, where the target predictive value is used for encoding or decoding of the current block, the method may include:

Step 1301, acquire the first prediction mode and the second prediction mode corresponding to the current block.

Step 1302: Determine a first prediction value corresponding to the current block according to the first prediction mode.

Step 1303: Determine a second prediction value corresponding to the current block according to the second prediction mode.

Step 1304, perform weighting processing according to the first predictive value and the second predictive value to obtain the target predictive value of the current block.

It can be seen from the above technical solutions that in this embodiment, two prediction modes of the current block can be obtained, prediction values are respectively obtained according to the two prediction modes, and prediction values of the current block are obtained according to the two prediction values. In the above method, two prediction modes can be used to perform prediction respectively, which can improve prediction accuracy, improve prediction performance, improve coding performance, and reduce coding residual error.

In step 1301, the decoding end or the encoding end needs to determine whether to enable target weighted prediction for the current block. If the target weighted prediction is enabled for the current block, the codec method of the embodiment of the present application can be used. If the target weighted prediction is not started for the current block, the codec method in the embodiment of the present application may not be used, and the implementation manner of this case is not limited.

Exemplarily, it may be judged whether the feature information of the current block satisfies a specific condition; if yes, it is determined to start target weighted prediction for the current block. If not, it is determined not to enable target weighted prediction for the current block. The characteristic information may include but not limited to one or any combination of the following: frame type of the current frame where the current block is located, size information of the current block, and switch control information. Wherein, the switch control information may be SPS (sequence level) switch control information, or PPS (picture parameter level) switch control information, or TILE (tile level) switch control information.

For example, if the feature information is the frame type of the current frame where the current block is located, then the frame type of the current frame where the current block is located meets certain conditions, which may include but not limited to: if the frame type of the current frame where the current block is located is a B frame, then determine The frame type satisfies a specific condition; or, if the frame type of the current frame where the current block is located is an I frame, it is determined that the frame type satisfies a specific condition.

For example, if the characteristic information is the size information of the current block, and the size information includes the width of the current block and the height of the current block, then the size information of the current block satisfies certain conditions, which may include but not limited to: if the width of the current block is greater than or If it is equal to the first value and the height of the current block is greater than or equal to the second value, it is determined that the size information of the current block satisfies a specific condition. Or, if the width of the current block is greater than or equal to the third value, the height of the current block is greater than or equal to the fourth value, the width of the current block is less than or equal to the fifth value, and the height of the current block is less than or equal to the sixth value, determine the current block The dimension information for satisfies certain conditions.

Exemplarily, the above numerical values may be configured according to experience, such as 8, 16, 32, 64, 128, etc., without limitation. In a possible implementation manner, the first value may be 8, the second value may be 8, the third value may be 8, the fourth value may be 8, the fifth value may be 64, and the sixth value may be 64 . Of course, the above is just an example, without limitation. To sum up, if the width of the current block is greater than or equal to 8, and the height of the current block is greater than or equal to 8, it is determined that the size information of the current block satisfies a specific condition. Or, if the width of the current block is greater than or equal to 8, the height of the current block is greater than or equal to 8, the width of the current block is less than or equal to 64, and the height of the current block is less than or equal to 64, it is determined that the size information of the current block meets a specific condition.

For example, if the characteristic information is switch control information, then the switch control information satisfies a specific condition, which may include but not limited to: if the switch control information is enabled, then determining that the switch control information satisfies a specific condition.

For example, if the feature information is the frame type of the current frame where the current block is located and the size information of the current block, then the frame type meets a specific condition, and when the size information meets a specific condition, it is determined that the feature information of the current block satisfies a specific condition . If the feature information is the frame type and switch control information of the current frame where the current block is located, then the frame type satisfies a specific condition, and when the switch control information satisfies the specific condition, it is determined that the feature information of the current block satisfies the specific condition. If the characteristic information is size information and switch control information of the current block, then the size information satisfies a specific condition, and when the switch control information satisfies a specific condition, it is determined that the characteristic information of the current block satisfies the specific condition. If the characteristic information is the frame type of the current frame where the current block is located, the size information of the current block, and the switch control information, then the frame type satisfies a specific condition, and the size information satisfies a specific condition, and the switch control information satisfies a specific condition. condition, it is determined that the feature information of the current block satisfies a specific condition.

In step 1301, the decoding end or the encoding end obtains the first prediction mode and the second prediction mode corresponding to the current block, the first prediction mode and the second prediction mode may be the same, or the first prediction mode and the second prediction mode may be different. Exemplarily, the first prediction mode may include but not limited to one of the following prediction modes: conventional combined inter prediction mode, triangular inter prediction mode, intra block copy prediction mode, intra prediction mode, MMVD inter prediction Mode, Affine Merge Inter Prediction Mode, ATMVP Inter Prediction Mode. The second prediction mode may include but not limited to one of the following prediction modes: regular merge inter prediction mode, triangular inter prediction mode, intra block copy prediction mode, intra prediction mode, MMVD inter prediction mode, affine Combined inter prediction mode, ATMVP inter prediction mode.

For example, when the first prediction mode is the regular combined inter prediction mode, the second prediction mode can be the triangular inter prediction mode, the intra block copy prediction mode, the intra prediction mode, the MMVD inter prediction mode, and the affine combined frame Inter prediction mode, one of ATMVP inter prediction modes. When the first prediction mode is triangular inter prediction mode, the second prediction mode can be conventional combined inter prediction mode, intra block copy prediction mode, intra prediction mode, MMVD inter prediction mode, affine combined inter prediction mode mode, one of the ATMVP inter prediction modes. When the first prediction mode is the intra block copy prediction mode, the second prediction mode can be the conventional merged inter prediction mode, the triangular inter prediction mode, the intra prediction mode, the MMVD inter prediction mode, and the affine merged inter prediction mode. mode, one of the ATMVP inter prediction modes. When the first prediction mode is intra prediction mode, the second prediction mode can be conventional merged inter prediction mode, triangular inter prediction mode, intra block copy prediction mode, MMVD inter prediction mode, affine merged inter prediction mode mode, one of the ATMVP inter prediction modes. When the first prediction mode is MMVD inter prediction mode, the second prediction mode can be regular combined inter prediction mode, triangular inter prediction mode, intra block copy prediction mode, intra prediction mode, affine combined inter prediction mode, one of the ATMVP inter prediction modes. When the first prediction mode is an affine combined inter prediction mode, the second prediction mode can be a regular combined inter prediction mode, a triangular inter prediction mode, an intra block copy prediction mode, an intra prediction mode, and an MMVD inter prediction mode. mode, one of the ATMVP inter prediction modes. When the first prediction mode is the ATMVP inter prediction mode, the second prediction mode can be the conventional combined inter prediction mode, the triangular inter prediction mode, the intra block copy prediction mode, the intra prediction mode, and the MMVD inter prediction mode, One of the affine merge inter prediction modes.

For another example, when the first prediction mode is the normal combined inter-frame prediction mode, the second prediction mode may be the normal combined inter-frame prediction mode. When the first prediction mode is a triangular inter prediction mode, the second prediction mode may be a triangular inter prediction mode. When the first prediction mode is an intra block copy prediction mode, the second prediction mode may be an intra block copy prediction mode. When the first prediction mode is an intra prediction mode, the second prediction mode may be an intra prediction mode. When the first prediction mode is the MMVD inter prediction mode, the second prediction mode may be the MMVD inter prediction mode. When the first prediction mode is an affine combining inter prediction mode, the second prediction mode may be an affine combining inter prediction mode. When the first prediction mode is an ATMVP inter prediction mode, the second prediction mode may be an ATMVP inter prediction mode.

When determining the first prediction value corresponding to the current block and the second prediction value corresponding to the current block, the determination process of the first prediction value is related to the first prediction mode. For the specific determination process, refer to the above embodiment, but in the above embodiment, It is to determine the prediction value of two sub-blocks, and in this embodiment, the coding end/decoding end is to determine the prediction value of the current block. The determination process of the second predicted value is related to the second prediction mode. For the specific determination process, refer to the above-mentioned embodiment, which will not be described in detail, but in the above-mentioned embodiment, the predicted values of the two sub-blocks are determined, and this embodiment Among them, the encoding end/decoding end is to determine the prediction value of the current block.

Case 1, assuming that the first prediction mode is different from the second prediction mode, the process of determining the first prediction value corresponding to the current block according to the first prediction mode and the second prediction value corresponding to the current block according to the second prediction mode may include :

If the first prediction mode is the conventional merged inter prediction mode, a motion information candidate list of the conventional merged inter prediction mode can be constructed for the current block, and there are multiple candidate motion information (such as motion vectors and reference frames) in the motion information candidate list Information), such as spatial candidate motion information, time domain candidate motion information, historical motion information, default motion information, etc. After constructing the motion information candidate list for the current block, select a candidate motion information from the motion information candidate list as the target motion information of the current block, and obtain the first prediction value corresponding to the current block according to the target motion information, the process is no longer repeat.

If the first prediction mode is a triangular inter-frame prediction mode, a motion information candidate list of the triangular inter-frame prediction mode is constructed for the current block, and the motion information candidate list includes a plurality of candidate motion information (such as unidirectional motion information). The construction process of the information candidate list is not limited. Divide the current block into the first triangular sub-block and the second triangular sub-block, select one candidate motion information from the motion information candidate list as the target motion information of the first triangular sub-block, and select another candidate from the motion information candidate list The motion information is used as the target motion information of the second triangular sub-block, and the target motion information of the first triangular sub-block is different from the target motion information of the second triangular sub-block. Determine the predicted value of the first triangular sub-block according to the target motion information of the first triangular sub-block, determine the predicted value of the second triangular sub-block according to the target motion information of the second triangular sub-block, and determine the predicted value of the second triangular sub-block according to the predicted value of the first triangular sub-block and The predicted value of the second triangular sub-block obtains the first predicted value corresponding to the current block, and this process will not be repeated.

If the first prediction mode is the intra block copy prediction mode, a block vector candidate list is constructed for the current block. The block vector candidate list includes multiple candidate block vectors. The candidate block vectors in the block vector candidate list include but are not limited to: current block The block vectors of adjacent blocks in the spatial domain of the current block, the historical block vectors in the HMVP list corresponding to the current block, the default block vector, etc., there is no restriction on the construction process of the block vector candidate list. Then, a candidate block vector is selected from the block vector candidate list as the target block vector of the current block, and the first predictive value corresponding to the current block is obtained according to the target block vector, and the process will not be repeated here.

If the first prediction mode is an intra prediction mode, the target intra sub-prediction mode of the current block is obtained, and the first prediction value corresponding to the current block is obtained according to the target intra sub-prediction mode, and the process is not repeated here. In order to obtain the target intra-frame sub-prediction mode of the current block, the following manner may be adopted: a specified intra-frame sub-prediction mode is determined as the target intra-frame sub-prediction mode of the current block. Alternatively, construct an intra-frame sub-prediction mode candidate list for the current block, the intra-frame sub-prediction mode candidate list includes multiple candidate intra-frame sub-prediction modes, such as Planar mode, DC mode, vertical angle mode, horizontal angle mode, etc., without limitation; A candidate intra-frame sub-prediction mode is selected from the intra-frame sub-prediction mode candidate list as the target intra-frame sub-prediction mode of the current block. Or, determine the intra-frame sub-prediction mode of the adjacent blocks of the current block as the target intra-frame sub-prediction mode of the current block.

If the first prediction mode is the MMVD inter-frame prediction mode, a motion information candidate list of the MMVD inter-frame prediction mode can be constructed for the current block, the motion information candidate list includes a plurality of candidate motion information, and the motion information candidate list includes a reference to the original motion information The motion information obtained after offsetting is not limited to the construction process of the motion information candidate list. Exemplarily, the original motion information may include but not limited to: motion information of spatial adjacent blocks of the current block, motion information of temporal blocks of the current block, default motion information, etc., and there is no limitation on the original motion information. For example, the motion information of multiple spatial adjacent blocks is obtained, such as motion information C1-motion information C4, and motion information C1, motion information C2, motion information C3' obtained by offsetting motion information C3, motion information The motion information C4' obtained after the offset of C4 is added to the motion information candidate list. Then, a candidate motion information is selected from the motion information candidate list as the target motion information of the current block, and the first predictive value corresponding to the current block is obtained according to the target motion information, and the process will not be repeated here.

If the first prediction mode is an affine combined inter-frame prediction mode, a motion information candidate list of an affine combined inter-frame prediction mode may be constructed for the current block, the motion information candidate list includes a plurality of candidate motion information, and the motion information candidate list Including but not limited to: motion information constructed based on the motion information of the spatial adjacent blocks of the current block, motion information constructed based on the motion information of the current block in the time domain, motion information constructed using fixed rules, default motion information, etc., for The construction process of the motion information candidate list is not limited. Then, a candidate motion information is selected from the motion information candidate list as the target motion information of the current block. The affine merged inter prediction mode is a prediction technology based on sub-blocks. The motion information of each sub-block can be deduced through the motion parameter model. Therefore, after selecting the target motion information from the motion information candidate list, for the current block For each sub-block, the motion information of each sub-block of the current block may be derived based on the target motion information and the motion parameter model. For each sub-block, the prediction value of the sub-block can be determined by using the motion information of the sub-block. Further, based on the prediction value of each sub-block, the first prediction value corresponding to the current block can be obtained.

If the first prediction mode is the ATMVP inter-frame prediction mode, determine the reference frame corresponding to the current block by specifying the motion information, and obtain the reference block corresponding to the current block from the reference frame, and then determine the current block according to the motion information of the reference block For example, the motion information of the reference block is scaled and changed, and the changed motion information is used as the target motion information of the current block. Acquire the first prediction value corresponding to the current block according to the target motion information, and the process will not be repeated here.

If the second prediction mode is regular merged inter prediction mode, triangular inter prediction mode, intra block copy prediction mode, intra prediction mode, MMVD inter prediction mode, affine merge inter prediction mode or ATMVP inter prediction mode In the case of , the process of obtaining the second prediction value corresponding to the current block can be referred to the above-mentioned embodiment, and will not be repeated here.

Case 2, assuming that the first prediction mode is the same as the second prediction mode, for the process of determining the first prediction value corresponding to the current block according to the first prediction mode, and determining the second prediction value corresponding to the current block according to the second prediction mode, it may include :

If both the first prediction mode and the second prediction mode are regular merged inter prediction modes, a motion information candidate list of the regular merged inter prediction mode may be constructed for the current block, and the motion information candidate list includes a plurality of candidate motion information. Select one candidate motion information from the motion information candidate list as the first target motion information of the current block, and select another candidate motion information from the motion information candidate list as the second target motion information of the current block, according to the first target motion information A first prediction value corresponding to the current block is obtained, and a second prediction value corresponding to the current block is obtained according to the second target motion information.

If both the first prediction mode and the second prediction mode are intra block copy prediction modes, a block vector candidate list can be constructed for the current block, the block vector candidate list includes multiple candidate block vectors, and the candidate block vectors in the block vector candidate list Including but not limited to: the block vector of the adjacent blocks in the air space of the current block, the historical block vector in the HMVP list corresponding to the current block, the default block vector, and the like. Select a candidate block vector from the block vector candidate list as the first target block vector of the current block, and select another candidate block vector from the block vector candidate list as the second target block vector of the current block, and according to the first target block The first predictive value corresponding to the current block is acquired through the vector, and the second predictive value corresponding to the current block is acquired according to the second target block vector.

If both the first prediction mode and the second prediction mode are intra prediction modes, the first target intra sub prediction mode and the second target intra sub prediction mode of the current block can be obtained, and the current block can be obtained according to the first target intra sub prediction mode For the first predictive value corresponding to the block, the second predictive value corresponding to the current block is obtained according to the second target intra sub-prediction mode.

The manner of obtaining the first target intra-frame sub-prediction mode and the second target intra-frame sub-prediction mode may include but not limited to the following manner: determine the designated first intra-frame sub-prediction mode as the first target intra-frame sub-prediction mode of the current block, and set The designated second intra-frame sub-prediction mode is determined as the second target intra-frame sub-prediction mode of the current block. Alternatively, construct an intra-frame sub-prediction mode candidate list for the current block, and the intra-frame sub-prediction mode candidate list may include multiple candidate intra-frame sub-prediction modes, such as Planar mode, DC mode, vertical angle mode, horizontal angle mode, etc.; from intra-frame sub-prediction Select a candidate intra-frame sub-prediction mode from the mode candidate list as the first target intra-frame sub-prediction mode of the current block, and select another candidate intra-frame sub-prediction mode from the intra-frame sub-prediction mode candidate list as the second target intra-frame sub-prediction mode of the current block model. Or, push to the first target intra-frame sub-prediction mode and the second target intra-frame sub-prediction mode of the current block according to the intra-frame sub-prediction mode of the adjacent block of the current block; for example, obtain the intra-frame sub-prediction of the first adjacent block of the current block mode and the intra-frame sub-prediction mode of the second adjacent block of the current block, if the intra-frame sub-prediction mode of the first adjacent block is different from the intra-frame sub-prediction mode of the second adjacent block, the intra-frame sub-prediction mode of the first adjacent block The prediction mode is determined as the first target intra-frame sub-prediction mode of the current block, and the intra-frame sub-prediction mode of the second adjacent block is determined as the second target intra-frame sub-prediction mode of the current block; if the intra-frame sub-prediction of the first adjacent block mode is the same as the intra-frame sub-prediction mode of the second adjacent block, then the intra-frame sub-prediction mode of the first adjacent block is determined as the first target intra-frame sub-prediction mode of the current block, and will be different from the first target intra-frame sub-prediction mode Another intra-frame sub-prediction mode of is determined as the second target intra-frame sub-prediction mode of the current block. Of course, the above-mentioned manners are just a few examples, and are not limited thereto.

Of course, the above is just an example, and different combinations of the first prediction mode and the second prediction mode have different ways of determining the prediction value of the current block, which will not be repeated here. For example, the first prediction mode and the second prediction mode are affine merging inter prediction mode, the first prediction mode and the second prediction mode are MMVD inter prediction mode, etc. For the process of determining the prediction value, refer to the above examples.

In step 1304, the encoding end/decoding end may perform weighting processing according to the first predictive value and the second predictive value to obtain the target predictive value of the current block. For example, weighting processing is performed according to the first predictive value, the first weight value corresponding to the first predictive value, the second predictive value, and the second weight value corresponding to the second predictive value, to obtain the target predictive value of the current block. The first weight value and the second weight value may be different or the same. There is no limitation on the manner of determining the first weight value and the second weight value.

Exemplarily, the magnitude relationship of weight values may be determined according to prediction mode information of neighboring blocks of the current block. For example, if the prediction mode information of the adjacent blocks of the current block is the same as the first prediction mode, the first weight value may be increased. If the prediction mode information of the adjacent blocks of the current block is the same as the second prediction mode, the second weight value may be increased.

For example, if the first prediction mode is the normal merge mode, the second prediction mode is the intra prediction mode, if the prediction mode information of the adjacent block of the current block is the normal merge mode, then increase the first weight value; If the prediction mode information of the adjacent block is an intra prediction mode, the second weight value is added; of course, the above are just a few examples, and there is no limitation to this.

Based on the same application concept as the above-mentioned method, the embodiment of the present application also proposes a codec device, which is applied to the encoding end or the decoding end, as shown in Figure 14, which is a structural diagram of the device, including: an acquisition module 1401, configured to acquire block division information of the current block when it is determined to start sub-block-based joint prediction for the current block; a processing module 1402, configured to divide the current block into at least two sub-blocks according to the block division information; The obtaining module 1401 is further configured to obtain prediction mode information corresponding to the at least two sub-blocks; obtain prediction values corresponding to the at least two sub-blocks according to the prediction mode information; The corresponding prediction value obtains the prediction value of the current block.

Exemplarily, the at least two sub-blocks include a first sub-block and a second sub-block; wherein, the prediction mode information of the first sub-block is an intra block copy prediction mode; the prediction mode of the second sub-block The information is an intra prediction mode, or an inter prediction mode, or an intra block copy prediction mode.

If the prediction mode information of the first sub-block is an intra block copy prediction mode, and the prediction mode information of the second sub block is an intra block copy prediction mode, the obtaining module 1401 obtains the prediction mode information according to the prediction mode information. The predictive values corresponding to the at least two sub-blocks are specifically used to: construct a block vector candidate list, the block vector candidate list includes a plurality of candidate block vectors; select a candidate block vector from the block vector candidate list as the the first target block vector of the first sub-block, selecting another candidate block vector from the block vector candidate list as the second target block vector of the second sub-block; A prediction value corresponding to the first sub-block; and obtaining a prediction value corresponding to the second sub-block according to the second target block vector.

If the prediction mode information of the first sub-block is an intra block copy prediction mode, and the prediction mode information of the second sub-block is an inter prediction mode, the acquiring module 1401 acquires the at least The predictive values corresponding to the two sub-blocks are specifically used to: construct a block vector candidate list, the block vector candidate list includes a plurality of candidate block vectors; select a candidate block vector from the block vector candidate list as the first The target block vector of the sub-block; constructing a motion information candidate list, the motion information candidate list including at least one candidate motion information; selecting a candidate motion information from the motion information candidate list as the target motion information of the second sub-block ; Obtain a prediction value corresponding to the first sub-block according to the target block vector; obtain a prediction value corresponding to the second sub-block according to the target motion information.

If the prediction mode information of the first sub-block is an intra block copy prediction mode, and the prediction mode information of the second sub-block is an intra prediction mode, the acquiring module 1401 acquires the at least The predictive values corresponding to the two sub-blocks are specifically used to: construct a block vector candidate list, the block vector candidate list includes a plurality of candidate block vectors; select a candidate block vector from the block vector candidate list as the first A target block vector of a sub-block; acquiring a target intra-frame sub-prediction mode of the second sub-block; acquiring a predictive value corresponding to the first sub-block according to the target block vector; acquiring a prediction value corresponding to the target intra-frame sub-prediction mode according to the target The predicted value corresponding to the second sub-block.

The at least two sub-blocks include a first sub-block and a second sub-block; the prediction mode information of the first sub-block is an intra-frame prediction mode, and the prediction mode information of the second sub-block is an intra-frame prediction mode, so When the obtaining module 1401 obtains the prediction values corresponding to the at least two sub-blocks according to the prediction mode information, it is specifically used to: obtain the first target intra-frame sub-prediction mode of the first sub-block, the A second target intra-frame sub-prediction mode, the first target intra-frame sub-prediction mode is different from the second target intra-frame sub-prediction mode; obtain a prediction corresponding to the first sub-block according to the first target intra-frame sub-prediction mode value; obtain a prediction value corresponding to the second sub-block according to the second target intra-frame sub-prediction mode.

When the acquiring module 1401 acquires the first target intra-frame sub-prediction mode of the first sub-block and the second target intra-frame sub-prediction mode of the second sub-block, it is specifically used to: determine the specified first intra-frame sub-prediction mode as The first target intra-frame sub-prediction mode of the first sub-block, and determine the designated second intra-frame sub-prediction mode as the second target intra-frame sub-prediction mode of the second sub-block; or, construct an intra-frame sub-prediction mode candidate list , the intra-frame sub-prediction mode candidate list includes a plurality of candidate intra-frame sub-prediction modes; select a candidate intra-frame sub-prediction mode from the intra-frame sub-prediction mode candidate list as the first target intra-frame sub-prediction mode of the first sub-block , and select another candidate intra sub-prediction mode from the intra-frame sub-prediction mode candidate list as the second target intra-frame sub-prediction mode of the second sub-block; or, if the first adjacent block of the first sub-block The intra-frame sub-prediction mode is different from the intra-frame sub-prediction mode of the second adjacent block of the second sub-block, and the intra-frame sub-prediction mode of the first adjacent block is determined as the first target intra-frame sub-prediction mode of the first sub-block, determining the intra-frame sub-prediction mode of the second adjacent block as the second target intra-frame sub-prediction mode of the second sub-block; if the intra-frame sub-prediction mode of the first adjacent block is the same as that of the second adjacent block The intra-frame sub-prediction modes are the same, the intra-frame sub-prediction mode of the first adjacent block is determined as the first target intra-frame sub-prediction mode of the first sub-block, and another sub-prediction mode different from the first target intra-frame sub-prediction mode is determined An intra-frame sub-prediction mode is determined as a second target intra-frame sub-prediction mode of the second sub-block.

The at least two sub-blocks include a first sub-block and a second sub-block; the prediction mode information of the first sub-block is an inter-frame prediction mode, and the prediction mode information of the second sub-block is an intra-frame prediction mode, so When the obtaining module 1401 obtains the predicted values corresponding to the at least two sub-blocks according to the prediction mode information, it is specifically used to: construct a motion information candidate list, and the motion information candidate list includes at least one candidate motion information; from the motion Selecting a candidate motion information from the information candidate list as the target motion information of the first sub-block; acquiring the target intra-frame sub-prediction mode of the second sub-block; acquiring the target motion information corresponding to the first sub-block according to the target motion information A predictive value; acquiring a predictive value corresponding to the second sub-block according to the target intra-frame sub-prediction mode.

When the acquiring module 1401 acquires the target intra-frame sub-prediction mode of the second sub-block, it is specifically used to: determine a specified intra-frame sub-prediction mode as the target intra-frame sub-prediction mode of the second sub-block; or construct an intra-frame sub-prediction A mode candidate list, the intra-frame sub-prediction mode candidate list includes a plurality of candidate intra-frame sub-prediction modes; select a candidate intra-frame sub-prediction mode from the intra-frame sub-prediction mode candidate list as the target intra-frame sub-prediction of the second sub-block mode; or, determining an intra-frame sub-prediction mode of a neighboring block of the second sub-block as a target intra-frame sub-prediction mode of the second sub-block.

The at least two sub-blocks include a first sub-block and a second sub-block; the prediction mode information of the first sub-block is an inter-frame prediction mode, and the prediction mode information of the second sub-block is an inter-frame prediction mode, so When the obtaining module 1401 obtains the predicted values corresponding to the at least two sub-blocks according to the prediction mode information, it is specifically used to: construct the first motion information candidate list of the first sub-mode in the inter prediction mode, the first motion information The candidate list includes at least one candidate motion information; select a candidate motion information from the first motion information candidate list as the target motion information of the first sub-block; construct the second sub-mode of the inter-frame prediction mode. A motion information candidate list, the second motion information candidate list includes at least one candidate motion information; one candidate motion information is selected from the second motion information candidate list as the target motion information of the second sub-block; the first sub-block The mode is different from the second sub-mode; the prediction value corresponding to the first sub-block is obtained according to the target motion information of the first sub-block; the prediction value corresponding to the first sub-block is obtained according to the target motion information of the second sub-block The predicted value corresponding to the two sub-blocks; wherein, the first sub-mode is one of the following sub-modes: conventional merging sub-mode, MMVD sub-mode, affine merging sub-mode, ATMVP sub-mode; the second sub-mode is One of the following submodes: regular merge submode, MMVD submode, affine merge submode, ATMVP submode.

Exemplarily, the shape of the first sub-block is the same as that of the second sub-block; or, the shape of the first sub-block is different from that of the second sub-block. The first sub-block is one of the following sub-blocks: triangular sub-block, trapezoidal sub-block, pentagonal sub-block; the second sub-block is one of the following sub-blocks: triangular sub-block, trapezoidal sub-block, Pentagon sub-blocks.

Exemplarily, when the first sub-block adopts the MMVD sub-mode in the intra block copy prediction mode, the block vector candidate list includes a block vector candidate list of the MMVD sub-mode.

Exemplarily, when the second sub-block or the first sub-block adopts the normal merging sub-mode in the inter prediction mode, the motion information candidate list includes the motion information candidate list of the normal merging sub-mode; or, When the second sub-block or the first sub-block adopts the MMVD sub-mode in the inter prediction mode, the motion information candidate list includes the motion information candidate list of the MMVD sub-mode; or, in the second sub-block When the block or the first sub-block adopts the affine merging sub-mode in the inter-frame prediction mode, the motion information candidate list includes the motion information candidate list of the affine merging sub-mode; or, in the second sub-block or When the first sub-block adopts the ATMVP sub-mode in the inter-frame prediction mode, the motion information candidate list includes the motion information candidate list of the ATMVP sub-mode.

The at least two sub-blocks include a first sub-block and a second sub-block, the first sub-block corresponds to the first prediction mode information, the second sub-block corresponds to the second prediction mode information, and the acquiring module 1401 according to the When the prediction mode information obtains the prediction values corresponding to the at least two sub-blocks, it is specifically used to: divide the current block into a first area block, a second area block, and a third area block; wherein, the first area The block is located in the first sub-block, the second area block is located in the second sub-block, and the distance between the center of each sub-block in the third area block and the dividing line is less than a preset threshold, The division line is determined based on the block division information; the target prediction value corresponding to the first region block is obtained according to the first prediction mode information; the second region block is obtained according to the second prediction mode information Corresponding target predictive value: Acquiring the target predictive value corresponding to the third area block according to the first prediction mode information and/or the second prediction mode information.

When the obtaining module 1401 obtains the target prediction value corresponding to the third area block according to the first prediction mode information and/or the second prediction mode information, it is specifically used to: obtain the third area according to the first prediction mode information The target prediction value corresponding to the block; or, according to the second prediction mode information, obtain the target prediction value corresponding to the third region block; or, according to the first prediction mode information, obtain the third region block corresponding to the A predictive value, obtaining a second predictive value corresponding to the third regional block according to the second predictive mode information, and performing weighting processing on the first predictive value and the second predictive value to obtain the third predictive value The target predictor value corresponding to the region block.

Based on the same application concept as the above-mentioned method, the embodiment of the present application also proposes a codec device, which is applied to the encoding end or the decoding end, as shown in Figure 15, which is a structural diagram of the device, including:

The obtaining module 1501 is used to obtain the first prediction mode and the second prediction mode corresponding to the current block when it is determined that the current block starts target weighted prediction; the determination module 1502 is used to determine the current prediction mode according to the first prediction mode. A first prediction value corresponding to the block; determining a second prediction value corresponding to the current block according to the second prediction mode; a processing module 1503, configured to perform weighting processing according to the first prediction value and the second prediction value , to obtain a target predictive value of the current block, where the target predictive value is used for encoding or decoding of the current block.

Exemplarily, the first prediction mode is one of the following prediction modes: conventional combined inter prediction mode, triangular inter prediction mode, intra block copy prediction mode, intra prediction mode, MMVD inter prediction mode, Affine merged inter-frame prediction mode, ATMVP inter-frame prediction mode; the second prediction mode is one of the following prediction modes: conventional merged inter-frame prediction mode, triangular inter-frame prediction mode, intra block copy prediction mode, frame Intra prediction mode, MMVD inter prediction mode, affine merge inter prediction mode, ATMVP inter prediction mode.

Based on the same application concept as the above-mentioned method, the decoding end device provided by the embodiment of the present application, from the hardware level, its hardware architecture schematic diagram can be referred to as shown in FIG. 16 . Including: a processor 1601 and a machine-readable storage medium 1602, wherein: the machine-readable storage medium 1602 stores machine-executable instructions that can be executed by the processor 1601; the processor 1601 is used to execute machine-executable instructions Instructions to implement the methods disclosed in the above examples of the present application.

For example, the processor 1601 is configured to execute machine-executable instructions to implement the following steps:

When it is determined to start sub-block-based joint prediction for the current block, acquire block division information of the current block; divide the current block into at least two sub-blocks according to the block division information; acquire the at least two sub-blocks respectively Corresponding prediction mode information; obtaining the prediction values corresponding to the at least two sub-blocks according to the prediction mode information; obtaining the prediction value of the current block according to the prediction values corresponding to the at least two sub-blocks; or,

When it is determined that the current block starts target weighted prediction, obtain the first prediction mode and the second prediction mode corresponding to the current block; determine the first prediction value corresponding to the current block according to the first prediction mode; The prediction mode determines the second prediction value corresponding to the current block; performs weighting processing according to the first prediction value and the second prediction value to obtain the target prediction value of the current block, and the target prediction value is used for the current block Describe the decoding of the current block.

Based on the same application concept as the above-mentioned method, the encoding end device provided by the embodiment of the present application, from the hardware level, its hardware architecture schematic diagram can be referred to as shown in FIG. 17 . Including: a processor 1701 and a machine-readable storage medium 1702, wherein: the machine-readable storage medium 1702 stores machine-executable instructions that can be executed by the processor 1701; the processor 1701 is used to execute machine-executable instructions Instructions to implement the methods disclosed in the above examples of the present application.

For example, the processor 1701 is configured to execute machine-executable instructions to implement the following steps:

When it is determined to start sub-block-based joint prediction for the current block, acquire block division information of the current block; divide the current block into at least two sub-blocks according to the block division information; acquire the at least two sub-blocks respectively Corresponding prediction mode information; obtaining the prediction values corresponding to the at least two sub-blocks according to the prediction mode information; obtaining the prediction value of the current block according to the prediction values corresponding to the at least two sub-blocks; or,

When it is determined that the current block starts target weighted prediction, obtain the first prediction mode and the second prediction mode corresponding to the current block; determine the first prediction value corresponding to the current block according to the first prediction mode; The prediction mode determines the second prediction value corresponding to the current block; performs weighting processing according to the first prediction value and the second prediction value to obtain the target prediction value of the current block, and the target prediction value is used for the current block Describe the encoding of the current block.

Based on the same application idea as the above-mentioned method, the embodiment of the present application also provides a machine-readable storage medium, on which several computer instructions are stored, and when the computer instructions are executed by a processor, the present invention can be realized. Apply the method disclosed by the above example. Wherein, the above-mentioned machine-readable storage medium may be any electronic, magnetic, optical or other physical storage device, which may contain or store information, such as executable instructions, data, and so on. For example, the machine-readable storage medium can be: RAM (Radom Access Memory, random access memory), volatile memory, non-volatile memory, flash memory, storage drive (such as hard disk drive), solid-state hard disk, any type of storage disk (such as CD, DVD, etc.), or similar storage media, or a combination of them.

The systems, devices, modules, or units described in the above embodiments can be specifically implemented by computer chips or entities, or by products with certain functions. A typical implementing device is a computer, which may take the form of a personal computer, laptop computer, cellular phone, camera phone, smart phone, personal digital assistant, media player, navigation device, e-mail device, game control device, etc. desktops, tablets, wearables, or any combination of these. For the convenience of description, when describing the above devices, functions are divided into various units and described separately. Of course, when implementing the present application, the functions of each unit can be implemented in one or more pieces of software and/or hardware.

Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products. This application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Embodiments of the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present application is described with reference to flowcharts and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device implements the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram. These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operational steps are performed on the computer or other programmable equipment to produce computer-implemented processing, so that the information executed on the computer or other programmable equipment The instructions provide steps for implementing the functions specified in the flow chart or blocks of the flowchart and/or the block or blocks of the block diagrams. The above descriptions are only examples of the present application, and are not intended to limit the present application. For those skilled in the art, various modifications and changes may occur in this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included within the scope of the claims of the present application.

Claims (7)

1. A codec method, characterized in that the method comprises: When determining to start sub-block-based joint prediction for the current block, acquiring block division information of the current block; dividing the current block into at least two sub-blocks according to the block division information; Obtain prediction mode information respectively corresponding to the at least two sub-blocks; Acquiring prediction values respectively corresponding to the at least two sub-blocks according to the prediction mode information; Acquiring the predicted value of the current block according to the predicted values respectively corresponding to the at least two sub-blocks; Wherein, the at least two sub-blocks include a first sub-block and a second sub-block; the current block includes a first area block, a second area block and a third area block, and the first area block is located in the first area block In the sub-block, the second area block is located in the second sub-block, and the distance between the center of each sub-block in the third area block and the dividing line is smaller than a preset threshold, and the dividing line is based on The block division information is determined; if the prediction mode information of the first sub-block is an inter-frame prediction mode, and the prediction mode information of the second sub-block is an intra-frame prediction mode, then: The obtaining the prediction values respectively corresponding to the at least two sub-blocks according to the prediction mode information includes: Constructing a motion information candidate list, the motion information candidate list including at least one candidate motion information; selecting a candidate motion information from the motion information candidate list as the target motion information of the first sub-block; Acquiring a target intra-frame sub-prediction mode of the second sub-block; Acquiring a target prediction value corresponding to the first area block according to the target motion information; Acquiring a target predictive value corresponding to the second regional block according to the target intra-frame sub-prediction mode; Acquiring a first predictive value corresponding to the third regional block according to the target motion information, obtaining a second predictive value corresponding to the third regional block according to the target intra sub-prediction mode, and calculating the first predictive value performing weighting processing with the second predicted value to obtain a target predicted value corresponding to the third regional block; Wherein, the first sub-block is one of the following sub-blocks: triangular sub-block, trapezoidal sub-block, pentagonal sub-block; the second sub-block is one of the following sub-blocks: triangular sub-block, trapezoidal sub-block blocks, pentagonal sub-blocks. 2. The method of claim 1, wherein, The acquiring the target intra-frame sub-prediction mode of the second sub-block includes: determining a specified intra-frame sub-prediction mode as the target intra-frame sub-prediction mode of the second sub-block; or, Constructing an intra-frame sub-prediction mode candidate list, the intra-frame sub-prediction mode candidate list including a plurality of candidate intra-frame sub-prediction modes; selecting a candidate intra-frame sub-prediction mode from the intra-frame sub-prediction mode candidate list as the second sub-block the target intra sub-prediction mode; or, The intra-frame sub-prediction mode of the neighboring blocks of the second sub-block is determined as the target intra-frame sub-prediction mode of the second sub-block. 3. The method according to claim 1, wherein the shape of the first sub-block is the same as that of the second sub-block; or, the shape of the first sub-block is the same as that of the second sub-block The shapes of the blocks are different. 4. The method of claim 1, wherein, When the first sub-block adopts the normal merging submode in the inter prediction mode, the motion information candidate list includes the motion information candidate list of the normal merging submode; or, When the first sub-block adopts the MMVD sub-mode in the inter-frame prediction mode, the motion information candidate list includes a motion information candidate list of the MMVD sub-mode; or, When the first sub-block adopts the affine merging submode in the inter prediction mode, the motion information candidate list includes the motion information candidate list of the affine merging submode; or, When the first sub-block adopts the ATMVP sub-mode in the inter-frame prediction mode, the motion information candidate list includes a motion information candidate list of the ATMVP sub-mode. 5. A codec device, characterized in that the device comprises: An acquisition module, configured to acquire block division information of the current block when it is determined to start joint prediction based on sub-blocks for the current block; a processing module, configured to divide the current block into at least two sub-blocks according to the block division information; The acquiring module is further configured to acquire prediction mode information respectively corresponding to the at least two sub-blocks; acquire predicted values corresponding to the at least two sub-blocks according to the prediction mode information; Acquiring the predicted value of the current block; Wherein, the at least two sub-blocks include a first sub-block and a second sub-block; the current block includes a first area block, a second area block and a third area block, and the first area block is located in the first area block In the sub-block, the second area block is located in the second sub-block, and the distance between the center of each sub-block in the third area block and the dividing line is smaller than a preset threshold, and the dividing line is based on The block division information is determined; if the prediction mode information of the first sub-block is an inter-frame prediction mode, and the prediction mode information of the second sub-block is an intra-frame prediction mode, then: the acquisition module according to the When the prediction mode information obtains the predicted values corresponding to the at least two sub-blocks, it is specifically used for: Constructing a motion information candidate list, the motion information candidate list including at least one candidate motion information; selecting a candidate motion information from the motion information candidate list as the target motion information of the first sub-block; Acquiring a target intra-frame sub-prediction mode of the second sub-block; Acquiring a target prediction value corresponding to the first area block according to the target motion information; Acquiring a target predictive value corresponding to the second regional block according to the target intra-frame sub-prediction mode; Acquiring a first predictive value corresponding to the third regional block according to the target motion information, obtaining a second predictive value corresponding to the third regional block according to the target intra sub-prediction mode, and calculating the first predictive value performing weighting processing with the second predicted value to obtain a target predicted value corresponding to the third regional block; Wherein, the first sub-block is one of the following sub-blocks: triangular sub-block, trapezoidal sub-block, pentagonal sub-block; the second sub-block is one of the following sub-blocks: triangular sub-block, trapezoidal sub-block blocks, pentagonal sub-blocks. 6. A decoding terminal device, comprising: a processor and a machine-readable storage medium, the machine-readable storage medium storing machine-executable instructions that can be executed by the processor; The processor is used to execute machine-executable instructions to implement the following steps: When it is determined to start sub-block-based joint prediction for the current block, acquire block division information of the current block; divide the current block into at least two sub-blocks according to the block division information; acquire the at least two sub-blocks respectively Corresponding prediction mode information; obtaining prediction values respectively corresponding to the at least two sub-blocks according to the prediction mode information; obtaining prediction values of the current block according to prediction values respectively corresponding to the at least two sub-blocks; Wherein, the at least two sub-blocks include a first sub-block and a second sub-block; the current block includes a first area block, a second area block and a third area block, and the first area block is located in the first area block In the sub-block, the second area block is located in the second sub-block, and the distance between the center of each sub-block in the third area block and the dividing line is smaller than a preset threshold, and the dividing line is based on The block division information is determined; if the prediction mode information of the first sub-block is an inter-frame prediction mode, and the prediction mode information of the second sub-block is an intra-frame prediction mode, then: The obtaining the prediction values respectively corresponding to the at least two sub-blocks according to the prediction mode information includes: Constructing a motion information candidate list, the motion information candidate list including at least one candidate motion information; selecting a candidate motion information from the motion information candidate list as the target motion information of the first sub-block; Acquiring a target intra-frame sub-prediction mode of the second sub-block; Acquiring a target prediction value corresponding to the first area block according to the target motion information; Acquiring a target predictive value corresponding to the second regional block according to the target intra-frame sub-prediction mode; Acquiring a first predictive value corresponding to the third regional block according to the target motion information, obtaining a second predictive value corresponding to the third regional block according to the target intra sub-prediction mode, and calculating the first predictive value performing weighting processing with the second predicted value to obtain a target predicted value corresponding to the third regional block; Wherein, the first sub-block is one of the following sub-blocks: triangular sub-block, trapezoidal sub-block, pentagonal sub-block; the second sub-block is one of the following sub-blocks: triangular sub-block, trapezoidal sub-block blocks, pentagonal sub-blocks. 7. An encoding device, comprising: a processor and a machine-readable storage medium, the machine-readable storage medium storing machine-executable instructions that can be executed by the processor; The processor is used to execute machine-executable instructions to implement the following steps: When it is determined to start sub-block-based joint prediction for the current block, acquire block division information of the current block; divide the current block into at least two sub-blocks according to the block division information; acquire the at least two sub-blocks respectively Corresponding prediction mode information; obtaining prediction values respectively corresponding to the at least two sub-blocks according to the prediction mode information; obtaining prediction values of the current block according to prediction values respectively corresponding to the at least two sub-blocks; Wherein, the at least two sub-blocks include a first sub-block and a second sub-block; the current block includes a first area block, a second area block and a third area block, and the first area block is located in the first area block In the sub-block, the second area block is located in the second sub-block, and the distance between the center of each sub-block in the third area block and the dividing line is smaller than a preset threshold, and the dividing line is based on The block division information is determined; if the prediction mode information of the first sub-block is an inter-frame prediction mode, and the prediction mode information of the second sub-block is an intra-frame prediction mode, then: The obtaining the prediction values respectively corresponding to the at least two sub-blocks according to the prediction mode information includes: Constructing a motion information candidate list, the motion information candidate list including at least one candidate motion information; selecting a candidate motion information from the motion information candidate list as the target motion information of the first sub-block; Acquiring a target intra-frame sub-prediction mode of the second sub-block; Acquiring a target prediction value corresponding to the first area block according to the target motion information; Acquiring a target predictive value corresponding to the second regional block according to the target intra-frame sub-prediction mode; Acquiring a first predictive value corresponding to the third regional block according to the target motion information, obtaining a second predictive value corresponding to the third regional block according to the target intra sub-prediction mode, and calculating the first predictive value performing weighting processing with the second predicted value to obtain a target predicted value corresponding to the third regional block; Wherein, the first sub-block is one of the following sub-blocks: triangular sub-block, trapezoidal sub-block, pentagonal sub-block; the second sub-block is one of the following sub-blocks: triangular sub-block, trapezoidal sub-block blocks, pentagonal sub-blocks.

Images