CN102215390B - Processing method and device for image coding and decoding - Google Patents

Abstract

Embodiments of the present invention provide an image codec processing method and device. An image coding processing method, comprising: performing down-sampling division on macroblocks to be coded to obtain a plurality of blocks; performing spatial prediction intra-frame encoding on the plurality of blocks, and obtaining prediction residuals respectively corresponding to the plurality of blocks , wherein the spatial predictive intra-frame encoding at least includes performing inter-block predictive intra-frame encoding using a prediction mode; performing directional transformation based on the prediction mode on at least one of the prediction residuals. The embodiments of the present invention can effectively improve prediction accuracy and improve coding and compression performance.

Description

Image codec processing method and device

technical field

Embodiments of the present invention relate to the communication field, and in particular, to an image encoding and decoding processing method and device.

Background technique

Video coding compression is a video compression processing method that utilizes the correlation between the space domain, time domain and codewords of video images to remove redundancy as much as possible. The intra coding method is a block-based hybrid video coding method.

In the prior art, intra-frame coding methods may include: spatial prediction, transformation, quantization and entropy coding. Wherein, the spatial domain prediction can utilize the correlation between adjacent blocks to perform spatial domain prediction coding. For example, the spatial domain prediction in the H.264 standard can use coded adjacent blocks to perform predictive coding on the block currently required to be predicted. In the H.264 standard, there are 9 prediction modes for the luma component and 5 prediction modes for the chrominance component. Among these prediction modes, except the DC mode, the remaining prediction modes actually represent the texture information of different directions of the image. When performing spatial prediction coding, the current block can be predicted and coded according to the selected prediction mode to obtain a prediction residual, and then the prediction residual is transformed, quantized, and entropy coded to finally generate a compressed code stream. Through these steps, the spatial redundancy of the video image can be removed, thereby achieving the purpose of compression coding. Correspondingly, the decoder can also perform decoding according to information such as prediction mode and prediction residual, so as to obtain a decoded image.

In the process of realizing the present invention, the inventors found that the data volume of high-definition video images is large, and the transmission takes up more network bandwidth resources, and the existing network bandwidth resources are difficult to meet the transmission of high-definition video images. Therefore, how to further improve video coding compression performance has become an urgent problem to be solved.

Contents of the invention

Embodiments of the present invention provide an image codec processing method and device.

An embodiment of the present invention provides an image coding processing method, including:

Subsampling and dividing the macroblocks to be coded to obtain multiple blocks;

Perform spatial predictive intra-frame encoding on the plurality of blocks, and obtain prediction residuals corresponding to the plurality of blocks, wherein the spatial predictive intra-frame encoding at least includes performing inter-block predictive intra-frame encoding using a prediction mode;

A directional transformation based on the prediction mode is performed on at least one of the prediction residuals.

An embodiment of the present invention provides an image decoding processing method, including:

performing a directional inverse transformation based on a prediction mode on the prediction residual coefficients corresponding to at least one of the prediction residual coefficients corresponding to the plurality of blocks respectively, to obtain a prediction residual;

Performing spatial prediction intra-frame decoding processing on the prediction residual to obtain the plurality of blocks, wherein the spatial domain prediction intra-frame decoding processing at least includes performing inter-block prediction intra-frame decoding using the prediction mode;

Perform upsampling and synthesis on the plurality of blocks to obtain decoded macroblocks.

An embodiment of the present invention provides an image coding processing device, including:

The coding division module is used to perform down-sampling division on the macroblocks to be coded to obtain a plurality of blocks;

An encoding prediction module, configured to perform spatial prediction intra-frame encoding on the plurality of blocks, and obtain prediction residuals respectively corresponding to the plurality of blocks, wherein the spatial prediction intra-frame encoding at least includes performing inter-block prediction using a prediction mode intraframe coding;

A coding transformation module, configured to perform directional transformation based on the prediction mode on at least one of the prediction residuals.

An embodiment of the present invention provides an image decoding processing device, including:

The decoding transformation module is used to perform directional inverse transformation based on the prediction mode on the prediction residual coefficient corresponding to at least one of the prediction residual coefficients corresponding to the plurality of blocks respectively, to obtain the prediction residual;

A decoding prediction module, configured to perform spatial prediction intra-frame decoding processing on the prediction residual, and obtain the plurality of blocks, wherein the spatial prediction intra-frame decoding processing at least includes using the prediction mode to perform inter-block prediction intra-frame decoding ;

The decoding and combining module is configured to perform upsampling and combining on the plurality of blocks to obtain decoded macroblocks.

In the embodiment of the present invention, by downsampling the macroblocks to be coded, the correlation between pixels can be fully utilized, thereby improving prediction accuracy and coding compression performance; At least one of the prediction residuals in the difference is subjected to mode-based directional transformation, which can further remove the correlation of directional texture information in the prediction residuals and improve the coding compression performance.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained according to these drawings without any creative effort.

FIG. 1 is a flow chart of Embodiment 1 of the image coding processing method of the present invention;

FIG. 2 is a flow chart of Embodiment 2 of the image coding processing method of the present invention;

FIG. 3 is a schematic structural diagram of downsampling division in Embodiment 2 of the image coding processing method of the present invention;

FIG. 4 is a schematic structural diagram of performing intra-frame prediction in Embodiment 2 of the image coding processing method of the present invention;

FIG. 5 is a flow chart of Embodiment 3 of the image coding processing method of the present invention;

FIG. 6 is a flow chart of Embodiment 4 of the image coding processing method of the present invention;

7 is a schematic structural diagram of performing intra-frame prediction in Embodiment 4 of the image coding processing method of the present invention;

FIG. 8 is a flow chart of Embodiment 5 of the image coding processing method of the present invention;

FIG. 9 is a flow chart of Embodiment 6 of the image coding processing method of the present invention;

FIG. 10 is a schematic structural diagram of performing intra-frame prediction in Embodiment 6 of the image coding processing method of the present invention;

FIG. 11 is a flow chart of Embodiment 7 of the image coding processing method of the present invention;

FIG. 12 is a flow chart of Embodiment 1 of the decoding processing method of the present invention;

FIG. 13 is a flowchart of Embodiment 2 of the decoding processing method of the present invention;

FIG. 14 is a flow chart of Embodiment 3 of the decoding processing method of the present invention;

FIG. 15 is a flowchart of Embodiment 4 of the decoding processing method of the present invention;

FIG. 16 is a flowchart of Embodiment 5 of the decoding processing method of the present invention;

FIG. 17 is a flow chart of Embodiment 6 of the decoding processing method of the present invention;

FIG. 18 is a flow chart of Embodiment 7 of the decoding processing method of the present invention;

FIG. 19 is a schematic structural diagram of Embodiment 1 of an image encoding processing device according to the present invention;

FIG. 20 is a schematic structural diagram of Embodiment 2 of an image encoding processing device according to the present invention;

FIG. 21 is a schematic structural diagram of Embodiment 3 of an image encoding processing device according to the present invention;

FIG. 22 is a schematic structural diagram of Embodiment 4 of an image encoding processing device according to the present invention;

FIG. 23 is a schematic structural diagram of Embodiment 5 of an image encoding processing device according to the present invention;

FIG. 24 is a schematic structural diagram of Embodiment 1 of an image decoding processing device according to the present invention;

FIG. 25 is a schematic structural diagram of Embodiment 2 of an image decoding processing device according to the present invention;

FIG. 26 is a schematic structural diagram of Embodiment 3 of an image decoding processing device according to the present invention;

FIG. 27 is a schematic structural diagram of Embodiment 4 of an image decoding processing device according to the present invention;

FIG. 28 is a schematic structural diagram of Embodiment 5 of an image decoding processing device according to the present invention;

FIG. 29 is a schematic structural diagram of Embodiment 6 of an image decoding processing device according to the present invention.

Detailed ways

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

Fig. 1 is a flow chart of Embodiment 1 of the image coding processing method of the present invention. As shown in Fig. 1, the method of this embodiment may include:

Step 101: Perform down-sampling division on the macroblocks to be coded to obtain a plurality of blocks.

Specifically, when the image coding processing device performs coding processing on a macroblock to be coded (Macroblock, hereinafter referred to as MB), it may perform down-sampling division on the macroblock to be coded, so as to obtain a plurality of blocks (hereinafter referred to as MB). : Block). For example, the MB to be coded is 16×16, and the image coding processing device can perform 1/2 downsampling on the MB, that is, perform 1/2 extraction on the rows and columns of the 16×16 MB, so that Get four 8×8 Blocks. In this embodiment, the downsampling division method is used to divide the MB to be coded, which can make full use of the correlation between pixels, thereby improving the prediction accuracy and the coding compression performance.

It should be noted that the size of the MB described in this embodiment can be the above-mentioned 16×16, or 32×32, 64×64, 128×128 or any other size. The luma blocks may be processed, and the chrominance blocks may also be processed, and the downsampling division may also adopt other downsampling methods except 1/2 downsampling, which is not limited in this embodiment.

Step 102: Perform spatial predictive intra-frame encoding on the plurality of blocks, and obtain prediction residuals corresponding to the plurality of blocks, wherein the spatial predictive intra-frame encoding at least includes inter-block predictive intra-frame encoding using a prediction mode .

After the image encoding processing device acquires the plurality of Blocks in the Macroblock to be encoded, it can perform spatial prediction intra-frame encoding on the plurality of Blocks, so as to obtain prediction residuals corresponding to the plurality of Blocks respectively. For example, the image coding processing device may use inter-block prediction and intra-frame coding for all four 8×8 Blocks, or may perform inter-block prediction on one 8×8 Block among the four 8×8 Blocks For the intra-frame encoding process, for the other three 8×8 Blocks, the inter-pixel predictive intra-frame encoding process can be performed with reference to the Block that adopts the inter-block prediction intra-frame encoding process. Wherein, inter-block prediction and intra-frame encoding processing refer to adjacent coded blocks for prediction, and inter-pixel prediction intra-frame coding processing refers to adjacent coded pixels as reference for prediction. Therefore, in this embodiment, the image coding processing device may subtract the spatial prediction intra-frame coding processing results respectively corresponding to the four 8×8 Blocks from the corresponding original pixels of the four 8×8 Blocks, so as to obtain the corresponding The prediction residuals corresponding to the four 8×8 Blocks respectively.

It should be noted that the spatial prediction intra-frame coding in this embodiment can be realized by any spatial prediction intra-frame coding method in the prior art, for example, the traditional inter-block prediction intra-frame coding process, or the inter-pixel prediction intra-frame coding process. For other spatial predictive intra-frame encoding methods such as encoding processing, as long as the spatial predictive intra-frame encoding at least includes inter-block predictive intra-frame encoding using a prediction mode, this embodiment does not limit it.

Step 103: Perform directional transformation based on the prediction mode on at least one of the prediction residuals.

Since the intra prediction mode (Intra prediction mode) of spatial prediction intra-frame coding can reflect the texture direction information of the Block itself to a certain extent, and the texture direction information still exists in the prediction residuals of multiple Blocks. Therefore, in this embodiment, a prediction mode-based directional transform (Mode-Dependent Directional Transform, MDDT for short) may be used for at least one of the prediction residuals respectively corresponding to a plurality of Blocks, for example, the method described in step 102 is adopted. The adopted prediction mode performs directional transformation, so that the correlation of directional texture information in the prediction residual can be further removed, and the coding and compression performance can be improved.

Specifically, MDDT can customize a transformation for various Intra prediction modes to better adapt to different directional texture information in the prediction residual. For example, in the Key Technology Area (hereinafter referred to as: KTA) reference software, MDDT customizes a directional transformation for other Intra prediction modes except the direct current (hereinafter referred to as: DC) mode, such as for H.264 In the 8×8 and 4×4MB, the other 8 Intraprediction modes except DC mode correspond to 8 kinds of directional transformations respectively, while for the DC mode, transformations that have nothing to do with directional texture information are still used, such as discrete cosine transform (discrete cosine transform) cosine transform, hereinafter referred to as: DCT), discrete sine transform, wavelet transform, etc. These transforms have nothing to do with the prediction mode that characterizes the directional texture information, for example, it has nothing to do with the above 8 Intra prediction modes. In this embodiment, by adopting MDDT, the correlation of directional texture information in the prediction residual can be further removed, and the coding compression performance can be improved.

In this embodiment, by down-sampling the MBs to be coded, the correlation between pixels can be fully utilized, thereby improving prediction accuracy and coding compression performance; At least one prediction residual is subjected to MDDT, which can further remove the correlation of direction texture information in the prediction residual, and improve the coding compression performance.

The technical solution of the image coding processing method of the present invention will be described in detail below using several specific embodiments.

FIG. 2 is a flow chart of Embodiment 2 of the image coding processing method of the present invention. As shown in FIG. 2, the method of this embodiment may include:

Step 201: Perform down-sampling division on the macroblocks to be coded to obtain a plurality of blocks.

In this embodiment, the implementation principle of step 201 is similar to that of step 101 shown in FIG. 1 . In this embodiment, it may be assumed that the MB to be coded is 16×16. Fig. 3 is a schematic structural diagram of downsampling division in Embodiment 2 of the image coding processing method of the present invention. As shown in Fig. 3 , the image coding processing device can perform 1/2 downsampling division on 16×16 MB, that is, vertically and horizontally Extract every other pixel in the direction, and form a new block with the extracted pixels, forming a total of four 8×8 Blocks. In this embodiment, the four 8×8 Blocks can be respectively marked as Block0, Block1, Block2 and Block3.

Step 202: Perform inter-block prediction and intra-frame coding processing on the first block of the plurality of blocks by using the prediction mode, obtain the first prediction residual corresponding to the first block, and apply the block of the first block Inter-prediction and intra-frame encoding processing results are performed on the rest of the plurality of blocks by inter-pixel prediction and intra-frame encoding to obtain second prediction residuals respectively corresponding to the remaining blocks of the plurality of blocks.

In this embodiment, the image coding processing device can use Intra prediction mode to perform inter-block prediction intra-frame coding processing on the 8×8 Block3, obtain the inter-block prediction intra-frame coding processing result of the Block3, and convert the inter-block prediction frame The intra-coding processing result is subtracted from the original pixels of the 8×8 Block3 to obtain the first prediction residual corresponding to the Block3. Then, the image coding processing device can use the inter-block prediction intra-frame coding processing result of Block3 as a reference, and perform inter-pixel prediction intra-frame coding processing on the remaining three 8×8 Blocks, namely Block0, Block1, and Block2, so as to obtain the same The second prediction residuals corresponding to Block0, Block1, and Block2 respectively. Specifically, in this embodiment, interpolation can be performed on the pixels of Block3, so as to obtain a more accurate prediction estimate. For example, this embodiment can use an interpolation method based on 4-tap horizontal and vertical interpolation filters to interpolate the pixels of Block3. Therefore, the pixels in Block0, Block1, and Block2 can refer to the adjacent coded The pixels of Block3 are predicted, and the inter-pixel prediction is more accurate than the inter-block prediction. So far, the image coding processing device can obtain the inter-pixel prediction intra-frame coding processing results corresponding to Block0, Block1, and Block2 respectively, and then the image coding processing device can respectively combine the inter-pixel prediction intra-frame coding processing results of Block0, Block1, and Block2 with The original pixels of Block0, Block1, and Block2 are correspondingly subtracted, so as to obtain second prediction residuals respectively corresponding to Block0, Block1, and Block2.

FIG. 4 is a schematic structural diagram of intra-frame prediction in Embodiment 2 of the image coding processing method of the present invention. As shown in FIG. The first prediction residual has an Intra prediction mode; and P0, P1, and P2 respectively indicate that the inter-pixel prediction intra-frame coding processing of Block0, Block1, and Block2 is performed with the inter-block prediction intra-frame coding processing result of Block3 as a reference, and the second Prediction residuals, therefore, there is no Intra prediction mode for second prediction residuals.

It should be noted that, in this embodiment, the prediction mode used may be a pre-selected best matching mode, and those skilled in the art may select the best matching mode by using existing technologies, which will not be repeated here.

Step 203: Perform directional transformation based on the prediction mode on the first prediction residual, and perform directivity-independent transformation on the second prediction residual.

Since I3 is obtained by traditional inter-block prediction and intra-frame coding processing, it has an Intra prediction mode representing directional texture information, and P0, P1, and P2 are obtained by inter-pixel prediction and intra-frame coding processing, and there is no Intra prediction mode. And MDDT must have Intra prediction mode, therefore, the present embodiment can adopt MDDT transformation to I3, promptly adopt the transformation matrix corresponding to the Intraprediction mode used in step 202 to carry out MDDT transformation to I3, and adopt to P0, P1 and P2 Transforms that are independent of directional texture information, such as DCT transforms.

It should be noted that, in this embodiment, for the DC mode in the Intra prediction mode, since it does not represent directional texture information, MDDT transformation is not used, but DCT transformation can be used.

In this embodiment, by down-sampling the MB to be coded, the correlation between pixels can be fully utilized, thereby improving prediction accuracy and coding compression performance; the first prediction obtained after inter-block prediction and intra-frame coding Residual MDDT can remove the directional texture information correlation in the first prediction residual and improve the encoding and compression performance of Block3, and use the inter-block prediction and intra-frame encoding processing results of Block3 as a reference to perform inter-pixel prediction on Block0, Block1, and Block2 Intra-frame encoding processing can further improve encoding and compression performance.

FIG. 5 is a flow chart of Embodiment 3 of the image coding processing method of the present invention. As shown in FIG. 5, the method of this embodiment may include:

Step 301: Perform down-sampling division on the macroblocks to be coded to obtain a plurality of blocks.

Step 302: Perform inter-block prediction and intra-frame coding processing on the first block of the plurality of blocks by using the prediction mode, obtain the first prediction residual corresponding to the first block, and apply the block of the first block Inter-prediction and intra-frame encoding processing results are performed on the rest of the plurality of blocks by inter-pixel prediction and intra-frame encoding to obtain second prediction residuals respectively corresponding to the remaining blocks of the plurality of blocks.

In this embodiment, the implementation principles of step 301 and step 302 are the same as the implementation principles of step 201 and step 202 shown in FIG. 2 above, and will not be repeated here.

Step 303: Perform directional transformation based on the prediction mode on the first prediction residual and the second prediction residual.

The difference between this embodiment and Embodiment 2 of the image coding processing method of the present invention shown in FIG. deal with. It should be noted that, in this embodiment, the prediction mode adopted when performing MDDT processing on the second prediction residual is the same as the prediction mode of the first prediction residual.

For example, as shown in Figure 4, since I3 uses the traditional inter-block prediction intra-frame coding process to obtain the first prediction residual, and has an Intra prediction mode representing directional texture information, it can directly apply MDDT, while P0 , P1 and P2 are the second prediction residuals respectively obtained by inter-pixel prediction and intra-frame coding processing, which do not have an Intra prediction mode, so MDDT cannot be directly applied. However, under the framework of spatial prediction intra-frame coding processing based on downsampling partition, each downsampled block, namely Block0, Block1, Block2 and Block3 is a microcosm of the whole MB, and its texture direction information is consistent with the texture direction of the whole MB The message is consistent. That is to say, the texture direction information of each downsampling block is the same or similar. Therefore, P0, P1, and P2 are actually the same or similar to the texture direction information of I3, and therefore, similar texture direction information remains in the second prediction residual corresponding to P0, P1, and P2 respectively. Therefore, P0, P1, and P2 can use the Intra prediction mode of I3 for MDDT transformation. That is, when performing MDDT on P0, P1, and P2, the transformation matrix corresponding to the Intra prediction mode of I3 is used. In this way, the MDDT transformation is implemented for all down-sampled blocks in the MB.

It should be noted that, in this embodiment, for the DC mode in the Intra prediction mode, since it does not represent directional texture information, MDDT transformation is not used, but DCT transformation can be used.

In this embodiment, by down-sampling the MB to be coded, the correlation between pixels can be fully utilized, thereby improving prediction accuracy and coding compression performance; the first prediction obtained after inter-block prediction and intra-frame coding MDDT transformation is performed on the residual and the second prediction residual obtained after inter-pixel prediction and intra-frame encoding, which can remove the directional texture information correlation between the first prediction residual and the second prediction residual, and improve the accuracy of all downsampled blocks. Encoding compression performance.

FIG. 6 is a flow chart of Embodiment 4 of the image coding processing method of the present invention. As shown in FIG. 6, the method of this embodiment may include:

Step 401: Perform the first downsampling division on the macroblock, obtain the first block and the plurality of second blocks, and perform the second downsampling division on the first block, obtain the first subblock and the plurality of second subblocks .

In this embodiment, a multi-layer division method is adopted for the MBs to be coded. Specifically, in this embodiment, on the basis of the first downsampling division shown in FIG. 4 , the second downsampling division can be performed on I3 again. For example, the image encoding processing device may divide the 16×16 MB to be coded by first downsampling, that is, divide by 1/2 downsampling, and obtain the first 8×8 block Block3 and three 8×8 second blocks. blocks Block0, Block1, and Block2, and then the image encoding processing device can perform second downsampling division on the first block Block3, such as 1/2 downsampling division, to obtain the first sub-block sub-Block3 of 4×4 and three 4× 4's second sub-blocks sub-Block0, sub-Block1 and sub-Block2.

It should be noted that, in this embodiment, both the first down-sampling division and the second down-sampling division are 1/2 down-sampling divisions, but those skilled in the art can understand that the first down-sampling division and the second down-sampling division The division may also be different, and those skilled in the art may select a downsampling division method according to the size of the MB, which is not limited here.

Step 402: Perform inter-prediction and intra-frame encoding processing on the first sub-block by using the prediction mode, obtain the first prediction residual corresponding to the first sub-block, and apply the inter-block prediction of the first sub-block The intra-frame encoding processing result performs inter-pixel prediction intra-frame encoding processing on the plurality of second blocks and the plurality of second sub-blocks, and obtains The corresponding second prediction residual.

In this embodiment, the image coding processing device can use Intra prediction mode to perform inter-block prediction intra-frame coding processing on 4×4 sub-Block3, obtain the inter-block prediction intra-frame coding processing result of the sub-Block3, and convert the The inter-block prediction intra-frame coding processing result is subtracted from the original pixels of the 4×4 sub-Block3 to obtain the first prediction residual corresponding to the sub-Block3. Then, the image encoding processing device can use the inter-block prediction intra-frame encoding processing result of the sub-Block3 as a reference to perform the remaining three 4×4 second sub-blocks sub-Block0, sub-Block1 and sub-Block2 and the three The 8×8 second blocks Block0, Block1, and Block2 are subjected to inter-pixel prediction and intra-frame coding processing, so as to obtain second prediction residuals corresponding to sub-Block0, sub-Block1, sub-Block2, Block0, Block1, and Block2 respectively.

7 is a schematic structural diagram of intra-frame prediction in Embodiment 4 of the image coding processing method of the present invention. As shown in FIG. , p1, p2, P0, P1, and P2 represent the intra-frame coding processing results of sub-Block3's inter-block prediction as a reference, respectively, for sub-Block0, sub-Block1, sub-Block2, Block0, Block1, and Block2. The intra-frame coding process is predicted, and the second prediction residuals are obtained respectively.

Step 403: Perform directional transformation based on the prediction mode on the first prediction residual, and perform directivity-independent transformation on the second prediction residual.

Since I is acquired by traditional inter-block prediction and intra-frame coding, it has an Intra prediction mode representing directional texture information, and p0, p1, p2, P0, P1, and P2 are obtained by inter-pixel prediction and intra-frame coding, and there is no Intra prediction mode. prediction mode. And MDDT must have Intraprediction mode, therefore, the present embodiment can adopt MDDT transformation to I, promptly adopts the transformation matrix corresponding to the Intra prediction mode used in step 402 to carry out MDDT transformation to I, and p0, p1, p2, P0, P1 and P2 adopt a transform independent of directional texture information, such as DCT transform.

It should be noted that, in this embodiment, for the DC mode in the Intra prediction mode, since it does not represent directional texture information, MDDT transformation is not used, but DCT transformation can be used.

In this embodiment, by performing multi-layer down-sampling division on the MB to be coded, the correlation between pixels can be fully utilized, thereby improving prediction accuracy and coding compression performance; Performing MDDT on the first prediction residual can remove the directional texture information correlation in the first prediction residual and improve the encoding and compression performance of sub-Block3, and use the inter-block prediction and intra-frame encoding processing results of sub-Block3 as a reference for sub-Block0 , sub-Block1, sub-Block2, Block0, Block1 and Block2 perform inter-pixel prediction and intra-frame coding processing, which can further improve the coding compression performance.

FIG. 8 is a flow chart of Embodiment 5 of the image coding processing method of the present invention. As shown in FIG. 8, the method of this embodiment may include:

Step 501, perform first downsampling division on the macroblock, obtain the first block and a plurality of second blocks, and perform second downsampling division on the first block, obtain the first subblock and the plurality of second subblocks .

Step 502: Perform inter-prediction and intra-frame encoding processing on the first sub-block by using the prediction mode, obtain the first prediction residual corresponding to the first sub-block, and apply the inter-block prediction of the first sub-block The intra-frame encoding processing result performs inter-pixel prediction intra-frame encoding processing on the plurality of second blocks and the plurality of second sub-blocks, and obtains The corresponding second prediction residual.

The implementation principles of step 501 and step 502 in this embodiment are similar to those of step 401 and step 402 shown in FIG. 6 , and will not be repeated here.

Step 503: Perform directional transformation based on the prediction mode on the first prediction residual and the second prediction residual.

The difference between this embodiment and Embodiment 4 of the image coding processing method of the present invention shown in FIG. transform.

For example, as shown in Figure 7, since I is to obtain the first prediction residual by using the traditional inter-block prediction intra-frame coding process, and has an Intra prediction mode representing directional texture information, it can directly apply MDDT, and p0 , p1, p2, P0, P1, and P2 are the second prediction residuals respectively obtained by inter-pixel prediction and intra-frame encoding, which do not have an Intra prediction mode, so MDDT cannot be directly applied. However, under the framework of the spatially predictive intra-frame coding process based on downsampling partition, each downsampled block, namely sub-Block0, sub-Block1, sub-Block2, sub-Block3, Block0, Block1 and Block2 is the entire A microcosm of an MB whose texture direction information is consistent with that of the entire MB. That is to say, the texture direction information of each downsampling block is the same or similar. Therefore, p0, p1, p2, P0, P1, and P2 are actually the same as or similar to the texture direction information of I, and therefore, the second prediction residuals corresponding to p0, p1, p2, P0, P1, and P2 respectively are also retained There is similar texture direction information. Therefore, p0, p1, p2, P0, P1 and P2 can use the Intra prediction mode of I for MDDT transformation. That is, when performing MDDT on p0, p1, p2, P0, P1, and P2, the transformation matrix corresponding to the Intra prediction mode of I is used. In this way, the MDDT transformation is implemented for all down-sampled blocks in the MB.

It should be noted that, in this embodiment, for the DC mode in the Intra prediction mode, since it does not represent directional texture information, MDDT transformation is not used, but DCT transformation can be used.

In this embodiment, by performing multi-layer down-sampling division on the MB to be coded, the correlation between pixels can be fully utilized, thereby improving prediction accuracy and coding compression performance; Both the first prediction residual and the second prediction residual obtained after inter-pixel prediction and intra-frame encoding are subjected to MDDT, which can remove the correlation of directional texture information in the first prediction residual and the second prediction residual, and further improve the overall MB encoding compression performance.

FIG. 9 is a flow chart of Embodiment 6 of the image coding processing method of the present invention. As shown in FIG. 9, the method of this embodiment may include:

Step 601: Perform down-sampling division on the macroblock to obtain a first block and a plurality of second blocks, and perform spatial division processing on the first block to obtain a plurality of first sub-blocks.

The difference between this embodiment and step 501 shown in FIG. 8 is that this embodiment divides the 8×8 first block Block3 into four 4×4 first sub-blocks sub-Block3 in the spatial domain, corresponding to the predicted The representation form of the mode is 4 I sub-blocks. Fig. 10 is a schematic structural diagram of intra-frame prediction in Embodiment 6 of the image coding processing method of the present invention. As shown in Fig. 10 , in this embodiment, all four 4×4 sub-Block3s need to adopt inter-block predictive coding The I sub-block, and the remaining three second blocks Block0, Block1 and Block2 are all P blocks that need to be coded by inter-pixel prediction, corresponding to P0, P1 and P2 respectively.

Step 602: Perform inter-block prediction and intra-frame coding processing on the plurality of first sub-blocks respectively in the prediction mode, obtain first prediction residuals respectively corresponding to the plurality of first sub-blocks, and apply the plurality of first sub-blocks Inter-prediction and intra-frame coding processing results of the first sub-block are performed on the plurality of second blocks with inter-pixel prediction and intra-frame coding processing, and second prediction residuals respectively corresponding to the plurality of second blocks are obtained.

In this embodiment, the image coding processing device can use the Intra prediction mode to perform inter-block prediction intra-frame coding processing on four 4×4 sub-Block3s respectively, and obtain the inter-block prediction intra-frame coding of the four sub-Block3s respectively. Processing the results, thereby obtaining the first prediction residuals corresponding to the four sub-Block3 respectively, and the image coding processing device can regard the four inter-block prediction intra-frame coding processing results as a whole as a reference, and for the remaining three The 8×8 Blocks, that is, Block0, Block1, and Block2 are subjected to inter-pixel prediction and intra-frame coding processing, so as to obtain second prediction residuals corresponding to Block0, Block1, and Block2 respectively.

Step 603: Perform directional transformation based on the prediction mode on the first prediction residual, and perform directionality-independent transformation on the second prediction residual.

In this embodiment, since four 4×4 sub-Block3, that is, the combination of four I sub-blocks is equivalent to a microcosm of the entire MB, and a single 4×4 sub-Block3, that is, a single I sub-block and Not a microcosm of the whole MB. Therefore, in this case, P0, P1, and P2 cannot utilize the Intra prediction mode of the I sub-block for MDDT transformation. Therefore, in this embodiment, the MDDT transformation is adopted for the I sub-block, that is, the MDDT transformation is performed on the I sub-block by using the transformation matrix corresponding to the Intra prediction mode used in step 402, and the P0, P1, and P2 adopt an transformation, such as DCT transformation.

It should be noted that, in this embodiment, for the DC mode in the Intra prediction mode, since it does not represent directional texture information, MDDT transformation is not used, but DCT transformation can be used.

In this embodiment, by performing multi-layer down-sampling division on the MB to be coded, the correlation between pixels can be fully utilized, thereby improving prediction accuracy and coding compression performance; Performing MDDT on the first prediction residual can remove the directional texture information correlation in the first prediction residual and improve the coding compression performance of Block3, and use the inter-block prediction and intra-frame coding processing results of Block3 as a reference to perform pixel coding on Block0, Block1 and Block2 Inter-prediction and intra-frame coding processing can further improve coding and compression performance.

FIG. 11 is a flow chart of Embodiment 7 of the image coding processing method of the present invention. As shown in FIG. 11, the method of this embodiment may include:

Step 701: Perform down-sampling division on the macroblock to obtain a first block and a plurality of second blocks, and perform spatial division processing on the first block to obtain a plurality of first sub-blocks.

Step 702: Perform inter-prediction and intra-frame encoding processing on the plurality of first sub-blocks by using the prediction mode, obtain first prediction residuals respectively corresponding to the plurality of first sub-blocks, and apply the plurality of first sub-blocks Inter-prediction and intra-frame coding processing results of the first sub-block are performed on the plurality of second blocks with inter-pixel prediction and intra-frame coding processing, and second prediction residuals respectively corresponding to the plurality of second blocks are obtained.

The implementation principles of step 701 and step 702 in this embodiment are similar to the implementation principles of step 601 and step 602 shown in FIG. 9 , and will not be repeated here.

Step 703: Perform directional transformation based on the prediction mode on the first prediction residual and the second prediction residual.

The difference between this embodiment and Embodiment 6 of the image coding processing method of the present invention shown in FIG. transform.

Specifically, in this embodiment, the four I sub-blocks can be considered to have the same Intraprediction mode, then the directional texture information of each I sub-block still represents the directional texture information of the entire MB, and these directional texture information can be It is further utilized by P0, P1, and P2, so that P0, P1, and P2 can all use MDDT, thereby further removing the correlation of directional texture information retained in the second prediction residual of P0, P1, and P2 blocks, thereby improving coding compression performance.

It should be noted that, in this embodiment, for the DC mode in the Intra prediction mode, since it does not represent directional texture information, MDDT transformation is not used, but DCT transformation can be used.

In this embodiment, by performing multi-layer down-sampling division on the MB to be coded, the correlation between pixels can be fully utilized, thereby improving prediction accuracy and coding compression performance; Both the first prediction residual and the second prediction residual obtained after inter-pixel prediction and intra-frame encoding are subjected to MDDT, which can remove the correlation of directional texture information in the first prediction residual and the second prediction residual, and further improve the overall MB encoding compression performance.

FIG. 12 is a flowchart of Embodiment 1 of the decoding processing method of the present invention. As shown in FIG. 12, the method of this embodiment may include:

Step 104: Perform directional inverse transformation based on the prediction mode on the prediction residual coefficient corresponding to at least one block among the prediction residual coefficients corresponding to the plurality of blocks respectively, to obtain the prediction residual.

Step 105: Perform spatial prediction intra-frame decoding processing on the prediction residual to obtain the plurality of blocks, wherein the spatial prediction intra-frame decoding processing at least includes performing inter-block prediction intra-frame decoding using the prediction mode.

Step 106: Perform upsampling and synthesis on the plurality of blocks to obtain decoded macroblocks.

The method of this embodiment is a decoding processing process corresponding to Embodiment 1 of the image encoding processing method shown in FIG. The implementation principles and achieved effects of the illustrated embodiments are similar, and will not be repeated here.

FIG. 13 is a flowchart of Embodiment 2 of the decoding processing method of the present invention. As shown in FIG. 13, the method of this embodiment may include:

Step 204: Perform directional inverse transformation based on the prediction mode on the first prediction residual coefficient corresponding to the first block in the plurality of blocks to obtain the first prediction residual, which corresponds to the remaining blocks in the plurality of blocks The second prediction residual coefficient is subjected to inverse transformation independent of directionality to obtain the second prediction residual.

Step 205: Perform inter-block prediction intra-frame decoding processing on the first prediction residual by using the prediction mode, obtain the inter-block prediction intra-frame decoding processing result of the first block, and apply the block of the first block The inter-prediction intra-frame decoding processing result performs inter-pixel prediction intra-frame decoding processing on the second prediction residual, and obtains the inter-pixel prediction intra-frame decoding processing results of the remaining blocks in the plurality of blocks.

Step 206: Perform upsampling and synthesis on the inter-block prediction intra-frame decoding processing result and the inter-pixel prediction intra-frame decoding processing result to obtain a decoded macroblock.

The method of this embodiment is a decoding processing process corresponding to Embodiment 2 of the image encoding processing method shown in FIG. The implementation principles and achieved effects of the illustrated embodiments are similar, and will not be repeated here.

FIG. 14 is a flowchart of Embodiment 3 of the decoding processing method of the present invention. As shown in FIG. 14, the method of this embodiment may include:

Step 304: Perform directional inverse transformation based on the same prediction mode on the first prediction residual coefficient corresponding to the first block in the plurality of blocks and the second prediction residual coefficient corresponding to the remaining blocks in the plurality of blocks , to obtain the first prediction residual and the second prediction residual respectively.

Step 305: Perform inter-block prediction intra-frame decoding processing on the first prediction residual by using the prediction mode, obtain the inter-block prediction intra-frame decoding processing result of the first block, and apply the block of the first block The inter-prediction intra-frame decoding processing result performs inter-pixel prediction intra-frame decoding processing on the second prediction residual, and obtains the inter-pixel prediction intra-frame decoding processing results of the remaining blocks in the plurality of blocks.

Step 306: Perform upsampling and synthesis on the inter-block prediction intra-frame decoding processing result and the inter-pixel prediction intra-frame decoding processing result to obtain a decoded macroblock.

The method of this embodiment is a decoding processing process corresponding to Embodiment 3 of the image encoding processing method shown in FIG. The implementation principles and achieved effects of the illustrated embodiments are similar, and will not be repeated here.

FIG. 15 is a flow chart of Embodiment 4 of the decoding processing method of the present invention. As shown in FIG. 15, the method of this embodiment may include:

Step 404: Perform directional inverse transformation based on the prediction mode on the first prediction residual coefficient corresponding to the first sub-block in the plurality of blocks, obtain the first prediction residual, and compare the coefficients corresponding to the first sub-block in the plurality of blocks The second prediction residual coefficients respectively corresponding to the second block and the plurality of second sub-blocks are subjected to directionality-independent inverse transformation to obtain the second prediction residual.

Step 405: Perform inter-block prediction intra-frame decoding processing on the first prediction residual by using the prediction mode, obtain the inter-block prediction intra-frame decoding processing result of the first sub-block, and apply the first sub-block Perform inter-pixel prediction intra-frame decoding processing on the second prediction residual, and obtain the inter-pixel prediction frames of the plurality of second blocks and the plurality of second sub-blocks in the plurality of blocks Inner decoding processing result.

Step 406: Perform second upsampling synthesis on the inter-block prediction intra-frame decoding processing results of the first sub-block and the inter-pixel prediction intra-frame decoding processing results of the plurality of second sub-blocks to obtain the first block, And performing first upsampling synthesis on the inter-pixel prediction intra-frame decoding processing results of the first block and the plurality of second blocks to obtain decoded macroblocks.

The method of this embodiment is a decoding processing process corresponding to Embodiment 4 of the image encoding processing method shown in FIG. The implementation principles and achieved effects of the illustrated embodiments are similar, and will not be repeated here.

FIG. 16 is a flowchart of Embodiment 5 of the decoding processing method of the present invention. As shown in FIG. 16, the method of this embodiment may include:

Step 504, for the first prediction residual coefficient corresponding to the first sub-block in the plurality of blocks and the second prediction residual corresponding to the plurality of second blocks and the plurality of second sub-blocks in the plurality of blocks The coefficients are subjected to directional inverse transformation based on the same prediction mode to obtain the first prediction residual and the second prediction residual respectively.

Step 505: Perform inter-block prediction intra-frame decoding processing on the first prediction residual by using the prediction mode, obtain the inter-block prediction intra-frame decoding processing result of the first sub-block, and apply the first sub-block Perform inter-pixel prediction intra-frame decoding processing on the second prediction residual, and obtain the inter-pixel prediction frames of the plurality of second blocks and the plurality of second sub-blocks in the plurality of blocks Inner decoding processing result.

Step 506: Perform second upsampling synthesis on the inter-block prediction intra-frame decoding processing results of the first sub-block and the inter-pixel prediction intra-frame decoding processing results of the plurality of second sub-blocks to obtain the first block, And performing first upsampling synthesis on the inter-pixel prediction intra-frame decoding processing results of the first block and the plurality of second blocks to obtain decoded macroblocks.

The method of this embodiment is a decoding processing process corresponding to Embodiment 5 of the image encoding processing method shown in FIG. The implementation principles and achieved effects of the illustrated embodiments are similar, and will not be repeated here.

Fig. 17 is a flow chart of Embodiment 6 of the decoding processing method of the present invention. As shown in Fig. 17, the method of this embodiment may include:

Step 604: Perform directional inverse transformation based on the prediction mode on the first prediction residual coefficients corresponding to the plurality of first sub-blocks in the plurality of blocks, obtain the first prediction residual, and compare the coefficients corresponding to the plurality of first sub-blocks The second prediction residual coefficients corresponding to the plurality of second blocks in the block are subjected to directionality-independent inverse transformation to obtain the second prediction residual.

Step 605: Use the prediction mode to perform inter-block prediction intra-frame decoding processing on the first prediction residual, obtain the inter-block prediction intra-frame decoding processing results of the plurality of first sub-blocks, and apply the plurality of Inter-prediction intra-frame decoding processing results of the first sub-block Perform inter-pixel prediction intra-frame decoding processing on the second prediction residual, and obtain inter-pixel prediction intra-frame decoding processing of a plurality of second blocks among the plurality of blocks result.

Step 606: Perform spatial synthesis processing on the inter-predicted intra-frame decoding processing results of the plurality of first sub-blocks, acquire the first block, and perform pixel synthesis on the first block and the plurality of second blocks Inter-prediction and intra-frame decoding processing results are up-sampled and synthesized to obtain decoded macroblocks.

The method of this embodiment is a decoding processing process corresponding to Embodiment 6 of the image encoding processing method shown in FIG. The implementation principles and achieved effects of the illustrated embodiments are similar, and will not be repeated here.

FIG. 18 is a flowchart of Embodiment 7 of the decoding processing method of the present invention. As shown in FIG. 18, the method of this embodiment may include:

Step 704: Perform same-based prediction on the first prediction residual coefficients corresponding to the plurality of first sub-blocks in the plurality of blocks and the second prediction residual coefficients corresponding to the plurality of second blocks in the plurality of blocks The directionality inverse transformation of the mode is used to obtain the first prediction residual and the second prediction residual respectively.

Step 705: Perform inter-block prediction intra-frame decoding processing on the first prediction residual by using the prediction mode, obtain the inter-block prediction intra-frame decoding processing results of the plurality of first sub-blocks, and apply the complex number of first sub-blocks Inter-prediction intra-frame decoding processing results of a sub-block are performed on the second prediction residual to perform inter-pixel prediction intra-frame decoding processing, and obtain inter-pixel prediction intra-frame decoding processing results of a plurality of second blocks among the plurality of blocks .

Step 706: Perform spatial synthesis processing on the inter-predicted intra-frame decoding processing results of the plurality of first sub-blocks, acquire the first block, and perform pixel synthesis on the first block and the plurality of second blocks Inter-prediction and intra-frame decoding processing results are up-sampled and synthesized to obtain decoded macroblocks.

The method of this embodiment is a decoding processing process corresponding to Embodiment 7 of the image encoding processing method shown in FIG. The implementation principles and achieved effects of the illustrated embodiments are similar, and will not be repeated here.

Fig. 19 is a schematic structural diagram of Embodiment 1 of the image coding processing device of the present invention. As shown in Fig. 19 , the device of this embodiment may include: a coding division module 11, a coding prediction module 12, and a coding transformation module 13, wherein the coding division module 11 is used to perform down-sampling division on the macroblocks to be coded to obtain a plurality of blocks; the coding prediction module 12 is used to perform spatial prediction intra-frame coding on the plurality of blocks, and obtain predictions corresponding to the plurality of blocks respectively Residuals, wherein the spatial domain prediction intra-frame encoding at least includes performing inter-block prediction intra-frame encoding using a prediction mode; the coding transformation module 13 is used to perform a direction based on the prediction mode on at least one of the prediction residuals gender transformation.

The device of this embodiment can be used to execute the technical solution of the method embodiment 1 shown in FIG. 1 , and its implementation principle is similar to the achieved technical effect, and will not be repeated here.

Fig. 20 is a schematic structural diagram of Embodiment 2 of the image coding processing device of the present invention. As shown in Fig. 20 , this embodiment is based on the first embodiment of the image coding processing device shown in Fig. 19 , further, the coding prediction module 12 includes : the first coding prediction unit 121 and the second coding prediction unit 122, wherein the first coding prediction unit 121 is used to perform inter-block prediction and intra-frame coding processing on the first block in the plurality of blocks in a prediction mode, and obtain the same The first prediction residual corresponding to the first block; the second coding prediction unit 122 is used to apply the inter-block prediction intra-frame coding processing result of the first block to perform inter-pixel prediction on the remaining blocks in the plurality of blocks Intra-frame coding processing, obtaining second prediction residuals respectively corresponding to the remaining blocks in the plurality of blocks; the coding transformation module 13 includes: a first coding transformation unit 131 and a second coding transformation unit 132, wherein the first coding The transformation unit 131 is configured to perform directional transformation based on the prediction mode on the first prediction residual; the second coding transformation unit 132 is configured to perform directionality-independent transformation on the second prediction residual.

The device of this embodiment can be used to implement the technical solution of the second method embodiment shown in FIG. 2 , and its implementation principle is similar to the achieved technical effect, so it will not be repeated here.

Fig. 21 is a schematic structural diagram of the third embodiment of the image coding processing device of the present invention. As shown in Fig. 21, this embodiment is based on the first embodiment of the image coding processing device shown in Fig. 19, further, the coding prediction module 12 includes : the third coding prediction unit 123 and the fourth coding prediction unit 124, wherein the third coding prediction unit 123 is configured to perform inter-block prediction and intra-frame coding processing on the first block in the plurality of blocks in a prediction mode, and obtain the same The first prediction residual corresponding to the first block; the fourth coding prediction unit 124 is used to apply the inter-block prediction intra-frame coding processing result of the first block to perform inter-pixel prediction on the remaining blocks in the plurality of blocks Intra-frame encoding processing, obtaining second prediction residuals respectively corresponding to the remaining blocks in the plurality of blocks; the encoding transformation module 13 is specifically configured to perform the first prediction residual and the second prediction residual based on the Directional transformation of the prediction mode.

The device of this embodiment can be used to implement the technical solution of the third embodiment of the method shown in FIG. 5 , and its implementation principle is similar to the achieved technical effect, and will not be repeated here.

FIG. 22 is a schematic structural diagram of Embodiment 4 of the image encoding processing device of the present invention. As shown in FIG. 22 , this embodiment is based on Embodiment 1 of the image encoding processing device shown in FIG. 19 , further, the encoding division module 11 includes : a first coding sampling unit 111 and a second coding sampling unit 112, wherein the first coding sampling unit 111 is used for performing first down-sampling division on the macroblock to obtain the first block and a plurality of second blocks; the second The encoding sampling unit 112 is used to perform second down-sampling division on the first block to obtain the first sub-block and a plurality of second sub-blocks; the encoding prediction module 12 includes: a fifth encoding prediction unit 125 and a sixth encoding prediction unit 126, wherein the fifth coding prediction unit 125 is configured to perform inter-block prediction and intra-frame coding processing on the first sub-block in a prediction mode, and obtain a first prediction residual corresponding to the first sub-block; the sixth coding prediction The unit 126 is configured to apply the inter-block prediction intra-frame coding processing result of the first sub-block to perform inter-pixel prediction intra-frame coding processing on the plurality of second blocks and the plurality of second sub-blocks, and obtain the same The second prediction residuals respectively corresponding to the plurality of second blocks and the plurality of second sub-blocks; the coding transformation module 13 includes: a third coding transformation unit 133 and a fourth coding transformation unit 134, wherein the third coding transformation The unit 133 is configured to perform directional transformation based on the prediction mode on the first prediction residual; or perform directional transformation based on the prediction mode on the first prediction residual and the second prediction residual ; The fourth coding transformation unit 134 is configured to perform directionality-independent transformation on the second prediction residual.

The device of this embodiment can be used to implement the technical solution of the fourth method embodiment shown in FIG. 6 or the fifth method embodiment shown in FIG. 8 , and its implementation principle is similar to the achieved technical effect, so it will not be repeated here.

Fig. 23 is a schematic structural diagram of Embodiment 5 of the image coding processing device of the present invention. As shown in Fig. 23 , this embodiment is based on Embodiment 1 of the image coding processing device shown in Fig. 19 , further, the coding division module 11 includes : the third coding sampling unit 113 and the fourth coding sampling unit 114, wherein the third coding sampling unit 113 is used to perform down-sampling division on the macroblock to obtain the first block and a plurality of second blocks; the fourth coding sampling The unit 114 is used to perform spatial division processing on the first block to obtain a plurality of first sub-blocks; the coding prediction module 12 includes: a seventh coding prediction unit 127 and an eighth coding prediction unit 128, wherein the seventh coding prediction unit 127 is configured to perform inter-block prediction and intra-frame coding processing on the plurality of first sub-blocks respectively in a prediction mode, and obtain first prediction residuals respectively corresponding to the plurality of first sub-blocks; the eighth coding prediction unit 128 Applying the inter-block prediction intra-frame coding processing results of the plurality of first sub-blocks to perform inter-pixel prediction intra-frame coding processing on the plurality of second blocks, and obtaining the first sub-blocks respectively corresponding to the plurality of second blocks Two prediction residuals; the encoding transformation module 13 is specifically configured to perform directional transformation based on the prediction mode on the first prediction residual, and perform directionality-independent transformation on the second prediction residual; or performing directional transformation based on the prediction mode on the first prediction residual and the second prediction residual.

The device of this embodiment can be used to implement the technical solution of the method embodiment 6 shown in FIG. 9 or the method embodiment 7 shown in FIG. 11 .

Fig. 24 is a schematic structural diagram of Embodiment 1 of the image decoding processing device of the present invention. As shown in Fig. 24, the image decoding processing device of this embodiment may include: a decoding transformation module 21, a decoding prediction module 22 and a decoding synthesis module 23, wherein , the decoding transformation module 21 is used to perform a directional inverse transformation based on the prediction mode on the prediction residual coefficient corresponding to at least one of the prediction residual coefficients corresponding to the plurality of blocks respectively, to obtain the prediction residual; the decoding prediction module 22 is used to Perform spatial prediction intra-frame decoding processing on the prediction residual to obtain the plurality of blocks, wherein the spatial domain prediction intra-frame decoding processing at least includes using the prediction mode to perform inter-block prediction intra-frame decoding; the decoding synthesis module 23 uses and performing up-sampling synthesis on the plurality of blocks to obtain decoded macroblocks.

The device of this embodiment can be used to execute the technical solution of the first method embodiment shown in FIG. 12 , and its implementation principle is similar to that of the embodiment shown in FIG. 12 and the effect achieved, so details will not be repeated here.

FIG. 25 is a schematic structural diagram of Embodiment 2 of an image decoding processing device according to the present invention. As shown in FIG. 25 , the image decoding processing device of this embodiment is based on Embodiment 1 of the image decoding processing device shown in FIG. 24 , further, The decoding and transformation module 21 includes: a first decoding and transformation unit 211 and a second decoding and transformation unit 212, wherein the first decoding and transformation unit 211 is configured to perform a first prediction residual coefficient corresponding to the first block in the plurality of blocks Based on the directional inverse transformation of the prediction mode, the first prediction residual is obtained; the second decoding and transformation unit 212 is used to perform directionality-independent inverse transformation on the second prediction residual coefficients corresponding to the remaining blocks in the plurality of blocks , to obtain the second prediction residual; the decoding prediction module 22 includes: a first decoding prediction unit 221 and a second decoding prediction unit 222, wherein the first decoding prediction unit 221 is used to use the prediction mode to perform the first prediction residual Perform inter-block prediction intra-frame decoding processing to obtain the inter-block prediction intra-frame decoding processing result of the first block; the second decoding prediction unit 222 is used to apply the inter-block prediction intra-frame decoding processing result of the first block to The second prediction residual is subjected to inter-pixel prediction intra-frame decoding processing, and the inter-pixel prediction intra-frame decoding processing results of the remaining blocks in the plurality of blocks are obtained; the decoding synthesis module 23 is specifically used to perform inter-block prediction intra-frame decoding processing. The decoding processing result and the inter-pixel prediction intra-frame decoding processing result are combined by upsampling to obtain a decoded macroblock.

The device of this embodiment can be used to implement the technical solution of the second method embodiment shown in FIG. 13 , and its implementation principle is similar to that of the embodiment shown in FIG. 13 and the effect achieved, and will not be repeated here.

Fig. 26 is a schematic structural diagram of Embodiment 3 of the image decoding processing device of the present invention. As shown in Fig. 26, the image decoding processing device of this embodiment is based on the first embodiment of the image decoding processing device shown in Fig. 24, and further, The decoding and transformation module 21 is specifically configured to perform the same prediction mode on the first prediction residual coefficient corresponding to the first block in the plurality of blocks and the second prediction residual coefficient corresponding to the remaining blocks in the plurality of blocks. Directional inverse transformation, respectively obtaining the first prediction residual and the second prediction residual; the decoding prediction module 22 includes: a third decoding prediction unit 223 and a fourth decoding prediction unit 224, wherein the third decoding prediction unit 223 is used to adopt The prediction mode performs inter-block prediction intra-frame decoding processing on the first prediction residual, and obtains the inter-block prediction intra-frame decoding processing result of the first block; the fourth decoding prediction unit 224 is used to apply the first The inter-block prediction intra-frame decoding processing result of the block performs inter-pixel prediction intra-frame decoding processing on the second prediction residual, and obtains the inter-pixel prediction intra-frame decoding processing results of the remaining blocks in the plurality of blocks; the decoding synthesis module 23 Specifically, it is used to perform upsampling synthesis on the inter-block prediction intra-frame decoding processing result and the inter-pixel prediction intra-frame decoding processing result to obtain a decoded macroblock.

The device of this embodiment can be used to implement the technical solution of the third method embodiment shown in FIG. 14 , and its implementation principle is similar to that of the embodiment shown in FIG. 14 and the effect achieved, and will not be repeated here.

Fig. 27 is a schematic structural diagram of Embodiment 4 of an image decoding and processing device according to the present invention. As shown in Fig. 27 , the image decoding and processing device of this embodiment is based on Embodiment 1 of the image decoding and processing device shown in Fig. 24 , further, The decoding and transforming module 21 includes: a third decoding and transforming unit 213 and a fourth decoding and transforming unit 214, wherein the third decoding and transforming unit 213 is used to convert the first prediction residual coefficient corresponding to the first sub-block in the plurality of blocks Perform directional inverse transformation based on the prediction mode to obtain the first prediction residual; the fourth decoding transformation unit 214 is used to respectively correspond to the plurality of second blocks and the plurality of second sub-blocks in the plurality of blocks. The prediction residual coefficient is inversely transformed regardless of directionality to obtain the second prediction residual; the decoding prediction module 22 includes: a fifth decoding prediction unit 225 and a sixth decoding prediction unit 226, wherein the fifth decoding prediction unit 225 is used for Use the prediction mode to perform inter-block prediction intra-frame decoding processing on the first prediction residual, and obtain the inter-block prediction intra-frame decoding processing result of the first sub-block; the sixth decoding prediction unit 226 is used to apply the Inter-prediction intra-frame decoding processing results of the first sub-block Perform inter-pixel prediction intra-frame decoding processing on the second prediction residual, and obtain the plurality of second blocks and the plurality of second sub-blocks in the plurality of blocks Inter-pixel prediction intra-frame decoding processing results; the decoding and synthesis module 23 includes: a first decoding sampling unit 231 and a second decoding sampling unit 232, wherein the first decoding sampling unit 231 is used for inter-block prediction of the first sub-block The intra-frame decoding processing result and the inter-pixel prediction intra-frame decoding processing result of the plurality of second sub-blocks are subjected to second upsampling synthesis to obtain the first block; the second decoding sampling unit 232 is used to perform a second upsampling synthesis on the first block And performing first upsampling synthesis on the inter-pixel prediction intra-frame decoding processing results of the plurality of second blocks to obtain decoded macroblocks.

The device of this embodiment can be used to implement the technical solution of the fourth embodiment of the method shown in FIG. 15 , and its implementation principle is similar to that of the embodiment shown in FIG. 15 and the effect achieved, and will not be repeated here.

Fig. 28 is a schematic structural diagram of Embodiment 5 of the image decoding processing device of the present invention. As shown in Fig. 28 , the image decoding processing device of this embodiment is based on Embodiment 1 of the image decoding processing device shown in Fig. 24 , further, The decoding and transformation module 21 is specifically configured to perform the first prediction residual coefficient corresponding to the first sub-block in the plurality of blocks and the first prediction residual coefficient corresponding to the plurality of second blocks and the plurality of second sub-blocks in the plurality of blocks. The two prediction residual coefficients are subjected to directional inverse transformation based on the same prediction mode, and the first prediction residual and the second prediction residual are obtained respectively; the decoding prediction module 22 includes: a seventh decoding prediction unit 227 and an eighth decoding prediction unit 228, Wherein, the seventh decoding prediction unit 227 is configured to use the prediction mode to perform inter-block prediction intra-frame decoding processing on the first prediction residual, and obtain the inter-block prediction intra-frame decoding processing result of the first sub-block; The eight-decoding prediction unit 228 is configured to apply the inter-block prediction intra-frame decoding processing result of the first sub-block to perform inter-pixel prediction intra-frame decoding processing on the second prediction residual, and obtain the plurality of first sub-blocks in the plurality of blocks Inter-pixel prediction intra-frame decoding processing results of two blocks and a plurality of second sub-blocks; the decoding and synthesis module 23 includes: a third decoding sampling unit 233 and a fourth decoding sampling unit 234, wherein the third decoding sampling unit 233 is used for The inter-block prediction intra-frame decoding processing result of the first sub-block and the inter-pixel prediction intra-frame decoding processing result of the plurality of second sub-blocks are combined by second upsampling to obtain the first block; the fourth decoding sampling The unit 234 is configured to perform first upsampling synthesis on the first block and the inter-pixel prediction intra-frame decoding processing results of the plurality of second blocks, and obtain a decoded macroblock.

The device of this embodiment can be used to implement the technical solution of the fifth embodiment of the method shown in FIG. 16 , and its implementation principle is similar to that of the embodiment shown in FIG. 16 and the effect achieved, so details are not repeated here.

FIG. 29 is a schematic structural diagram of Embodiment 6 of an image decoding processing device according to the present invention. As shown in FIG. 29 , the image decoding processing device of this embodiment is based on Embodiment 1 of the image decoding processing device shown in FIG. 24 , and further, The decoding and transforming module 21 includes: a fifth decoding and transforming unit 215 and a sixth decoding and transforming unit 216, wherein the fifth decoding and transforming unit 215 is used to perform the first prediction residual corresponding to the plurality of first sub-blocks in the plurality of blocks The difference coefficients are respectively subjected to directional inverse transformation based on the prediction mode to obtain the first prediction residual; the sixth decoding transformation unit 216 is used to perform the second prediction residual coefficient corresponding to the plurality of second blocks in the plurality of blocks Direction-independent inverse transformation to obtain the second prediction residual; the decoding prediction module 22 includes: a ninth decoding prediction unit 229 and a tenth decoding prediction unit 230, wherein the ninth decoding prediction unit 229 is used to adopt the prediction mode Perform inter-block prediction intra-frame decoding processing on the first prediction residual, and obtain the inter-block prediction intra-frame decoding processing results of the plurality of first sub-blocks; the tenth decoding prediction unit 230 is used to apply the plurality of first sub-blocks Inter-prediction intra-frame decoding processing results of a sub-block are performed on the second prediction residual to perform inter-pixel prediction intra-frame decoding processing, and obtain inter-pixel prediction intra-frame decoding processing results of a plurality of second blocks among the plurality of blocks The decoding and synthesis module 23 includes: a sixth decoding sampling unit 236 and a seventh decoding sampling unit 237, wherein the sixth decoding sampling unit 236 is used to perform inter-prediction and intra-frame decoding processing results of the plurality of first sub-blocks Spatial synthesis processing, obtaining the first block; the seventh decoding sampling unit 237 is used to perform upsampling synthesis on the first block and the inter-pixel prediction intra-frame decoding processing results of the plurality of second blocks, and obtain the decoded of macroblocks.

The device of this embodiment can be used to implement the technical solution of the sixth embodiment of the method shown in FIG. 17 , and its implementation principle is similar to that of the embodiment shown in FIG. 17 and the effect achieved, so it will not be repeated here.

Those of ordinary skill in the art can understand that all or part of the steps for realizing the above-mentioned method embodiments can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the It includes the steps of the above method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other various media that can store program codes.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims (23)

1. An image coding processing method, characterized in that, comprising: Subsampling and dividing the macroblocks to be coded to obtain multiple blocks; Perform spatial predictive intra-frame encoding on the plurality of blocks, and obtain prediction residuals corresponding to the plurality of blocks, wherein the spatial predictive intra-frame encoding at least includes performing inter-block predictive intra-frame encoding using a prediction mode; performing a directional transformation based on the prediction mode on at least one of the prediction residuals; Among them, downsampling is performed on the macroblocks to be coded to obtain a plurality of blocks, including: Extracting pixels at intervals to form the plurality of blocks; Performing spatial prediction intra-frame encoding on the plurality of blocks, and obtaining prediction residuals respectively corresponding to the plurality of blocks, wherein the spatial prediction intra-frame encoding at least includes performing inter-block prediction intra-frame encoding using a prediction mode, include: Perform inter-block prediction and intra-frame encoding processing on the first block of the plurality of blocks by using a prediction mode, obtain a first prediction residual corresponding to the first block, and apply the inter-block prediction frame of the first block The intra-coding processing result performs inter-pixel prediction intra-frame coding processing on the remaining blocks of the plurality of blocks, and obtains second prediction residuals respectively corresponding to the remaining blocks of the plurality of blocks. 2. The image coding processing method according to claim 1, wherein: The performing directional transformation based on the prediction mode on at least one of the prediction residuals includes: A directional transformation based on the prediction mode is performed on the first prediction residual, and a directionality-independent transformation is performed on the second prediction residual. 3. The image coding processing method according to claim 1, wherein: The performing directional transformation based on the prediction mode on at least one of the prediction residuals includes: A directional transformation based on the prediction mode is performed on the first prediction residual and the second prediction residual. 4. The image coding processing method according to claim 1, wherein the down-sampling division of the macroblocks to be coded to obtain a plurality of blocks comprises: performing a first down-sampling division on the macroblock, obtaining a first block and a plurality of second blocks, and performing a second down-sampling division on the first block, obtaining a first sub-block and a plurality of second sub-blocks; Performing spatial prediction intra-frame encoding on the plurality of blocks, and obtaining prediction residuals respectively corresponding to the plurality of blocks, wherein the spatial prediction intra-frame encoding at least includes performing inter-block prediction intra-frame encoding using a prediction mode, include: Perform inter-predictive intra-frame coding processing on the first sub-block by using a prediction mode, acquire a first prediction residual corresponding to the first sub-block, and apply inter-block predictive intra-frame coding on the first sub-block As a result of the processing, perform inter-pixel prediction and intra-frame encoding processing on the plurality of second blocks and the plurality of second sub-blocks, and obtain the first corresponding to the plurality of second blocks and the plurality of second sub-blocks respectively. Two prediction residuals; The performing directional transformation based on the prediction mode on at least one of the prediction residuals includes: Performing a directional transformation based on the prediction mode on the first prediction residual, and performing a directivity-independent transformation on the second prediction residual; or performing a transformation on the first prediction residual and the second prediction The residual is subjected to a directional transformation based on the prediction mode. 5. The image coding processing method according to claim 1, wherein said down-sampling division is performed on the macroblocks to be coded to obtain a plurality of blocks, comprising: performing down-sampling division on the macroblock, obtaining a first block and a plurality of second blocks, and performing spatial division processing on the first block, obtaining a plurality of first sub-blocks; Performing spatial prediction intra-frame encoding on the plurality of blocks, and obtaining prediction residuals respectively corresponding to the plurality of blocks, wherein the spatial prediction intra-frame encoding at least includes performing inter-block prediction intra-frame encoding using a prediction mode, include: Perform inter-prediction and intra-frame encoding on the plurality of first sub-blocks in a prediction mode, obtain first prediction residuals respectively corresponding to the plurality of first sub-blocks, and apply the plurality of first sub-blocks Inter-predictive intra-frame coding processing results of the blocks Perform inter-pixel predictive intra-frame coding processing on the plurality of second blocks, and obtain second prediction residuals respectively corresponding to the plurality of second blocks; The performing directional transformation based on the prediction mode on at least one of the prediction residuals includes: Performing a directional transformation based on the prediction mode on the first prediction residual, and performing a directivity-independent transformation on the second prediction residual; or performing a transformation on the first prediction residual and the second prediction The residual is subjected to a directional transformation based on the prediction mode. 6. An image decoding processing method, characterized in that, comprising: performing a directional inverse transformation based on a prediction mode on the prediction residual coefficients corresponding to at least one of the prediction residual coefficients corresponding to the plurality of blocks respectively, to obtain a prediction residual; Performing spatial prediction intra-frame decoding processing on the prediction residual to obtain the plurality of blocks, wherein the spatial domain prediction intra-frame decoding processing at least includes performing inter-block prediction intra-frame decoding using the prediction mode; performing upsampling synthesis on the plurality of blocks to obtain decoded macroblocks; The performing spatial prediction intra-frame decoding processing on the prediction residual to obtain the plurality of blocks, wherein the spatial domain prediction intra-frame decoding processing at least includes using the prediction mode to perform inter-block prediction intra-frame decoding, including: Use the prediction mode to perform inter-block prediction intra-frame decoding processing on the first prediction residual, obtain the inter-block prediction intra-frame decoding processing result of the first block in the plurality of blocks, and apply the inter-block prediction processing result of the first block Prediction of intra-frame decoding processing results Perform inter-pixel prediction intra-frame decoding processing on the second prediction residual, and obtain inter-pixel prediction intra-frame decoding processing results of remaining blocks in the plurality of blocks. 7. The image decoding processing method according to claim 6, wherein the prediction residual coefficient corresponding to at least one block among the prediction residual coefficients respectively corresponding to the plurality of blocks is subjected to directional inversion based on a prediction mode. Transform to obtain prediction residuals, including: performing directional inverse transformation based on the prediction mode on the first prediction residual coefficient corresponding to the first block in the plurality of blocks, obtaining the first prediction residual, and performing a directional inverse transformation on the second prediction residual coefficient corresponding to the remaining blocks in the plurality of blocks The prediction residual coefficient is subjected to an inverse transformation independent of directionality to obtain a second prediction residual; The step of performing upsampling and synthesizing the plurality of blocks to obtain decoded macroblocks includes: Perform upsampling and synthesis on the inter-block prediction intra-frame decoding processing result and the inter-pixel prediction intra-frame decoding processing result to obtain a decoded macroblock. 8. The image decoding processing method according to claim 6, wherein the prediction residual coefficient corresponding to at least one block among the prediction residual coefficients respectively corresponding to a plurality of blocks is subjected to directional inversion based on a prediction mode. Transform to obtain prediction residuals, including: performing directional inverse transformation based on the same prediction mode on the first prediction residual coefficient corresponding to the first block of the plurality of blocks and the second prediction residual coefficient corresponding to the remaining blocks of the plurality of blocks, respectively obtaining a first prediction residual and a second prediction residual; The step of performing upsampling and synthesizing the plurality of blocks to obtain decoded macroblocks includes: Perform upsampling and synthesis on the inter-block prediction intra-frame decoding processing result and the inter-pixel prediction intra-frame decoding processing result to obtain a decoded macroblock. 9. The image decoding processing method according to claim 6, characterized in that, the prediction residual coefficient corresponding to at least one block among the prediction residual coefficients respectively corresponding to a plurality of blocks is subjected to directional inversion based on a prediction mode. Transform to obtain prediction residuals, including: performing directional inverse transformation based on the prediction mode on the first prediction residual coefficient corresponding to the first sub-block in the plurality of blocks, obtaining the first prediction residual, and performing a directional inverse transformation corresponding to the plurality of second sub-blocks in the plurality of blocks The block and the second prediction residual coefficients corresponding to the plurality of second sub-blocks respectively perform inverse transformation independent of directionality to obtain the second prediction residual; The performing spatial prediction intra-frame decoding processing on the prediction residual to obtain the plurality of blocks, wherein the spatial domain prediction intra-frame decoding processing at least includes using the prediction mode to perform inter-block prediction intra-frame decoding, including: Use the prediction mode to perform inter-block prediction intra-frame decoding processing on the first prediction residual, obtain the inter-block prediction intra-frame decoding processing result of the first sub-block, and apply the inter-block prediction processing result of the first sub-block Prediction of intra-frame decoding processing results Perform inter-pixel prediction intra-frame decoding processing on the second prediction residual, and obtain inter-pixel prediction intra-frame decoding processing of the plurality of second blocks and the plurality of second sub-blocks in the plurality of blocks result; The step of performing upsampling and synthesizing the plurality of blocks to obtain decoded macroblocks includes: performing second upsampling synthesis on the inter-block prediction intra-frame decoding processing results of the first sub-block and the inter-pixel prediction intra-frame decoding processing results of the plurality of second sub-blocks to obtain the first block, and Perform first upsampling synthesis on the inter-pixel prediction intra-frame decoding processing results of the first block and the plurality of second blocks to obtain decoded macroblocks. 10. The image decoding processing method according to claim 6, wherein the prediction mode-based directional inversion is performed on the prediction residual coefficient corresponding to at least one block among the prediction residual coefficients respectively corresponding to a plurality of blocks. transformations, including: The first prediction residual coefficient corresponding to the first sub-block in the plurality of blocks and the second prediction residual coefficient corresponding to the plurality of second blocks and the plurality of second sub-blocks in the plurality of blocks are based on Directional inverse transformation of the same prediction mode to obtain the first prediction residual and the second prediction residual respectively; The performing spatial prediction intra-frame decoding processing on the prediction residual to obtain the plurality of blocks, wherein the spatial domain prediction intra-frame decoding processing at least includes using the prediction mode to perform inter-block prediction intra-frame decoding, including: Use the prediction mode to perform inter-block prediction intra-frame decoding processing on the first prediction residual, obtain the inter-block prediction intra-frame decoding processing result of the first sub-block, and apply the inter-block prediction processing result of the first sub-block Prediction of intra-frame decoding processing results Perform inter-pixel prediction intra-frame decoding processing on the second prediction residual, and obtain inter-pixel prediction intra-frame decoding processing of the plurality of second blocks and the plurality of second sub-blocks in the plurality of blocks result; The step of performing upsampling and synthesizing the plurality of blocks to obtain decoded macroblocks includes: performing second upsampling synthesis on the inter-block prediction intra-frame decoding processing results of the first sub-block and the inter-pixel prediction intra-frame decoding processing results of the plurality of second sub-blocks to obtain the first block, and Perform first upsampling synthesis on the inter-pixel prediction intra-frame decoding processing results of the first block and the plurality of second blocks to obtain decoded macroblocks. 11. The image decoding processing method according to claim 6, characterized in that, the prediction residual coefficient corresponding to at least one block among the prediction residual coefficients respectively corresponding to the plurality of blocks is subjected to directional inversion based on a prediction mode. transformations, including: performing directional inverse transformation based on the prediction mode on the first prediction residual coefficients corresponding to the plurality of first sub-blocks in the plurality of blocks, obtaining the first prediction residual, and The second prediction residual coefficient corresponding to the second block is subjected to an inverse transformation independent of directionality to obtain a second prediction residual; The performing spatial prediction intra-frame decoding processing on the prediction residual to obtain the plurality of blocks, wherein the spatial domain prediction intra-frame decoding processing at least includes using the prediction mode to perform inter-block prediction intra-frame decoding, including: Use the prediction mode to perform inter-block prediction intra-frame decoding processing on the first prediction residual, obtain the inter-block prediction intra-frame decoding processing results of the plurality of first sub-blocks, and apply the plurality of first sub-blocks performing inter-predictive intra-frame decoding processing results on the second prediction residual of the block, and obtaining inter-pixel intra-frame decoding processing results of the plurality of second blocks among the plurality of blocks; The step of performing upsampling and synthesizing the plurality of blocks to obtain decoded macroblocks includes: performing spatial synthesis processing on the inter-block prediction intra-frame decoding processing results of the plurality of first sub-blocks, obtaining the first block, and inter-pixel prediction frames of the first block and the plurality of second blocks The results of the inner decoding processing are up-sampled and synthesized to obtain the decoded macroblocks. 12. The image decoding processing method according to claim 6, characterized in that, the prediction residual coefficient corresponding to at least one block among the prediction residual coefficients respectively corresponding to a plurality of blocks is subjected to directional inversion based on a prediction mode. transformations, including: Performing a direction based on the same prediction mode on the first prediction residual coefficients corresponding to the plurality of first sub-blocks in the plurality of blocks and the second prediction residual coefficients corresponding to the plurality of second blocks in the plurality of blocks Inverse transformation, respectively obtain the first prediction residual and the second prediction residual; The performing spatial prediction intra-frame decoding processing on the prediction residual to obtain the plurality of blocks, wherein the spatial domain prediction intra-frame decoding processing at least includes using the prediction mode to perform inter-block prediction intra-frame decoding, including: Perform inter-block prediction intra-frame decoding processing on the first prediction residual by using the prediction mode, obtain inter-block prediction intra-frame decoding processing results of the plurality of first sub-blocks, and apply the plurality of first sub-blocks performing inter-predictive intra-frame decoding processing on the second prediction residual, and obtaining the inter-pixel intra-predictive intra-frame decoding processing results of the plurality of second blocks in the plurality of blocks; The step of performing upsampling and synthesizing the plurality of blocks to obtain decoded macroblocks includes: performing spatial synthesis processing on the inter-block prediction intra-frame decoding processing results of the plurality of first sub-blocks, obtaining the first block, and inter-pixel prediction frames of the first block and the plurality of second blocks The results of the inner decoding processing are up-sampled and synthesized to obtain the decoded macroblocks. 13. An image coding processing device, comprising: The coding division module is used to perform down-sampling division on the macroblocks to be coded to obtain a plurality of blocks; An encoding prediction module, configured to perform spatial prediction intra-frame encoding on the plurality of blocks, and obtain prediction residuals respectively corresponding to the plurality of blocks, wherein the spatial prediction intra-frame encoding at least includes performing inter-block prediction using a prediction mode intraframe coding; A coding transformation module, configured to perform directional transformation based on the prediction mode on at least one of the prediction residuals; Wherein, the encoding and dividing module is specifically used to extract pixels at intervals to form the plurality of blocks; The coding prediction module includes: The first encoding and prediction unit is configured to perform inter-prediction and intra-frame encoding processing on the first block among the plurality of blocks by using a prediction mode, and obtain a first prediction residual corresponding to the first block; The second coding prediction unit is configured to apply the inter-block prediction intra-frame coding processing result of the first block to perform inter-pixel prediction intra-frame coding processing on the remaining blocks in the plurality of blocks, and obtain the same information as in the plurality of blocks The rest of the blocks respectively correspond to the second prediction residuals. 14. The image encoding processing device according to claim 13, wherein: The code conversion module includes: A first coding transformation unit, configured to perform directional transformation based on the prediction mode on the first prediction residual; The second coding transformation unit is configured to perform directionality-independent transformation on the second prediction residual. 15. The image encoding processing device according to claim 13, wherein the encoding transformation module is specifically configured to perform directional transformation based on the prediction mode on the first prediction residual and the second prediction residual . 16. The image encoding processing device according to claim 13, wherein the encoding division module comprises: The first coding sampling unit is configured to perform first down-sampling division on the macroblock to obtain a first block and a plurality of second blocks; The second encoding sampling unit is configured to perform second downsampling division on the first block to obtain a first sub-block and a plurality of second sub-blocks; The coding prediction module includes: The fifth encoding and prediction unit is configured to perform inter-prediction and intra-frame encoding processing on the first sub-block in a prediction mode, and obtain a first prediction residual corresponding to the first sub-block; The sixth coding prediction unit is configured to apply the inter-block prediction intra-frame coding processing result of the first sub-block to perform inter-pixel prediction intra-frame coding processing on the plurality of second blocks and the plurality of second sub-blocks, Acquiring second prediction residuals respectively corresponding to the plurality of second blocks and the plurality of second sub-blocks; The code conversion module includes: A third coding transformation unit, configured to perform directional transformation based on the prediction mode on the first prediction residual; or perform directional transformation on the first prediction residual and the second prediction residual based on the prediction mode the directional transformation; The fourth coding transformation unit is configured to perform directionality-independent transformation on the second prediction residual. 17. The image encoding processing device according to claim 13, wherein the encoding division module comprises: The third coding sampling unit is configured to perform down-sampling division on the macroblock to obtain a first block and a plurality of second blocks; The fourth encoding sampling unit is configured to perform spatial division processing on the first block to obtain a plurality of first sub-blocks; The coding prediction module includes: The seventh coding prediction unit is configured to perform inter-block prediction and intra-frame coding processing on the plurality of first sub-blocks respectively in a prediction mode, and obtain first prediction residuals respectively corresponding to the plurality of first sub-blocks; The eighth coding prediction unit is configured to apply the inter-block prediction intra-frame coding processing results of the plurality of first sub-blocks to perform inter-pixel prediction intra-frame coding processing on the plurality of second blocks, and obtain the same information as the plurality of first sub-blocks The second prediction residuals corresponding to the two blocks respectively; The encoding transformation module is specifically configured to perform directional transformation based on the prediction mode on the first prediction residual, and perform directionality-independent transformation on the second prediction residual; or perform a directivity-independent transformation on the first prediction residual The residual and the second prediction residual undergo a directional transformation based on the prediction mode. 18. An image decoding processing device, characterized in that it comprises: The decoding transformation module is used to perform directional inverse transformation based on the prediction mode on the prediction residual coefficient corresponding to at least one of the prediction residual coefficients corresponding to the plurality of blocks respectively, to obtain the prediction residual; A decoding prediction module, configured to perform spatial prediction intra-frame decoding processing on the prediction residual to obtain the plurality of blocks, wherein the spatial prediction intra-frame decoding processing at least includes performing inter-block prediction intra-frame decoding using the prediction mode ; A decoding and synthesis module, configured to perform upsampling and synthesis on the plurality of blocks to obtain decoded macroblocks; The decoding prediction module includes: The first decoding prediction unit is configured to perform inter-block prediction intra-frame decoding processing on the first prediction residual by using the prediction mode, and obtain an inter-block prediction intra-frame decoding processing result of the first block in the plurality of blocks; The second decoding prediction unit is configured to apply the inter-block prediction intra-frame decoding processing result of the first block to perform inter-pixel prediction intra-frame decoding processing on the second prediction residual, and obtain the inter-pixel prediction of the remaining blocks in the plurality of blocks Predicts the result of the intra decoding process. 19. The image decoding processing device according to claim 18, wherein the decoding transformation module includes: The first decoding transformation unit is configured to perform directional inverse transformation based on a prediction mode on the first prediction residual coefficient corresponding to the first block of the plurality of blocks, to obtain the first prediction residual; The second decoding transformation unit is configured to perform directionality-independent inverse transformation on the second prediction residual coefficients corresponding to the remaining blocks in the plurality of blocks to obtain the second prediction residual; The decoding and combining module is specifically configured to perform upsampling and combining on the inter-block prediction intra-frame decoding processing result and the inter-pixel prediction intra-frame decoding processing result to obtain a decoded macroblock. 20. The image decoding processing device according to claim 18, wherein the decoding and transforming module is specifically configured to convert the first prediction residual coefficient corresponding to the first block in the complex number of blocks and the first prediction residual coefficient corresponding to the complex number of blocks performing directional inverse transformation based on the same prediction mode on the second prediction residual coefficients corresponding to the remaining blocks in the block to obtain the first prediction residual and the second prediction residual respectively; The decoding and combining module is specifically configured to perform upsampling and combining on the inter-block prediction intra-frame decoding processing result and the inter-pixel prediction intra-frame decoding processing result to obtain a decoded macroblock. 21. The image decoding processing device according to claim 18, wherein the decoding transformation module includes: A third decoding transformation unit, configured to perform directional inverse transformation based on a prediction mode on the first prediction residual coefficient corresponding to the first sub-block in the plurality of blocks, to obtain the first prediction residual; The fourth decoding transformation unit is configured to perform directionality-independent inverse transformation on the second prediction residual coefficients respectively corresponding to the plurality of second blocks and the plurality of second sub-blocks in the plurality of blocks to obtain the second prediction residual; The decoding prediction module includes: The fifth decoding prediction unit is configured to perform inter-block prediction intra-frame decoding processing on the first prediction residual by using the prediction mode, and obtain an inter-block prediction intra-frame decoding processing result of the first sub-block; The sixth decoding prediction unit is configured to apply the inter-block prediction intra-frame decoding processing result of the first sub-block to perform inter-pixel prediction intra-frame decoding processing on the second prediction residual, and obtain a plurality of blocks in the plurality of blocks Inter-pixel prediction intra-frame decoding processing results of the second block and the plurality of second sub-blocks; The decoding synthesis module includes: The first decoding sampling unit is configured to perform second up-sampling synthesis on the inter-block prediction intra-frame decoding processing result of the first sub-block and the inter-pixel prediction intra-frame decoding processing result of the plurality of second sub-blocks to obtain the result. Describe the first block; The second decoding sampling unit is configured to perform first upsampling synthesis on the first block and the inter-pixel prediction intra-frame decoding processing results of the plurality of second blocks, and obtain a decoded macroblock. 22. The image decoding processing device according to claim 18, wherein the decoding and transforming module is specifically configured to perform the first prediction residual coefficient corresponding to the first sub-block in the plurality of blocks and the first prediction residual coefficient corresponding to the In the plurality of blocks, the second prediction residual coefficients corresponding to the plurality of second blocks and the plurality of second sub-blocks are subjected to directional inverse transformation based on the same prediction mode, to obtain the first prediction residual and the second prediction residual respectively; The decoding prediction module includes: The seventh decoding prediction unit is configured to perform inter-block prediction intra-frame decoding processing on the first prediction residual by using the prediction mode, and obtain an inter-block prediction intra-frame decoding processing result of the first sub-block; The eighth decoding prediction unit is configured to apply the inter-block prediction intra-frame decoding processing result of the first sub-block to perform inter-pixel prediction intra-frame decoding processing on the second prediction residual, and obtain a plurality of blocks in the plurality of blocks Inter-pixel prediction intra-frame decoding processing results of the second block and the plurality of second sub-blocks; The decoding synthesis module includes: The third decoding sampling unit is configured to perform second up-sampling synthesis on the inter-block prediction intra-frame decoding processing result of the first sub-block and the inter-pixel prediction intra-frame decoding processing result of the plurality of second sub-blocks to obtain the result. Describe the first block; The fourth decoding and sampling unit is configured to perform first up-sampling synthesis on the first block and the inter-pixel prediction intra-frame decoding processing results of the plurality of second blocks to obtain a decoded macroblock. 23. The image decoding processing device according to claim 18, wherein the decoding transformation module includes: The fifth decoding transformation unit is configured to respectively perform directional inverse transformation based on a prediction mode on the first prediction residual coefficients corresponding to the plurality of first sub-blocks in the plurality of blocks, and obtain the first prediction residual; The sixth decoding and transformation unit is configured to perform directionality-independent inverse transformation on the second prediction residual coefficients corresponding to the plurality of second blocks in the plurality of blocks to obtain the second prediction residual; The decoding prediction module includes: The ninth decoding prediction unit is configured to perform inter-block prediction intra-frame decoding processing on the first prediction residual by using the prediction mode, and obtain inter-block prediction intra-frame decoding processing results of the plurality of first sub-blocks; The tenth decoding prediction unit is configured to apply the inter-block prediction intra-frame decoding processing results of the plurality of first sub-blocks to perform inter-pixel prediction intra-frame decoding processing on the second prediction residual, and obtain the Inter-prediction intra-frame decoding processing results of the plurality of second blocks; The decoding synthesis module includes: The sixth decoding sampling unit is configured to perform spatial synthesis processing on the inter-block prediction intra-frame decoding processing results of the plurality of first sub-blocks, and obtain the first block; The seventh decoding and sampling unit is configured to perform up-sampling and synthesis on the first block and the inter-pixel prediction intra-frame decoding processing results of the plurality of second blocks, and obtain a decoded macroblock.