CN107483942B - Decoding of video data compressed code stream, video data encoding method and device - Google Patents

Abstract

The present invention provides a method and device for decoding video data compressed code streams and encoding video data, wherein the decoding method for video data compressed code streams includes: parsing video data compressed code streams, acquiring sampling format information and/or decoding methods information; according to the sampling format information and/or decoding method information, among the predetermined multiple sampling formats and decoding methods, select the first sampling format and the decoding method corresponding to the first sampling format; adopt the first sampling format and the first The decoding mode corresponding to the sampling format decodes the decoding block. The present invention solves the technical problem of low efficiency when decoding with a single format and decoding method in the related art.

Description

Decoding of video data compressed code stream, video data encoding method and device

technical field

The present invention relates to the field of data processing, in particular to a method and device for decoding video data compression code streams and encoding video data.

Background technique

As human society enters the era of big data, cloud computing, mobile computing, cloud-mobile computing, ultra-high-definition (4K) and ultra-high-definition (8K) video image resolution, 4G/5G communication, and virtual reality, all kinds of data , including big data, image data, and video data, ultra-high compression ratio and extremely high-quality data compression has become an indispensable technology.

A dataset is a collection of data elements (eg, bytes, bits, pixels). When performing data compression encoding (and corresponding decoding) on a data set (for example: a file, a frame image, a video sequence) arranged in a certain shape and with a certain number of elements (that is, with a certain sampling format), usually the This data set is divided into several subsets of blocks with a predetermined shape and size (that is, the number of elements), called coding blocks (from the perspective of decoding, that is, decoding blocks, collectively referred to as codec blocks), with codec blocks as units, Encode or decode block by block. At any moment, the coding block being coded is called the current coding block. At any moment, the decoding block being decoded is called the current decoding block. The current coding block or the current decoding block is collectively referred to as the current codec block or the current block for short. A data element being encoded or decoded (referred to as an element for short) is referred to as a currently encoded data element or a currently decoded data element, collectively referred to as a current data element, or simply referred to as a current element. An element consists of N components (usually 1≤N≤5), so both the data set and the codec block also consist of N components. For example, the elements of a frame of image, i.e. pixels, are arranged in a rectangular shape with a size (resolution) of 1920 (width) x 1080 (height), consisting of 3 components: G (green) component, B (blue) component, R (red) component or Y (brightness) component, U (Cb chroma) component, V (Cr chroma) component.

In related technologies, both the data set and the codec block as the coding object have only one fixed sampling format and size. For example, for computer-generated images containing graphics and text, a sampling format called 4:4:4 is usually used, that is, the three components of the data set have the same sampling rate and size (that is, the number of component samples ). For natural images and videos ingested by cameras, a sampling format called 4:2:0 is usually used, which is 2 components (D component and E The sampling rate and size of the component) are respectively one quarter of the other component (the F component). In this case, one D component D[i][j] and one E component E[i][j] correspond to four (2×2) F components F[2i][2j], F[2i+ 1][2j], F[2i][2j+1], F[2i+1][2j+1]. If the resolution of the F component is 2M×2N, that is, the F component of the data set is F={F[i][j]: i=0~2M-1, j=0~2N-1}, then the D component and The resolutions of the E components are M×N respectively, that is, the D and E components of the data set are D={D[i][j]: i=0~M-1, j=0~N-1} and E={E[i][j]: i=0~M-1, j=0~N-1}. There is also a sampling format called 4:2:2, which is a data set (such as an image or video) with a rectangular shape and 3 components. The sampling rate and size of the 2 components (D component and E component) are another One-half of a component (F component). In this case, in the horizontal direction of the data set (such as image or video), one D component D[i][j] and one E component E[i][j] correspond to two (2×1) F Components F[2i][j] and F[2i+1][j]. If the resolution of the F component is 2M×N, that is, the F component of the data set is F={F[i][j]: i=0~2M-1, j=0~N-1}, then the D component The resolutions of the D and E components are both M×N, that is, the D and E components of the data set are D={D[i][j]: i=0~M-1, j=0~N-1 } and E={E[i][j]: i=0~M-1, j=0~N-1}. In images and videos using the YUV color format, the above-mentioned F, D, and E components are Y, U, and V components, respectively. In images and videos using the RGB color format, the above-mentioned F, D, and E components are G, B, and R components, respectively. In the existing technology, even in some cases, the data sets and codec blocks used as encoding objects have multiple sampling formats and sizes, when encoding these encoding objects with different sampling formats and sizes, the same encoding is used way, or a different encoding way, always encodes an encoded object of a single sample format and size. Here, different sampling formats mean that at least one component of a data set and/or a codec block has a different sampling rate and size (ie, the number of component samples). Different sampling rates and sizes are converted to each other by upsampling operation or downsampling operation. The upsampling operation is an operation to increase the number of samples. The downsampling operation is an operation to reduce the number of samples. Therefore, different sampling formats, ie at least one component of a data set and/or a codec block, have a different number of samples.

For data sets that are mixed with content of multiple characteristics, such as screen content images and videos mixed with computer-generated graphics and text and natural images and videos captured by cameras, images and videos of virtual reality, a single sampling Format and size, and essentially a single encoding method greatly affect the improvement of data compression efficiency.

Aiming at the above-mentioned problems existing in related technologies, no effective solution has been found yet.

Contents of the invention

Embodiments of the present invention provide a method and device for decoding compressed code streams of video data and encoding video data, so as to at least solve the technical problem of low efficiency when decoding with a single format and decoding method in the related art.

According to an embodiment of the present invention, there is provided a decoding method of a video data compressed code stream, which further includes: parsing the video data compressed code stream to obtain sampling format information and/or decoding method information; according to the sampling format information and/or or decoding method information, among predetermined multiple sampling formats and decoding methods, select the first sampling format and the decoding method corresponding to the first sampling format; adopt the first sampling format and the first sampling format The corresponding decoding mode decodes the decoding block.

Optionally, the video data compression code stream includes a data compression code stream of at least one of the following information: one-dimensional data, two-dimensional data, multi-dimensional data larger than two-dimensional, image, image sequence, video, audio, file, byte, bit, pixel, data consisting of three components, image having a rectangular shape, sequence of images having a rectangular shape, image consisting of three components, sequence of images consisting of three components, Composed video, image composed of R component, G component, B component, image sequence composed of R component, G component, B component, video composed of R component, G component, B component, composed of a brightness component and two An image composed of one chrominance component, an image sequence composed of one luminance component and two chrominance components, a video composed of one luminance component and two chrominance components, and a coded block of data.

Optionally, the decoding block is a decoding area of an image, wherein the decoding area includes at least one of the following: a sub-image of an image, a macroblock, a largest coding unit LCU, a coding tree unit CTU, a coding unit CU, or a CU Sub-region, prediction unit PU, transform unit TU.

Optionally, the multiple sampling formats include a main sampling format and other sampling formats, wherein the other sampling formats are sampling formats obtained through a sampling operation on the main sampling format.

Optionally, the video data compression code stream has a rectangular shape and a data compression code stream of images or sequences of images of three components.

Optionally, the multiple sampling formats are 4:4:4 sampling format and 4:2:0 sampling format; or, the multiple sampling formats are 4:4:4 sampling format and 4:2:2 sampling format format; or, the multiple sampling formats are 4:2:2 sampling format and 4:2:0 sampling format.

Optionally, the decoding method corresponding to the 4:2:0 sampling format includes: generating a data version of the 4:2:0 sampling format, and converting the data version of the 4:2:0 sampling format through an upsampling operation It is a data version in a 4:4:4 or 4:2:2 sampling format, wherein the method for generating the data version in the 4:2:0 sampling format includes: performing intra-frame prediction according to adjacent pixels of the decoding block operations that produce a version of the data in 4:2:0 sampling format, and/or operations that perform inter-prediction from adjacent pictures of the decoded picture produce a version of the data in 4:2:0 sampling format; and the 4:4:4 or The corresponding decoding method of the 4:2:2 sampling format includes: generating a data version of the 4:4:4 or 4:2:2 sampling format according to the prediction operation, and the 4:4:4 or 4:2:2 sampling format The data version of is converted into a data version in a 4:2:0 sampling format through a downsampling operation, wherein the prediction operation includes a string prediction operation.

Optionally, the decoding method includes at least one of the following: perform intra-frame prediction according to adjacent pixels of the decoded block; perform inter-frame prediction according to adjacent images of the decoded image; perform frame prediction according to adjacent images of the decoded image Inter-transformation; scaling; general-purpose string prediction; palette decoding; dictionary decoding; entropy decoding.

Optionally, it also includes: parsing the video data compression code stream, and obtaining the first flag bit from one of the following positions: sequence parameter set, image parameter set, sequence header, slice header, image header, CTU header, CU header , decoding the block header, wherein the first flag bit is used to indicate that multiple sampling formats and/or corresponding decoding methods are allowed to be used for decoding.

Optionally, it also includes: parsing the video data compression code stream, and obtaining the second flag bit from at least one of the following positions: sequence parameter set, image parameter set, sequence header, slice header, image header, decoding block header, wherein , the second flag bit is used to indicate that a decoding block using a 4:4:4 sampling format and/or a corresponding string prediction decoding mode is allowed to be used.

Optionally, it also includes: parsing the video data compression code stream, and obtaining the third flag bit from at least one of the following positions: sequence parameter set, image parameter set, sequence header, slice header, image header, decoding block header, wherein , the third flag bit is used to indicate that the decoding block that adopts the 4:2:2 sampling format and/or the corresponding string prediction decoding mode is allowed to be used.

Optionally, one of the predetermined plurality of sampling formats and decoding methods corresponds to a predetermined value k, and from the video data compression code stream, directly or Indirect or direct-indirect mixed sampling format and corresponding decoding method identification code.

Optionally, the direct sampling format and corresponding decoding mode identification codes are composed of one or more bit strings in the video data compression stream; the indirect sampling format and corresponding decoding mode identification codes are The sampling format and the corresponding decoding mode identification code derived from other decoding parameters other than the decoding mode parameters and/or other syntax elements of the video data compressed code stream except the syntax elements corresponding to the decoding mode parameters; The direct-indirect mixed sampling format and the corresponding decoding mode identification code are partly direct and partly indirect mixed sampling formats and corresponding decoding mode identification codes.

Optionally, the sampling format and the identification code corresponding to the decoding mode are obtained from the following positions of the video data compression code stream: the decoding block header information syntax element, sampling format and corresponding decoding mode identification code syntax element, additional The decoding block header information syntax elements, decoding block data syntax elements; or the decoding block header information syntax elements, partial sampling format and corresponding decoding mode identification code syntax elements, additional decoding block header information syntax elements, partial decoding block data syntax elements, and other Part of the sampling format and the corresponding decoding mode identification code syntax element, and another part of the decoding block data syntax element; wherein, when the value of the identification code of the identification code syntax element is equal to the specified value, it means that the sampling format corresponding to the specified value is adopted and the corresponding decoding mode to decode the decoding block.

According to another embodiment of the present invention, a method for encoding video data is provided, including: selecting a first sampling format from a plurality of predetermined sampling formats, and selecting a first sampling format from among a plurality of predetermined encoding methods A coding method corresponding to a sampling format; using the selected first sampling format and the selected coding method to encode the coding block of the video data to generate a video data compression code stream, wherein the video data compression code stream includes: the first sampling format and/or encoding mode, a syntax element corresponding to the first sampling format and/or encoding mode.

Optionally, the video data includes at least one of the following: one-dimensional data, two-dimensional data, multi-dimensional data larger than two-dimensional, image, image sequence, video, audio, file, byte, bit, pixel, composed of three data consisting of three components, an image having a rectangular shape, a sequence of images having a rectangular shape, an image consisting of three components, an image sequence consisting of three components, a video consisting of three components, consisting of R components, G An image composed of component and B component, an image sequence composed of R component, G component, and B component, a video composed of R component, G component, and B component, an image composed of a luminance component and two chrominance components, and an image composed of An image sequence composed of a luminance component and two chroma components, a video composed of a luminance component and two chroma components, and a coded block of data.

Optionally, the coding block is a coding area of an image, wherein the coding area includes at least one of the following: a sub-image of an image, a macroblock, a largest coding unit LCU, a coding tree unit CTU, a coding unit CU, or a CU Sub-region, prediction unit PU, transform unit TU.

Optionally, the multiple sampling formats include a main sampling format and other sampling formats, wherein the other sampling formats are sampling formats obtained through a sampling operation on the main sampling format.

Optionally, said video data is an image or sequence of images having a rectangular shape and three components.

Optionally, the multiple sampling formats are 4:4:4 sampling format and 4:2:0 sampling format; or, the multiple sampling formats are 4:4:4 sampling format and 4:2:2 sampling format format; or, the multiple sampling formats are 4:2:2 sampling format and 4:2:0 sampling format.

Optionally, the encoding method corresponding to the 4:2:0 sampling format includes: generating a data version of the 4:2:0 sampling format, and converting the data version of the 4:2:0 sampling format through an upsampling operation It is a data version in a 4:4:4 or 4:2:2 sampling format, wherein the method for generating the data version in the 4:2:0 sampling format includes: performing intra-frame prediction according to the adjacent pixels of the coding block The operation generates a data version in a 4:2:0 sampling format, and/or the operation of inter-predicting an adjacent image of the coded image generates a data version in a 4:2:0 sampling format; and the 4:4 :4 or 4:2:2 sampling format corresponding coding method includes: generating a data version of 4:4:4 or 4:2:2 sampling format according to the prediction operation, for the 4:4:4 or 4:2: The data version of the 2-sampling format is converted into a data version of the 4:2:0 sampling format through a down-sampling operation, wherein the prediction operation includes a string prediction operation.

Optionally, the encoding method includes at least one of the following: performing intra-frame prediction according to adjacent pixels of the encoded block; performing inter-frame prediction based on adjacent images of the encoded image; performing frame prediction based on adjacent images of the encoded image Inter-transformation; quantization; general string prediction; palette coding; dictionary coding; hybrid coding Hybrid coding; entropy coding.

Optionally, it also includes: including the first flag bit in one of the following parts of the video data compression code stream: sequence parameter set, image parameter set, sequence header, slice header, image header, CTU header, CU header, coded block header , wherein the first flag bit is used to indicate that multiple sampling formats and/or corresponding encoding methods are allowed to be used for encoding.

Optionally, it also includes: including a second flag bit in at least one of the following parts of the video data compression code stream: a sequence parameter set, an image parameter set, a sequence header, a slice header, an image header, and a coded block header, wherein the The second flag bit is used to indicate that a coding block using a 4:4:4 sampling format and/or corresponding string predictive coding mode is allowed to be used.

Optionally, it also includes: including a third flag in at least one of the following parts of the video data compression code stream: a sequence parameter set, an image parameter set, a sequence header, a slice header, an image header, and a coded block header, wherein the The third flag bit is used to indicate that a coding block that adopts the 4:2:2 sampling format and/or the corresponding string predictive coding method is allowed to be used.

Optionally, one of the predetermined plurality of sampling formats and coding methods corresponds to a predetermined value k, and a direct or indirect or direct-indirect mixed sampling format and corresponding An encoding mode identification code, including the encoding mode identification code in the video data compression code stream.

Optionally, the direct sampling format and corresponding encoding mode identification codes are composed of one or more bit strings in the video data compression code stream; the indirect sampling format and corresponding encoding mode identification codes are The sampling format and the corresponding encoding mode identification code derived from other encoding parameters other than the selected encoding mode parameters and/or other syntax elements of the video data compression stream except the syntax elements; the direct indirect mixing The sampling format and the corresponding coding mode identification code are partly direct and partly indirect mixed sampling format and corresponding coding mode identification code.

Optionally, the sampling format and the identification code corresponding to the encoding mode are present in the video data compression code stream in the following manner: the encoding block header information syntax element, the sampling format and the corresponding encoding mode identification code syntax element, Additional coded block header information syntax elements, coded block data syntax elements; or the coded block header information syntax elements, partial sampling formats and corresponding coding mode identification code syntax elements, additional coded block header information syntax elements, partial coded block data syntax elements, Another part of the sampling format and the corresponding encoding mode identification code syntax elements, and another part of the coding block data syntax elements; wherein, when the value of the identification code of the identification code syntax element is equal to the specified value, it means that the sampling corresponding to the specified value is adopted. The encoding block is encoded using a format and a corresponding encoding manner.

According to another embodiment of the present invention, a device for decoding video data compressed code streams is provided, including: an analysis module, configured to analyze video data compressed code streams, and obtain sampling format information and/or decoding method information; a selection module, It is used to select a first sampling format and a decoding method corresponding to the first sampling format among predetermined multiple sampling formats and decoding methods according to the sampling format information and/or decoding method information; the decoding module uses The decoded block is decoded by using the first sampling format and a decoding manner corresponding to the first sampling format.

According to another embodiment of the present invention, a method for encoding video data is provided, including: a selection module for selecting a first sampling format from a plurality of predetermined sampling formats, and selecting a first sampling format from among a plurality of predetermined encoding methods Select the encoding method corresponding to the first sampling format; the encoding module is used to use the selected first sampling format and the selected encoding method to encode the encoding block of the video data to generate a video data compression code stream, wherein the video The data compression code stream includes: a first sampling format and/or coding mode, and syntax elements corresponding to the first sampling format and/or coding mode.

According to still another embodiment of the present invention, a storage medium is also provided. The storage medium is configured to store program code for performing the following steps:

Parsing the video data compression code stream to obtain sampling format information and/or decoding method information;

According to the sampling format information and/or decoding mode information, among predetermined multiple sampling formats and decoding modes, select a first sampling format and a decoding mode corresponding to the first sampling format;

The decoded block is decoded by using the first sampling format and a decoding manner corresponding to the first sampling format.

According to still another embodiment of the present invention, a storage medium is also provided. The storage medium is configured to store program code for performing the following steps:

Selecting a first sampling format from a plurality of predetermined sampling formats, and selecting an encoding method corresponding to the first sampling format from among a plurality of predetermined encoding methods;

Use the selected first sampling format and the selected encoding method to encode the encoding block of the video data to generate a video data compression code stream, wherein the video data compression code stream includes: the first sampling format and/or the encoding method, and the second A syntax element corresponding to the sampling format and/or encoding method.

Through the present invention, the sampling format and the corresponding decoding method are selected among a plurality of predetermined sampling formats and decoding methods, which solves the technical problem of low efficiency when decoding with a single format and decoding method in the related art, and improves the decoding rate.

Description of drawings

The accompanying drawings described here are used to provide a further understanding of the present invention and constitute a part of the application. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations to the present invention. In the attached picture:

Fig. 1 is the flow chart of the decoding method of video data compression code stream according to the embodiment of the present invention;

Fig. 2 is the flowchart of the encoding method of video data according to the embodiment of the present invention;

3 is a structural block diagram of a decoding device for video data compression code stream according to an embodiment of the present invention;

Fig. 4 is a structural block diagram of an encoding device for video data according to an embodiment of the present invention;

Fig. 5 is a schematic diagram of the encoding method of this embodiment;

Fig. 6 is a schematic diagram of the decoding method in this embodiment.

Detailed ways

Hereinafter, the present invention will be described in detail with reference to the drawings and examples. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.

It should be noted that the terms "first" and "second" in the description and claims of the present invention and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence.

Example 1

In this embodiment, a method for decoding a video data compressed code stream is provided. FIG. 1 is a flowchart of a decoding method for a video data compressed code stream according to an embodiment of the present invention. As shown in FIG. 1 , the process includes the following steps :

Step S102, analyzing the compressed video data stream, and obtaining sampling format information and/or decoding method information;

Step S104, according to the sampling format information and/or decoding mode information, among predetermined multiple sampling formats and decoding modes, select a first sampling format and a decoding mode corresponding to the first sampling format;

Step S106, using the first sampling format and the decoding method corresponding to the first sampling format to decode the decoded block.

Through the above steps, the sampling format and the corresponding decoding method are selected among the predetermined multiple sampling formats and decoding methods, which solves the technical problem of low efficiency when decoding with a single format and decoding method in the related art, and improves the decoding rate.

Optionally, the execution subject of the above steps may be a decoder, a video processing device, such as a video receiving end, a video presentation device, etc., but is not limited thereto.

Optionally, the video data compression code stream includes a data compression code stream of at least one of the following information: one-dimensional data, two-dimensional data, multi-dimensional data larger than two-dimensional, image, image sequence, video, audio, file, byte , bit, pixel, data consisting of three components, image having a rectangular shape, sequence of images having a rectangular shape, image consisting of three components, sequence of images consisting of three components, image consisting of three components Video, an image composed of R component, G component, and B component, an image sequence composed of R component, G component, and B component, a video composed of R component, G component, and B component, and a brightness component and two color components. An image composed of a luminance component, an image sequence composed of a luminance component and two chrominance components, a video composed of a luminance component and two chrominance components, and a coded block of data.

Optionally, the decoding block is a decoding area of an image, wherein the decoding area includes at least one of the following: a sub-image of an image, a macroblock, a largest coding unit (The Largest Coding Unit, referred to as LCU), a coding tree unit (CodingTree Unit , referred to as CTU for short), a coding unit (Coding Unit, referred to as CU for short), a sub-region of the CU, a prediction unit PU (Prediction Unit, referred to as PU for short), and a transformation unit (Transform Unit, referred to as TU for short).

Optionally, the multiple sampling formats include a main sampling format and other sampling formats, wherein the other sampling formats are sampling formats obtained by performing a sampling operation on the main sampling format.

Optionally, the video data compression code stream has a rectangular shape and a data compression code stream of images or sequences of images with three components.

Optionally, the multiple sampling formats are 4:4:4 sampling format and 4:2:0 sampling format; or, the multiple sampling formats are 4:4:4 sampling format and 4:2:2 sampling format; or, The multiple sampling formats are 4:2:2 sampling format and 4:2:0 sampling format. Correspondingly, the decoding method corresponding to the 4:2:0 sampling format includes: generating a data version of the 4:2:0 sampling format, and converting the data version of the 4:2:0 sampling format to 4:4 after an upsampling operation: 4 or a data version in a 4:2:2 sampling format, wherein the method for generating a data version in a 4:2:0 sampling format includes: generating a 4:2:0 sampling format according to an operation of intra-frame prediction performed on adjacent pixels of the decoded block The data version of the 4:2:0 sampling format is generated according to the operation of inter prediction when the adjacent image of the decoded image is decoded; the decoding corresponding to the 4:4:4 or 4:2:2 sampling format The method includes: generating a data version of the 4:4:4 or 4:2:2 sampling format according to the prediction operation, and converting the data version of the 4:4:4 or 4:2:2 sampling format to 4:2 after the downsampling operation :0 The data version of the sampling format, specifically, the prediction operation may be a string prediction operation.

Optionally, the decoding method includes at least one of the following: performing intra-frame prediction according to adjacent pixels of the decoded block; performing inter-frame prediction according to adjacent images of the decoded image; performing inter-frame transformation according to adjacent images of the decoded image; scaling; Prediction; palette decoding; dictionary decoding; entropy decoding.

Optionally, parsing the compressed video data stream further includes: Obtaining the first flag bit from one of the following positions: sequence parameter set, image parameter set, sequence header, slice header, image header, CTU header, CU header, decoding The block header, wherein the first flag bit is used to indicate that multiple sampling formats and/or corresponding decoding methods are allowed to be used for decoding.

Optionally, parsing the video data compression code stream further includes: obtaining the second flag bit from at least one of the following positions: sequence parameter set, image parameter set, sequence header, slice header, image header, decoding block header, wherein, the first The two flags are used to indicate that the decoded block using the 4:4:4 sampling format and/or the corresponding string predictive decoding method is allowed.

Optionally, parsing the compressed video data stream further includes: obtaining the third flag bit from at least one of the following positions: sequence parameter set, image parameter set, sequence header, slice header, image header, decoding block header, wherein, the first The three flag bits are used to indicate that a decoding block using the 4:2:2 sampling format and/or the corresponding string predictive decoding method is allowed.

Optionally, one of the predetermined multiple sampling formats and decoding methods corresponds to a predetermined value k, and from the video data compression code stream, obtain direct or indirect or direct-indirect mixed Sampling format and corresponding decoding method identification code.

In this embodiment, the direct sampling format and the corresponding decoding mode identification code are composed of one or more bit strings in the video data compression code stream; The sampling format and corresponding decoding mode identification code derived from other decoding parameters of the video data compression code stream except the syntax element corresponding to the decoding mode parameter; the direct and indirect mixed sampling format and corresponding decoding mode identification code It is the sampling format and the identification code of the corresponding decoding mode mixed with some direct and some indirect.

Optionally, obtain the sampling format and the identification code of the corresponding decoding method from the following positions of the video data compression code stream:

Decoding block header information syntax elements, sampling format and corresponding decoding method identification code syntax elements, additional decoding block header information syntax elements, decoding block data syntax elements; or

Decoding block header information syntax elements, partial sampling format and corresponding decoding method identification code syntax elements, additional decoding block header information syntax elements, partial decoding block data syntax elements, another part of sampling format and corresponding decoding method identification code syntax elements, another part of decoding block data syntax elements;

Wherein, when the value of the identification code of the identification code syntax element is equal to the specified value, it means that the decoding block is decoded using the sampling format and corresponding decoding method corresponding to the specified value.

In this embodiment, a method for encoding video data is provided. FIG. 2 is a flowchart of a method for encoding video data according to an embodiment of the present invention. As shown in FIG. 2 , the process includes the following steps:

Step S202, selecting a first sampling format from a plurality of predetermined sampling formats, and selecting an encoding method corresponding to the first sampling format from among a plurality of predetermined encoding methods;

Step S204, using the selected first sampling format and the selected encoding method to encode the encoding block of the video data to generate a video data compression code stream, wherein the video data compression code stream includes: the first sampling format and/or encoding method, and A syntax element corresponding to the first sampling format and/or coding mode.

Optionally, the execution subject of the above steps may be an encoder, a video processing device, such as a video sending end, a video distribution device, etc., but is not limited thereto.

Optionally, the video data includes at least one of the following: one-dimensional data, two-dimensional data, multidimensional data larger than two-dimensional, image, image sequence, video, audio, file, byte, bit, pixel, consisting of three components Composed data, an image with a rectangular shape, a sequence of images with a rectangular shape, an image consisting of three components, an image sequence consisting of three components, a video consisting of three components, consisting of R component, G component, An image composed of B components, an image sequence composed of R components, G components, and B components, a video composed of R components, G components, and B components, an image composed of one brightness component and two chrominance components, and a brightness Image sequence consisting of two chrominance components, video consisting of one luminance component and two chrominance components, coded block of data.

Optionally, the coding block is a coding area of an image, where the coding area includes at least one of the following: a sub-image of an image, a macroblock, a largest coding unit LCU, a coding tree unit CTU, a coding unit CU, a sub-area of a CU, a prediction Unit PU, transformation unit TU.

Optionally, the multiple sampling formats include a main sampling format and other sampling formats, wherein the other sampling formats are sampling formats obtained by performing a sampling operation on the main sampling format.

Optionally, the video data is an image or sequence of images having a rectangular shape and three components,

Optionally, the multiple sampling formats are 4:4:4 sampling format and 4:2:0 sampling format; or, the multiple sampling formats are 4:4:4 sampling format and 4:2:2 sampling format; or, The multiple sampling formats are 4:2:2 sampling format and 4:2:0 sampling format. Correspondingly, the encoding method corresponding to the 4:2:0 sampling format includes: generating a data version of the 4:2:0 sampling format, and converting the data version of the 4:2:0 sampling format to 4:4 after an upsampling operation: The data version of 4 or 4:2:2 sampling format, wherein, the method for generating the data version of 4:2:0 sampling format includes: generating the 4:2:0 sampling format according to the operation of performing intra prediction on adjacent pixels of the encoding block and/or, according to the operation of inter-prediction of adjacent images when encoding the image, the data version of the 4:2:0 sampling format is generated; the corresponding encoding of the 4:4:4 or 4:2:2 sampling format The method includes: generating a data version of the 4:4:4 or 4:2:2 sampling format according to the prediction operation, and converting the data version of the 4:4:4 or 4:2:2 sampling format to 4:2 after the downsampling operation :0 The data version of the sampling format, specifically, the prediction operation may be a string prediction operation.

Optionally, the encoding method includes at least one of the following: performing intra-frame prediction according to adjacent pixels of the encoded block; performing inter-frame prediction based on adjacent images of the encoded image; performing inter-frame transformation according to adjacent images of the encoded image; quantization; general string prediction ; Palette coding; Dictionary coding; Hybrid coding Hybrid coding; Entropy coding.

Optionally, this embodiment further includes: including the first flag bit in one of the following parts of the video data compression code stream: sequence parameter set, image parameter set, sequence header, slice header, image header, CTU header, CU header, encoding A block header, wherein the first flag bit is used to indicate that multiple sampling formats and/or corresponding coding methods are allowed to be used for coding.

Optionally, this embodiment further includes: including a second flag bit in at least one of the following parts of the video data compression code stream: a sequence parameter set, an image parameter set, a sequence header, a slice header, an image header, and a coded block header, wherein, the first The two flag bits are used to indicate that a coding block that adopts the 4:4:4 sampling format and/or the corresponding string predictive coding method is allowed to be used.

Optionally, this embodiment further includes: including a third flag in at least one of the following parts of the video data compression code stream: a sequence parameter set, an image parameter set, a sequence header, a slice header, an image header, and a coded block header, wherein, the first The three flags are used to indicate that a coding block using the 4:2:2 sampling format and/or the corresponding string predictive coding method is allowed.

Optionally, one of the predetermined multiple sampling formats and coding methods corresponds to a predetermined value k, and a direct or indirect or direct-indirect mixed sampling format and corresponding coding method identification code are set for the coding block , including the encoding mode identification code in the video data compression code stream.

Optionally, the direct sampling format and the corresponding encoding mode identification code are composed of one or more bit strings in the video data compression code stream; the indirect sampling format and corresponding encoding mode identification code are in addition to the selected encoding mode parameters other encoding parameters and/or the sampling format and corresponding encoding mode identification code derived from other syntax elements of the video data compression code stream except for the syntax element; the direct and indirect mixed sampling format and corresponding encoding mode identification code are partly direct and partly indirect Mixed sampling formats and corresponding encoding method identifiers.

Optionally, the identification code of the sampling format and the corresponding encoding mode exists in the video data compression code stream in the following ways: encoding block header information syntax element, sampling format and corresponding encoding mode identification code syntax element, additional encoding block header information syntax element, Coding block data syntax elements; or coding block header information syntax elements, part of the sampling format and corresponding coding method identification code syntax elements, additional coding block header information syntax elements, part of coding block data syntax elements, another part of sampling format and corresponding coding method identification code Syntax element, another part of coding block data syntax element; among them, when the value of the identification code of the identification code syntax element is equal to the specified value, it means that the coding block is encoded using the sampling format and corresponding coding method corresponding to the specified value.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on such an understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products are stored in a storage medium (such as ROM/RAM, disk, CD) contains several instructions to enable a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in various embodiments of the present invention.

Example 2

This embodiment also provides a video data compression decoding device and a video data encoding device, which are used to implement the above embodiments and preferred implementation modes, and those that have already been described will not be repeated. As used below, the term "module" may be a combination of software and/or hardware that realizes a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementations in hardware, or a combination of software and hardware are also possible and contemplated.

Fig. 3 is a structural block diagram of a decoding device for video data compression code stream according to an embodiment of the present invention. As shown in Fig. 3, the device includes:

An analysis module 30, configured to analyze the compressed video data stream, and obtain sampling format information and/or decoding method information;

A selection module 32, configured to select a first sampling format and a decoding method corresponding to the first sampling format among predetermined multiple sampling formats and decoding methods according to the sampling format information and/or decoding method information;

The decoding module 34 is configured to decode the decoded block by using the first sampling format and the corresponding decoding manner of the first sampling format.

Fig. 4 is a structural block diagram of a device for encoding video data according to an embodiment of the present invention. As shown in Fig. 4, the device includes:

A selection module 40, configured to select a first sampling format from a plurality of predetermined sampling formats, and select an encoding method corresponding to the first sampling format from among a plurality of predetermined encoding methods;

The encoding module 42 is configured to use the selected first sampling format and the selected encoding method to encode the encoding block of the video data to generate a video data compression code stream, wherein the video data compression code stream includes: the first sampling format and/or encoding mode, a syntax element corresponding to the first sampling format and/or encoding mode.

It should be noted that the above-mentioned modules can be realized by software or hardware. For the latter, it can be realized by the following methods, but not limited to this: the above-mentioned modules are all located in the same processor; or, the above-mentioned modules can be combined in any combination The forms of are located in different processors.

Example 3

This embodiment is an optional embodiment of the present invention, and is used to supplement and describe in detail the schemes of multiple applications:

In order to solve this problem in the compression of data sets mixed with contents of various characteristics, this embodiment provides a data compression method using multiple (i.e. two or more) sampling formats and corresponding encoding methods And device: there are K (K>1) versions of data sets and codec blocks with K different sampling formats, correspondingly there are K sets of codec methods; when encoding and decoding a codec block, select all One of the above K versions uses a corresponding codec method for codec.

The primary technical feature of this embodiment is to use one of multiple sampling formats (that is, multiple data versions with different sampling formats) and corresponding encoding and decoding methods to encode and decode a codec block.

Preferably, one codec block is coded by using one of two sampling formats and corresponding codec methods.

Preferably, the dataset and its elements consist of 3 components.

Preferably, the data set is an image with a rectangular shape.

Preferably, the data set is a sequence of images having a rectangular shape.

Preferably, the data set is an image consisting of 3 components.

Preferably, the data set is an image sequence consisting of 3 components.

Preferably, the dataset is a video consisting of 3 components.

Preferably, the data set is an image composed of R component, G component and B component.

Preferably, the data set is a video composed of R component, G component and B component.

Preferably, the data set is an image composed of a Y luma component, a U chrominance component, and a V chrominance component.

In this embodiment, preferably, the data set is a video composed of a Y luminance component, a U chrominance component, and a V chrominance component.

In this embodiment, preferably, the two sampling formats are 4:4:4 sampling format and 4:2:0 sampling format.

In this embodiment, preferably, the two sampling formats are 4:4:4 sampling format and 4:2:2 sampling format.

In this embodiment, preferably, the two sampling formats are 4:2:0 sampling format and 4:2:2 sampling format.

In this embodiment, preferably, one of the multiple sampling formats is a main sampling format, and the other sampling formats are sampling formats obtained through a downsampling operation on the main sampling format.

In this embodiment, preferably, the data version of one sampling format generated during encoding and decoding is converted into a data version of another sampling format through a sampling format conversion operation.

In this embodiment, preferably, the sampling format conversion operation includes a resampling operation and/or an upsampling operation and/or a downsampling operation.

In this embodiment, preferably, the codec mode corresponding to one sampling format includes a block prediction operation and/or transformation operation; the codec mode corresponding to another sampling format includes a string prediction operation.

In this embodiment, preferably, the data set is an image with a rectangular shape, and the codec method corresponding to a sampling format includes an operation of intra-frame prediction from adjacent pixels of the current codec block, and/or a transformation operation; and Another codec method corresponding to the sampling format may include a string prediction operation.

In this embodiment, preferably, the data set is a sequence of images with a rectangular shape, and the codec method corresponding to a sampling format includes the operation of intra-frame prediction from adjacent pixels of the current codec block, and/or from the current Inter prediction operations and/or transformation operations are performed on adjacent images of codec images; codec methods corresponding to another sampling format may include string prediction operations.

In this embodiment, preferably, the data set is a sequence of images with a rectangular shape, and the codec method corresponding to the 4:2:0 sampling format includes an operation of performing intra prediction from adjacent pixels of the current codec block, and/or Or perform an inter-frame prediction operation from adjacent images of the current codec image, and/or a transformation operation; the codec mode corresponding to the 4:4:4 sampling format may include a string prediction operation.

In this embodiment, preferably, the data set is a sequence of images with a rectangular shape, and the codec method corresponding to the 4:2:0 sampling format includes an operation of performing intra prediction from adjacent pixels of the current codec block, and/or Or the operation of inter-frame prediction from the adjacent image of the current codec image, and/or the transformation operation, the data version of the 4:2:0 sampling format generated is converted to the data version of the 4:4:4 sampling format by upsampling operation ; The codec method corresponding to the 4:4:4 sampling format may include a string prediction operation, and the generated data version in the 4:4:4 sampling format is converted into a data version in the 4:2:0 sampling format through a downsampling operation.

The most basic unique technical feature of the encoding method or device in this embodiment is to adaptively adopt one of a plurality of predetermined sampling formats and corresponding encoding methods to encode the current encoding block according to the characteristics of the current encoding block, and generate at least A compressed data stream containing the sampling format and/or the identification code information corresponding to the encoding method of the sampling format and other corresponding information required for decoding.

Fig. 5 is a schematic diagram of the encoding method of this embodiment. Preferably, one coding block is coded using one of two sampling formats and corresponding coding methods. Preferably, the dataset and its elements consist of 3 components. Preferably, the data set is an image with a rectangular shape. Preferably, the data set is a sequence of images having a rectangular shape. Preferably, the data set is an image consisting of 3 components. Preferably, the data set is an image sequence consisting of 3 components. Preferably, the dataset is a video consisting of 3 components. Preferably, the data set is an image composed of R component, G component and B component. Preferably, the data set is a video composed of R component, G component and B component. Preferably, the data set is an image composed of a Y luma component, a U chrominance component, and a V chrominance component. Preferably, the data set is a video composed of a Y luma component, a U chrominance component, and a V chrominance component. Preferably, the two sampling formats are a 4:4:4 sampling format and a 4:2:0 sampling format. Preferably, the two sampling formats are a 4:4:4 sampling format and a 4:2:2 sampling format. Preferably, the two sampling formats are a 4:2:0 sampling format and a 4:2:2 sampling format. Preferably, one of the multiple sampling formats is a main sampling format, and the other sampling formats are sampling formats obtained by downsampling the main sampling format. Preferably, the data version of one sampling format generated during encoding is converted into a data version of another sampling format through a sampling format conversion operation. Preferably, the sampling format conversion operation includes a resampling operation and/or an upsampling operation and/or a downsampling operation. Preferably, the coding method corresponding to one sampling format includes block prediction operation and/or transformation operation; the coding method corresponding to another sampling format includes string prediction operation. Preferably, the data set is an image with a rectangular shape, and the encoding method corresponding to one sampling format includes the operation of intra-frame prediction from adjacent pixels of the current encoding block, and/or transformation operation; the encoding method corresponding to another sampling format The coding scheme includes a string prediction operation. Preferably, the data set is an image sequence with a rectangular shape, and the encoding method corresponding to a sampling format includes an operation of performing intra-frame prediction from adjacent pixels of the current encoding block, and/or performing inter-frame prediction from adjacent images of the current encoding image. The operation of prediction, and/or transformation operation; the encoding method corresponding to another sampling format includes a string prediction operation. Preferably, the data set is a sequence of images with a rectangular shape, and the encoding method corresponding to the 4:2:0 sampling format includes the operation of intra-frame prediction from adjacent pixels of the current encoding block, and/or from the adjacent images of the current encoding image An inter-frame prediction operation, and/or a transformation operation; the coding mode corresponding to the 4:4:4 sampling format includes a string prediction operation. Preferably, the data set is a sequence of images with a rectangular shape, and the encoding method corresponding to the 4:2:0 sampling format includes the operation of intra-frame prediction from adjacent pixels of the current encoding block, and/or from the adjacent images of the current encoding image The operation of inter-frame prediction, and/or transformation operation, the data version of the 4:2:0 sampling format generated by the upsampling operation is converted to the data version of the 4:4:4 sampling format; and the 4:4:4 sampling format The corresponding encoding method includes a string prediction operation, and the generated data version in the 4:4:4 sampling format is converted into a data version in the 4:2:0 sampling format through a downsampling operation.

The most basic unique technical feature of the decoding method or device of this embodiment is to analyze the compressed data stream, obtain the information of the sampling format and/or the corresponding encoding method, and use the predetermined information according to the sampling format and/or the corresponding encoding method One of multiple sampling formats and corresponding decoding methods decodes a current decoding block.

Fig. 6 is a schematic diagram of the decoding method in this embodiment. Preferably, one decoding block is decoded using one of two sampling formats and corresponding decoding methods. Preferably, the dataset and its elements consist of 3 components. Preferably, the data set is an image with a rectangular shape. Preferably, the data set is a sequence of images having a rectangular shape. Preferably, the data set is an image consisting of 3 components. Preferably, the data set is an image sequence consisting of 3 components. Preferably, the dataset is a video consisting of 3 components. Preferably, the data set is an image composed of R component, G component and B component. Preferably, the data set is a video composed of R component, G component and B component. Preferably, the data set is an image composed of a Y luma component, a U chrominance component, and a V chrominance component. Preferably, the data set is a video composed of a Y luma component, a U chrominance component, and a V chrominance component. Preferably, the two sampling formats are a 4:4:4 sampling format and a 4:2:0 sampling format. Preferably, the two sampling formats are a 4:4:4 sampling format and a 4:2:2 sampling format. Preferably, the two sampling formats are a 4:2:0 sampling format and a 4:2:2 sampling format. Preferably, one of the multiple sampling formats is a main sampling format, and the other sampling formats are sampling formats obtained by downsampling the main sampling format. Preferably, the data version in one sampling format generated during decoding is converted into a data version in another sampling format through a sampling format conversion operation. Preferably, the sampling format conversion operation includes a resampling operation and/or an upsampling operation and/or a downsampling operation. Preferably, the decoding method corresponding to one sampling format includes block prediction operation and/or transformation operation; the decoding method corresponding to another sampling format includes string prediction operation. Preferably, the data set is an image with a rectangular shape, and the decoding method corresponding to one sampling format includes the operation of intra-frame prediction from adjacent pixels of the current decoding block, and/or transformation operation; the decoding method corresponding to another sampling format The decoding method includes a string prediction operation. Preferably, the data set is an image sequence with a rectangular shape, and the decoding method corresponding to a sampling format includes an operation of intra-frame prediction from adjacent pixels of the currently decoded block, and/or inter-frame prediction from adjacent images of the currently decoded image Predictive operations, and/or transformation operations; decoding methods corresponding to another sampling format include string prediction operations. Preferably, the data set is a sequence of images with a rectangular shape, and the decoding method corresponding to the 4:2:0 sampling format includes an operation of intra-frame prediction from adjacent pixels of the currently decoded block, and/or from adjacent images of the currently decoded image Perform inter-frame prediction operations and/or transform operations; decoding methods corresponding to the 4:4:4 sampling format include string prediction operations. Preferably, the data set is a sequence of images with a rectangular shape, and the decoding method corresponding to the 4:2:0 sampling format includes an operation of intra-frame prediction from adjacent pixels of the currently decoded block, and/or from adjacent images of the currently decoded image The operation of inter-frame prediction, and/or transformation operation, the data version of the 4:2:0 sampling format generated by the upsampling operation is converted to the data version of the 4:4:4 sampling format; and the 4:4:4 sampling format The corresponding decoding method includes a string prediction operation, and the generated data version in the 4:4:4 sampling format is converted into a data version in the 4:2:0 sampling format through a downsampling operation.

According to an aspect of this embodiment, there is provided a coding method or device for compressing data, at least including steps or modules for completing the following functions and operations:

Adaptively select a sampling format and a corresponding coding method among a plurality of predetermined sampling formats and corresponding coding methods to encode a coding block, and generate at least information about the sampling format and/or corresponding coding methods and syntax elements thereof Compressed data stream.

This embodiment also provides a decoding method or device for compressing data, which at least includes steps or modules for completing the following functions and operations: parsing the compressed data stream, obtaining information about the sampling format and/or corresponding encoding methods, and according to the The information about the sampling format and/or the corresponding encoding method is used to decode a decoding block by using one sampling format and corresponding decoding method among the predetermined multiple sampling formats and corresponding decoding methods.

This embodiment is applicable to data encoding and decoding with lossy compression, and this embodiment is also applicable to data encoding and decoding with lossless compression. This embodiment is applicable to encoding and decoding of one-dimensional data such as character string data or byte string data, and this embodiment is also applicable to encoding and decoding of two-dimensional or more data such as image or video data.

In this embodiment, the data includes one or a combination of the following types of data: one-dimensional data; two-dimensional data; multi-dimensional data; image; image sequence; video; audio; file; byte; bit; pixel.

In this embodiment, when the data is an image, a sequence of images, video, etc., the coding block or decoding block is a coding area or a decoding area of the image, including the following situations: sub-images, macroblocks, and largest coding units of the image LCU, coding tree unit CTU, coding unit CU, sub-region of CU, prediction unit PU, transformation unit TU.

In this embodiment, the sampling format is one of the following sampling formats:

4:4:4 sampling format;

or

4:2:2 sampling format;

or

4:2:0 sampling format.

In this embodiment, the codec method includes one or a combination of the following operations:

1) Perform intra-frame prediction from adjacent pixels of the current codec block;

2) Perform inter-frame prediction from adjacent images of the current codec image;

3) Transformation and corresponding inverse transformation;

4) Quantization and corresponding dequantization;

5) Universal string prediction;

6) palette encoding and corresponding decoding;

7) Dictionary encoding and corresponding decoding;

8) Hybrid coding;

9) Entropy coding and corresponding entropy decoding.

The following are more implementation details or variants of this embodiment, including multiple examples.

Example 1

In the encoding method or device or decoding method or device, the multiple sampling formats are one of the following situations:

Two sampling formats;

or

Three sampling formats;

or

Four sampling formats.

Example 2

In the encoding method or device or decoding method or device, the data is one of the following types of data.

Data consisting of 3 components;

or

an image with a rectangular shape;

or

a sequence of images with a rectangular shape;

or

An image consisting of 3 components;

or

An image sequence consisting of 3 components;

or

A video consisting of 3 components;

or

An image composed of R component, G component, and B component;

or

An image sequence composed of R component, G component, and B component;

or

A video composed of R component, G component, and B component;

or

Image composed of Y luma component, U chroma component, V chroma component;

or

An image sequence composed of Y luma component, U chrominance component, and V chrominance component;

or

Video composed of Y luma component, U chroma component, V chroma component;

or

A codec block of the above various data;

or

Variants of the above various data, including variant data that have undergone one or a combination of the following operations: predicted prediction residuals, transformed transform domain data, difference data after difference operations, quantized quantized data, Inversely quantized data, inversely transformed data, deblocking filtered data, sample offset compensated data, and adaptive correction filtered data.

Example 3

In the encoding method or device or the decoding method or device, the data is an image composed of three components, the multiple sampling formats are two sampling formats, and the two sampling formats are one of the following situations:

4:4:4 sampling format and 4:2:0 sampling format;

or

4:4:4 sampling format and 4:2:2 sampling format;

or

4:2:0 sampling format and 4:2:2 sampling format.

Example 4

In the encoding method or device or decoding method or device, one of the multiple sampling formats is a main sampling format, and the other sampling formats are sampling formats obtained by downsampling the main sampling format.

Example 5

In the encoding method or device or the decoding method or device, a data version of a sampling format generated during encoding and decoding is converted into a data version of another sampling format through a sampling format conversion operation.

Example 6

In the encoding method or device or decoding method or device described in Example 5, the sampling format conversion operation includes a resampling operation and/or an upsampling operation and/or a downsampling operation.

Example 7

In the encoding method or device or decoding method or device, the codec method corresponding to one sampling format includes block prediction operation and/or transformation operation; the codec method corresponding to another sampling format includes string prediction operation.

Example 8

In the encoding method or device or the decoding method or device, the data is an image having a rectangular shape, and a codec method corresponding to a sampling format includes an operation of intra-frame prediction from adjacent pixels of the current codec block, and /or transform operation; the codec mode corresponding to another sampling format includes string prediction operation.

Example 9

In the encoding method or device or the decoding method or device, the data is a sequence of images having a rectangular shape, and a codec method corresponding to a sampling format includes intra-frame prediction from adjacent pixels of the current codec block , and/or the operation of performing inter-frame prediction from the neighboring images of the current codec image, and/or the transformation operation; the codec method corresponding to another sampling format includes the string prediction operation.

Example 10

In the encoding method or device or the decoding method or device, the data is a sequence of images with a rectangular shape and 3 components, and the multiple sampling formats are two sampling formats, and the two sampling formats are 4: 4:4 sampling format and 4:2:0 sampling format, the codec method corresponding to the 4:2:0 sampling format includes the operation of performing intra prediction from the adjacent pixels of the current codec block, and/or from the current Inter-frame prediction and/or transform operations are performed on adjacent images of codec images; the codec modes corresponding to the 4:4:4 sampling format include string prediction operations.

Example 11

In the encoding method or device or decoding method or device, the data is an image or sequence of images having a rectangular shape and three components, and the multiple sampling formats are two sampling formats, and the two sampling formats are 4:4:4 sampling format and 4:2:0 sampling format, the codec method corresponding to the 4:2:0 sampling format includes the operation of performing intra prediction from adjacent pixels of the current codec block, and/or The inter-frame prediction operation and/or transformation operation is performed from the adjacent image of the current codec image, and the data version of the 4:2:0 sampling format generated is converted into a data version of the 4:4:4 sampling format through an upsampling operation; The codec method corresponding to the 4:4:4 sampling format includes a string prediction operation, and the generated data version in the 4:4:4 sampling format is converted into a data version in the 4:2:0 sampling format through a downsampling operation.

Example 12

In the encoding method or device or decoding method or device, the data is an image or sequence of images having a rectangular shape and three components, and the multiple sampling formats are two sampling formats, and the two sampling formats are 4:4:4 sampling format and 4:2:0 sampling format, the codec method corresponding to the 4:2:0 sampling format includes the operation of performing intra prediction from adjacent pixels of the current codec block, and/or The operation of performing inter-frame prediction from the adjacent image of the current codec image, and/or the transformation operation, the D component D420={D420[i][j]:i=0 of the data version of the 4:2:0 sampling format generated ~M-1, j=0~N-1} and E component E420={E420[i][j]: i=0~M-1, j=0~N-1}, respectively undergo the following upsampling operations D component D444 = {D444[i][j]: i = 0 ~ 2M-1, j = 0 ~ 2N-1} and E component E444 = {E444[ i][j]: i=0～2M-1, j=0～2N-1}:

D444[2i][2j]=D420[i][j]

D444[2i+1][2j]=D420[i][j]

D444[2i][2j+1]=D420[i][j]

D444[2i+1][2j+1]=D420[i][j]

E444[2i][2j]=E420[i][j]

E444[2i+1][2j]=E420[i][j]

E444[2i][2j+1]=E420[i][j]

E444[2i+1][2j+1]=E420[i][j]

Wherein, i=0～M-1, j=0～N-1; the codec method corresponding to the 4:4:4 sampling format includes a string prediction operation, and the generated data version of the 4:4:4 sampling format D component D444={D444[i][j]: i=0~2M-1, j=0~2N-1} and E component E444={E444[i][j]: i=0~2M- 1, j=0～2N-1}, after the following down-sampling operations, the D components of the data version converted into 4:2:0 sampling format D420={D420[i][j]: i=0～M-1 , j=0～N-1} and E component E420={E420[i][j]: i=0～M-1, j=0～N-1}:

D420[i][j]=(D444[2i][2j]+D444[2i+1][2j]+D444[2i][2j+1]+D444[2i+1][2j+1]+R )>>2

E420[i][j]=(E444[2i][2j]+E444[2i+1][2j]+E444[2i][2j+1]+E444[2i+1][2j+1]+R )>>2

Wherein, i=0˜M−1, j=0˜N−1, R is equal to 0 (truncation method) or 2 (rounding method).

Example 13

In the encoding method or device or decoding method or device, there is a flag bit indicating that multiple sampling formats and/or corresponding codec methods are allowed to be used for encoding and decoding in one or several of the following places of the video data compression code stream :

1) sequence parameter set; usually a syntax element that is directly present or implicitly derived from a sequence parameter set;

2) Image parameter set; usually a directly existing or implicitly derived syntax element of the image parameter set;

3) sequence header; usually a directly present or implicitly derived syntax element of the sequence header;

4) Slice header; usually a directly present or implicitly derived syntax element of the slice header;

5) Image header; usually a directly existing or implicitly derived syntax element of the image header;

6) CTU header; usually a directly existing or implicitly derived syntax element of the CTU header;

7) CU header; usually a directly existing or implicitly derived syntax element of the CU header;

8) Codec block header; usually a directly existing or implicitly derived syntax element of the codec block header.

Example 14

In the encoding method or device or decoding method or device, one or several of the following places in the video data compression code stream indicates that it is allowed to use the 4:4:4 sampling format and/or the corresponding string prediction codec method The flag bits of the codec block:

1) sequence parameter set; usually a syntax element that is directly present or implicitly derived from a sequence parameter set;

2) Image parameter set; usually a directly existing or implicitly derived syntax element of the image parameter set;

3) sequence header; usually a directly present or implicitly derived syntax element of the sequence header;

3) Slice header; usually a directly present or implicitly derived syntax element of the slice header;

3) Image header; usually a directly present or implicitly derived syntax element of the image header.

Example 15

In the encoding method or device or the decoding method or device, the predetermined plurality of sampling formats and corresponding codec methods are respectively represented by a plurality of predetermined values, and one sampling format and corresponding codec methods correspond to a predetermined value k, each codec block has a direct or indirect or direct-indirect mixed sampling format and corresponding codec identification code in the video data compression code stream,

If the sampling format and the corresponding codec identification code are equal to k, then

{

Encode and decode the codec block by using a sampling format corresponding to k and a corresponding codec method

}

The direct sampling format and the corresponding codec identification code are composed of one or more bit strings (binary symbol strings) in the video data compression code stream. The indirect sampling format and corresponding codec identification code are sampling formats and corresponding codec identification codes derived from other codec parameters and/or other syntax elements of the video data compression code stream. The direct-indirect mixed sampling format and the corresponding codec mode identification code are partly direct (that is, composed of one or more bit strings in the video data compression code stream) and partly indirect (that is, obtained from other codec parameters and/or video derived from other syntax elements of the data compression code stream) mixed sampling format and corresponding codec identification code.

Example 16

In the encoding method or device or the decoding method or device, the sampling format used to represent the codec block and the corresponding codec mode and the corresponding codec mode identification code syntax elements exist in the codec in the following form In the video data compression code stream of the block:

Codec block header information syntax elements, sampling format and corresponding codec mode identification code syntax elements, more codec block header information syntax elements, codec block data syntax elements;

or

Codec block header information syntax elements, some sampling formats and corresponding codec mode identifier syntax elements, more codec block header information syntax elements, part of codec block data syntax elements, another part of sampling format and corresponding codec mode identifier syntax elements element, another part of codec block data syntax element;

Wherein, when the sampling format and the corresponding encoding and decoding mode identification code take one value, the encoding and decoding block is encoded and decoded using the sampling format and corresponding encoding and decoding mode corresponding to the value.

Example 17

In the encoding method or device or the decoding method or device, the codec method corresponding to a sampling format includes a prediction operation, and/or a prediction compensation operation, and/or a deblocking filtering operation, and/or a sample offset Compensation operation, and/or adaptive correction filtering operation; codec method corresponding to another sampling format includes transformation operation, and/or quantization operation, and/or inverse quantization operation (scaling operation), and/or inverse transformation operate.

Example 18

In the encoding method or device or decoding method or device, the codec method corresponding to one sampling format includes block prediction operation, and/or string prediction operation, and/or prediction compensation operation; The codec mode includes transform operation, and/or quantization operation, and/or inverse quantization operation, and/or inverse transform operation.

Example 4

The embodiment of the invention also provides a storage medium. Optionally, in this embodiment, the above-mentioned storage medium may be configured to store program codes for performing the following steps:

S1, analyzing the compressed code stream of the video data, obtaining sampling format information and/or decoding method information;

S2. Select a first sampling format and a decoding mode corresponding to the first sampling format among predetermined multiple sampling formats and decoding modes according to the sampling format information and/or decoding mode information;

S3. Decode the decoded block by using the first sampling format and a decoding manner corresponding to the first sampling format.

Optionally, in this embodiment, the above-mentioned storage medium may include but not limited to: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk Various media that can store program codes such as discs or optical discs.

Optionally, in this embodiment, the processor executes and parses the compressed video data stream according to the program code stored in the storage medium, and obtains sampling format information and/or decoding mode information;

Optionally, in this embodiment, the processor executes according to the program code stored in the storage medium, and according to the sampling format information and/or decoding mode information, selects the second sampling format and decoding mode among predetermined multiple sampling formats and decoding modes. a sampling format and a decoding method corresponding to the first sampling format;

Optionally, in this embodiment, the processor executes, according to the program code stored in the storage medium, to decode the decoded block by using the first sampling format and a decoding manner corresponding to the first sampling format.

Optionally, for specific examples in this embodiment, reference may be made to the examples described in the foregoing embodiments and optional implementation manners, and details are not repeated in this embodiment.

Obviously, those skilled in the art should understand that each module or each step of the present invention described above can be realized by a general-purpose computing device, and they can be concentrated on a single computing device, or distributed in a network formed by multiple computing devices Alternatively, they may be implemented in program code executable by a computing device so that they may be stored in a storage device to be executed by a computing device, and in some cases in an order different from that shown here The steps shown or described are carried out, or they are separately fabricated into individual integrated circuit modules, or multiple modules or steps among them are fabricated into a single integrated circuit module for implementation. As such, the present invention is not limited to any specific combination of hardware and software.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (30)

1. A method for decoding a compressed bitstream of video data, comprising:

analyzing the compressed code stream of the video data to obtain sampling format information and/or decoding mode information;

selecting a first sampling format and a decoding mode corresponding to the first sampling format from a plurality of preset sampling formats and decoding modes according to the sampling format information and/or the decoding mode information;

decoding the decoding block by adopting the first sampling format and a decoding mode corresponding to the first sampling format;

wherein, one sampling format and decoding mode of the preset multiple sampling formats and decoding modes corresponds to a preset value k, and a sampling format and a corresponding decoding mode identification code which are directly or indirectly or directly and indirectly mixed are obtained for the decoding block from the video data compressed code stream;

Wherein the direct sampling format and the corresponding decoding mode identification code are composed of one or more bit strings in the video data compression code stream; the indirect sampling format and the corresponding decoding mode identification code are sampling formats and corresponding decoding mode identification codes derived from other decoding parameters except the decoding mode parameters and/or other syntax elements of the video data compression code stream except the syntax elements corresponding to the decoding mode parameters; the direct-indirect mixed sampling format and the corresponding decoding mode identification code are partial direct-partial indirect mixed sampling format and the corresponding decoding mode identification code.

2. The method of claim 1, wherein the video data compression stream comprises a data compression stream of information of at least one of:

one-dimensional data, two-dimensional data, a sequence of images, video, audio, files, bytes, bits, pixels, data composed of three components, an image having a rectangular shape, a sequence of images having a rectangular shape, an image composed of three components, an image sequence composed of three components, a video composed of three components, an image sequence composed of R components, G components, B components, a video composed of R components, G components, B components, an image composed of one luminance component and two chrominance components, an image sequence composed of one luminance component and two chrominance components, a video composed of one luminance component and two chrominance components, and encoded blocks of data.

3. The method of claim 1, wherein the decoded block is a decoded region of an image, wherein the decoded region comprises at least one of: sub-pictures of a picture, macro-blocks, largest coding units LCU, coding tree units CTU, coding units CU, sub-regions of a CU, prediction units PU, transform units TU.

4. The method of claim 1, wherein the plurality of sampling formats includes a main sampling format and other sampling formats, wherein the other sampling formats are sampling formats obtained by sampling operations of the main sampling format.

5. The method according to claim 1, wherein the video data compression stream has a rectangular shape and a data compression stream of three component images or sequences of images.

6. The method of claim 1, wherein the plurality of sampling formats are a 4:4:4 sampling format and a 4:2:0 sampling format; alternatively, the plurality of sampling formats are a 4:4:4 sampling format and a 4:2:2 sampling format; alternatively, the plurality of sampling formats are a 4:2:2 sampling format and a 4:2:0 sampling format.

7. The method of claim 6, wherein the step of providing the first layer comprises,

The decoding mode corresponding to the 4:2:0 sampling format comprises the following steps: generating a data version in a 4:2:0 sampling format, and converting the data version in the 4:2:0 sampling format into the data version in the 4:4:4 or 4:2:2 sampling format through an up-sampling operation, wherein the method for generating the data version in the 4:2:0 sampling format comprises the following steps: generating a data version in a 4:2:0 sampling format according to an operation of intra-predicting neighboring pixels of the decoding block, and/or generating a data version in a 4:2:0 sampling format according to an operation of inter-predicting neighboring images of the decoding image;

the decoding mode corresponding to the 4:4:4 or 4:2:2 sampling format comprises the following steps: generating a data version in a 4:4:4 or 4:2:2 sampling format according to a prediction operation, and converting the data version in the 4:4:4 or 4:2:2 sampling format into the data version in a 4:2:0 sampling format through a downsampling operation.

8. The method of claim 7, wherein the decoding means comprises at least one of: performing intra prediction according to adjacent pixels of the decoding block; inter-prediction from neighboring pictures of the decoded picture; transforming; scaling; universal string prediction; decoding a palette; dictionary decoding; and (5) entropy decoding.

9. The method as recited in claim 1, further comprising: analyzing the compressed code stream of the video data, and obtaining a first zone bit from one of the following positions: the video decoder comprises a sequence parameter set, a picture parameter set, a sequence header, a strip header, a picture header, a CTU header, a CU header and a decoding block header, wherein the first flag bit is used for indicating that decoding is allowed to be performed by adopting a plurality of sampling formats and/or corresponding decoding modes.

10. The method as recited in claim 1, further comprising: analyzing the video data compressed code stream, and acquiring a second zone bit from at least one of the following positions: a sequence parameter set, an image parameter set, a sequence header, a stripe header, an image header, and a decoding block header, wherein the second flag bit is used for indicating that the decoding block adopting a 4:4:4 sampling format and/or a corresponding string prediction decoding mode is allowed to be used.

11. The method as recited in claim 1, further comprising: analyzing the video data compressed code stream, and acquiring a third zone bit from at least one of the following positions: a sequence parameter set, an image parameter set, a sequence header, a stripe header, an image header, and a decoding block header, wherein the third flag bit is used for indicating that the decoding block adopting the 4:2:2 sampling format and/or the corresponding string prediction decoding mode is allowed to be used.

12. The method of claim 1, wherein the sampling format and the identification code corresponding to the decoding mode are obtained from the following positions of the compressed stream of video data:

the decoding block header information syntax element, the sampling format, the corresponding decoding mode identification code syntax element, the additional decoding block header information syntax element and the decoding block data syntax element; or (b)

The decoding block header information syntax element, the partial sampling format and corresponding decoding mode identification code syntax element, the additional decoding block header information syntax element, the partial decoding block data syntax element, the other partial sampling format and corresponding decoding mode identification code syntax element, the other partial decoding block data syntax element;

and when the value of the identification code syntax element is equal to a specified value, decoding the decoding block by adopting a sampling format corresponding to the specified value and a corresponding decoding mode.

13. The method of claim 7, wherein the prediction operation comprises a string prediction operation.

14. A method of encoding video data, comprising:

selecting a first sampling format from a predetermined plurality of sampling formats, and selecting a coding mode corresponding to the first sampling format from a predetermined plurality of coding modes;

Encoding the encoded blocks of video data using the selected first sampling format and the selected encoding scheme to produce a compressed video data stream, wherein the compressed video data stream comprises: a first sampling format and/or coding mode, syntax elements corresponding to the first sampling format and/or coding mode;

wherein, one sampling format and coding mode of the preset multiple sampling formats and coding modes corresponds to a preset value k, a sampling format and a corresponding coding mode identification code which are directly or indirectly or directly and indirectly mixed are set for the coding block, and the coding mode identification code is contained in the video data compression code stream;

wherein the direct sampling format and the corresponding coding mode identification code are composed of one or more bit strings in the video data compression code stream; the indirect sampling format and the corresponding coding mode identification code are sampling formats and corresponding coding mode identification codes derived from other coding parameters except the selected coding mode parameters and/or other syntax elements except the syntax elements of the video data compression code stream; the direct-indirect mixed sampling format and the corresponding coding mode identification code are part of the direct-indirect mixed sampling format and the corresponding coding mode identification code.

15. The method of claim 14, wherein the video data comprises at least one of:

one-dimensional data, two-dimensional data, a sequence of images, video, audio, files, bytes, bits, pixels, data composed of three components, an image having a rectangular shape, a sequence of images having a rectangular shape, an image composed of three components, an image sequence composed of three components, a video composed of three components, an image sequence composed of R components, G components, B components, a video composed of R components, G components, B components, an image composed of one luminance component and two chrominance components, an image sequence composed of one luminance component and two chrominance components, a video composed of one luminance component and two chrominance components, and encoded blocks of data.

16. The method of claim 14, wherein the encoded block is an encoded region of an image, wherein the encoded region comprises at least one of: sub-pictures of a picture, macro-blocks, largest coding units LCU, coding tree units CTU, coding units CU, sub-regions of a CU, prediction units PU, transform units TU.

17. The method of claim 14, wherein the plurality of sampling formats includes a main sampling format and other sampling formats, wherein the other sampling formats are sampling formats obtained by sampling operations of the main sampling format.

18. The method of claim 14, wherein the video data is an image or sequence of images having a rectangular shape and three components.

19. The method of claim 14, wherein the plurality of sampling formats are a 4:4:4 sampling format and a 4:2:0 sampling format; alternatively, the plurality of sampling formats are a 4:4:4 sampling format and a 4:2:2 sampling format; alternatively, the plurality of sampling formats are a 4:2:2 sampling format and a 4:2:0 sampling format.

20. The method of claim 19, wherein the step of determining the position of the probe comprises,

the coding modes corresponding to the 4:2:0 sampling format comprise: generating a data version in a 4:2:0 sampling format, and converting the data version in the 4:2:0 sampling format into the data version in the 4:4:4 or 4:2:2 sampling format through an up-sampling operation, wherein the method for generating the data version in the 4:2:0 sampling format comprises the following steps: generating a data version in a 4:2:0 sampling format according to an operation of intra-predicting neighboring pixels of the encoded block, and/or generating a data version in a 4:2:0 sampling format according to an operation of inter-predicting neighboring images of the encoded image;

The coding modes corresponding to the 4:4:4 or 4:2:2 sampling formats comprise: generating a data version in a 4:4:4 or 4:2:2 sampling format according to a prediction operation, and converting the data version in the 4:4:4 or 4:2:2 sampling format into the data version in a 4:2:0 sampling format through a downsampling operation.

21. The method of claim 20, wherein the encoding means comprises at least one of: performing intra prediction according to adjacent pixels of the coding block; inter-prediction from neighboring pictures of the encoded picture; transforming; quantifying; universal string prediction; palette coding; dictionary coding; hybrid coding; entropy coding.

22. The method as recited in claim 14, further comprising: the video data compression code stream comprises a first flag bit in one of the following parts: the coding method comprises the steps of a sequence parameter set, an image parameter set, a sequence header, a strip header, an image header, a CTU header, a CU header and a coding block header, wherein the first flag bit is used for indicating that coding is allowed to be performed by adopting a plurality of sampling formats and/or corresponding coding modes.

23. The method as recited in claim 14, further comprising: at least one of the following parts of the compressed code stream of the video data comprises a second flag bit: the second flag bit is used for indicating that the coding block adopting a 4:4:4 sampling format and/or a corresponding coding mode is allowed to be used.

24. The method as recited in claim 14, further comprising: the video data compression code stream comprises a third flag bit in at least one of the following parts: the third flag bit is used for indicating that the coding block adopting a 4:2:2 sampling format and/or a corresponding coding mode is allowed to be used.

25. The method of claim 14, wherein the sampling format and the identification code corresponding to the encoding mode are present in the compressed stream of video data using the following modes:

the coding block header information syntax element, the sampling format, the corresponding coding mode identification code syntax element, the additional coding block header information syntax element and the coding block data syntax element; or (b)

The coding block header information syntax element, the partial sampling format and corresponding coding mode identification code syntax element, the additional coding block header information syntax element, the partial coding block data syntax element, the other partial sampling format and corresponding coding mode identification code syntax element and the other partial coding block data syntax element;

and when the value of the identification code syntax element is equal to a specified value, encoding the encoding block by adopting a sampling format corresponding to the specified value and a corresponding encoding mode.

26. The method of claim 22, wherein the prediction operation comprises a string prediction operation.

27. A decoding apparatus for a compressed bitstream of video data, comprising:

the analysis module is used for analyzing the compressed code stream of the video data and acquiring sampling format information and/or decoding mode information;

the selection module is used for selecting a first sampling format and a decoding mode corresponding to the first sampling format from a plurality of preset sampling formats and decoding modes according to the sampling format information and/or the decoding mode information;

the decoding module is used for decoding the decoding block by adopting the first sampling format and a decoding mode corresponding to the first sampling format;

the parsing module is further configured to obtain, from the compressed video data stream, a sampling format and a corresponding decoding mode identification code of direct or indirect or direct-indirect mixture for the decoding block, where one sampling format and decoding mode of the predetermined multiple sampling formats and decoding modes corresponds to a predetermined value k;

the analysis module is further used for directly analyzing the video data compressed code stream according to the sampling format and the corresponding decoding mode identification code, wherein the analysis module is also used for directly analyzing the video data compressed code stream according to the sampling format and the corresponding decoding mode identification code; the indirect sampling format and the corresponding decoding mode identification code are sampling formats and corresponding decoding mode identification codes derived from other decoding parameters except the decoding mode parameters and/or other syntax elements of the video data compression code stream except the syntax elements corresponding to the decoding mode parameters; the direct-indirect mixed sampling format and the corresponding decoding mode identification code are partial direct-partial indirect mixed sampling format and the corresponding decoding mode identification code.

28. An apparatus for encoding video data, comprising:

a selection module, configured to select a first sampling format from a predetermined plurality of sampling formats, and select a coding mode corresponding to the first sampling format from a predetermined plurality of coding modes;

the encoding module is configured to encode an encoded block of video data using the selected first sampling format and the selected encoding mode to generate a compressed video data stream, where the compressed video data stream includes: a first sampling format and/or coding mode, syntax elements corresponding to the first sampling format and/or coding mode;

the selection module is further configured to set a sampling format and a corresponding coding mode identification code of direct or indirect or direct-indirect mixing for the coding block, where one sampling format and coding mode of the predetermined multiple sampling formats and coding modes corresponds to a predetermined value k, and the coding mode identification code is included in the video data compressed code stream;

wherein, the selection module is also used for the direct sampling format and the corresponding coding mode identification code to be composed of one or more bit strings in the video data compression code stream; the indirect sampling format and the corresponding coding mode identification code are sampling formats and corresponding coding mode identification codes derived from other coding parameters except the selected coding mode parameters and/or other syntax elements except the syntax elements of the video data compression code stream; the direct-indirect mixed sampling format and the corresponding coding mode identification code are part of the direct-indirect mixed sampling format and the corresponding coding mode identification code.

29. A computer storage medium having a program recorded thereon, wherein the program is executable by a processor to implement the method of any one of claims 1 to 26.

30. A processor for running a program, wherein the program when run performs the method of any one of claims 1 to 26.

Images