CN106954082A - Video encoding and decoding method, encoding and decoding device and system - Google Patents

Abstract

The invention discloses a video coding method, which comprises: when a sub-region of a frame is a background region, copying an image corresponding to the sub-region from a reference frame of the frame, and encoding the copied image as a sub-region Image. The invention also discloses another video coding method, a video decoding method, a coding device, a decoding device and a codec system. The present invention does not need to encode and decode the background area according to the traditional encoding and decoding method, effectively reduces the complexity of encoding and decoding, reduces time consumption, and improves the efficiency of encoding and decoding.

Description

Video encoding and decoding method, encoding and decoding device and system

technical field

The present invention relates to the field of video codec, in particular to a video codec method and a codec device.

Background technique

In low-latency video communication applications such as video conferencing, video chat, and mobile video, the requirements for user experience are constantly increasing, and the resolution is also increasing, from the original 720p to 1080p and even 4k. Under the limitation of limited bandwidth, the higher the resolution, the higher the requirements for video codec technology, and the existing video codec technology is more and more difficult to meet the needs of video data compression, the codec process is complicated, and consumes The time is getting longer and longer, and the efficiency is lower.

Contents of the invention

The main purpose of the present invention is to provide a video encoding and decoding method and encoding and decoding device, aiming to solve the technical problem of low encoding and decoding efficiency caused by the complicated video encoding and decoding process and the increasingly long time consumed in the prior art.

In order to achieve the above object, a video encoding method provided by the present invention includes:

When the sub-area of the frame is the background area, the image corresponding to the sub-area is copied from the reference frame of the frame, and the copied image is used as the encoded image of the sub-area.

Preferably, the method also includes:

When the sub-area is a background area, a first background identifier is set for the sub-area, and the first background identifier is used to identify the sub-area as a background area in a decoding process.

Preferably, the method also includes:

When the sub-area is a non-background area, traverse the block unit in the sub-area, if the traversed block unit is a background unit, copy the image corresponding to the block unit from the reference frame of the frame , using the copied image as the block-unit encoded image.

Preferably, the method also includes:

If the traversed block unit is a background unit, a second background identifier is set for the block unit, and the second background identifier is used to identify the block unit as a background unit in a decoding process.

To achieve the above object, the present invention also provides a video coding method, the method comprising:

When the sub-area of the frame is a background area, a first background identifier is set for the sub-area, and the first background identifier is used to identify the sub-area as a background area in the decoding process, so that the When the region is decoded, the decoding device copies the image corresponding to the sub-region from the decoding reference frame of the frame, and uses the copied image as the decoded image of the sub-region;

Acquire the encoded image of the sub-region.

Preferably, the acquisition of the encoded image of the sub-region includes:

From the coded reference frame of the frame, the image corresponding to the sub-region is copied as the coded image of the sub-region.

Preferably, the method also includes:

When the sub-area is a non-background area, traverse the block units in the sub-area, if the traversed block unit is a background unit, set a second background identifier for the block unit, the second background identifier The symbol is used to identify the block unit as a background unit in the decoding process, so that when decoding the block unit, the decoding device copies the image corresponding to the block unit from the decoding reference frame of the frame, and The copied image is used as the decoded image of the block unit;

Acquire the encoded image of the block unit.

Preferably, the acquiring the encoded image of the block unit includes:

From the coded reference frame of the frame, copy the image corresponding to the block unit as the coded image of the block unit.

To achieve the above object, the present invention also provides a video decoding method, the method comprising:

When the sub-region of the frame contains the first background identifier, copy the image corresponding to the sub-region from the reference frame of the frame, and use the copied image as the decoded image of the sub-region, the second A background identifier is used to identify the sub-area as a background area.

Preferably, the method also includes:

When the sub-region does not contain the first background identifier, if there is a block unit containing the second background identifier in the sub-region, copy the image corresponding to the block unit from the reference frame of the frame , using the copied image as the decoded image of the block unit, and the second background identifier is used to identify the block unit as a background unit.

To achieve the above object, the present invention also provides an encoding device, comprising:

Copying module, for when the sub-area of the frame is a background area, copy the image corresponding to the sub-area from the reference frame of the frame, and use the copied image as the encoded image of the sub-area .

Preferably, the device also includes:

A first setting module, configured to set a first background identifier for the sub-area when the sub-area is a background area, and the first background identifier is used to identify the sub-area as a background area during decoding .

Preferably, the device also includes:

The traversal and copying module is used to traverse the block units in the sub-area when the sub-area is a non-background area, and if the traversed block unit is a background unit, copy the reference frame of the frame with the The image corresponding to the block unit is selected, and the copied image is used as the encoded image of the block unit.

Preferably, the device also includes:

The second setting module is used to set a second background identifier for the block unit if the traversed block unit is a background unit, and the second background identifier is used to identify the block unit as a background during the decoding process unit.

In order to achieve the above object, the present invention also provides an encoding device, which includes:

The third setting module is used to set a first background identifier for the sub-area when the sub-area of the frame is a background area, and the first background identifier is used to identify the sub-area as a background area in the decoding process , so that when decoding the sub-region, the decoding device copies the image corresponding to the sub-region from the decoding reference frame of the frame, and uses the copied image as the decoded image of the sub-region;

The first acquiring module is configured to acquire the coded image of the sub-region.

Preferably, the first obtaining module is specifically configured to copy an image at a position corresponding to the sub-region from the coded reference frame of the frame as the coded image of the sub-region.

Preferably, the device also includes:

The traversal and setting module is used to traverse the block units in the sub-area when the sub-area is a non-background area, and if the traversed block unit is a background unit, set a second background identifier for the block unit , the second context identifier is used to identify the block unit as a background unit during the decoding process, so that when decoding the block unit, the decoding device copies the block from the decoding reference frame of the frame The image corresponding to the position of the unit, and the copied image is used as the decoded image of the block unit;

The second obtaining module is used to obtain the encoded image of the block unit.

Preferably, the second acquiring module is specifically configured to: copy an image corresponding to the block unit from the encoding reference frame of the frame as the encoded image of the block unit.

In order to achieve the above object, the present invention also provides a decoding device, which includes:

The first image copying module is used to copy the image corresponding to the sub-region from the reference frame of the frame when the sub-region of the frame contains the first background identifier, and use the copied image as the sub-region In the decoded image, the first background identifier is used to identify the sub-region as a background region.

Preferably, the device also includes:

The second image copying module is used for copying from the reference frame of the frame and For the image corresponding to the block unit, the copied image is used as the decoded image of the block unit, and the second background identifier is used to identify the block unit as a background unit.

To achieve the above object, the present invention further provides a codec system, comprising: the above-mentioned encoding device and the above-mentioned decoding device.

The present invention provides a video encoding and decoding method and encoding and decoding device, and the beneficial effects that can be realized are:

In the video coding process, when the sub-region of the frame is the background region, the image corresponding to the sub-region is copied from the reference frame of the frame, and the copied image is used as the encoded image of the sub-region, so that no need The sub-region is coded according to the existing coding method, which effectively reduces coding complexity, reduces coding time consumption and improves coding efficiency. And in the video decoding process, when the sub-area of the frame contains the first background identifier that identifies the sub-area as the background area, copy the image corresponding to the sub-area from the reference frame of the frame, and copy the obtained The image is decoded as the sub-region, so that the sub-region does not need to be decoded according to the existing decoding method, effectively reducing the decoding complexity, reducing the time consumed in the decoding process and improving the decoding efficiency.

Description of drawings

FIG. 1 is a schematic flowchart of a video encoding method in a first embodiment of the present invention;

Fig. 2 is a schematic flow chart of the additional steps of the first embodiment shown in Fig. 1;

Fig. 3 is a schematic flow chart of the additional steps of the first embodiment shown in Fig. 1;

Fig. 4 is a schematic flow chart of the additional steps of the embodiment shown in Fig. 3;

FIG. 5 is a schematic flowchart of a video encoding method in a second embodiment of the present invention;

Fig. 6 is a schematic flow chart of the additional steps of the second embodiment shown in Fig. 5;

FIG. 7 is a schematic flowchart of a video decoding method in a third embodiment of the present invention;

Fig. 8 is a schematic flow chart of the additional steps of the third embodiment of the present invention;

FIG. 9 is a schematic diagram of functional modules of an encoding device in a fourth embodiment of the present invention;

FIG. 10 is a schematic diagram of additional functional modules of the fourth embodiment shown in FIG. 9;

FIG. 11 is a schematic diagram of additional functional modules of the fourth embodiment shown in FIG. 9;

Fig. 12 is a schematic diagram of an additional functional module of the embodiment shown in Fig. 11;

FIG. 13 is a schematic diagram of functional modules of an encoding device in a fifth embodiment of the present invention;

Fig. 14 is a schematic diagram of an additional functional module of the embodiment shown in Fig. 13;

FIG. 15 is a schematic diagram of functional modules of a decoding device in a sixth embodiment of the present invention;

Fig. 16 is a schematic diagram of an additional functional module of the embodiment shown in Fig. 15;

Fig. 17 is a schematic diagram of functional modules of the codec system in the sixth embodiment of the present invention.

The realization of the purpose of the present invention, functional characteristics and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

detailed description

It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

The present invention provides a method for video encoding and decoding, which specifically includes a video encoding method and a video decoding method. In the video encoding method, when a sub-area of a frame is a background area, the frame corresponding to the sub-area is copied from the reference frame of the frame. The image of the position, the copied image is used as the sub-region coded image, and the sub-region coded image is obtained by copying the image of the reference frame, so that it is not necessary to obtain the sub-region coded image through the existing coding method, and can Effectively shorten encoding time, reduce encoding complexity, and improve encoding efficiency.

In the video decoding method, when a sub-region of a frame contains a first background identifier that identifies the sub-region as a background region, the image corresponding to the sub-region is copied from the reference frame of the frame, and the obtained image is copied As the decoded image of the sub-region, there is no need to use the existing decoding method to decode the sub-region, which can effectively save the time consumed by decoding, reduce the complexity of decoding, and improve the decoding efficiency.

Among them, the existing coding method refers to performing prediction, transformation, quantization, entropy coding and reconstruction on the frame, and the existing decoding method refers to performing entropy decoding, inverse quantization, inverse transformation, prediction and reconstruction on the frame.

In the embodiment of the present invention, the frame that can use the above codec method is a P frame or a B frame.

Among them, a P frame is a forward predictive coding frame, also known as an inter-frame coding frame. The P frame needs to be generated by referring to the previous I frame or P frame adjacent to it, and it can be another P frame or B frame. reference frame.

Among them, the B frame is a bidirectional predictive coding frame, which is also an inter-frame coding frame. The B frame needs to be generated by referring to the previous I frame or P frame or the subsequent P frame, and the B frame is not used as a reference frame for other frames.

Among them, I frame is a kind of full-frame compression coding frame, also called intra-frame coding frame, so the data volume of I frame is generally relatively large, and I frame does not need to refer to other frames to generate, it can be the reference of P frame or B frame frame.

In the embodiment of the present invention, the P frame and the B frame in a video image are divided into sub-regions according to the same size, for example, they can be divided into 4 sub-regions, and each sub-region is an area that can be independently coded, wherein each Each sub-area is divided into block units according to the same size, for example, it can be divided into 16 block units of the same size. Therefore, for P frame and B frame, they have the same number of sub-areas, and in each frame , the size and number of block units contained in sub-regions at the same position are also the same.

Wherein, the block unit is a codec unit divided into video images, and in the traditional codec process, the process of codec is performed in units of block units. For example, in the High Efficiency Video Coding (High Efficiency Video Coding, HEVC) protocol, the block unit may be an LCU, and in the H.264 protocol, the block unit may be a Macro Block (Macro Block, MB).

Wherein, a sub-area contains multiple block units. For example, a sub-area may be a Slice in the H.264 protocol, and each Slice may be decoded independently, or a sub-area may be a tile in the HEVC protocol.

In order to better understand the technical solutions of video encoding and decoding in the embodiments of the present invention, the video encoding method and the video decoding method in the embodiments of the present invention will be respectively introduced below.

Please refer to FIG. 1, which is a schematic flowchart of a video encoding method in the first embodiment of the present invention, the method includes:

Step 101. When the sub-area of the frame is the background area, copy the image corresponding to the sub-area from the reference frame of the frame, and use the copied image as the encoded image of the sub-area.

In the embodiment of the present invention, the video encoding method is executed by an encoding device, and the encoding device will sequentially encode frames in a video image.

Wherein, when the sub-area of the frame is the background area, the image corresponding to the sub-area is copied from the reference frame of the frame, and the copied image is used as the encoded image of the sub-area.

In the embodiment of the present invention, there are many ways to judge whether a sub-region is a background region. For example, the encoding device will determine the pixel value of each pixel in the sub-region, and determine that the sub-region has the same The pixel value of each pixel in the auxiliary sub-area of the position, and calculate the difference between the pixel value of the pixel in the sub-area and the pixel value of the corresponding pixel in the auxiliary sub-area until the calculated All the differences, and sum the absolute values of all the differences, compare the sum with the preset first value, if the sum is smaller than the preset first value, then determine the sub-region as the background region , if the sum value is greater than or equal to the preset first value, it is determined that the sub-area is a non-background area. That is, it is judged whether the sub-area is the background area or not by the sum of the absolute values of the difference values of the pixels.

Or, for another example: the encoding device determines the pixel value of each pixel in the sub-region, and determines the pixel value of each pixel in the auxiliary sub-region having the same position as the sub-region in the previous frame, and calculates the sub-region in turn. The difference between the pixel value of the pixel point in the area and the pixel value of the pixel point at the corresponding position in the copied sub-region, until all the difference values are calculated, sum all the difference values, and calculate the absolute value of the sum Value, compare the absolute value of the sum with the preset second value, if the absolute value of the sum is smaller than the preset second value, then determine the sub-region as the background region, if the absolute value of the sum is greater than or If it is equal to the preset first value, then the sub-area is determined to be a non-background area. That is, it is judged whether the sub-area is the background area by the absolute value of the sum of the difference values of the pixels.

It should be noted that, in the embodiment of the present invention, the step of copying the image corresponding to the sub-region from the reference frame of the frame is to prevent the "frame" from becoming the reference frame of other frames in the subsequent encoding process , the problem that the image cannot be obtained in the form of copying.

In the video coding process in the embodiment of the present invention, when the sub-region of the frame is the background region, from the reference frame of the frame, copy the image corresponding to the sub-region, and use the copied image as the sub-region encoding The resulting image makes it unnecessary to obtain the encoded graphics of the sub-region according to the existing encoding method, which effectively reduces the complexity of the encoding process, saves encoding time, and improves encoding efficiency.

In the embodiment of the present invention, in order to obtain the decoded image of the sub-region by copying during the decoding process, the encoding device can also set the first background identifier for the sub-region. For ease of understanding, please refer to FIG. 2, It is a schematic flow chart of the additional steps of the first embodiment shown in Figure 1, including:

Step 201. When the sub-region is a background region, set a first background identifier for the sub-region, and the first background identifier is used to identify the sub-region as a background region during decoding.

In the embodiment of the present invention, if the encoding device determines that the sub-area is a background area, it sets a first background identifier for the sub-area. Wherein, the first background identifier is used to identify the sub-area as the background area, and is used to identify the sub-area as the background area during the decoding process. Therefore, in the decoding process, it can be judged whether the sub-area contains the first background The identifier determines whether the subregion is a background region.

Wherein, each sub-area is provided with an identification bit for identifying whether the sub-area is a background area, and when the identification bit is 0, it indicates that the sub-area is a non-background area, and when the identification bit is 1, it indicates that the sub-area is the background area, and before judging whether the sub-area is the background area, the value of the flag is 0. When the encoding device determines that the sub-area is a background area, it can set the value of the identification bit to 1, that is, the operation of setting the first background identifier for the sub-area is completed. And when the encoding device determines that the sub-area is not a background area, it will not operate on the flag. For example, in the HEVC protocol, the above flag may be tile_mv_0_flag, and the flag may be set in the slice_segment_header() function.

Wherein, setting the first background identifier on the sub-area determined as the background area is to determine whether the sub-area is the background area by directly judging whether the sub-area contains the first background identifier during the decoding process.

It should be noted that, in the embodiment of the present invention, the execution time sequence of step 201 shown in FIG. 2 and step 101 in the embodiment shown in FIG. 1 is not limited.

In the embodiment of the present invention, when the encoding device determines that a sub-region is a background region, it will set a first background identifier for the background region, and the first background identifier is used to identify the sub-region as a background region during the decoding process, When decoding, the decoding process can be realized by copying the image corresponding to the reference frame of the frame to which the sub-region belongs, so that the sub-region does not need to be decoded by the existing decoding method, effectively reducing the complexity of the decoding process and saving decoding time and improve decoding efficiency.

In the embodiment of the present invention, when the sub-area is a non-background area, the block units in the sub-area will be further coded. For a better understanding, please refer to FIG. 3, which is the first implementation shown in FIG. 1 of the present invention A schematic flow chart of an example additional step, the method includes:

Step 301, when the sub-area is a non-background area, then traverse the block unit in the sub-area, if the traversed block unit is a background unit, copy the image corresponding to the block unit from the reference frame of the frame, and copy the obtained The image is encoded as a block unit image.

In the embodiment of the present invention, when the encoding device determines that the sub-area is a non-background area, the encoding device will traverse the block units in the sub-region, and determine whether the traversed block units are background units.

In the embodiment of the present invention, the encoding device determines whether the block unit is a background unit in many ways, for example: the encoding device determines the pixel value of each pixel in the block unit, and determines the pixel value of the block unit in the previous frame. The sub-area has an auxiliary sub-area with the same position, and the encoding device will determine the pixel value of each pixel in the auxiliary block unit that has the same position as the above-mentioned block unit in the auxiliary sub-area, and calculate the pixel points in the block unit in turn The difference between the pixel value of and its corresponding pixel value in the auxiliary block unit, after calculating all the differences, sum the absolute values of all the differences, and compare the sum with the preset third value For comparison, if the sum value is less than the preset third value, then the block unit is determined to be a background unit, and if the sum value is greater than or equal to the preset first value, then the block unit is determined to be a non-background unit.

Or, another example: the coding device determines the pixel value of each pixel in the block unit, and determines the auxiliary sub-region that has the same position as the sub-region to which the block unit belongs in the previous frame, and the coding device will determine that the sub-region in the auxiliary sub-region The pixel value of each pixel point in the auxiliary block unit that has the same position as the above block unit in the area, and calculate the difference between the pixel value of the pixel point in the block unit and its corresponding pixel value in the auxiliary block unit in turn , after calculating all the differences, sum all the differences and calculate the absolute value, compare the absolute value with the preset fourth value, if the absolute value is less than the preset fourth value, then determine The block unit is a background unit, and if the sum value is greater than or equal to the preset first value, it is determined that the block unit is a non-background unit.

In the embodiment of the present invention, if the traversed block unit is a background unit, the encoding device will copy the image corresponding to the block unit from the reference frame of the frame, and use the copied image as the encoded image of the block unit. Wherein, copying the image corresponding to the block unit from the reference frame of the frame specifically includes: in the reference frame of the frame, determining a reference sub-region having a corresponding position with the sub-region to which the block unit belongs; copying the image in the reference sub-region and The block unit corresponds to the location of the image.

Wherein, if the traversed block unit is a non-background unit, the encoding device will obtain the encoded image of the block unit according to the existing encoding method.

In the embodiment of the present invention, when the sub-area is a non-background area, the block unit in the sub-area is traversed, and if the traversed block unit is a background unit, copy the corresponding block unit from the reference frame of the frame The image of the position uses the copied image as the image encoded by the block unit, so that when the block unit is the background unit, the image encoded by the block unit can be obtained by copying, without using the existing encoding method to encode the block unit Encoding can effectively reduce the complexity and time required for encoding, and improve encoding efficiency.

In the embodiment of the present invention, in order to be able to identify the block unit as the background unit in the decoding process, the second background identifier can be set for the block unit determined as the background unit in the encoding process, please refer to FIG. 4, which is a diagram of the present invention A schematic flow chart of the additional steps of the embodiment shown in 3, including:

Step 401. When the traversed block unit is a background unit, set a second background identifier for the block unit, and the second background identifier is used to identify the block unit as a background unit during decoding.

In the embodiment of the present invention, when the encoding device determines that a block unit is a background unit, a second background identifier is set for the block unit, and the second background identifier is used to identify the block unit as a background unit during decoding, so that In the process, it may be determined whether the block unit is a background unit by judging whether the block unit contains the second context identifier.

Wherein, an identification bit has been set in the block unit, and the identification bit is used to indicate whether the block unit is a background unit. When the value of the identification bit is 1, it indicates that the block unit is a background unit. When the value of the identification bit is 0 Indicates that the block unit is a non-background unit. And before encoding, the value of the identification bit of the block unit is 0, when the encoding device determines that the block unit is a background unit, the value of the identification bit will be set to 1, that is, the second background identifier is set for the block unit. In the HEVC protocol, the flag can be set to cu_mv_0_flag, and the flag can be set in the prediction_uint() function.

Wherein, setting the second background identifier for the block unit is to determine whether the block unit is a background unit by judging whether the block unit contains the second background identifier during the decoding process.

In the encoding process in the embodiment of the present invention, when the traversed block unit is a background unit, a second background identifier is set for the block unit, so that the block can be obtained by copying in the process of decoding the block unit The image decoded by the unit does not need to be decoded by the existing decoding method, which effectively reduces the complexity and time required for decoding, and improves the decoding efficiency.

Please refer to FIG. 5, which is a schematic flowchart of a video encoding method in the second embodiment of the present invention, including:

Step 501, when the sub-region of the frame is a background region, set a first background identifier for the sub-region, and the first background identifier is used to identify the sub-region as a background region during the decoding process, so that when decoding the sub-region, The decoding device copies the image corresponding to the sub-region from the decoding reference frame of the frame, and uses the copied image as the decoded image of the sub-region;

Step 502. Acquire the coded image of the sub-region.

In this embodiment of the present invention, when encoding a frame, if the encoding device determines that the sub-area of the frame is a background area, it sets a first background identifier for the sub-area, and the first background identifier is used in the decoding process. Identifying the sub-area as the background area, so that when the decoding device decodes the sub-area, it can copy the image corresponding to the sub-area from the decoding reference frame of the frame.

Wherein, the decoding reference frame refers to a reference frame when the frame is decoded.

In the embodiment of the present invention, after the encoding device sets the first background identifier for the sub-area belonging to the background area, it will also acquire the encoded image of the sub-area.

In the embodiment of the present invention, by setting the first background identifier for the sub-region belonging to the background region during the encoding process, the decoded image of the sub-region can be obtained by copying the image during the decoding process without the need The decoded graphics of the sub-region are obtained according to the existing decoding method, which effectively reduces the decoding complexity and required time, and improves the decoding efficiency.

Preferably, in the embodiment of the present invention, when the encoding device executes step 502 in the embodiment shown in FIG. 5 , it may execute according to the following steps, specifically including:

From the coded reference frame of the frame, the image corresponding to the position of the sub-region is copied as the coded image of the sub-region.

Wherein, the coding reference frame refers to a reference frame during the coding process of the frame.

In the embodiment of the present invention, when the encoding device determines that the sub-area of the frame is the background area, it can copy the image corresponding to the sub-area from the encoding reference frame of the frame as the encoded image of the sub-area, so that no Encoding the sub-region by means of an existing encoding method can effectively reduce encoding complexity and required time, and improve encoding efficiency.

Please refer to FIG. 6, which is a schematic flow chart of the additional steps of the second embodiment shown in FIG. 5 of the present invention, including:

Step 601. When the sub-area is a non-background area, traverse the block units in the sub-area. If the traversed block unit is a background unit, set a second background identifier for the block unit. The second background identifier is used in decoding In the process, the block unit is identified as the background unit, so that when the block unit is decoded, the decoding device copies the image corresponding to the block unit from the decoding reference frame of the frame, and uses the copied image as the decoded image of the block unit;

Step 603, acquire the encoded image in block units.

In the embodiment of the present invention, when the encoding device determines that a sub-area is a non-background area, it will further traverse the block units in the sub-area, and if the traversed block unit is a background unit, set a second background for the block unit identifier, the second context identifier is used to identify the block unit as a background unit in the decoding process, so that when decoding the block unit belonging to the background unit, the decoding device can copy from the decoding reference frame of the frame and the For the image at the corresponding position of the block unit, the copied image is used as the decoded image of the block unit.

Wherein, after the encoding device sets the second background identifier for the block unit, it will acquire the encoded image of the block unit.

In the embodiment of the present invention, by setting the second background identifier for the block unit belonging to the background unit during the encoding process, the decoded image of the sub-region can be obtained by copying the image during the decoding process without the need for The decoded image of the sub-region is obtained according to the existing decoding method, which effectively reduces the decoding complexity and required time, and improves the decoding efficiency.

Preferably, in the embodiment of the present invention, when the encoding device executes step 602 shown in FIG. 6 , it may specifically execute as follows, including:

From the coded reference frame of the frame, the image corresponding to the block unit is copied as the coded image of the block unit.

Wherein, the coding reference frame refers to a reference frame during the coding process of the frame.

In the embodiment of the present invention, when the encoding device determines that the traversed block unit is a background unit, it can copy the image corresponding to the block unit from the encoding reference frame of the frame as the encoded image of the block unit, so that The block unit does not need to be encoded in an existing encoding manner, effectively reducing encoding complexity and required time, and improving encoding efficiency.

Figures 1 to 6 describe the detailed technical solutions of the video encoding method, and the detailed technical solutions of the video decoding method in the embodiment of the present invention will be introduced below, please refer to Figure 7, which is the detailed technical solution of the video decoding method in the third embodiment of the present invention Schematic diagram of the process, the method comprising:

Step 701, when the sub-region of the frame contains the first background identifier, copy the image corresponding to the sub-region from the reference frame of the frame, and use the copied image as the decoded image of the sub-region, and use the first background identifier To identify the sub-region as the background region.

In the embodiment of the present invention, when the decoding device decodes the sub-region of the frame, it will determine whether the sub-region contains the first background identifier, and when the decoding device determines that the sub-region contains the first background identifier, the decoding device will determine from the frame In the reference frame of , the image corresponding to the sub-region is copied, and the copied image is used as the decoded image of the sub-region.

In the video decoding method in the embodiment of the present invention, when the decoding device determines that the sub-region is a background region, it can decode the copied image as the sub-region by copying the image corresponding to the sub-region in the reference frame The resulting image does not need to decode the sub-region according to the existing coding method, which effectively reduces the decoding complexity and the time required for decoding, and improves the decoding efficiency.

Please refer to FIG. 8, which is a schematic flow chart of the additional steps of the third embodiment shown in FIG. 7 of the present invention, including:

Step 801, when the sub-region does not contain the first background identifier, if there is a block unit containing the second background identifier in the sub-region, copy the image corresponding to the block unit from the reference frame of the frame, and copy the obtained image As the decoded image of the block unit, the second background identifier is used to identify the block unit as the background unit.

In the embodiment of the present invention, when the decoding device determines that the sub-region of the frame does not contain the first background identifier, it will determine whether there is a block unit containing the second background identifier among the block units in the sub-region. If there is a block unit containing the second background identifier in the sub-region, copy the graphics corresponding to the sub-region from the reference frame of the frame to which the sub-region belongs, and use the copied image as the decoded sub-region In the image, the second background identifier is used to identify the block unit as a background unit.

In the embodiment of the present invention, when it is determined that the block unit does not contain the second context identifier, the decoding device will perform decoding according to the existing decoding method, which will not be described in detail here.

In the video decoding method in the embodiment of the present invention, when it is determined that the sub-region does not contain the first context identifier, if there is a block unit containing the second context identifier in the sub-region, it is not necessary to follow the Decoding is performed in an existing decoding method, and the decoded image of the block unit is obtained by copying an image, which can effectively reduce decoding complexity and time required for decoding, and improve decoding efficiency.

It should be noted that the technical solutions described in the embodiments of the present invention are obtained through creative efforts based on two features of the low-latency video communication scene, one of which is: in a relatively large part of the time, the picture motion is small And still, another feature is: in a certain period of time, in some pictures, only the foreground object moves left and right or up and down, while the background part does not change.

Please refer to FIG. 9, which is a schematic diagram of the functional modules of the encoding device in the fourth embodiment of the present invention. The encoding device includes:

Copy module 901, for when the sub-area of the frame is a background area, copy the image corresponding to the sub-area from the reference frame of the frame, and use the copied image as the encoded sub-area image.

In the embodiment of the present invention, there are many ways to judge whether a sub-region is a background region. For example, the encoding device will determine the pixel value of each pixel in the sub-region, and determine that the sub-region has the same The pixel value of each pixel in the auxiliary sub-area of the position, and calculate the difference between the pixel value of the pixel in the sub-area and the pixel value of the corresponding pixel in the auxiliary sub-area until the calculated All the differences, and sum the absolute values of all the differences, compare the sum with the preset first value, if the sum is smaller than the preset first value, then determine the sub-region as the background region , if the sum value is greater than or equal to the preset first value, it is determined that the sub-area is a non-background area. That is, it is judged whether the sub-area is the background area or not by the sum of the absolute values of the difference values of the pixels.

Or, for another example: the encoding device determines the pixel value of each pixel in the sub-region, and determines the pixel value of each pixel in the auxiliary sub-region having the same position as the sub-region in the previous frame, and calculates the sub-region in turn. The difference between the pixel value of the pixel point in the area and the pixel value of the pixel point at the corresponding position in the copied sub-region, until all the difference values are calculated, sum all the difference values, and calculate the absolute value of the sum Value, compare the absolute value of the sum with the preset second value, if the absolute value of the sum is smaller than the preset second value, then determine the sub-region as the background region, if the absolute value of the sum is greater than or If it is equal to the preset first value, then the sub-area is determined to be a non-background area. That is, it is judged whether the sub-area is the background area by the absolute value of the sum of the difference values of the pixels.

In the embodiment of the present invention, during the encoding process, when the sub-region of the frame is a background region, the copying module 901 copies the image corresponding to the sub-region from the reference frame of the frame to which the sub-region belongs, and obtains The image of the sub-region is used as the coded image of the sub-region, so that the sub-region does not need to be coded according to the existing coding method, the complexity of the coding process is effectively reduced, the coding time is saved, and the coding efficiency is improved.

Please refer to FIG. 10, which is a schematic diagram of the additional functional modules of the fourth embodiment shown in FIG. 9 of the present invention, including:

A first setting module 1001, configured to set a first background identifier for the sub-region when the sub-region is a background region, and the first background identifier is used to identify the sub-region as a background during decoding area.

In the embodiment of the present invention, each sub-area is provided with an identification bit for identifying whether the sub-area is a background area, and when the identification bit is 0, it indicates that the sub-area is a non-background area, and the identification bit is 1 When , it indicates that the sub-area is a background area, and the value of the identification bit is 0 before judging whether the sub-area is a background area. When the encoding device determines that the sub-area is a background area, it can set the value of the identification bit to 1, that is, the operation of setting the first background identifier for the sub-area is completed. And when the encoding device determines that the sub-area is not a background area, it will not operate on the flag.

In the embodiment of the present invention, when the encoding device determines that a sub-area is a background area, the first setting module 1001 will set a first background identifier for the background area, and the first background identifier is used to identify the sub-area in the decoding process. The area is the background area, so that when decoding, the decoding process can be realized by copying the image corresponding to the reference frame of the frame to which the sub-area belongs, so that the sub-area does not need to be decoded by the existing decoding method, effectively reducing the decoding process. complexity, saving decoding time and improving decoding efficiency.

Please refer to FIG. 11, which is a schematic diagram of additional functional modules of the fourth embodiment shown in FIG. 9, including:

The traversal and copying module 1101 is used to traverse the block units in the sub-area when the sub-area is a non-background area, and if the traversed block unit is a background unit, then copy and For the image at the corresponding position of the block unit, the copied image is used as the encoded image of the block unit.

In the embodiment of the present invention, the encoding device determines whether the block unit is a background unit in many ways, for example: the encoding device determines the pixel value of each pixel in the block unit, and determines the pixel value of the block unit in the previous frame. The sub-area has an auxiliary sub-area with the same position, and the encoding device will determine the pixel value of each pixel in the auxiliary block unit that has the same position as the above-mentioned block unit in the auxiliary sub-area, and calculate the pixel points in the block unit in turn The difference between the pixel value of and its corresponding pixel value in the auxiliary block unit, after calculating all the differences, sum the absolute values of all the differences, and compare the sum with the preset third value For comparison, if the sum value is less than the preset third value, then the block unit is determined to be a background unit, and if the sum value is greater than or equal to the preset first value, then the block unit is determined to be a non-background unit.

Or, another example: the coding device determines the pixel value of each pixel in the block unit, and determines the auxiliary sub-region that has the same position as the sub-region to which the block unit belongs in the previous frame, and the coding device will determine that the sub-region in the auxiliary sub-region The pixel value of each pixel point in the auxiliary block unit that has the same position as the above block unit in the area, and calculate the difference between the pixel value of the pixel point in the block unit and its corresponding pixel value in the auxiliary block unit in turn , after calculating all the differences, sum all the differences and calculate the absolute value, compare the absolute value with the preset fourth value, if the absolute value is less than the preset fourth value, then determine The block unit is a background unit, and if the sum value is greater than or equal to the preset first value, it is determined that the block unit is a non-background unit.

In the embodiment of the present invention, when the sub-area is a non-background area, the traversal and copy module 1101 traverses the block units in the sub-area, and if the traversed block unit is a background unit, from the reference frame of the frame, Copy the image corresponding to the block unit and use the copied image as the coded image of the block unit, so that when the block unit is the background unit, the coded image of the block unit can be obtained by copying without using the existing The encoding method encodes block units, which effectively reduces the complexity and time required for encoding, and improves encoding efficiency.

Please refer to FIG. 12 , which is a schematic diagram of adding functional modules to the embodiment shown in FIG. 11 of the present invention, including:

The second setting module 1201 is configured to set a second background identifier for the block unit if the traversed block unit is a background unit, and the second background identifier is used to identify the block unit as background unit.

Wherein, an identification bit has been set in the block unit, and the identification bit is used to indicate whether the block unit is a background unit. When the value of the identification bit is 1, it indicates that the block unit is a background unit. When the value of the identification bit is 0 Indicates that the block unit is a non-background unit. And before encoding, the value of the identification bit of the block unit is 0, when the encoding device determines that the block unit is a background unit, the value of the identification bit will be set to 1, that is, the second background identifier is set for the block unit. In the HEVC protocol, the flag can be set to cu_mv_0_flag, and the flag can be set in the prediction_uint() function.

Wherein, setting the second background identifier for the block unit is to determine whether the block unit is a background unit by judging whether the block unit contains the second background identifier during the decoding process.

In the encoding process in the embodiment of the present invention, when the traversed block unit is a background unit, the second setting module 1201 sets the second background identifier for the block unit, so that in the process of decoding the block unit, copying The decoded image of the block unit is obtained in a manner without decoding the block unit through the existing decoding method, which effectively reduces decoding complexity and time required, and improves decoding efficiency.

Please refer to Figure 13, which is a schematic diagram of the functional modules of the encoding device in the fifth embodiment of the present invention, including:

A third setting module 1301, configured to set a first background identifier for the sub-region when the sub-region of the frame is a background region, and the first background identifier is used to identify the sub-region as a background during the decoding process an area, such that when decoding the sub-area, the decoding device copies the image corresponding to the sub-area from the decoding reference frame of the frame, and uses the copied image as the decoded image of the sub-area;

The first obtaining module 1302 is configured to obtain the coded image of the sub-region.

Preferably, the first obtaining module 1302 in the embodiment of the present invention is specifically configured to copy an image at a position corresponding to the sub-region from the coding reference frame of the frame as the coded image of the sub-region.

In the embodiment of the present invention, when encoding a sub-region, if the sub-region is a background region, the third setting module 1301 sets the first background identifier for the sub-region, so that the image can be copied during the decoding process. The decoded image of the sub-region is obtained without obtaining the decoded graphics of the sub-region according to the existing decoding method, which effectively reduces the complexity and time required for decoding, and improves decoding efficiency.

Please refer to Figure 14, which is a schematic diagram of additional functional modules in the embodiment shown in Figure 13 of the present invention, including:

The traversal and setting module 1401 is used for traversing the block units in the sub-area when the sub-area is a non-background area, and setting a second background identifier for the block unit if the block unit traversed is a background unit character, the second context identifier is used to identify the block unit as a background unit during the decoding process, so that when decoding the block unit, the decoding device copies from the decoding reference frame of the frame the same as the The image corresponding to the position of the block unit, and the copied image is used as the decoded image of the block unit;

The second acquiring module 1402 is configured to acquire the encoded image of the block unit.

Preferably, the second obtaining module 1402 is specifically configured to: copy an image corresponding to the block unit from the encoding reference frame of the frame as the encoded image of the block unit.

In the embodiment of the present invention, when the sub-area is a non-background area, the traversal and setting module 1401 traverses the block units in the sub-area, and when the traversed block unit is a background unit, sets the second background identifier for the block unit , so that the decoded image of the sub-region can be obtained by copying the image in the decoding process, without the need to obtain the decoded image of the sub-region according to the existing decoding method, effectively reducing the complexity of decoding and the time required, Improve decoding efficiency.

Please refer to FIG. 15, which is a schematic diagram of the functional modules of the decoding device in the sixth embodiment of the present invention, including:

The first image copying module 1501 is configured to, when the sub-area of the frame contains the first background identifier, copy the image corresponding to the sub-area from the reference frame of the frame, and use the copied image as the sub-area In an image after region decoding, the first background identifier is used to identify the subregion as a background region.

In the embodiment of the present invention, when the decoding device determines that the sub-region is the background region, the first image copying module 1501 in the encoding device copies the image corresponding to the sub-region in the reference frame, and uses the copied image as the background region. The decoded image of the sub-region does not need to decode the sub-region according to the existing encoding method, which effectively reduces the decoding complexity and the time required for decoding, and improves the decoding efficiency.

Please refer to Figure 16, which is a schematic diagram of the additional functional modules of the embodiment shown in Figure 15 of the present invention, including:

The second image copying module 1601 is used to copy from the reference frame of the frame if there is a block unit containing the second background identifier in the sub-region when the sub-region does not contain the first background identifier For the image corresponding to the block unit, the copied image is used as the decoded image of the block unit, and the second background identifier is used to identify the block unit as a background unit.

In the embodiment of the present invention, when the decoding device determines that the sub-area does not contain the first background identifier, if there is a block unit containing the second background identifier in the sub-area, the second image copying module 1601 starts from the frame Copy the image corresponding to the block unit in the reference frame, and use the copied image as the decoded image of the block unit, so that the block unit does not need to be decoded according to the existing decoding method, which can effectively reduce the decoding complexity and decoding The time required to improve decoding efficiency.

Please refer to Figure 17, which is a schematic diagram of the functional modules of the codec system in the sixth embodiment of the present invention, including: the encoding device 1701 in the embodiment shown in any one of Figures 10 to 15, and as shown in Figure 15 or 16 Decoding device 1702 in the illustrated embodiment.

In the embodiment of the present invention, both the encoding device 1701 and the decoding device 1702 can obtain the encoded and decoded image by copying the reference frame, without the need to obtain the encoded and decoded image through the existing encoding and decoding method, effectively reducing the complexity of the encoding and decoding Speed and reduce codec time, improve codec efficiency.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on such an understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products are stored in a storage medium (such as ROM/RAM, disk, CD) contains several instructions to make a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods of various embodiments of the present invention.

The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by using the description of the present invention and the contents of the accompanying drawings, or directly or indirectly used in other related technical fields , are all included in the scope of patent protection of the present invention in the same way.

Claims (21)

1. a kind of method for video coding, it is characterised in that including：

When the subregion of frame is background area, replicated and the subregion pair from the reference frame of the frame The image of position is answered, the image that duplication is obtained is used as the image after subregion coding.

2. according to the method described in claim 1, it is characterised in that methods described also includes：

It is that the subregion sets the first background identifier when the subregion is background area, it is described First background identifier is used to recognize that the subregion is background area in decoding process.

3. method according to claim 1 or 2, it is characterised in that methods described also includes：

When the subregion is non-background area, the module unit in the subregion is traveled through, if traversing Module unit be background cell, then replicated from the reference frame of the frame with the module unit correspondence position Image, the image that duplication is obtained is used as the image after module unit coding.

4. method according to claim 3, it is characterised in that methods described also includes：

If the module unit traversed is background cell, the second background identifier is set for the module unit, The second background identifier is used to recognize that the module unit is background cell in decoding process.

5. a kind of method for video coding, it is characterised in that methods described includes：

It is that the subregion sets the first background identifier when the subregion of frame is background area, it is described First background identifier is used to recognize that the subregion is background area in decoding process so as to institute When stating subregion and being decoded, decoding apparatus is replicated and the subregion from the decoded reference frame of the frame The image of correspondence position, the image that duplication is obtained is used as the decoded image of the subregion；

Obtain the image after the subregion coding.

6. method according to claim 5, it is characterised in that the acquisition subregion is compiled Image after code, including：

From the reference coding frame of the frame, the image with the subregion correspondence position is replicated as described Image after subregion coding.

7. the method according to claim 5 or 6, it is characterised in that methods described also includes：

When the subregion is non-background area, the module unit in the subregion is traveled through, if traversing Module unit be background cell, then be the module unit set the second background identifier, second background Identifier is used to recognize that the module unit is background cell in decoding process so as to the module unit When being decoded, decoding apparatus is replicated and the module unit correspondence position from the decoded reference frame of the frame Image, obtained image will be replicated and be used as the decoded image of the module unit；

Obtain the image after the module unit coding.

8. method according to claim 7, it is characterised in that the acquisition module unit is compiled Image after code includes：

From the reference coding frame of the frame, the image with the module unit correspondence position is replicated as described Image after module unit coding.

9. a kind of video encoding/decoding method, it is characterised in that methods described includes：

When frame subregion include the first background identifier when, from the reference frame of the frame replicate with it is described The image of subregion correspondence position, will replicate obtained image as the decoded image of the subregion, The first background identifier is used to identify the subregion for background area.

10. method according to claim 9, it is characterised in that methods described also includes：

When the subregion does not include the first background identifier, second is included if existing in the subregion The module unit of background identifier, then replicate and the module unit correspondence position from the reference frame of the frame Image, the image that duplication is obtained is used as the decoded image of the module unit, the second background mark Accord with for identifying the module unit for background cell.

11. a kind of code device, it is characterised in that including：

Replication module, for when the subregion of the frame is background area, from the reference frame of the frame The image with the subregion correspondence position is replicated, the image that duplication is obtained is encoded as the subregion Image afterwards.

12. device according to claim 11, it is characterised in that described device also includes：

First setup module, for when the subregion is background area, being that the subregion sets the One background identifier, the first background identifier is used to recognize that the subregion is the back of the body in decoding process Scene area.

13. the device according to claim 11 or 12, it is characterised in that described device also includes：

Traversal and replication module, for when the subregion is non-background area, traveling through the subregion Interior module unit, if the module unit traversed be background cell, from the reference frame of the frame replicate with The image of the module unit correspondence position, the image that duplication is obtained is used as the figure after module unit coding Picture.

14. device according to claim 13, it is characterised in that described device also includes：

Second setup module, if being background cell for the module unit traversed, sets for the module unit The second background identifier is put, the second background identifier is used to recognize the module unit in decoding process For background cell.

15. a kind of code device, it is characterised in that described device includes：

3rd setup module, for when the subregion of frame is background area, being that the subregion sets the One background identifier, the first background identifier is used to recognize that the subregion is the back of the body in decoding process Scene area so that when being decoded to the subregion, decoded reference frame of the decoding apparatus from the frame Middle duplication and the image of the subregion correspondence position, the image that duplication is obtained are used as the subregion solution Image after code；

First acquisition module, for obtaining the image after the subregion coding.

16. device according to claim 15, it is characterised in that the first acquisition module tool Body is used for from the reference coding frame of the frame, and the image replicated with the subregion correspondence position is used as institute State the image after subregion coding.

17. the device according to claim 15 or 16, it is characterised in that described device also includes：

Traversal and setup module, for when the subregion is non-background area, traveling through the subregion Interior module unit, if the module unit traversed is background cell, the second background is set for the module unit Identifier, the second background identifier is used to recognize that the module unit is background cell in decoding process, So that when being decoded to the module unit, decoding apparatus replicated from the decoded reference frame of the frame with The image of the module unit correspondence position, the image that duplication is obtained is used as the decoded figure of the module unit Picture；

Second acquisition module, for obtaining the image after the module unit coding.

18. device according to claim 17, it is characterised in that the second acquisition module tool Body is used for：From the reference coding frame of the frame, the image conduct with the module unit correspondence position is replicated Image after the module unit coding.

19. a kind of decoding apparatus, it is characterised in that described device includes：

First copying image module, for when the subregion of frame includes the first background identifier, from described The image with the subregion correspondence position is replicated in the reference frame of frame, the image that duplication is obtained is used as institute The decoded image of subregion is stated, the first background identifier is used to identify the subregion for background area Domain.

20. device according to claim 19, it is characterised in that described device also includes：

Second copying image module, for when the subregion does not include the first background identifier, if institute The module unit for existing in subregion and including the second background identifier is stated, then is replicated from the reference frame of the frame With the image of the module unit correspondence position, the image that duplication is obtained is decoded as the module unit Image, the second background identifier is used to identify the module unit for background cell.

21. a kind of coding/decoding system, it is characterised in that including：As claim 12 to 14 is any one Code device described in and the decoding apparatus as described in claim 19 or 20；Or, such as right will Ask the code device described in 15 to 18 any one and the decoding apparatus as described in claim 19 or 20.