CN114449262A - Video coding control method, device, equipment and storage medium - Google Patents
Video coding control method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN114449262A CN114449262A CN202210200093.7A CN202210200093A CN114449262A CN 114449262 A CN114449262 A CN 114449262A CN 202210200093 A CN202210200093 A CN 202210200093A CN 114449262 A CN114449262 A CN 114449262A
- Authority
- CN
- China
- Prior art keywords
- coding block
- intra
- coding
- frame
- current
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000007781 pre-processing Methods 0.000 claims abstract description 110
- 230000004044 response Effects 0.000 claims abstract description 16
- 108091026890 Coding region Proteins 0.000 claims description 12
- 238000010586 diagram Methods 0.000 description 8
- 238000005192 partition Methods 0.000 description 6
- 238000007906 compression Methods 0.000 description 3
- 102100037812 Medium-wave-sensitive opsin 1 Human genes 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The embodiment of the application discloses a video coding control method, a device, equipment and a storage medium, wherein the method comprises the following steps: acquiring the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block; when the intra-frame preprocessing cost is larger than the inter-frame preprocessing cost and the current coding block meets an initial intra-frame skipping condition, determining an adjacent coding block and a parent coding block which are associated with the current coding block; and determining whether to skip the intra-frame prediction mode of the current coding block according to the coding information of the adjacent coding block and the parent coding block, and skipping the intra-frame prediction mode of the current coding block in response to the judgment result of skipping the intra-frame prediction mode of the current coding block. The scheme obviously improves the video coding efficiency by reasonably skipping the intra-frame prediction mode.
Description
Technical Field
The embodiment of the application relates to the technical field of video processing, in particular to a video coding control method, a video coding control device, video coding control equipment and a storage medium.
Background
In order to improve the storage and transmission efficiency of video, a common method is to compress video data, and the compression process involves encoding video images. Because the content of continuous multi-frame images in the video images has similarity, the video image sequence can be coded by an intra-frame prediction technology and an inter-frame prediction technology, and the video compression efficiency can be greatly improved.
In the related technology, an encoder first performs preprocessing on an input video image sequence, and performs intra-frame prediction coding and inter-frame prediction coding on coding blocks divided in each frame of image after the preprocessing is completed. Among them, intra-frame prediction coding is one of core techniques of video coding, and is widely used in video coding. The intra-frame prediction technology is that the spatial correlation of a video is utilized, and the current pixel is predicted by using the pixel value coded in the current frame, so that the aim of removing spatial redundancy is fulfilled, the spatial correlation of the video is effectively reduced, and the video compression efficiency is greatly improved. As a main prediction means, the complexity of the decision process of intra-frame prediction coding in an encoder is high, which has a large influence on the coding efficiency of the encoder, and significantly increases the coding complexity and coding time of the encoder, and needs to be reasonably skipped.
Disclosure of Invention
The embodiment of the application provides a video coding control method, a video coding control device, video coding control equipment and a storage medium, solves the problems of coding complexity improvement and coding time consumption increase caused by an intra-frame prediction mode during video coding, and obviously improves video coding efficiency by reasonably skipping the intra-frame prediction mode.
In a first aspect, an embodiment of the present application provides a video coding control method, where the method includes:
acquiring the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block;
when the intra-frame preprocessing cost is larger than the inter-frame preprocessing cost and the current coding block meets an initial intra-frame skipping condition, determining an adjacent coding block and a parent coding block which are associated with the current coding block;
and determining whether to skip the intra-frame prediction mode of the current coding block according to the coding information of the adjacent coding block and the parent coding block, and skipping the intra-frame prediction mode of the current coding block in response to the judgment result of skipping the intra-frame prediction mode of the current coding block.
In a second aspect, an embodiment of the present application further provides a video encoding control apparatus, including:
the preprocessing cost acquisition module is configured to acquire the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block;
a coding block determining module configured to determine an adjacent coding block and a parent coding block associated with the current coding block when the intra-frame preprocessing cost is greater than the inter-frame preprocessing cost and the current coding block satisfies an initial intra-frame skipping condition;
and the intra-frame mode skipping module is configured to determine whether to skip the intra-frame prediction mode of the current coding block according to the coding information of the adjacent coding block and the parent coding block, and skip the intra-frame prediction mode of the current coding block in response to the judgment result of skipping the intra-frame prediction mode of the current coding block.
In a third aspect, an embodiment of the present application further provides a video encoding control device, including:
one or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the video encoding control method according to the embodiment of the present application.
In a fourth aspect, the present application further provides a storage medium storing computer-executable instructions, which are used to execute the video coding control method according to the present application when executed by a computer processor.
In the embodiment of the application, by acquiring the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block, when the intra-frame preprocessing cost is greater than the inter-frame preprocessing cost and the current coding block meets the initial intra-frame skipping condition, the adjacent coding block and the parent coding block which are associated with the current coding block are determined, whether the intra-frame prediction mode of the current coding block is skipped is determined according to the coding information of the adjacent coding block and the parent coding block, and the intra-frame prediction mode of the current coding block is skipped in response to the judgment result of the intra-frame prediction mode of the current coding block, so that the video coding efficiency is ensured, the intra-frame prediction mode is reasonably skipped, the coding efficiency of an encoder is improved, and the processing time consumption of the encoder is remarkably reduced.
Drawings
Fig. 1 is a flowchart of a video encoding control method according to an embodiment of the present application;
fig. 2 is a flowchart of another video encoding control method according to an embodiment of the present application;
fig. 3 is a schematic diagram of determining adjacent coding blocks associated with a current coding block according to an embodiment of the present application;
fig. 4 is a schematic diagram of a determined parent coding block of a current coding block according to an embodiment of the present application;
fig. 5 is a flowchart of another video encoding control method according to an embodiment of the present application;
fig. 6 is a flowchart of another video encoding control method according to an embodiment of the present application;
fig. 7 is a block diagram illustrating a structure of a video coding control apparatus according to an embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of a video coding control apparatus according to an embodiment of the present application.
Detailed Description
The embodiments of the present application will be described in further detail with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of and not restrictive on the broad embodiments of the present application. It should be further noted that, for convenience of description, only some structures related to the embodiments of the present application are shown in the drawings, not all of the structures are shown.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
Fig. 1 is a flowchart of a video encoding control method provided in an embodiment of the present application, which may be implemented by a computing device related to video encoding, such as a server, an intelligent terminal, a notebook, a tablet computer, and the like, and specifically includes the following steps:
step S101, obtaining the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block.
In one embodiment, in encoding video data, the encoding of each frame image is performed for a sequence of input video image frames. Optionally, the video image frame is first preprocessed in the encoding process, where the preprocessing includes down-sampling the video image frame and dividing the video image frame into coding blocks of a preset size, for example, dividing the video image frame into multiple coding blocks of 8 × 8 or 16 × 16 pixel area size. Video encoding, such as inter-prediction encoding or intra-prediction encoding, is performed for each divided encoding block.
In one embodiment, a determination is made as to whether to skip an intra prediction mode for a currently selected coding block, and whether to skip the intra prediction mode or not based on the determination. In the judgment process, firstly, the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block are obtained. The intra-frame preprocessing cost and the inter-frame preprocessing cost may be calculated and generated in a preprocessing process of an encoder, and are respectively used for representing cost loss conditions when intra-frame prediction encoding and inter-frame prediction encoding of an image are performed, where the higher the cost loss is, the greater the distortion degree when the image is encoded is, and the lower the encoding efficiency is. Conversely, the lower the cost loss, the smaller the degree of distortion in image encoding, and the higher the encoding efficiency.
In an embodiment, for a current coding block, if the obtained intra-frame preprocessing cost and inter-frame preprocessing cost are the intra-frame preprocessing cost and inter-frame preprocessing cost of each sub-coding block included in the current coding block, the intra-frame preprocessing cost and the inter-frame preprocessing cost of each internally included sub-coding are respectively summed to obtain the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block.
And S102, when the intra-frame preprocessing cost is larger than the inter-frame preprocessing cost and the current coding block meets the initial intra-frame skipping condition, determining an adjacent coding block and a parent coding block which are related to the current coding block.
In one embodiment, after the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block are obtained, whether the adjacent coding block and the parent coding block associated with the current coding block are subsequently determined further is determined based on the sizes of the intra-frame preprocessing cost and the inter-frame preprocessing cost and whether the previous coding block meets the initial intra-frame skipping condition. That is, before determining the adjacent coding block and the parent coding block associated with the current coding block, the intra-frame preprocessing cost is required to be greater than the inter-frame preprocessing cost, and the current coding block meets the initial intra-frame skipping condition. The order of determining the above two conditions is not limited. The comparison between the intra-frame preprocessing cost and the inter-frame preprocessing cost can be preferentially performed, or whether the current coding block meets the initial intra-frame skipping condition or not can be preferentially judged.
If the intra-frame preprocessing cost of the current coding block is greater than the inter-frame preprocessing cost and the current coding block meets the initial intra-frame skipping condition, judging that the triggering condition is met, namely further determining an adjacent coding block and a parent coding block which are associated with the current coding block.
In one embodiment, the judgment condition that the intra-frame preprocessing cost is greater than the inter-frame preprocessing cost may be: the intra-frame preprocessing cost is greater than the product of the inter-frame preprocessing cost and a preset threshold, and the preset threshold is greater than 1. Illustratively, if preInterCost represents inter-frame preprocessing cost, preInterCost represents intra-frame preprocessing cost, and the preset threshold is denoted as H, the determination condition may be represented as: preincost > preincost × H. Illustratively, the inter-frame preprocessing cost and the intra-frame preprocessing cost are different in different coding standards or results calculated based on different processing algorithms, and taking the value range of the inter-frame preprocessing cost and the intra-frame preprocessing cost as an example of 0 to 1000, the preset value H is illustratively 1.5, 2 or 3, and the like.
In one embodiment, the initial intra skip condition satisfied by the current coding block includes: the level of the current coding block in the current picture group meets a preset level interval, and the division depth of the current coding block meets a preset division depth interval. The Group of pictures is a Group of pictures (GOP) of the image where the current coding block is located, and the GOP refers to a Group of continuous pictures in a coded video stream. Each coded video stream consists of successive GOPs. The compressed video stream has independent GOPs, and when a decoder decodes a new GOP, a former frame is needed to decode a later frame, and the GOP can be positioned in the video more quickly. In the video coding process, a GOP begins with an I frame, which is understood as an interval between two I frames, wherein an I frame refers to an intra-frame coded image frame, which is coded by using only information of the frame without referring to other image frames. Illustratively, taking a GOP containing 32 frames of images as an example, sequentially written as a first frame, a second frame, a. The upper layer image in the hierarchical structure is obtained by coding with reference to two images of the lower layer, the lower the numerical value of the hierarchy is, the closer the hierarchy is to the bottom layer, that is, the higher the importance of the reference is, and when the intra-frame prediction mode is directly skipped, the hierarchy where the hierarchy is located needs to be referred to.
Wherein, the division depth refers to the number of times of sequentially dividing the maximum coding unit. For example, for 64 × 64 coding units, 4 coding units of 32 × 32 are obtained by first dividing, each coding unit of 32 × 32 is divided into 4 coding units of 16 × 16 for the second time, each coding unit of 16 × 16 is divided into 4 coding units of 8 × 8 for the third time, and the corresponding division depth is increased by 1 every time division is performed, which is only an exemplary division manner performed on coding units of 64 × 64 size, and the division process may not be performed in an equally dividing manner. The smaller the division depth is, the closer to the original image which is the maximum coding unit of the division, the higher the reference degree is, and when determining whether to skip the intra prediction mode, the corresponding division depth needs to be referred to.
Illustratively, the level where the current coding block is located is denoted as cu.layer, the partition depth is denoted as cu.depth, the preset level interval is denoted as (L0, L1], the preset partition depth is denoted as (D0, D1), and whether the current coding block satisfies the initial intra-frame skip condition can be denoted as (L0< cu.layer ≦ L1) & & (D0< cu.depth ≦ D1), that is, when the level of the current coding block in the current picture group satisfies the preset level interval and the partition depth of the current coding block satisfies the preset partition depth interval, it is determined that the current coding block satisfies the initial intra-frame skip condition.
In one embodiment, when encoding a video frame image, a frame image is divided into a plurality of encoding blocks of the same size, for example, into a plurality of pixel regions of 16 × 16 size, each pixel region of 16 × 16 size is an encoding block, and the encoding blocks are adjacent in sequence. For the current coding block, adjacent coding blocks are respectively a coding block positioned above the current coding block, a coding block positioned below the current coding block, a coding block positioned on the left side and a coding block positioned on the right side. And determining the coding block which has finished coding as the adjacent coding block associated with the current coding block in the adjacent coding blocks of the current coding block according to the coding sequence of the coding blocks. For example, the coding block above and the coding block on the left side of the current coding block are adjacent to the current coding block and are already coded, and then the coding block above and the coding block on the left side of the current coding block are determined as the adjacent coding block associated with the current coding block.
In one embodiment, a parent coding block of a current coding block is a corresponding coding block when a coding block division is performed last time, for example, a coding block is divided into 4 coding blocks, the coding block before the division is a parent coding block of the divided 4 coding blocks, and the divided 4 coding blocks are child coding blocks with respect to the parent coding block. In the process of video coding, a picture is sampled and divided by downsampling to obtain a plurality of maximum coding units, which may be different for different video coding algorithms, and an exemplary maximum coding unit is 64 × 64. In this case, encoding with the most suitable division depth for different image contents significantly improves encoding efficiency, for example, for a background image of the same color, the smaller the division depth, the higher the encoding efficiency, and for a complex image, the relatively larger division depth is required on the premise of ensuring picture quality, for example, a coding block with a size of 64 × 64 is divided into a plurality of coding blocks with 8 × 8, and each coding block with 8 × 8 is encoded as one coding unit. In an embodiment, in the preprocessing, statistics of coding efficiency under different partition depths may be performed, that is, there may be records of coding information of corresponding coding blocks under a plurality of different partition depths.
Step S103, determining whether to skip the intra-frame prediction mode of the current coding block according to the coding information of the adjacent coding block and the parent coding block, and skipping the intra-frame prediction mode of the current coding block in response to the judgment result of skipping the intra-frame prediction mode of the current coding block.
In one embodiment, after determining the adjacent coding block and the parent coding block associated with the current coding block, whether to skip the intra prediction mode of the current coding block is determined based on the coding information of the adjacent coding block and the parent coding block. The coding information of the adjacent coding block and the parent coding block is recorded with the coding condition used by the adjacent coding block and the parent coding block, such as whether the coding is carried out by using an intra-frame mode or an inter-frame mode. Optionally, if the coding modes of the adjacent coding block and the parent coding block are both inter-coding modes, skipping the intra-frame prediction mode of the current coding block, that is, performing the correlation processing of the inter-frame prediction mode.
According to the scheme, by acquiring the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block, when the intra-frame preprocessing cost is larger than the inter-frame preprocessing cost and the current coding block meets the initial intra-frame skipping condition, the adjacent coding block and the parent coding block which are associated with the current coding block are determined, whether the intra-frame prediction mode of the current coding block is skipped is determined according to the coding information of the adjacent coding block and the parent coding block, and the intra-frame prediction mode of the current coding block is skipped in response to the judgment result of the intra-frame prediction mode which is skipped over the current coding block, so that the reasonable skipping of the inter-frame prediction mode is realized while the video coding efficiency is ensured, the coding efficiency of an encoder is improved, and the processing time consumption of the encoder is remarkably reduced.
Fig. 2 is a flowchart of another video coding control method provided in an embodiment of the present application, which shows a specific method for determining adjacent coding blocks and parent coding blocks associated with a current coding block, as shown in fig. 2, including:
step S201, obtaining an intra-frame preprocessing cost and an inter-frame preprocessing cost of a current coding block.
Step S202, when the intra-frame preprocessing cost is larger than the inter-frame preprocessing cost and the current coding block meets the initial intra-frame skipping condition, determining an adjacent coding block associated with the current coding block according to the position of the current coding block and the coding sequence of each coding block, and determining a parent coding block according to the division relation of the current coding block.
In one embodiment, after the division of the coding blocks is performed, the coding is sequentially performed according to the set coding order. When the adjacent coding block associated with the current coding block is determined, the adjacent coding block associated with the current coding block is determined according to the position of the current coding block and the coding sequence of each coding block. Specifically, as shown in fig. 3, fig. 3 is a schematic diagram for determining adjacent coding blocks associated with a current coding block according to an embodiment of the present application, an exemplary image is divided into 16 coding blocks with 4 rows and 4 columns, and a coding order of each coding block includes coding sequentially from top to bottom row by row and from left to right according to a position of each coding block, that is, coding of the coding blocks sequentially from 1 to 16 according to sequence numbers of each coding block in fig. 3. Of course, other sequences may be used for encoding, and the specific encoding sequence of each encoding block is not limited. In another embodiment, the coding sequence of each coding block may also be that the coding is performed sequentially from top to bottom and from right to left line by line according to the position of each coding block, and then according to the coding sequence, it is determined that the adjacent coding blocks associated with the current coding block are the adjacent upper coding block and the adjacent right coding block. In another embodiment, the coding sequence of each coding block may also be that the coding is performed sequentially from left to right and from top to bottom according to the position of each coding block, and then according to the coding sequence, it is determined that the adjacent coding block associated with the current coding block is the same as the case of performing coding sequentially from left to right and from row to row, and the adjacent upper coding block and the adjacent left coding block of the current coding block are determined as the associated adjacent coding blocks. Similarly, the coding sequence of each coding block may also be that the coding blocks are sequentially coded from right to left and from top to bottom according to the positions of the coding blocks, and then according to the coding sequence, it is determined that the adjacent coding block associated with the current coding block is the same as the case of sequentially coding from row to row and from right to left, and the coding block above and the coding block right adjacent to the current coding block are determined to be the associated adjacent coding block.
Taking fig. 3 as an example, assuming that the current coding block is coding block 6, and the coding blocks adjacent to coding block 6 are coding blocks 2, 5, 7 and 10, according to the sequence that each coding block sequentially performs coding from top to bottom row by row and from left to right, the adjacent upper coding block 2 and the adjacent left coding block 5 of the current coding block are selected to be determined as the adjacent coding block associated with the current coding block. Taking the coding block 2 as an example, the coding blocks 1, 3 and 6 adjacent to each other are known to be sequentially coded from left to right line by line according to the sequence in which each coding block is sequentially coded from left to right, and only the coding block 1 on the adjacent left side exists and the coding block above the adjacent left side does not exist.
In one embodiment, when determining the parent coding block, the determination may be made according to the partitioning relationship of the current coding block. Fig. 4 is a schematic diagram of a determined parent coding block of a current coding block according to an embodiment of the present application. As shown in fig. 4, assuming that one coding block 001 is divided into 4 sub-coding blocks 0011, 0012, 0013, and 0014 when coding block division is performed, when a determination is made as to whether coding block 0011 performs an intra prediction coding mode, the corresponding coding block 001 is determined as a parent coding block.
Step S203, determining whether to skip the intra-frame prediction mode of the current coding block according to the coding information of the adjacent coding block and the father coding block, and skipping the intra-frame prediction mode of the current coding block in response to the judgment result of skipping the intra-frame prediction mode of the current coding block.
From the above, by obtaining the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block, when the intra-frame preprocessing cost is greater than the inter-frame preprocessing cost and meets the initial skipping condition, determining the adjacent coding block associated with the current coding block according to the position of the current coding block and the coding sequence of each coding block, determining the parent coding block according to the division relation of the current coding block, then determining whether to skip the intra-frame prediction mode of the current coding block according to the coding conditions of the adjacent coding block and the parent coding block, skipping the intra-frame prediction mode of the current coding block in response to the judgment result of skipping the intra-frame prediction mode of the current coding block, namely, when judging whether the current coding block skips the intra-frame prediction mode, making a decision by referring to the coding information of the adjacent coding block and the parent coding block, thereby realizing the video coding efficiency is ensured, the intra-frame prediction mode is reasonably skipped, so that the coding efficiency of the coder is improved, and the time consumption of the coder in processing is obviously reduced.
Fig. 5 is a flowchart of another video coding control method according to an embodiment of the present application, which shows a specific manner for determining whether to skip an intra prediction mode of a current coding block according to coding information of adjacent coding blocks and a parent coding block, and as shown in fig. 5, the specific manner includes:
step S301, acquiring the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block.
Step S302, when the intra-frame preprocessing cost is larger than the inter-frame preprocessing cost and the current coding block meets the initial intra-frame skipping condition, the adjacent coding block and the parent coding block which are related to the current coding block are determined.
And step S303, determining the coding modes of the adjacent coding block and the parent coding block, and skipping the intra-frame prediction mode of the current coding block if the coding modes of the adjacent coding block and the parent coding block are both inter-frame coding modes.
In one embodiment, the encoding modes of the adjacent encoding blocks and the parent encoding block are determined by encoding information of the adjacent encoding blocks and the parent encoding block, the encoding information records encoding modes of the encoding blocks which have completed encoding, and the encoding modes include an inter-encoding mode and an intra-encoding mode. Specifically, the set judgment condition may be: and if the coding modes of the adjacent coding blocks and the parent coding block are both the inter-frame coding modes, skipping the intra-frame prediction mode of the current coding block and directly carrying out the prediction coding of the inter-frame prediction mode. And if the coding modes of the adjacent coding block and the parent coding block are not both the inter-coding modes, not skipping the intra-prediction mode of the current coding block.
Therefore, by determining the coding modes of the adjacent coding block and the parent coding block of the current coding block, if the coding modes of the adjacent coding block and the parent coding block are both inter-coding modes, the intra-frame prediction mode of the current coding block is skipped, and the intra-frame prediction mode of the current coding block is skipped by referring to the specific situations of the adjacent coding block and the parent coding block of the current coding block, so that the reasonable skip of the inter-frame prediction mode is realized while the video coding efficiency is ensured, the coding efficiency of the coder is improved, and the processing time consumption of the coder is obviously reduced.
Fig. 6 is a flowchart of another video coding control method according to an embodiment of the present application, where when obtaining an intra-frame preprocessing cost and an inter-frame preprocessing cost of a current coding block, the method further includes: setting the intra-frame prediction mode of the current coding block as an unavailable state; correspondingly, in response to the determination result of not skipping the intra prediction mode of the current coding block, setting the intra prediction mode of the current coding block to be in an available state, and performing predictive coding of the intra prediction mode of the current coding block, as shown in fig. 6, specifically including:
step S401, the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block are obtained, and the intra-frame prediction mode of the current coding block is set to be in an unavailable state.
In one embodiment, the skip flag is set to characterize the skip intra prediction mode of the current coding block, for example, the skip flag is set to false, which indicates that the intra prediction mode of the current coding block is unavailable. Illustratively, when determining whether to skip the intra prediction mode for each coding block, the skip flag is initialized to false in the process of acquiring the intra pre-processing cost and the inter pre-processing cost.
Step S402, when the intra-frame preprocessing cost is larger than the inter-frame preprocessing cost and the current coding block meets the condition of initial intra-frame skipping, the adjacent coding block and the parent coding block which are related to the current coding block are determined.
Step S403, determining whether to skip the intra prediction mode of the current coding block according to the coding information of the adjacent coding block and the parent coding block.
And S404, responding to the judgment result of skipping the intra-frame prediction mode of the current coding block, and skipping the intra-frame prediction mode of the current coding block.
Step S405, responding to the judgment result of not skipping the intra-frame prediction mode of the current coding block, setting the intra-frame prediction mode of the current coding block to be in an available state, and performing prediction coding of the intra-frame prediction mode of the current coding block.
In one embodiment, if it is determined that the intra prediction mode is not skipped, the intra prediction mode of the current coding block is set to be available, and the intra prediction mode of the current coding block is predicted and encoded.
As can be seen from the above, an intra prediction mode of a current coding block is set to be in an unavailable state by obtaining an intra prediction cost and an inter prediction cost of the current coding block, when the intra prediction cost is greater than the inter prediction cost and the current coding block meets an initial intra skip condition, an adjacent coding block and a parent coding block associated with the current coding block are determined, whether the intra prediction mode of the current coding block is skipped is determined according to coding conditions of the adjacent coding block and the parent coding block, the intra prediction mode of the current coding block is skipped in response to a determination result of skipping the intra prediction mode of the current coding block, the intra prediction mode of the current coding block is set to be in an available state in response to a determination result of not skipping the intra prediction mode of the current coding block, and predictive coding of the intra prediction mode of the current coding block is performed, therefore, whether the intra-frame prediction mode of the current coding block is skipped or not can be judged according to the coding conditions of the adjacent coding block and the father coding block of the current coding block, the intra-frame prediction mode is reasonably skipped by setting the available state and the unavailable state, the coding efficiency of the coder is improved, and the processing time consumption of the coder is remarkably reduced.
Fig. 7 is a block diagram of a video coding control apparatus according to an embodiment of the present application, where the apparatus is configured to execute a video coding control method according to the foregoing embodiment, and has functional modules and beneficial effects corresponding to the execution method. As shown in fig. 7, the apparatus specifically includes: a preprocessing cost acquisition module 101, an encoded block determination module 102, and an inter mode skip module 103, wherein,
a preprocessing cost obtaining module 101 configured to obtain an intra-frame preprocessing cost and an inter-frame preprocessing cost of a current coding block;
a coding block determining module 102, configured to determine, when the intra-frame preprocessing cost is greater than the inter-frame preprocessing cost and the current coding block meets an initial intra-frame skipping condition, an adjacent coding block and a parent coding block associated with the current coding block;
an intra-mode skipping module 103 configured to determine whether to skip the intra-prediction mode of the current coding block according to the coding information of the adjacent coding block and the parent coding block, and skip the intra-prediction mode of the current coding block in response to a determination result of skipping the intra-prediction mode of the current coding block.
According to the scheme, by acquiring the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block, when the intra-frame preprocessing cost is larger than the inter-frame preprocessing cost and the current coding block meets the initial intra-frame skipping condition, the adjacent coding block and the parent coding block which are associated with the current coding block are determined, whether the intra-frame prediction mode of the current coding block is skipped is determined according to the coding information of the adjacent coding block and the parent coding block, and the intra-frame prediction mode of the current coding block is skipped in response to the judgment result of the intra-frame prediction mode which is skipped over the current coding block, so that the reasonable skipping of the intra-frame prediction mode is realized while the video coding efficiency is ensured, the coding efficiency of an encoder is improved, and the processing time consumption of the encoder is remarkably reduced.
In one possible embodiment, the encoded block determination module 102 is configured to:
the level of the current coding block in the current picture group meets a preset level interval, and the division depth of the current coding block meets a preset division depth interval.
In one possible embodiment, the encoded block determination module 102 is configured to: determining an adjacent coding block associated with the current coding block according to the position of the current coding block and the coding sequence of each coding block;
and determining a parent coding block according to the division relation of the current coding block.
In a possible embodiment, the encoding order of each encoding block includes encoding sequentially from top to bottom and from left to right according to the position of each encoding block, and the encoding block determining module 102 is configured to: and determining an adjacent upper coding block and an adjacent left coding block of the current coding block as adjacent coding blocks associated with the current coding block.
In one possible embodiment, the intra mode skip module 103 is configured to:
determining coding modes of the adjacent coding blocks and the parent coding block;
and if the coding modes of the adjacent coding block and the father coding block are both inter-coding modes, skipping the intra-frame prediction mode of the current coding block.
In one possible embodiment, if the coding modes of the neighboring coding block and the parent coding block are not both inter-coding modes, the intra-prediction mode of the current coding block is not skipped.
In one possible embodiment, the preprocessing cost obtaining module 102 is configured to:
when the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block are obtained, setting the intra-frame prediction mode of the current coding block to be in an unavailable state;
accordingly, the intra mode skip module 103 is configured to: and responding to the judgment result of not skipping the intra-frame prediction mode of the current coding block, setting the intra-frame prediction mode of the current coding block to be in an available state, and performing prediction coding on the intra-frame prediction mode of the current coding block.
Fig. 8 is a schematic structural diagram of a video coding control apparatus provided in an embodiment of the present application, and as shown in fig. 8, the apparatus includes a processor 201, a memory 202, an input device 203, and an output device 204; the number of the processors 201 in the device may be one or more, and one processor 201 is taken as an example in fig. 8; the processor 201, the memory 202, the input device 203 and the output device 204 in the apparatus may be connected by a bus or other means, and fig. 8 illustrates the connection by a bus as an example. The memory 202 is a computer-readable storage medium, and can be used for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the video coding control method in the embodiment of the present application. The processor 201 executes various functional applications of the device and data processing by running software programs, instructions, and modules stored in the memory 202, that is, implements the video encoding control method described above. The input device 203 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function controls of the apparatus. The output device 204 may include a display device such as a display screen.
The present application further provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a video encoding control method described in the foregoing embodiments, specifically including:
acquiring the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block;
when the intra-frame preprocessing cost is larger than the inter-frame preprocessing cost and the current coding block meets an initial intra-frame skipping condition, determining an adjacent coding block and a parent coding block which are associated with the current coding block;
and determining whether to skip the intra-frame prediction mode of the current coding block according to the coding information of the adjacent coding block and the parent coding block, and skipping the intra-frame prediction mode of the current coding block in response to the judgment result of skipping the intra-frame prediction mode of the current coding block.
It should be noted that, in the embodiment of the video coding control apparatus, the included units and modules are only divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the embodiments of the present application.
Claims (10)
1. A video encoding control method, comprising:
acquiring the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block;
when the intra-frame preprocessing cost is larger than the inter-frame preprocessing cost and the current coding block meets an initial intra-frame skipping condition, determining an adjacent coding block and a parent coding block which are associated with the current coding block;
and determining whether to skip the intra-frame prediction mode of the current coding block according to the coding information of the adjacent coding block and the parent coding block, and skipping the intra-frame prediction mode of the current coding block in response to the judgment result of skipping the intra-frame prediction mode of the current coding block.
2. The video coding control method of claim 1, wherein the current coding block satisfies an initial intra skip condition, comprising:
the level of the current coding block in the current picture group meets a preset level interval, and the division depth of the current coding block meets a preset division depth interval.
3. The video coding control method of claim 1, wherein the determining neighboring coding blocks and a parent coding block associated with the current coding block comprises:
determining an adjacent coding block associated with the current coding block according to the position of the current coding block and the coding sequence of each coding block;
and determining a parent coding block according to the division relation of the current coding block.
4. The video coding control method of claim 3, wherein the coding order of the coding blocks comprises coding sequentially from top to bottom line by line and from left to right according to the positions of the coding blocks, and wherein the determining the adjacent coding blocks associated with the current coding block comprises:
and determining an adjacent upper coding block and an adjacent left coding block of the current coding block as adjacent coding blocks associated with the current coding block.
5. The video coding control method of claim 1, wherein the determining whether to skip the intra prediction mode of the current coding block according to the coding information of the neighboring coding blocks and the parent coding block comprises:
determining coding modes of the adjacent coding blocks and the parent coding block;
and if the coding modes of the adjacent coding block and the father coding block are both inter-coding modes, skipping the intra-frame prediction mode of the current coding block.
6. The video coding control method of claim 5, wherein if the coding modes of the neighboring coding block and the parent coding block are not both inter-coding modes, the intra-prediction mode of the current coding block is not skipped.
7. The video coding control method according to any one of claims 1 to 6, wherein when obtaining the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block, the method further comprises:
setting the intra-frame prediction mode of the current coding block as an unavailable state;
correspondingly, responding to the judgment result of not skipping the intra-frame prediction mode of the current coding block, setting the intra-frame prediction mode of the current coding block to be in an available state, and performing prediction coding on the intra-frame prediction mode of the current coding block.
8. A video encoding control apparatus, comprising:
the preprocessing cost acquisition module is configured to acquire the intra-frame preprocessing cost and the inter-frame preprocessing cost of the current coding block;
a coding block determining module configured to determine an adjacent coding block and a parent coding block associated with the current coding block when the intra-frame preprocessing cost is greater than the inter-frame preprocessing cost and the current coding block meets an initial intra-frame skipping condition;
and the intra-frame mode skipping module is configured to determine whether to skip the intra-frame prediction mode of the current coding block according to the coding information of the adjacent coding block and the parent coding block, and skip the intra-frame prediction mode of the current coding block in response to the judgment result of skipping the intra-frame prediction mode of the current coding block.
9. A video encoding control apparatus, the apparatus comprising: one or more processors; storage means for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the video encoding control method of any of claims 1-7.
10. A storage medium storing computer-executable instructions for performing the video encoding control method of any one of claims 1-7 when executed by a computer processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210200093.7A CN114449262A (en) | 2022-03-02 | 2022-03-02 | Video coding control method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210200093.7A CN114449262A (en) | 2022-03-02 | 2022-03-02 | Video coding control method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114449262A true CN114449262A (en) | 2022-05-06 |
Family
ID=81359389
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210200093.7A Pending CN114449262A (en) | 2022-03-02 | 2022-03-02 | Video coding control method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114449262A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116366839A (en) * | 2023-02-28 | 2023-06-30 | 腾讯科技（深圳）有限公司 | Decision-making method, device, equipment and storage medium of prediction mode |
| WO2023155751A1 (en) * | 2022-02-17 | 2023-08-24 | 百果园技术(新加坡)有限公司 | Video coding control method, apparatus, device, and storage medium |
| CN117596392A (en) * | 2023-09-28 | 2024-02-23 | 书行科技(北京)有限公司 | Coding information determining method of coding block and related product |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070217500A1 (en) * | 2003-12-31 | 2007-09-20 | Institute Of Computing Of Technology, Chinese Academy Of Sciences | Encoding Method for Skipped Macroblocks in Video Image |
| CN101179728A (en) * | 2007-12-13 | 2008-05-14 | 北京中星微电子有限公司 | Method and apparatus for determining interframe encoding mode |
| WO2013014693A1 (en) * | 2011-07-22 | 2013-01-31 | 株式会社日立製作所 | Video decoding method and image encoding method |
| CN108810531A (en) * | 2017-05-03 | 2018-11-13 | 腾讯科技（深圳）有限公司 | Video coding processing method, device and electronic equipment |
| WO2019148906A1 (en) * | 2018-02-01 | 2019-08-08 | 腾讯科技（深圳）有限公司 | Video coding method, computer device, and storage medium |
-
2022
- 2022-03-02 CN CN202210200093.7A patent/CN114449262A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070217500A1 (en) * | 2003-12-31 | 2007-09-20 | Institute Of Computing Of Technology, Chinese Academy Of Sciences | Encoding Method for Skipped Macroblocks in Video Image |
| CN101179728A (en) * | 2007-12-13 | 2008-05-14 | 北京中星微电子有限公司 | Method and apparatus for determining interframe encoding mode |
| WO2013014693A1 (en) * | 2011-07-22 | 2013-01-31 | 株式会社日立製作所 | Video decoding method and image encoding method |
| CN108810531A (en) * | 2017-05-03 | 2018-11-13 | 腾讯科技（深圳）有限公司 | Video coding processing method, device and electronic equipment |
| WO2019148906A1 (en) * | 2018-02-01 | 2019-08-08 | 腾讯科技（深圳）有限公司 | Video coding method, computer device, and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 孟巍;韩峥;崔慧娟;唐昆;: "H.264中SKIP和帧内模式的快速判断算法", 清华大学学报(自然科学版)网络.预览, no. 08, 15 August 2009 (2009-08-15) * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023155751A1 (en) * | 2022-02-17 | 2023-08-24 | 百果园技术(新加坡)有限公司 | Video coding control method, apparatus, device, and storage medium |
| CN116366839A (en) * | 2023-02-28 | 2023-06-30 | 腾讯科技（深圳）有限公司 | Decision-making method, device, equipment and storage medium of prediction mode |
| CN117596392A (en) * | 2023-09-28 | 2024-02-23 | 书行科技(北京)有限公司 | Coding information determining method of coding block and related product |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114449262A (en) | Video coding control method, device, equipment and storage medium | |
| US20240031576A1 (en) | Method and apparatus for video predictive coding | |
| CN111669589A (en) | Image encoding method, image encoding device, computer device, and storage medium | |
| EP4024872A1 (en) | Video coding method and apparatus, video decoding method and apparatus, electronic device, and storage medium | |
| WO2021196035A1 (en) | Video coding method and apparatus | |
| US20080095461A1 (en) | Apparatus and method for determining filter condition area in deblocking filter | |
| CN101917627B (en) | Video fault-tolerant coding method based on self-adaptation flexible macro-block order | |
| CN113573066B (en) | Video coding method and device | |
| CN111447452A (en) | Data coding method and system | |
| CN114584768A (en) | Video coding control method, device, equipment and storage medium | |
| CN111212288B (en) | Video data encoding and decoding method and device, computer equipment and storage medium | |
| CN105100799A (en) | Method for reducing intraframe coding time delay in HEVC encoder | |
| CN101977317B (en) | Intra-frame prediction method and device | |
| CN114697650B (en) | Down-sampling-based intra-frame division method, related device equipment and medium | |
| EP3742734A1 (en) | Method and device for selecting prediction direction in image encoding, and storage medium | |
| CN108111862B (en) | Video coding method and device | |
| WO2024098821A1 (en) | Av1 filtering method and apparatus | |
| CN116112691A (en) | Picture stream intelligent analysis and inspection method and device, storage medium and terminal | |
| CN112738522A (en) | Video coding method and device | |
| CN111800643A (en) | Deblocking filter for video coding and filtering method thereof | |
| CN117135364B (en) | Video decoding method and system | |
| CN117596392B (en) | Coding information determining method of coding block and related product | |
| US10491927B1 (en) | Quadtree-based bandwidth compression prediction method and system thereof | |
| CN113055670B (en) | HEVC/H.265-based video coding method and system | |
| US20240155137A1 (en) | Multimedia data processing method and apparatus, computer device, computer-readable storage medium, and computer program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |