CN1589022A - Macroblock split mode selecting method in multiple mode movement estimation decided by oriented tree - Google Patents
Macroblock split mode selecting method in multiple mode movement estimation decided by oriented tree Download PDFInfo
- Publication number
- CN1589022A CN1589022A CN 200410056862 CN200410056862A CN1589022A CN 1589022 A CN1589022 A CN 1589022A CN 200410056862 CN200410056862 CN 200410056862 CN 200410056862 A CN200410056862 A CN 200410056862A CN 1589022 A CN1589022 A CN 1589022A
- Authority
- CN
- China
- Prior art keywords
- pattern
- towards
- cut apart
- apart
- cost function
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
This invention relates to a method for determining the prediction of a macroblock segment mode among frames utilizing the character that in the segment of blocks, different sizes of pixel block motion estimation have different forward properties for SAD value due to the different space distribution of brightness value of the pixel, in a 16x16 piexl block, a forward tree structure is set up formed by 11 level different segment modes divided according to the segment granwarity to quickly determine the predict macroblock segment mode.
Description
Affiliated technical field
The invention belongs to the electron trade technical field, be specifically related in the multi-mode estimation, easy a kind of method of determining inter prediction macroblock partition pattern apace.
Background technology
Fig. 1 is to be estimation (Motion Estimation, functional schematic ME) of unit with the piece in the general video coding.The major function of ME is, for a block of pixels that is encoded (in general can be square or rectangular) in the current frame image, the window of an appointment in reference frame image (can be square or other shape, in general greater than the block of pixels that is encoded) in search differ minimum with it (in general with SAD, be absolute value difference sum Sum of Absolute Difference, be measurement standard) block of pixels, as optimum Match.
Estimation obtains two values: one: the block of pixels that is encoded is with respect to the skew of optimum Match block of pixels in the reference frame, i.e. motion vector MV (Motion Vector); Two: the residual absolute value sum SAD between the block of pixels that is encoded and the optimum Match pixel.The calculating of this part has accounted for the very big proportion (can reach 60% even higher usually) of whole cataloged procedure amount of calculation.Therefore, whether effectively the execution efficient of this part hardware be directly connected to the operation of whole integrated circuit (IC) chip.
For the coloured image of representing with passages such as brightness and colourities, estimation is general only carries out the motion estimation analysis processing to the data of luminance channel, and each Color Channel directly adopts the result of brightness estimation.This is the industrial quarters convention, and the present invention continues to use this convention.
Fig. 2 is the H.264/MPEG-4 functional schematic of estimation in the AVC standard of ITU-T.In this standard, there is the block of pixels of seven kinds of different sizes and shape to be used to estimation.
Summary of the invention
The purpose of this invention is to provide a kind ofly in the multi-mode estimation, can be easy determine the method for inter prediction macroblock partition pattern fast.
This method may further comprise the steps:
With the various possible pattern of cutting apart of one 16 * 16 block of pixels (being called " macro block " down), be divided into from 0 to 10 totally 11 grades by the particulate degree of cutting apart (granularity).
The pattern of cutting apart of 11 grades being divided into is formed a tree by certain division rule, in this structure, because many patterns of cutting apart have towards characteristic, promptly because the difference of each pixel brightness value spatial distribution makes the sad value difference of different size difference towards the block of pixels estimation, be divided into level towards with vertical towards two classes, therefore this structure forms towards tree, and the pattern of cutting apart of different stage constitutes " tree root " respectively, has towards subtree and do not have towards subtree.
Utilization is cut apart pattern and is determined inter prediction macroblock partition pattern apace towards map is easy.
Utilization is cut apart pattern and is determined that fast the method for inter prediction macroblock partition pattern comprises towards map is easy:
Select the originate mode collection: select one to comprise set of patterns that minority cuts apart pattern, see 601 among Fig. 6,602,603 and 604 for details as the originate mode collection.
Select originate mode.
The result who selects according to originate mode determines the optimum segmentation pattern of each macro block in first P frame, forms initial optimum segmentation pattern and towards map.
With the optimum segmentation pattern of determining in the previous step with towards map next predictive frame (B or P) is handled.
Wherein select the method for originate mode to comprise:
Whole algorithm is that unit carries out with GOP, and GOP is in the digital video signal sequence, from an I frame, all the P frames before and the summation of B frame occur to next I frame.The starting point of determining entire method is first P frame of digital video signal sequence units GOP.
Adopt " cost function mcost " as weighing a criterion of cutting apart the pattern quality.Cost function mcost is a numerical value that combines residual sum SAD and other coding expense (for example motion vector data etc.).If cut apart the cost function that pattern causes and cut apart the cost function that pattern causes less than another for one, then this is cut apart pattern and is better than another and cuts apart pattern.
Determine initial optimum segmentation pattern and comprise towards the method for map:
Select a macro block, it is a maximum MAX (701) that cost function mcost is set.
Concentrate one of taking-up arbitrarily to cut apart pattern from originate mode.
Adopt this pattern that selected macroblock is carried out exploratory estimation, and write down the cost function mcost of this pattern correspondence: if this cost function of cutting apart pattern then keeps the current pattern of cutting apart greater than current cost function value; If this cost function of cutting apart pattern less than current cost function value, is then cut apart pattern with this and is replaced the current pattern of cutting apart.If this cost function of cutting apart pattern equates with current cost function value, be chosen in that of in tree rank numbering less (being that fine granularity is thicker); If fine granularity is also identical, then select one arbitrarily.
Using such method respectively each macro block in first P frame of each GOP is adopted that originate mode concentrates other cut apart pattern and carry out estimation, all relatively after, that pattern of cost function mcost minimum is the optimum segmentation pattern.
After determining the initial optimum segmentation pattern of each macro block of first P frame of each GOP, promptly obtain initial optimum segmentation pattern and towards map.What this map will instruct each macro block in the later predictive frame of this GOP cuts apart determining of pattern.
Comprise with optimum segmentation pattern of determining in the previous step and the method for next predictive frame (B or P) being handled towards map:
Pass through principle of inertia, promptly utilize the correlation between present frame and the reference frame, the default pattern MODE0 (901 of cutting apart during with the cutting apart pattern (be documented in cut apart pattern and in map) and cut apart the model selection process and begin of reference frame correspondence position macro block as current macro, 902), carry out other estimation of integer pixel level.Draw the default SAD (residual sum) under the pattern, total residual sum SAD0 and the cost function mcost0 cut apart of selected macroblock.
Adopt trim step (alligatoring and refinement):
Check earlier total residual sum SAD0 whether " satisfaction ";
Because for same macro block, the sad value that causes than the coarse segmentation pattern cuts the SAD of pattern less than segmenting scarcely, therefore, this method quantitatively defines " satisfaction " with " the SAD upper limit " and " SAD lower limit "." the SAD upper limit " and " SAD lower limit " is to calculate two empirical values that obtain according to the neighbor information of selected macroblock.The way of a specific implementation example is: for current macro, according to adjacent macroblocks correlation spatially, by the SAD of its left side macro block
L, the top macro block SAD
U, the upper right side macro block SAD
URAnd the SAD of upper left side macro block
ULDetermine respectively " the SAD upper limit " and " SAD lower limit ":
The SAD upper limit=(SAD
L+ SAD
U+ SAD
UR+ SAD
UL)/4+C
1
SAD lower limit=(SAD
L+ SAD
U+ SAD
UR+ SAD
UL)/4-C
2
Wherein the quantity of the sad value of addition is denominator, C
1And C
2It is the empirical of determining by experiment.
SAD0 is compared with " the SAD upper limit " and " SAD lower limit ",, accept to cut apart the motion estimation result (905) that pattern draws with this if SAD0, just thinks that this default mode meets coding requirement between between the two.If SAD0 is greater than " the SAD upper limit ", this method thinks that this default pattern of cutting apart gets too slightly, needs " refinement ".If SAD0 is less than " SAD lower limit ", this method is thought needs this default pattern split hairs of cutting apart " alligatoring ".As the total residual sum SAD1 that the default pattern of cutting apart carried out alligatoring/refinement, then can get making new advances and new integrate-cost function m cost1.
Compare step: be about to new integrate-cost function m cost1 and default integrate-cost function m cost0 compares, keep less one.
Modification is cut apart pattern and towards map: determine whether to revise according to the result in the comparison step and cut apart pattern and towards map, promptly keep and confirm the pairing mode of integrate-cost function m cost that keeps in the above-mentioned steps.In view of the above to cut apart pattern and in map the entry of this macro block make amendment or prolong usefulness, and in the next predictive frame the default pattern of cutting apart of the macro block of correspondence position.
Along in the process of tree alligatoring and refinement, exist to allow and the pattern of cutting apart that is not allowed to.As current cut apart pattern and in topographic map corresponding selected macroblock towards be masked as level towards, then refinement/alligatoring rule allows this to cut apart pattern to be cut apart pattern by refinement/alligatoring for another level, be an isotropism pattern (will keep level simultaneously) perhaps, but can not refinement/alligatoring be that a nothing is towards pattern towards sign by refinement/alligatoring.(in like manner be applicable to vertically towards.)
As current cut apart pattern and in topographic map corresponding selected macroblock towards be masked as level towards, to cut apart pattern be an isotropism pattern (all having some isotropism patterns towards subtree with vertical in subtree in level) and sound out, and this pattern need be by refinement/alligatoring, it is that a level is cut apart pattern by refinement/alligatoring that then refinement/alligatoring rule allows this to cut apart pattern, but can not refinement/alligatoring be that a nothing is towards pattern.(in like manner be applicable to vertically towards.)
Situation when the method that the present invention proposes extends to more than a reference frame.In the time of need using a plurality of reference frame as the estimation of present frame, cutting apart pattern and all preserved each reference frame towards map.These reference frames are all from same GOP, but because the existence of refinement and alligatoring mechanism, therefore with regard to each macro block, pairing is consistent towards sign in each reference frame corresponding map; But in each map, provide to cut apart pattern then not necessarily consistent.
The present invention is directed to such as H.264 waiting and realize the rather time-consuming situation of many sized blocks estimation that high-performance code adopted in the standard, proposed a kind ofly in multiple different inter prediction macroblock partition pattern, to select a kind of pattern of better cutting apart rapidly, effectively reduced the method for above-mentioned selection course institute spended time.The present invention is applicable to the two-way reference (B-Frame) in the standard such as MPEG-2 simultaneously, H.264 waits multiframe in the standard with reference to (Multi-frame Reference).
Description of drawings
Fig. 1 is for being estimation (Motion Estimation, functional schematic ME) of unit with the block of pixels in the general video coding;
Fig. 2 is the H.264/MPEG-4 functional schematic of estimation in the AVC standard of ITU-T;
Fig. 3 is 11 ranks of macroblock partition pattern;
Fig. 4 for of the present invention towards tree thought schematic diagram (contain have and do not have) towards subtree towards subtree;
Fig. 5 is the schematic diagram of will putting of the present invention, i.e. model selection flow chart when each GOP carries out estimation in the video sequence;
Four of concentrating for originate mode of Fig. 6 are cut apart pattern;
Fig. 7 for the initial optimum segmentation pattern of determining a macro block and towards flow chart;
Fig. 8 is for cutting apart pattern and towards map;
Fig. 9 is the flow chart of each macro block in all the other predictive frames except that first P frame among GOP of processing;
Figure 10 shows along allowing and unallowed operation in tree alligatoring and thinning process;
A plurality of when Figure 11 estimates for the multiframe reference motion are cut apart pattern and towards map.
Embodiment
Below in conjunction with accompanying drawing embodiments of the invention are described in further detail.
Fig. 3 shows, we can be with the various possible pattern of cutting apart to one 16 * 16 block of pixels (hereinafter referred to as " macro block "), is divided into from 0 to 10 totally 11 grades by the particulate degree of cutting apart (granularity).Wherein, the 0th grade is had only a pattern, promptly this macro block is not done any pattern of cutting apart.The 1st grade has two patterns, is about to the pattern that this macro block is divided into the pattern of two 16 * 8 block of pixels and is divided into two 8 * 16 block of pixels.The 2nd grade has a pattern, is about to the pattern that this macro block is divided into four 8 * 8 block of pixels.Or the like.
Fig. 4 shows that the present invention forms a tree with the pattern of cutting apart of 11 grades shown in Figure 3 by certain division rule.This tree " tree root " has only one, is in the 0th grade, promptly this macro block do not done the pattern of any cutting apart (401).This tree root pattern has two direct " children " to cut apart pattern (the 1st grade of pattern), promptly is divided into the pattern (402) of two 16 * 8 block of pixels and is divided into the pattern (403) of two 8 * 16 block of pixels.Wherein, notice that pattern (402) has the advantages that level is cut apart, and pattern (403) have the characteristics of vertical segmentation.In general, concerning same 16 * 16 block of pixels, take exercises with two 16 * 8 block of pixels and to estimate the sad value that obtains, the sad value that obtains with the estimation of taking exercises with two 8 * 16 block of pixels is different.Its result is often relevant with the spatial distribution of each pixel brightness value in this macro block, we this specific character call block of pixels in cutting apart towards characteristic, total level towards with vertical towards two classes.
The 2nd grade of tree has two patterns, i.e. pattern (404) and pattern (405), and they all are the block of pixels that former 16 * 16 macro blocks is divided into 48 * 8.We notice that it is duplicate cutting apart pattern for these two, and segmentation obtains but they pass through further by different " father and mother " patterns (402) and (403) respectively, so list it respectively in tree.
From the 2nd grade down, whole tree is divided into to be had towards subtree (comprise level towards subtree with vertical towards subtree) and not to have towards subtree.There is " growth " rule to be: children's pattern of each pattern towards subtree, be on the basis of this pattern, for any one square pixel piece (8 * 8) of remaining in the horizontal direction on (descendants) or the vertical direction for 402 (descendants) to 403 once divide equally just and form; Be on the basis of this pattern, with a pair of have towards the rectangular pixels piece be divided into four 4 * 4 block of pixels and form.This process is performed until this macro block and all is divided into till 16 4 * 4 block of pixels (410).According to this rule as seen, from the 2nd grade of growth, only used article one rule to 3rd level; And from 3rd level growth course down, two rules have all been used; Only used the second rule from the 9th grade to the 10th grade.
What form like this has following three characteristics towards subtree:
1, the closer to the pattern of cutting apart of root, fine granularity spatially is thick more; And more away from the pattern of cutting apart of root, the fine granularity on the space is thin more.
2, by in 402 patterns level down each pattern in subtree, only exist divided in horizontal direction or isotropism to cut apart (i.e. four 4 * 4 block of pixels or four 8 * 8 block of pixels), do not exist vertical direction to cut apart.And, only exist vertical direction to cut apart or isotropism is cut apart by in 403 patterns vertical each pattern in subtree down, there is not divided in horizontal direction.
3, with vertical some is cut apart pattern and is equal in branch, for example pattern (404) is identical with (405) towards branch for level, and pattern (410) is the leaf of all branches, etc.
From 9 grades of 3rd levels to the, every level that promptly do not belong to or not vertically mixing towards subtree again towards cutting apart pattern towards subtree, and we are included into nothing towards subtree with them., in cutting apart pattern, or cut apart by isotropism entirely and form a nothing, or both having contained level cuts apart and also contain vertical segmentation.Nothing also is divided into some levels by the particulate degree of cutting apart towards subtree, and wherein the pattern in each grade is one 8 * 8 block of pixels just once to be segmented and obtain (for example pattern 408 and 409 relation) on upper level pattern basis.In the method, Tong Ji pattern particulate degree is considered to equally.
Fig. 5 shows that the bare bones of cutting apart mode selecting method proposed by the invention comprises:
● the whole algorithm process is that unit carries out with GOP.GOP is a unit of digital video signal sequence.General digital video signal sequence is made of some frames, comprising I frame (promptly can not rely on the information of other frame to the encoding and decoding of this frame and independently carry out), P frame (promptly need rely on the frame that early occurs in the sequence to the encoding and decoding of this frame on time shaft or the information of some frames just can be carried out) and B frame (promptly need rely in the sequence on time shaft the encoding and decoding of this frame and just can carry out morning and two frames of later appearance or the information of some frames) etc.From an I frame, all P frames and B frame before occur to next I frame and be called as a GOP.Initial first P frame of this method since a GOP.
● select originate mode collection and originate mode.H.264 waiting in the video encoding standard, need sound out the more than one pattern of cutting apart usually, cutting apart pattern and can cause forced coding this macro block so which kind of to be determined to the inter prediction formula of each 16 * 16 macro block in the P frame (or B frame) coding.So-called " the best " can have many different criterions, and for the sake of simplicity and be without loss of generality, we use " cost function (mcost) " to be used as weighing a criterion of cutting apart the pattern quality in the following description.Through after the exploratory calculating, cost function can be quantified as an integer.Cost function mcost is a numerical value that combines residual sum SAD and other coding expense (for example motion vector data etc.).In our method,, just think that this is cut apart pattern and is better than another and cuts apart pattern if one cuts apart the cost function that pattern causes and cuts apart the cost function that pattern causes less than another.All are cut apart in the pattern in that this method is soundd out, and the best pattern of cutting apart is that of cost function minimum.
When this method is carried out predictive coding to a GOP, we do not wish Fig. 3 is listed all cut apart pattern and all sound out one time, the required like that time is too many.For this reason, we at first select one to comprise minority and cut apart the originate mode collection of pattern and sound out (501).In the method, the pattern of cutting apart of selected originate mode collection can be arbitrarily, and Fig. 6 shows, in a specific implementation example, we are with 2 16 * 8 (seeing 601), 28 * 16 (seeing 602), and 88 * 4 (seeing 603), 84 * 8 (seeing 604) are cut apart pattern as the originate mode collection for these 4 kinds.Cutting apart pattern for these 4 all has towards property, and wherein, pattern 601 and 602 is arranged in Fig. 4 the 1st grade towards tree, and pattern 603 and 604 is arranged in Fig. 4 the 6th grade towards tree.
To first P frame among each GOP cut apart pattern determine it is the basis of subsequent process.Therefore, when allow computing time, concentrate at originate mode also to comprise more kinds of patterns of cutting apart.
● determine initial optimum segmentation pattern and towards map.To each macro block of first P frame of each GOP, each pattern that this method adopts originate mode to concentrate is carried out exploratory estimation (502), and detailed process is seen Fig. 7.At first cost function is initialized as a maximum MAX (701).Cut apart cost function that pattern causes greater than current cost function value if one new, then keep the current pattern of cutting apart; Cut apart cost function that pattern causes less than current cost function value if one new, then replace the current pattern of cutting apart with this new pattern of cutting apart.If new cost function equates with existing cost function value, then be chosen in that of in tree rank numbering less (being that fine granularity is thicker); If fine granularity is also identical, then select one arbitrarily.
After the optimum segmentation pattern of each macro block of first P frame of each GOP all determines, we just obtain as shown in Figure 8 initial optimum segmentation pattern and towards map.What this figure will instruct each macro block in the later predictive frame of this GOP cuts apart determining of pattern.
Fig. 9 shows, utilize cut apart pattern and towards map to a GOP in the method handled of all the other predictive frames (B or P) except that first P frame.Its details was divided into for four steps:
● principle of inertia: because the motion relevance between the motion image sequence consecutive frame, the optimum segmentation pattern of consecutive frame correspondence position macro block is close often, or even identical.Therefore, utilize the correlation between present frame and the reference frame, the default pattern (901 of cutting apart during with the cutting apart pattern (be documented in cut apart pattern and in map) and cut apart the model selection process and begin of reference frame correspondence position macro block as current macro, 902), and carry out other estimation of integer pixel level.
Above-mentionedly cut apart the result that pattern is put in order the pixel scale estimation, comprise that this cuts apart the SAD of each piecemeal in the pattern (residual sum), total residual sum SAD0 of this macro block, and a cost function mcost0 with default.
● trim step (alligatoring and refinement): next this method enters trim step.Whether the total residual sum SAD0 that checks earlier this macro block " satisfaction "." the SAD upper limit " and " SAD lower limit " with SAD0 and this macro block compares for this reason.Here, " the SAD upper limit " and " SAD lower limit " is to extrapolate according to the neighbor information of this macro block.The way of a specific implementation example is: for current macro, according to adjacent macroblocks correlation spatially, by the SAD of its left side macro block
L, the top macro block SAD
U, the upper right side macro block SAD
URAnd the SAD of upper left side macro block
ULDetermine:
The SAD upper limit=(SAD
L+ SAD
U+ SAD
UR+ SAD
UL)/4+C
1
SAD lower limit=(SAD
L+ SAD
U+ SAD
UR+ SAD
UL)/4-C
2
C wherein
1And C
2It is the empirical of determining by experiment.
Because for same macro block, the sad value that causes than the coarse segmentation pattern cuts the SAD of pattern less than segmenting scarcely, therefore, this method quantitatively defines " satisfaction " with " the SAD upper limit " and " SAD lower limit ".If SAD0, just thinks that this default mode meets coding requirement between between the two, accept to cut apart the motion estimation result (905) that pattern draws with this.If SAD0 is greater than " the SAD upper limit ", this method thinks that this default pattern of cutting apart gets too slightly, needs " refinement ".If SAD0 is less than " SAD lower limit ", this method is thought needs this default pattern split hairs of cutting apart " alligatoring ".
In the method, alligatoring and refinement have two common features:
1, alligatoring and refinement are all being carried out under the sign constraint, that is to say, for each macro block, if to the coding of first P frame of a GOP time, be registered as alignment target, then among this GOP in all subsequent prediction frames the macro block of this position all will carry out estimation with the pattern of cutting apart of level in subtree; If to the coding of first P frame of a GOP time, be registered as vertical sign, then among this GOP in all subsequent prediction frames the macro block of this position all will carry out estimation with the vertical pattern of cutting apart in subtree.
2, alligatoring and refinement are all only carried out at the adjacent level in tree.That is to say, if the current default pattern of cutting apart is positioned at towards the K level of setting, then the result of alligatoring selects one in same K-1 level towards tree to cut apart pattern, and the result of refinement selects one in same K+1 level towards tree to cut apart pattern (0＜K＜10).
● comparison step.The result of alligatoring or refinement still needs further to compare with former default mode, could determine whether be used.Criterion relatively is integrate-cost function m cost.If the mcost of new model is less, then adopts the new pattern of cutting apart, otherwise keep former default mode.
● revise and to cut apart pattern and towards map.If in above-mentioned fine setting and comparison step, accepted the default mode m ode0 of cutting apart, then needn't to cut apart pattern and in map the entry of this macro block make amendment, this is default cuts apart the macro block that pattern will be in use to correspondence position in the next predictive frame.If alligatoring or refinement have taken place in above-mentioned trim step and have adopted the new mode m ode1 of cutting apart to substitute the default mode m ode0 of cutting apart, then cut apart pattern and in map the entry of this macro block be modified to mode1, as the default pattern of cutting apart of the macro block of correspondence position in the next predictive frame.
Figure 10 shows, along in tree alligatoring and thinning process, permission cut apart model selection with unallowed.Wherein, Figure 10 (A) expression, if current cut apart pattern and towards corresponding this macro block of topographic map kind towards be masked as level towards, then refinement rule allows this to cut apart pattern to be refined as another level and to cut apart pattern, perhaps be refined as an isotropism pattern (will keep level simultaneously), but can not be refined as a nothing towards pattern towards sign.(in like manner be applicable to vertically towards.) Figure 10 (B) demonstration, if current cut apart pattern and towards corresponding this macro block of topographic map kind towards be masked as level towards, to cut apart pattern be an isotropism pattern (all having some isotropism patterns towards subtree with vertical in subtree in level) and sound out, and this pattern need be by refinement, then refinement rule allows this to cut apart pattern to be refined as a level and to cut apart pattern, but can not be refined as a nothing towards pattern.(in like manner be applicable to vertically towards.)
Figure 10 (C) shows, if current cut apart pattern and towards corresponding this macro block of topographic map kind towards be masked as level towards, then alligatoring rule allows this to cut apart pattern to be cut apart pattern by alligatoring for another level, be an isotropism pattern (will keep level simultaneously) perhaps, but can not alligatoring be that a nothing is towards pattern towards sign by alligatoring.(in like manner be applicable to vertically towards.) Figure 10 (D) demonstration, if current cut apart pattern and towards corresponding this macro block of topographic map kind towards be masked as level towards, to cut apart pattern be an isotropism pattern and sound out, and this pattern need be by alligatoring, then to allow this to cut apart pattern be that a level is cut apart pattern by alligatoring for alligatoring rule, but can not alligatoring be that a nothing is towards pattern.(in like manner be applicable to vertically towards.)
Figure 11 shows, the situation the when method that the present invention is proposed is generalized to more than a reference frame.The two-way reference (B-Frame) that this is applicable in the standard such as MPEG-2 is applicable to that also the multiframe that H.264 waits in the standard is with reference to (Multi-frame Reference).As shown, if the estimation of present frame need be used reference frame A, B, C, and D, then this method requires reference frame A, B, C, D's cuts apart pattern and is all preserved towards map.Because these reference frames are all from same GOP, therefore with regard to each macro block, pairing towards sign at map A, map B, map C and is consistent among the map D; But because the existence of alligatoring and refinement mechanism, usually, with regard to each macro block, the pattern of cutting apart that it provides in each map is not necessarily consistent.In a specific implementation example, our regulation: with regard to a macro block, it finally cuts apart determining and need each map all being compared by the flow process of Fig. 9 of pattern, and cuts apart pattern with that of cost function mcost minimum as it.When certain two map occurring and provide same cost function just, this method is selected thicker that of particulate degree.
Claims (9)
1, in the multiple dimensioned estimation of multi-mode that with the piece is unit, can be easy determine the method for inter prediction macroblock partition pattern fast, comprise following feature:
1), is divided into from 0 to 10 totally 11 grades by the particulate degree of cutting apart (granularity) with the various possible pattern of cutting apart of one 16 * 16 block of pixels (being called " macro block " down).
2) pattern of cutting apart of 11 grades being divided into is formed a tree by certain division rule, in this structure, because block of pixels is cut apart and is had towards characteristic in the macro block, be that the difference of each pixel brightness value spatial distribution makes the sad value difference of different size block of pixels estimation, be divided into level towards with vertical towards two classes, so this structure forms towards tree.
3) utilize and to cut apart pattern and to determine inter prediction macroblock partition pattern fast towards map is easy.
4) be that unit makes decision to the motion estimation mode of each macro block of each predictive frame in the video sequence with GOP, comprising: (1), to the processing method of first P frame among the GOP; (2) with fixed optimum segmentation pattern in first P frame and towards map to GOP in the method handled of all the other predictive frames (B or P), it is characterized in that having adopted on the time shaft inertia to cut apart pattern thought and inching thought.
Situation when 5) this method is applied to more than a reference frame.
2, according to claim 1 the various of a macro block may be cut apart the method that pattern is divided into 11 grades, be characterised in that by particulate degree (granularity) classification of cutting apart pattern, wherein, the 0th grade is had only a pattern, promptly this macro block is not done any pattern of cutting apart; The 1st grade has two patterns, is about to the pattern that this macro block is divided into the pattern of two 16 * 8 block of pixels and is divided into two 8 * 16 block of pixels; The 2nd grade has a pattern, is about to the pattern that this macro block is divided into four 8 * 8 block of pixels.Or the like.
3, foundation according to claim 1 is characterised in that the pattern of cutting apart with 11 grades in the claim 2 towards the method for tree, according to forming a tree towards characteristic by certain division rule, specifically comprises following feature:
1) " tree root " has only one, is in the 0th grade, promptly this macro block do not done any pattern of cutting apart.
2) this tree root pattern has two direct " children " to cut apart pattern (the 1st grade of pattern), promptly is divided into two and has level and cut apart 16 * 8 block of pixels patterns of characteristics and be divided into two 8 * 16 block of pixels patterns with vertical segmentation characteristics.
3) the 2nd grade of tree has two patterns, and they all are the block of pixels that former 16 * 16 macro blocks is divided into 48 * 8, respectively by " father and mother " pattern different in the 1st grade of pattern through further segmentation and obtain, but these two to cut apart pattern be duplicate.
4) from the 2nd grade down, whole tree is divided into to be had towards subtree (comprise level towards subtree with vertical towards subtree) and not to have towards subtree.Have towards subtree and have two " growth " rules: children's pattern of each pattern, or be on the basis of this pattern, to any one square pixel piece (8 * 8) of remaining in the horizontal direction or once divide equally just on the vertical direction and form; Be on the basis of this pattern, with a pair of have towards the rectangular pixels piece be divided into four 4 * 4 block of pixels and form.This process is performed until this macro block and all has been divided into till 16 4 * 4 block of pixels.What form like this has following three characteristics towards subtree:
A. the closer to the pattern of cutting apart of root, fine granularity spatially is thick more; And more away from the pattern of cutting apart of root, the fine granularity on the space is thin more.
B. by in the 1st grade of horizontal/vertical down each pattern in subtree, only exist in the same way direction to cut apart or isotropism is cut apart (i.e. four 4 * 4 block of pixels or four 8 * 8 block of pixels), do not exist inverse direction to cut apart.
C. with vertical some is cut apart pattern and is equal in branch, the 10th grade of pattern is the leaf of all branches to level towards branch.
5) from 9 grades of 3rd levels to the, every level that neither belongs to or not vertically mixing towards subtree again towards cutting apart pattern towards subtree, all is included into nothing towards subtree.Nothing is towards " growth " rule of subtree:, or cut apart by isotropism entirely and form in cutting apart pattern a nothing, or both having contained level cuts apart and also contain vertical segmentation, at the same level to cut apart pattern particulate degree all the same.
4, utilization according to claim 1 is cut apart pattern and is determined that fast the method for inter prediction macroblock partition pattern may further comprise the steps towards map is easy:
1) one of selection comprises minority and cuts apart the set of patterns of pattern as the originate mode collection.
2) concentrate the selection originate mode from originate mode.
3) result who selects according to originate mode determines among the GOP optimum segmentation pattern of each macro block in first P frame, forms to cut apart pattern and towards map.
4) with 3) in the optimum segmentation pattern determined and towards next predictive frame (B or P) is handled.
5, the method for selection originate mode according to claim 4 is characterized in that having adopted starting point thought, comprises as follows:
1) whole algorithm is that unit carries out with digital video signal sequence units GOP.Determine the starting point of entire method first P frame for each GOP.
2) adopt " cost function mcost " as weighing a criterion of cutting apart the pattern quality.Cost function mcost is a numerical value that combines residual sum SAD and other coding expense (for example motion vector data etc.).If cut apart the cost function that pattern causes and cut apart the cost function that pattern causes less than another for one, then this is cut apart pattern and is better than another and cuts apart pattern.
3) to first P frame among each GOP cut apart pattern determine it is the basis of subsequent process.Therefore, when allow computing time, concentrate at originate mode also to comprise more kinds of patterns of cutting apart, and can be arbitrarily.
6, the result who selects according to originate mode according to claim 4 determines the optimum segmentation pattern of each macro block in first P frame, formation is cut apart pattern and towards the method for map, it is characterized in that getting minimum value, comprise as follows to cost function with towards comparing:
1) select a macro block, it is a maximum MAX (701) that cost function is set.
2) concentrate one of taking-up arbitrarily to cut apart pattern from originate mode, adopt this pattern that selected macroblock is carried out exploratory estimation, and write down the cost function mcost of this pattern correspondence: if this cost function of cutting apart pattern then keeps the current pattern of cutting apart greater than current cost function value; If this cost function of cutting apart pattern less than current cost function value, is then cut apart pattern with this and is replaced the current pattern of cutting apart.If this cost function of cutting apart pattern equates with current cost function value, be chosen in that of in tree rank numbering less (being that fine granularity is thicker); If fine granularity is also identical, then select one arbitrarily.
3) Using such method respectively each macro block in first P frame of each GOP is adopted that originate mode concentrates other cut apart pattern and carry out estimation, all relatively after, that pattern of cost function mcost minimum is the optimum segmentation pattern.
4) determine the initial optimum segmentation pattern of each macro block of first P frame of each GOP after, can obtain initial optimum segmentation pattern and towards map.
7, fixed optimum segmentation pattern of usefulness according to claim 4 and the method next predictive frame (B or P) handled towards map is characterized in that having adopted on the time shaft inertia to cut apart pattern thought and inching thought, comprise as follows:
1) inertia is cut apart pattern thought on the time shaft, promptly utilize the correlation between present frame and the reference frame, the default pattern MODE0 of cutting apart during with the cutting apart pattern (be documented in right 6 described optimum segmentation patterns and in map) and cut apart the model selection process and begin as current macro of reference frame correspondence position macro block carries out other estimation of integer pixel level.Draw the default SAD (residual sum) under the pattern, total residual sum SAD0 and the cost function mcost0 cut apart of selected macroblock.
2) inching thought: SAD0 is compared with quantitative defining standard " the SAD upper limit " and " SAD lower limit ", whether judge according to the result and to cut apart pattern adjustment default, thereby determine to accept the default cost function mcost of cutting apart pattern, still through the current pattern cost function mcost1 of cutting apart after the inching.
3) compare step: be about to new integrate-cost function m cost1 and default integrate-cost function m cost0 compares, select less that of cost function to cut apart pattern.
4) revise and to cut apart pattern and towards map: determine whether to revise according to the result in the comparison step and cut apart pattern and, promptly keep and confirm the pairing mode of integrate-cost function m cost that keeps in the above-mentioned steps towards map.In view of the above to cut apart pattern and in map the entry of this macro block make amendment or prolong usefulness, and in the next predictive frame the default pattern of cutting apart of the macro block of correspondence position.
8, inching thought according to claim 7, i.e. the method for alligatoring and refinement comprises following feature:
1) this method quantitatively defines " satisfaction " with " the SAD upper limit " and " SAD lower limit "." the SAD upper limit " and " SAD lower limit " is to calculate two empirical values that obtain according to the neighbor information of selected macroblock.Default total residual sum SAD0 of cutting apart pattern is compared with " the SAD upper limit " and " SAD lower limit ",, accept to cut apart the motion estimation result that pattern draws with this if SAD0, just thinks that this default mode meets coding requirement between between the two.If SAD0 is greater than " the SAD upper limit ", this method thinks that this default pattern of cutting apart gets too slightly, needs " refinement ".If SAD0 is less than " SAD lower limit ", this method is thought needs this default pattern split hairs of cutting apart " alligatoring ".
2) in the method, alligatoring and refinement have two common features:
A. alligatoring and refinement are all being carried out under the sign constraint.Promptly for each macro block, if to the coding of first P frame of a GOP time, be registered as the horizontal/vertical sign, then among this GOP in all subsequent prediction frames this macro block all will carry out estimation with the equidirectional pattern of cutting apart in subtree.
B. alligatoring and refinement are all only carried out at the adjacent level in tree.If the promptly current default pattern of cutting apart is positioned at towards the K level of setting, then the result of alligatoring selects one in same K-1 level towards tree to cut apart pattern, and the result of refinement selects one in same K+1 level towards tree to cut apart pattern (0＜K＜10).
3), exist to allow and the pattern of cutting apart that is not allowed to along in the process of tree alligatoring and refinement.As current cut apart pattern and in topographic map corresponding selected macroblock towards be masked as level towards, then refinement/alligatoring rule allows this to cut apart pattern to be cut apart pattern by refinement/alligatoring for another level, be an isotropism pattern (will keep level simultaneously) perhaps, but can not refinement/alligatoring be that a nothing is towards pattern towards sign by refinement/alligatoring.(in like manner be applicable to vertically towards.)
As current cut apart pattern and in topographic map corresponding selected macroblock towards be masked as level towards, to cut apart pattern be an isotropism pattern (all having some isotropism patterns towards subtree with vertical in subtree in level) and sound out, and this pattern need be by refinement/alligatoring, it is that a level is cut apart pattern by refinement/alligatoring that then refinement/alligatoring rule allows this to cut apart pattern, but can not refinement/alligatoring be that a nothing is towards pattern.(in like manner be applicable to vertically towards.)
Situation when 9, this method according to claim 1 may be used on more than a reference frame, characteristics comprise:
1) in the time of need using a plurality of reference frame as the estimation of present frame, cutting apart pattern and all preserved each reference frame towards map.These reference frames are all from same GOP, but because the existence of refinement and alligatoring mechanism, therefore with regard to each macro block, pairing is consistent towards sign in each reference frame corresponding map; But in each map, provide to cut apart pattern then not necessarily consistent.
2) with regard to a macro block, it finally cuts apart determining and need all comparing each map of pattern, and cuts apart pattern with that of cost function mcost minimum as it.
3) when certain two map occurring and provide same cost function just, this method is selected thicker that of particulate degree.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200410056862 CN1589022A (en) | 2004-08-26 | 2004-08-26 | Macroblock split mode selecting method in multiple mode movement estimation decided by oriented tree |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200410056862 CN1589022A (en) | 2004-08-26 | 2004-08-26 | Macroblock split mode selecting method in multiple mode movement estimation decided by oriented tree |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN1589022A true CN1589022A (en) | 2005-03-02 |
Family
ID=34603230
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200410056862 Pending CN1589022A (en) | 2004-08-26 | 2004-08-26 | Macroblock split mode selecting method in multiple mode movement estimation decided by oriented tree |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1589022A (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100397906C (en) * | 2005-08-24 | 2008-06-25 | 天津大学 | A fast inter-frame mode selection method for video information |
| CN100405851C (en) * | 2005-11-18 | 2008-07-23 | 宁波中科集成电路设计中心有限公司 | Design Method of Motion Vector Prediction Multiplexing in Multimode Standard Decoder |
| CN101022555B (en) * | 2007-02-12 | 2010-12-08 | 清华大学 | Fast Mode Selection Method for Inter-Frame Predictive Coding |
| CN101605262B (en) * | 2009-07-09 | 2011-11-09 | 杭州士兰微电子股份有限公司 | Method and device for predicting size motion of variable block |
| CN102611882A (en) * | 2011-01-19 | 2012-07-25 | 华为技术有限公司 | Encoding and decoding method and device |
| CN104050512A (en) * | 2013-03-15 | 2014-09-17 | Sap股份公司 | Transport time estimation based on multi-granular map |
| CN101848391B (en) * | 2005-09-26 | 2014-11-26 | 三菱电机株式会社 | Dynamic image encoding device and dynamic image decoding device |
| CN104601988A (en) * | 2014-06-10 | 2015-05-06 | 腾讯科技（北京）有限公司 | Video coder, method and device and inter-frame mode selection method and device thereof |
| CN105635733A (en) * | 2015-12-29 | 2016-06-01 | 广东顺德中山大学卡内基梅隆大学国际联合研究院 | Optimal telescopic multi-mode decision method based on motion information |
| TWI553593B (en) * | 2010-04-13 | 2016-10-11 | Ｇｅ影像壓縮有限公司 | Decoder, method for decoding and related encoder, method for encoding and digital storage medium |
| WO2017008678A1 (en) * | 2015-07-15 | 2017-01-19 | Mediatek Singapore Pte. Ltd | Method of conditional binary tree block partitioning structure for video and image coding |
| US9807427B2 (en) | 2010-04-13 | 2017-10-31 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| CN109302613A (en) * | 2018-10-26 | 2019-02-01 | 西安科锐盛创新科技有限公司 | Based on the prediction technique of macroblock partition in bandwidth reduction |
| CN109302607A (en) * | 2018-10-26 | 2019-02-01 | 西安科锐盛创新科技有限公司 | More prediction techniques and its system based on image scene |
| US20190089962A1 (en) | 2010-04-13 | 2019-03-21 | Ge Video Compression, Llc | Inter-plane prediction |
| US10248966B2 (en) | 2010-04-13 | 2019-04-02 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
-
2004
- 2004-08-26 CN CN 200410056862 patent/CN1589022A/en active Pending
Cited By (91)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100397906C (en) * | 2005-08-24 | 2008-06-25 | 天津大学 | A fast inter-frame mode selection method for video information |
| CN101848391B (en) * | 2005-09-26 | 2014-11-26 | 三菱电机株式会社 | Dynamic image encoding device and dynamic image decoding device |
| CN100405851C (en) * | 2005-11-18 | 2008-07-23 | 宁波中科集成电路设计中心有限公司 | Design Method of Motion Vector Prediction Multiplexing in Multimode Standard Decoder |
| CN101022555B (en) * | 2007-02-12 | 2010-12-08 | 清华大学 | Fast Mode Selection Method for Inter-Frame Predictive Coding |
| CN101605262B (en) * | 2009-07-09 | 2011-11-09 | 杭州士兰微电子股份有限公司 | Method and device for predicting size motion of variable block |
| US10708629B2 (en) | 2010-04-13 | 2020-07-07 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US11102518B2 (en) | 2010-04-13 | 2021-08-24 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US9596488B2 (en) | 2010-04-13 | 2017-03-14 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| TWI578273B (en) * | 2010-04-13 | 2017-04-11 | Ｇｅ影像壓縮有限公司 | Decoder, method for decoding and related encoder, method for encoding and digital storage medium |
| US12513307B2 (en) | 2010-04-13 | 2025-12-30 | Dolby Video Compression, Llc | Inter-plane prediction |
| US12328453B2 (en) | 2010-04-13 | 2025-06-10 | Dolby Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US12155871B2 (en) | 2010-04-13 | 2024-11-26 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US20170134761A1 (en) | 2010-04-13 | 2017-05-11 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US9807427B2 (en) | 2010-04-13 | 2017-10-31 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US10748183B2 (en) | 2010-04-13 | 2020-08-18 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US12120316B2 (en) | 2010-04-13 | 2024-10-15 | Ge Video Compression, Llc | Inter-plane prediction |
| US12010353B2 (en) | 2010-04-13 | 2024-06-11 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US10003828B2 (en) | 2010-04-13 | 2018-06-19 | Ge Video Compression, Llc | Inheritance in sample array multitree division |
| US10038920B2 (en) | 2010-04-13 | 2018-07-31 | Ge Video Compression, Llc | Multitree subdivision and inheritance of coding parameters in a coding block |
| US10051291B2 (en) | 2010-04-13 | 2018-08-14 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US20180324466A1 (en) | 2010-04-13 | 2018-11-08 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US11983737B2 (en) | 2010-04-13 | 2024-05-14 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US11910029B2 (en) | 2010-04-13 | 2024-02-20 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division preliminary class |
| US11910030B2 (en) | 2010-04-13 | 2024-02-20 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US11900415B2 (en) | 2010-04-13 | 2024-02-13 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US20190089962A1 (en) | 2010-04-13 | 2019-03-21 | Ge Video Compression, Llc | Inter-plane prediction |
| US10248966B2 (en) | 2010-04-13 | 2019-04-02 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US10719850B2 (en) | 2010-04-13 | 2020-07-21 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US20190164188A1 (en) | 2010-04-13 | 2019-05-30 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US20190174148A1 (en) | 2010-04-13 | 2019-06-06 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US11856240B1 (en) | 2010-04-13 | 2023-12-26 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US20190197579A1 (en) | 2010-04-13 | 2019-06-27 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US10432978B2 (en) | 2010-04-13 | 2019-10-01 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US10432979B2 (en) | 2010-04-13 | 2019-10-01 | Ge Video Compression Llc | Inheritance in sample array multitree subdivision |
| US10432980B2 (en) | 2010-04-13 | 2019-10-01 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US10440400B2 (en) | 2010-04-13 | 2019-10-08 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US10448060B2 (en) | 2010-04-13 | 2019-10-15 | Ge Video Compression, Llc | Multitree subdivision and inheritance of coding parameters in a coding block |
| US10460344B2 (en) | 2010-04-13 | 2019-10-29 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US10621614B2 (en) | 2010-04-13 | 2020-04-14 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US10672028B2 (en) | 2010-04-13 | 2020-06-02 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US10681390B2 (en) | 2010-04-13 | 2020-06-09 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US10687085B2 (en) | 2010-04-13 | 2020-06-16 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US10687086B2 (en) | 2010-04-13 | 2020-06-16 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US10694218B2 (en) | 2010-04-13 | 2020-06-23 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| TWI553593B (en) * | 2010-04-13 | 2016-10-11 | Ｇｅ影像壓縮有限公司 | Decoder, method for decoding and related encoder, method for encoding and digital storage medium |
| US10708628B2 (en) | 2010-04-13 | 2020-07-07 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US10721496B2 (en) | 2010-04-13 | 2020-07-21 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US10250913B2 (en) | 2010-04-13 | 2019-04-02 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US9591335B2 (en) | 2010-04-13 | 2017-03-07 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US11810019B2 (en) | 2010-04-13 | 2023-11-07 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US10764608B2 (en) | 2010-04-13 | 2020-09-01 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US10771822B2 (en) | 2010-04-13 | 2020-09-08 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US10803485B2 (en) | 2010-04-13 | 2020-10-13 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US10805645B2 (en) | 2010-04-13 | 2020-10-13 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US10803483B2 (en) | 2010-04-13 | 2020-10-13 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US10848767B2 (en) | 2010-04-13 | 2020-11-24 | Ge Video Compression, Llc | Inter-plane prediction |
| US10855995B2 (en) | 2010-04-13 | 2020-12-01 | Ge Video Compression, Llc | Inter-plane prediction |
| US10856013B2 (en) | 2010-04-13 | 2020-12-01 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US10855991B2 (en) | 2010-04-13 | 2020-12-01 | Ge Video Compression, Llc | Inter-plane prediction |
| US10855990B2 (en) | 2010-04-13 | 2020-12-01 | Ge Video Compression, Llc | Inter-plane prediction |
| US10863208B2 (en) | 2010-04-13 | 2020-12-08 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US10873749B2 (en) | 2010-04-13 | 2020-12-22 | Ge Video Compression, Llc | Inter-plane reuse of coding parameters |
| US10880580B2 (en) | 2010-04-13 | 2020-12-29 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US10880581B2 (en) | 2010-04-13 | 2020-12-29 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US10893301B2 (en) | 2010-04-13 | 2021-01-12 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US11037194B2 (en) | 2010-04-13 | 2021-06-15 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US11051047B2 (en) | 2010-04-13 | 2021-06-29 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US20210211743A1 (en) | 2010-04-13 | 2021-07-08 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US11087355B2 (en) | 2010-04-13 | 2021-08-10 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US10721495B2 (en) | 2010-04-13 | 2020-07-21 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US11546642B2 (en) | 2010-04-13 | 2023-01-03 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US11546641B2 (en) | 2010-04-13 | 2023-01-03 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US11553212B2 (en) | 2010-04-13 | 2023-01-10 | Ge Video Compression, Llc | Inheritance in sample array multitree subdivision |
| US11611761B2 (en) | 2010-04-13 | 2023-03-21 | Ge Video Compression, Llc | Inter-plane reuse of coding parameters |
| US11736738B2 (en) | 2010-04-13 | 2023-08-22 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using subdivision |
| US11734714B2 (en) | 2010-04-13 | 2023-08-22 | Ge Video Compression, Llc | Region merging and coding parameter reuse via merging |
| US11765362B2 (en) | 2010-04-13 | 2023-09-19 | Ge Video Compression, Llc | Inter-plane prediction |
| US11765363B2 (en) | 2010-04-13 | 2023-09-19 | Ge Video Compression, Llc | Inter-plane reuse of coding parameters |
| US11778241B2 (en) | 2010-04-13 | 2023-10-03 | Ge Video Compression, Llc | Coding of a spatial sampling of a two-dimensional information signal using sub-division |
| US11785264B2 (en) | 2010-04-13 | 2023-10-10 | Ge Video Compression, Llc | Multitree subdivision and inheritance of coding parameters in a coding block |
| CN102611882B (en) * | 2011-01-19 | 2014-02-26 | 华为技术有限公司 | Encoding and decoding method and device |
| WO2012097747A1 (en) * | 2011-01-19 | 2012-07-26 | 华为技术有限公司 | Coding-decoding method and device |
| CN102611882A (en) * | 2011-01-19 | 2012-07-25 | 华为技术有限公司 | Encoding and decoding method and device |
| CN104050512A (en) * | 2013-03-15 | 2014-09-17 | Sap股份公司 | Transport time estimation based on multi-granular map |
| CN104601988B (en) * | 2014-06-10 | 2018-02-02 | 腾讯科技（北京）有限公司 | Video encoder, method and apparatus and its inter-frame mode selecting method and device |
| CN104601988A (en) * | 2014-06-10 | 2015-05-06 | 腾讯科技（北京）有限公司 | Video coder, method and device and inter-frame mode selection method and device thereof |
| US10334281B2 (en) | 2015-07-15 | 2019-06-25 | Mediatek Singapore Pte. Ltd. | Method of conditional binary tree block partitioning structure for video and image coding |
| WO2017008678A1 (en) * | 2015-07-15 | 2017-01-19 | Mediatek Singapore Pte. Ltd | Method of conditional binary tree block partitioning structure for video and image coding |
| CN105635733A (en) * | 2015-12-29 | 2016-06-01 | 广东顺德中山大学卡内基梅隆大学国际联合研究院 | Optimal telescopic multi-mode decision method based on motion information |
| CN109302607A (en) * | 2018-10-26 | 2019-02-01 | 西安科锐盛创新科技有限公司 | More prediction techniques and its system based on image scene |
| CN109302613A (en) * | 2018-10-26 | 2019-02-01 | 西安科锐盛创新科技有限公司 | Based on the prediction technique of macroblock partition in bandwidth reduction |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1589022A (en) | Macroblock split mode selecting method in multiple mode movement estimation decided by oriented tree | |
| CN104796694B (en) | Optimization intraframe video coding method based on video texture information | |
| CN106961606B (en) | HEVC intra-frame coding mode selection method based on texture division characteristics | |
| CN1284373C (en) | Method and apparatus for motion or depth estimation and image processing apparatus equipped with such motion estimation apparatus | |
| CN1921628A (en) | Motion vector detection apparatus and motion vector detection method | |
| CN1761322A (en) | Selection method of reference pictures | |
| CN1874519A (en) | Intraprediction method and apparatus using video symmetry and encoding and decoding method and apparatus | |
| CN1610410A (en) | Intra prediction method and apparatus | |
| Shen et al. | Ultra fast H. 264/AVC to HEVC transcoder | |
| CN107071416A (en) | A kind of HEVC Adaptive Mode Selection Method for Intra-Prediction | |
| CN1533675A (en) | Method and apparatus for sub-pixel motion estimation | |
| CN1236624C (en) | Quick full pixel movement evaluation method of multiple kinds of modules | |
| CN108881904A (en) | Quick decision method, device and storage medium in frame based on Sobel operator | |
| CN107623848B (en) | A kind of method for video coding and device | |
| CN1245028C (en) | Non-uniform multilayer hexaploid lattice full pixel kinematic search method | |
| Ni et al. | High efficiency intra CU partition and mode decision method for VVC | |
| CN1233372A (en) | Moving picture encoding device and moving picture decoding device | |
| Wang et al. | Convolutional neural network based low complexity HEVC intra encoder | |
| CN107087171A (en) | HEVC Integer Pixel Motion Estimation Method and Device | |
| CN1134175C (en) | Video image communication system and implementation method for multi-camera video target extraction | |
| CN1198245C (en) | Method for motion estimation for transmission cost reduction of motion vectors | |
| CN103702131A (en) | Pattern-preprocessing-based intraframe coding optimization method and system | |
| CN100338957C (en) | Complexity hierarchical mode selection method | |
| CN1268136C (en) | Frame field adaptive coding method based on image slice structure | |
| CN1753501A (en) | Method of selecting H.264/AVC frame to frame motion estimation mode |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: THOMSON BROADBAND R & D (BEIJING) LTD. Free format text: FORMER OWNER: ZHONGXIN UNITED (BEIJING) MICROELECTRONIC CO., LTD. Effective date: 20051223 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20051223 Address after: 100085, Beijing science and technology road, Haidian District, 8, science and technology wealth center A block 8 Applicant after: Thomson Broadband Development (Beijing) Co.Ltd Address before: 100083, Beijing, Zhichun Road, Haidian District 27, quantum core 19 layer Applicant before: Zhongxin United (Beijing) Microelectronic Co., Ltd. |
|
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |