CN102215386A - Video image block processing method and device - Google Patents
Video image block processing method and device Download PDFInfo
- Publication number
- CN102215386A CN102215386A CN2010101446308A CN201010144630A CN102215386A CN 102215386 A CN102215386 A CN 102215386A CN 2010101446308 A CN2010101446308 A CN 2010101446308A CN 201010144630 A CN201010144630 A CN 201010144630A CN 102215386 A CN102215386 A CN 102215386A
- Authority
- CN
- China
- Prior art keywords
- motion vector
- estimated motion
- template
- matching error
- current block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention relates to a video image block processing method and a video image block processing device. The method comprises the following steps of: acquiring matching errors between a current template of a current block and reference templates corresponding to more than one estimated motion vector; correcting the matching errors between the reference templates corresponding to a part or all of the more than one estimated motion vector and the current template according to the credibility of the estimated motion vector; selecting an optimal matched template from the more than one reference template according to the corrected matching errors; and obtaining a predicted block of the current block according to the optimal matched template, and coding or decoding the current block. By the method and the device, matching similarities between the reference templates corresponding to incredible estimated motion vectors and the current template are reduced, so the probability that the selected optimal matched template is the reference template corresponding to a credible estimated motion vector is increased, and wobble effects are worsened.
Description
Technical field
The embodiment of the invention relates to the communications field, relates in particular to a kind of video image blocks processing method and device.
Background technology
In video coding, the inter prediction technology of motion compensation has important effect to the raising of code efficiency.In existing video standard, encoder adopts the method for motion search to derive movable information, this movable information can be motion vector (Motion Vector, be called for short: relevant information MV), for example: movable information is the motion vector difference with respect to the spatial motion vectors predicted value, movable information is encoded in the code stream, and decoder decodes movable information from code stream, utilizes motion compensation technique to come reconstructed image then.For example, in standard H.264/AVC, encoder adopts the method for estimating of nonstandardized technique to derive and obtains movable information, movable information is encoded in the code stream, decoder decodes movable information from code stream, in reference frame, be displaced to the band of position of motion vector indication, inter prediction is carried out as the prediction signal of current block in this band of position.In this inter prediction technology, movable information will take a large amount of coded bit streams.
In order to reduce coded bit stream, prior art proposes a kind of decoding end motion vector (Decoder Side Motion Vector Derivation that can derive, be called for short: DMVD) technology, it is applied in the interframe prediction coding and decoding, need in code stream, not transmit movable information.Particularly, at coding side, the reconstructed image that obtains the left side of current block and top constitutes when front template (TM1), the reference template (TM2) of search and current template matches in the hunting zone of appointment in the reference frame of current block, and the shape of TM1 and TM2 is the same; When the matching error of TM1 and TM2 hour, the prediction piece adjacent with TM2 predicted the residual error that obtains current block as the prediction signal of current block to current block, carries out carrying out entropy coding again after transform and quantization handles.In decoding end, utilize method search same as described above to obtain TM2, according to the prediction piece adjacent, rebuild current block with TM2.
Further, the method for fast searching of predictability has replaced above-mentioned all direction search method in the DMVD technology, this method is with the motion vector of encoded image piece around the current block set of candidate motion vectors as current block, because the room and time correlation of moving object, the DMVD technology can be selected the optimum motion vector as current block in these set of candidate motion vectors, and needn't as conventional motion vector all direction search method, search within the specific limits, and according to certain level from whole pixel, the branch pixel is searched for step by step, thereby has significantly reduced the calculating pressure of decoding end.
Since need be in code stream in the DMVD technology explicit encoding motion vector, adopt the DMVD technology can reduce a large amount of coded bit streams.If there is not the movable information coding, then can reduce the needed bit of coding.(Rate Distortion Optimization is called for short: RDO) under the mode adjudging, for the continuous motion image-region, often adopt the DMVD technology to encode in rate-distortion optimal.Do not have architectural feature or smoother if these zones are relative, then for each different motion vector candidates value, the template matches error amount of DMVD may become very close.
In the process that realizes the invention, the inventor finds: owing to have quantizing noise in template or the reference frame, DMVD may derive and obtain a motion vector with respect to the true nature dyskinesia in the video sequence.Accordingly, when obtain in time this or the space on during irregular motion vector, can cause influencing the jitter block effect of subjective vision effect.
Summary of the invention
The embodiment of the invention provides a kind of video image blocks processing method and device, in order to weaken the jitter block effect.
The embodiment of the invention provides a kind of video image blocks processing method, comprising:
Obtain the matching error when a front template and an above estimated motion vector corresponding reference template of current block;
According to the confidence level of described estimated motion vector, part or all of estimated motion vector corresponding reference template in the described above estimated motion vector and the described matching error of working as front template are revised;
According to revised matching error, from an above reference template, select the optimum Match template;
According to described optimum Match template, obtain the prediction piece of current block, described current block is encoded or decoded.
The embodiment of the invention provides a kind of video image blocks processing unit, comprising:
Matching module is used to obtain the matching error when a front template and an above estimated motion vector corresponding reference template of current block;
Correcting module is used for the confidence level according to described estimated motion vector, and part or all of estimated motion vector corresponding reference template in the described above estimated motion vector and the described matching error of working as front template are revised;
Select module, be used for, from an above reference template, select the optimum Match template according to revised matching error;
Processing module is used for obtaining the prediction piece of current block according to described optimum Match template, and described current block is encoded or decoded.
The embodiment of the invention is revised matching error according to the confidence level of estimated motion vector, from an above reference template, select the optimum Match template according to revised matching error, according to the optimum Match template, find the prediction piece of current block, current block is encoded or decoded.By matching error is revised, can be so that incredible estimated motion vector corresponding reference template be weakened with the matching similarity when front template, the optimum Match template of Xuan Zeing is the possibility increase of believable estimated motion vector corresponding reference template like this, has also just weakened flutter effect.
Description of drawings
In order to be illustrated more clearly in the technical scheme in the embodiment of the invention, to do to introduce simply to the accompanying drawing of required use among the embodiment below, apparently, accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
The flow chart of the video image blocks processing method that Fig. 1 provides for the embodiment of the invention one;
The flow chart of the video image blocks processing method that Fig. 2 provides for the embodiment of the invention two;
The flow chart of the video image blocks processing method that Fig. 3 provides for the embodiment of the invention three;
The flow chart of the video image blocks processing method that Fig. 4 provides for the embodiment of the invention four;
The schematic diagram of present frame in the video image blocks processing method that Fig. 5 provides for the embodiment of the invention four;
Fig. 6 is the schematic diagram of the present frame corresponding reference frame of Fig. 5;
The flow chart of the video image blocks processing method that Fig. 7 provides for the embodiment of the invention six;
The structural representation of the video image blocks processing unit that Fig. 8 provides for the embodiment of the invention seven;
The structural representation of the video image blocks processing unit that Fig. 9 provides for the embodiment of the invention eight;
The structural representation of the video image blocks processing unit that Figure 10 provides for the embodiment of the invention nine;
The structural representation of the video image blocks processing unit that Figure 11 provides for the embodiment of the invention ten;
The structural representation of the video image blocks processing unit that Figure 12 provides for the embodiment of the invention 11;
The structural representation of the video image blocks processing unit that Figure 13 provides for the embodiment of the invention 12.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the invention, the technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that is obtained under the creative work prerequisite.
The flow chart of the video image blocks processing method that Fig. 1 provides for the embodiment of the invention one.As shown in Figure 1, present embodiment comprises:
101, obtain the matching error when a front template and an above estimated motion vector corresponding reference template of current block.
In the method for fast searching of predictability, utilize the reconstructed pixels structure of current block periphery to work as front template, with the motion vector of encoded image piece around the current block set of candidate motion vectors as current block, these candidate motion vectors are as the part of estimated motion vector; In the peripheral region of the candidate motion vector indication band of position (respectively being offset the zone of a search precision unit about as above), the search that becomes more meticulous obtains some reference templates the same with current shape of template, and the motion vector that becomes more meticulous of these reference template correspondences is also as the part of estimated motion vector.
Obtain the matching error when front template and above-mentioned candidate motion vector and the motion vector corresponding reference template that becomes more meticulous of current block respectively.
102, according to the confidence level of estimated motion vector, part or all of estimated motion vector corresponding reference template in the above estimated motion vector is revised with the matching error when front template.
The confidence level of so-called estimated motion vector is meant motion vector and the real consistency of moving of this object that estimation obtains, a part is considered to believable (being that confidence level is higher) in the above estimated motion vector, another part is considered to incredible (being that confidence level is lower), for example: because the spatial continuity of object of which movement, it is believable that candidate motion vector can be considered to, and the motion vector that becomes more meticulous is considered to incredible.
In the present embodiment, can revise believable estimated motion vector corresponding reference template and matching error when front template, also can revise, can also revise whole estimated motion vector corresponding reference templates and matching error when front template to incredible estimated motion vector corresponding reference template and matching error when front template.
103,, from an above reference template, select the optimum Match template according to revised matching error.
After revising, the size of comparison match error, the reference template that can select the matching error minimum is as the optimum Match template.
104, according to the optimum Match template, obtain the prediction piece of current block, described current block is encoded or decoded.
According to the optimum Match template, by the motion vector of this optimum Match template correspondence, find the prediction piece of current block, described current block is encoded or decoded.
Present embodiment is revised matching error according to the confidence level of estimated motion vector, from an above reference template, select the optimum Match template according to revised matching error, according to the optimum Match template, find the prediction piece of current block, current block is encoded or decoded.By matching error is revised, can be so that incredible estimated motion vector corresponding reference template be weakened with the matching similarity when front template, the optimum Match template of Xuan Zeing is the possibility increase of believable estimated motion vector corresponding reference template like this, has also just weakened flutter effect.
The flow chart of the video image blocks processing method that Fig. 2 provides for the embodiment of the invention two.As shown in Figure 2, present embodiment comprises:
201, obtain the matching error when a front template and an above estimated motion vector corresponding reference template of current block.
The specific implementation process of this step can be identical with step 101.
202, with part estimated motion vector corresponding reference template and the cost function of presetting when the first matching error substitution of front template, obtain first cost function value as revised matching error.
Confidence level according to estimated motion vector, can be with an above estimated motion vector separated into two parts, a part is believable motion vector, a part is incredible motion vector, the described part estimated motion vector of this step is incredible motion vector, incredible motion vector with a low credibility in believable motion vector.With incredible motion vector corresponding reference template and the cost function of presetting when the first matching error substitution of front template, obtain first cost function value as revised matching error, wherein first cost function value is greater than first matching error, that is to say, increased through the matching error of revising the incredible motion vector in back.
As a kind of embodiment, default cost function can for:
C＝ω·SAD(MV) (1)
Wherein, SAD (MV) is first matching error, be specially absolute error and, can certainly for the difference of two squares and or square root and, can also be the functions relevant such as code rate distortion with distortion, present embodiment does not limit this; ω is the punishment parameter, and the first cost function value C that obtains after ω＞1, the first matching error SAD (MV) process is revised here is greater than SAD (MV).
Cost function shown in the formula (1) only is a concrete example, and present embodiment is not limited only to this, all belongs to the claimed scope of present embodiment so long as guarantee revised first cost function value greater than the cost function of first matching error.
203, select minimum one in the revised matching error of part with in through the matching error of revising, with its corresponding reference template as the optimum Match template.
Present embodiment is revised the matching error of incredible motion vector, the matching error of believable motion vector is not through revising, from these revised matching errors and not through one of selection minimum the matching error of revising, the matching error corresponding reference template that this is minimum is as the optimum Match template.
204, according to the optimum Match template, obtain the prediction piece of current block, described current block is encoded or decoded.
According to the optimum Match template, by the motion vector of this optimum Match template correspondence, find the prediction piece of current block, described current block is encoded or decoded.
Present embodiment is revised the matching error of incredible motion vector, revised matching error has increased, make incredible estimated motion vector corresponding reference template weakened with matching similarity when front template, select minimum matching error corresponding reference template as the optimum Match template then, the optimum Match template of selecting is that the possibility of believable estimated motion vector corresponding reference template increases, and has also just weakened flutter effect.
The flow chart of the video image blocks processing method that Fig. 3 provides for the embodiment of the invention three.As shown in Figure 3, present embodiment comprises:
301, obtain the matching error when a front template and an above estimated motion vector corresponding reference template of current block.
The specific implementation process of this step can be identical with step 101.
302, with part estimated motion vector corresponding reference template and the cost function of presetting when the second matching error substitution of front template, obtain second cost function value as revised matching error.
Confidence level according to estimated motion vector, can be with an above estimated motion vector separated into two parts, a part is believable motion vector, a part is incredible motion vector, the described part estimated motion vector of this step is believable motion vector, believable motion vector with a high credibility in incredible motion vector.With believable motion vector corresponding reference template and the cost function of presetting when the second matching error substitution of front template, obtain second cost function value as revised matching error, wherein second cost function value is less than second matching error, that is to say, reduced through the matching error of revising the believable motion vector in back.
As a kind of embodiment, default cost function can for:
C＝ω·SAD(MV) (2)
Wherein, SAD (MV) is second matching error, be specially absolute error and, can certainly for the difference of two squares and or square root and, can also be the functions relevant such as code rate distortion with distortion, present embodiment does not limit this; ω is the punishment parameter, and the second cost function value C that obtains after ω＜1, the second matching error SAD (MV) process is revised here is less than SAD (MV).
Cost function shown in the formula (2) only is a concrete example, and present embodiment is not limited only to this, all belongs to the claimed scope of present embodiment so long as guarantee revised second cost function value less than the cost function of second matching error.
303, select minimum one in the revised matching error of part with in through the matching error of revising, with its corresponding reference template as the optimum Match template.
Present embodiment is revised the matching error of believable motion vector, the matching error of incredible motion vector is not through revising, from these revised matching errors and not through one of selection minimum the matching error of revising, the matching error corresponding reference template that this is minimum is as the optimum Match template.
304, according to the optimum Match template, obtain the prediction piece of current block, described current block is encoded or decoded.
According to the optimum Match template, by the motion vector of this optimum Match template correspondence, find the prediction piece of current block, described current block is encoded or decoded.
Present embodiment is revised the matching error of believable motion vector, revised matching error has reduced, make believable estimated motion vector corresponding reference template and the matching similarity of working as front template be enhanced, select minimum matching error corresponding reference template as the optimum Match template then, the optimum Match template of selecting is that the possibility of believable estimated motion vector corresponding reference template increases, and has also just weakened flutter effect.
The flow chart of the video image blocks processing method that Fig. 4 provides for the embodiment of the invention four.As shown in Figure 4, present embodiment comprises:
401, obtain the matching error when a front template and an above estimated motion vector corresponding reference template of current block.
In the method for fast searching of predictability, with the motion vector of encoded image piece around the current block set of candidate motion vectors as current block, candidate motion vector is the known motion vector or the whole pixel precision motion vector of current block periphery, and these candidate motion vectors are as the part of estimated motion vector; In the peripheral region of the candidate motion vector indication band of position (respectively being offset the zone of a search precision unit about as above), the search that becomes more meticulous obtains some reference templates, the motion vector that becomes more meticulous of these reference template correspondences is also as the part of estimated motion vector, and the motion vector that becomes more meticulous is motion vector or the half-pixel accuracy motion vector that candidate motion vector obtains by skew half-pixel accuracy position.Describe below by a concrete example:
The schematic diagram of present frame in the video image blocks processing method that Fig. 5 provides for the embodiment of the invention four, Fig. 6 is the schematic diagram of the present frame corresponding reference frame of Fig. 5.Wherein, present frame is meant the frame under the image block (being current block) of pre-treatment.As shown in Figure 5, the encoded image piece comprises left side piece A, upper right C and upper left C ' around the current block, the set of candidate motion vectors { mv1, mv2, the mv3 that their motion vector are formed current block, mv4}, mv1 wherein, mv2, mv3 are respectively the motion vector of left side piece A, upper right C and upper left C ', mv4 is mv1, mv2 and mv3 mean value.The peripheral region of each candidate motion vector indication band of position in reference frame, the search that becomes more meticulous obtains some reference templates, and the motion vector that becomes more meticulous of these reference template correspondences is also as the part of estimated motion vector.As shown in Figure 6, with upper left C ' is example, position in reference frame shown in the circle is the motion vector mv3 indication band of position of upper left C ', carry out the sub-pix displacement in this band of position, obtain the deviation post of 4 triangle indications, the reference template that forms at the deviation post of these 4 triangle indications is the reference template that the search that becomes more meticulous obtains, these reference template correspondences motion vector { mv31 that becomes more meticulous, mv32, mv33, mv34}, these become more meticulous motion vector and set of candidate motion vectors constitute the estimated motion vector collection jointly.
This step is obtained the matching error when front template and above-mentioned candidate motion vector and the motion vector corresponding reference template that becomes more meticulous of current block respectively, when the shape of front template and reference template is the same.Wherein matching error can be absolute error and (Sum of Absolute Differences, be called for short: SAD), also can for the difference of two squares and (Sum of Squares for Error, be called for short: SSE) or square root and, can also be the functions relevant such as code rate distortion with distortion.
402, the cost function that the matching error substitution is preset according to the character of estimated motion vector, obtains cost function value as revised matching error.
For the continuous motion image-region, if there is not architectural feature or smoother, the value of matching error may be very close, the influence of quantizing noise is in addition directly selected the optimum Match template to derive according to matching error and is obtained a motion vector with respect to the true nature dyskinesia in the video sequence.This step weakens the jitter block effect under the prerequisite that guarantees than high coding efficiency, and the method that provides a kind of weakening to become more meticulous the template matches similarity particularly, utilizes some conditional-variables to construct cost function, is used to revise matching error.
Present embodiment provides a kind of cost function, and the parameter of this cost function comprises the punishment parameter, and the value of punishment parameter is according to the confidence level of estimated motion vector and definite.Further, in the present embodiment, whether the confidence level of estimated motion vector is again to be the candidate motion vector of current block and definite according to estimated motion vector.Think the with a high credibility of candidate motion vector in the present embodiment, so the value of the punishment parameter of candidate motion vector correspondence is less than the value of the punishment parameter of the motion vector correspondence that becomes more meticulous in the motion vector that becomes more meticulous.
As a kind of embodiment, default cost function can for:
C＝ω·SAD(MV)，
Wherein, ω for punishment parameter, SAD (MV) be a matching error, be specially absolute error and, can certainly for the difference of two squares and or square root with, can also be the functions relevant such as code rate distortion with distortion, present embodiment does not limit this; C is a cost function value.When estimated motion vector was original candidate motion vector, the value of punishment parameter was 1, and when estimated motion vector is not original candidate motion vector, but when becoming more meticulous motion vector, the value of punishment parameter is
Wherein
The value that also is the punishment parameter of estimated motion vector when being candidate motion vector is the value of the punishment parameter when becoming more meticulous motion vector less than estimated motion vector, like this according to formula (3), for the cost function value of the motion vector corresponding reference template that becomes more meticulous cost function value, thereby make the motion vector corresponding reference template that becomes more meticulous weakened with respect to candidate motion vector with matching similarity when front template greater than candidate motion vector corresponding reference template.
Can comprise the punishment parameter in the code stream, the value of punishment parameter is predefined at coding side, concrete value can be set by off-line training, after coding side is according to default punishment calculation of parameter cost function value, this punishment parameter can be write in the code stream like this; When decoding end is decoded, can from code stream, decode and obtain punishing parameter, according to this punishment calculation of parameter cost function value.Also can not comprise the punishment parameter in the code stream, the value of punishment parameter is predefined with decoding end and be identical at coding side, concrete value can be set by off-line training, and coding side uses predefined identical punishment calculation of parameter cost function value respectively with decoding end.
As another embodiment, default cost function can for:
C＝ω·SAD(MV)+δ，
Wherein, ω for punishment parameter, SAD (MV) be a matching error, be specially absolute error and, can certainly for the difference of two squares and or square root with, can also be the functions relevant such as code rate distortion with distortion, present embodiment does not limit this; C is a cost function value, and δ is the correction value of presetting, and its value can obtain by off-line training.When estimated motion vector was original candidate motion vector, the value of punishment parameter was 1, and when estimated motion vector is not original candidate motion vector, but when becoming more meticulous motion vector, the value of punishment parameter is
Wherein
The value that also is the punishment parameter of estimated motion vector when being candidate motion vector is the value of the punishment parameter when becoming more meticulous motion vector less than estimated motion vector, like this according to formula (4), the cost function value of the motion vector corresponding reference that becomes more meticulous template is greater than the cost function value of candidate motion vector corresponding reference template, thereby the feasible motion vector corresponding reference template that becomes more meticulous is weakened with respect to candidate motion vector with the matching similarity when front template.
From the above, in the present embodiment cost function determine be subjected to matching error and the estimated motion vector corresponding with reference template is the influence of the original candidate motion vector or the motion vector that becomes more meticulous.
Cost function shown in formula (3) and (4) only is a concrete example; present embodiment is not limited only to this, so long as become more meticulous after guarantee revising motion vector corresponding reference template with all belong to the claimed scope of present embodiment when the matching similarity of the front template cost function weakened with respect to candidate motion vector.
403, from an above reference template, select revised matching error minimum as the optimum Match template.
The cost function value that relatively calculates, the reference template of selecting the cost function minimum is as the optimum Match template.
404, with the image block of the estimated motion vector indication of optimum Match template correspondence as the prediction piece, current block is encoded or is decoded.
At coding side, the image block of the estimated motion vector indication of this optimum Match template correspondence as the prediction piece, is predicted the residual error that obtains current block to current block, carry out carrying out entropy coding again after transform and quantization handles; In decoding end, the image block of the estimated motion vector indication of optimum Match template correspondence as the prediction piece, is rebuild current block according to this prediction piece.
In the present embodiment, directly the above-mentioned cost function of transmission in code stream after coding side is according to the cost function calculation cost function value, can write cost function in the code stream; When decoding end is decoded, can from code stream, decode and obtain cost function, according to this cost function calculation cost function value.The index value that also can comprise cost function in the code stream, in this case, the cost function that might adopt for different current blocks is different, adopt the cost function of formula (3) as some current blocks, other current blocks adopt the cost function of formula (4), the index value of transmission cost function in the code stream, encoding and decoding end select corresponding cost function to calculate according to index value respectively.
Present embodiment is by the cost function of structure, matching error correction is obtained cost function value, the feasible revised matching error of motion vector corresponding reference template that becomes more meticulous is bigger, the revised matching error of candidate motion vector corresponding reference template is less, from an above reference template, select the optimum Match template according to revised matching error then, according to the optimum Match template, find the prediction piece of current block, current block is encoded or decoded, the reference template that the search that becomes more meticulous in the present embodiment obtains is weakened with the matching similarity confidence level when front template, therefore the optimum Match template of selecting is the possibility increase of candidate motion vector corresponding reference template, has so also just weakened the flutter effect that brings because of the search that becomes more meticulous.
Video image blocks processing method that the embodiment of the invention five provides and the difference of the foregoing description four are that the confidence level of estimated motion vector is definite with the texture structure information of working as front template according to estimated motion vector corresponding reference template, also be that the value of punishment parameter in the cost function is subjected to matching error and when the influence of the texture structure information of front template and reference template, further, the confidence level of estimated motion vector is definite with the similarity degree of the variance of working as front template or gradient information according to estimated motion vector corresponding reference template.
With the variance is example, present embodiment is on the basis of the foregoing description four, determine cost function with following method replacement according to the character of estimated motion vector: the variance of obtaining current block when a front template (representing) and an above estimated motion vector corresponding reference template (representing) with TM2 with TM1, wherein the variance of TM1 is the D1=∑ | TM1 (x, y)-and E1|, wherein E1 is the average of each pixel value of TM1, TM1 (x, y) be that TM1 is at (x, y) pixel value of position; The variance of TM2 is the D2=∑ | and TM2 (x, y)-E2|, wherein E2 is the average of each pixel value of TM2, (x is that TM2 is at (x, y) pixel value of position y) to TM2.
As a kind of embodiment, default cost function can for:
C＝ω·SAD(MV)，
Wherein, ω for punishment parameter, SAD (MV) be a matching error, be specially absolute error and, can certainly for the difference of two squares and or square root with, can also be the functions relevant such as code rate distortion with distortion, present embodiment does not limit this; C is a cost function value.When D1/D2＜1.5 and D1/D2＞2/3, the value of punishment parameter is 1, and when D1/D2＜2/3 or D1/D2＞1.5, the value of punishment parameter is
Wherein
Also be, the value of punishment parameter is according to when the texture similarity degree of front template and reference template and definite, when D1/D2＜2/3 or D1/D2＞1.5, show that the texture structure when front template and reference template differs bigger, the estimated motion vector of this reference template correspondence is considered to insincere motion vector, promptly think with a low credibility, the value of punishment parameter is
When D1/D2＜1.5 and D1/D2＞2/3, show when the texture structure of front template and reference template more similarly, the estimated motion vector of this reference template correspondence is considered to credible motion vector, i.e. confidence level height, the value of punishment parameter is 1.
As another embodiment, default cost function can for:
C＝ω·SAD(MV)+δ，
Wherein, ω for punishment parameter, SAD (MV) be a matching error, be specially absolute error and, can certainly for the difference of two squares and or square root with, can also be the functions relevant such as code rate distortion with distortion, present embodiment does not limit this; C is a cost function value, and δ is the correction value of presetting, and its value can obtain by off-line training.When D1/D2＜1.5 and D1/D2＞2/3, the value of punishment parameter is 1, and when D1/D2＜2/3 or D1/D2＞1.5, the value of punishment parameter is
Wherein
Also be, the value of punishment parameter is according to when the texture similarity degree of front template and reference template and definite, when D1/D2＜2/3 or D1/D2＞1.5, show that the texture structure when front template and reference template differs bigger, the estimated motion vector of this reference template correspondence is considered to insincere motion vector, and the value of punishment parameter is
When D1/D2＜1.5 or D1/D2＞2/3, show when the texture structure of front template and reference template more similarly, the estimated motion vector of this reference template correspondence is considered to credible motion vector, and the value of punishment parameter is 1.
Present embodiment also can be determined the value of punishment parameter according to the similarity degree of the gradient information of working as front template and reference template.
Because when the texture structure information of front template and reference template also is to weigh the image block of motion vector indication of reference template correspondence as a kind of method of current block predicted value confidence level, so above-mentioned value and the candidate motion vector that according to estimated motion vector whether is current block by determining the punishment parameter when the texture structure information of front template and reference template determines to punish that the effect of the value of parameter is identical.
The cost function of present embodiment structure obtains cost function value according to texture structure information to matching error correction, make that reference template and the revised matching error of reference template that differs greatly when the front template texture are bigger, reference template and when the less revised matching error of reference template of front template texture difference less, from an above reference template, select the optimum Match template according to revised matching error then, according to the optimum Match template, find the prediction piece of current block, current block is encoded or decoded, the reference template that the texture diversity ratio is bigger in the present embodiment is weakened with the matching similarity when front template, therefore the optimum Match template of selecting is the possibility increase of the less reference template of texture difference, has so also just weakened because of falsely dropping the flutter effect that non-true motion vector is brought.
The flow chart of the video image blocks processing method that Fig. 7 provides for the embodiment of the invention six.As shown in Figure 7, present embodiment comprises:
501, obtain the matching error when a front template and an above estimated motion vector corresponding reference template of current block.
502, the cost function that the matching error substitution is preset according to the character of estimated motion vector, obtains cost function value as revised matching error.
503, from an above reference template, select revised matching error minimum as the optimum Match template.
504, if present embodiment is applied to coding side, this step is specially: when the estimated motion vector of optimum Match template correspondence is first estimated motion vector, adopt the DMVD technology that current block is encoded; When the estimated motion vector of optimum Match template correspondence is second estimated motion vector, movable information is write code stream, adopt non-DMVD technology that current block is encoded, wherein first estimated motion vector is with a high credibility in second estimated motion vector;
If present embodiment is applied to decoding end, this step is specially: when the estimated motion vector of optimum Match template correspondence is first estimated motion vector, adopt the DMVD technology that current block is decoded; When the estimated motion vector of optimum Match template correspondence is second estimated motion vector, according to the movable information in the code stream, adopt non-DMVD technology that current block is decoded, wherein first estimated motion vector is with a high credibility in second estimated motion vector.
The above-mentioned movable information that writes code stream can be set the difference of motion vector for the motion vector and that obtains by prior art estimation H.264/AVC.
Specifically, the description of the specific implementation process of above-mentioned steps 501-503 can not repeat them here referring to the step of embodiment two, three, four or five correspondences.
In above-mentioned steps 504, if present embodiment is applied to coding side, when the estimated motion vector of optimum Match template correspondence is believable estimated motion vector, adopt the DMVD technology that current block is encoded, also soon the image block of the estimated motion vector indication of optimum Match template correspondence is encoded to current block as the prediction piece; When the estimated motion vector of optimum Match template correspondence is incredible estimated motion vector, adopt non-DMVD technology (as the technology in H.264/AVC) that current block is encoded.If present embodiment is applied to decoding end, when the estimated motion vector of optimum Match template correspondence is believable estimated motion vector, adopt the DMVD technology that current block is decoded, also soon the image block of the estimated motion vector indication of optimum Match template correspondence is rebuild current block as the prediction piece according to this prediction piece; When the estimated motion vector of optimum Match template correspondence is incredible estimated motion vector,, adopt non-DMVD technology (as the technology in H.264/AVC) that current block is decoded according to the movable information in the code stream.
When the estimated motion vector of optimum Match template correspondence was believable estimated motion vector, present embodiment adopted the DMVD technology of the method for fast searching of predictability to encode or decode, and has weakened the jitter block effect.When the estimated motion vector of optimum Match template correspondence is incredible estimated motion vector, if adopting the DMVD technology in this case encodes or decodes, some shakes can occur again, present embodiment coding side in this case, adopt non-DMVD technology to encode, decoding end is according to the movable information in the code stream (as motion vector difference), adopt non-DMVD technology to decode, since in the non-DMVD technology according to the RDO criterion, in the destructuring zone, coding side more is ready to select less motion vector difference to encode, and can produce the motion vector field of rule like this, guarantee the motion vector field regularization, also weakened the jitter block effect.
The structural representation of the video image blocks processing unit that Fig. 8 provides for the embodiment of the invention seven.As shown in Figure 8, present embodiment comprises: matching module 11, correcting module 12, selection module 13 and processing module 14, wherein:
Correcting module 12 is used for the confidence level according to estimated motion vector, and part or all of estimated motion vector corresponding reference template in the above estimated motion vector is revised with the matching error when front template;
Specifically, in the method for fast searching of predictability, with the motion vector of encoded image piece around the current block set of candidate motion vectors as current block, these candidate motion vectors are as the part of estimated motion vector; In the peripheral region of the candidate motion vector indication band of position (respectively being offset the zone of a search precision unit about as above), the search that becomes more meticulous obtains some reference templates, and the motion vector that becomes more meticulous of these reference template correspondences is also as the part of estimated motion vector.Matching module 11 obtains the matching error when front template and above-mentioned candidate motion vector and the motion vector corresponding reference template that becomes more meticulous of current block respectively.
A part is considered to believable (being that confidence level is higher) in the above estimated motion vector, another part is considered to incredible (being that confidence level is lower), for example: candidate motion vector can be considered to believable, and the motion vector that becomes more meticulous is considered to incredible.In the present embodiment, correcting module 12 can be revised believable estimated motion vector corresponding reference template and the matching error when front template, also can revise, can also revise whole estimated motion vector corresponding reference templates and matching error when front template to incredible estimated motion vector corresponding reference template and matching error when front template.
After revising, select the size of module 13 comparison match errors, the reference template that can select the matching error minimum is as the optimum Match template.
In the present embodiment, correcting module is revised matching error according to the confidence level of estimated motion vector, select module from an above reference template, to select the optimum Match template according to revised matching error, processing module is according to the optimum Match template, find the prediction piece of current block, current block is encoded or decoded.By matching error is revised, can be so that incredible estimated motion vector corresponding reference template be relatively weakened with the matching similarity when front template, the optimum Match template of Xuan Zeing is that the possibility of believable estimated motion vector corresponding reference template relatively increases like this, has also just weakened flutter effect.
The structural representation of the video image blocks processing unit that Fig. 9 provides for the embodiment of the invention eight.As shown in Figure 9, present embodiment is on the basis of the foregoing description seven, further, correcting module 12 comprises: first amending unit 21, be used for part estimated motion vector corresponding reference template and the cost function of presetting when the first matching error substitution of front template are obtained first cost function value as revised matching error.
Above-mentioned part estimated motion vector with a low credibility in other estimated motion vectors except that the part estimated motion vector, first cost function value is greater than first matching error.
Confidence level according to estimated motion vector, can be with an above estimated motion vector separated into two parts, a part is believable motion vector, a part is incredible motion vector, the part estimated motion vector is incredible motion vector in the present embodiment, incredible motion vector with a low credibility in believable motion vector.First amending unit 21 is with incredible motion vector corresponding reference template and the cost function of presetting when the first matching error substitution of front template, obtain first cost function value as revised matching error, wherein first cost function value is greater than first matching error, that is to say, increased through the matching error of revising the incredible motion vector in back.
Further, the cost function that present embodiment adopted can be formula (1).
The implementation procedure of each module concrete function of video image blocks processing unit that present embodiment provides can be with reference to the associated description among the said method embodiment two.
Present embodiment first amending unit is revised the matching error of incredible motion vector, revised matching error has increased, make incredible estimated motion vector corresponding reference template weakened with matching similarity when front template, select minimum matching error corresponding reference template as the optimum Match template then, the optimum Match template of selecting is that the possibility of believable estimated motion vector corresponding reference template increases, and has also just weakened flutter effect.
The structural representation of the video image blocks processing unit that Figure 10 provides for the embodiment of the invention nine.As shown in figure 10, present embodiment is on the basis of the foregoing description seven, further, correcting module 12 comprises: second amending unit 31, be used for part estimated motion vector corresponding reference template and the cost function of presetting when the second matching error substitution of front template are obtained second cost function value as revised matching error.
Above-mentioned part estimated motion vector with a high credibility in other estimated motion vectors except that the part estimated motion vector, second cost function value is less than second matching error.
Confidence level according to estimated motion vector, can be with an above estimated motion vector separated into two parts, a part is believable motion vector, a part is incredible motion vector, the part estimated motion vector is believable motion vector in the present embodiment, believable motion vector with a high credibility in incredible motion vector.Second amending unit 31 is with believable motion vector corresponding reference template and the cost function of presetting when the second matching error substitution of front template, obtain second cost function value as revised matching error, wherein second cost function value is less than second matching error, that is to say, reduced through the matching error of revising the believable motion vector in back.
Further, the cost function that present embodiment adopted can be formula (2).
The implementation procedure of each module concrete function of video image blocks processing unit that present embodiment provides can be with reference to the associated description among the said method embodiment three.
Present embodiment second amending unit is revised the matching error of believable motion vector, revised matching error has reduced, make believable estimated motion vector corresponding reference template and the matching similarity of working as front template be enhanced, relatively, incredible estimated motion vector corresponding reference template is weakened with the matching similarity when front template, select minimum matching error corresponding reference template as the optimum Match template then, the optimum Match template of selecting is that the possibility of believable estimated motion vector corresponding reference template increases, and has also just weakened flutter effect.
The structural representation of the video image blocks processing unit that Figure 11 provides for the embodiment of the invention ten.As shown in figure 11, present embodiment is on the basis of the foregoing description seven, further, correcting module 12 comprises: the 3rd amending unit 41, be used for an above estimated motion vector corresponding reference template and the cost function of presetting when the matching error substitution of front template are obtained cost function value as revised matching error.
In the present embodiment, the parameter of cost function comprises the punishment parameter, and the value of punishment parameter is according to the confidence level of estimated motion vector and definite.Further, whether the confidence level of estimated motion vector can be to be the candidate motion vector of current block and definite according to estimated motion vector, think the with a high credibility in the motion vector that becomes more meticulous of candidate motion vector like this, the value of the punishment parameter of candidate motion vector correspondence is less than the value of the punishment parameter of the motion vector correspondence that becomes more meticulous.The confidence level of estimated motion vector also can be definite with the texture structure information of working as front template according to estimated motion vector corresponding reference template, further, the confidence level of estimated motion vector is definite with the similarity degree of the variance of working as front template or gradient information according to estimated motion vector corresponding reference template.
Further, the cost function that present embodiment adopted can be in formula (3)-(6) any one.
The implementation procedure of each module concrete function of video image blocks processing unit that present embodiment provides can be with reference to the associated description among said method embodiment four or five.
Present embodiment the 3rd amending unit is revised the matching error of whole estimated motion vectors, wherein the value of punishment parameter is to determine according to the confidence level of estimated motion vector in the cost function, make incredible estimated motion vector corresponding reference template weakened like this with matching similarity when front template, select minimum matching error corresponding reference template as the optimum Match template then, the optimum Match template of selecting is that the possibility of believable estimated motion vector corresponding reference template increases, and has also just weakened flutter effect.
On the basis of the foregoing description seven to ten any embodiment, as a kind of execution mode, processing module 14 can specifically be used for the image block of the estimated motion vector indication of optimum Match template correspondence as the prediction piece current block being encoded or decoding.As another kind of execution mode, processing module 14 can also realize other codings or decoding function, is described respectively below.
The structural representation of the video image blocks processing unit that Figure 12 provides for the embodiment of the invention 11.As shown in figure 12, present embodiment is specially a code device, on the basis of the foregoing description seven, processing module 14 further comprises: coding unit 51, be used for when the estimated motion vector of optimum Match template correspondence is first estimated motion vector, adopt the decoding end motion vector DMVD technology of can deriving that current block is encoded; When the estimated motion vector of optimum Match template correspondence is second estimated motion vector, movable information is write code stream, adopt non-DMVD technology that current block is encoded, wherein first estimated motion vector is with a high credibility in second estimated motion vector.
Processing module also can comprise this coding unit in the foregoing description eight or nine or ten.
The structural representation of the video image blocks processing unit that Figure 13 provides for the embodiment of the invention 12.As shown in figure 13, present embodiment is specially a decoding device, and on the basis of the foregoing description seven, processing module 14 further comprises: decoding unit 61, be used for when the estimated motion vector of optimum Match template correspondence is first estimated motion vector, adopt the DMVD technology that current block is decoded; When the estimated motion vector of optimum Match template correspondence is second estimated motion vector, according to the movable information in the code stream, adopt non-DMVD technology that current block is decoded, wherein first estimated motion vector is with a high credibility in second estimated motion vector.
Processing module also can comprise this decoding unit in the foregoing description eight or nine or ten.
When the estimated motion vector of optimum Match template correspondence was believable estimated motion vector, the foregoing description adopted the DMVD technology of the method for fast searching of predictability to encode or decode, and has weakened the jitter block effect.When the estimated motion vector of optimum Match template correspondence is incredible estimated motion vector, if adopting the DMVD technology in this case encodes or decodes, some shakes can occur again, the foregoing description coding side in this case, adopt non-DMVD technology to encode, decoding end is according to the movable information in the code stream (as motion vector difference), adopt non-DMVD technology to decode, since in the non-DMVD technology according to the RDO criterion, in the destructuring zone, coding side more is ready to select less motion vector difference to encode, and can produce the motion vector field of rule like this, guarantee the motion vector field regularization, also weakened the jitter block effect.
One of ordinary skill in the art will appreciate that: all or part of step that realizes said method embodiment can be finished by the relevant hardware of program command, aforesaid program can be stored in the computer read/write memory medium, this program is when carrying out, execution comprises the step of said method embodiment, and aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CD.
It should be noted that at last: above embodiment only in order to the technical scheme of the explanation embodiment of the invention, is not intended to limit; Although the embodiment of the invention is had been described in detail with reference to previous embodiment, those of ordinary skill in the art is to be understood that: it still can be made amendment to the technical scheme that aforementioned each embodiment put down in writing, and perhaps part technical characterictic wherein is equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution break away from the spirit and scope of each embodiment technical scheme of the embodiment of the invention.
Claims (15)
1. a video image blocks processing method is characterized in that, comprising:
Obtain the matching error when a front template and an above estimated motion vector corresponding reference template of current block;
According to the confidence level of described estimated motion vector, part or all of estimated motion vector corresponding reference template in the described above estimated motion vector and the described matching error of working as front template are revised;
According to revised matching error, from an above reference template, select the optimum Match template;
According to described optimum Match template, obtain the prediction piece of current block, described current block is encoded or decoded.
2. video image blocks processing method according to claim 1, it is characterized in that, described confidence level according to described estimated motion vector comprises part estimated motion vector corresponding reference template in the described above estimated motion vector and described matching error correction of working as front template:
With described part estimated motion vector corresponding reference template and described when the default cost function of the first matching error substitution of front template, obtain first cost function value as described revised matching error, described part estimated motion vector with a low credibility in other estimated motion vectors except that described part estimated motion vector, described first cost function value is greater than described first matching error;
Perhaps, with described part estimated motion vector corresponding reference template and described when the default cost function of the second matching error substitution of front template, obtain second cost function value as described revised matching error, described part estimated motion vector with a high credibility in other estimated motion vectors except that described part estimated motion vector, described second cost function value is less than described second matching error.
3. video image blocks processing method according to claim 1, it is characterized in that, described confidence level according to described estimated motion vector comprises whole estimated motion vector corresponding reference templates in the described above estimated motion vector and described matching error correction of working as front template:
With a described above estimated motion vector corresponding reference template and described, obtain cost function value as described revised matching error when the default cost function of the matching error substitution of front template.
4. video image blocks processing method according to claim 3 is characterized in that the parameter of described cost function comprises the punishment parameter, and the value of described punishment parameter is according to the confidence level of described estimated motion vector and definite.
5. video image blocks processing method according to claim 4, it is characterized in that, whether the confidence level of described estimated motion vector is candidate motion vector and definite according to described estimated motion vector, described candidate motion vector with a high credibility in the confidence level of the motion vector that becomes more meticulous, the value of the punishment parameter of described candidate motion vector correspondence is less than the value of the punishment parameter of the described motion vector correspondence that becomes more meticulous.
6. video image blocks processing method according to claim 4 is characterized in that, the confidence level of described estimated motion vector is definite with the texture structure information of working as front template according to described estimated motion vector corresponding reference template.
7. video image blocks processing method according to claim 6, it is characterized in that, described according to definite the comprising of described estimated motion vector corresponding reference template: definite with the similarity degree of the variance of working as front template or gradient information according to described estimated motion vector corresponding reference template with working as the texture structure information of front template.
8. video image blocks processing method according to claim 4 is characterized in that, comprises described punishment parameter in the code stream.
9. video image blocks processing method according to claim 1 is characterized in that, and is described according to described optimum Match template, obtains the prediction piece of current block, and described current block is encoded to be comprised:
When the estimated motion vector of described optimum Match template correspondence is first estimated motion vector, adopt the decoding end motion vector DMVD technology of can deriving that described current block is encoded; When the estimated motion vector of described optimum Match template correspondence is second estimated motion vector, movable information is write code stream, adopt non-DMVD technology that described current block is encoded, wherein first estimated motion vector is with a high credibility in second estimated motion vector.
10. video image blocks processing method according to claim 1 is characterized in that, and is described according to described optimum Match template, obtains the prediction piece of current block, and described current block is decoded to be comprised:
When the estimated motion vector of described optimum Match template correspondence is first estimated motion vector, adopt the DMVD technology that described current block is decoded; When the estimated motion vector of described optimum Match template correspondence is second estimated motion vector, according to the movable information in the code stream, adopt non-DMVD technology that described current block is decoded, wherein first estimated motion vector is with a high credibility in second estimated motion vector.
11. a video image blocks processing unit is characterized in that, comprising:
Matching module is used to obtain the matching error when a front template and an above estimated motion vector corresponding reference template of current block;
Correcting module is used for the confidence level according to described estimated motion vector, and part or all of estimated motion vector corresponding reference template in the described above estimated motion vector and the described matching error of working as front template are revised;
Select module, be used for, from an above reference template, select the optimum Match template according to revised matching error;
Processing module is used for obtaining the prediction piece of current block according to described optimum Match template, and described current block is encoded or decoded.
12. video image blocks processing unit according to claim 11 is characterized in that, described correcting module comprises:
First amending unit is used for described part estimated motion vector corresponding reference template and described when the default cost function of the first matching error substitution of front template is obtained first cost function value as described revised matching error; Described part estimated motion vector with a low credibility in other estimated motion vectors except that described part estimated motion vector, described first cost function value is greater than described first matching error;
Perhaps, second amending unit, be used for described part estimated motion vector corresponding reference template and described when the default cost function of the second matching error substitution of front template, obtain second cost function value as described revised matching error, described part estimated motion vector with a high credibility in other estimated motion vectors except that described part estimated motion vector, described second cost function value is less than described second matching error.
13. video image blocks processing unit according to claim 11 is characterized in that, described correcting module comprises:
The 3rd amending unit is used for a described above estimated motion vector corresponding reference template and described when the default cost function of the matching error substitution of front template is obtained cost function value as described revised matching error.
14., it is characterized in that described processing module comprises according to claim 11 or 12 or 13 described video image blocks processing unit:
Coding unit is used for when the estimated motion vector of described optimum Match template correspondence is first estimated motion vector, adopts the decoding end motion vector DMVD technology of can deriving that described current block is encoded; When the estimated motion vector of described optimum Match template correspondence is second estimated motion vector, movable information is write code stream, adopt non-DMVD technology that described current block is encoded, wherein first estimated motion vector is with a high credibility in second estimated motion vector.
15., it is characterized in that described processing module comprises according to claim 11 or 12 or 13 described video image blocks processing unit:
Decoding unit is used for when the estimated motion vector of described optimum Match template correspondence is first estimated motion vector, adopts the DMVD technology that described current block is decoded; When the estimated motion vector of described optimum Match template correspondence is second estimated motion vector, according to the movable information in the code stream, adopt non-DMVD technology that described current block is decoded, wherein first estimated motion vector is with a high credibility in second estimated motion vector.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010144630 CN102215386B (en) | 2010-04-09 | 2010-04-09 | Video image block processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010144630 CN102215386B (en) | 2010-04-09 | 2010-04-09 | Video image block processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102215386A true CN102215386A (en) | 2011-10-12 |
| CN102215386B CN102215386B (en) | 2013-03-27 |
Family
ID=44746483
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201010144630 Active CN102215386B (en) | 2010-04-09 | 2010-04-09 | Video image block processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102215386B (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104335586A (en) * | 2012-04-11 | 2015-02-04 | 高通股份有限公司 | Motion vector rounding |
| CN105122813A (en) * | 2013-04-11 | 2015-12-02 | Lg电子株式会社 | Video signal processing method and device |
| CN105338351A (en) * | 2014-05-28 | 2016-02-17 | 华为技术有限公司 | Template coupling based intraframe prediction encoding and decoding method and apparatus, and array scanning method and apparatus |
| CN107396128A (en) * | 2012-01-19 | 2017-11-24 | 韩国电子通信研究院 | Method and apparatus for encoding/decoding image |
| WO2018120290A1 (en) * | 2016-12-26 | 2018-07-05 | 华为技术有限公司 | Prediction method and device based on template matching |
| CN109791695A (en) * | 2016-10-13 | 2019-05-21 | Ati科技无限责任公司 | Motion vector image block based determines described piece of variance |
| WO2020001624A1 (en) * | 2018-06-28 | 2020-01-02 | 杭州海康威视数字技术股份有限公司 | Method and apparatus for determining motion vector |
| CN110662033A (en) * | 2018-06-28 | 2020-01-07 | 杭州海康威视数字技术股份有限公司 | Decoding and encoding method and device thereof |
| CN110832859A (en) * | 2017-07-11 | 2020-02-21 | 华为技术有限公司 | Decoding method and device based on template matching |
| WO2020057524A1 (en) * | 2018-09-19 | 2020-03-26 | Huawei Technologies Co., Ltd. | Method for skipping refinement based on patch similarity in bilinear interpolation based decoder-side motion vector refinement |
| CN111201795A (en) * | 2017-10-09 | 2020-05-26 | 华为技术有限公司 | Memory access window and padding for motion vector modification |
| WO2020164582A1 (en) * | 2019-02-14 | 2020-08-20 | Beijing Bytedance Network Technology Co., Ltd. | Video processing method and apparatus |
| WO2020164544A1 (en) * | 2019-02-13 | 2020-08-20 | Beijing Bytedance Network Technology Co., Ltd. | Updating of history based motion vector prediction tables |
| CN111711823A (en) * | 2020-06-30 | 2020-09-25 | Oppo广东移动通信有限公司 | Motion vector processing method and device, electronic device and storage medium |
| CN111800631A (en) * | 2020-06-22 | 2020-10-20 | 西安万像电子科技有限公司 | Data processing method and system |
| CN111971962A (en) * | 2017-11-02 | 2020-11-20 | 联发科技股份有限公司 | Video encoding and decoding device and method |
| CN116233449A (en) * | 2023-03-06 | 2023-06-06 | 杭州海康威视数字技术股份有限公司 | Video encoding and decoding methods, devices, equipment and storage medium |
| US12081767B2 (en) | 2019-02-03 | 2024-09-03 | Beijing Bytedance Network Technology Co., Ltd | Interaction between MV precisions and MV difference coding |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1925614A (en) * | 2005-08-30 | 2007-03-07 | 深圳清华大学研究院 | Rapid movement estimating method |
| CN101557514A (en) * | 2008-04-11 | 2009-10-14 | 华为技术有限公司 | Method, device and system for inter-frame predicting encoding and decoding |
| CN101605256A (en) * | 2008-06-12 | 2009-12-16 | 华为技术有限公司 | A kind of method of coding and decoding video and device |
| CN101686393A (en) * | 2008-09-28 | 2010-03-31 | 华为技术有限公司 | Fast-motion searching method and fast-motion searching device applied to template matching |
-
2010
- 2010-04-09 CN CN 201010144630 patent/CN102215386B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1925614A (en) * | 2005-08-30 | 2007-03-07 | 深圳清华大学研究院 | Rapid movement estimating method |
| CN101557514A (en) * | 2008-04-11 | 2009-10-14 | 华为技术有限公司 | Method, device and system for inter-frame predicting encoding and decoding |
| CN101605256A (en) * | 2008-06-12 | 2009-12-16 | 华为技术有限公司 | A kind of method of coding and decoding video and device |
| CN101686393A (en) * | 2008-09-28 | 2010-03-31 | 华为技术有限公司 | Fast-motion searching method and fast-motion searching device applied to template matching |
Non-Patent Citations (1)
| Title |
|---|
| STEFFEN KAMP ET AL.: "Decoder side motion vector derivation for inter frame video coding", 《IMAGE PROCESSING,2008.ICIP2008.15TH IEEE INTERNATIONAL CONFERENCE ON》, 15 October 2008 (2008-10-15) * |
Cited By (40)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11470342B2 (en) | 2012-01-19 | 2022-10-11 | Electronics And Telecommunications Research Institute | Method and apparatus for image coding/decoding |
| US10638154B2 (en) | 2012-01-19 | 2020-04-28 | Electronics And Telecommunications Research Institute | Method and apparatus for image coding/decoding |
| CN107396128A (en) * | 2012-01-19 | 2017-11-24 | 韩国电子通信研究院 | Method and apparatus for encoding/decoding image |
| CN107396128B (en) * | 2012-01-19 | 2020-04-24 | 韩国电子通信研究院 | Method for image encoding/decoding |
| US11006142B2 (en) | 2012-01-19 | 2021-05-11 | Electronics And Telecommunications Research Institute | Method and apparatus for image coding/decoding |
| US12126826B2 (en) | 2012-01-19 | 2024-10-22 | Electronics And Telecommunications Research Institute | Method and apparatus for image coding/decoding |
| CN104335586B (en) * | 2012-04-11 | 2017-12-29 | 高通股份有限公司 | Motion vector is rounded |
| CN104335586A (en) * | 2012-04-11 | 2015-02-04 | 高通股份有限公司 | Motion vector rounding |
| CN105122813A (en) * | 2013-04-11 | 2015-12-02 | Lg电子株式会社 | Video signal processing method and device |
| CN105338351B (en) * | 2014-05-28 | 2019-11-12 | 华为技术有限公司 | Intra prediction coding and decoding, array scanning method and device based on template matching |
| US10219003B2 (en) | 2014-05-28 | 2019-02-26 | Huawei Technologies Co., Ltd. | Intra-frame predictive coding and decoding methods based on template matching, array scanning method and apparatus, and apparatus |
| CN105338351A (en) * | 2014-05-28 | 2016-02-17 | 华为技术有限公司 | Template coupling based intraframe prediction encoding and decoding method and apparatus, and array scanning method and apparatus |
| CN109791695B (en) * | 2016-10-13 | 2023-06-20 | Ati科技无限责任公司 | Determining a variance of an image block based on a motion vector of the block |
| CN109791695A (en) * | 2016-10-13 | 2019-05-21 | Ati科技无限责任公司 | Motion vector image block based determines described piece of variance |
| WO2018120290A1 (en) * | 2016-12-26 | 2018-07-05 | 华为技术有限公司 | Prediction method and device based on template matching |
| CN110832859A (en) * | 2017-07-11 | 2020-02-21 | 华为技术有限公司 | Decoding method and device based on template matching |
| CN111201795A (en) * | 2017-10-09 | 2020-05-26 | 华为技术有限公司 | Memory access window and padding for motion vector modification |
| US11153595B2 (en) | 2017-10-09 | 2021-10-19 | Huawei Technologies Co., Ltd. | Memory access window and padding for motion vector refinement |
| CN111971962A (en) * | 2017-11-02 | 2020-11-20 | 联发科技股份有限公司 | Video encoding and decoding device and method |
| CN110662074B (en) * | 2018-06-28 | 2021-11-23 | 杭州海康威视数字技术股份有限公司 | Motion vector determination method and device |
| CN110662074A (en) * | 2018-06-28 | 2020-01-07 | 杭州海康威视数字技术股份有限公司 | Motion vector determination method and device |
| WO2020001624A1 (en) * | 2018-06-28 | 2020-01-02 | 杭州海康威视数字技术股份有限公司 | Method and apparatus for determining motion vector |
| CN110662033A (en) * | 2018-06-28 | 2020-01-07 | 杭州海康威视数字技术股份有限公司 | Decoding and encoding method and device thereof |
| CN110662033B (en) * | 2018-06-28 | 2021-11-23 | 杭州海康威视数字技术股份有限公司 | Decoding and encoding method and device thereof |
| US11178426B2 (en) | 2018-09-19 | 2021-11-16 | Huawei Technologies Co., Ltd. | Skipping refinement based on patch similarity in bilinear interpolation based decoder-side motion vector refinement |
| WO2020057524A1 (en) * | 2018-09-19 | 2020-03-26 | Huawei Technologies Co., Ltd. | Method for skipping refinement based on patch similarity in bilinear interpolation based decoder-side motion vector refinement |
| US11722691B2 (en) | 2018-09-19 | 2023-08-08 | Huawei Technologies Co., Ltd. | Decoder-side motion vector refinement (DMVR) process method and apparatus |
| US12081767B2 (en) | 2019-02-03 | 2024-09-03 | Beijing Bytedance Network Technology Co., Ltd | Interaction between MV precisions and MV difference coding |
| WO2020164544A1 (en) * | 2019-02-13 | 2020-08-20 | Beijing Bytedance Network Technology Co., Ltd. | Updating of history based motion vector prediction tables |
| US11863771B2 (en) | 2019-02-13 | 2024-01-02 | Beijing Bytedance Network Technology Co., Ltd | Updating of history based motion vector prediction tables |
| WO2020164582A1 (en) * | 2019-02-14 | 2020-08-20 | Beijing Bytedance Network Technology Co., Ltd. | Video processing method and apparatus |
| US11240531B2 (en) | 2019-02-14 | 2022-02-01 | Beijing Bytedance Network Technology Co., Ltd. | Size selective application of decoder side refining tools |
| US11425417B2 (en) | 2019-02-14 | 2022-08-23 | Beijing Bytedance Network Technology Co., Ltd. | Techniques for using a decoder side motion vector refinement tool |
| US12034964B2 (en) | 2019-02-14 | 2024-07-09 | Beijing Bytedance Network Technology Co., Ltd | Selective application of decoder side refining tools |
| US11876932B2 (en) | 2019-02-14 | 2024-01-16 | Beijing Bytedance Network Technology Co., Ltd | Size selective application of decoder side refining tools |
| CN111800631A (en) * | 2020-06-22 | 2020-10-20 | 西安万像电子科技有限公司 | Data processing method and system |
| CN111711823B (en) * | 2020-06-30 | 2022-11-15 | Oppo广东移动通信有限公司 | Motion vector processing method and apparatus, electronic device, and storage medium |
| CN111711823A (en) * | 2020-06-30 | 2020-09-25 | Oppo广东移动通信有限公司 | Motion vector processing method and device, electronic device and storage medium |
| CN116233449A (en) * | 2023-03-06 | 2023-06-06 | 杭州海康威视数字技术股份有限公司 | Video encoding and decoding methods, devices, equipment and storage medium |
| CN116233449B (en) * | 2023-03-06 | 2024-10-01 | 杭州海康威视数字技术股份有限公司 | Video encoding and decoding methods, devices, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102215386B (en) | 2013-03-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102215386B (en) | Video image block processing method and device | |
| CN108028939B (en) | Method and apparatus for motion derivation at the decoder side of video codec | |
| WO2022267667A1 (en) | Systems and methods for inter frame prediction of a video | |
| CN108134939B (en) | Motion estimation method and device | |
| CN102685504B (en) | The decoding method of video image, code device, decoding device and system thereof | |
| US10051282B2 (en) | Method for obtaining motion information with motion vector differences | |
| JP2011511541A (en) | Method, apparatus, and system for interframe predictive coding | |
| JP7330243B2 (en) | Method and apparatus for encoding or decoding video data in FRUC mode with reduced memory access | |
| JP5367097B2 (en) | Motion vector predictive coding method, motion vector predictive decoding method, moving picture coding apparatus, moving picture decoding apparatus, and programs thereof | |
| KR20200121925A (en) | Image encoding/decoding method and device | |
| CN101610413A (en) | Video encoding/decoding method and device | |
| TW202019179A (en) | Method and apparatus of motion-vector rounding unification for video coding system | |
| MX2021000351A (en) | Video encoder, video decoder, and corresponding method. | |
| KR102696422B1 (en) | Decoding method, encoding method, device, apparatus and storage medium | |
| CN110662033B (en) | Decoding and encoding method and device thereof | |
| CN110636290B (en) | Video image motion vector encoding/decoding method and encoder/decoder | |
| JP6019797B2 (en) | Moving picture coding apparatus, moving picture coding method, and program | |
| CN114503557A (en) | Sampling clipping method and device for optical flow prediction refinement in video coding | |
| CN110662074B (en) | Motion vector determination method and device | |
| CN111837386A (en) | Image decoding device, image encoding device, image processing system, and program | |
| WO2019150411A1 (en) | Video encoding device, video encoding method, video decoding device, and video decoding method, and video encoding system | |
| KR102651484B1 (en) | Method and apparatus for coding images of video sequences, and terminal device | |
| CN111629207A (en) | A Template Matching Intra-Frame Subdivision Method | |
| CN113382248B (en) | Interframe prediction value correction method, encoder and computer-readable storage medium | |
| CN112702601B (en) | Method and apparatus for determining motion vector for inter prediction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |