CN1838775B

CN1838775B - Moving picture coding apparatus, moving picture decoding apparatus, moving picture coding method and moving picture decoding method

Info

Publication number: CN1838775B
Application number: CN 200610076393
Authority: CN
Inventors: 荣藤稔; 安达悟; 小林充; 加藤祯笃
Original assignee: NTT Docomo Inc
Current assignee: NTT Docomo Inc
Priority date: 2001-11-30
Filing date: 2002-11-29
Publication date: 2011-11-23
Anticipated expiration: 2022-11-29
Also published as: CN1838774A; CN1838775A; CN1838774B

Abstract

The invention relates to a mobile image code device, which uses displacement compensation to code the mobile image formed by frame image sequences, wherein said device comprises: one reference image generator for executing several different image treatments via one reference frame image, to generate different reference images; one displacement compensator for using generated reference image, to calculating one displacement compensated value on coded area; and one sending unit for sending one combination between reference image information and the instruction displacement compensated value used to calculate displacement compensated value; the reference image information is one combination between reference frame image mark information and instruction image processing information.

Description

Moving picture coding apparatus and method, moving picture decoding apparatus and method

It is on November 29th, 2002 that the application is based on the international filing date of submitting on May 28th, 2004, be entitled as dividing an application that the Chinese patent application 02823828.1 of " moving picture coding apparatus, moving picture decoding apparatus, mobile method for encoding images, moving picture decoding method, program and stored program computer-readable recording medium " proposes.

Technical field

The present invention relates to a kind of moving picture coding apparatus, a kind of moving picture decoding apparatus, a kind of mobile method for encoding images and a kind of moving picture decoding method.

Background technology

Example as traditional mobile image encoding system, a kind of moving picture coding apparatus and a kind of moving picture decoding apparatus based on " the H.26L coded system " described in " ITU-T SG16VCEG-M81, H.26L Test Model Long Term Number 8 (TML-8) " are described below.Fig. 1 has shown a kind of configuration of aforementioned moving picture coding apparatus 20, and Fig. 2 has shown a kind of configuration of aforementioned moving picture decoding apparatus 50.

Moving picture coding apparatus shown in Figure 1 is by the bit shift compensation inter prediction, reduced the redundant representation of time orientation, and, further reduced the redundancy of direction in space, thereby carried out the Information Compression of mobile image (incoming video signal) by orthogonal transform.Fig. 3 has shown the key diagram of a bit shift compensation inter prediction.

Hereinafter, will be described with reference to of the operation of these accompanying drawings moving picture coding apparatus shown in Figure 1 20.

Incoming video signal 1 is made up of the sequential of two field picture.Here, suppose that two field picture to be encoded is divided into the square area of 16 * 16 pixels (macro block), and the decoding processing of the encoding process of moving picture coding apparatus 20 and moving picture decoding apparatus 50 is that unit carries out with these macro blocks.In addition, the two field picture that is divided into macro block unit is defined as " frame image signal 2 ".

According to " H.26L coded system ", it can be used as " predictive mode ", be one " INTRA predictive mode ", the pixel value that is used for using the adjacent domain that same two field picture encoded (for example, the pixel value of the upper left side of contiguous frame image signal 2 to be encoded) carries out spatial prediction, and use some " INTER predictive modes " that the two field picture of encode carries out the bit shift compensation inter prediction in time and difference.

Configuration " H.26L coded system " like this can by switching " predictive mode " of macro block, be carried out effective Information Compression according to the position characteristics of incoming video signal 1.

" bit shift compensation inter prediction " is a kind of technology, is used for searching the picture signal pattern that is similar in the frame image signal 2 in the predetermined seek scope of reference frame image 5; Be used to survey the space displacement amount conduct " motion vector 3 " between two picture signal pattern; And be used for coding and send " bit shift compensation relevant information ", this information comprises " motion vector 3 ", " predictive mode " and " reference frame number " and " residual signal 9 of prediction " that calculate according to motion vector 3.

According to " H.26L coded system ", as shown in Figure 3,7 kinds " INTER predictive modes " are available.More properly, in fact, except these predictive modes, when video when being static, " dancing mode " is available, as the predictive mode of the pixel of direct copy reference frame image 5 (two field picture of encoding) same position.

As shown in Figure 3, motion vector 3 is that unit is detected with " pattern 1 " with 16 * 16 pixels, is that unit is detected with " pattern 2 " with 8 * 16 pixels, is that unit is detected with " mode 3 " with 16 * 8 pixels, is that unit is detected with " pattern 4 " with 8 * 8 pixels, is that unit is detected with " pattern 5 " with 8 * 4 pixels, is that unit is detected with " pattern 6 " with 8 * 4 pixels, and is that unit is detected with " mode 7 " with 4 * 4 pixels.

That is to say that these 7 kinds of predictive modes can segment displacement and survey unit in macro block, and, can reach the displacement that occurs in the various macro blocks of accurate grasp.

At first, an input block 31 sends to displacement exploring block 32 and spatial prediction parts 35 with frame image signal 2.

Then, displacement exploring block 32 is by the reference frame image 5 of reference from frame memory 34, and the number that detects motion vector 3 meets the predetermined predictive mode 4 of the frame image signal 2 that receives.

Meanwhile, spatial prediction parts 35 use the pixel value from the same two field picture adjacent domain of frame memory 34 of encoding to carry out spatial prediction.Spatial prediction parts 35 can be carried out spatial prediction by Several Methods.

The second, displacement exploring block 32 sends to displacement compensator 33 with all " INTER predictive modes " the shown in Figure 3 motion vector 3 that detects and predictive mode (for example, pattern 1 to 7) that meets motion vector 3.

Then, displacement compensator 33 is passed through bit shift compensation, generate a prediction image signal (macroblock unit) 6, this bit shift compensation uses from the reference frame image 5 of frame memory 34 and some motion vectors 3 and combination from the predictive mode 4 of displacement exploring block 32.

The 3rd, the prediction image signal 6 that displacement compensator 33 will generate by bit shift compensation for information about, predictive mode 4, motion vector 3 and code efficiency send to predictive mode decision means 36.On the other hand, spatial prediction parts 35 prediction image signal 7 that will generate by spatial prediction for information about, predictive mode (if having some kinds of spatial predictions) 4 and code efficiency send to predictive mode decision means 36.

The 4th, predictive mode judging unit 36 is assessed all " INTER predictive modes " shown in Figure 3 with macro block unit, so that select to determine the highest " the INTER predictive mode " of code efficiency.

In addition, if " INTRA predictive mode " is higher than " INTER predictive mode " aspect code efficiency, then predictive mode decision means 36 is assessed " INTRA predictive mode " similarly, and selection " INTRA predictive mode ".

Then, predictive mode decision means 36 will send to subtracter 37 by the prediction image signal (macroblock unit) 8 that selected predictive mode 4 generates.

In addition, when " INTER predictive mode " selected during as predictive mode 4, predictive mode decision means 36 sends to Variable Length Code parts 40 with " bit shift compensation relevant information ", wherein, the bit shift compensation relevant information comprises the number (every macro block 16) of the motion vector 3 that is provided with in selected " INTER predictive mode " etc.On the other hand, selected during as predictive mode 4 when " INTRA predictive mode ", predictive mode decision means 36 does not send motion vector 3.

The five, one orthogonal transform parts 38 by orthogonal transform being applied to frame image signal 2 and the difference between the prediction image signal 8 (a prediction residual signal 9) from subtracter 37, generate an orthogonal transform coefficient 10.

The 6th, quantize parts 39 by quantizing orthogonal transform coefficient 10 from orthogonal transform parts 38, generate the orthogonal transform coefficient 11 of a quantification.

The 7th, 40 pairs of Variable Length Code parts carry out entropy coding from the orthogonal transform coefficient 11 of the quantification that quantizes parts 39 with from the predictive mode 4 (with motion vector 3) of predictive mode decision means 36, so that they are multiplexed in the compressive flow 12.

Variable Length Code parts 40 can be that unit sends to moving picture decoding apparatus 50 with the macro block with this compressive flow 12, perhaps are that unit sends this compressive flow 12 with the two field picture.

In addition, re-quantization parts 41 by carrying out re-quantization from the orthogonal transform coefficient 11 of the quantification that quantizes parts 39, generate an orthogonal transform coefficient 13.Then, inverse orthogonal transformation parts 42 by the orthogonal transform coefficient 13 from re-quantization parts 14 is carried out inverse orthogonal transformation, generate a prediction residual signal 14.

Next, in an adder, be added in together, generate a frame image signal 15 from the prediction residual signal 14 of inverse orthogonal transformation parts 42 with from the prediction image signal 8 of predictive mode decision means 36.

The frame image signal 15 of macroblock unit is stored in frame memory 34.In frame memory 34, stored the information (pixel value or motion vector) of the macro block that the coding of the reference frame image 5 that is used for the two field picture unit that next code handles and current two field picture of encoding crosses.

Next, the operation of moving picture decoding apparatus 10 shown in Figure 2 is described.

At first, after receiving compressive flow 12, variable-length decoding parts 71 detect the synchronization character of an every frame head of indication, and are each macroblock unit recovery motion vector 3, predictive mode 4 and quantification orthogonal transform coefficient 11.

Then, variable-length decoding parts 71 will quantize orthogonal transform coefficient 11 and send to re-quantization parts 76, and predictive mode is sent to switch 75.In addition, when predictive mode 4 was " INTER predictive mode ", variable-length decoding parts 71 sent to displacement compensator 72 with motion vector 3 and predictive mode 4; When predictive mode 4 is " INTRA predictive mode ", predictive mode 4 is sent to spatial prediction parts 74.

Next step, when predictive mode 4 is " INTER predictive mode ", motion vector 3 and predictive mode 4 that displacement compensator 72 is used from variable-length decoding parts 71, the reference frame image 5 with reference to from frame memory 73 generates a prediction image signal 6.

On the other hand, when predictive mode 4 was " INTRA predictive mode ", 74 references of spatial prediction parts generated a prediction image signal 7 from the coding image signal of the adjacent domain of frame memory 73.

Next step, switch 75 is according to the predictive mode 4 from variable-length decoding parts 71, one of selects in the

prediction image signal

6 and 7, thereby determines prediction image signal 8.

Meanwhile, the quantification orthogonal transform coefficient 11 of variable-length decoding parts 71 decodings is orthogonal transform coefficient 10 by re-quantization parts 76 re-quantizations thereby be resumed.And orthogonal transform coefficient 10 is carried out inverse orthogonal transformation via inverse orthogonal transformation parts 77, is prediction residual signal 9 thereby be resumed.

Then, in adder 78, be added in together from the prediction image signal 8 of switch 75 with from the prediction residual signal 9 of inverse orthogonal transformation parts 77, thereby frame image signal 2 is resumed so that send to output block 80.Output block 80 outputs to display device, (not shown) with the related scheduled time of this signal, thereby copies outputting video signal (a kind of mobile image) 1A.

In addition, recover frame image signal 2 and be stored in frame memory 73, for use in decoding processing thereafter.

In " TML-8 ", realized the bit shift compensation of use " special position " notion.Fig. 4 has shown this " special position " and integral image position, 1/2 picture position and 1/4 picture position.By way of parenthesis, in " TML-8 ", realized the bit shift compensation of 1/4 pixel precision.

In Fig. 4, suppose integer pixel positions ((1 pixel in reference frame image 5 of motion vector 3 indications that displacement exploring block 32 detects, 1 pixel) location of pixels) " D ", it is relevant with integer pixel positions " A " in the frame image signal 2 to be encoded.In this case, the pixel value of the location of pixels in the reference frame image 5 " D " becomes " bit shift compensation value ", and this is worth with the location of pixels in the frame image signal to be encoded 2 " A " is relevant.

Next step supposes 1/2 location of pixels (location of pixels of (1/2 pixel, 1/2 pixel)) " E " in reference frame image 5 of motion vector 3 indication, and it is relevant with integer pixel positions " A " in the frame image signal 2 to be encoded.In this case, 6 grades of filters (1 of the pixel value of and level in reference frame image 5 in integer pixel positions vertical by independent operating,-5,20,20 ,-5,1)/32 obtains an interpolate value, this interpolate value is as " bit shift compensation value ", and it is relevant with location of pixels " A " in the frame image signal 2 to be encoded.

Next step supposes 1/4 location of pixels (location of pixels of (1/4 pixel, 1/4 pixel)) " F " or " G " in reference frame image 5 of motion vector 3 indication, and it is relevant with integer pixel positions " A " in the frame image signal 2 to be encoded.In this case, the linear interpolation of the pixel value of the pixel value of a contiguous integer pixel positions and vicinity 1/2 location of pixels is as " bit shift compensation value ", and it is relevant with location of pixels " A " in the frame image signal 2 to be encoded.

For example, location of pixels " F " in motion vector 3 indication reference frame image 5, it is relevant with location of pixels " A " in the frame image signal 2 to be encoded, the pixel value of the pixel value of contiguous integer pixel positions and contiguous 1/2 location of pixels, as " bit shift compensation value ", it is relevant with location of pixels " A " in the frame image signal 2 to be encoded round the mean value of 4 pixel values of location of pixels " F " for these.

In addition, when the location of pixels " G " in the motion vector 3 indication reference frame image 5, it is relevant with integer pixel positions A in the frame image signal 2 to be encoded, level clips the mean value of 2 pixel values of 1/2 location of pixels of location of pixels " G " as " bit shift compensation value ", and it is relevant with location of pixels A in the frame image signal 2 to be encoded.

Further, location of pixels (N+3/4 pixel in motion vector indication reference frame image 5, M+3/4 pixel: N and M are given integer) time, it is relevant with integer pixel positions A in the frame image signal 2 to be encoded, " the bit shift compensation value " relevant with integer pixel positions in the frame image signal 2 to be encoded become in the reference frame image 5 (N, M), (N, M+1), (N+1, M) and (N+1, M+1) mean value of pixel value.Here, (the N+3/4 pixel, M+3/4 pixel: N and M are given integer) in the reference frame image 5 is exactly aforesaid " special position ".

For example, location of pixels " H " in motion vector 3 indication reference frame image 5 (for example, one " special position ") time, it is relevant with integer pixel positions " A " in the frame image signal 2 to be encoded, " the bit shift compensation value " relevant with location of pixels " A " in the frame image signal 2 to be encoded be not aforementioned 1/4 location of pixels (for example, location of pixels " F ") value that calculates in the situation, but the value that calculates by (A+B+C+D)/4.

As mentioned above, in " H.26L coded system ", many " INTER predictive modes " are available for the bit shift compensation of refining.In addition, the bit shift compensation based on integer pixel positions, 1/2 location of pixels, 1/4 location of pixels and special position all is available.By aforementioned arrangements, when a kind of predicted configuration is refined, introduce a kind of mechanism that prevents prediction image signal 8 breakages, predict the frame image signal 2 that does not have realization even imported it, this mechanism also works.

1/4 precision of images is calculated by the linear interpolation of the pixel value of neighborhood pixels position and is undertaken.Like this, in the frequency domain space, the low-pass type operation is provided, so that generate level and smooth prediction image signal 6.

In addition, when the bit shift compensation that uses based on special position, " bit shift compensation value " calculated based on the mean value of 4 pixel values of contiguous integer pixel positions, thereby generates further level and smooth prediction image signal.If Gaussian noise is superimposed on the prediction image signal, when noise contribution became big, this smoothly can obtain the effect that reduces prediction error.

Like this, in " the H.26L coded system " of " TML-8 " definition, if noise is superimposed upon on the reference frame image 5, perhaps, if many high pass compositions are included in reference frame image 5, and the mistake in the prediction is flagrant, by using 1/4 pixel precision to calculate and improving code efficiency based on the bit shift compensation of special position.

Yet in traditional " H.26L coded system ", following problems can be imagined and can take place.

At first, location of pixels in frame image signal to be encoded 2 has location of pixels (the N+3/4 pixel that an indication equals " special position ", M+3/4 pixel: N and M are given integer) motion vector the time, " the bit shift compensation value " calculated always passed through strong level and smooth, and, the problem that the bit shift compensation of refining when especially, having two-forty is hindered (first problem).

That is to say that in traditional " H.26L coded system ", special position is by the absolute value definition of motion vector 3.Like this, as shown in Figure 5, for example, as piece A, B, C, D and E are to be parallel to lower right side (3/4 pixel, 3/4 pixel) when mobile, and (MVx MVy)=(3/4,3/4) carries out level and smooth bit shift compensation based on motion vector MV=.Alternatively, by (MVx MVy)=(1/2,3/4) or (4/3,1), supplies with the motion vector that is different from the real number displacement and carries out bit shift compensation based on motion vector MV=.Here, the X element of MVx indication motion vector, and the Y element of MVy indication motion vector.

Especially, as shown in Figure 5, in traditional " H.26L coded system ", when piece to be encoded is E, and the motion vector MV of piece E is (MVxE, MVyE) time, always one in a zone " special position ", and the pixel value of level and smooth mistake selected " bit shift compensation value " as piece E by " MVxE%4=3 " and " MVyE%4=3 " compression.Here, " % " is merchant's remainder compute sign, and the unit of expression motion vector MV is 1/4 pixel.

Like this, in " H.26L coded system ", because motion vector (3/4,3/4) indication real number (1/2,1/2) the smooth pixel value that occurs in the location of pixels, the problem that exists the expression of the pixel value of the location of pixels (N+3/4 pixel, M+3/4 pixel: N and M are given integer) equal " special position " to be hindered.

The second, in generating 1/4 pixel precision prediction image signal, prediction is refined and is predicted that level and smooth effect is supposed in two-forty and low rate respectively.Yet level and smooth for the prediction in low rate, the bit shift compensation of 1/4 pixel precision is unnecessary, and the bit shift compensation of 1/2 pixel precision is just enough.Therefore, the detection of motion vector that has occupied 1/4 pixel precision that is used for smoothing prediction of half parameter space of motion vector is redundant, and this also is a problem.

Therefore, the present invention is based on foregoing problems, its objective is with the light weight expense and express prediction image signal, and the bit shift compensation of different stage pixel precision is provided.

Summary of the invention

First feature of the present invention is summarised as a kind of moving picture coding apparatus, is used for by bit shift compensation, will be encoded by the mobile image that the two field picture sequential is formed.This moving picture coding apparatus comprises: a motion vector exploring block is used for the motion vector of explore frame image presumptive area to be encoded; Prediction parts by using the motion vector of the presumptive area of encoding in the two field picture, are used to predict the motion vector of presumptive area to be encoded; A decision means is used to judge whether the motion vector that the motion vector exploring block detects is a predetermined displacement vector that the motion vector that predicts according to the prediction parts is provided with; And a switching part, whether the motion vector that detects based on the motion vector exploring block is the predetermined displacement vector, is used to switch the computational methods of presumptive area bit shift compensation value to be encoded.

Second feature of the present invention is summarised as a kind of moving picture decoding apparatus, is used for by bit shift compensation, will be decoded by the mobile image that the two field picture sequential is formed.This moving picture decoding apparatus comprises: motion vector decoding parts, and the motion vector that is used for the presumptive area that two field picture is to be decoded is decoded; Prediction parts by using the motion vector of the presumptive area of decoding in the two field picture, are used to predict the motion vector of presumptive area to be decoded; A decision means is used to judge whether the motion vector that the motion vector exploring block detects is a predetermined displacement vector that the motion vector that predicts according to the prediction parts is provided with; And a switching part, whether the motion vector of decoding based on motion vector decoding parts is the predetermined displacement vector, is used to switch the computational methods of presumptive area bit shift compensation value to be decoded.

The 3rd feature of the present invention is summarised as a kind of mobile method for encoding images, is used for by bit shift compensation, will be encoded by the mobile image that the two field picture sequential is formed.This mobile method for encoding images comprises: a steps A is used for the motion vector of explore frame image presumptive area to be encoded; A step B by using the motion vector of the presumptive area of encoding in the two field picture, is used to predict the motion vector of presumptive area to be encoded; A step C, whether the motion vector that detects among the determining step A is a predetermined displacement vector that is provided with according to the motion vector that predicts among the step B; And a step D, whether be the predetermined displacement vector based on the motion vector that detects in the steps A, be used to switch the computational methods of presumptive area bit shift compensation value to be encoded.

The 4th feature of the present invention is summarised as a kind of moving picture decoding method, is used for by bit shift compensation, will be decoded by the mobile image that the two field picture sequential is formed.This moving picture decoding method comprises: a steps A, and the motion vector that is used for the presumptive area that two field picture is to be decoded is decoded; A step B by using the motion vector of the presumptive area of decoding in the two field picture, is used to predict the motion vector of presumptive area to be decoded; A step C, whether the motion vector of decoding among the determining step A is a predetermined displacement vector that is provided with according to the motion vector that predicts among the step B; And a step D, whether be the predetermined displacement vector based on the motion vector of decoding in the steps A, be used to switch the computational methods of presumptive area bit shift compensation value to be decoded.

The 5th feature of the present invention is summarised as a kind of program, and it impels computer to play the effect of moving picture coding apparatus, by bit shift compensation, the mobile image that is made of the two field picture sequential is encoded.This moving picture coding apparatus comprises: a motion vector exploring block is used for the motion vector of explore frame image presumptive area to be encoded; Prediction parts by using the motion vector of the presumptive area of encoding in the two field picture, are predicted the motion vector of presumptive area to be encoded; A decision means is used to judge whether the motion vector that the motion vector exploring block is surveyed is a predetermined displacement vector of setting according to the motion vector of prediction parts prediction; And a switching part, whether the motion vector of surveying according to the motion vector exploring block is this predetermined motion vector, is used to switch the computational methods of the bit shift compensation value of presumptive area to be encoded.

The 6th feature of the present invention is summarised as a kind of program, and it impels computer to play the effect of moving picture decoding apparatus, by bit shift compensation, the mobile image that is made of the two field picture sequential is decoded.This moving picture decoding apparatus comprises: motion vector decoding parts, and the motion vector that is used for the presumptive area that two field picture is to be decoded is decoded; Prediction parts by using the motion vector of the presumptive area of encoding in the two field picture, are predicted the motion vector of presumptive area to be decoded; A decision means is used to judge whether the motion vector of motion vector decoding parts decoding is a predetermined displacement vector of setting according to the motion vector of prediction parts prediction; And a switching part, whether be this predetermined motion vector according to the motion vector of motion vector decoding parts decoding, be used to switch the computational methods of the bit shift compensation value of presumptive area to be decoded.

The 7th feature according to the present invention is summarised as a kind of computer-readable recording medium, and its storage makes computer play the program of moving picture coding apparatus effect, by bit shift compensation, the mobile image that is made of the two field picture sequential is encoded.This moving picture coding apparatus comprises: a motion vector exploring block is used for the motion vector of explore frame image presumptive area to be encoded; Prediction parts by using the motion vector of the presumptive area of encoding in the two field picture, are predicted the motion vector of presumptive area to be encoded; A decision means is used to judge whether the motion vector that the motion vector exploring block is surveyed is a predetermined displacement vector of setting according to the motion vector of prediction parts prediction; And a switching part, whether the motion vector of surveying according to the motion vector exploring block is this predetermined motion vector, is used to switch the computational methods of the bit shift compensation value of presumptive area to be encoded.

In the 7th feature of the present invention, the predetermined displacement vector is preferably set to and the different value of motion vector of predicting the parts prediction.

In addition, in the 7th feature of the present invention, when the poor information between the motion vector that the motion vector and the motion vector exploring block of the prediction of prediction parts are surveyed was a predetermined value, decision means judged that preferably the motion vector that the motion vector exploring block is surveyed is this predetermined displacement vector.

The 8th feature of the present invention is summarised as a kind of computer-readable recording medium, and its storage makes computer play the program of moving picture decoding apparatus effect, by bit shift compensation, the mobile image that is made of the two field picture sequential is decoded.This moving picture decoding apparatus comprises: motion vector decoding parts, and the motion vector that is used for the presumptive area that two field picture is to be decoded is decoded; Prediction parts by using the motion vector of the presumptive area of encoding in the two field picture, are predicted the motion vector of presumptive area to be decoded; A decision means is used to judge whether the motion vector of motion vector decoding parts decoding is a predetermined displacement vector of setting according to the motion vector of prediction parts prediction; And a switching part, whether be this predetermined motion vector according to the motion vector of motion vector decoding parts decoding, be used to switch the computational methods of the bit shift compensation value of presumptive area to be decoded.

In the 8th feature of the present invention, the predetermined displacement vector is preferably set to and the different value of motion vector of predicting the parts prediction.

In addition, in the 8th feature of the present invention, when the poor information between the motion vector that the motion vector and the motion vector decoding parts of the prediction of prediction parts are decoded was a predetermined value, decision means judged that preferably the motion vector of motion vector decoding parts decoding is this predetermined displacement vector.

The 9th feature of the present invention is summarised as a moving picture coding apparatus, and it will be encoded by the mobile image that the two field picture sequential constitutes by bit shift compensation.This moving picture coding apparatus comprises: a reference picture generates parts, is used for handling by a reference frame image being carried out some different images, generates some different reference pictures; A displacement compensator is by using the reference picture that generates, for presumptive area to be encoded is calculated a bit shift compensation value; And a transmit block, be used to send an employed reference image information of displacement calculating offset and the combination of indicating displacement offset information.Reference image information is the combination of the information of a reference frame image mark information and indicating image processing.

The of the present invention ten feature is summarised as a moving picture coding apparatus, and it will be encoded by the mobile image that the two field picture sequential constitutes by bit shift compensation.This moving picture coding apparatus comprises: a reference picture generates parts, is used for according to presumptive area encoding condition to be encoded, generates a reference picture of handling through predetermined image from reference frame image; And a displacement compensator, by using the reference picture that generates, be that presumptive area to be encoded is calculated a bit shift compensation value through the predetermined image processing.

The 11 feature of the present invention is summarised as a moving picture decoding apparatus, and it will be decoded by the mobile image that the two field picture sequential constitutes by bit shift compensation.This moving picture decoding apparatus comprises: a reference picture generates parts, is used for generating some different reference pictures by reference frame image being carried out some different image processing; Decoding parts are used for that moving picture coding apparatus is calculated the employed reference image information of bit shift compensation value and decode; And a displacement compensator, by using the reference picture of the reference image information appointment that generates, be used to calculate the bit shift compensation value of presumptive area to be decoded.Reference image information is the combination of a reference frame image mark information and image processing data.

The 12 feature of the present invention is summarised as a moving picture decoding apparatus, and it will be decoded by the mobile image that the two field picture sequential constitutes by bit shift compensation.This moving picture decoding apparatus comprises: a reference picture generates parts, is used for the encoding condition according to presumptive area to be decoded, generates the reference picture of handling through predetermined image from reference frame image; And a displacement compensator, by using the reference picture that generates, be used to calculate the bit shift compensation value of presumptive area to be decoded through the predetermined image processing.

The 13 feature of the present invention is summarised as a mobile method for encoding images, and it will be encoded by the mobile image that the two field picture sequential constitutes by bit shift compensation.This mobile method for encoding images comprises: a steps A by reference frame image being carried out some different image processing, generates some different reference pictures; A step B by using the reference picture that generates, calculates the bit shift compensation value of presumptive area to be encoded; And a step C, the combination that is used to send the employed reference image information of displacement calculating offset and indicates the information of displacement offset.Reference image information is the identification information of a reference frame image and the combination of instruction image processing information.

The 14 feature of the present invention is summarised as a mobile method for encoding images, and it will be encoded by the mobile image that the two field picture sequential constitutes by bit shift compensation.This mobile method for encoding images comprises: a steps A, be used for encoding condition according to presumptive area to be encoded, and generate the reference picture of handling through predetermined image from reference frame image; With a step B,, be used to calculate the bit shift compensation value of presumptive area to be encoded by using the reference picture that generates through the predetermined image processing.

The 15 feature of the present invention is summarised as a moving picture decoding method, and it will be decoded by the mobile image that the two field picture sequential constitutes by bit shift compensation.This moving picture decoding method comprises: a steps A is used for generating some different reference pictures by reference frame image being carried out some different image processing; A step B is used for that moving picture coding apparatus is calculated the employed reference image information of bit shift compensation value and decodes; With a step C,, be used to calculate the bit shift compensation value of presumptive area to be decoded by using the reference picture of the reference image information appointment that generates.Reference image information is the combination of a reference frame image mark information and image processing data.

The 16 feature of the present invention is summarised as a moving picture decoding method, and it will be decoded by the mobile image that the two field picture sequential constitutes by bit shift compensation.This moving picture decoding method comprises: a steps A, be used for encoding condition according to presumptive area to be decoded, and generate the reference picture of handling through predetermined image from reference frame image; With a step B,, be used to calculate the bit shift compensation value of presumptive area to be decoded by using the reference picture that generates through the predetermined image processing.

The 17 feature of the present invention is summarised as a kind of program, and it makes computer play the effect of moving picture coding apparatus, by bit shift compensation, the mobile image that is made of the two field picture sequential encoded.This moving picture coding apparatus comprises: a reference picture generates parts, is used for generating some different reference pictures by a reference frame image is carried out some different image processing; A displacement compensator is by using the reference picture that generates, for presumptive area to be encoded is calculated a bit shift compensation value; And a transmit block, be used to send an employed reference image information of displacement calculating offset and the combination of indicating displacement offset information.Reference image information is the combination of a reference frame image mark information and instruction image processing information.

The 18 feature of the present invention is summarised as a kind of program, and it makes computer play the effect of moving picture coding apparatus, by bit shift compensation, the mobile image that is made of the two field picture sequential encoded.This moving picture coding apparatus comprises: a reference picture generates parts, is used for the encoding condition according to presumptive area to be encoded, generates a reference picture of handling through predetermined image from reference frame image; And a displacement compensator, by using the reference picture that generates, be that presumptive area to be encoded is calculated a bit shift compensation value through the predetermined image processing.

Nineteen feature of the present invention is summarised as a kind of program, and it makes computer play the effect of moving picture decoding apparatus, by bit shift compensation, the mobile image that is made of the two field picture sequential is decoded.This moving picture decoding apparatus comprises: a reference picture generates parts, is used for generating some different reference pictures by reference frame image being carried out some different image processing; Decoding parts are used for that moving picture coding apparatus is calculated the employed reference image information of bit shift compensation value and decode; And a displacement compensator, by using the reference picture of the reference image information appointment that generates, be used to calculate the bit shift compensation value of presumptive area to be decoded.Reference image information is the combination of a reference frame image mark information and image processing data.

The 20 feature of the present invention is summarised as a kind of program, and it makes computer play the effect of moving picture decoding apparatus, by bit shift compensation, the mobile image that is made of the two field picture sequential decoded.This moving picture decoding apparatus comprises: a reference picture generates parts, is used for the encoding condition according to presumptive area to be decoded, generates the reference picture of handling through predetermined image from reference frame image; And a displacement compensator, by using the reference picture that generates, be used to calculate the bit shift compensation value of presumptive area to be decoded through the predetermined image processing.

The 21 feature of the present invention is summarised as a kind of computer-readable recording medium, and its storage makes computer play the program of moving picture coding apparatus effect, by bit shift compensation, the mobile image that is made of the two field picture sequential is encoded.This moving picture coding apparatus comprises: a reference picture generates parts, is used for generating some different reference pictures by a reference frame image is carried out some different image processing; A displacement compensator is by using the reference picture that generates, for presumptive area to be encoded is calculated a bit shift compensation value; And a transmit block, be used to send an employed reference image information of displacement calculating offset and the combination of indicating displacement offset information.Reference image information is the combination of a reference frame image mark information and instruction image processing information.

In the 21 feature of the present invention, preferably, displacement compensator is switched the employed reference picture of displacement calculating offset to survey motion vector unit, and transmit block is to survey the combination that motion vector unit sends reference image information and indication displacement offset information.

In the 21 feature of the present invention, preferably, reference image information is that the identification information of motion vector unit and the combination of instruction image processing information are surveyed in an indication, and transmit block is used to send the combination of the bit shift compensation value information of reference image information, reference frame image mark information and indication each presumptive area to be encoded.

In addition, in the 21 feature of the present invention, preferably, image processing is a processing that changes spatial resolution, and when using the reference picture of low spatial resolution, displacement compensator is used to reduce the employed motion vector precision of displacement calculating vector.

In addition, in the 21 feature of the present invention, preferably, according to the encoding condition of presumptive area to be encoded, reference image information dynamically changes the combination of reference frame image mark information and instruction image processing information.

Further, in the 21 feature of the present invention, preferably, according to the encoding condition of presumptive area to be encoded, reference image information dynamically changes indication and surveys the identification information of motion vector unit and the combination of instruction image processing information.

The 22 feature of the present invention is summarised as a kind of computer-readable recording medium, and its storage makes computer play the program of moving picture coding apparatus effect, by bit shift compensation, the mobile image that is made of the two field picture sequential is encoded.This moving picture coding apparatus comprises: a reference picture generates parts, is used for according to presumptive area encoding condition to be encoded, generates a reference picture of handling through predetermined image from reference frame image; And a displacement compensator, by using the reference picture that generates, be that presumptive area to be encoded is calculated a bit shift compensation value through the predetermined image processing.

In the 22 feature of the present invention, preferably, according to the type of surveying motion vector unit, reference picture generates parts and is used to generate the reference picture of handling through predetermined image.

In addition, in the 22 feature of the present invention, preferably, according to quantization step, reference picture generates parts and is used to generate the reference picture of handling through predetermined image.

The 23 feature of the present invention is summarised as a kind of computer-readable recording medium, and its storage makes computer play the program of moving picture decoding apparatus effect, by bit shift compensation, the mobile image that is made of the two field picture sequential is decoded.This moving picture decoding apparatus comprises: a reference picture generates parts, is used for generating some different reference pictures by reference frame image being carried out some different image processing; Decoding parts are used for that moving picture coding apparatus is calculated the employed reference image information of bit shift compensation value and decode; And a displacement compensator, by using the reference picture of the reference image information appointment that generates, be used to calculate the bit shift compensation value of presumptive area to be decoded.Reference image information is the combination of a reference frame image mark information and image processing data.

In the 23 feature of the present invention, preferably, the decoding parts are decoded to the information of reference image information and indication displacement offset to survey motion vector unit, and displacement compensator is switched the employed reference picture of displacement calculating offset to survey motion vector unit.

In the 23 feature of the present invention, preferably, reference image information is that the identification information of motion vector unit and the combination of instruction image processing information are surveyed in an indication, and the decoding parts are used for presumptive area unit to be decoded the information of reference image information, reference frame image mark information and indication displacement offset being decoded.In addition, preferably, displacement compensator is used to calculate the bit shift compensation value of presumptive area to be decoded by the reference image information of use generation and the reference picture of reference frame image mark information appointment.

In addition, in the 23 feature of the present invention, preferably, image processing is a processing that changes spatial resolution, and when using the reference picture of low spatial resolution, displacement compensator is used to reduce the employed motion vector precision of displacement calculating offset.

In addition, in the 23 feature of the present invention, preferably, according to the encoding condition of presumptive area to be decoded, reference image information dynamically changes the identification information of reference frame image and the combination of instruction image processing information.

Further, in the 23 feature of the present invention, preferably, according to the encoding condition of presumptive area to be decoded, reference image information dynamically changes indication and surveys the identification information of motion vector unit and the combination of instruction image processing information.

The 24 feature of the present invention is summarised as a kind of computer-readable recording medium, and its storage makes computer play the program of moving picture decoding apparatus effect, by bit shift compensation, the mobile image that is made of the two field picture sequential is decoded.This moving picture decoding apparatus comprises: a reference picture generates parts, is used for the encoding condition according to presumptive area to be decoded, generates the reference picture of handling through predetermined image from reference frame image; And a displacement compensator, by using the reference picture that generates, be used to calculate the bit shift compensation value of presumptive area to be decoded through the predetermined image processing.

In addition, in the 24 feature of the present invention, preferably, according to the type of surveying motion vector unit, reference picture generates parts and is used to generate the reference picture of handling through predetermined image.

Further, in the 24 feature of the present invention, preferably, according to quantization step, reference picture generates parts and is used to generate the reference picture of handling through predetermined image.

The 25 of the present invention is characterized as a kind of moving picture coding apparatus, and it will be encoded by the mobile image that the two field picture sequential constitutes by bit shift compensation.This moving picture coding apparatus comprises: a reference picture generates parts, is used for generating some different reference pictures by a reference frame image is carried out some different image processing; One 3 dimension motion vector generates parts, is associated by the information that will use reference picture motion vector that detects and the image processing that is designated as the reference picture execution, is used to generate one 3 dimension motion vector; A displacement compensator is by using the reference picture that generates, for presumptive area to be encoded is calculated a bit shift compensation value; And a transmit block, be used to send the combination of 3 dimension motion vectors and indication displacement offset information.

The 26 of the present invention is characterized as a kind of moving picture decoding apparatus, is used for by bit shift compensation, will be decoded by the mobile image that the two field picture sequential is formed.This moving picture decoding apparatus comprises: a reference picture generates parts, is used for generating some different reference pictures by a reference frame image is carried out some different image processing; Decoding parts are used for 3 dimension motion vectors of presumptive area to be decoded are decoded; And a displacement compensator, by using the reference picture of the 3 dimension motion vector appointments that generate, for presumptive area to be decoded is calculated a bit shift compensation value.

The 27 of the present invention is characterized as a kind of mobile method for encoding images, and it will be encoded by the mobile image that the two field picture sequential constitutes by bit shift compensation.This mobile method for encoding images comprises: a steps A by reference frame image being carried out some different image processing, generates some different reference pictures; A step B is associated by the information that will use reference picture motion vector that detects and the image processing that is designated as the reference picture execution, is used to generate one 3 dimension motion vector; A step C by using the reference picture that generates, calculates the bit shift compensation value of presumptive area to be encoded; And a step D, be used to send the combination of 3 dimension motion vectors and indication displacement offset information.

The 28 of the present invention is characterized as a kind of moving picture decoding method, is used for by bit shift compensation, will be decoded by the mobile image that the two field picture sequential is formed.This moving picture decoding method comprises: a steps A is used for generating some different reference pictures by a reference frame image is carried out some different image processing; A step B is used for 3 dimension motion vectors of presumptive area to be decoded are decoded; With a step C, by using the reference picture of the 3 dimension motion vector appointments that generate, for presumptive area to be decoded is calculated a bit shift compensation value.

Second nineteen of the present invention is characterized as a kind of program, and it makes computer play the effect of moving picture coding apparatus, by bit shift compensation, the mobile image that is made of the two field picture sequential is encoded.This moving picture coding apparatus comprises: a reference picture generates parts, is used for generating some different reference pictures by a reference frame image is carried out some different image processing; One 3 dimension motion vector generates parts, is associated by the information that will use reference picture motion vector that detects and the image processing that is designated as the reference picture execution, is used to generate one 3 dimension motion vector; A displacement compensator is by using the reference picture that generates, for presumptive area to be encoded is calculated a bit shift compensation value; And a transmit block, be used to send the combination of 3 dimension motion vectors and indication displacement offset information.

The 30 of the present invention is characterized as a kind of program, and it makes computer play the effect of moving picture decoding apparatus, by bit shift compensation, the mobile image that is made of the two field picture sequential is decoded.This moving picture decoding apparatus comprises: a reference picture generates parts, is used for generating some different reference pictures by a reference frame image is carried out some different image processing; Decoding parts are used for 3 dimension motion vectors of presumptive area to be decoded are decoded; And a displacement compensator, by using the reference picture of the 3 dimension motion vector appointments that generate, for presumptive area to be decoded is calculated a bit shift compensation value.

The 31 of the present invention is characterized as a kind of computer-readable recording medium, and its storage makes computer play the program of moving picture coding apparatus effect, by bit shift compensation, the mobile image that is made of the two field picture sequential is encoded.This moving picture coding apparatus comprises: a reference picture generates parts, is used for generating some different reference pictures by a reference frame image is carried out some different image processing; One 3 dimension motion vector generates parts, is associated by the information that will use reference picture motion vector that detects and the image processing that is designated as the reference picture execution, is used to generate one 3 dimension motion vector; A displacement compensator is by using the reference picture that generates, for presumptive area to be encoded is calculated a bit shift compensation value; And a transmit block, be used to send the combination of 3 dimension motion vectors and indication displacement offset information.

In the 31 feature of the present invention, preferably, reference picture generates parts and carries out filtration treatment by the filter that use has some different passbands, is used to generate some different reference pictures, and, 3 dimension motion vector identification filters.

In addition, in the 31 feature of the present invention, preferably, 3 dimension motion vectors prediction parts are by using the correlation of the presumptive area of encoding in the two field picture and presumptive area to be encoded, be used to predict 3 dimension motion vectors, and transmit block is used to send 3 dimension motion vectors and generates the poor information of 3 dimension motion vectors of 3 dimension motion vectors that parts generate and 3 dimension motion vectors prediction parts predictions and the combination of indicating displacement offset information.

In addition, in the 31 feature of the present invention, preferably, 3 dimension motion vector prediction parts are by switching the context prediction 3 dimension motion vectors in the encryption algorithm.

Further, in the 31 feature of the present invention, preferably, image processing is the processing that changes spatial resolution, and 3 dimension motion vectors generate parts and are used to reduce the precision that 3 of low spatial resolution reference picture is tieed up motion vectors.

The 32 of the present invention is characterized as a kind of computer-readable recording medium, and its storage makes computer play the program of moving picture decoding apparatus effect, by bit shift compensation, the mobile image that is made of the two field picture sequential is decoded.This moving picture decoding apparatus comprises: a reference picture generates parts, is used for generating some different reference pictures by a reference frame image is carried out some different image processing; Decoding parts are used for 3 dimension motion vectors of presumptive area to be decoded are decoded; And a displacement compensator, by using the reference picture of the 3 dimension motion vector appointments that generate, for presumptive area to be decoded is calculated a bit shift compensation value.

In the 32 feature of the present invention, preferably, reference picture generates parts and carries out filtration treatment by the filter that use has some different passbands, is used to generate some different reference pictures, and, 3 dimension motion vector identification filters.

In addition, in the 32 feature of the present invention, preferably, 3 dimension motion vectors prediction parts are by using the correlation of the presumptive area of decoding in the two field picture and presumptive area to be decoded, be used to predict 3 dimension motion vectors, and displacement compensator is tieed up the poor information that motion vectors are tieed up in 3 of motion vector prediction parts prediction by the 3 dimension motion vectors and 3 that use the parts of decoding to decode, and is used to calculate the bit shift compensation value of presumptive area to be decoded.

Further, in the 32 feature of the present invention, preferably, 3 dimension motion vector prediction parts are by switching the context prediction 3 dimension motion vectors in the encryption algorithm.

Description of drawings

Fig. 1 has shown the schematic diagram according to the moving picture coding apparatus of conventional art;

Fig. 2 has shown the schematic diagram according to the moving picture decoding apparatus of conventional art;

Fig. 3 has shown the pattern of cutting apart according to macro block in the INTER predictive mode of conventional art;

Fig. 4 has shown the notion according to the special position of conventional art;

Fig. 5 has shown according to the method for calculating the predictive displacement vector in the moving picture coding apparatus of the embodiment of the invention;

Fig. 6 has shown the functional block diagram according to the displacement compensator of the moving picture coding apparatus of the embodiment of the invention;

Fig. 7 has shown according to the notion of judging " special position " in the moving picture coding apparatus of the embodiment of the invention;

Fig. 8 has shown the operational flowchart according to the displacement compensator of the moving picture coding apparatus of the embodiment of the invention;

Fig. 9 has shown the flow chart according to the decoding processing in the moving picture decoding apparatus of the embodiment of the invention;

Figure 10 has shown the notion of judging " special position " in the moving picture coding apparatus that improves embodiment according to the present invention;

Figure 11 has shown the notion of judging " special position " in the moving picture coding apparatus that improves embodiment according to the present invention;

Figure 12 has shown the schematic diagram according to the moving picture coding apparatus of the embodiment of the invention;

Figure 13 has shown the schematic diagram according to the moving picture decoding apparatus of the embodiment of the invention;

Figure 14 has shown the coding grammer in the macroblock unit in the employed in embodiments of the present invention H.26L coded system;

Figure 15 has shown the example of employed reference frame code table in this inventive embodiments;

Figure 16 has shown the part of employed reference frame code table in this inventive embodiments;

Figure 17 has shown in the present invention and has improved among the embodiment coding grammer in the macroblock unit in the employed H.26L coded system;

Figure 18 has shown employed macro block mode code table in this invention improvement embodiment;

Figure 19 has shown the schematic diagram according to the moving picture coding apparatus of the embodiment of the invention;

Figure 20 has shown the schematic diagram according to the moving picture decoding apparatus of the embodiment of the invention;

Figure 21 is the layering reference picture that is used to explain according to this inventive embodiments;

Figure 22 is the method that is used to explain according to the generation layering reference picture of this inventive embodiments;

Figure 23 is used for showing the method for calculating the predictive displacement vector according to the moving picture coding apparatus of this inventive embodiments;

Figure 24 has shown the flow chart according to displacement compensating operation in the moving picture coding apparatus of this inventive embodiments;

Figure 25 has explained the method for the generation layering reference picture that improves embodiment according to the present invention;

Figure 26 has shown the computer-readable recording medium, and its computer that makes of storing this inventive embodiments plays the program of moving picture coding apparatus or moving picture decoding apparatus effect.

Embodiment

(embodiment 1)

In first embodiment of the invention, moving picture coding apparatus 20 and moving picture decoding apparatus 50 are described, wherein, (first problem) introduced and improved aspect " special position " bit shift compensation, and the problem here is the problem of tradition " TML-8 " definition " H.26L coded system ".

According to this embodiment, except the bit shift compensation in " special position ", other operation is similar with " TML-8 " middle moving picture coding apparatus and moving picture decoding apparatus of describing.Like this, detail will be omitted, and description will concentrate on difference.

Especially, the difference of the configuration of the moving picture coding apparatus 20 of the embodiment of the invention and traditional embodiment and moving picture decoding apparatus 50 is: the displacement compensator 33 of the present invention and conventional art and 72 different configurations.

In embodiments of the present invention, because the displacement compensator 33 of moving picture coding apparatus 20 and the displacement compensator 72 of moving picture coding apparatus 50 have identical configuration.The displacement compensator 33 of moving picture coding apparatus 20 like this, hereinafter will be described.

Incidentally, the moving picture coding apparatus 20 of this embodiment is to be used for according to bit shift compensation, and the mobile image of being made up of the two field picture sequential (incoming video signal 1) is encoded.The moving picture decoding apparatus 50 of this embodiment is to be used for according to bit shift compensation, and the mobile image of being made up of the two field picture sequential (an outputting video signal 1A) is decoded.

In addition, in the moving picture coding apparatus 20 of this embodiment, displacement exploring block 32 is formed a motion vector exploring block, is used for the motion vector 3 of explore frame image presumptive area to be encoded (for example, macro block).In the moving picture decoding apparatus 50 of this embodiment, variable-length decoding parts 71 are formed motion vector decoding parts, and the motion vector 3 that is used for the presumptive area that two field picture is to be decoded (for example, macro block) is decoded.

As shown in Figure 6, the displacement compensator 33 of the moving picture coding apparatus 20 of this embodiment comprises that a motion vector input block 33a, a reference frame image input block 33b, predictive displacement vector calculation component 33c, a decision means 33d and a prediction image signal generate parts 33e.

According to this embodiment, predictive displacement vector calculation component 33c forms prediction parts, by using motion vector (for example, the MV of the presumptive area of encoding in the two field picture _A=(MVx _A, MVy _A), MV _B=(MVx _B, MVy _B), MV _C=(MVx _C, MVy _C)), be used to predict the predictive displacement vector PMV of presumptive area to be encoded (a macro block E) _E=(PMVx _E, PMVy _E).

In addition, decision means 33d forms a decision means, is used to the motion vector MV that judges that motion vector exploring block (displacement exploring block 32) detects _E=(MVx _E, MVy _E) whether be the motion vector MPV that predicts according to prediction parts (predictive displacement vector calculation component 33c) _E=(PMVx _E, PMVy _E) the predictive displacement vector motion vector of (indication " special position ") that is provided with.

Further, prediction image signal generates switching part of parts 33e composition, the motion vector MV that it detects according to motion vector exploring block (displacement exploring block 32) _E=(MVx _E, MVy _E) whether be predetermined displacement vector (motion vector of indication " special position "), be used to switch the method (the generation method of prediction image signal 6) of " the bit shift compensation value " of calculating presumptive area to be encoded.

Motion vector input block 33a is connected to decision means 33d, is used to receive the motion vector MV that displacement exploring block 32 detects _E, so that with this motion vector MV _ESend to decision means 33d.

Reference frame image input block 33b is connected to predictive displacement vector calculation component 33c and decision means 33d, be used to extract adjacent domain (the macro block A of presumptive area to be encoded, B and C) motion vector, it is stored in the frame memory 34, thereby these vectors are sent to predictive displacement vector calculation component 33c.Equally, reference frame image input block 33 is used to extract the reference frame image 5 that is stored in frame memory 34, thereby this reference frame image 5 is sent to decision means 33d.

Predictive displacement vector calculation component 33c is connected to reference frame image input block 33b and decision means 33d, for example, by adjacent domain (macro block A, B, motion vector C) (motion vector of the presumptive area of encoding in the two field picture) MV that uses presumptive area to be encoded _A, MV _BAnd MV _C, it is stored in the frame memory 34, is used to calculate predictive displacement vector PMV _E=(PMVx _E, PMVy _E), it is the motion vector MV of presumptive area (macro block) to be encoded _E=(MVx _E, MVy _E) predicted value.

Here, PMVx _EThe horizontal elements (an X element) of indication predictive displacement vector, PMVy _EThe perpendicular elements (Y element) of indication predictive displacement vector.

According to " TML-8 ", in order effectively motion vector to be encoded, the motion vector of presumptive area to be encoded is predicted, and uses the motion vector be included in the adjacent domain that the coding in the reference frame image 5 crosses to encode by the prognoses system that is called " median prediction ".

In Fig. 5, because the motion vector MV:MV of adjacent domain (macro block) A, B and C _A=(MVx _A, MVy _A), MV _B=(MVx _B, MVy _B) and MV _C=(MVx _C, MVy _C) be encoded, can obtain motion vector horizontal elements MVx _A, MVx _BAnd MVx _CMean value, it is set to the horizontal elements PMVx of the predictive displacement vector of presumptive area to be encoded (macro block) E _E, and also obtain motion vector perpendicular elements MVy _A, MVy _BAnd MVy _CMean value, it is set to the perpendicular elements PMVy of the predictive displacement vector of presumptive area to be encoded (macro block) E _E

For example, under a kind of situation of predictive mode (coding mode), wherein, as adjacent domain (macro block) A that calculates predictive displacement vector PMV, B and C are outside two field picture or do not have motion vector, and predictive displacement vector PMV is set to 0 vector.

Further, there are not 3 or more during the multidigit amount of shifting in as adjacent domain (macro block) A, the B of the predictive displacement vector PMV that calculates presumptive area (macro block) E to be encoded and C, be set to 0 vector or other hypothesis by the motion vector that uses hypothesis adjacent domain (macro block) A, B and C, the predictive displacement vector PMV of presumptive area to be encoded (macro block) E _EValue always can obtain.

In addition, predictive displacement vector calculation component 33c calculates the motion vector MV from motion vector input block 33a _EWith predictive displacement vector PMV _EBetween poor information MVD=(MVDx, MVDy).Here, the X element M VDx that differs from information is by " MVx _E-PMVx _E" the calculating acquisition, the Y element MVDy of difference information is by " MVy _E-PMVy _E" the calculating acquisition.

In " H.26L coded system ", in order to improve transmitting efficiency, motion vector MV encodes with the form of aforementioned poor information MVD and sends.

Decision means 33d is connected to motion vector input block 33a, reference frame image input block 33b, predictive displacement vector calculation component 33c and prediction image signal and generates parts 33e.Decision means 33d is used for according to the motion vector MV from motion vector input block 33a _EWith predictive displacement vector PMV from predictive displacement vector calculation component 33c _E, judge the method (a displacement calculating compensation value method) of generation forecast picture signal 6, thereby this method put into prediction image signal generation parts 33e.

Especially, as shown in Figure 7, decision means 33d generates the vertical component PMVy of the predictive displacement vector of parts 33e generation according to prediction image signal _EPhase place and the motion vector MV that detects of displacement exploring block 32 _E, judge motion vector MV _EWhether indicated one " special position ", and judged result has been put into prediction image signal generation parts 33e.

Hereinafter, predictive displacement vector PMV _EWith motion vector MV _EThe unit of expression formula be 1/4 pixel.

At first, at " PMVy _E%4=0 or 1 " (for example, PMVy _EBe to be in first kind of phase place), " MVx _E%4=3 " and " MVy _E%4=3 " situation under, decision means 33d judges the motion vector MV of presumptive area (macro block E) to be encoded _E(MVx _E, MVy _E) indicated one " special position ".

The second, at " PMVy _E%4=2 or 3 " (for example, PMVy _EBe to be in second kind of phase place), " MVx _E%4=1 " and " MVy _E%4=1 " situation under, decision means 33d judges the motion vector MV of presumptive area (macro block E) to be encoded _E(MVx _E, MVy _E) indicated this " special position ".

As a result, predictive displacement vector PMV _EThe zone of indication is adjusted, thereby is not superimposed upon this " special position ".That is to say the predictive displacement vector PMV of predictive displacement vector calculation component 33c (prediction parts) prediction _EBe set to different with the motion vector of indicating " special position " (predetermined displacement vector).

At PMVy _EBe under the situation of first kind of phase place, in fact, used the bit shift compensation (for example, the motion vector indication " special position " of indication location of pixels a (see figure 7)) of tradition " H.26L coded system ".

In addition, at PMVy _EBe under the situation of second kind of phase place, the motion vector of indication different pixels position b (see figure 7) is supposed indication " special position ".

Yet " the bit shift compensation value " of acquisition is smoothed, and as the mean value around the pixel value of 4 contiguous integer pixel positions of motion vector, and other bit shift compensation is handled the bit shift compensation processing that is similar to tradition " H.26L coded system ".

Prediction image signal generates parts 33e and is connected to decision means 33d, by switching " the generation method of prediction image signal 6 " of presumptive area to be encoded (macro block), is used for generation forecast picture signal 6.

Especially, in other cases, as the motion vector MV that judges the presumptive area to be encoded (macro block E) that displacement exploring block 32 is surveyed _EDuring indication " special position ", prediction image signal generates the prediction image signal 6 of level and smooth this presumptive area of parts 33e, as centering on motion vector MV _EThe mean value of the pixel value of 4 contiguous integer pixel positions of indicated location of pixels, and pass through the prediction image signal 6 that tradition " H.26L coded system " generates presumptive area.

In addition, in the present embodiment, displacement compensator 33 and displacement exploring block 32 are to arrange separately respectively.Yet displacement compensator 33 and displacement exploring block 32 can integratedly be arranged.

Fig. 8 has shown the operation of aforementioned displacements compensating unit 33.

In step 401, the motion vector MV that predictive displacement vector calculation component 33c crosses based on the coding of adjacent domain in the same two field picture (the macro block A among Fig. 5, B and C) _A, MV _BAnd MV _C, calculate predictive displacement vector PMV _E, it is a predicted value of the motion vector of presumptive area to be encoded in the two field picture (the macro block E among Fig. 5).

In step 402, decision means 33d basis is from the perpendicular elements PMVy of the predictive displacement vector of predictive displacement vector calculation component 33c _EPhase place and from the motion vector MV of motion vector input block 33a _E, judge motion vector MV _EWhether indicated one " special position ".

In step 403, the current rheme amount of shifting to MV _EWhen having indicated " special position ", prediction image signal generates parts 33e generates a presumptive area with level and smooth form prediction image signal 6.

In step 404, the current rheme amount of shifting to MV _EWhen not indicating " special position ", prediction image signal generates parts 33e generates a presumptive area by tradition " H.26L coded system " prediction image signal 6.

Next step describes decoding processing step in the moving picture decoding apparatus 50 below with reference to Fig. 9.

In step 501, variable-length decoding parts 71 are surveyed " synchronization character " of picture of indication (every two field picture of forming incoming video signal 1) header.

In step 502, " picture header " of the aforementioned picture of variable-length decoding parts 71 decodings.Should " picture header " comprise " picture type information ", should " picture type information " be used to judge that this picture was one " all macro blocks of forming picture all pass through the picture (hereinafter being called " I picture ") that the INTRA predictive mode is encoded " or one " using the picture (hereinafter being called " P picture ") of INTER predictive mode ".Equally, picture header comprises a quantization parameter value in the orthogonal transform coefficient etc.

Next, carry out the data decode processing of each macroblock layer of forming by predetermined grammer.

In step 503, " RUN " in the variable-length decoding parts 71 decoded macroblock layers.Should " RUN " indication macroblock layer data be 0 repetition macroblock number, and, generated the macro block (jump MB) that the dancing mode with " RUN " number similar number is applied thereon.

In step 505,, in fact, be used to prediction image signal 6 at 16 * 16 pixel regions that are stored in same position on the predetermined reference two field picture 5 of frame memory 73 if macro block is a jump MB.By being that the identification number of a motion vector of 0 and a predetermined reference two field picture sends to displacement compensator 72 and carries out this processing with its value by variable-length decoding parts 72.

In step 506,, judge then whether " RUN " of MB indicates last MB of picture if this macro block is not a jump MB.

In step 507, if MB " RUN " is last MB, the variable-length decoding of this picture is terminated, and begins the variable-length decoding of next picture.

In step 508, if should " RUN " neither jump MB, neither last MB, for example, if should " RUN " be a common MB, variable-length decoding parts 71 decoding " MB_Type " (macro block (mb) types).By this " MB_Type ", set up the predictive mode 4 of presumptive area to be decoded (macro block).In step 509, judge whether the predictive mode of setting up 4 is " INTER predictive mode ".

In step 510, if predictive mode 4 is " an INTRA predictive mode ", 71 decodings " intra_pred_mode " of variable-length decoding parts.In step 511, spatial prediction parts 74 are carried out spatial prediction based on " intra_pred_mode " from the pixel value of adjacent domain, thus generation forecast picture signal 7.

If predictive mode 4 is " an INTER predictive mode ", this predictive mode 4 is one of in the pattern 1 to 7 shown in Figure 3.Like this, at this moment, set up number and " MVDs (the poor information of motion vector) " of " Ref_frames (reference frame image number) " to be decoded.According to such information, the combination of variable-length decoding parts 71 decodings " Ref_frame " and " MVD ".

Yet, in step 512,, therefore, need to judge according to " picture type information " value whether " Ref_frame " exists because the judgement whether " Ref_frame " has been re-used is to be integrated in aforementioned " picture type information ".

In step 513, if " Ref_frame " exists, " Ref_frame " is somebody's turn to do in 71 decodings of variable-length decoding parts, then, in

step

514,71 decodings " MVD " of variable-length decoding parts.If " Ref_frame " do not exist, only decoding " MVD " in the step 514.

In step 514, the predictive mode 4 based on being set up by " Ref_frame " that obtain, " MVD " and " MB_Type " is resumed corresponding to all motion vector MV of 4 * 4 among the MB.

In step 515, displacement compensator 72 is prediction image signal 6 of each 4 * 4 generations based on this " Ref_frame " and motion vector MV.Processing about " special position " here reflects.

In step 516, variable-length decoding parts 71 recover to quantize orthogonal transform coefficient 11.In step 517, re-quantization parts 76 recover orthogonal transform coefficient 10.In step 518, inverse orthogonal transformation parts 77 recover prediction residual signal 9.

In step 519, in adder 78, from the prediction image signal 8 of switch 75 with from prediction residual signal 9 additions of inverse orthogonal transformation parts 77 and obtain the frame image signal 2 of MB.Then, carry out the decoding processing of next MB.

(according to the operation/effect of the mobile image coding and decoding equipment of embodiment 1)

Moving picture coding apparatus according to this embodiment, prediction image signal generates the judged result of parts 33e according to decision means 33d, the predictive displacement vector of predictive displacement vector calculation component 33c prediction for example switches the computational methods of the bit shift compensation value of presumptive area to be encoded.For this reason, the pixel value of same pixel position (N+3/4 pixel, M+3/4 pixel: N and M are given integer) might be expressed as " special position ".

In addition, might solve and smoothly always be applied to have the problem of indication same pixel position by force as " bit shift compensation value " in the zone of the motion vector of " special position ".

The generation forecast picture signal of describing among this embodiment or the method for bit shift compensation value only are examples.Given method for the switching displacement compensation value calculation method necessity that realizes carrying out according to present embodiment also can be used.

(improving embodiment 1A)

The moving picture coding apparatus 20 of previous embodiment 1 and the improvement embodiment 1A of moving picture decoding apparatus 50 are described below.Hereinafter, difference with previous embodiment 1 is only described.

About improving moving picture coding apparatus 20 and the moving picture decoding apparatus 50 of embodiment according to this, in the displacement compensator 72 of the displacement compensator 33 of the moving picture coding apparatus 20 of previous embodiment and moving picture decoding apparatus 50, introduce and improve.The displacement compensator 33 of moving picture coding apparatus 20 is identical with the displacement compensator 72 of moving picture decoding apparatus 50.Like this, hereinafter, will the displacement compensator 33 of moving picture coding apparatus 20 be described.

Improve embodiment according to this, the decision means 33d of displacement compensator 33 is according to the horizontal elements PMVx of predictive displacement vector _EPhase place and the motion vector MV that detects of displacement exploring block 32 _E=(MVx _E, MVy _E), judge whether motion vector indicates " special position ".Then, decision means 33d reports prediction image signal with judged result and generates parts 33e.Hereinafter, motion vector expression formula MV _E=(MVx _E, MVy _E) unit be 1/4 pixel.

At first, at " PMVx _E%4=0 or 1 " (for example, PMVx _EBe to be in first kind of phase place), " MVx _E%4=3 " and " MVy _E%4=3 " situation under, decision means 33d judges motion vector MV _E(MVx _E, MVy _E) indicated one " special position ".

The second, at " PMVx _E%4=2 or 3 " (for example, PMVx _EBe to be in second kind of phase place), " MVx _E%4=1 " and " MVy _E%4=1 " situation under, decision means 33d judges motion vector MV _E(MVx _E, MVy _E) indicated this " special position ".

As a result, predictive displacement vector PMV _EThe zone of indication is adjusted, thereby is not superimposed upon this " special position ".That is to say that the motion vector of indication " special position " is set to and predictive displacement vector PMV _EDifferent.

As mentioned above, improve embodiment 1A, have and reduce the possible effect of motion vector stack that becomes " special position " in the real number displacement by using the forecast coding structure of motion vector.For example, in Fig. 5, when second phase place of predictive displacement vector PMV is 2, even piece A, B, C, D and E are with (3/4 pixel, 3/4 pixel) parallel the moving along the lower right, for example, though motion vector MV=(MVx, MVy)=(3/4,3/4) under the situation, (MVx MVy)=(3/4,3/4) also need not indicate " special position " motion vector MV=.

(improving embodiment 1B)

The moving picture coding apparatus 20 of previous embodiment 1 and the improvement embodiment 1B of moving picture decoding apparatus 50 are described below.Hereinafter, difference with embodiment 1 is only described.

Improving according to this in moving picture coding apparatus 20 and moving picture decoding apparatus 50 of embodiment, in the displacement compensator 72 of the displacement compensator 33 of the moving picture coding apparatus 20 of previous embodiment and moving picture decoding apparatus 50, variation is taking place.The displacement compensator 33 of moving picture coding apparatus 20 is identical with the displacement compensator 72 of moving picture decoding apparatus 50.Like this, hereinafter, will the displacement compensator 33 of moving picture coding apparatus 20 be described.

Improve embodiment according to this, the decision means 33d of displacement compensator 33 is according to aforementioned poor information MVD _E=(MVDx _E, MVDy _E), the motion vector MV of the presumptive area to be encoded (macro block E) that judgement displacement exploring block 32 detects _EWhether indicate " special position ".Then, decision means 33d reports prediction image signal with judged result and generates parts 33e.

That is to say that decision means 33d forms a decision means, when the prediction parts are predicted the motion vector PMV that (predictive displacement vector calculation component 33c) arrives _EThe poor information MVD of the motion vector MVE that detects with motion vector exploring block (displacement exploring block 32) _EWhen equaling predetermined value, be used to the motion vector MV that judges that motion vector exploring block (displacement exploring block 32) detects _EBe predetermined displacement vector (motion vector of an indication " special position ").

Hereinafter, motion vector expression formula MV _E=(MVx _E, MVy _E) unit be 1/4 pixel.

For example, under the situation of " MVxE%4=3 " and " MVyE%4=3 ", decision means 33d judges the motion vector MV that displacement exploring block 32 detects _E=(MVx _E, MVy _E) one " special position " of indication.

In this case, for example, if use motion vector difference information MVD _EThe surplus smooth operation of carrying out of merchant, need to change the computational methods of pixel value in " special position ".

That is to say that according to conventional art, previous embodiment 1 and improve embodiment 1 is carried out bit shift compensation based on the mean value around the pixel value of the integer pixel positions of " special position ".Yet, if use motion vector difference information MVD _ESurplus the carrying out of merchant " special position " judge that " special position " self shows as an integer pixel positions, and the integer pixel positions that is used to obtain mean value may not be set up.Like this, the bit shift compensation operation is according to following execution.

In Figure 11, because " MVDxE%4=3 " and " MVDyE%4=3 " (in this case, " PMVxE%4=1 " and " PMVyE%4=1 "), predicted picture generates the motion vector MV that parts 33e judges that displacement exploring block 32 detects _E=(MVx _E, MVy _E) one " special position " of indication.Here, in fact, motion vector MV _E=(MVx _E, MVy _E) indicated an integer pixel positions " D ".

As shown in figure 11, in this case, predicted picture generates parts 33e makes the bit shift compensation value of presumptive area (macro block or sub-piece) use pixel value (MVx in the reference frame image 5 _E+ 2, MVy _E+ 2), pixel value (MVx _E+ 2, MVy _E-2), pixel value (MVx _E-2, MVy _E+ 2) and pixel value (MVx _E-2, MVy _E-2) mean value is taken on.

Replacedly, except coming from the pixel value of integer pixel positions in the reference frame image 5, predicted picture generates the bit shift compensation value that parts 33e also can obtain presumptive area to be encoded (macro block or sub-piece).Especially, the bit shift compensation value also can be pixel value ((MVx _E/ 4) * 4, (MVy _E/ 4) * 4), (((MVx _E+ 4)/4) * 4, (MVy _E/ 4) * 4), ((MVx _E/ 4) * 4, ((MVy _E+ 4)/4) * 4) and (((MVx _E+ 4)/4) * 4, ((MVy _E+ 4)/4) * 4) mean value.

Improve embodiment 1B according to this, in moving picture coding apparatus 20, can be at real number motion vector (MVx _E, MVy _E) transmission and be used to carry out the motion vector MV of level and smooth bit shift compensation _E=(MVx _E, MVy _E)=(1,1) select between the transmission.

(embodiment 2)

Moving picture coding apparatus 20 and moving picture decoding apparatus 50 according to the embodiment of the invention 2 are described below.In this embodiment, do not use the bit shift compensation of " special position ".

The description of embodiment 1 is by reference, with the transmission problem of the motion vector MV (or poor information MVD of motion vector) of reply indication " special position ", for example, the transmission of the real number motion vector MV problem of being obstructed.Yet, the possibility that still exists real number motion vector MV not to be sent out.

Like this, in the present embodiment, moving picture coding apparatus 20 and moving picture decoding apparatus 50 will be described below.This mobile image coding and decoding equipment is by preparing the strong level and smooth prediction image signal that " bit shift compensation value " in picture embodiment 1 " special position " provides separately, with a prediction image signal that removes common " the bit shift compensation value " of " special position ", and by the identification information of these two kinds of prediction image signals number is sent signalisation with reference frame image, can carry out bit shift compensation from reference picture, its level and smooth rank is different to another from a presumptive area to be encoded.Like this, can not use " special position " to carry out bit shift compensation.

Figure 12 is the schematic diagram of the moving picture coding apparatus 20 of this embodiment, and Figure 13 is the schematic diagram of a moving picture decoding apparatus 50.

In an embodiment, situation as embodiment 1, moving picture coding apparatus 20 and moving picture decoding apparatus 50 are described below, wherein, introduce aspect " special position " bit shift compensation and improve, the problem here is the problem (first problem) in tradition " TML-8 " definition " H.26L coded system ".

In this embodiment 2, except carrying out bit shift compensation rather than use " special position " from reference picture, the moving picture coding apparatus 20 described among other operation and " TML-8 " and the class of operation of moving picture decoding apparatus 50 are seemingly.Like this, detailed description will be omitted, and following description only concentrates on difference.

Except

displacement compensator

33 and 72 and Variable Length Code parts 40 in introduce to improve, and increased new reference picture and generated parts 45 and 80, according to the basic operation of the moving picture coding apparatus 20 of this embodiment and moving picture decoding apparatus 50 in fact with identical according to the operation of the moving picture coding apparatus 20 of conventional art and moving picture decoding apparatus 50.

According to this embodiment, reference picture generates parts 45 and 80 to be passed through reference frame image 5 is carried out some different image processing, is used to generate some different reference pictures (the strong second level and smooth reference picture of common first reference picture or application) 17.Here, as aforementioned image processing, the processing of other processing of the level and smooth level of change, change spatial resolution etc. can contemplate.In this embodiment, as image processing, the situation that level and smooth rank is handled that changes of using is described below.

In addition, displacement compensator 33 replaces reference frame image 5 by using reference picture 17, is used to calculate the bit shift compensation value (prediction image signal 6) of presumptive area to be encoded (macro block).

Variable Length Code parts 40 are formed transmit block, are used to send displacement calculating offset (prediction image signal 6) employed " information of reference picture 17 (reference frame sign indicating number: Ref_frame) " and " information of indication displacement offset (is predicted residual signal digital coding grammer: " the combination text code grammer).

In addition, variable-length decoding parts 71 are formed the decoding parts, and the moving picture coding apparatus 20 that is used for decoding calculates bit shift compensation value employed " reference image information (Ref_frame) " and " information of indication displacement offset (prediction residual signal digital coding grammer) ".

Variable-length decoding parts 71 send to displacement compensator 72 with motion vector 3, predictive mode 4 and " reference frame sign indicating number (Ref_frame) " 4A.

Further, displacement compensator 72 replaces reference frame image 5 by the reference picture 17 that uses " reference image information (Ref_frame) " appointment, is used to calculate the bit shift compensation value of presumptive area to be encoded (macro block).

According to this embodiment, " information of reference picture 17 (reference frame sign indicating number: Ref_frame) " is the combination of " identification information of reference frame image (reference frame image number) " and " indicating level and smooth class information (first reference picture or second reference picture) ".

At first, according to this embodiment, reference picture generates parts 45 and generates a common reference picture (hereinafter being called first reference picture) that does not have " special position ".Except one initial " bit shift compensation value " is used, even for " the bit shift compensation value " of " special position " same position of " TML-8 ", " the bit shift compensation value " of first reference picture equals " the bit shift compensation value " of each location of pixels of integer pixel positions, 1/2 location of pixels and 1/4 location of pixels of " TML-8 ".

Be in position (1/4 pixel in " bit shift compensation value ", 1/4 pixel) rather than under the situation of " the special position " of " TML-8 ", be generated with " the bit shift compensation value " of first reference picture of the same pixel position of " the special position " of " TML-8 ", as 4 mean value of the pixel value of contiguous integer pixel positions and contiguous 1/2 location of pixels.

The second, by using first reference picture, generate a reference picture (hereinafter being called second reference picture), the reference picture that it provides for " the bit shift compensation value " of " the special position " of similar " TML-8 " of strong level and smooth mistake.Here, can use various smoothing filter carries out image processing, generate second reference picture by each pixel value to first reference picture.For example, by 3 grades of filters of isolated operation (1,4,1)/6, the vertical and horizontal smooth effect of pixel value of each location of pixels that it has first reference picture of 1/4 pixel precision can generate second reference picture with 1/4 pixel precision.

According to " H.26L coded system ", the two field picture that differs from one another in time that some codings are crossed is prepared as with reference to two field picture numbers 5, and these can be used as the reference picture of bit shift compensation.In addition, the identification information position of these two field pictures that differ from one another in time of encoding number is distinguished with reference frame image.

According to this embodiment, the identification information of the identification information of first reference picture or second reference picture for example, generates the information of reference picture and reference frame image and number is combined in together and sends.

Like this, under the situation of not using " special position ", (for example, a macro block reference picture that differs from one another of) level and smooth rank can carry out bit shift compensation to use presumptive area to be encoded.

In this case, for the reference frame image 5 of its two field picture of crossing for the coding that differs from one another in time, reference picture generates parts 45 and 80 and generates different level and smooth grade other first and second reference pictures.Therefore, these reference frame image can be used as " reference picture " that is used for bit shift compensation in

displacement compensator

33 and 72.

That Figure 14 has shown is employed among this embodiment " according to the coding grammer of each macroblock unit of coded system H.26L ".According to this embodiment, H.26L the coding grammer of each macroblock unit of coded system does not change.Yet the combination of " reference frame image number " and " reference picture generation method identification information " is changed in the definition of " Ref_frame ", for example, and one " reference frame sign indicating number ".

As shown in figure 14, even when having used the predictive mode (for example, mode 7) that requires the some motion vectors of detection in the macro block, coding still can carry out, and need not comprise information such as some " MB_TYPEs ", " Ref_frames ".

That is to say that by use coding grammer, the transmission action of response " MB_TYPEs ", " Ref_frames " etc. repeats to send the poor information MVD of motion vector and predicts that residual signal digital coding grammer (a text code grammer) is possible.Here, prediction residual signal digital coding grammer obtains through Variable Length Code by quantizing orthogonal transform coefficient 11.

Figure 15 has shown an example based on the reference frame sign indicating number (Ref_frame) of the combination of reference frame image number and reference picture generation method identification information.

Here, as shown in figure 15, the reference frame sign indicating number (" 0 " to " 4 ") number identical with mark tradition reference frame image H.26L is used to first reference picture, and the reference frame sign indicating number that increases newly (" 5 " are to " 9 ") is used to second reference picture.

According to this embodiment, second reference picture likens to first reference picture of common reference picture smoothed more strongly, and second reference picture is a reference picture that does not possess the spatial resolution that initial pictures (reference frame image number 5) had.

Like this, when using stronger level and smooth other reference picture of level, coding distortion has been suppressed when a lot, and bit shift compensation efficient is when being modified, and second reference picture is used.Like this, compare, select the possibility of second reference picture very little with first reference picture.

Therefore, in many cases, selecting it is that first reference picture of common reference picture is as being used for the reference picture of bit shift compensation.In this case, the reference frame code table that is used to define the reference frame sign indicating number to be sent is similar to the reference frame code table that is used to define reference frame sign indicating number (Ref_frame) of " H.26L coded system " shown in Figure 16.Like this, compare, do not have increase by the caused bit quantity of the change of reference frame sign indicating number with the situation of tradition " H.26L coded system ".

Further, using stronger level and smooth other second reference picture of level to carry out under the situation of bit shift compensation, reference frame sign indicating number to be sent needs long relatively code length.Yet, use the possibility of second reference picture little, and, to compare with the bit shift compensation efficient of using strong level and smooth other second reference picture of level to increase, the influence of the bit quantity that the reference frame sign indicating number increases is less.Like this, can obtain high efficiency coding.

(according to the operation/effect of the mobile image coding and decoding equipment of embodiment 2)

According to moving picture coding apparatus 20 of the present invention, by using other reference picture of the level and smooth level of two kinds of differences, for example, reference picture generates common reference picture (first reference picture) and strong level and smooth level other reference picture (second reference picture) that parts 45 form, other reference picture of level carries out bit shift compensation can to use presumptive area to be encoded (for example, macro block) to differ from one another smoothly.

In addition, according to moving picture coding apparatus 20 of the present invention, by generating the reference frame sign indicating number of a combination " reference picture generation method identification information " and " reference frame image number ", the level and smooth rank of reference picture is notified by sending signal.In addition, may solve the problem that smoothly always is applied to have " the bit shift compensation value " in the motion vector zone of " special position " same pixel position in indication and " the H.26L coded system " by force.

In the present embodiment, being used to generate its filter for second reference picture of strong level and smooth rank reference picture only is an example.By filter being used for remove other processing of smoothing processing, can realize prediction based on the different characteristic reference picture.

In addition, in Figure 11, describe for simplifying, the maximum number that is used for the reference frame image of reference picture generation is " 5 ".Yet the present invention is not limited to this numerical value, and the reference frame image maximum number can optionally be provided with.

According to " TML-8 ", the reference frame image maximum number that is used for the reference picture generation in moving picture coding apparatus 20 and the moving picture decoding apparatus 50 is known given.

Further, in actual applications, the maximum number of reference frame image can be determined by a kind of method or based on the information of 50 the compressive flow 12 from moving picture coding apparatus 20 to moving picture decoding apparatus.

Under any circumstance, in moving picture coding apparatus 20 and moving picture decoding apparatus 50, the maximum number that is used for the reference frame image of reference picture generation is well-determined.Like this, according to the maximum number of the reference frame image that is used for the reference picture generation, the reference frame code table can uniquely be determined.

Further, in Figure 16, define in the reference frame code table of reference frame sign indicating number (Ref_frames), it is " reference frame image number " and " reference frame sign indicating number (Ref_frame) " of the combination of " second reference picture ", is to be assigned with afterwards at its " reference frame sign indicating number (Ref_frame) " for combination that should " reference frame image number " and " first reference picture ".Yet, close the frequent hypothesis of using of reference picture based on following the bit shift compensation time closely, those the less reference frame image in strong level and smooth other second reference picture of level number can be arranged at the higher position of reference frame code table.

In addition, according to the encoding condition of above-mentioned presumptive area (macro block) to be encoded, the reference frame code table can be determined by unique.Perhaps, according to aforementioned encoding condition, the reference frame sign indicating number can dynamically be changed.Here, for aforementioned encoding condition, predictive mode (for example, surveying motion vector unit's kind), quantization step (QP value) etc. can contemplate.Here, for the unit kind of surveying motion vector, for example, the size of the sub-piece of detection motion vector etc. can contemplate.

As a specific example, the situation that dynamically changes the reference frame sign indicating number according to quantization step is described below.Here, when using the low bit speed rate coding, strong level and smooth other second reference picture of level can frequently be used.Therefore, " the reference frame sign indicating number " that, comprises " second reference picture " if quantization step is equal to or less than predetermined threshold is arranged at the lower position of reference frame code table.If quantization step surpasses predetermined threshold, " the reference frame sign indicating number " that comprise " second reference picture " is arranged at the higher position of reference frame code table.

As mentioned above, " the reference frame code table " of the definition that shows among Figure 15 " reference frame sign indicating number " only is an example, and reference frame sign indicating number wherein is the combination of " reference frame image number " and " reference picture generation method identification information ".According to this embodiment, for being implemented in the needs that switch between " reference frame image number " and " reference picture generation method identification information ", it is possible using the given reference frame code table of carrying out according to this embodiment.

In addition, according to this embodiment, the level and smooth rank of reference picture can be automatically switched to according to the encoding condition of presumptive area to be encoded (macro block) is unique to be determined, and other explicit signaling notice of the level and smooth level of employed reference picture in the bit shift compensation of replacement use reference frame sign indicating number (Ref_frame).

That is to say that according to the encoding condition (unit of detection motion vector, quantization step etc.) of presumptive area to be encoded (macro block), reference picture generates parts 45 can generate predetermined level and smooth other reference picture 17 of level.

For example, in the zone of " macro block mode (MB_Type a: predictive mode) " coding compound displacement may take place, wherein, presumptive area to be encoded (macro block) is cut apart very meticulously, therefore, the reference picture that is used for bit shift compensation can not need high pixel value precision.

Further, in the macro block of big quantization step (a QP value), the employed reference picture of bit shift compensation can not need high pixel value precision.

Like this, for those macro blocks, wherein, number or the quantization step of surveying the unit (sub-piece) of motion vector surpass predetermined threshold, can always be to use strong level and smooth other second reference picture of level.

In this case, because the reference picture that generates according to encoding condition is well-determined, do not need to use the level and smooth rank identification information of reference frame image number.Like this, compare, do not increase by changing reference frame sign indicating number or the caused bit quantity of macro block mode sign indicating number with " H.26L coded system ".

(improving embodiment 2A)

The improvement embodiment 2A of previous embodiment 2 is described below.The difference of this improvement embodiment and embodiment 2 hereinafter, is only described.

According to previous embodiment 2, form the reference picture (first and second reference pictures) 17 of two kinds of variety classes generation methods (level and smooth rank).As a result, " reference picture generation method identification information (the indicating level and smooth class information) " of formation and " reference frame image number (identification information of the reference frame image) " generation that is combined " reference frame image sign indicating number (reference frame image information) ".Like this, carry out bit shift compensation by the different reference picture of level and smooth rank that uses each presumptive area to be encoded (macro block).

Yet only for the macroblock unit of assigned references two field picture unit, other switching of level and smooth level is possible.

Like this, improve among the embodiment at this, moving picture coding apparatus 20 and moving picture decoding apparatus 50 are described below, it can send the combination of " reference frame sign indicating number " and " sub-module unit (surveying motion vector unit for) "." reference frame sign indicating number " generates by combined reference two field picture number and reference picture generation method identification information.Sub-piece is a part of carrying out the macro block of bit shift compensation.

In fact the mobile image coding and

decoding equipment

20 and 50 with previous embodiment 2 is identical with 50 basic operation according to this mobile image coding and decoding equipment 20 that improves embodiment.

Improve embodiment according to this, displacement compensator 33 is switched the reference picture (first reference picture or second reference picture) 17 of the bit shift compensation value that is used to calculate to survey motion vector unit's (macroblock unit).

Variable Length Code parts 40 are surveyed motion vector unit's (sub-module unit) with one, send the combination of " reference image information (Ref_frame) " and " indication displacement offset information (prediction residual signal digital coding grammer) ".

In addition, variable-length decoding parts 71 are decoded to " reference image information (reference frame sign indicating number) " and " information of indication bit shift compensation (prediction residual signal digital coding grammer) " to survey motion vector unit's (sub-module unit).

Further, displacement compensator 72 is switched the reference picture 17 that is used for the displacement calculating offset to survey motion vector unit's (sub-module unit).

Here, as a example, suppose that it is similar to the reference frame sign indicating number among the embodiment 2 based on " reference frame sign indicating number (Ref_frame) " of the combination of " reference frame image number " and " reference picture generation method identification information ".

Figure 17 has shown according to this coding grammer based on macroblock unit according to embodiment.

Improve embodiment according to this, in macro block, need several times to send " reference frame sign indicating number (Ref_frame) " by combination " reference frame image number " and " reference picture generation method identification information " generation with sub-module unit.

" reference frame sign indicating number (Ref_frames) " number can be notified by " macro block (mb) type (MB_type) ", because type and sub-piece number send by " macro block (mb) type (MB_type) ".

For example, if macro block (mb) type is " INTER predictive mode (mode 7) ", " reference frame sign indicating number (Ref_frames) " number of transmission is " 16 ".

Improving embodiment according to this, is to survey in the macro block in " sub-piece " unit of motion vector unit at it, may carry out bit shift compensation by using other reference picture 17 of different level and smooth levels.

In addition, it is possible using the different reference frame image of each sub-piece number 5 execution bit shift compensations.In addition, the shape of response frame picture signal 2 and displacement can be carried out higher free other bit shift compensation of level.

Further, improve embodiment according to this, the level and smooth rank of reference picture can automatically switch to according to the encoding condition of the presumptive area (macro block or sub-piece) of surveying motion vector is unique to be determined, replaces using reference frame sign indicating number (Ref_frame) to carry out other explicit signaling notice of level and smooth level of the reference picture of bit shift compensation.

(improving embodiment 2B)

The improvement embodiment 2B of embodiment 2 is described below.Do not use " special position " similar according to the operation of the moving picture coding apparatus 20 described among the operation of the moving picture coding apparatus 20 of the embodiment of the invention and moving picture decoding apparatus 50 and " TML-8 " and moving picture decoding apparatus 50 except using different reference pictures to carry out bit shift compensations.Therefore, omit detailed description, and focus on the place that description is different.

According to previous embodiment 2, form the reference picture (first and second reference pictures) of two kinds of variety classes generation methods (level and smooth rank).As a result, " the reference picture generation method identification information " of formation and " reference frame image number " generation that is combined " reference frame sign indicating number ".Like this, can carry out bit shift compensation, wherein, (for example, macro block: the level and smooth rank unit of assigned references two field picture number) is different to each presumptive area to be encoded.

According to embodiment, form the level and smooth level of two kinds of differences other reference picture (first and second reference pictures) according to this, and, " the reference picture generation method identification information " of formation and " macro block mode " generation " macro block mode sign indicating number " that is combined.Like this, can carry out bit shift compensation, wherein, the level and smooth rank of each presumptive area to be encoded (macro block) is different.

According to this basic operation that improves the moving picture coding apparatus 20 of embodiment and moving picture decoding apparatus 50 in fact with identical according to the operation of the moving picture coding apparatus 20 of previous embodiment 2 and moving picture decoding apparatus 50.

Improve embodiment according to this, " reference image information (macro block mode sign indicating number) " is the combination of " indication survey unit of motion vector unit identification information (macro block mode: MB_Type) " and " indicating level and smooth class information (first reference picture or second reference picture) ".

Variable Length Code parts 40 are unit with presumptive area to be encoded (macroblock unit), send the combination of " reference image information (macro block mode sign indicating number) ", " reference frame image mark information (reference frame image number: Ref_frame) " and " information of indication displacement offset (prediction residual signal digital coding grammer) ".

In addition, variable-length decoding parts 71 are unit with presumptive area to be encoded (macro block), and " reference image information (macro block mode sign indicating number: MB_Types) ", " reference frame image mark information (Ref_frame) " and " the prediction residual signal digital coding syntactic information of indication displacement offset " are decoded.

Further, displacement compensator 72 uses the reference picture 17 of " reference image information (MB_Type) " and " reference frame image mark information (Ref_frame) " appointment to replace reference frame image 5, thereby calculates the bit shift compensation value of presumptive area to be encoded (macro block).

Figure 14 has shown the H.26L coding grammer based on macroblock unit of coded system of basis.Improve embodiment according to this, with traditional " H.26L coded system is the coding grammer of unit with the macro block " not variation.Yet the line display that is combined into by " macro block mode " and " reference picture generation method identification information " is changed in the definition of " macro block mode (MB_Type) ".

Figure 18 has shown an example based on " macro block mode sign indicating number (MB_Type) " of " macro block mode " and " reference picture generation method identification information " combination.

As shown in figure 18, about with the tradition identical macro block mode of macro block mode H.26L, the execution of bit shift compensation is instructed from first reference picture.About the macro block mode that increases newly, the execution of bit shift compensation is from other the second reference picture instruction of strong level and smooth level.

Improving embodiment according to this, because macro block mode is assigned to a macroblock unit, is that unit is possible from other reference picture execution bit shift compensation of the level and smooth level of difference with the macro block.

Further, improve embodiment according to this, the level and smooth rank of reference picture can automatically switch to according to the encoding condition of zone to be encoded (macro block) is unique to be determined, replaces other explicit signaling notice of the level and smooth level of the reference picture that is used for bit shift compensation by using macro block mode sign indicating number (MB_Type).

(improving embodiment 2C)

The improvement embodiment 2C of previous embodiment 2 is described below.Improve embodiment according to this, second reference picture of previous embodiment 2 is through strong level and smooth, and, always in bit shift compensation, do not need with the motion vector of the first reference picture same precision.Like this, a kind of configuration that motion vector changes is described below when using second reference picture.The difference of this improvement embodiment and previous embodiment 2 hereinafter, is described.

Improve embodiment according to this, when using strong level and smooth other reference picture of level (second two field picture), displacement compensator 33 reduces the motion vector precision of displacement calculating offset (prediction image signal 6).Especially, in this case, displacement compensator 33 is used to reduce the level of motion vector and the precision of vertical component.

According to this according to embodiment, as under the situation of previous embodiment 2, after generating first reference picture, reference picture generates parts 45 and generates through strong level and smooth reference picture, as second reference picture, wherein, spatial resolution is reduced to 1/2 pixel precision or integer-pel precision.

As spatial resolution be in second reference picture of 1/2 pixel precision through the example of the strong level and smooth reference picture method of generationing, describe below by first reference picture being moved the descending method of sampling of (1,2,1)/4 filters.

In addition, as being the example of the strong level and smooth reference picture generation method of integer-pel precision, describe below by 1/2 pixel precision image of level and smooth mistake being moved the descending method of sampling of (1,2,1)/4 filters through spatial resolution.

Improve embodiment according to this,, suppose that it is similar to the reference frame sign indicating number in the previous embodiment 2 as a example based on " the reference frame sign indicating number " of the combination of " reference frame image number " and " reference picture generation method identification information ".

For example, when the strong level and smooth reference picture that is reduced to 1/2 pixel precision when a spatial resolution is generated as second reference picture, the motion vector of supposing first reference picture for (MVx, MVy), the displacement below in the motion vector of second reference picture, carrying out.

The location of pixels of first reference picture:

MVx, MVy (1/4 pixel unit)

The location of pixels of second reference picture:

MVx//2，MVy//2

Here, " // " expression is with accept or reject dividing exactly of operation on zero direction.

In addition, if spatial resolution is reduced to the strong level and smooth reference picture of integer-pel precision when generating as second reference picture, the motion vector of supposing first reference picture for (MVx, MVy), the displacement in the motion vector of second reference picture below the execution.

The location of pixels of first reference picture:

MVx, MVy (1/4 pixel unit)

The location of pixels of second reference picture:

MVx//4，MVy//4

Like this, (MVx MVy) has several values to second reference picture for same motion vector MV=.

For example, if when second reference picture is reduced to 1/2 pixel precision, same motion vector is represented in (3,3), (2,3), (3,2) and (2,2).

Therefore, in second reference picture, when when Variable Length Code parts 40 are carried out coding, the less motion vector (as (2,2)) of the encoding amount of generation can be used as typical value and sends.

Alternately, in second reference picture, poor information MVD between predictive displacement vector PMV and the motion vector can carry out motion vector calculating after replacing by using according to spatial resolution, and the poor value of information of motion vector to be sent can reduce.In other words, can reduce encoding amount.

In this case, if the poor information MVD between predictive displacement vector and this motion vector from second reference picture of big resolution when first reference picture calculates, replace and be reversed execution to increase the spatial resolution of the second reference picture motion vector.

By aforesaid change, if noise is superimposed upon on the reference frame image 5, code efficiency can obtain by second reference picture of reference low spatial resolution.

In addition, this improvement embodiment is characterised in that: in second reference picture of low spatial resolution, the spatial resolution of motion vector has reduced, and has avoided the redundancy of motion vector scramble time.

Further, according to this improved embodiment, the spatial resolution of reference picture can automatically switch to according to the encoding condition of zone to be encoded (macro block) is unique determines the explicit signaling notice of the spatial resolution of the reference picture that is used for bit shift compensation of replacement use reference frame sign indicating number (Ref_frame).

For example, compound displacement may take place in the zone of encoding with " macro block mode (MB_Type: a kind of predictive mode) ", presumptive area wherein to be encoded (macro block) is cut apart meticulously, and therefore, the reference picture that is used for bit shift compensation can not need high pixel value precision.

In addition, in the macro block of big quantization step (QP value), the reference picture that is used for bit shift compensation can not need high pixel value precision.

Like this,, wherein survey the predetermined threshold that outnumbers of motion vector unit (sub-piece) or quantization step, can always be to use strong level and smooth second reference picture (as low spatial resolution) for macro block.

In this case, because the reference picture that generates is well-determined according to encoding condition, so just do not needed by using reference frame image number to discern level and smooth other information of level.Therefore, compare, do not have the increase of the bit quantity that the variation by reference frame sign indicating number or macro block mode sign indicating number causes with " H.26L coded system ".

Further, level and smooth rank and spatial resolution can automatically switch to according to aforementioned encoding condition (macro block mode, quantization step etc.) is unique and determine.

In this case, for macro block, the predetermined threshold that outnumbers of cutting apart number or quantization step of its neutron piece, by spatial resolution being reduced to 1/2 pixel precision or integer-pel precision, by always utilizing a reference picture, it uses filter to use strong level and smooth rank, and by reducing the level and the vertical component of motion vector, the encoding amount of the motion vector of generation has reduced.

(embodiment 3)

Moving picture coding apparatus 20 and moving picture decoding apparatus 50 according to embodiment 3 will be described below.Moving picture coding apparatus 20 and moving picture decoding apparatus 50 have been mentioned in the description of embodiment 2.Mobile image coding and decoding equipment is by the signaling of " reference image information (reference frame sign indicating number or macro block mode sign indicating number) ", it is the combination of " reference picture generation method identification information (first reference picture or second reference picture) " and " reference frame image number ", can make to use common reference picture (first reference picture) and strong level and smooth reference picture (second reference picture) to carry out bit shift compensation to each presumptive area to be encoded (macro block).

In the present embodiment, moving picture coding apparatus 20 and moving picture decoding apparatus 50 are described below, it forms a pyramid to the layer of each spatial resolution, so that generate the reference picture with three kinds of different pixels precision.

Figure 19 has shown the schematic diagram of the moving picture coding apparatus 20 of present embodiment, and Figure 20 has shown the schematic diagram of the moving picture decoding apparatus 50 of present embodiment.

Except in displacement exploring block 32,

displacement compensator

33 and 72, and Variable Length Code parts 40 are introduced outside some improvement, and generate the parts 46 and 81 except adding the layering reference picture, identical with moving picture coding apparatus 20 fully according to the basic operation of the moving picture coding apparatus 20 of present embodiment and moving picture decoding apparatus 50 with moving picture decoding apparatus 50 according to conventional art.

According to present embodiment, the layering reference picture generates parts 46 and 81 and forms reference picture generation parts, and it is used to generate some different reference pictures (layering reference picture 18) by reference frame image 15 is carried out some different image processing.Here, as aforementioned image processing, the processing of other processing of the level and smooth level of change, change spatial resolution etc. is conceivable.The description of this embodiment will be with reference to the processing of the change spatial resolution that is used as aforementioned image processing.

In addition, by carrying out the filtration treatment through some different pass-band filters, each layering reference picture generates parts 46 and 81 and generates the reference picture (a layering reference picture 18) with some spatial resolutions.Here, " instruction image processing information, for example, indication spatial resolution information (layer) " be a sign of this filter.

Further, displacement exploring block 32 is formed one 3 dimension motion vector and is generated parts, be associated with " indication reference picture (layering reference picture 18) spatial resolution information (layer) " by " motion vector (MVx; MVy) " that will use that reference picture (layering reference picture 18) detects, be used to generate one " 3 dimension motion vectors (layer; MVx, MVy) ".

Displacement exploring block 32 can be used to reduce the precision of 3 dimension motion vectors of the reference picture of low spatial resolution (as layer 3 etc.).

In addition, displacement compensator 33 (72) replaces reference frame image 5 by using reference picture (layering reference picture 18), is presumptive area (macro block) the displacement calculating offset of (decoding) to be encoded.

Further, displacement compensator 33 is formed one 3 dimension motion vector prediction parts, by using the correlation (as contextual switching in the encryption algorithm) between the presumptive area (macro block of encoding) of encode in the two field picture and the presumptive area (macro block to be encoded) to be encoded, be used to predict that 3 tie up motion vectors.

Variable Length Code parts 40 are formed a transmit block, are used for sending the combination of " 3 dimension motion vector " and " information of indication displacement offset ".

Incidentally, Variable Length Code parts 40 can send a poor information (layer D, MVDx, MVDy) and the combination of indication displacement offset information, wherein, this difference information be the 3 dimension motion vectors that generate of displacement exploring block 32 (layer, MVx, MVy) and 3 dimension motion vector (P layer, PMVx, PMVy) the poor information between of displacement compensator 33 prediction.

In addition, variable-length decoding parts 71 are formed decoding parts, are used for 3 dimension motion vectors of presumptive area to be decoded are decoded.

At first, with reference to Figure 21 and 22 notion that this embodiment uses is described.

Each layering reference picture generates parts 46 and 81 by each

displacement compensator

33 and 72, for the reference frame image 5 that is used for bit shift compensation generates 3 layers.

At first, shown in Figure 21 and 22, each layering reference picture generate parts 46 and 81 with reference frame image 5 through 8 grades of filter upstream samplings, thereby generate one 1/4 pixel precision layer 1, it is a layering reference picture 18.The example of 8 grades of filters used herein is as follows:

For 1/4 location of pixels: (3,12 ,-37,229,71 ,-21,6 ,-1)/256

For 2/4 location of pixels: (3,12 ,-39,158,158 ,-39,12 ,-3)/256

For 3/4 location of pixels: (1,6 ,-21,71,229 ,-37,12 ,-3)/256

Here, for the pixel value of integer pixel positions, the pixel value of the same position of reference frame image 5 is copied.The filtration coefficient of the pixel value of 1/4 location of pixels between the integer pixel positions, 2/4 location of pixels and 3/4 location of pixels by the pixel value of aforementioned integer pixel positions multiplies each other and addition obtains.This filtration treatment is carried out separately in level and vertical direction.

Describe filtration treatment in the upstream sampling operation of 1/8 pixel precision of tradition " TML-8 ", therefore, omitted detailed description here.

The second, each layering reference picture generate 1/4 pixel precision that parts 46 and 81 will generate layer 1 through the descending sampling of 3 grades of filters (lower passband type filter), thereby generate one 1/2 pixel precision layer 2, it is a layering reference picture 18.The example of 3 grades of filters used herein is " (1,2,1)/4 ".

The 3rd, each layering reference picture generates the layer 2 of 1/2 pixel precision that parts 46 and 81 will generate through the descending sampling of 3 grades of filters (lower passband type filter), thereby generates layers 3 of an integer-pel precision, and it is a layering reference picture 18.3 grades of filters used herein with use previously identical.

Note, according to the situation of conventional art, layer 1 has 1/4 pixel precision, but the pixel value of 1/4 location of pixels is not by linear interpolation, but aforementioned filtration treatment calculates by carrying out, thereby safeguarded the spatial resolution of initial pictures (reference frame image 5).

As mentioned above, each layering reference picture generates parts 46 and 81 the filtration treatment of filter by having some different passbands, generates the reference picture (layer 1 to 3) with some spatial resolutions.

According to this embodiment, displacement compensator 33 is carried out bit shift compensation by using the layering reference picture 18 that generates with aforementioned manner.

In this incident, motion vector 3 is not (MVx, 2 groups MVy) (2 dimension motion vector), but (layer, MVx, 3 groups (3 motion vector) MVy).

Displacement exploring block 32 detections 3 dimension motion vectors (layer, MVx, MVy), replacement 2 dimension motion vectors (MVx, MVy).

Layer 2 has layer 1 half spatial resolution, and layer 3 has half spatial resolution of layer 2.Therefore, carry out following displacement.

The resolution of layer 1: MVx, MVy (1/4 pixel unit),

The resolution of layer 2: MVx//2, MVy//2,

The resolution of layer 3: MVx//4, MVy//4

Wherein, " // " expression is with accept or reject dividing exactly of operation on zero direction.

Like this, for the same displacement vector, the

layer

2 and 3 have some values (MVx, MVy).

For example, in

layer

2 and 3, same motion vector is represented in (2,3,3), (2,2,3), (2,2,3) and (2,2,2).

Therefore, in the layer (layer 2 or layer 3), when when Variable Length Code parts 40 are carried out coding, the less motion vector (as (2,2,2)) of encoding amount can be used as typical value and sends in the above.

Alternately, in layer 2 and layer 3, poor information MVD between predictive displacement vector PMV and a motion vector can be by using the motion vector calculating after replacing according to every layer of resolution, and the poor information MVD value of motion vector to be sent can reduce.In other words, can reduce encoding amount.

In this case, when the poor information MVD between the predictive displacement vector PMV at the motion vector of this motion vector and layer 1 large space resolution calculates from such layer, replace and be reversed execution to increase the spatial resolution of every layer motion vector.

By using aforesaid notion, as shown in figure 23, by identical method complete and previous embodiment 1, the predictive displacement vector calculation component 33c prediction of displacement compensator 22 expands to 3 dimension motion vectors of some spatial resolutions.

In Figure 23, " PMV _XE" the predictive displacement vector PMV of expression estimation range (macro block) E to be encoded _EHorizontal component, " PMV _YE" the predictive displacement vector PMV of expression estimation range (macro block) E to be encoded _EVertical component.

" P layer _E" the prediction spatial resolution of expression estimation range (macro block) E to be encoded.

Each " MVDX _E" and " MVDY _E" the poor information of motion vector of 1/4 pixel precision of expression estimation range (macro block) E to be encoded." layer _D" the prediction spatial discrimination rate variance information of expression estimation range (macro block) E to be encoded.

Like this, to (layer D, MVD _X, PMV _Y) 3 groups carry out encoding process.

Incidentally, displacement compensator 33 can be by using 3 dimension motion vectors of the presumptive area (macro block) of encoding in the frame image signal 2, predict 3 dimension motion vectors of presumptive area (macro block) to be encoded, calculate the poor information of 3 dimension motion vectors of prediction 3 dimension motion vectors and 32 detections of motion vector exploring block, and by using the 3 dimension motion vector difference information and executing bit shift compensations that calculated.

Here, if general forecast layer D is in null set, when being uneven from a layer 1 or layer 3 conversion of seeing.

Like this,, can use and realize " adaptive coding algorithm " in the conventional art, and can carry out has increased further expanding of 3 states of P layer context model according to this embodiment, thus the correlation of use and adjacent domain macro block.

As mentioned above, for this layer, it is possible carrying out the coding that uses with adjacent domain macro block correlation.

In aforementioned description, carried out the predicted difference coding that uses P layer and layer D.Yet the execution of predicted difference coding is identical with the execution of context model.

Therefore, the correlation by direct use and adjacent domain macro block or use median such as P layer (using context to switch) as context model, be not layer D but this layer self can use encryption algorithm to be encoded.

Incidentally, because the notion and the details of aforesaid " adaptive algorithm " are described as " based on adaptive binary encryption algorithm context ", omit detailed description herein.

Similar

previous embodiment

1 and 2 and improve embodiment, the present invention is with reference to new bit shift compensation, wherein, " 2 dimension motion vector " is expanded to comprising " the 3 dimension motion vector " of " information (layer) that indicating image is handled (spatial resolution) ", replaces " the 2 dimension motion vector " and " information (information of indication spatial resolution) that indicating image is handled " that send.

By reference Figure 24, the bit shift compensation operation in the moving picture coding apparatus 20 of the embodiment of the invention is described below.

In step 1201, the layering reference picture generates parts 46 by using the reference frame image of extracting from frame memory 34 5, generates a layering reference picture 18.

In step 1202, displacement exploring block 32 is surveyed 3 dimension motion vectors of presumptive area (macro block) to be encoded by with reference to the layering reference picture 18 that generates parts 46 from the layering reference picture.

In step 1203, displacement compensator 33 is based on generating the layering reference picture 18 of parts 46, generation forecast picture signal 6 from 3 dimension motion vectors of displacement exploring block 32 with from the layering reference picture.

According to this embodiment,,, obtain code efficiency by the tomographic image of reference adaptive low spatial resolution if noise is superimposed upon reference frame image 5.

In addition, the tomographic image of low spatial resolution (as layer 2 or 3) is characterised in that the spatial resolution of 3 dimension motion vectors has reduced, and, avoided the redundancy in the 3 dimension motion vector codings.

Further, according to this embodiment, 3 dimension motion vectors have been used.Vector distribution at 3 dimension motion vector parameter spaces spatially is continuous, and can improve code efficiency.

According to the prediction image signal of this embodiment and the generation method of bit shift compensation value, only be an example.Use and realize that the needed optional generation method of displacement compensation value calculation method is possible among this embodiment of switching.

(according to the operation/effect of the mobile image coding and decoding equipment of embodiment 3)

According to moving picture coding apparatus of the present invention, because displacement exploring block 32 generates 3 dimension motion vectors according to layering reference picture 17, the bit shift compensation of carrying out each presumptive area different pixels precision to be encoded is possible.

(improving embodiment 3A)

The improvement embodiment 3A of previous embodiment 3 is described below.Hereinafter with reference Figure 25 describes the difference of this improvement embodiment and embodiment 3.

At first, the difference of this improvement embodiment and previous embodiment 3 is: be to carry out bit shift compensation with 1/4 pixel precision rather than 1/2 pixel precision.

That is to say, improve embodiment according to this, each layering reference picture generates the 6 grade filters (1 of parts 46 and 81 by using in the tradition " TML-8 ",-5,20,20,-5,1)/32 is applied to reference frame image 5 and carries out upstream sampling, thereby generate the layer 1 of 1/2 pixel precision.

The second, the difference of this improvement embodiment and previous embodiment 3 is: each layering reference picture generates parts 46 and 81 smoothing filter " (1,2,1)/4 " is applied to layer 1 respectively horizontally and vertically, thereby generates layer 2.

The 3rd, the difference of this improvement embodiment and previous embodiment 3 is: the number of plies is 2, and (layer 1 and layer 2) and both have the same space resolution.

Like this, realize following situation:

The location of pixels of layer 1: MVx, MVy (1/2 pixel unit),

The location of pixels of layer 2: MVx, MVy (1/2 pixel unit)

By increasing aforesaid variation, and carry out " median prediction " based on the method identical with conventional art, (layer D, MVDx MVDy) encodes to 3 dimension motion vectors." adaptive coding algorithm " is with the difference of previous embodiment 3: the P layer _EContext experienced two states.

By aforementioned variation, when carrying out 1/2 pixel precision bit shift compensation, if noise is superimposed upon reference frame image 5, it is possible carrying out the bit shift compensation that switches to the self adaptation low resolution.

Especially, in low rate coding, suppose that 1/4 pixel precision is unwanted, have the tendency of image of the level and smooth mistake of a kind of use 1/4 pixel precision bit shift compensation.Therefore,, the explicit system that switches to the low spatial resolution of figure is described to this improved embodiment here.

Incidentally, improve embodiment according to this, the filter " (1,2,1)/4 " that is used to generate layer 2 image is the filter of a simple low-pass type.Yet, can use the clip-on type smoothing filter in edge.

For example, be useful on " intermediate filter " of the median in the zone that obtains 3 * 3 pixels in the smoothing filter of edge gripping type, also can use " the dynamic weighting filter " described in the United States Patent (USP) 6041145 " equipment of the equipment of the equipment of smoothed image signal and method, coded image and method and decoded picture and method " by name.

Aforementioned " dynamic weighting filter " is by calculating the poor absolute value between level and smooth center pixel value and its approximate pixel value, by will with the difference absolute value mutually the inversely proportional filtration coefficient be provided to surrounding pixel value (contiguous 8) and carry out adaptive smooth.

Incidentally, be used for making computer 100 can be stored in the computer-readable recording medium as the program of moving picture coding apparatus 20 of the present invention or moving picture decoding apparatus 50.

As the computer-readable recording medium, show as Figure 26, for example, can list diskette 1 01, compact disk 102, IC chip 103, cassette tape 104 etc.According to this computer-readable recording medium of having stored program, aforementioned program can be preserved at an easy rate, transmitted, sale etc.

Commercial Application

As mentioned above, according to the present invention, can enough light weight expenses represent the picture signal of a prediction, and the bit shift compensation of different pixels precision is provided.

Claims

1. moving picture coding apparatus, it will be encoded by the mobile image that the two field picture sequential constitutes by bit shift compensation, it is characterized in that this equipment comprises:

A reference picture generates parts, is used for handling by a reference frame image being carried out some different images, generates some different reference pictures;

A displacement compensator is by using the reference picture that generates, for presumptive area to be encoded is calculated a bit shift compensation value; And

A transmit block is used to send a combination of calculating the information of employed reference image information of described bit shift compensation value and the described bit shift compensation value of indication;

Wherein, described reference image information is the identification information of a reference frame image and the combination of indicating the information of described image processing.

2. according to the moving picture coding apparatus of claim 1, wherein,

Displacement compensator is used for switching the employed described reference picture of displacement calculating offset to survey motion vector unit, and

Described transmit block is used for to survey the combination that motion vector unit sends the information of described reference image information and the described bit shift compensation value of indication.

3. moving picture coding apparatus, it will be encoded by the mobile image that the two field picture sequential constitutes by bit shift compensation, it is characterized in that this equipment comprises:

Wherein, described reference image information is a combination of indicating the identification information of the unit that surveys motion vector and indicating the information of described image processing, and,

Described transmit block is used for sending the identification information of described reference image information, a described reference frame image and indicating the combination of the information of described bit shift compensation value with presumptive area unit to be encoded.

4. according to the moving picture coding apparatus of claim 1, wherein, described reference image information dynamically changes the identification information of a described reference frame image and the combination of the information of the described image processing of indication according to the encoding condition of presumptive area to be encoded.

5. according to the moving picture coding apparatus of claim 2, wherein, described reference image information dynamically changes the identification information of a described reference frame image and the combination of the information of the described image processing of indication according to the encoding condition of presumptive area to be encoded.

6. according to the moving picture coding apparatus of claim 3, wherein, described reference image information is surveyed the identification information of described motion vector unit and is indicated the action attitude that is combined into of the information of described image processing to change indication according to the encoding condition of presumptive area to be encoded.

7. according to any 1 moving picture coding apparatus among the claim 1-6, wherein,

Described reference picture generates the filtration treatment of the filter of parts by use being had some different passbands and carries out as described image processing, is used to generate described some different reference pictures, and

Indicate the information of described image processing, identify described filter.

8. according to any 1 moving picture coding apparatus among the claim 1-6,

Described reference picture generates parts and carries out as described image processing by the processing that will change spatial resolution, be used to generate described some different reference pictures, when using the described reference picture of low spatial resolution, described displacement compensator is used to reduce the employed motion vector precision of displacement calculating offset

Indicate the information of described image processing, identify described spatial resolution.

9. moving picture decoding apparatus, it will be decoded by the mobile image that the two field picture sequential constitutes by bit shift compensation, it is characterized in that this equipment comprises:

A reference picture generates parts, is used for generating some different reference pictures by a reference frame image is carried out some different image processing;

Decoding parts are used for decoding to calculating the employed reference image information of bit shift compensation value at moving picture coding apparatus; And

A displacement compensator by using the described reference picture of the described reference image information appointment that generates, is used to calculate the bit shift compensation value of presumptive area to be decoded,

Wherein, described reference image information is the identification information of a described reference frame image and the combination of indicating the information of described image processing.

10. according to the moving picture decoding apparatus of claim 9, wherein,

The decoding parts are used for coming the information of described reference image information and the described bit shift compensation value of indication is decoded to survey motion vector unit, and

Described displacement compensator is used for switching the employed described reference picture of displacement calculating offset to survey motion vector unit.

11. a moving picture decoding apparatus, it will be decoded by the mobile image that the two field picture sequential constitutes by bit shift compensation, it is characterized in that this equipment comprises:

Wherein, described reference image information is that the identification information of motion vector unit and the combination of the information of the described image processing of indication are surveyed in an indication.

12. according to the moving picture decoding apparatus of claim 9, wherein, described reference image information according to the decode condition of presumptive area to be decoded, dynamically changes the identification information of a described reference frame image and the combination of the information of the described image processing of indication.

13. according to the moving picture decoding apparatus of claim 10, wherein, described reference image information according to the decode condition of presumptive area to be decoded, dynamically changes the identification information of a described reference frame image and the combination of the information of the described image processing of indication.

14. moving picture decoding apparatus according to claim 11, wherein, described reference image information is according to the decode condition of presumptive area to be decoded, to the attitude change of taking action that is combined into of identification information of indicating the unit that surveys described motion vector and the information of indicating described image processing.

15. according to any 1 moving picture decoding apparatus among the claim 9-14, wherein,

16. according to any 1 moving picture decoding apparatus among the claim 9-14,

Described reference picture generates parts and carries out as described image processing by the processing that will change spatial resolution, is used to generate described some different reference pictures,

When using the described reference picture of low spatial resolution, described displacement compensator is used to reduce the employed motion vector precision of displacement calculating offset,

17. a mobile method for encoding images, it will be encoded by the mobile image that the two field picture sequential constitutes by bit shift compensation, it is characterized in that this method comprises:

A steps A by a reference frame image is carried out some different image processing, generates some different reference pictures;

A step B by using the reference picture that generates, calculates the bit shift compensation value of presumptive area to be encoded; And

A step C is used to send the combination of the information of calculating employed reference image information of described bit shift compensation value and the described bit shift compensation value of indication,

Wherein, described reference image information is the identification information of reference frame image and the combination of indicating the information of described image processing.

18. according to the mobile method for encoding images of claim 17, wherein,

In step B, the employed described reference picture of displacement calculating offset is switched to survey motion vector unit, and

In step C, the combination of the information of described reference image information and the described bit shift compensation value of indication is sent out to survey motion vector unit.

19. a mobile method for encoding images, it will be encoded by the mobile image that the two field picture sequential constitutes by bit shift compensation, it is characterized in that this method comprises:

Wherein, described reference image information is the identification information and the combination of indicating described image processing data of the unit of an indication detection motion vector, and,

In step C, the identification information of described reference image information, a described reference frame image and indicate the combination of described bit shift compensation value information to be sent out with presumptive area unit to be encoded.

20. according to the mobile method for encoding images of claim 17, wherein, described reference image information dynamically changes the identification information of a described reference frame image and the combination of the information of the described image processing of indication according to the encoding condition of presumptive area to be encoded.

21. according to the mobile method for encoding images of claim 18, wherein, described reference image information dynamically changes the identification information of a described reference frame image and the combination of the information of the described image processing of indication according to the encoding condition of presumptive area to be encoded.

22. mobile method for encoding images according to claim 19, wherein, described reference image information is surveyed the identification information of described motion vector unit and is indicated the action attitude that is combined into of described image processing data to change indication according to the encoding condition of presumptive area to be encoded.

23. according to any 1 the mobile method for encoding images among the claim 17-22, wherein,

In steps A, by execution the filtration treatment that use has the filter of some different passbands is carried out as described image processing, generate described some different reference pictures, and

24. according to any 1 the mobile method for encoding images among the claim 17-22, wherein,

In steps A, carry out as described image processing by the processing that will change spatial resolution, generate described some different reference pictures,

In step B, when using the described reference picture of low spatial resolution, reduce the employed motion vector precision of displacement calculating offset,

25. a moving picture decoding method, it will be decoded by the mobile image that the two field picture sequential constitutes by bit shift compensation, it is characterized in that this method comprises:

A steps A by a reference frame image is carried out some different image processing, is used to generate some different reference pictures;

A step B is used for decoding to calculating the employed reference image information of bit shift compensation value at moving picture coding apparatus; With

A step C by using the reference picture of the described reference image information appointment that generates, calculates the bit shift compensation value of presumptive area to be decoded,

26. according to the moving picture decoding method of claim 25, wherein,

In step B, the information of reference image information and the described bit shift compensation value of indication is decoded to survey motion vector unit, and

In step C, the employed described reference picture of displacement calculating offset is switched to survey motion vector unit.

27. a moving picture decoding method, it will be decoded by the mobile image that the two field picture sequential constitutes by bit shift compensation, it is characterized in that this method comprises:

28. according to the moving picture decoding method of claim 25, described reference image information according to the decode condition of presumptive area to be decoded, dynamically changes the identification information of a described reference frame image and the combination of the information of the described image processing of indication.

29. according to the moving picture decoding method of claim 26, described reference image information according to the decode condition of presumptive area to be decoded, dynamically changes the identification information of a described reference frame image and the combination of the information of the described image processing of indication.

30. moving picture decoding method according to claim 27, wherein, described reference image information according to the decode condition of presumptive area to be decoded, is surveyed the identification information of described motion vector unit and is indicated the action attitude that is combined into of described image processing data to change indication.

31. according to any 1 the moving picture decoding method among the claim 25-30, wherein,

In steps A, the filtration treatment of the filter by use being had some different passbands is carried out as described image processing, generates described some different reference pictures, and

32. according to any 1 the moving picture decoding method among the claim 25-30,

In steps A, carry out as described image processing by the processing that will change spatial resolution, be used to generate described some different reference pictures,

In step C, when using the described reference picture of low spatial resolution, reduced the employed motion vector precision of displacement calculating offset.

33. a moving picture coding apparatus, it will be encoded by the mobile image that the two field picture sequential constitutes by bit shift compensation, it is characterized in that this equipment comprises:

A reference picture generates parts, handles by a reference frame image being carried out some different images, is used to generate some different reference pictures;

One 3 dimension motion vector generates parts, is associated with the information of indication to the image processing of reference frame image execution by the motion vector that will use reference picture to detect, and is used to generate one 3 dimension motion vector;

A transmit block, the combination that is used to send one 3 dimension motion vector and indicates the information of displacement offset.

34. according to the moving picture coding apparatus of claim 33, wherein,

Described reference picture generates parts by carrying out the filtration treatment of using the filter with some different passbands, is used to generate described some different reference pictures, and

Described 3 dimension motion vectors identify described filter.

35. a moving picture coding apparatus, it will be encoded by the mobile image that the two field picture sequential constitutes by bit shift compensation, it is characterized in that this equipment comprises:

A displacement compensator is by using the reference picture that generates, for presumptive area to be encoded is calculated a bit shift compensation value;

One 3 dimension motion vector prediction parts by using the presumptive area of encode in the two field picture and the correlation between the presumptive area to be encoded, are used to predict that 3 tie up motion vectors; And

A transmit block is used to send the combination of difference information between the described 3 dimension motion vectors that one 3 dimension motion vector generates 3 dimension motion vectors that parts generate and described 3 dimension motion vectors prediction parts predictions and indication displacement offset information.

36. according to the moving picture coding apparatus of claim 35, wherein, described 3 dimension motion vector prediction parts are used to predict described 3 dimension motion vectors by switching the encryption algorithm context.

37. according to the moving picture coding apparatus of claim 33, wherein,

Image processing is the processing that changes spatial resolution, and

Described 3 dimension motion vectors generate parts and are used to reduce the precision that described 3 of low spatial resolution reference picture is tieed up motion vectors.

38. a moving picture decoding apparatus is used for by bit shift compensation, will be decoded by the mobile image that the two field picture sequential is formed, and it is characterized in that this equipment comprises:

Decoding parts are used for 3 dimension motion vectors of presumptive area to be decoded are decoded; And

A displacement compensator is by using the described reference picture by described 3 dimension motion vector appointments that generates, for presumptive area to be decoded is calculated a bit shift compensation value.

39. according to the moving picture decoding apparatus of claim 38, wherein,

Described 3 dimension motion vectors identify described filter.

40. a moving picture decoding apparatus is used for by bit shift compensation, will be decoded by the mobile image that the two field picture sequential is formed, and it is characterized in that this equipment comprises:

Decoding parts are used for 3 dimension motion vectors of presumptive area to be decoded are decoded;

One 3 dimension motion vector prediction parts by using the presumptive area of decode in the two field picture and the correlation between the presumptive area to be decoded, are used to predict that 3 tie up motion vectors; And

A displacement compensator is tieed up the described 3 poor information of tieing up between the motion vectors that motion vector prediction parts are predicted by the 3 dimension motion vectors and described 3 that use the parts of decoding to decode, and calculates the bit shift compensation value of presumptive area to be decoded.

41. according to the moving picture decoding apparatus of claim 40, wherein, described 3 dimension motion vector prediction parts are predicted described 3 dimension motion vectors by switching the context of encryption algorithm.

42. a mobile method for encoding images, it will be encoded by the mobile image that the two field picture sequential constitutes by bit shift compensation, and this method comprises:

A step B is associated by the information that will use reference picture motion vector that detects and the image processing that is designated as the reference frame image execution, is used to generate one 3 dimension motion vector;

A step C by using the described reference picture that generates, calculates the bit shift compensation value of presumptive area to be encoded; And

A step D, the combination that is used to send one 3 dimension motion vector and indicates the information of displacement offset.

43. according to the mobile method for encoding images of claim 42, wherein,

In steps A, by carrying out the filtration treatment of using filter, generate described some different reference pictures with some different passbands, and

Described 3 dimension motion vectors identify described filter.

44. a mobile method for encoding images, it will be encoded by the mobile image that the two field picture sequential constitutes by bit shift compensation, and this method comprises:

A step C by using the described reference picture that generates, calculates the bit shift compensation value of presumptive area to be encoded;

A step e by using the presumptive area of encode in the two field picture and the correlation between the presumptive area to be encoded, is used to predict that 3 tie up motion vectors; And

Between the described 3 dimension motion vectors of predicting in 3 dimension motion vectors that generate among a step D, step B and the step e the combination of poor information and the information of indicating the displacement offset be sent out.

45., wherein, in step e, predict described 3 dimension motion vectors by switching the encryption algorithm context according to the mobile method for encoding images of claim 44.

46. according to the mobile method for encoding images of claim 42, wherein,

Image processing is the processing that changes spatial resolution, and

In step B,, reduce the precision of described 3 dimension motion vectors for the reference picture of low spatial resolution.

47. a moving picture decoding method is used for by bit shift compensation, will be decoded by the mobile image that the two field picture sequential is formed, this method comprises:

A steps A is used for handling by a reference frame image being carried out some different images, generates some different reference pictures;

A step B is used for 3 dimension motion vectors of presumptive area to be decoded are decoded; With

A step C is by using the described reference picture by described 3 dimension motion vector appointments that generates, for presumptive area to be decoded is calculated a bit shift compensation value.

48. according to the moving picture decoding method of claim 47, wherein,

In steps A, have the filtration treatment of some different pass-band filters by carrying out to use, generate some different reference pictures, and

Described 3 dimension motion vectors identify described filter.

49. a moving picture decoding method is used for by bit shift compensation, will be decoded by the mobile image that the two field picture sequential is formed, this method comprises:

A step B is used for 3 dimension motion vectors of presumptive area to be decoded are decoded;

A step D by using the presumptive area of decode in the two field picture and the correlation between the presumptive area to be decoded, is used to predict that 3 tie up motion vectors; And

A step C, by use between the described 3 dimension motion vectors of predicting among the 3 dimension motion vectors of decoding among the step B and the step D poor information, calculate the bit shift compensation value of presumptive area to be decoded.

50., wherein, in step D, predict described 3 dimension motion vectors by switching the encryption algorithm context according to the moving picture decoding method of claim 49.