CN101385349A - Inter-Layer Prediction Method for Video Signal - Google Patents

Abstract

The present invention relates to a method for using interlaced video signal of a base layer in interlayer texture prediction. The present method separates interaced video signal of a base layer into even- field and odd- field components, interpolates the even- field and the odd- field components respectively in vertical and/or horizontal direction, and constructs a combined video data by interleaving the interpolated even-field and odd-field components.

Description

Inter-Layer Prediction Method for Video Signal

1. Technical field

The present invention relates to methods for inter-layer prediction when encoding/decoding video signals.

2. Background technology

A scalable video codec (SVC) encodes video into a picture sequence with the highest image quality while ensuring that parts of the picture sequence are encoded (specifically, a partial frame sequence intermittently selected from the entire frame sequence) Can be decoded and used to represent the video with low image quality.

Although low image quality video can be represented by receiving and processing parts of a sequence of pictures encoded according to a scalable downscaling scheme, there remains a problem that image quality drops significantly if the bit rate is reduced. One solution to this problem is to provide a low bitrate auxiliary picture sequence, eg a picture sequence with a small screen size and/or a low frame rate, as at least one layer in the hierarchy.

When it is assumed that two sequences are provided, the auxiliary (lower) picture sequence is called the base layer, and the main (upper) picture sequence is called the enhancement or enhancement layer. The base layer and enhancement layer video signals are redundant because the same video source is coded into both layers. In order to improve the codec efficiency of the enhancement layer, the video signal of the enhancement layer is coded using the coded information (motion information or texture information) of the base layer.

While a single video source 1 can be encoded into multiple layers with different transfer rates as shown in Figure 1a, multiple video sources 2b in different scan modes containing the same content 2a can also be encoded into corresponding layers as shown in Figure 1b. layers. Also in this case, the encoder encoding the upper layer can increase the codec gain by performing inter-layer prediction with the encoded information of the lower layer, since both sources 2b provide the same content 2a.

Therefore, there is a need to provide an inter-layer prediction method that takes into account the scanning mode of the video signal when encoding different sources into respective layers. When encoding interlaced video, it can be encoded as even and odd fields, and also as odd and even pairs of macroblocks in a frame. Correspondingly, for inter-layer prediction, the picture type used for encoding and decoding interlaced video signals must also be considered.

In general, the enhancement layer provides a picture with a higher resolution than the base layer. Correspondingly, if the pictures of different layers have different resolutions when encoding different sources into corresponding layers, it is also necessary to perform interpolation to increase the picture resolution (ie, the picture size). Because for predictive coding and decoding, the closer the image of the base layer picture used in the inter-layer prediction is to the image of the enhancement layer picture, the higher the codec rate is, so it is necessary to provide a scanning mode that takes the video signals of the layers into consideration interpolation method.

3. Contents of the invention

It is an object of the present invention to provide a method for performing inter-layer prediction in the case where at least one of the two layers has an interlaced video signal component.

Another object of the present invention is to provide a method of performing inter-layer motion prediction for layers of pictures having different spatial resolutions (scalability) according to picture types.

Yet another object of the present invention is to provide a method of performing inter-layer texture prediction for layers of pictures with different spatial and/or temporal resolutions (scalability).

An inter-layer motion prediction method according to the present invention includes: setting motion-related information of an intra-mode macroblock as motion-related information of an inter-mode macroblock, the intra-mode and inter-mode macroblocks being two vertically adjacent macroblocks of a base layer block; then obtain the motion information of the vertically adjacent macroblock pair based on these two vertically adjacent macroblocks for inter-layer motion prediction.

Another inter-layer motion prediction method according to the present invention includes: setting an intra-mode macroblock as one of two vertically adjacent intra-mode and inter-mode macroblocks of the base layer as an inter-mode block with 0 motion-related information; and then Motion information for a vertically adjacent macroblock pair is obtained based on the two vertically adjacent macroblocks for inter-layer motion prediction.

Another method of inter-layer motion prediction according to the present invention includes: deriving motion information for a single macroblock from motion information for a pair of vertically adjacent frame macroblocks in a base layer; and using the derived motion information as a field macroblock in the current layer The motion information of the block or the prediction information of the respective motion information of the field macroblock pair in the current layer.

Another inter-layer motion prediction method according to the invention consists in deriving the respective motion of two macroblocks from the motion information of a single field macroblock of the base layer or of a single field macroblock selected from a pair of vertically adjacent field macroblocks of the base layer information; and using the derived respective motion information as prediction information for the respective motion information of the frame macroblocks of the current layer.

An interlayer motion prediction method for layers of pictures having different resolutions according to the present invention includes: converting lower layers into frames by selectively using a prediction method according to the type of the picture and the type of macroblocks in the picture to a frame of the same resolution; upsample the frame to have the same resolution as the upper layer; then apply the type and upper layer for the frame macroblocks in this upsampled frame Inter-layer prediction method for macroblock types in a picture.

Another inter-layer motion prediction method according to the present invention for layers of pictures with different resolutions includes: identifying the types of pictures of lower and upper layers and/or the types of macroblocks included in these pictures; Apply the method of predicting frame macroblock pairs from a single field macroblock to the lower layer picture to construct a virtual picture with the same aspect ratio as the upper layer picture; upsample the virtual picture; then use this upsampled virtual The picture applies inter-layer motion prediction to the upper layer.

Another inter-layer motion prediction method according to the present invention for layers of pictures with different resolutions includes: identifying the types of pictures of lower and upper layers and/or the types of macroblocks included in these pictures; The obtained result applies the method of predicting frame macroblock pairs from single field macroblocks to the lower layer picture to construct a virtual picture having the same aspect ratio as that of the upper layer picture; and applies the layer to the upper layer picture using the constructed virtual picture motion prediction.

Another inter-layer motion prediction method according to the present invention for layers of pictures with different resolutions includes: identifying the types of lower-layer and upper-layer pictures; if the type of the lower-layer picture is field and the type of the upper-layer picture is progressive, The motion information of the blocks in the lower layer picture is then copied to construct a virtual picture; the virtual picture is upsampled; and a frame macroblock-macroblock motion prediction method is applied between this upsampled virtual picture and the upper layer picture.

Another inter-layer motion prediction method according to the present invention for layers of pictures with different resolutions includes: identifying the types of lower-layer and upper-layer pictures; if the type of the lower-layer picture is field and the type of the upper-layer picture is progressive, The motion information of the blocks of the lower layer is then copied to construct a virtual picture; and the virtual picture is used to apply inter-layer motion prediction to the upper layer picture.

In an embodiment of the present invention, a division mode, a reference index, and a motion vector are sequentially predicted in inter-layer motion prediction.

In another embodiment of the present invention, the reference index, motion vector, and partition mode are predicted sequentially.

In another embodiment of the invention, the motion information of the field macroblock pairs of the virtual base layer to be used for inter-layer motion prediction is derived from the motion information of the frame macroblock pairs of the base layer.

In another embodiment of the invention, the motion information of the field macroblocks in the even or odd field picture of the virtual base layer to be used for inter-layer motion prediction is derived from the motion information of the frame macroblock pairs of the base layer.

In another embodiment of the present invention, macroblocks are selected from field macroblock pairs of the base layer, and the motion information of the frame macroblock pairs of the virtual base layer to be used for inter-layer motion prediction is selected from the motion information of the selected macroblocks derived.

In another embodiment of the invention, the motion information of frame macroblock pairs of a virtual base layer to be used for inter-layer motion prediction is derived from the motion information of field macroblocks in even or odd field pictures of the base layer.

In another embodiment of the present invention, the information of the field macroblocks in the even or odd field picture of the base layer is copied to additionally construct a virtual field macroblock, and the frame macroblock pairs of the virtual base layer to be used for inter-layer motion prediction The motion information of is derived from the motion information of field macroblock pairs constructed in this way.

An inter-layer texture prediction method according to the present invention includes: constructing field macroblock pairs from vertically adjacent frame macroblock pairs of the base layer; and using the texture information of the constructed field macroblock pairs as field macroblocks of the current layer For the respective texture prediction information.

Another inter-layer texture prediction method according to the present invention includes: constructing a single field macroblock from vertically adjacent frame macroblock pairs of the base layer; and using the texture information of the constructed single field macroblock as the field macroblock of the current layer texture prediction information.

Another inter-layer texture prediction method according to the present invention includes: constructing a frame macroblock pair from a single field macroblock or a vertically adjacent field macroblock pair of the base layer; and using the constructed frame macroblock pair's respective texture information as The frame macroblocks of the current layer have their respective texture prediction information.

Another inter-layer texture prediction method according to the present invention comprises constructing N pairs of frame macroblocks from pairs of vertically adjacent field macroblocks of the base layer, wherein N is an integer greater than 1; The texture information is used as the respective texture prediction information of N pairs of frame macroblocks located at different time positions in the current layer.

Another inter-layer texture prediction method according to the present invention includes: dividing each frame of the lower layer into multiple field pictures to allow the lower layer to have the same temporal resolution as the upper layer; upsampling each separated field picture in the vertical direction to expand each separated field picture in the vertical direction; and then use each up-sampled field picture for inter-layer texture prediction of each frame of the upper layer.

Another inter-layer texture prediction method according to the present invention includes: upsampling each field picture of the lower layer in the vertical direction to expand each field picture in the vertical direction; and using each up-sampled field picture for the upper layer Inter-layer texture prediction for each frame.

Another inter-layer texture prediction method according to the present invention includes: dividing each frame of the upper layer into a plurality of field pictures; down-sampling the pictures of the lower layer to shrink the pictures of the lower layer in the vertical direction; and then using the down-sampled pictures for Inter-layer texture prediction of the separated field picture of the upper layer.

A method of encoding a video signal using inter-layer prediction according to the present invention comprises: determining whether to use in inter-layer texture prediction by alternately selecting rows of 2N blocks in an arbitrary picture of a base layer and then arranging the selected rows in the selected order The texture information of each of the constructed 2N blocks, also using the texture information of each of the 2N blocks constructed by interpolating one block selected from the 2N blocks of the base layer; and incorporating information indicating this determination into the encoded information.

A method for decoding a video signal using inter-layer prediction according to the present invention includes: checking whether specific indication information is included in a received signal; and determining whether to use in inter-layer texture prediction by alternately Select the rows of 2N blocks in the arbitrary picture of the base layer and then arrange the texture information of each of the 2N blocks constructed by arranging the selected rows in the selected order, or use the 2N blocks constructed by interpolating a block selected from the 2N blocks of the base layer Respective texture information.

In an embodiment of the present invention, each frame of the upper or lower layer is divided into two field pictures.

In an embodiment of the invention, if the specific indication information is not included in the received signal, the situation is considered to be related to receiving a signal including the indication information which has been set to 0 and determining its respective texture information The same is true for blocks to be used for inter-layer prediction.

A method for using the video signal of the base layer for inter-layer texture prediction according to the present invention includes: dividing the interlaced video signal of the base layer into even and odd field components; respectively amplifying the even and odd field components in the vertical and/or horizontal direction; The upscaled sets of even and odd field components are then combined for inter-layer texture prediction.

Another method for using the video signal of the base layer for inter-layer texture prediction according to the present invention includes: dividing the progressive video signal of the base layer into an even row group and an odd row group; Upscaling; the upscaled even and odd row groups are combined and used for inter-layer texture prediction.

Another method of using the video signal of the base layer for inter-layer texture prediction according to the present invention includes: amplifying the interlaced video signal of the base layer in the vertical and/or horizontal direction to have the same resolution as the progressive video signal of the upper layer ; and performing inter-layer texture prediction of the video signal of the upper layer based on the upscaled video signal.

Another method of using the video signal of the base layer for inter-layer texture prediction according to the present invention includes: amplifying the progressive video signal of the base layer in the vertical and/or horizontal direction to have the same resolution as the interlaced video signal of the upper layer ; and performing inter-layer texture prediction of the video signal of the upper layer based on the upscaled video signal.

In one embodiment of the invention, video signal separation and amplification is performed at the macroblock level (or, ie, on a macroblock basis).

In another embodiment of the present invention, video signal separation and amplification is performed at the picture level.

In another embodiment of the present invention, video signal separation and enlarge.

In another embodiment of the present invention, video signal separation and upscaling are performed if the pictures of both layers to which inter-layer texture prediction is to be applied are interlaced.

4. Brief description of the drawings

Figures 1a and 1b illustrate a method of encoding a single video source into multiple layers;

Fig. 2 a and 2 b schematically show the configuration of the video signal coding apparatus applying the inter-layer prediction method according to the present invention;

Figures 2c and 2d illustrate the types of picture sequences used to encode interlaced video signals;

Figures 3a and 3b schematically illustrate a process in which base layer pictures are constructed for inter-layer texture prediction and deblocking filtering is performed, according to an embodiment of the present invention;

Figures 4a to 4f schematically illustrate how motion information of field macroblocks of a virtual base layer to be used for inter-layer motion prediction of field macroblocks of an MBAFF frame is derived using motion information of frame macroblocks according to an embodiment of the present invention process;

Fig. 4g schematically shows a procedure in which texture information of macroblock pairs is used for texture prediction of field macroblock pairs in an MBAFF frame according to an embodiment of the present invention;

Figure 4h shows a method for transforming a frame macroblock pair into a field macroblock pair according to an embodiment of the present invention;

Figures 5a and 5b illustrate a reference index and motion information derivation procedure according to another embodiment of the present invention;

6a to 6c schematically illustrate a procedure in which motion information of field macroblocks in a virtual base layer is derived using motion information of frame macroblocks according to an embodiment of the present invention;

Fig. 6d schematically shows a procedure in which texture information of a frame macroblock pair is used for texture prediction of a field macroblock in a field picture according to an embodiment of the present invention;

Figures 7a and 7b illustrate a reference index and motion information derivation procedure according to another embodiment of the present invention;

Figures 8a to 8c schematically illustrate a field macroblock frame macroblock of a virtual base layer to be used for inter-layer motion prediction in which motion information of field macroblocks in an MBAFF frame is derived using motion information of field macroblocks in an MBAFF frame according to an embodiment of the present invention program of;

Fig. 8d schematically shows a procedure in which texture information of a field macroblock pair in an MBAFF frame is used for texture prediction of a frame macroblock pair according to an embodiment of the present invention;

Figure 8e shows a method of transforming a field macroblock pair into a frame macroblock pair according to an embodiment of the present invention;

Figures 8f and 8g schematically illustrate the use of texture information of a field macroblock pair in an MBAFF frame for inter-layer prediction of a frame macroblock pair when only one macroblock in the field macroblock pair is inter-mode according to an embodiment of the present invention program of;

Figure 8h schematically shows a procedure in which texture information of field macroblock pairs in an MBAFF frame is used for texture prediction of multiple pairs of frame macroblocks according to an embodiment of the present invention;

Figures 9a and 9b illustrate a reference index and motion information derivation procedure according to another embodiment of the present invention;

Figures 10a to 10c schematically illustrate a procedure in which motion information of frame macroblocks of a virtual base layer to be used for inter-layer motion prediction is derived using motion information of field macroblocks in field pictures according to an embodiment of the present invention ;

Fig. 10d schematically shows a procedure in which texture information of field macroblocks in a field picture is used for texture prediction of frame macroblock pairs according to an embodiment of the present invention;

FIG. 11 shows a reference index and motion information derivation procedure according to another embodiment of the present invention;

Figures 12a and 12b schematically illustrate a motion information of a frame macroblock of a virtual base layer to be used for inter-layer motion prediction in which motion information of a field macroblock in a field picture is derived according to another embodiment of the present invention program;

Figures 13a to 13d schematically show the procedure of deriving the motion information of the field macroblock of the virtual base layer to be used for inter-layer motion prediction according to the type of the picture, respectively, using the motion information of the field macroblock;

14a to 14k illustrate methods of performing inter-layer motion prediction when spatial resolutions of layers are different according to various embodiments of the present invention according to types of pictures, respectively;

Figures 15a and 15b schematically illustrate a procedure for using pictures of base layers with different spatial resolutions for inter-layer texture prediction when the enhancement layer is progressive and the base layer is interlaced, according to an embodiment of the present invention;

16a and 16b schematically illustrate a procedure in which pairs of macroblocks in a picture are divided into macroblocks and the separated macroblocks are enlarged in order to use a picture of a base layer for inter-layer texture prediction according to an embodiment of the present invention;

Figures 17a and 17b schematically illustrate a procedure for using pictures of a base layer with different spatial resolutions for inter-layer texture prediction when the enhancement layer is interlaced and the base layer is progressive according to an embodiment of the present invention;

FIG. 18 schematically shows a procedure for using pictures of base layers with different spatial resolutions for inter-layer prediction when both the enhancement layer and the base layer are interlaced according to an embodiment of the present invention;

Figure 19a shows a procedure for applying inter-layer prediction when the enhancement layer is a progressive frame sequence and the picture types and temporal resolutions of the two layers are different according to an embodiment of the present invention;

Figure 19b shows a procedure for applying inter-layer prediction when the enhancement layer is a progressive frame sequence and the two layers have different picture types and the same resolution according to an embodiment of the present invention;

20 shows a procedure for applying inter-layer prediction when the base layer is a progressive frame sequence and the picture types and temporal resolutions of the two layers are different according to an embodiment of the present invention; and

FIG. 21 shows a procedure for applying inter-layer prediction when the base layer is a progressive frame sequence and the two layers have different picture types and the same resolution according to an embodiment of the present invention.

5. Embodiments of the present invention

Embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

Fig. 2a schematically shows building blocks of a video signal encoding device applying the inter-layer prediction method according to the present invention. Although the apparatus of Fig. 2a is implemented to encode an input video signal into two layers, the principles of the invention described below also apply to the inter-layer process when the video signal is encoded into three or even more layers.

The inter-layer prediction method according to the invention is performed at the enhancement layer (EL) encoder 20 in the arrangement of Fig. 2a. The encoded information (motion information and texture information) is received at the base layer (EL) encoder 21 . Inter-layer texture prediction or motion prediction is performed based on the received information. If necessary, the received information is decoded and a prediction is performed based on the decoded information. Certainly, in the present invention, as shown in FIG. 2 b , the input video signal may be encoded and decoded using the already encoded video source 3 of the base layer. In this case the inter-layer prediction method described below also applies.

In the case of Fig. 2a, there may be two methods in which the BS encoder 21 codes the interlaced video signal or in which the coded video source 3 of Fig. 2b is coded. Specifically, in one of the two methods, as shown in Figure 3a, the interlaced video signal is simply encoded as a sequence of fields on a field-by-field basis, while in the other method, as shown in Figure 3b, the Frames are coded into a sequence of frames by constructing each frame of the sequence in pairs of macroblocks of two (even and odd) fields. The upper macroblock of a pair of macroblocks in a frame encoded in this way is called the "top macroblock" and the lower macroblock is called the "bottom macroblock". If the top macroblock is composed of even (or odd) field image components, the bottom macroblock is composed of odd (or even) field image components. Frames constructed in this manner are referred to as macroblock adaptive frame field (MBAFF) frames. An MBAFF frame may include not only macroblock pairs each containing odd and even field macroblocks, but also macroblock pairs each containing two frame macroblocks.

Correspondingly, when a macroblock in a picture has an interlaced image component, it may be a macroblock in a field, and it may also be a macroblock in a frame. Each macroblock with an interlaced image component is called a field macroblock, and each macroblock with a progressive (scanning) image component is called a frame macroblock.

Therefore, it is necessary to determine the interlayer prediction method by determining whether the respective types of the macroblock to be encoded at the EL encoder 20 and the base layer macroblock to be used in the interlayer prediction of the macroblock are the frame macroblock type or the field macroblock type . If the macroblock is a field macroblock, the inter-layer prediction method needs to be determined by determining whether it is a field macroblock in a field or an MBAFF frame.

The method will be described for each case separately. Before the description, it is assumed that the resolution of the current layer is equal to the resolution of the base layer. That is, assume that SpatialScalabilityType() is 0. A description of when the resolution of the current layer is higher than that of the base layer will be given later. In the following description and drawings, the terms "top" and "even" (or odd) are used interchangeably, and the terms "bottom" and "odd" (or even) are used interchangeably.

In order to perform inter-layer prediction using a base layer to encode or decode an enhancement layer, it is first necessary to decode the base layer. Therefore, base layer decoding is first described as follows.

When decoding the base layer, not only base layer motion information such as division mode, reference index, and motion vector but also texture of the base layer is decoded.

When the texture of the base layer is decoded for inter-layer texture prediction, not all image sample data of the base layer are decoded, which is to reduce the load of the decoder. Image sample data of intra-mode macroblocks is decoded, while inter-mode macroblocks only residual data—that is, error data between image sample data—is decoded without motion compensation for adjacent frames.

Furthermore, base layer texture decoding for inter-layer texture prediction is performed not on a macroblock-by-macroblock basis but on a picture-by-picture basis to construct base layer pictures that are temporally consistent with enhancement layer pictures. A base layer picture is constructed as described above from image sample data reconstructed from intra-mode macroblocks and residual data decoded from inter-mode macroblocks.

Intra-mode or inter-mode motion compensation and transformations such as DCT and quantization are performed on a block basis, e.g. on a 16 x 16 macroblock basis or on a 4 x 4 subblock basis. This results in blocking artifacts at block boundaries that distort the image. Deblocking filtering is applied to reduce these blocking artifacts. The deblocking filter smoothes the edges of image blocks to improve the quality of video frames.

Whether to apply deblocking filtering to reduce block distortion depends on the intensity of the image block at the boundary and the gradient of the pixels around the boundary. The strength or degree of the deblocking filter is determined by quantization parameters, intra mode, inter mode, image block division mode indicating block size, etc., motion vectors, pixel values before deblocking filtering, and the like.

A deblocking filter in inter-layer prediction is applied to an intra-mode macroblock in a base layer picture that is the basis for texture prediction of an intra-base mode (intraBL or inter-layer intra-mode) macroblock of the enhancement layer.

When the two layers to be coded according to the inter-layer prediction method are both coded into a sequence of field pictures as shown in Fig. An encoding/decoding process including deblocking filtering is derived.

Now we will focus on the case where the picture format of the base layer is different from the picture format of the enhancement layer—that is, the case where the base layer is a frame (or progressive) format and the base layer is a field (or interlaced) format, the base layer is a field format and the base layer is a frame format, or the case where one of the enhancement layer and the base layer is coded as a sequence of field pictures and the other is coded as an MBAFF frame even though both the enhancement layer and the base layer are in field format as shown in Figures 2c and 2d— A method for performing deblocking filtering according to an embodiment of the present invention will be described.

Figures 3a and 3b schematically illustrate a process in which a base layer picture is constructed to perform deblocking filtering for inter-layer texture prediction according to an embodiment of the present invention.

Figure 3a shows an embodiment in which the enhancement layer is in frame format and the base layer is in field format, while Figure 3b shows an embodiment in which the base layer is in field format and the base layer is in frame format.

In these embodiments, for inter-layer texture prediction, the texture of the inter-mode macroblocks and intra-mode macroblocks of the base layer is decoded to construct a base layer picture including image sample data and residual data, and after applying the deblocking filter After the constructed picture is used to reduce blocking artifacts, the constructed picture is up-sampled according to the ratio of the resolution of the base layer (or screen size) to the resolution of the enhancement layer.

The first method (method 1) in FIGS. 3a and 3b is a method in which a base layer is divided into two field pictures to perform deblocking filtering. In this method, when an enhancement layer is created using a base layer encoded in a different picture format, the base layer picture is divided into an even field picture and an odd field picture, and the two field pictures are deblocked (i.e., processed for deblocking filtering) and upsampling. These two pictures are then spliced into a single picture, and inter-layer texture prediction is performed based on the single picture.

This first method includes the following three steps.

In the separation step (step 1), the base layer picture is divided into a top field (or odd field) picture including even lines and a bottom field (or even field) picture including odd lines. A base layer picture is a video picture including residual data (inter-mode data) and image sample data (intra-mode data) reconstructed from the data stream of the base layer by motion compensation.

In the deblocking step (step 2), the field pictures separated in the separating step are deblocked by a deblocking filter. Here, a conventional deblocking filter may be used as the deblocking filter.

When the resolution of the enhancement layer is different from that of the base layer, the deblocked field pictures are upsampled according to the ratio of the resolution of the enhancement layer to the resolution of the base layer.

In the stitching step (step 3), the up-sampled top field picture and the up-sampled bottom field picture are interlaced in an alternate manner to be stitched into a single picture. Afterwards, texture prediction of the enhancement layer is performed based on this single picture.

In the second method (method 2) in Figures 3a and 3b, when creating an enhancement layer with a base layer coded in a different picture format, the base layer picture is not split into two field pictures but is directly deblocked and Upsampling and performing inter-layer texture prediction based on the resulting frame.

In this second approach, base layer pictures corresponding to enhancement layer pictures to be coded by inter-layer texture prediction are not split into top and bottom field pictures but are immediately deblocked and then upsampled. Then, texture prediction of the enhancement layer is performed based on this upsampled picture.

A deblocking filter applied to a base layer picture constructed for inter-layer motion prediction is applied only to a region including image sample data decoded from an intra-mode macroblock, and not to a region including residual data.

In the case where the base layer in Fig. 3a is coded in field format - i.e. the base layer is coded as a sequence of field pictures as shown in Fig. 2c or as an MBAFF frame as shown in Fig. 2d, in order to apply the second method, one needs Alternately interleaving the lines of the top and bottom field pictures to combine them into a single picture (in the case of Figure 2c) or alternately interleaving the lines of the top and bottom macroblocks of a field macroblock pair to combine them into a single The process of the picture (in the case of Figure 2d). This process will be described in detail with reference to Figures 8d and 8e. The top and bottom field pictures or top and bottom macroblocks to be interlaced are field pictures or macroblocks including residual data (inter mode data) and image sample data (intra mode data) reconstructed by motion compensation.

Furthermore, the top and bottom macroblocks of the field macroblock pairs (of the base layer) in an MBAFF frame as shown in Fig. 2d are of different modes and the intra-mode blocks are selected from these macroblocks for the In the case of inter-layer texture prediction (in the case of Figure 8g described later), any frame (picture) in the base layer encoded as a pair of field macroblocks in an MBAFF frame as shown in Figure 2d is temporally related to In the case of non-uniform enhancement layer pictures (in the case of Fig. 8h described later), or when the texture of the enhancement layer with macroblock pairs is predicted from the base layer with field macroblocks of field pictures as shown in Fig. 2c In the case (in the case of Fig. 10d described later), a selected one of the field macroblocks is upsampled into a temporary macroblock pair ("841" in Fig. 8g and "851" and "852" in Fig. 8h ") or two temporary macroblocks ("1021" in Fig. 10d), and apply the deblocking filter to the intra-mode macroblocks in these macroblocks.

The inter-layer texture prediction described in the following various embodiments is performed based on the deblocked base layer pictures described in the embodiments of Figs. 3a and 3b.

The inter-layer prediction method will now be described separately for each case classified according to the macroblock type in the current layer to be coded and the macroblock type of the base layer to be used for inter-layer prediction of the macroblock of the current layer. In this description, it is assumed that the spatial resolution of the current layer is equal to the spatial resolution of the base layer as described above.

I. Case of field MB in frame MB->MBAFF frame

In this case, macroblocks in the current layer (EL) are coded as field macroblocks in an MBAFF frame, and macroblocks in the base layer to be used for inter-layer prediction of macroblocks in the current layer are coded as frame macroblocks piece. The video signal components included in both the upper macroblock and the lower macroblock in the base layer are the same as those included in a pair of co-located macroblocks in the current layer. The upper and lower (top and bottom) macroblocks will be referred to as macroblock pairs, and the term "pair" will be used in the following description to describe a pair of vertically adjacent blocks. First, inter-layer motion prediction is described as follows.

The EL encoder 20 uses the macroblock division mode obtained by merging the macroblock pairs 410 of the base layer into a single macroblock (by compressing to half the size in the vertical direction) as the division mode of the current macroblock. Figure 4a shows a detailed example of this process. As shown, first, the corresponding macroblock pairs 410 of the base layer are merged into a single macroblock (S41), and the division mode of the macroblock obtained by merging is copied to another macroblock to construct the macroblock pair 411 (S42). . After that, the respective division modes of the pair of macroblocks 411 are applied to the macroblock pair 412 of the virtual base layer (S43).

However, when the corresponding macroblock pairs 410 are merged into a single macroblock, a split area that is not allowed in the split mode may be generated. In order to prevent this, the EL encoder 20 determines the division pattern according to the following rules.

1) The top and bottom two 8 x 8 blocks ("B8_0" and "B8_2" in Figure 4a) of the macroblock pair in the base layer are merged into a single 8 x 8 block. However, if any of the corresponding 8 x 8 blocks are not subdivided, they are merged into two 8 x 4 blocks, and if any of the corresponding 8 x 8 blocks are subdivided, they are are merged into four 4 x 4 blocks (“401” in Figure 4a).

2) The 8 x 16 block of the base layer is reduced to an 8 x 8 block, the 16 x 8 block is reduced to two adjacent 8 x 4 blocks, and the 16 x 16 block is reduced to a 16 x 8 block.

If at least one macroblock in the corresponding macroblock pair is intra-mode coded, the EL encoder 20 first performs the following process before the merging process.

If only one of the two macroblocks is intra mode, the motion information of the inter macroblock such as macroblock partition mode, reference index, and motion vector is copied to the intra macroblock as shown in Figure 4b, or the intra macroblock A macroblock as shown in Figure 4c is considered to be a 16 x 16 inter-macroblock with a motion vector of 0 and a reference index of 0. Alternatively, as shown in Fig. 4d, the reference index of the inner macroblock is set by copying the reference index of the inter macroblock to the inner macroblock, and a 0 motion vector is assigned to the inner macroblock. Then, the merge process mentioned above is performed, followed by the reference index and motion vector derivation procedure as described below.

The EL encoder 20 performs the following process to derive the reference index of the current macroblock pair 412 from the reference index of the corresponding macroblock pair 410 .

If each block in the base layer 8 x 8 block pair corresponding to the current 8 x 8 block has been subdivided into the same number of parts, the reference index of a piece (top block or bottom block) in the 8 x 8 block pair is determined is the reference index of the current 8 x 8 block. Otherwise, the reference index of the block that has been subdivided into a smaller number of parts in the 8x8 block pair is determined to be the reference index of the current 8x8 block.

In another embodiment of the present invention, the smaller one of the reference indices set for the base layer 8 x 8 block pair corresponding to the current 8 x 8 block is determined as the reference index of the current 8 x 8 block. This method of determination in the example of Figure 4e can be expressed as follows:

The current reference index of B8_0=min(the reference index of B8_0 of the base top frame MB, the reference index of B8_2 of the base top frame MB)

Current reference index of B8_1=min(reference index of B8_1 of base top frame MB, reference index of B8_3 of base top frame MB)

Reference index of current B8_2=min(reference index of B8_0 of base frame MB, reference index of B8_2 of base frame MB), and

The current reference index of B8_3=min(the reference index of B8_1 of the base frame MB, the reference index of B8_3 of the base frame MB).

The above reference index derivation procedure is applicable to both top and bottom field macroblocks. The reference index of each 8 x 8 block determined in this way is multiplied by 2, and the multiplied reference index is determined as its final reference index. The reason for this multiplication is that at the time of decoding, the number of pictures is twice that of the sequence of frames, since the field macroblocks belonging to a picture are divided into even and odd fields. Depending on the decoding algorithm, the final reference index of the bottom field macroblock can be determined by multiplying its reference index by 2 and adding 1 to the multiplied reference index.

The following is the procedure for the EL encoder 20 to derive the motion vectors of the macroblock pairs of the virtual base layer.

Motion vectors are determined on the basis of 4 x 4 blocks, so the corresponding 4 x 8 blocks of the base layer are identified, as shown in Fig. 4f. If the corresponding 4x8 block has been subdivided, the motion vector of its top or bottom 4x4 block is determined to be the motion vector of the current 4x4 block. Otherwise, determine the motion vector of the corresponding 4 x 8 block as the motion vector of the current 4 x 4 block. The determined motion vector is used as the final motion vector for the current 4x4 block after its vertical component is divided by 2. The reason for this division is that the image components included in two frame macroblocks correspond to the image components of one field macroblock thereby reducing the size of the field image by half in the vertical direction.

Once the motion information of the field macroblock pair 412 of the virtual base layer is determined in this way, this motion information is used for inter-layer motion prediction of the target field macroblock pair 413 of the enhancement layer. Likewise, in the following description, once the motion information of a macroblock or macroblock pair of a virtual base layer is determined, the motion information is used for inter-layer motion prediction of the corresponding macroblock or macroblock pair of the current layer. In the following description, it is assumed that the process is applied even without mentioning that motion information of a macroblock or a macroblock pair of a virtual base layer is used for inter-layer motion prediction of a corresponding macroblock or a corresponding macroblock pair of a current layer.

5 schematically shows how the motion information of a field macroblock pair 500 of a virtual base layer to be used for inter-layer prediction is derived from the motion information of a base layer frame macroblock pair corresponding to the current macroblock pair according to another embodiment of the present invention. Derivation. In this embodiment, as shown, the reference index of the top or bottom 8x8 block of the top macroblock of the base layer's frame macroblock pair is used as the reference index of each macroblock in the virtual base layer's field macroblock pair 500 The reference index of the top 8 x 8 block, and the reference index of the top or bottom 8 x 8 block of the bottom macroblock of the base layer is used as the reference index of the bottom 8 x 8 block of each macroblock in the field macroblock pair 500 . On the other hand, the motion vectors for the topmost 4 x 4 block of the top macroblock of the base layer's frame macroblock pair 500 are shared for each of the topmost macroblocks in the virtual base layer's field macroblock pair 500, as shown 4 x 4 blocks above, the motion vector of the third 4 x 4 block of the top macroblock of the frame macroblock pair of the base layer is shared for the second 4 x 4 of each macroblock in the field macroblock pair 500 block, the motion vector of the topmost 4 x 4 block of the bottom macroblock of the frame macroblock pair of the base layer is shared for the third 4 x 4 block of each macroblock in the field macroblock pair 500, and the base layer's The motion vector for the third 4 x 4 block of the bottom macroblock of the frame macroblock pair is shared for the fourth 4 x 4 block of each macroblock in the field macroblock pair 500.

As shown in Figure 5a, the top 4 x 4 block 501 and the bottom 4 x 4 block 502 of the 8 x 8 block pairs 500 in a field macroblock constructed for use in inter-layer prediction use the difference in the base layer. Motion vectors for 4 x 4 blocks out of 8 x 8 blocks 511 and 512. These motion vectors may be motion vectors using different reference pictures. That is, different 8x8 blocks 511 and 512 may have different reference indices. Correspondingly, in this case, to construct the macroblock pair 500 of the virtual base layer, the EL encoder 20 will share the motion vectors of the corresponding 4 x 4 block 503 selected for the top 4 x 4 block 501 as the second one of the virtual base layer The motion vector for the 4 x 4 block 502, as shown in Figure 5b (521).

In the embodiment described with reference to FIGS. 4a to 4f, in order to construct the motion information of the virtual base layer to predict the motion information of the current macroblock pair, the EL encoder 20 sequentially derives the partitioning mode based on the motion information of the corresponding macroblock pair of the base layer, ref. index, and motion vector. However, in the embodiment described with reference to Figures 5a and 5b, the EL encoder 20 first derives the reference indices and motion vectors of the macroblock pairs of the virtual base layer based on the motion information of the corresponding macroblock pairs of the base layer, and then based on the derived The value ultimately determines the partitioning mode of the macroblock pairs of the virtual base layer. When the partition mode is determined, 4 x 4 block units with the same derived motion vector and reference index are combined, and if the combined block mode is an allowed partition mode, the partition mode is set to this combined mode, otherwise set the division mode to the mode before combination.

In the above-mentioned embodiment, if both macroblocks in the corresponding macroblock pair 410 of the base layer are intra-mode, only intra-base prediction is performed on the current macroblock pair 413 . In this case, motion prediction is not performed. Of course, macroblock pairs of the virtual base layer are not constructed in the case of texture prediction. If only one macroblock in the corresponding macroblock pair 410 of the base layer is an intra mode, the motion information of the inter macroblock is copied to the intra macroblock as shown in Figure 4b, and the motion vector and reference The index is set to 0, or the reference index of the inner macroblock is set by copying the reference index of the inter macroblock to the inner macroblock and the motion vector of the inner macroblock is set to 0 as shown in Fig. 4d. Then, the motion information for the macroblock pairs of the virtual base layer is derived as described above.

After constructing the macroblock pairs of the virtual base layer for inter-layer motion prediction as described above, the EL encoder 20 uses the motion information of the constructed macroblock pairs to predict and encode the motion information of the current field macroblock pair 413 .

Inter-layer texture prediction will now be described. Fig. 4g shows an example inter-layer texture prediction method in the case of "frame MB -> field MB in MBAFF frame". The EL encoder 20 identifies the block mode for the corresponding frame macroblock pair 410 of the base layer. If both macroblocks in a corresponding frame macroblock pair 410 are either both intra-mode or both inter-mode, the EL encoder 20 converts (transforms) the corresponding macroblock pair 410 of the base layer into a temporary field macroblock pair 421, In order to perform either the base intra prediction of the current field macroblock pair 413 (when both frame macroblocks 410 are intra mode) or its residual prediction in the manner described below (when both frame macroblocks 410 are inter mode hour). When both macroblocks in the corresponding macroblock pair 410 are intra-mode, the temporary field macroblock pair 421 is deblocked (i.e., performed Filtered data for deblocking). In the following description of various embodiments, the same is true for temporal macroblock pairs derived from macroblocks of the base layer used for texture prediction.

However, inter-layer texture prediction is not performed when only one of the two macroblocks is inter mode. A macroblock pair 410 of a base layer for inter-layer texture prediction has uncoded raw image data (or decoded image data) if the macroblock is intra mode, and has uncoded raw image data (or decoded image data) if the macroblock is inter mode Encoded residual data (or decoded residual data). The same is true for macroblock pairs of the base layer in the following description of texture prediction.

Figure 4h shows a method for converting frame macroblock pairs into field macroblock pairs to be used for inter-layer texture prediction. As shown, the even rows of a pair of frame macroblocks A and B are sequentially selected to construct the top field macroblock A', and the odd rows of the pair of frame macroblocks A and B are sequentially selected to construct the bottom field macroblock B' . When a field macroblock is filled with rows, it is first filled with the even (or odd) row (A_even or A_odd) of the top block A, and then with the odd (or even) row (B_even) of the bottom block B (B_ even or B_odd) to pad.

II. The case of frame MB->field frame and field MB

In this case, macroblocks in the current layer are coded as field macroblocks in field pictures, and macroblocks in the base layer to be used for inter-layer prediction of macroblocks in the current layer are coded as frame macroblocks . The video signal components included in the pair of macroblocks in the base layer are the same as those included in the co-located macroblocks in the even field or odd field in the current layer. First, inter-layer motion prediction is described as follows.

The EL encoder 20 uses a macroblock division mode obtained by merging pairs of macroblocks of the base layer into a single macroblock (by compressing to half the size in the vertical direction) as a division mode of even or odd macroblocks of the virtual base layer. Figure 6a shows a detailed example of this process. As shown in the figure, the corresponding macroblock pairs 610 of the base layer are first merged into a single macroblock 611 (S61), and the division mode obtained by this merging is applied to the virtual base layer to be used for the inter-layer motion prediction of the current macroblock 613 macroblocks (S62). The merge rules are the same as in case I earlier. The processing method when at least one macroblock in the corresponding macroblock pair 610 is coded in the intra mode is the same as that in the previous case I.

The procedure for deriving reference indices and motion vectors is also performed in the same manner as described above in the previous case I. In case I, the same derivation procedure is applied to top and bottom macroblocks, since pairs of even and odd macroblocks are carried in one frame. However, this case II differs from case I in that the derivation procedure is only applied to one field macroblock, as shown in Figures 6b and 6c, because there is only one macroblock pair corresponding to the base layer macroblock 610 macroblocks.

In the above embodiments, in order to predict the motion information of a macroblock of a virtual base layer, the EL encoder 20 sequentially derives the division mode, reference index, and motion vector of the macroblock based on the motion information of the corresponding macroblock pair of the base layer.

In another embodiment of the present invention, the EL encoder 20 first derives the reference index and the motion vector of the macroblocks of the virtual base layer based on the motion information of the corresponding macroblock pairs of the base layer, and then finally determines the virtual base layer based on the derived values The block mode of the macroblock. Figures 7a and 7b schematically illustrate the derivation of reference indices and motion vectors for field macroblocks of a virtual base layer. The operation for derivation in this case is similar to that in case I described with reference to Figures 5a and 5b, with the difference that the motion information for the top or bottom macroblock is derived using the motion information for the macroblock pair of the base layer.

When the partition mode is finalized, 4 x 4 block units with the same derived motion vector and reference index are combined, and if the combined block mode is an allowed partition mode, the partition mode is set to this combined mode, otherwise set the division mode to the mode before combination.

In the above-mentioned embodiments, if two macroblocks in the corresponding macroblock pair of the base layer are intra-mode, motion prediction is not performed, and motion information of the macroblock pair of the virtual base layer is not constructed, and if the two macroblocks Only one of the blocks is intra mode, in which case motion prediction is performed as previously described.

Inter-layer texture prediction will now be described. Fig. 6d shows an example inter-layer texture prediction method in the case of "frame MB -> field MB in field picture". EL encoder 20 identifies the block mode of the corresponding macroblock pair 610 of the base layer. The EL encoder 20 constructs a temporary field macroblock 621 from a single pair of frame macroblocks 610 if both macroblocks in the macroblock pair are either both intra-mode or both inter-mode. If the current macroblock 613 belongs to an even field picture, the EL encoder 20 constructs a temporary field macroblock 621 from the even row of the corresponding macroblock pair 610 . If the current macroblock 613 belongs to an odd field picture, the EL encoder 20 constructs a temporary field macroblock 621 from the odd row of the corresponding macroblock pair 610 . The method of construction is similar to the method of constructing a single field macroblock A' or B' in Fig. 4h.

Once the temporary field macroblock 621 is constructed, the EL encoder 20 performs intra-base prediction of the current field macroblock 613 based on the texture information in the field macroblock 621 (when both macroblocks in the corresponding macroblock pair 610 are Intra mode), or perform its residual prediction (when both macroblocks in the corresponding macroblock pair 610 are inter mode).

If only one macroblock in the corresponding macroblock pair 610 is inter mode, the EL encoder 20 does not perform inter-layer texture prediction.

III. Case of MB in MBAFF frame -> frame MB

In this case, macroblocks in the current layer are coded as frame macroblocks, and macroblocks in the base layer to be used for inter-layer prediction of frame macroblocks in the current layer are coded as field macroblocks in MBAFF frames piece. The video signal components included in a field macroblock in the base layer are the same as those included in a pair of co-located macroblocks in the current layer. First, inter-layer motion prediction is described as follows.

The EL encoder 20 uses a macroblock division pattern obtained by extending the top or bottom macroblock of a base layer macroblock pair (expanded to double in the vertical direction) as a division pattern of a macroblock pair in a virtual base layer. Figure 8a shows a detailed example of this process. Although the top field macroblock is selected in the following description and drawings, the same applies when the bottom field macroblock is selected.

As shown in Figure 8a, the top field macroblocks of the corresponding macroblock pair 810 of the base layer are expanded twice to construct two macroblocks 811 (S81), and the division mode obtained by the expansion is applied to the macroblocks of the virtual base layer Pair 812 (S82).

However, when the macroblock of the corresponding field is expanded to double in the vertical direction, a division mode (or pattern) not allowed in the macroblock division mode may be generated. In order to prevent this, the EL encoder 20 determines the division pattern from the extended division pattern according to the following rule.

1) The 4 x 4, 8 x 4, and 16 x 8 blocks of the base layer after expansion are determined as 4 x 8, 8 x 8, and 16 x 16 blocks obtained by upscaling them to two times in the vertical direction.

2) The 4 x 8, 8 x 8, and 16 x 16 blocks of the base layer are each determined to be the top and bottom two blocks of the same size after expansion. As shown in Figure 8a, the 8x8 block B8_0 of the base layer is determined as two 8x8 blocks (801). The reason why 8 x 8 block B8_0 is not set to 8 x 16 block after expansion is that the adjacent expanded blocks on the left or right side of it may not be 8 x 16 partition blocks, and in this case there is no kind of macroblock Partition mode is supported.

If one macroblock in the corresponding macroblock pair 810 is coded in intra mode, EL encoder 20 selects not intra mode but the top or bottom field macroblock in inter mode, and performs the above expansion process on it to determine The partition mode of macroblock pairs 812 in the virtual base layer.

If both macroblocks in the corresponding macroblock pair 810 are intra-mode, the EL encoder 20 only performs inter-layer texture prediction, and does not perform the division mode determination through the above extension process and the reference index and motion described below Vector derivation process.

In order to derive the reference index of the macroblock pair of the virtual base layer from the reference index of the corresponding field macroblock, the EL encoder 20 determines the reference index of the corresponding 8 x 8 block B8_0 of the base layer as the reference index of the top and bottom two 8 x 8 blocks The reference index of each is shown in Figure 8b, and the determined reference index of each 8 x 8 block is divided by 2 to obtain its final reference index. The reason for this division is that in order to be applicable to frame sequences, the number of pictures needs to be reduced by half, because the number of reference pictures for field macroblocks is set based on pictures divided into even and odd fields.

When deriving the motion vector of the frame macroblock pair 812 of the virtual base layer, the EL encoder 20 determines the motion vector of the corresponding 4x4 block of the base layer as the motion vector of the 4x8 block in the macroblock pair 812 of the virtual base layer, e.g. 8c, and use the determined motion vector after multiplying its vertical component by 2 as the final motion vector. The reason for this multiplication is that the image components included in one field macroblock correspond to the image components of two frame macroblocks, thereby doubling the size of the frame image in the vertical direction.

In the above-described embodiments, in order to predict the motion information of a macroblock pair of a virtual base layer, the EL encoder 20 sequentially derives the division mode, reference index, and motion vector of the macroblock based on the motion information of the corresponding field macroblock of the base layer.

In another embodiment of the present invention, when deriving the motion information of a macroblock pair of a virtual base layer to be used for inter-layer prediction of a current macroblock pair, the EL encoder 20 first bases the motion information of the corresponding field macroblock of the base layer on the basis of The reference index and the motion vector of the macroblock pair of the virtual base layer are obtained, and then the block mode of each macroblock in the macroblock pair of the virtual base layer is finally determined based on the obtained values, as shown in FIG. 9 a . When the partition mode is finalized, 4 x 4 block units with the same derived motion vector and reference index are combined, and if the combined block mode is an allowed partition mode, the partition mode is set to this combined mode, otherwise set the division mode to the mode before combination.

A more detailed description of the embodiment of Figure 9a follows. As shown, the inter-mode field macroblock of the base layer is selected, and the motion vector and reference index of the selected macroblock are used to derive the reference of the frame macroblock pair of the virtual base layer to be used for motion prediction of the current macroblock pair index and motion vector. If both macroblocks are inter mode, any one of the top and bottom macroblocks is selected (901 or 902), and the motion vector and reference index information of the selected macroblock is used. As shown, to derive the reference index, the corresponding values of the top 8 x 8 block of the selected macroblock are copied to the reference indices of the top and bottom 8 x 8 blocks of the top macroblock of the virtual base layer, and the selected macroblock's The corresponding values of the bottom 8x8 block are copied to the reference indices of the top and bottom 8x8 blocks of the bottom macroblock of the virtual base layer. As shown, to derive motion vectors, the corresponding values of each 4 x 4 block of the selected macroblocks are shared as the motion vectors for a corresponding pair of vertically adjacent 4 x 4 blocks in the macroblock pair of the virtual base layer. In another embodiment of the present invention, the motion information of the corresponding macroblock pairs of the base layer can be mixed and used to derive the motion vector and reference index of the frame macroblock pairs of the virtual base layer, which is different from the embodiment shown in Fig. 9a. Fig. 9b shows the procedure for deriving motion vectors and reference indices according to this embodiment. A detailed description of the copy association of the reference index of the sub-block (8 x 8 block and 4 x 4 block) in the macroblock pair of the virtual base layer and the motion vector is omitted here, because it can be derived from the above-mentioned description of the motion information derivation procedure and Intuitive understanding in the inset of Figure 9b.

However, since the motion information of both macroblocks in the field macroblock pair of the base layer is used in the embodiment of FIG. The motion information of an intra-mode macroblock is derived from the motion information of another macroblock of the mode macroblock. Specifically, after constructing the motion vector and reference index of the intra-mode macroblock by copying the corresponding information of the inter-mode macroblock to the intra-mode macroblock as shown in Figure 4b, or after the intra-mode After the macroblock is considered as an inter-mode macroblock with 0 motion vector and 0 reference index, or after the reference index of the intra-mode macroblock is set by copying the reference index of the inter-mode macroblock to the intra-mode macroblock as shown in Figure 4d After the motion vector is set to 0, the motion vector and reference index information of the macroblock pair of the virtual base layer are derived as shown in FIG. 9b. Once the motion vector and reference index information of the macroblock pair of the virtual base layer is derived, the block mode of the macroblock pair is determined based on the derived information as previously described.

On the other hand, if both macroblocks in the corresponding field macroblock pair of the base layer are intra-mode, no motion prediction is performed.

Inter-layer texture prediction will now be described. Fig. 8d shows an example inter-layer texture prediction method in the case of "field MB in MBAFF frame -> frame MB". EL encoder 20 identifies the block mode for the corresponding field macroblock pair 810 of the base layer. If both macroblocks in the corresponding frame macroblock pair 810 are either intra-mode or both inter-mode, the EL encoder 20 converts the corresponding field macroblock pair 810 of the base layer into a temporary frame macroblock pair 821 so that Either perform base intra prediction of the current frame macroblock pair 813 (when both frame macroblocks 810 are intra mode) or perform its residual prediction in the manner described below (when both frame macroblocks 810 are inter mode). When both macroblocks in a corresponding macroblock pair 810 are intra-mode, the macroblock pair 810 includes data that has already been decoded, and a deblocking filter is applied to the frame macroblock pair 821 as previously described. Figure 8e shows a method for converting field macroblock pairs into frame macroblock pairs. As shown, the rows of a pair of field macroblocks A and B are alternately selected sequentially from the top of each macroblock (A->B->A->B->A->, . . . ), They are then arranged sequentially from the top in the selected order to construct a pair of frame macroblocks A' and B'. Because the rows of a field pair of macroblocks are rearranged in this way, the top frame macroblock A' is constructed from the upper half rows of the pair of field macroblocks A and B, while the bottom frame macroblock B' is constructed from the lower half of the rows are constructed.

On the other hand, if only one macroblock in the corresponding field macroblock pair 810 of the base layer is inter mode, a block is selected from the macroblock pair 810 of the base layer according to the block mode of the current frame macroblock pair 813, and the selected Blocks are used for inter-layer texture prediction. Alternatively, before determining the block mode of the macroblock pair 813 of the current frame, each method described below may be applied to perform inter-layer prediction, and then the block mode of the macroblock pair 813 may be determined.

Figures 8f and 8g show examples where one block is selected to perform inter-layer prediction. In the case that the current frame macroblock pair 813 is coded in inter mode (or is performing inter mode prediction), as shown in FIG. Blocks are up-sampled in the vertical direction to create two corresponding macroblocks 831 . These two macroblocks 831 are then used for residual prediction of the current frame macroblock pair 813 . In the case that the current frame macroblock pair 813 is not coded in inter mode (or is performing its intra mode prediction), as shown in Figure 8g, the intra mode block 810b is selected from the field macroblock pair 810 of the base layer, and The block of is vertically up-sampled to create two corresponding macroblocks 841. These two macroblocks 841 are used for intra-base prediction of the macroblock pair 813 of the current frame after applying a deblocking filter to the two macroblocks 841 .

The method shown in Figures 8f and 8g where one block is selected and up-sampled to create pairs of macroblocks to be used for inter-layer texture prediction can also be applied when the layers have different picture rates. When the picture rate of the enhancement layer is higher than that of the base layer, some pictures in the picture sequence of the enhancement layer may not have corresponding pictures in time in the base layer. Inter-layer texture prediction of a frame macroblock pair included in an enhancement layer picture that has no temporally corresponding picture in the base layer may utilize A macroblock to execute.

Figure 8h is an example of this approach in the case where the frame rate of the enhancement layer is twice the frame rate of the base layer.

As shown, the frame rate of the enhancement layer is twice that of the base layer. Thus, for every two pictures in the enhancement layer - such as a picture with a picture order count (POC) of "n2" - there is no picture in the base layer with the same picture order count (POC). Here, the same POC indicates temporal consistency.

When there is no temporally consistent picture in the base layer (for example, when the current POC is n2), a pair of spatially coherent field macroblocks included in a previous picture (that is, a picture with a POC lower than the current POC by 1) The bottom field macroblock 802 is vertically up-sampled to create a temporary macroblock pair 852 ( S82 ), which is then used to perform inter-layer texture prediction of the current macroblock pair 815 . When there is a temporally consistent picture in the base layer (for example, when the current POC is n1), the top field macroblock 801 included in a pair of spatially co-located field macroblocks in this temporally consistent picture is vertically upgraded Sampling to create a temporary macroblock pair 851 (S82), and then use this temporary macroblock pair 851 to perform inter-layer texture prediction of the current macroblock pair 814. When a macroblock pair decoded from an intra-mode macroblock is included in the temporary macroblock pair 851 or 852 created by upsampling, the macroblock pair is used for inter-layer texture prediction after applying a deblocking filter to the macroblock pair .

In another embodiment of the present invention, when there are temporally consistent pictures in the base layer (when the current POC in the example of Fig. 8h is n1), instead of using the method shown in Fig. 8h, the frame macroblock pair can be The embodiment shown in Fig. 8d is created from pairs of field macroblocks, which can then be used for inter-layer texture prediction. Furthermore, when the current picture has no temporally consistent picture in the base layer (when the current POC is n2 in the example of FIG. 8h ), inter-layer texture prediction may be performed as in FIG. block performs inter-layer texture prediction.

Accordingly, an embodiment of the present invention assigns a flag 'field_base_flag' to indicate whether the inter-layer texture prediction is performed according to the method shown in FIG. 8d or according to the method shown in FIG. 8h, and includes this flag in coded information. For example, the flag is set to '0' when the texture prediction has been performed according to the method shown in Figure 8d, and set to '1' when the texture prediction has been performed according to the method shown in Figure 8h. This flag is defined in the sequence parameter set in the enhancement layer, the sequence parameter in the degradable extension, the picture parameter set, the picture parameter set in the degradable extension, the slice header, the degradable extension to be transmitted to the decoder In the slice header, in the macroblock layer, or in the macroblock layer in the scalable extension.

IV. Case of Field MB -> Frame MB in Field Picture

In this case, the macroblocks in the current layer (EL) are coded as frame macroblocks, and the macroblocks in the base layer (BL) to be used for inter-layer prediction of frame macroblocks in the current layer are coded as A field macroblock in a field picture. The video signal components included in a field macroblock in the base layer are the same as those included in a pair of co-located macroblocks in the current layer. First, inter-layer motion prediction is described as follows.

The EL encoder 20 uses, as a division mode of a macroblock in a virtual base layer, a division pattern obtained by extending a macroblock in an even or odd field of the base layer (expanding to double in the vertical direction). Figure 10a shows a detailed example of this process. The procedure shown in Figure 10a differs from that of case III where the top or bottom field macroblocks in the MBAFF frame are selected in that spatially co-located field macroblocks 1010 in even or odd fields are naturally used, whereas It is similar to the procedure of Case III in that the co-located field macroblock 1010 is extended and the division mode of the two macroblocks obtained by the extension is applied to the macroblock pair 1012 of the virtual base layer. When the corresponding field macroblock 1010 is expanded to double in the vertical direction, a division pattern (or pattern) that is not allowed in the macroblock division mode may be generated. In order to prevent this, the EL encoder 20 determines the division pattern from the extended division pattern by the same rules as the rules 1) and 2) suggested in Case III.

If the corresponding macroblock has been coded in the intra mode, the EL encoder 20 performs only inter-layer texture prediction without performing the division mode determination through the above extension process and the reference index and motion vector derivation process described below. That is, the EL encoder 20 does not perform inter-layer motion prediction.

The reference index and motion vector derivation procedure is also similar to that described in Case III above. However, the present case IV differs from case III in the following respects. In case III, one of the top and bottom macroblocks is selected and used for the derivation procedure because the corresponding base layer macroblock is carried in the even and odd macroblock pair in the frame. In this case IV, since there is only one macroblock corresponding to the current macroblock to be coded in the base layer, the motion information of the macroblock pair 1012 of the virtual base layer is derived from the motion information of the corresponding field macroblock, without The macroblock selection procedure shown in 10b and 10c, and the derived motion information is used for the inter-layer motion prediction of the current macroblock pair 1013.

Fig. 11 schematically shows the derivation of reference indices and motion vectors of macroblock pairs of a virtual base layer according to another embodiment of the present invention. In this case, the motion information of the macroblock pairs of the virtual base layer is derived from the motion information of the even or odd field macroblocks of the base layer, unlike the case described above with reference to Fig. 9a. The same derivation operation as in the case of Fig. 9a applies to this case. However, the process of mixing and using the motion information of pairs of macroblocks in the case shown in Fig. 9b does not apply in this case IV because there is no pair of top and bottom macroblocks in the corresponding field in the base layer.

In the embodiment described with reference to FIGS. 10a to 10c, in order to predict the motion information of a macroblock pair of a virtual base layer, the EL encoder 20 sequentially derives the division mode, reference index, and motion vector based on the motion information of the corresponding field macroblock of the base layer. . However, in another embodiment of FIG. 11, the EL encoder 20 first derives the reference index and the motion vector of the macroblock pair of the virtual base layer based on the motion information of the corresponding macroblock pair of the base layer, and then finally determines The division mode of the macroblock pair of the virtual base layer. When the partition mode is determined, the 4x4 block units with the same derived motion vector and reference index are combined, and if the combined block mode is an allowed partition mode, the partition mode is set to this combined mode, Otherwise, set the division mode to the mode before combining.

When texture prediction is performed in the above-mentioned embodiments, if the corresponding field macroblock of the base layer is an intra mode, the intra-base prediction codec is performed on the current macroblock. If the corresponding field macroblock is in inter mode, and if the current macroblock has been coded in inter mode, inter-layer residual prediction coding is performed. Here, of course, field macroblocks used in prediction are used for texture prediction after they are up-sampled in the vertical direction.

In another embodiment of the invention, virtual macroblocks are created from field macroblocks included in odd or even fields to construct macroblock pairs, and then the motion of the macroblock pairs of the virtual base layer is derived from the constructed macroblock pairs. information. Figures 12a and 12b show examples of this embodiment.

In this embodiment, the reference indices and motion vectors of the corresponding even (or odd) field macroblocks of the base layer are copied (1201 and 1202) to create a virtual odd (or even) field macroblock to construct a macroblock pair 1211, and the The constructed motion information of the macroblock pair 1211 is mixed to derive the motion information of the macroblock pair 1212 of the virtual base layer (1203 and 1204). In an exemplary method of mixing and using motion information, as shown in Figures 12a and 12b, the reference index of the top 8 x 8 block of the corresponding top macroblock is applied to the top 8 x 8 of the top macroblock of the macroblock pair 1212 of the virtual base layer 8 blocks, the reference index of the bottom 8 x 8 block is applied to the top 8 x 8 block of the bottom macroblock, and the reference index of the top 8 x 8 block of the corresponding bottom macroblock is applied to the top macro of the macroblock pair 1212 of the virtual base layer The bottom 8x8 block of the block, and the reference index of the bottom 8x8 block is applied to the bottom 8x8 block of the bottom macroblock (1203). Motion vectors are applied according to the reference index (1204). The description of this process is omitted here because it can be intuitively understood from Figs. 12a and 12b.

In the embodiment shown in Figures 12a and 12b, the partition mode of the macroblock pair 1212 of the virtual base layer is determined based on the derived reference index and motion vector using the same method as described above.

Inter-layer texture prediction will now be described. Fig. 10b shows an example inter-layer texture prediction method for the case of "field MB in field picture -> frame MB". The EL encoder 20 first upsamples the corresponding field macroblocks 1010 of the base layer to create two temporary macroblocks 1021 . If the corresponding field macroblock 1010 is intra-mode, the EL encoder 20 applies a deblocking filter to the created two temporary macroblocks 1021, and then performs the encoding of the current frame macroblock pair 1013 based on these two temporary macroblocks 1021. base forecast. If the corresponding field macroblock 1010 is inter mode, the EL encoder 20 performs residual prediction of the current frame macroblock pair 1013 based on the created two temporary macroblocks 1021 .

V. Case of field MB -> field MB

This case is subdivided into the following four cases because field macroblocks are divided into field macroblocks included in a field picture and field macroblocks included in an MBAFF frame.

i) The case where the base layer and the enhancement layer are MBAFF frames

This situation is shown in Figure 13a. As shown in the figure, the motion information (partition mode, reference index, and motion vector) of the corresponding macroblock pair of the base layer is used as a virtual base layer by directly copying the motion information of the corresponding macroblock pair to the macroblock pair of the virtual base layer The motion information of the macroblock pair. Here, motion information is copied between macroblocks with the same parity. Specifically, the motion information of the even-field macroblock is copied to the even-field macroblock, and the motion information of the odd-field macroblock is copied to the odd-field macroblock, so as to construct a virtual layer for motion prediction of the macroblock of the current layer. macroblock.

A known method of inter-layer texture prediction between frame macroblocks is applied when performing texture prediction.

ii) The case where the base layer includes field pictures and the enhancement layer includes MBAFF frames

This situation is shown in Figure 13b. As shown in the figure, the motion information (partition mode, reference index, and motion vector) of the corresponding field macroblock of the base layer is obtained by directly copying the motion information of the corresponding field macroblock to each macroblock in the macroblock pair of the virtual base layer Instead, it is used as motion information for each macroblock in the macroblock pair of the virtual base layer. Here, the same parity copy rule does not apply because the motion information of a single field macroblock is used for both top and bottom field macroblocks.

When performing texture prediction, apply base intra prediction (when the corresponding block of the base layer is Intra mode) or apply residual prediction (when the corresponding block of the base layer block is an inter mode).

iii) The case where the base layer includes MBAFF frames and the enhancement layer includes field pictures

This situation is shown in Figure 13c. As shown in the figure, the field macroblocks with the same parity are selected from the base layer macroblock pairs corresponding to the current field macroblock, and the motion information of the selected field macroblock is directly copied to the field macroblock of the virtual base layer. The motion information (division mode, reference index, and motion vector) of the selected field macroblock is used as the motion information of the field macroblock of the virtual base layer.

When performing texture prediction, apply base intra prediction (when the corresponding block of the base layer is Intra mode) or apply residual prediction (when the corresponding block of the base layer block is an inter mode).

iv) The case where the base layer and the enhancement layer are field pictures

This situation is shown in Figure 13d. As shown in the figure, the motion information (partition mode, reference index, and motion vector) of the corresponding field macroblock of the base layer is used as a virtual Motion information for the field macroblocks of the base layer. Also in this case, motion information is copied between macroblocks with the same parity.

A known method of inter-layer texture prediction between frame macroblocks is applied when performing texture prediction.

The above description of inter-layer prediction is given for the case where the base layer and the enhancement layer have the same resolution. The following description will be how to identify the picture type of each layer (progressive frame, MBAFF frame, or interlaced field) and and/or the type of macroblock in the picture, and the application of the inter-layer prediction method according to the identified type is given. Inter-layer motion prediction will be described first.

M_A). Base layer (progressive frame) -> enhancement layer (MBAFF frame)

Fig. 14a shows the processing method for this case. As shown, first, the motion information of all macroblocks of the corresponding frame in the base layer is copied to create a virtual frame. Then perform upsampling. In this upsampling, interpolation is performed using texture information of a base layer picture at an interpolation rate that allows the resolution (or ie picture size) of the picture to be equal to the resolution of the current layer. Furthermore, the motion information of each macroblock of the picture enlarged by interpolation is constructed based on the motion information of each macroblock of the virtual frame. One of a number of known methods can be used for this construction. The pictures of the temporary base layer constructed in this way have the same resolution as the pictures of the current (enhancement) layer. Accordingly, the inter-layer motion prediction described above can be applied in this case.

In this case (FIG. 14a), the macroblocks in the pictures in the base layer and current layer are frame macroblocks and field macroblocks in MBAFF frames, since the base layer includes frames and the current layer includes MBAFF frames. Accordingly, the method of case I above is applied to perform inter-layer motion prediction. However, not only field macroblock pairs but also frame macroblock pairs may be included in the same MBAFF frame as described above. Correspondingly, when the type of the current layer macroblock pair corresponding to the macroblock pair in the picture of the temporary base layer has been identified as a frame macroblock type instead of a field macroblock type, the known A method of motion prediction involving a simple copy of motion information between frames (frame-by-frame prediction method).

M_B). Base layer (progressive frame) -> enhancement layer (interlaced field)

Fig. 14b shows the processing method for this case. As shown, first, the motion information of all macroblocks of the corresponding frame in the base layer is copied to create a virtual frame. Then perform upsampling. In this upsampling, using the texture information of the base layer picture, interpolation is performed at an interpolation rate that allows the resolution of the picture to be equal to the resolution of the current layer. Also, the motion information of each macroblock of the picture enlarged by interpolation is constructed based on the motion information of each macroblock of the created virtual frame.

Apply the method of case II above to perform inter-layer motion prediction, because each macroblock of the picture of the temporary base layer constructed in this way is a frame macroblock, and each macroblock of the current layer is a field in a field picture macroblock.

M_C). Base layer (MBAFF frame) -> enhancement layer (progressive frame)

Fig. 14c shows the processing method for this case. As shown, first, the corresponding MBAFF frame of the base layer is converted into a progressive frame. The method of case III above is suitable for transforming field macroblock pairs of MBAFF frames into progressive frames, and known frame-frame prediction methods are suitable for transforming frame macroblock pairs of MBAFF frames. Of course, when the method of Case III is applied to this case, it is to use the data created by the inter-layer prediction that does not need to perform the operation of encoding and decoding the difference between the predicted data and the data of the layer to be actually encoded and decoded. Virtual frame and motion information for each macroblock of that frame.

Once a virtual frame is obtained, upsampling is performed on the virtual frame. In this upsampling, interpolation is performed at an interpolation rate that allows the resolution of the base layer to be equal to the resolution of the current layer. Furthermore, the motion information of each macroblock of the enlarged picture is constructed based on the motion information of each macroblock of the virtual frame using one of several known methods. Here, the known frame macroblock-macroblock inter-layer motion prediction method is performed, because each macroblock of the picture of the temporary base layer constructed in this way is a frame macroblock, and each macroblock of the current layer is a frame macroblock. is a frame macroblock.

M_D). Base layer (interlaced field) -> enhancement layer (progressive frame)

Figure 14d shows one approach to this situation. In this case, the type of the picture is the same as the type of the macroblocks of the picture. As shown, first, the corresponding fields of the base layer are converted into progressive frames. The transformed frame has the same vertical/horizontal (aspect) ratio as the picture of the current layer. The up-sampling process and method of Case IV above apply to convert interlaced fields into progressive frames. Of course, when the method of case IV is applied to this case, the data obtained by inter-layer prediction without performing the operation of encoding and decoding the difference between the predicted data and the data of the layer to be actually encoded and decoded is used to Create the texture data of the virtual frame and the motion information of each macroblock of the frame.

Once a virtual frame is obtained, upsampling is performed on the virtual frame. In this upsampling, interpolation is performed to allow the resolution of the virtual frame to be equal to the resolution of the current layer. Furthermore, the interpolated motion information for each macroblock of the picture is constructed based on the motion information for each macroblock of the virtual frame using one of several known methods. Here is to implement the known frame macroblock-macroblock inter-layer motion prediction method, because each macroblock of the picture of the temporary base layer constructed in this way is a frame macroblock, and each macroblock of the current layer is a frame macroblock.

Fig. 14e shows a processing method for the above case M_D) according to another embodiment of the present invention. As shown, this embodiment converts odd or even corresponding fields into progressive frames. To convert an interlaced field to a progressive frame, upsampling is applied as shown in Figure 14d and the method of Case IV above. Once a virtual frame is obtained, a method of motion prediction between pictures with the same aspect ratio is applied to the virtual frame - which is one of several known methods - between the pictures of the current layer and the temporary layer motion prediction to perform predictive coding and decoding of the motion information of each macroblock of the progressive picture of the current layer.

The method shown in Fig. 14e differs from the method in Fig. 14d in that no temporary prediction signal is generated.

Fig. 14f shows a processing method for the above case M_D) according to another embodiment of the present invention. As shown, this embodiment copies the motion information of all macroblocks of the corresponding field of the base layer to create a virtual picture. Then perform upsampling. In this upsampling, the texture information of the picture of the base layer is used, and different interpolation rates are used for vertical and horizontal interpolation so that the enlarged picture has the same size (or resolution) as the picture of the current layer. Furthermore, one of various known prediction methods such as Extended Specific Scalability (ESS) may be applied to the virtual picture to construct various syntax information and motion information of the enlarged picture. The motion vectors constructed in this process are expanded according to the magnification ratio. Once the upsampled picture of the temporary base layer is constructed, this picture is used to perform inter-layer motion prediction for each macroblock in the picture of the current layer to encode and decode the motion of each macroblock in the picture of the current layer information. Here, the known frame-macroblock=macroblock inter-layer motion prediction method is applied.

Fig. 14g shows a processing method for the above case M_D) according to another embodiment of the present invention. As shown, this embodiment first copies the motion information of all macroblocks of the corresponding field of the base layer to create a virtual picture. Afterwards, interpolation is performed at different rates for vertical and horizontal interpolation using the texture information of the picture of the base layer. The texture information created by this operation is used for inter-layer texture prediction. Furthermore, the motion information in the virtual picture is used to perform inter-layer motion prediction for each macroblock in the picture of the current layer. Here, one of various known methods such as Extended Specific Scalability (ESS) defined in Joint Scalable Video Model (JSVM) is applied to perform motion prediction coding and decoding of pictures of the current layer.

The method shown in Fig. 14g differs from the method in Fig. 14f in that no temporary prediction signal is generated.

M_E). Base layer (MBAFF frame) -> Enhancement layer (MBAFF frame)

Fig. 14h shows the processing method for this case. As shown, first, the corresponding MBAFF frame of the base layer is converted into a progressive frame. In order to transform MBAFF frames into progressive frames, the method of Case III above is applied to the transformation of field macroblock pairs of MBAFF frames, and the frame-to-frame prediction method is applied to the transformation of frame macroblock pairs of MBAFF frames. Of course, when the method of case III is applied to this case, the virtual Motion information for a frame and for each macroblock in that frame.

Once a virtual frame is obtained, upsampling is performed on the virtual frame. In this upsampling, interpolation is performed at an interpolation rate that allows the resolution of the base layer to be equal to the resolution of the current layer. Furthermore, the motion information of each macroblock of the enlarged picture is constructed based on the motion information of each macroblock of the virtual frame using one of various known methods. Apply the method of case I above to perform inter-layer motion prediction, because each macroblock of the picture of the temporary base layer constructed in this way is a frame macroblock, and each macroblock of the current layer is a field in an MBAFF frame macroblock. However, not only field macroblock pairs but also frame macroblock pairs may be included in the same MBAFF frame as described above. Correspondingly, when the current layer macroblock pair corresponding to the macroblock pair in the picture of the temporary base layer is a frame macroblock instead of a field macroblock, the known method of copying between frame macroblocks including motion information is applied A method of motion prediction (frame-by-frame prediction method).

M_F). Base layer (MBFF frame) -> enhancement layer (interlaced field)

Figure 14i shows how this situation is handled. As shown, first, the corresponding MBAFF frame of the base layer is converted into a progressive frame. In order to transform MBAFF frames into progressive frames, the method of Case III above is applied to the transformation of field macroblock pairs of MBAFF frames, and the frame-to-frame prediction method is applied to the transformation of frame macroblock pairs of MBAFF frames. Of course, similarly, when the method of case III is applied to this case, the data obtained by the inter-layer prediction that does not need to perform the operation of the difference between the codec predicted data and the data of the layer actually to be codec is used to obtain Create a virtual frame and motion information for each macroblock in that frame.

Once a virtual frame is acquired, it is interpolated at an interpolation rate that allows a resolution equal to that of the current layer. Furthermore, the motion information for each macroblock of the enlarged picture is constructed based on the motion information for each macroblock of the virtual frame using one of several known methods. Apply the method of the above case II to perform inter-layer motion prediction, because each macroblock of the picture of the temporary base layer constructed in this way is a frame macroblock, and each macroblock of the current layer is an even or odd field field macroblocks.

M_G). Base layer (interlaced field) -> enhancement layer (MBAFF frame)

Fig. 14j shows the processing method for this case. As shown in the figure, first, the interlaced fields of the base layer are converted into progressive frames. Apply upsampling and the method of Case IV above to convert the interlaced fields into progressive frames. Of course, similarly, when the method of Case IV is applied to this case, it is obtained by inter-layer prediction without performing the operation of encoding and decoding the difference between the predicted data and the data of the layer to be actually coded and decoded. data to create a virtual frame and motion information for each macroblock of that frame.

Once a virtual frame is obtained, upsampling is performed on the virtual frame to allow a resolution equal to that of the current layer. Furthermore, motion information for each macroblock of the enlarged picture is constructed using one of several known methods. Apply the method of case I above to perform inter-layer motion prediction, because each macroblock of the picture of the temporary base layer constructed in this way is a frame macroblock, and each macroblock of the current layer is a field in an MBAFF frame macroblock. However, not only field macroblock pairs but also frame macroblock pairs may be included in the same MBAFF frame as described above. Therefore, when the current layer macroblock pair corresponding to the macroblock pair in the picture of the temporary base layer comprises a frame macroblock instead of a field macroblock, the known method of motion prediction between frame macroblocks (frame- frame prediction method) instead of the prediction method of case I above.

M_H). Base layer (interlaced field) -> enhancement layer (interlaced field)

Fig. 14k shows the processing method for this case. As shown in the figure, first, motion information of all macroblocks of a corresponding field in a base layer is copied to create a virtual field, and then upsampling is performed on the virtual field. This upsampling is performed at an upsampling rate that allows the resolution of the base layer to be equal to the resolution of the current layer. Furthermore, the motion information of each macroblock of the enlarged picture is constructed based on the motion information of each macroblock of the created virtual frame using one of several known methods. Apply the method of case iv) in the above case V to perform inter-layer motion prediction, because each macroblock of the picture of the temporary base layer constructed in this way is a field macroblock in the field picture, and each macroblock of the current layer Each macroblock is also a field macroblock in a field picture.

Although in the description of the embodiment of Figs. 14a to 14k the texture information of the virtual field or frame of the temporary layer is used for upsampling instead of the texture information of the picture of the base layer, the texture information of the picture of the base layer can also be used for upsampling. Furthermore, if not necessary, when deriving motion information of a picture of a temporary layer to be used for inter-layer motion prediction performed in a subsequent stage, an interpolation process using texture information may be omitted in the above-described upsampling process.

On the other hand, although the description of texture prediction is given for the case where the base layer and the enhancement layer have the same spatial resolution, the two layers may have different spatial resolutions as mentioned above. In the case where the resolution of the enhancement layer is higher than that of the base layer, first, an operation of making the resolution of the picture of the base layer equal to the resolution of the picture of the enhancement layer is performed to create a picture having the same resolution as that of the enhancement layer base layer picture, and select a texture prediction method corresponding to each of the above cases I-V on a per macroblock basis in the picture to perform predictive coding and decoding. The procedure for making the resolution of the base layer picture equal to the resolution of the enhancement layer picture is now described in detail.

When considering two layers for inter-layer prediction, the number of combinations of picture formats (progressive and interlaced formats) for encoding and decoding between the two layers is 4, because there are two video signal scanning methods, one is progressive One is line scanning and the other is interlaced scanning. Therefore, a method of increasing the resolution of a base layer picture to perform inter-layer texture prediction will be described for each of these four cases, respectively.

T_A). The case where the enhancement layer is progressive and the base layer is interlaced

Figure 15a shows an embodiment of a method for using base layer pictures for inter-layer texture prediction for this case. As shown, a base layer picture 1501 corresponding in time to a picture 1500 of the current (enhancement) layer includes even and odd fields output at different times. Therefore, first, the EL encoder 20 divides the picture of the base layer into even and odd fields (S151). The intra-mode macroblocks of the base layer picture 1501 have uncoded raw image data (or decoded image data) for intra-mode prediction, and their inter-mode macroblocks have coded residuals for residual prediction. data (or decoded residual data). The same is true for base layer macroblocks or pictures when texture prediction is described below.

After dividing the corresponding picture 1501 into field components, the EL encoder 20 performs interpolation of the separated fields 1501a and 1501b in vertical and/or horizontal directions to create enlarged even and odd pictures 1502a and 1502b (S152). This interpolation uses one of several known methods, such as 6-tap filtering and binary linear filtering. The vertical and horizontal ratios for increasing the resolution (ie, size) of a picture by interpolation are equal to the vertical and horizontal ratios of the size of the enhancement layer picture 1500 to the size of the base layer picture 1501 . The vertical and horizontal ratios may be equal to each other. For example, if the resolution between the enhancement layer and the base layer is 2, then interpolation is performed on the separated even and odd fields 1501a and 1501b to reconstruct between each pixel in each field both vertically and horizontally. Create a pixel.

Once the interpolation is complete, the amplified even and odd fields 1502a and 1502b are combined to construct the frame 1503 (S153). In this combination, rows of amplified even and odd fields 1502a and 1502b are alternately selected (1502a->1502b->1502a->1502b->..) and then arranged in the selected order to construct the combined picture 1503. Here, the block mode of each macroblock in the combined picture 1503 is determined. For example, the block mode of the macroblock of the combined picture 1503 is determined to be equal to the block mode of the macroblock in the base layer picture 1501 including an area having the same image component. This determination method is applicable in any case of the enlarged picture described below. Because the combined picture 1503 constructed in this way has the same spatial resolution as the current picture 1500 of the enhancement layer, the texture prediction of the macroblocks in the current progressive picture 1500 (e.g., frame - Inter-macroblock texture prediction) (S154).

Fig. 15b shows a method of using base layer pictures in inter-layer texture prediction according to another embodiment of the present invention. As shown, this embodiment does not separate base layer pictures on the basis of field attributes (parity), but directly performs interpolation of base layer pictures including even and odd fields output at different times in the vertical and/or horizontal direction (S155) to construct an enlarged picture with the same resolution (ie, size) as that of the enhancement layer picture. The enlarged picture constructed in this way is used to perform inter-layer texture prediction of the current progressive picture of the enhancement layer (S156).

Figure 15a shows at picture level the procedure for interpolating pictures with even and odd fields by separating them on the basis of field attributes. However, the EL encoder 20 can achieve the same result as shown in FIG. 15a by performing the procedure shown in FIG. 15a at the macroblock level. More specifically, when the base layer with even and odd fields is MBAFF coded, vertically adjacent pairs of macroblocks in picture 1501 that are co-located with pairs of macroblocks in the enhancement layer picture currently subject to texture prediction codecs can be A video signal comprising even and odd field components as in Figure 16a or 16b. Figure 16a shows a frame MB pair mode in which even and odd field components are interleaved in each of a pair of macroblocks A and B, while Figure 16b shows a pattern in which each of a pair of macroblocks A and B A block consists of field MB pair patterns of video lines with the same field attributes.

In the case of Fig. 16a, to apply the method shown in Fig. 15a, the even row of each macroblock in the pair of macroblocks A and B is selected to construct the even-field block A', and its odd row is selected to construct the odd-field block B', thereby splitting the pair of macroblocks with even and odd field components interleaved in each macroblock into two blocks A' and B' with even and odd field components, respectively. Interpolation is performed on each of the two macroblocks A' and B' separated in this way to construct an enlarged block. Texture prediction is performed using data in an area of the upscaled block corresponding to a macroblock of intra_BL (intra-base layer) or residual_prediction (residual prediction) mode in an enhancement layer picture to be currently subject to texture prediction codec. Although not shown in FIG. 16a, combining the individually enlarged blocks on a field attribute basis may construct the enlarged even and odd frames 1502a and 1502b in FIG. 15a, so the enlarged even and odd frames 1502a in FIG. and 1502b can be constructed by repeating the above operation for each pair of macroblocks.

In the case of splitting a pair of macroblocks based on field attributes to construct each macroblock as in FIG. 16b, the separation procedure described above is a process of simply copying each macroblock from the pair of macroblocks to construct two separate macroblocks. The subsequent procedure is similar to that described with reference to Figure 16a.

T_B). The case where the enhancement layer is interlaced and the base layer is progressive

Figure 17a shows an embodiment of a method for using base layer pictures for inter-layer texture prediction for this case. As shown, first, the EL encoder 20 constructs two pictures for the current layer picture 1700 (S171). In applying an example method of constructing two pictures, an even row of a corresponding picture 1701 is selected to construct one picture 1701a, and an odd row thereof is selected to construct another picture 1701b. The EL encoder 20 then performs interpolation of the thus constructed two pictures 1701a and 1701b in the vertical and/or horizontal direction to create two enlarged pictures 1702a and 1702b (S172). This interpolation uses one of several known methods, such as 6-tap filtering and binary linear filtering in case T_A). The ratios for increasing the resolution are also the same as those described in case T_A).

Once the interpolation is complete, the two upscaled fields 1702a and 1702b are combined to construct the frame 1703 (S173). In this combination, the lines of the two enlarged fields 1702a and 1702b are alternately selected (1702a->1702b->1702a->1702b->...) and then arranged in the selected order to construct the combined picture 1703. Because the combined picture 1703 constructed in this way has the same spatial resolution as the current picture 1700 of the enhancement layer, texture prediction of the macroblocks in the current interlaced picture 1700 is performed based on the corresponding macroblocks of the combined picture 1703 (e.g., Frame-to-frame inter-macroblock texture prediction or texture prediction described with reference to FIG. 4g) (S174).

Fig. 17b shows a method of using base layer pictures in inter-layer texture prediction according to another embodiment of the present invention. As shown in the figure, this embodiment does not divide the base layer picture into two pictures, but directly performs the interpolation of the base layer picture in the vertical and/or horizontal direction (S175), so as to construct a resolution that is consistent with the resolution of the enhancement layer picture (i.e. , size) the same enlarged picture. The enlarged picture constructed in this way is used to perform inter-layer texture prediction of the current interlaced picture of the enhancement layer (S176).

Although the description of Fig. 17a is also given on the picture level, the EL encoder 20 may perform the picture separation process on the macroblock level as described in case T_A) above. The method of Fig. 17b is similar to the separation and interpolation procedure shown in Fig. 17a when a single picture 1701 is considered as a pair of vertically contiguous macroblocks. A detailed description of this procedure is omitted here because it can be intuitively understood from Fig. 17a.

T_C). The case where both the enhancement layer and the base layer are interlaced

Fig. 18 shows an embodiment of a method for using base layer pictures for inter-layer texture prediction for this case. In this case, as shown in the drawing, the EL encoder 20 divides the base layer picture 1801 temporally corresponding to the current layer picture 1800 into even and odd fields in the same manner as in case T_A) (S181). The EL encoder 20 then performs interpolation of the separated fields 1801a and 1801b in the vertical and/or horizontal direction to create enlarged even and odd pictures 1802a and 1802b (S182). EL encoder 20 then combines the amplified even and odd fields 1802a and 1802b to construct picture 1803 (S182). The EL encoder 20 then performs inter-layer texture prediction (e.g., frame-to-frame inter-macroblock texture prediction or reference picture 4g described texture prediction) (S184).

Although the two layers have the same picture format, the EL encoder 20 separates the base layer picture 1801 on the basis of field attributes (S181) and individually enlarges the separated fields (S182) and then combines the enlarged pictures (S183), which is Because if the combined even and odd field picture 1801 is directly interpolated when it has the even and odd field video signal's widely varying characteristics, compared to the enhancement layer's interlaced picture 1800 with interleaved even and odd fields, The enlarged frame may have a distorted image (eg, an image with stretched borders). Accordingly, even if both layers are interlaced, according to the present invention, the EL encoder 20 uses it to obtain two fields after separating the base layer picture on the basis of field attributes, and individually amplifies the two fields, and then Combine the amplified fields.

Of course, the method shown in FIG. 18 may not always be used when the pictures of both layers are interlaced, but may be selectively used according to the video characteristics of the pictures instead.

Fig. 18 shows at the picture level the procedure for separating and enlarging pictures with even and odd fields on the basis of field attributes according to the present invention. However, as described in T_A) above, the EL encoder 20 can achieve the same result as shown in FIG. 18 by executing the procedure shown in FIG. 18 at the macroblock level, which includes the macro-based Block separation and interpolation processes (specifically, splitting frame macroblock pairs into even and odd row blocks and upscaling the separated blocks individually) and combining and inter-layer texture prediction processes (specifically, alternately selecting the upscaled to construct a pair of enlarged blocks, and use the constructed pair of enlarged blocks to perform texture prediction of the frame macroblock pair of the current layer).

T_D). The case where both the enhancement layer and the base layer are progressive

In this case, the base layer picture is upscaled to the same size as the enhancement layer picture, and the upscaled picture is used for inter-layer texture prediction of the current enhancement layer picture with the same picture format.

Although the above has described embodiments of texture prediction when the base layer and the enhancement layer have the same temporal resolution, the two layers may have different temporal resolutions, ie different frame rates. If the pictures of the layers are of different picture scan types even when the layers have the same temporal resolution, these pictures may contain video signals with different output times, even though they are pictures of the same POC (i.e., temporally corresponding to each other). screen). The inter-layer texture prediction method in this case will now be described. In the following description, it is assumed that the two layers initially have the same spatial resolution. If the two layers have different spatial resolutions, the method described below is applied after upsampling each picture of the base layer to make the spatial resolution equal to that of the enhancement layer, as described above.

a) The case where the enhancement layer consists of progressive frames, the base layer consists of MBAFF frames, and the temporal resolution of the enhancement layer is twice as high

Fig. 19a shows an inter-layer texture prediction method for this case. As shown, each MBAFF frame of the base layer includes even and odd fields with different output times, so the EL encoder 20 divides each MABFF frame into even and odd fields (S191). The EL encoder 20 separates even field components (eg, even lines) and odd field components (eg, odd lines) of each MBAFF frame into even fields and odd fields, respectively. After dividing the MBAFF frame into two fields in this way, the EL encoder 20 interpolates each field in the vertical direction to have up to twice as high resolution (S192). This interpolation uses one of several known methods, such as 6-tap filtering, binary linear filtering, and sample row zero padding. Once the interpolation is complete, each frame of the enhancement layer has temporally consistent pictures in the base layer, so the EL encoder 20 performs known inter-layer texture prediction (e.g., frame-by-frame inter-macroblock prediction) (S193).

The above procedure can also be applied to inter-layer motion prediction. Here, when the MBAFF frame is divided into two fields, the EL encoder 20 copies the motion information of each macroblock in the field macroblock pair in the MBAFF frame as the motion information of the macroblock having the same field attribute (parity), to use it for inter-layer motion prediction. Even when there is no temporally consistent picture in the base layer (in the case of t1, t3, . . . ), using this method can create a temporally consistent picture according to the method described above to perform inter-layer motion prediction.

The above can be directly applied when the resolution of one of the two layers is twice as high as that of the other layer as in the example of Fig. 19a and even when it is N times (three times or more) higher. method. For example, when the resolution is three times higher, one of the two separated fields can be additionally copied to construct and use three fields, and when the resolution is four times higher, the two can be copied again Each of the fields is separated to construct and use four fields. Obviously, in case of any temporal resolution difference, a person skilled in the art can perform inter-layer prediction simply by applying the principles of the present invention without any creative thinking. Therefore, any method for predicting between layers with different temporal resolutions not described in this specification naturally falls within the scope of the present invention. The same is true for other cases described below.

If the base layer has been coded as Picture Adaptive Fields and Frames (PAFF) instead of MBAFF frames, both layers may have the same temporal resolution as in Fig. 19b. Therefore, in this case, inter-layer texture prediction is performed after constructing a picture having the same temporal resolution as the current layer by directly interpolating a frame without performing a process of dividing the frame into two fields.

b) The case where the enhancement layer includes MBAFF frames, the base layer includes progressive frames, and the temporal resolution of the enhancement layer is half of that of the base layer

Fig. 20 shows an inter-layer texture prediction method for this case. As shown, each MBAFF frame of the enhancement layer includes even and odd fields with different output times, so the EL encoder 20 divides each MABFF frame into even and odd fields (S201). The EL encoder 20 separates even field components (eg, even lines) and odd field components (eg, odd lines) of each MBAFF frame into even fields and odd fields, respectively. The EL encoder 20 performs subsampling of each frame of the base layer in the vertical direction to construct a half-resolution picture (S202). This subsampling can use row subsampling or one of various other known downsampling methods. In the example of FIG. .) to get half-sized pictures, and select odd lines of pictures with odd picture indices (pictures t1, t3...) to get half-sized pictures. Frame separation (S201) and subsampling (S202) may also be performed in reverse order.

Once these two processes S201 and S202 are completed, the field 2001 separated from the frame of the enhancement layer has a picture in the base layer that coincides in time with the field 2001 and has the same spatial resolution as the field 2001, whereby the EL encoder 20 performs known inter-layer texture prediction (for example, frame-to-frame inter-macroblock prediction) on macroblocks in each field (S203).

The above procedure can also be applied to inter-layer motion prediction. Here, when acquiring a reduced-size picture from each frame of the base layer by subsampling (S202), the EL encoder 20 may vertically The motion information of each macroblock in the adjacent macroblock pair is obtained from the motion information of the corresponding macroblock, and then the obtained motion information can be used for inter-layer motion prediction.

In this case, the pictures of the enhancement layer are PAFF coded for transmission because inter-layer prediction is performed on each field picture 2001 separated from the MBAFF frame.

c) The enhancement layer includes MBAFF frames, the base layer includes progressive frames, and the two layers have the same temporal resolution

Fig. 21 shows an inter-layer texture prediction method for this case. As shown, each MBAFF frame of the enhancement layer includes even and odd fields with different output times, so the EL encoder 20 divides each MABFF frame into even and odd fields (S211). The EL encoder 20 separates even field components (eg, even lines) and odd field components (eg, odd lines) of each MBAFF frame into even fields and odd fields, respectively. The EL encoder 20 performs subsampling of each frame of the base layer in the vertical direction to construct a half-resolution picture (S212). This subsampling may use row subsampling or one of various other known downsampling methods. Frame separation (S211) and subsampling (S212) may also be performed in reverse order.

EL encoder 20 may also construct fields (eg, even field pictures) from MBAFF frames instead of splitting the MBAFF frame into two fields. This is because the two layers have the same temporal resolution, so only one of the two field pictures separated from a frame (not both) has a corresponding frame in the base layer that can be used for inter-layer prediction.

Once these two processes S211 and S212 are completed, the EL encoder 20 performs the known inter-layer Texture prediction (eg, frame-to-frame inter-macroblock prediction) (S213).

Also in this case, inter-layer motion prediction may be performed on the separated field of the enhancement layer for which inter-layer texture prediction is performed in the same manner as described in case b).

Although the above description is given in relation to the inter-layer prediction operation performed by the EL encoder 20 of Figure 2a or 2b, all descriptions of the inter-layer prediction operation are collectively applicable to receiving decoded information from the base layer and decoding the enhancement layer EL decoder for streams. In encoding and decoding procedures, the above-mentioned inter-layer prediction operations (including operations for separating, enlarging, and combining video signals in pictures or macroblocks) are performed in the same manner, but operations after inter-layer prediction are performed in different way to execute. An example of this difference is: After performing motion and texture prediction, the encoder encodes the predicted information or the difference between the predicted information and the actual information to transmit it to the decoder, and the decoder uses the The information obtained by performing the same inter-layer motion and texture prediction as performed at the encoder is directly applied to the current macroblock or the actual motion information and texture information are obtained by additionally using the actually received macroblock codec information. The details and principles of the present invention described above from an encoding perspective are directly applicable to a decoder decoding a received two-layer data stream.

However, when an EL encoder transmits an enhancement layer with an MBAFF frame in a PAFF manner after separating the enhancement layer into field sequences and performing inter-layer prediction as described with reference to FIGS. 20 and 21 , the decoder does not perform the above-mentioned A program that divides MBAFF frames into field pictures.

Furthermore, the decoder then decodes from the received signal a flag 'field_base_flag' identifying whether the EL encoder 20 has performed inter-layer texture prediction between macroblocks as shown in Fig. 8d or as shown in Fig. 8h. Based on the decoded flag value, the decoder determines whether the prediction between macroblocks is performed as shown in FIG. 8d or as shown in FIG. 8h, and obtains texture prediction information based on this determination. If the flag 'field_base_flag' is not received, the EL decoder assumes that a flag with a value of "0" has been received. That is, the EL decoder assumes that the texture prediction between macroblocks is performed according to the method shown in Fig. 8d, and obtains the prediction information of the current macroblock pair to reconstruct the current macroblock or macroblock pair.

At least one of the above-described limited embodiments of the present invention can perform inter-layer prediction even when video sources of different formats (or modes) are used. Therefore, when encoding and decoding multiple layers, the data encoding rate can be increased regardless of the picture type of the video signal, such as interlaced signal, progressive signal, MBAFF frame picture, and field picture. Furthermore, when one of the two layers is an interlaced video signal source, the image of the picture used in the prediction can be constructed to be more similar to the original image used for the prediction codec, thereby increasing the data encoding rate.

Although the present invention has been described with reference to preferred embodiments, it will be apparent to those skilled in the art that various improvements, modifications, substitutions, and additions can be made in the present invention without departing from the scope and spirit of the invention. Thus, the present invention is intended to cover improvements, modifications, substitutions, and additions to this invention provided they come within the scope of the appended claims and their equivalents.

Claims (16)

1. method that is used for when encoding/decoding video signal carrying out inter-layer motion prediction said method comprising the steps of:

A) from the derive movable information of single macro block of the right movable information that vertically adjoins the frame macro block of basic unit; And

B) with the movable information derived as the movable information of the field macro block in anterior layer or described field macro block in anterior layer to the information of forecasting of separately movable information.

2. the method for claim 1 is characterized in that, described step a) may further comprise the steps:

With described frame macro block to dwindling into single macro block, and based on the partition mode that obtains described single macro block according to the described partition mode that dwindles;

Related according to the amplification that described single macro block and described frame macro block are right, obtain the reference key of described single macro block based at least one reference key in 8 corresponding 8 x of 8 x in described frame macro block centering and the described single macro block, 16 zones; And

Related according to the amplification that described single macro block and described frame macro block are right, obtain the motion vector of described single macro block based at least one motion vector in 4 corresponding 4 x of 4 x in described frame macro block centering and the described single macro block, 8 zones.

3. the method for claim 1 is characterized in that, described step a) may further comprise the steps:

Related according to the amplification that described single macro block and described frame macro block are right, obtain the reference key of described single macro block based at least one reference key in 8 corresponding 8 x of 8 x in described frame macro block centering and the described single macro block, 16 zones; And

Related according to the amplification that described single macro block and described frame macro block are right, obtain the motion vector of described single macro block based at least one motion vector in 4 corresponding 4 x of 4 x, 8 zones of described frame macro block centering and described single macro block; And

Obtain the partition mode of described single macro block based on the reference key that is obtained and motion vector.

4. the method for claim 1, it is characterized in that, if described frame macro block is to comprising internal schema macro block and inter mode macro block, the movable information that then described step a) is included in described inter mode macro block is copied to after the movable information of described internal schema macro block, from the derive movable information of described single macro block of the right movable information of described frame macro block.

5. the method for claim 1, it is characterized in that, if described frame macro block is to comprising internal schema macro block and inter mode macro block, then described step a) is included in described internal schema macro block is considered as having after the inter mode macro block of 0 motion vector and 0 reference key, from the derive movable information of described single macro block of the right movable information of described frame macro block.

6. method that is used for when encoding/decoding video signal carrying out inter-layer motion prediction said method comprising the steps of:

A) from the movable information of single the macro block of basic unit or the movable information that vertically adjoins single right macro block of a macro block that is selected from described basic unit two macro blocks movable information separately of deriving; And

B) with the movable information separately derived as when the frame macro block of anterior layer information of forecasting to separately movable information.

7. method as claimed in claim 6 is characterized in that, described step a) may further comprise the steps:

Described single macro block is extended to two macro blocks, and obtains described two macro blocks partition mode separately based on the partition mode of expanding according to described expansion;

Related according to described single macro block with the amplification of described two macro blocks, by with in the reference key of 8 of 8 x in described single the macro block and described two macro blocks with described single field macro block in the reference key of 8 of 8 corresponding two 8 x of 8 x in each be associated, obtain 8 reference keys separately of described two 8 x; And

Related according to described single macro block with the amplification of described two macro blocks, by with in the motion vector of 4 of 4 x in described single the macro block and described two macro blocks with described single field macro block in the motion vector of 4 of 4 corresponding two 4 x of 4 x in each be associated, obtain 4 motion vectors separately of described two 4 x.

8. method as claimed in claim 7, it is characterized in that, the step of two macro blocks of described acquisition partition mode separately comprises and obtains described two macro blocks block mode separately as follows: the block mode that 4 x, 4,8 x 4 in described single the macro block and 16 x are 8 is configured to expand in vertical direction the block mode of twice, and other piece block mode separately is configured to two block modes of identical size.

9. method as claimed in claim 6 is characterized in that, described step a) may further comprise the steps:

Related according to described single macro block with the amplification of described two macro blocks, by with in the reference key of 8 of 8 x in described single the macro block and described two macro blocks with described single field macro block in the reference key of 8 of 8 corresponding two 8 x of 8 x in each be associated, obtain 8 reference keys separately of described two 8 x;

Related according to described single macro block with the amplification of described two macro blocks, by with in the motion vector of 4 of 4 x in described single the macro block and described two macro blocks with described single field macro block in the motion vector of 4 of 4 corresponding two 4 x of 4 x in each be associated, obtain 4 motion vectors separately of described two 4 x; And

Obtain described two macro blocks partition mode separately based on reference key that is obtained and motion vector.

10. method as claimed in claim 6, it is characterized in that, if described macro block is to comprising internal schema macro block and inter mode macro block, then described step a) comprises selects described inter mode macro block and with the movable information of selected inter mode macro block described two macro blocks movable information separately that is used to derive.

11. method as claimed in claim 6, it is characterized in that, described step a) comprises that the information of described single the macro block of copy is right with an other structure macro block, and from the macro block that constructed to described two macro blocks movable information separately of deriving of movable information separately.

12. a method that is used for carrying out inter-layer motion prediction when encoding/decoding video signal said method comprising the steps of:

A) confirm that two of basic unit adjoin vertically whether to have one in the macro block at least be internal schema; And

B) if confirm only have one to be internal schema in described two macro blocks, then the motion related information with inter mode macro block included in described two macro blocks is copied to described internal schema macro block described internal schema macro block is arranged to have the piece of movable information.

13. method as claimed in claim 12 is characterized in that, the motion related information that is copied is the information about motion vector and reference key.

14. method as claimed in claim 12 is characterized in that, and is further comprising the steps of:

After the step of the described piece of the internal schema macro block being arranged to have movable information, utilize the motion related information of described two macro blocks to determine the partition mode of described two macro blocks.

15. method as claimed in claim 12 is characterized in that, described two macro blocks that macro block is the frame component image.

16. method as claimed in claim 15 is characterized in that, the described motion related information of described two macro blocks is used to the right inter-layer motion prediction of macro block of field component image on the upper strata of described basic unit.

Images