CN103561273B - Code device and method, error detector element and method, decoding apparatus and method - Google Patents

Abstract

Provided are an encoding method and an encoding device capable of reducing the amount of encoding required to encode a reference index and improving encoding efficiency. The encoding method of the present invention is an encoding method for encoding random-accessible pictures by using inter-view reference, including: a step of writing a segment header (S103), configuring the inter-view reference picture at the beginning for correcting the reference picture The reference list modification syntax is written into the slice header of the picture that can be randomly accessed; the allocation step (S104) is to allocate the inter-view reference picture to the beginning of the reference picture list; and the encoding step (S105) is to use the reference picture list to be able to Object fragment encoding for randomly accessed pictures.

Description

Encoding device and method, error detection device and method, decoding device and method

This application is a divisional application of the application dated March 26, 2010, the application number is 201080001719.7, and the title of the invention is "encoding device and method, error detection device and method, decoding device and method".

technical field

The present invention relates to an encoding method, an error detection method, and a decoding method used in encoding and decoding of all multimedia data, and particularly relates to an encoding method, an error detection method, and a decoding method used in encoding and decoding of multi-viewpoint video.

Background technique

In order to provide a 3D visual effect to the viewer, there are several methods. One is a method in which the viewer's left and right eyes see two images respectively. This is called stereoscopic photography, and it is a method of capturing two images using two cameras. One of the conventionally used techniques for displaying stereoscopic images is a method of filtering color components so that each eye can see them. In such techniques, the resolution of images reaching the respective eyes becomes low.

Due to recent advances in display technology, viewers are now able to view images with maximum resolution with one eye. The H.264/MPEG-4AVC multi-view video coding (MVC) video standard is formulated for the purpose of compressing 3D images when each viewpoint (view) is displayed at the maximum resolution.

The H.264/MPEG-4AVC multi-view video coding (MVC) video standard provides a set of compression tools capable of efficiently compressing moving pictures targeting sets of multiple views. According to the MVC video standard, pictures can be compressed using predictive coding based on reconstructed pictures with different viewpoint sets. This "inter-viewpoint" prediction utilizes the correlation of images captured by each camera at approximately the same time to efficiently compress pictures.

In the MVC video specification, "inter-viewpoint" prediction is performed only on pictures of different viewpoints that have the same picture order count information. The picture sequence number information is used to indicate the order of reconstructed pictures of the same viewpoint. In the MVC video specification, pictures of different viewpoints having the same picture serial number information (that is, viewpoint components defined by the MVC specification) are set as containers called access units.

In the MVC video specification, a coded picture that refers to only slices in the same access unit for any slice is called an anchor picture. As shown in FIG. 1 , an anchor picture is identified based on a bit carried in a NAL unit header of a coded picture, specifically based on a bit indicating anchor_pic_flag. In addition, FIG. 1 is a diagram showing an example of a data structure of an access unit.

Through this bit, the MVC decoder can identify the anchor pictures of the coded video sequence, and use these anchor pictures as random access points for the MVC decoder to reconstruct images without decoding the pictures preceding the anchor pictures.

In addition, as shown in FIG. 1 , among the view components included in the access unit, only the first view component is a basic view component, and the remaining view components are non-basic view components. The non-baseview component that appears after the baseview component is the first non-baseview component.

H.264/MPEG-4AVC High Profile (High Profile) is widely used in various applications such as HD storage media (medium) and HD digital broadcasting. The multi-view high-end class defined by the MVC image specification is developed by extending the H.264/MPEG-4AVC high-end class. Decoding of compressed video streams of Viewpoint High Class.

As mentioned above, anchor pictures can be used as random access points. Therefore, anchor pictures are indispensable for applications that require functions such as special playback or stream switching.

An anchor picture is defined in the MVC video specification as a coded picture that only refers to a slice in the same access unit in any slice. In the video specification of MVC, an access unit is composed of one or more view elements depending on the number of corresponding views.

In many applications, in order to improve compression efficiency, only one view component of the anchor access unit is intra-coded, and the rest of the view components of the anchor access unit are inter-coded. Inter-coded view components utilize inter-view prediction from intra-coded view components. An intra-coded view component utilizes only spatial prediction tools (eg, intra prediction) in order to reconstruct the view.

In video standards such as the H.264/MPEG-4 AVC standard and MVC, reference pictures that can be used for sample prediction are identified for each image using a reference picture list. Each coded block of a coded picture can refer to a reference picture for prediction by sending an index to a reference picture list (see Patent Document 1).

Regarding the samples of each view component, the initialization process for creating both inter-prediction and inter-view prediction lists is prescribed by MVC. As stipulated in the video specification of MVC, in the initialization process of the reference list, the reference picture of the same viewpoint is placed at the head of the list, and the inter-view reference picture is placed at the end of the reference picture list. An example of such a reference picture list is shown in FIG. 2 . In addition, FIG. 2 is a diagram for explaining an example of initialization processing of a conventional reference picture list.

As described above, predictive encoding can be performed using a reference list indicating intra-view reference pictures (inter-prediction) and inter-view reference pictures.

Patent Document 1: Japanese Patent Laid-Open No. 2007-159111

Contents of the invention

However, in the conventional technology described above, it is necessary to transmit indexes (reference indexes) to the reference picture list for each block of the view component, and the number of bits used to transmit these reference indexes increases, resulting in poor coding efficiency.

As shown in FIG. 1 , the transmission of the reference index is performed for each slice macroblock. Since the anchor picture cannot perform inter-prediction (prediction from a reconstructed picture of the same viewpoint), most of the indexes in the reference picture list are not used.

Specifically, in the example shown in FIG. 2 , when the picture included in the access unit 10 is an anchor picture, when encoding the view component 20 included in the second view, reference pictures A to A are not referred to. D, when encoding the view component 20, refer to the inter-view reference picture E. Therefore, in each macroblock, the reference index [4] is often coded, but the reference indexes [0] to [3] are not coded.

At this time, the bits generally used to transmit the reference index to the reference picture list increase with the value of the reference index as shown in FIG. 3 . FIG. 3 shows the relationship between the value of the reference index and the number of bits when encoding the reference index when the type of entropy coding used for coding the slice is variable-length coding.

As shown in FIG. 3, since the inter-view reference picture is always placed at the end of the reference picture list, the value of the reference index for the inter-view reference picture (in the example in FIG. 2, the reference index indicating the inter-view reference picture) won't get smaller. Thus, the number of bits used to encode such a reference index for a view element becomes considerable.

Therefore, the present invention was made to solve the above problems, and an object of the present invention is to provide an encoding method and an encoding device capable of reducing the amount of encoding required for encoding a reference index and improving encoding efficiency.

In order to solve the above-mentioned problems, the encoding method of the present invention is an encoding method for encoding random-access pictures by using inter-view reference, including: a slice header writing step, which will be used to modify the first reference picture list to use inter-view reference The correction syntax of the first reference list that arranges the picture to the beginning is written into the segment header of the above random-accessible picture; the allocation step is to arrange the above-mentioned inter-view reference picture to the beginning of the above-mentioned first reference picture list; and the encoding step is to use The first reference picture list encodes target slices of the randomly accessible pictures.

In pictures that can be randomly accessed, inter-view reference pictures are often referred to, so according to the encoding method of the present invention, the reference index indicating the inter-view reference picture has a small value, and the need for encoding the reference index can be reduced. The amount of code, improve coding efficiency.

In addition, it may also be that the above-mentioned encoding method further includes a NAL unit header writing step of writing the NAL unit header; in the above-mentioned NAL unit header writing step, a The value is set in the anchor_pic_flag, and the above-mentioned anchor_pic_flag is written into the above-mentioned NAL unit header.

In this way, a value indicating that the image is an anchor picture can be written in the NAL unit header. Therefore, at the time of decoding, it is possible to determine whether or not the image to be decoded is an anchor picture only by using the interest-bearing NAL unit header.

In addition, the above-mentioned segment header writing step may also determine whether the segment type of the target segment is a B segment, and if the segment type of the target segment is a B segment, it will be used to correct the first reference picture list. A different second reference picture list is written in the above-mentioned slice header with the modified syntax of the second reference list that arranges the inter-view reference picture at the head.

As a result, even when a plurality of reference picture lists are used, the inter-view reference picture can be arranged at the head of each reference picture list, the amount of code required for coding the reference index can be reduced, and code efficiency can be improved.

In addition, in writing the first reference list modification syntax, a value indicating modification of the first reference picture list may be set in ref_pic_list_modification_flag_10; the above ref_pic_list_modification_flag_10 may be written in the slice header; A value of abs_diff_view_idx_minus1 corresponding to the value added to the predicted value of the inter-view reference index is set in the first modification_of_pic_nums_idc; the above-mentioned first modification_of_pic_nums_idc is written into the above-mentioned slice header; 0 is set in the above-mentioned first abs_diff_view_idx_minus1; Writing the first abs_diff_view_idx_minus1 into the slice header; setting a value indicating the end of the modification of the first reference picture list in the second modification_of_pic_nums_idc; writing the second modification_of_pic_nums_idc into the slice header.

In this way, the fact that the inter-view reference picture is arranged at the head of the reference picture list can be written in the slice header using a plurality of parameters, so it is possible to determine whether the reference picture has been corrected or not only by analyzing the slice header at the time of decoding.

In addition, in writing the first reference list modification syntax, the ref_pic_list_modification_flag_10, the first modification_of_pic_nums_idc, and the first abs_diff_view_idx_minus1 may be sequentially written in the slice header.

In this way, each parameter is sequentially and continuously written, so the analysis of the slice header at the time of decoding becomes easy.

In addition, in the writing of the second reference list modification syntax, a value indicating modification of the second reference picture list may be set in ref_pic_list_modification_flag_l1; the ref_pic_list_modification_flag_l1 may be written in the slice header; Two abs_diff_view_idx_minus1 corresponding to the value added to the predicted value of the inter-view reference index is set in the third modification_of_pic_nums_idc; the above-mentioned third modification_of_pic_nums_idc is written into the above-mentioned segment header; 0 is set in the above-mentioned second abs_diff_view_idx_minus1; Writing the second abs_diff_view_idx_minus1 into the slice header; setting a value indicating the end of the modification of the second reference picture list in the fourth modification_of_pic_nums_idc; writing the fourth modification_of_pic_nums_idc into the slice header.

As a result, even when multiple reference picture lists are used, multiple parameters can be written in the slice header according to the parameter picture list to place the inter-view reference picture at the head of the reference picture list. Therefore, only by By parsing the segment header, it is possible to determine whether each reference picture list has been modified.

In addition, in writing the second reference list modification syntax, the ref_pic_list_modification_flag_l1, the third modification_of_pic_nums_idc, and the second abs_diff_view_idx_minus1 may be successively written in the slice header in sequence.

In this way, each parameter is sequentially and continuously written, so the analysis of the slice header at the time of decoding becomes easy.

In addition, the aforementioned randomly accessible picture may be an anchor picture.

In addition, the error detection method of the present invention is an error detection method for detecting errors in random-accessible pictures coded by inter-view reference, and includes: an initialization step that indicates that no errors have occurred in the above-mentioned random-accessible pictures The value is set in detected_error_flag; the judging step is to read at least one parameter included in the correction syntax used to modify the reference picture list to arrange the inter-view reference picture at the beginning from the segment header of the above random-accessible picture , judging whether an error has occurred in the read parameter; and a setting step, when it is judged that the above error has occurred, setting a value indicating that an error has occurred in the above random accessable picture to the above detected_error_flag In the above-mentioned judging step, at least one of the following judging processes is performed: (i) the first judging process is to read ref_pic_list_modification_flag_10 from the above-mentioned slice header as the above-mentioned parameter, and judge whether the read ref_pic_list_modification_flag_10 indicates that the above-mentioned Refer to the modified value of the picture list, and determine that an error has occurred when the ref_pic_list_modification_flag_10 is not a value indicating that the reference picture list has been modified; (ii) the second judgment process reads modification_of_pic_nums_idc as the parameter from the slice header, It is determined whether the read modification_of_pic_nums_idc is a value indicating that abs_diff_view_idx_minus1 corresponds to a value added to the predicted value of the inter-view reference index, and it is determined that the above modification_of_pic_nums_idc does not indicate that the above-mentioned abs_diff_view_idx_minus1 corresponds to a value added to the above predicted value. (iii) The third judgment process is to read abs_diff_view_idx_minus1 from the above-mentioned segment header as the above-mentioned parameter, judge whether the value of the read abs_diff_view_idx_minus1 is 0, and judge that an error has occurred if the above-mentioned abs_diff_view_idx_minus1 is not 0.

In this way, it can be determined whether or not a random-accessible picture encoded by modifying the reference picture list so that the inter-view reference picture is placed at the head of the reference picture list is correctly encoded.

In addition, it may also be that, in the above-mentioned segment header, the above-mentioned ref_pic_list_modification_flag_10, the above-mentioned modification_of_pic_nums_idc, and the above-mentioned abs_diff_view_idx_minus1 are successively written in sequence; in the above-mentioned judgment step, the above-mentioned first judgment process, the above-mentioned second judgment process, and the above-mentioned third judgment are sequentially performed processing until it is judged that an error has occurred by any one of the first judgment processing, the second judgment processing, and the third judgment processing.

Thereby, an error can be detected even if a correct value is not written in one of the plurality of parameters.

In addition, the aforementioned randomly accessible picture may be an anchor picture.

In addition, the decoding method of the present invention is a decoding method for decoding a random-accessible picture coded by inter-view reference, and includes an analysis step of analyzing the slice header of the random-accessible picture to determine whether the reference is corrected. The picture list arranges the inter-view reference picture at the beginning; in the predicting step, when it is determined that the above-mentioned reference picture list has been corrected, a predicted image is generated according to a preset specification, and when it is determined that the above-mentioned reference picture list is not corrected , generating a predictive image according to a method different from the above-mentioned specification; the decoding step is to decode the target segment of the random-accessible picture based on the predictive image.

Accordingly, it is possible to correctly decode a random-accessible picture coded by modifying the reference picture list so that the inter-view reference picture is arranged at the head of the reference picture list.

In addition, in the analysis step, it may be determined whether or not ref_pic_list_modification_flag_10 is a value indicating that the reference picture list has been modified by analyzing the slice header.

In this way, it is possible to determine whether or not the reference picture list has been modified simply by reading ref_pic_list_modification_flag_10.

In addition, in the prediction step, when the ref_pic_list_modification_flag_10 indicates that the reference picture list has been modified, (i) a modification syntax for modifying the reference picture list may be read from the slice header; (ii) Arranging the inter-view reference picture at the head of the reference picture list; (iii) performing motion prediction using the reference picture list to generate the predicted image.

As a result, only by decoding according to the standard, the reference picture list can be corrected, and a coded picture that can be randomly accessed can be correctly decoded.

In addition, in the prediction step, when the ref_pic_list_modification_flag_10 is not a value indicating that the reference picture list has been modified, the predicted image may be generated using a base view image as a reference image without referring to a reference index.

As a result, even when the reference picture list has not been updated, it is possible to decode a randomly accessible coded picture.

In addition, the present invention can be realized not only as an encoding method, an error detection method, and a decoding method, but also as a device including processing steps included in the encoding method, error detection method, and decoding method as a processing unit.

According to the present invention, it is possible to reduce the amount of codes required for coding a reference index and improve coding efficiency.

Description of drawings

FIG. 1 is a diagram showing an example of a data structure of an access unit.

FIG. 2 is a diagram for explaining an example of initialization processing of a conventional reference picture list.

3 is a diagram showing an example of the relationship between the value of the reference index and the number of bits when the value of the reference index is coded by variable-length entropy coding.

FIG. 4 is a block diagram showing an example of the configuration of an encoding device according to Embodiment 1 of the present invention.

5 is a block diagram showing an example of a configuration of an encoding unit that encodes a non-base-view component according to Embodiment 1 of the present invention.

FIG. 6 is a diagram illustrating an example of modification of a reference picture list according to Embodiment 1 of the present invention.

7A is a diagram showing an example of a stream structure when encoding a non-base-view component (P picture) of an anchor access unit according to Embodiment 1 of the present invention.

7B is a diagram showing an example of a stream structure when encoding a non-base-view component (B picture) of an anchor access unit according to Embodiment 1 of the present invention.

8 is a flowchart showing an example of a process of encoding an anchor access unit non-base-view element according to Embodiment 1 of the present invention.

9 is a flowchart showing an example of a process of writing a reference list MVC modification syntax when encoding a non-base-view component of an anchor access unit according to Embodiment 1 of the present invention.

10 is a block diagram showing an example of the configuration of a decoding device according to Embodiment 2 of the present invention.

11 is a block diagram showing an example of the configuration of an error detection unit according to Embodiment 2 of the present invention.

12 is a flowchart showing an example of a process of detecting an error in an anchor access unit non-base-view component according to Embodiment 2 of the present invention.

13 is a block diagram showing an example of the configuration of an MVC decoder unit according to Embodiment 2 of the present invention.

14 is a block diagram showing an example of a detailed configuration of an MVC decoder unit according to Embodiment 2 of the present invention.

15 is a flowchart showing an example of a process of decoding an anchor access unit non-base-view component according to Embodiment 2 of the present invention.

FIG. 16 is a block diagram showing an example of the configuration of a decoding device according to a modified example of the embodiment of the present invention.

FIG. 17 is a block diagram showing an example of the operation of a decoding device according to a modified example of the embodiment of the present invention.

FIG. 18 is a schematic diagram showing an example of an overall configuration of a content supply system for realizing a content distribution service.

Fig. 19 is a diagram showing the appearance of a mobile phone.

FIG. 20 is a block diagram showing a configuration example of a mobile phone.

FIG. 21 is a schematic diagram showing an example of an overall configuration of a digital broadcasting system.

FIG. 22 is a block diagram showing a configuration example of a television.

23 is a block diagram showing a configuration example of an information reproducing and recording unit that reads and writes information to and from a recording medium that is an optical disc.

Fig. 24 is a diagram showing a configuration example of a recording medium as an optical disk.

25 is a block diagram showing a configuration example of an integrated circuit for realizing the image encoding method and the image decoding method according to each embodiment.

detailed description

Hereinafter, embodiments of the present invention will be described in detail using the drawings.

(Embodiment 1)

The encoding method according to Embodiment 1 of the present invention is an encoding method for encoding randomly accessible pictures by using inter-view reference, and is characterized in that it includes: a step of writing a slice header, which is used to modify the reference picture list to The modified syntax for configuring the reference picture to the beginning is written into the segment header of the randomly accessible picture, and the reference picture list represents the intra-view reference picture and the inter-view reference picture; the configuration step is to configure the inter-view reference picture into the reference picture list the beginning of the encoding step, using the reference picture list, encoding the target segment of the picture that can be randomly accessed.

First, an example of an encoding device implementing the encoding method of the present invention will be described.

FIG. 4 is a diagram showing an example of the configuration of the encoding device 100 according to Embodiment 1 of the present invention. The coding device 100 is a device that codes images including a plurality of viewpoints. In the example shown in FIG. 4 , a base-view image and a non-base-view image are coded. The encoding device 100 includes a first-viewpoint component encoding unit 110 , a storage unit 120 , and a second-viewpoint component encoding unit 130 .

The first-view component encoding unit 110 acquires the base-view image 201 which is the first-view image, and compresses and encodes the acquired base-view image 201 to generate a compressed base-view component 202 . The generated compressed base view element 202 is output as a bit stream. Furthermore, the first-view component encoding unit 110 locally decodes the compressed base-view component 202 to generate the reconstructed image 203 . The generated reconstructed image 203 is stored in the storage unit 120 .

The storage unit 120 is a memory for storing reference images. Specifically, the storage unit 120 stores the reconstructed image 203 generated by the first-viewpoint component encoding unit 110 as a reference image.

The second-view component encoding unit 130 acquires the non-base-view image 211 which is the second-view image, and compresses and encodes the acquired non-base-view image to generate the compressed non-base-view component 212 . Specifically, the second-view component encoding unit 130 reads the reference image 213 from the storage unit 120, generates a predicted image using the read reference image 213, and encodes the difference between the generated predicted image and the non-base-view image 211. . In addition, the generated compressed non-base-view component 212 is output as a bitstream.

In addition, the second-viewpoint component coding unit 130 modifies the reference picture list when coding a randomly accessible picture, for example, an anchor picture. The detailed configuration of the second-viewpoint component coding unit 130 will be described later using FIG. 5 .

FIG. 5 is a block diagram showing an example of the configuration of the second-view component encoding unit 130 according to Embodiment 1 of the present invention. As shown in FIG. 5 , the second-view component encoding unit 130 includes an encoding unit 301 , a header writing unit 302 , and a list modification unit 303 .

The coding unit 301 generates the compressed non-base-view component 212 by coding the non-base-view image 211 using a reference picture list. Specifically, when the non-base-view image 211 to be encoded is an image included in a randomly accessible picture, the encoding unit 301 uses the reference picture list corrected by the list correcting unit 303 to read from the storage unit 120 . A reference image 213 is displayed. In addition, a picture that can be randomly accessed is, for example, an anchor picture.

When inter-view reference is performed when encoding an anchor picture, the reference image 213 read from the storage unit 120 is a reconstructed image of the base view included in the same access unit. Then, the encoding unit 301 generates a predicted image using the reference image 213 , and encodes a difference between the generated predicted image and the non-base-view image 211 .

When the non-base-view image 211 is an image included in a randomly accessible picture, the header writing unit 302 writes correction syntax for changing the reference picture list in the slice header. The modification syntax is, for example, the reference list MVC modification syntax, which is ref_pic_list_mvc_modifications() shown in FIG. 1 . A specific example of the modified syntax written by the header writing unit 302 will be described later.

In addition, the reference picture list is a list showing the correspondence relationship between reference indexes and reference pictures. As shown in FIG. 2 , the reference picture list establishes corresponding representations of intra-view reference pictures, inter-view reference pictures and multiple reference indexes.

Furthermore, the header writing unit 302 writes anchor_pic_flag in the NAL unit header. Specifically, when the non-base-view image 211 is an image included in an anchor picture, the header writing unit 302 sets a value indicating that it is an anchor picture (specifically, 1) in anchor_pic_flag, and sets The specified anchor_pic_flag is written into the NAL unit header. In addition, a specific example of anchor_pic_flag will be described later.

The list modification unit 303 is an example of an arrangement unit according to the present invention, and modifies the reference picture list so that the inter-view reference picture is placed at the head of the reference picture list. That is, the list modification unit 303 changes the correspondence relationship between the reference index and the reference picture. Specifically, the reference picture list is changed so that the reference index [0] indicates an inter-view reference picture.

For example, as shown in FIG. 6 , the list modification unit 303 modifies the reference picture list so that the inter-view reference picture E associated with the reference index [4] is associated with the reference index [0]. Accordingly, when the non-base-view image 211 is an image included in an anchor picture, it is possible to reduce the amount of code required to encode the reference index.

For example, when the non-base-view image 211 included in the view unit 20 in FIG. 2 is an image included in an anchor picture, only images in the same access unit are reference images. That is, when encoding the non-base-view image 211 , the inter-view reference picture E is referred to instead of the reference pictures A to D.

Therefore, a frequently used reference index is reference index [0], which can be represented by 1 bit in the example shown in FIG. 3 . Before the correction of the reference picture, the reference index indicating the inter-view reference picture E is the reference index [4], which requires 5 bits, so the amount of coding required for coding the reference index can be reduced.

With the above configuration, the encoding device 100 according to the present invention arranges the inter-view reference picture at the head of the reference picture list when encoding a randomly accessible picture. As a result, the reference index of the frequently used inter-view reference picture has a small value, and it is possible to reduce the amount of codes required for encoding the reference index, that is, the bits representing the reference index, thereby improving encoding efficiency.

Hereinafter, an example of a stream structure generated by encoding the non-base-view component of the anchor access unit according to Embodiment 1 of the present invention will be described. In addition, the positions of the non-base-view components of the access unit are as shown in FIG. 1 .

FIG. 7A is a diagram showing an example of a stream structure of a P slice encoding a non-base-view component of an anchor access unit.

As shown in FIG. 7A , anchor_pic_flag is written in the NAL unit header. The anchor_pic_flag is a flag used to determine whether the image to which the anchor_pic_flag is assigned is an image included in an anchor picture.

Specifically, a value of anchor_pic_flag of 1 indicates that all slices constituting a picture are coded with reference only to slices in the same access unit, that is, no inter-prediction (time direction) is used. In addition, the anchor_pic_flag value of 1 indicates that the coded picture following the display order does not refer to a picture preceding the coded picture in the decoding order.

That is, pictures to which the anchor_pic_flag is set to have a value of 1 can be randomly accessed. Conversely, an anchor_pic_flag assigned a value of 0 cannot be randomly accessed. Therefore, for example, anchor_pic_flag is set to 1 in all NAL units of the anchor picture.

Furthermore, as shown in FIG. 7A , ref_pic_list_modification_flag_10, modification_of_pic_nums_idc, and abs_diff_view_idx_minus1 are written in the slice header. These three parameters correspond to ref_pic_list_mvc_modifications() shown in FIG. 1 , that is, the reference list MVC modification syntax.

ref_pic_list_modification_flag_10 is a parameter indicating whether to modify the reference picture list. Specifically, a value of 1 in ref_pic_list_modification_flag_10 indicates that the first reference picture list (list 0) is modified, and a value of ref_pic_list_modification_flag_10 indicates that the first reference picture list (list 0) is not modified.

In addition, the first reference picture list is, for example, a list indicating reference pictures referred to by the P picture. Alternatively, the first reference picture list is, for example, a list indicating reference pictures in one direction (for example, forward) among the reference pictures referred to by the B picture.

modification_of_pic_nums_idc is used together with other parameters such as abs_diff_view_idx_minus1, and is a parameter indicating the modification method of the reference picture list. For example, a value of modification_of_pic_nums_idc of 5 indicates that the value of abs_diff_view_idx_minus1 corresponds to the value added to the predicted value of the inter-view reference syntax. In addition, the value of modification_of_pic_nums_idc being 3 indicates that the modification process of the reference picture list has been completed.

abs_diff_view_idx_minus1 indicates a value regarding the inter-view reference index. Specifically, when the value of modification_of_pic_nums_idc is 5, the value of abs_diff_view_idx_minus1 corresponds to the difference added to the predicted value of the inter-view reference index. Therefore, when the value of abs_diff_view_idx_minus1 is 0, the inter-view reference index is [0], and the inter-view reference picture is arranged at the head of the reference list.

7B is a diagram showing an example of a stream structure of a coded B slice of a non-base-view component of an anchor access unit. Compared to the case of encoding a P slice shown in FIG. 7A , ref_pic_list_modification_l1, modification_of_pic_nums_idc, and abs_diff_view_idx_minus1 are also written in the slice header.

ref_pic_list_modification_l1 is a parameter indicating whether to modify the reference picture list. Specifically, a value of 1 in ref_pic_list_modification_flag_l1 indicates that the second reference picture list (list 1) is modified, and a value of ref_pic_list_modification_flag_l1 is 0 indicates that the second reference picture list (list 0) is not modified. In addition, the second reference picture list is, for example, a list indicating reference pictures in one direction (for example, backward) among the reference pictures referred to by the B picture.

Modification_of_pic_nums_idc and abs_diff_view_idx_minus1 are the same as those shown in FIG. 7A , so description thereof will be omitted.

Hereinafter, the operation of the encoding device 100 according to Embodiment 1 of the present invention will be described.

8 is a flowchart showing an example of encoding processing of an anchor access unit non-base-view element according to Embodiment 1 of the present invention.

As shown in FIG. 8 , first, the header writing unit 302 sets the value of the anchor_pic_flag parameter to 1 ( S101 ). Next, the header writing unit 302 writes the anchor_pic_flag parameter into the NAL unit header of the slice ( S102 ).

Next, the header writing unit 302 writes the reference list MVC correction syntax into the slice header (S103). Next, the list modification unit 303 puts the inter-view reference picture at the head of the reference picture list ( S104 ). An inter-view reference picture is, for example, a base view component of an anchor access unit.

Finally, the encoding unit 301 encodes the non-base-view component using the inter-view reference picture ( S105 ).

As described above, encoding device 100 according to Embodiment 1 of the present invention corrects the reference picture list so that inter-view reference pictures are arranged in a case where the picture to be encoded is a picture included in a random-accessible picture such as an anchor picture. to the beginning of the reference list. Hereinafter, a specific writing process (S103) of the reference list MVC correction syntax will be described.

9 is a flowchart showing an example of the process of writing the reference list MVC modification syntax when encoding the non-base-view component of the anchor access unit according to Embodiment 1 of the present invention.

As shown in FIG. 9 , first, the header writing unit 302 sets the value of the parameter ref_pic_list_modification_flag_10 to 1 ( S201 ). Next, the header writing unit 302 writes the ref_pic_list_modification_flag_10 parameter into the slice header (S202). In this way, the header writing unit 302 writes a value indicating correction of the reference picture list (first reference picture list) in the slice header.

Next, the header writing unit 302 sets the value of the first modification_of_pic_nums_idc parameter to 5 (S203). Then, the header writing unit 302 writes the first modification_of_pic_nums_idc parameter in a position following the ref_pic_list_modification_flag_10 parameter of the slice header (S204).

Next, the header writing unit 302 sets the value of the abs_diff_view_idx_minus1 parameter to 0 (S205). Next, the header writing unit 302 writes the abs_diff_view_idx_minus1 parameter in a position subsequent to the first modification_of_pic_nums_idc parameter of the slice header ( S206 ). In this way, the header writing unit 302 writes, into the slice header, a value indicating that the inter-view reference picture is arranged at the head of the reference list.

Next, the header writing unit 302 sets the value of the second modification_of_pic_nums_idc parameter to 3 (S207). Next, the header writing unit 302 writes the second modification_of_pic_nums_idc parameter in the slice header at a position subsequent to the first abs_diff_view_idx_minus1 parameter of the slice header ( S208 ). In this way, the header writing unit 302 writes a value indicating that the correction process of the reference picture list has been completed in the slice header.

However, there are cases where the value 3 of the second modification_of_pic_nums_idc is not written immediately after the abs_diff_view_idx_minus1 parameter in the slice header, but is written at least once in a position before the ref_pic_list_modification_flag_l1 parameter, or at the end of the reference list MVC modification syntax. in the parameter position.

Here, it is judged whether the segment type is a B segment (S209). This determination is performed, for example, by the encoding unit 301 or a control unit (not shown in FIGS. 4 and 5 ).

When the segment type is a P segment ("No" in S209), the writing process of the reference list MVC correction syntax ends.

When the slice type is a B slice (YES in S209 ), the header writing unit 302 writes a new parameter after the value 3 of the second modification_of_pic_nums_idc parameter in the slice header. Specifically, first, the header writing unit 302 sets the value of the ref_pic_list_modification_flag_l1 parameter to 1 (S210). Next, the header writing unit 302 writes ref_pic_list_modification_flag_11 into the slice header (S211). In this way, the header writing unit 302 writes a value indicating the correction of the second reference picture list into the slice header.

Next, the header writing unit 302 sets the value of the new modification_of_pic_nums_idc parameter to 5 (S212), and writes it in a position subsequent to the ref_pic_list_modification_flag_l1 parameter of the slice header (S213). Furthermore, the header writing unit 302 sets the value of the new abs_diff_view_idx_minus1 parameter to 0 (S214), and writes it in a position subsequent to the modification_of_pic_nums_idc parameter of the slice header (S215). In this way, the header writing unit 302 writes, into the slice header, a value indicating that the inter-view reference picture is arranged at the head of the reference list.

Finally, the header writing unit 302 sets the value of the last modification_of_pic_nums_idc parameter to 3 (S216), and writes it in the last parameter position of the reference list MVC modification syntax (S217).

As described above, encoding device 100 according to Embodiment 1 of the present invention writes, in the slice header, the syntax indicating to place an inter-view reference picture at the head of the reference picture list when encoding a randomly accessible picture such as an anchor picture. Furthermore, when encoding an image included in a non-base-view anchor picture, the coding apparatus 100 modifies the reference picture list so that the inter-view reference picture is placed at the head of the reference picture list, and the non-base-view reference picture list is modified according to the modified reference picture list. Image encoding of viewpoints.

This makes it possible to reduce the value of the reference index of the frequently used inter-view reference picture, and reduce the amount of code required to encode the reference index. Also, since the slice header of the coded stream includes syntax indicating to modify the reference picture list, the coded stream can be properly decoded on the decoding device side.

In addition, in the above-mentioned embodiment, an example was shown in which an anchor access unit is composed of two view components, a base-view component and a non-base-view component. However, as shown in FIG. 1 , an anchor access unit may include a plurality of non-base-view components. .

In this case, the list modification unit 303 modifies the reference picture list so that the reference indices representing the plurality of inter-view reference pictures are smaller than the reference index values representing the intra-view reference pictures. For example, when one non-base-view element (first non-base-view element) refers to multiple view elements (base-view element and second base-view element), for example, the list modification unit 303 modifies the reference picture list so that Reference index [0] indicates a base-view component, and reference index [1] indicates a second non-base-view component.

(Embodiment 2)

The error detection method according to Embodiment 2 of the present invention is an error detection method for detecting an error in a random-accessible picture coded by inter-frame reference, and is characterized in that it includes: A value in which no error has occurred in is set to a predetermined error detection flag; in the judging step, the parameters included in the correction syntax for correcting the reference picture list to arrange the inter-view reference picture at the beginning are read from the slice header, It is judged whether an error has occurred in the read parameter; and in the setting step, when it is judged that an error has occurred, a value indicating that an error has occurred is set in the error detection flag.

Furthermore, the decoding method according to Embodiment 2 of the present invention is a decoding method for decoding a random-accessible picture coded by using inter-view reference, and is characterized in that it includes an analysis step of segmenting a random-accessible picture Header analysis, judging whether the reference picture list has been corrected to arrange the inter-view reference picture at the beginning; the prediction step, if it is judged that the reference picture list has been corrected, generate a predicted image according to the preset specification, and if it is judged that there is no correction In the case of referring to the picture list, a predictive image is generated in a method different from the above specification; in the decoding step, a target segment of a randomly accessible picture is decoded based on the predictive image.

First, an example of a decoding device implementing the error detection method and the decoding method according to Embodiment 2 of the present invention will be described.

FIG. 10 is a block diagram showing an example of the configuration of a decoding device 400 according to Embodiment 2 of the present invention. The decoding device 400 is a device that decodes an encoded stream (MVC bit stream 501 ) generated by encoding images of a plurality of viewpoints, and has a function of detecting errors in the bit stream. As shown in FIG. 10 , the decoding device 400 includes an error detection unit 410 , a switching unit 420 , an MVC decoder unit 430 , a storage unit 440 , and an error concealment unit 450 .

The error detection unit 410 is an example of a processing unit that implements the error detection method according to Embodiment 2 of the present invention. The error detection unit 410 is an encoded picture included in the MVC bitstream 501 , and detects an error in a randomly accessible picture encoded by inter-view reference. For example, the error detection unit 410 determines whether an error has occurred in the compressed non-base-view component included in the anchor unit.

When an error is detected, the error detection unit 410 sets a value indicating that an error has occurred to a preset error detection flag 502 , and outputs the set error detection flag 502 to the switching unit 420 . In the example shown in FIG. 10 , the error detection flag 502 is detected_error_flag, and 1 is set in detected_error_flag when an error is detected. When no error is detected, for example, in the initial state, detected_error_flag is set to 0. Note that the detailed configuration of the error detection unit 410 will be described later.

The switching unit 420 switches between the MVC decoder unit 430 and the error concealment unit 450 to output the MVC bit stream 501 according to the error detection flag 502 . Specifically, the switching unit 420 outputs the MVC bit stream 501 to the error concealment unit 450 when the error detection flag 502 indicates that an error has occurred. For example, when the value of detected_error_flag is 1, the switch unit 420 outputs the MVC bit stream 501 to the error concealment unit 450 .

Furthermore, the switching unit 420 outputs the MVC bit stream 501 to the MVC decoder unit 430 when the error detection flag 502 indicates that no error has occurred. For example, when the value of detected_error_flag is 0, the switching unit 420 outputs the MVC bit stream 501 to the MVC decoder unit 430 .

The MVC decoder unit 430 is an example of a processing unit implementing the decoding method according to Embodiment 2 of the present invention, and decodes the MVC bit stream 501 . Specifically, the MVC decoder unit 430 reads the reference picture 503 from the storage unit 440, generates a predicted picture using the read reference picture 503, and uses the generated predicted picture to convert the random-accessible pictures included in the MVC bit stream 501 to decoding. The reconstructed image 504 generated by decoding is output to the outside and stored in the storage unit 440 . Note that the detailed configuration of the MVC decoder unit 430 will be described later.

The storage unit 440 is a memory for storing the reconstructed image 504 . In addition, the storage unit 440 may store only images that may be referred to in subsequent processing among the reconstructed images 504 generated by the MVC decoder unit 430 .

The error concealment unit 450 performs error concealment processing for concealing errors occurring in the compression of non-base-view components. For example, the error hiding unit 450 reads the reconstructed base-view component 505 included in the same access unit as the non-base-view component in which the error occurred, from the storage unit 440 , and stores the read reconstructed base-view component 505 is output as a reconstructed image 506 of the non-base-view component.

In addition, the error concealment process performed by the error concealment unit 450 is not limited to this, and an error concealed image may be generated by performing motion prediction and motion compensation processing using another image, and the generated error concealed image may be output as the reconstructed image 506. .

Here, the operation of the processing unit of the decoding device 400 shown in FIG. 10 will be briefly described according to the data flow. First, the MVC bit stream 501 is read by the error detection unit 410 , and a detected_error_flag parameter which is an example of the error detection flag 502 is output.

The switch unit 420 reads the detected_error_flag parameter from the error detection unit 410 , and if the value of detected_error_flag is 0, outputs the coded view element included in the MVC bit stream 501 to the MVC decoder unit 430 . The MVC decoder unit 430 reads the coded viewpoint unit, reads the reference image 503 from the storage unit 440 , and outputs the reconstructed image 504 . In addition, the reconstructed image 504 is then saved in the storage section 440 .

When the value of detected_error_flag is 1, the switching unit 420 sends the non-base-view component included in the MVC bitstream 501 to the error concealment unit 450 . The error concealment unit 450 reads the reconstructed base-view element 505 and the encoded non-base-view element, and outputs the error-concealed image as the reconstructed image 506 . The error concealment method used by the error concealment unit 450 includes, for example, a method of copying the reconstructed base view and outputting it as a non-base view.

Next, the configuration of the error detection unit 410 that implements the error detection method according to Embodiment 2 of the present invention will be described with reference to FIG. 11 . In addition, FIG. 11 is a block diagram showing an example of the configuration of the error detection unit 410 according to Embodiment 2 of the present invention.

As shown in FIG. 11 , the error detection unit 410 includes a parameter determination unit 601 and an error flag setting unit 602 .

The parameter judgment unit 601 reads at least one parameter included in the correction syntax for modifying the reference picture list from the slice header, and judges whether or not an error has occurred in the read parameter. Specifically, the parameter determination unit 601 performs at least one of the following three first to third determination processes.

The first determination process reads ref_pic_list_modification_flag_10 from the slice header as a parameter, and determines whether the read ref_pic_list_modification_flag_10 is a value (for example, 1) indicating that the reference picture list is modified. In the first determination process, it is determined that an error has occurred when ref_pic_list_modification_flag_10 is not a value (for example, 1) indicating that the reference picture list is modified.

The second determination process reads modification_of_pic_nums_idc from the slice header as a parameter, and determines whether the read modification_of_pic_nums_idc is a value indicating that abs_diff_view_idx_minus1 corresponds to a value added to the predicted value of the inter-view reference index (for example, 5). In the second determination process, it is determined that an error has occurred when the modification_of_pic_nums_idc is not a value indicating that abs_diff_view_idx_minus1 corresponds to a value added to the predicted value of the inter-view reference index (for example, 5).

The third judging process reads abs_diff_view_idx_minus1 from the slice header as a parameter, and judges whether or not the read value of abs_diff_view_idx_minus1 is 0. In the third determination process, it is determined that an error has occurred when abs_diff_view_idx_minus1 is not 0.

In addition, as shown in FIGS. 7A and 7B , in the slice header, ref_pic_list_modification_flag_10 , modification_of_pic_nums_idc , and abs_diff_view_idx_minus1 are successively written in this order. Therefore, the parameter determination unit 601 specifically performs the first to third determination processes in order until it is determined that an error has occurred by any one of the first to third determination processes.

The error flag setting unit 602 first sets a value indicating that no error has occurred in a randomly accessible picture in detected_error_flag as an initialization process of the error detection flag. Furthermore, the error flag setting unit 602 sets a value (for example, 1) indicating that an error has occurred in a randomly accessible picture in detected_error_flag when the parameter determining unit 601 determines that an error has occurred.

Next, an example of the operation of the error detection unit 410 that implements the error detection method according to Embodiment 2 of the present invention will be described with reference to FIG. 12 . 12 is a flowchart showing an example of a process of detecting an error in an anchor access unit non-base-view component according to Embodiment 2 of the present invention.

First, the error flag setting unit 602 initializes the detected_error_flag parameter by setting the detected_error_flag parameter to a value of 0 (S301). Use this parameter to indicate whether there are no errors in non-base view components. That is, as described above, when the value of this parameter is 1, the non-base-view component contains some kind of error. The other cases, that is, the case where the value of the detected_error_flag parameter is 0, mean that there is no error in the non-basic view component.

Next, the parameter judgment unit 601 reads the anchor_pic_flag parameter from the NAL unit header (S302). Then, the parameter judgment unit 601 judges whether or not the read anchor_pic_flag parameter is 1 (S303). That is, the parameter determination unit 601 determines whether or not the non-base-view component is an anchor picture.

Regarding the non-base-view component of the anchor access unit, when the value of this parameter is not 1 ("No" in S303), that is, when the non-base-view component is not an anchor picture, the error flag setting unit 602 sets detected_error_flag to The value is set to 1 (S310).

Regarding the non-base-view component of the anchor access unit, when the value of the anchor_pic_flag parameter is 1 (YES in S303), that is, when the non-base-view component is an anchor picture, the parameter judgment unit 601 reads Take ref_pic_list_modification_flag_10 (S304). The position of the ref_pic_list_modification_flag_10 parameter is as shown in FIGS. 7A and 7B .

Next, the parameter judgment unit 601 judges whether or not the read parameter value of ref_pic_list_modification_flag_10 is 1 (S304). That is, the parameter determination unit 601 determines whether to modify the reference picture list for the non-base-view component of the anchor access unit.

When the value of the parameter ref_pic_list_modification_flag_10 is not 1 (NO in S305 ), that is, when the parameter picture list is not modified, the error flag setting unit 602 sets the value of the parameter detected_error_flag to 1 ( S310 ).

When the value of the ref_pic_list_modification_flag_10 parameter is 1 (YES in S305), that is, when the reference picture list is modified, the parameter determination unit 601 reads the modification_of_pic_nums_idc parameter from the slice header (S306). The position of the modification_of_pic_nums_idc parameter is as shown in FIGS. 7A and 7B .

Next, the parameter judgment unit 601 judges whether or not the value of the read modification_of_pic_nums_idc parameter is 5 (S307). That is, the parameter judgment unit 601 judges whether or not the modification_of_pic_nums_idc parameter is a value indicating that abs_diff_view_idx_minus1 corresponds to a value added to the predicted value of the inter-view reference index.

When the value of the modification_of_pic_nums_idc parameter is not 5 ("No" in S307), that is, when the modification_of_pic_nums_idc parameter is not a value indicating that abs_diff_view_idx_minus1 corresponds to the value added to the predicted value of the inter-view reference index, the error flag setting unit 602 Set the value of the detected_error_flag parameter to 1 (S310).

When the value of the modification_of_pic_nums_idc parameter is 5 (YES in S307), that is, when the modification_of_pic_nums_idc parameter is a value indicating that abs_diff_view_idx_minus1 corresponds to a value added to the predicted value of the inter-view reference index, the parameter determination unit 601 selects The abs_diff_view_idx_minus1 parameter is read in the segment header (S308). In addition, in the slice header, the parameters of ref_pic_list_modification_flag_10, modification_of_pic_nums_idc, and abs_diff_view_idx_minus1 are consecutive sequentially as shown in FIGS. 7A and 7B .

And finally, the parameter judgment unit 601 judges whether or not the value of the abs_diff_view_idx_minus1 parameter is 0 (S309).

When the value of the abs_diff_view_idx_minus1 parameter is not 0 (NO in S309 ), the error flag setting unit 602 sets the value of the detected_error_flag parameter to 1 ( S310 ). When the value of the abs_diff_view_idx_minus1 parameter is 0 (YES in S309 ), the error flag setting unit 602 keeps the value of the detected_error_flag parameter at 0 and outputs it to the switching unit 420 .

As described above, the error detection unit 410 according to Embodiment 2 of the present invention can determine whether a random-accessible picture encoded by correcting the reference picture list so that the inter-view reference picture is placed at the head of the reference picture list is correctly encoded.

Next, the configuration of the MVC decoder unit 430 that implements the decoding method according to Embodiment 2 of the present invention will be described.

FIG. 13 is a block diagram showing an example of the configuration of the MVC decoder unit 430 according to Embodiment 2 of the present invention. The MVC decoder unit 430 includes an analysis unit 710 , a prediction unit 720 , and a decoding unit 730 .

The analysis unit 710 analyzes the slice header to determine whether the reference picture list has been corrected. Specifically, the analysis unit 710 determines whether the reference picture list is corrected when the decoding target picture is a picture included in a randomly accessible picture and included in a non-base-view component.

The prediction unit 720 generates a predicted image according to a preset specification when it is determined by the analysis unit 710 that the reference picture list has been corrected. For example, when the prediction unit 720 determines that the reference picture list has been modified, it generates a predicted image based on the H.264/AVC MVC video standard.

Furthermore, when the analysis unit 710 determines that the reference picture list has not been corrected, the prediction unit 720 generates a predicted image in a method different from the above-mentioned standard. For example, the prediction unit 720 generates a predicted image using, as a reference image, a base-view component included in the same access unit as a picture to be decoded that is not a base-view component.

The decoding unit 730 decodes an image of a randomly accessible picture included in the non-base-view component based on the predicted image generated by the predicting unit 720 .

A more detailed configuration of the MVC decoder unit 430 will be described below.

FIG. 14 is a block diagram showing an example of a detailed configuration of the MVC decoder unit 430 according to Embodiment 2 of the present invention. As shown in FIG. 14 , the MVC decoder unit 430 includes an analysis unit 710 , a prediction unit 720 , a decoding unit 730 , and a storage unit 740 .

As shown in FIG. 14 , the analysis unit 710 includes a ref_pic_list_modification_flag_10 parameter analysis unit 711 . Furthermore, the prediction unit 720 includes a switching unit 721 , a reference list modification syntax analysis unit 722 , a reference list modification unit 723 , a first motion prediction unit 724 , a base view search unit 725 , and a second motion prediction unit 726 . Furthermore, the decoding unit 730 includes a picture reconstruction unit 731 .

The ref_pic_list_modification_flag_10 parameter analysis unit 711 reads the slice header of the non-base-view element 801 of the anchor access unit, and outputs the value of the ref_pic_list_modification_flag_10 parameter 802 to the switching unit 721 .

When the value of the ref_pic_list_modification_flag_10 parameter is 1, the switching unit 721 transfers the non-base-view component 801 to the reference list modification syntax analysis unit 722 . Also, when the value of the ref_pic_list_modification_flag_10 parameter is 0, the switch unit 721 transfers the non-base-view component 801 to the base-view search unit 725 .

The reference list modification syntax analysis unit 722 reads the slice header of the non-base-view component 801 , and outputs the reference list modification syntax 803 to the reference list modification unit 723 .

The reference list modification unit 723 reads the reference list modification syntax 803 , modifies the reference picture list based on the read reference list modification syntax 803 , and outputs the modified reference picture list 804 to the first motion prediction unit 724 .

The first motion prediction unit 724 uses the corrected reference picture list for motion prediction, and outputs it as a predicted image 805 to the picture reconstruction unit 731 .

The base-view search unit 725 finds the corresponding base-view unit 806 from the storage unit 740 , and outputs the found base-view unit 806 to the second motion prediction unit 726 .

The second motion prediction unit 726 uses the searched base-view component 806 for motion prediction, and outputs the predicted image 807 to the picture reconstruction unit 731 .

The picture reconstruction unit 731 reads the predicted image 805 or 807 , reconstructs a non-base-view reconstructed image, and outputs the reconstructed non-base-view reconstructed image.

With the above configuration, decoding device 400 according to Embodiment 2 of the present invention can correctly decode a random-accessible picture coded by modifying the reference picture list so that an inter-view reference picture is arranged at the head of the reference picture list.

Next, the operation of the decoding device 400 according to Embodiment 2 of the present invention will be described.

15 is a flowchart showing an example of a process of decoding an anchor access unit non-base-view component according to Embodiment 2 of the present invention.

First, the analysis unit 710 reads the ref_pic_list_modification_flag_10 parameter from the slice header (S401). Then, the analysis unit 710 judges whether or not the value of the ref_pic_list_modification_flag_10 parameter is 0 (S402). That is, the analysis unit 710 determines whether the reference picture list has been corrected for the non-base-view component of the anchor access unit.

When the value of the ref_pic_list_modification_flag_10 parameter is 0 (YES in S402 ), that is, when the reference picture list has not been modified, the base-view detection unit 725 searches for the corresponding base-view of the anchor picture stored in the storage unit 740 components (S403). The corresponding base view component of the anchor picture has the same picture sequence number as the non-base view component in the decoding process. That is, they are base view components included in the same access unit.

Next, the second motion prediction unit 726 performs motion prediction using the searched base-view component (S404). In coded non-base-view components, a reference index for identifying which reference picture in the reference list should be used for motion prediction may be added to the macroblock header. However, the second motion prediction unit 726 does not refer to these reference indexes, but selects the base-view component (base-view image) found by searching as a reference picture used for motion prediction.

Also, when the value of the ref_pic_list_modification_flag_10 parameter is not 0 (NO in S402), that is, when the reference picture list has been modified, the reference list modification syntax analyzer 722 reads the reference list modification syntax from the slice header (S405 ). Then, the reference list modification unit 723 modifies the syntax modification reference list based on the read reference list ( S406 ). Specifically, as shown in FIG. 6 , the reference picture list is modified so that the inter-view reference picture is arranged at the head of the reference picture list. Next, the first motion prediction unit 724 performs motion prediction using the corrected reference list (S407).

Finally, after performing motion prediction, the picture reconstruction unit 731 reconstructs a non-base-view reconstructed image (S408).

As described above, the decoding device 400 according to Embodiment 2 of the present invention judges that the coded anchor picture included in the coded stream indicates the Correct if an error occurred in the syntax of the reference image list. Furthermore, the decoding device 400 modifies the reference picture list based on the syntax read from the coded stream, and uses the corrected reference picture list to decode a randomly accessible picture encoded based on the corrected reference picture list, for example, a coded anchor picture.

This makes it possible to detect an error in a randomly accessible picture encoded using the corrected reference picture list, and to correctly decode the picture.

In addition, the decoding device 400 according to Embodiment 2 of the present invention does not need to include the error detection unit 410 . Specifically, even if the decoding device according to the present invention includes only the MVC decoder unit 430 , it can refer to the corrected reference picture list and decode encoded random-accessible pictures.

In addition, the error detection unit 410 according to Embodiment 2 of the present invention may not be provided in the decoding device 400 . It may also be implemented as an error detection device independent of the encoding device and the decoding device. In addition, in order to confirm that encoding is performed correctly, the encoding device may include an error detection unit 410 .

Also, as a modified example of the decoding device and decoding method according to the present invention, when a picture to be decoded is a picture that can be randomly accessed, the same access unit as that of the picture to be decoded may be used regardless of the value of the reference index. The base view component of is used as the reference image.

FIG. 16 is a block diagram showing an example of the configuration of a decoding device 900 according to a modified example of the embodiment of the present invention. As shown in FIG. 16 , the decoding device 900 includes a determination unit 910 and a decoding unit 920 .

The judging unit 910 judges whether to perform random access. Specifically, the determination unit 901 determines whether or not an instruction to start random access has been received from the user, and determines that random access is to be performed when an instruction to start random access has been received. Alternatively, the determination unit 910 may determine whether or not the first base-view image at the start of decoding is an image included in an I picture. When the first base-view image is an image included in an I picture, the determination unit 910 determines that random access is to be performed.

When it is determined by the determination unit 910 that random access is to be performed, the decoding unit 920 decodes the non-base-view of the access unit including the first picture of the random access, irrespective of the reference index, and decodes the base-view of the same access unit. Components are used as reference pictures for decoding of non-base-view components. In addition, it is also possible to prohibit base-view components of access units different from the access unit including the first picture in random access from being used as reference images, and to use only the base-view component of the access unit including the first picture in random access as a reference image. Decoding of non-baseview components.

Hereinafter, the operation of the decoding device 900 according to the modified example of the embodiment of the present invention will be described using FIG. 17 . FIG. 17 is a flowchart showing an example of the operation of the decoding device 900 according to the modified example of the embodiment of the present invention.

First, the judging unit 910 judges whether to perform random access (S501). For example, the determination unit 910 determines whether or not an instruction to start random access has been received from the user, and determines to execute random access when an instruction to start random access has been received. In addition, the determination unit 910 may determine whether a base-view component referred to by an image to be decoded included in a non-base-view component is an I picture, and determine that random access is performed if the base-view component is an I picture.

Then, when it is determined that random access is performed (YES in S501 ), the decoding unit 920 ignores the reference index and decodes an image that is not a base-view component to be decoded using the base-view component as a reference picture ( S502 ).

When it is not determined that random access is performed ("No" in S501), an image to be decoded is decoded according to a preset standard, for example, the H.264/AVC MVC video standard (S503).

As described above, the decoding device 900 according to the modified example of the present invention includes a judging unit for judging whether to perform random access. Decoding of base view components. Thereby, regardless of the order in which the reference indexes are added on the encoding side, it is possible to decode a randomly accessible encoded image.

In addition, the decoding device according to the modified example of the present invention may include a decoding start picture specifying unit that specifies a decoding start picture, and when the base-view picture specified by the decoding start picture specifying unit is an I picture, it is determined that the random access is started. The judging unit, when it is judged by the judging unit that the random access is started, prohibits the reference of the base-view pictures of the random access unit other than the random access unit when decoding the non-base-view of the random access unit including the I picture, and only A decoding unit for decoding with reference to a base-view picture in a random access unit.

(Embodiment 3)

The processing shown in the above embodiments can be easily implemented in an independent computer system by recording a program for realizing the configuration of the image coding method or the image decoding method shown in the above embodiments in a storage medium. The storage medium may be a magnetic disk, an optical disk, a magneto-optical disk, an IC card, a semiconductor memory, etc., as long as it can record a program.

Furthermore, an application example of the image encoding method and image decoding method described in the above-mentioned embodiments and a system using the same will be described here.

FIG. 18 is a diagram showing an overall configuration of a content supply system ex100 for realizing a content distribution service. The area for providing communication services is divided into desired sizes, and base stations ex106 to ex110 serving as fixed wireless stations are installed in each cell.

The content supply system ex100 is connected to the Internet ex101 via the Internet service provider ex102, the telephone network ex104, and the base stations ex106 to ex110 to each of a computer ex111, a PDA (Personal Digital Assistant) ex112, a camera ex113, a mobile phone ex114, and a game machine ex115. equipment.

However, the content supply system ex100 is not limited to the configuration shown in FIG. 18, and some components may be combined and connected. In addition, each device may be directly connected to the telephone network ex104 without passing through the base stations ex106 to ex110 which are fixed wireless stations. In addition, the respective devices may be directly connected to each other via short-range wireless or the like.

The camera ex113 is a device capable of shooting motion pictures such as a digital video camera, and the camera ex116 is a device capable of shooting hard images or moving pictures such as a digital camera. In addition, the mobile phone ex114 is GSM (Global System for Mobile Communications) system, CDMA (Code Division Multiple Access) system, W-CDMA (Wideband-Code Division Multiple Access) system, or LTE (Long Term Evolution) system, HSPA (High Speed Packet Access) mobile phone or PHS (Personal Handyphone System), etc., whichever is acceptable.

In the content supply system ex100, by connecting the camera ex113 and the like to the streaming server ex103 via the base station ex109 and the telephone network ex104, on-site distribution and the like can be performed. In the on-site distribution, the content (for example, a video of a live concert, etc.) photographed by the user with the camera ex113 is encoded as described in the above-mentioned embodiment, and transmitted to the streaming server ex103. On the other hand, the streaming media server ex103 stream-distributes the sent content data to the requesting clients. As the client, there are computers ex111, PDA ex112, camera ex113, mobile phone ex114, game machine ex115, etc. capable of decoding the encoded data. In each device that has received the distributed data, the received data is decoded and reproduced.

In addition, the encoding process of the photographed data may be performed by the camera ex113, may be performed by the streaming server ex103 that transmits the data, or may be shared between them. Similarly, the decoding process of the distributed data can be performed by the client, or by the streaming media server ex103, or can be shared with each other. In addition, it is not limited to the camera ex113, and still image and/or moving image data captured by the camera ex116 may be transmitted to the streaming server ex103 via the computer ex111. In this case, the encoding process may be performed by any one of the camera ex116, the computer ex111, and the streaming server ex103, or may be shared among them.

In addition, these coding processing and decoding processing are generally processed in the computer ex111 and the LSI (Large Scale Integration) ex500 included in each device. LSIex500 can be either a single chip or a multi-chip structure. In addition, software for image encoding and image decoding may be loaded into a certain recording medium (CD-ROM, floppy disk, hard disk, etc.) that can be read by a computer ex111, etc., and the encoding process and decoding process may be performed using the software. . Furthermore, when the mobile phone ex114 is equipped with a camera, it is also possible to transmit video data acquired by the camera. The video data at this time is encoded by the LSI ex500 included in the mobile phone ex114.

In addition, the streaming server ex103 may be a plurality of servers or computers, and may have a structure in which data is processed in a distributed manner or records are distributed.

As described above, in the content supply system ex100, the client can receive encoded data and reproduce it. In this way, in the content supply system ex100, the client can receive, decode, and reproduce information sent by the user in real time, and even a user who does not have special rights or equipment can realize personal broadcasting.

For encoding and decoding of each device constituting the content supply system, the image encoding method or the image decoding method described in the above-mentioned embodiments may be used.

As an example, the mobile phone ex114 will be described.

FIG. 19 is a diagram showing a mobile phone ex114 using the image coding method and the image decoding method described in the above-mentioned embodiments. The mobile phone ex114 has an antenna ex601 for transmitting and receiving radio waves to and from the base station ex110, a camera unit ex603 capable of taking images such as CCD cameras and still images, and displays images captured by the camera unit ex603 and images received by the antenna ex601. A display unit ex602 such as a liquid crystal display for decoded data, a main unit composed of a group of operation keys ex604, a voice input unit ex608 such as a microphone for voice output, and a voice input unit ex605 such as a microphone for voice input , the recording medium ex607 for storing encoded data or decoded data such as captured moving image or still image data, received mail data, moving image data, or still image data, etc. The recording medium ex607 can be attached to the slot part ex606 of the mobile phone ex114. The recording medium ex607 has a structure in which a flash memory element such as an EEPROM, which is a type of electrically rewritable and erasable nonvolatile memory, is accommodated in a plastic case such as an SD card.

Furthermore, the mobile phone ex114 will be described using FIG. 20 . The mobile phone ex114 is connected to the main control unit ex711, which comprehensively controls each unit of the main unit including the display unit ex602 and the operation keys ex604, via the synchronous bus ex713, the power supply circuit unit ex710, the operation input control unit ex704, the image encoding unit ex712, and the camera interface unit ex703. , LCD (Liquid Crystal Display) control unit ex702, image decoding unit ex709, multiplexing and demultiplexing unit ex708, recording and reproducing unit ex707, modulation and demodulation circuit unit ex706, and sound processing unit ex705.

The power supply circuit unit ex710 activates the digital mobile phone with camera ex114 to an operable state by supplying power from the battery pack to each unit when the call end and the power key are turned on by the user's operation.

The mobile phone ex114 converts the audio signal collected by the audio input unit ex605 into digital audio data by the audio processing unit ex705 in the audio communication mode under the control of the main control unit ex711 composed of CPU, ROM, and RAM, and converts it into digital audio data by means of modulation The demodulation circuit unit ex706 performs spectrum diffusion processing, and the transmission and reception circuit unit ex701 performs digital-to-analog conversion processing and frequency conversion processing, and then transmits through the antenna ex601. In addition, when the cellular phone ex114 is in voice communication mode, it amplifies the reception data received by the antenna ex601, performs frequency conversion processing and analog-to-digital conversion processing, performs spectral inverse diffusion processing by the modulation and demodulation circuit part ex706, and converts the received data by the voice processing part ex705. After simulating the audio data, it is output via the audio output unit ex608.

Furthermore, when sending an e-mail in the data communication mode, the text data of the e-mail input by operating the operation keys ex604 of the main body is sent to the main control unit ex711 via the operation input control unit ex704. The main control unit ex711 performs spectrum diffusion processing on the text data by the modulation and demodulation circuit unit ex706, performs digital-to-analog conversion processing and frequency conversion processing by the transceiver circuit unit ex701, and transmits the text data to the base station ex110 through the antenna ex601.

When transmitting image data in the data communication mode, the image data captured by the camera unit ex603 is supplied to the image encoding unit ex712 via the camera interface unit ex703. In addition, when the image data is not transmitted, the image data captured by the camera unit ex603 may be directly displayed on the display unit ex602 via the camera interface unit ex703 and the LCD control unit ex702.

The image encoding unit ex712 is configured to include the image encoding device described in the present invention, and converts the image data supplied from the camera unit ex603 into a code by compression encoding using the encoding method used in the image encoding device described in the above-mentioned embodiment. The image data is sent to the demultiplexing unit ex708. At the same time, the mobile phone ex114 sends the audio collected by the audio input unit ex605 during imaging with the camera unit ex603 to the multiplexing and demultiplexing unit ex708 as digital audio data via the audio processing unit ex705.

The demultiplexing unit ex708 multiplexes the encoded image data supplied from the image encoding unit ex712 and the audio data supplied from the audio processing unit ex705 in a predetermined manner, and demodulates the resultant multiplexed data by modulation. The modulation circuit unit ex706 performs spectrum diffusion processing, and the transmission and reception circuit unit ex701 performs digital-to-analog conversion processing and frequency conversion processing, and then transmits through the antenna ex601.

In the data communication mode, when the data of the moving image file linked on the homepage etc. is received, the reception data received from the base station ex110 via the antenna ex601 is subjected to spectral inverse diffusion processing by the modem circuit part ex706, and the result is The obtained multiplexed data is sent to the demultiplexing unit ex708.

In addition, in order to decode the multiplexed data received via the antenna ex601, the demultiplexing unit ex708 separates the multiplexed data into a bit stream of image data and a bit stream of audio data, and transmits the multiplexed data via the synchronous bus ex713. The encoded image data is supplied to the image decoding unit ex709, and the audio data is supplied to the audio processing unit ex705.

Next, the image decoding unit ex709 is configured to include the image decoding device described in this application, and generates reproduced moving image data by decoding the bit stream of image data by a decoding method corresponding to the encoding method described in the above-mentioned embodiment, and converts it to The data is supplied to the display unit ex602 via the LCD control unit ex702, thereby displaying, for example, video data contained in a video file linked to a homepage. At the same time, the audio processing unit ex705 converts the audio data into analog audio data, and supplies the audio data to the audio output unit ex608, thereby reproducing audio data contained in, for example, a video file linked to a homepage.

In addition, it is not limited to the example of the above-mentioned system, and digital broadcasting of satellite and terrestrial waves has become the focus of attention recently, and as shown in FIG. . Specifically, the broadcasting station ex201 transmits audio data, video data, or a bit stream in which these data are multiplexed to the broadcasting satellite ex202 via radio wave communication or transmission. The broadcasting satellite ex202 receiving it transmits radio waves for broadcasting, and the antenna ex204 of a household equipped with a satellite broadcasting receiving device receives the radio waves, and devices such as a television (receiver) ex300 or a set-top box (STB) ex217 decode the bit stream and convert it reproduce. In addition, in the reader/recorder ex218 that reads and decodes a bit stream in which image data and audio data are multiplexed and recorded on recording media ex215 and ex216 such as CD and DVD, etc. The image decoding device described in the above-mentioned embodiment is installed. In this case, the reproduced video signal is displayed on the monitor ex219. In addition, a configuration in which an image decoding device is installed in a set-top box ex217 connected to a cable ex203 for cable TV or an antenna ex204 for satellite/terrestrial broadcasting and reproduced on a monitor ex219 of a TV may also be considered. In this case, the image decoding device may be incorporated in the television instead of the set-top box. In addition, a car ex210 having an antenna ex205 may receive a signal from a satellite ex202 or a base station, and reproduce a moving image on a display device such as a car navigation system ex211 included in the car ex210.

Also, when reading and decoding audio data, video data, or a coded bit stream in which these data are multiplexed, or encoding audio data, video data, or these data recorded on a recording medium ex215 such as DVD or BD, as The image decoding device or image encoding device shown in the above-mentioned embodiments can also be installed in the reader/recorder ex218 that records the multiplexed data on the recording medium ex215. In this case, the reproduced video signal is displayed on the monitor ex219. In addition, other devices and systems can reproduce video signals through the recording medium ex215 on which the coded bit stream is recorded. For example, another reproduction device ex212 can reproduce video signals on the monitor ex213 using the recording medium ex214 on which the coded bit stream is copied.

In addition, an image decoding device may be installed in a set-top box ex217 connected to a cable ex203 for cable TV or an antenna ex204 for satellite/terrestrial broadcasting to display it on a monitor ex219 of a TV. In this case, the image decoding device may be incorporated in the television instead of the set-top box.

FIG. 22 is a diagram showing a television (receiver) ex300 employing the image decoding method and image encoding method described in the above-mentioned embodiments. The television ex300 includes a tuner ex301 that acquires or outputs bit streams of movie information via the antenna ex204 and cable ex203 that receive the above-mentioned broadcast, and demodulates the received coded data, or converts the generated coded data for external transmission. A modulation/demodulation unit ex302 for modulation, and a multiplexing/demultiplexing unit ex303 for separating demodulated video data and audio data, or multiplexing coded video data and audio data. In addition, the television ex300 includes a signal processing unit ex306 including an audio signal processing unit ex304 for decoding audio data and video data or encoding each information, a video signal processing unit ex305, and a speaker for outputting decoded audio signals. ex307, an output unit ex309 of the display unit ex308 such as a display for displaying the decoded video signal. Furthermore, the television ex300 includes an interface unit ex317 including an operation input unit ex312 for accepting an input of a user operation. Furthermore, the television ex300 includes a control unit ex310 that comprehensively controls each unit, and a power supply circuit unit ex311 that supplies power to each unit. In addition to the operation input unit ex312, the interface unit ex317 may also include a bridge ex313 connected to an external device such as a reader/writer ex218, a slot unit ex314 for installing a recording medium ex216 such as an SD card, and a slot unit ex314 for connecting to an external device such as a reader/writer ex218. A drive ex315 connected to an external recording medium such as a hard disk, a modem ex316 connected to a telephone network, and the like. In addition, the recording medium ex216 is a medium in which information can be recorded electrically by a nonvolatile/volatile semiconductor memory element that is stored. Each part of the TV ex300 is connected to each other via a synchronous bus.

First, a configuration in which the television ex300 decodes and reproduces data acquired from the outside through the antenna ex204 and the like will be described. The television ex300 receives user operations from the remote controller ex220, etc., and separates the video data and audio data demodulated by the modulation/demodulation unit ex302 with the multiplexing/demultiplexing unit ex303 under the control of the control unit ex310 having a CPU or the like. . Furthermore, the television ex300 decodes the separated audio data by the audio signal processing unit ex304, and decodes the separated video data by the video signal processing unit ex305 using the decoding method described in the above embodiment. The decoded audio signal and video signal are respectively output from the output unit ex309 to the outside. At the time of output, these signals may be temporarily stored in buffers ex318, ex319, etc., so that audio signals and video signals may be reproduced synchronously. In addition, the television ex300 may read encoded encoded bit streams from recording media ex215 and ex216 such as magnetic/optical disks and SD cards instead of broadcasting. Next, a configuration in which the television ex300 encodes audio signals and video signals, transmits them to the outside, or writes them to a recording medium or the like will be described. The television ex300 receives user operations from the remote controller ex220, and based on the control of the control unit ex310, the audio signal processing unit ex304 encodes the audio signal, and the video signal processing unit ex305 encodes the video signal using the encoding method described in the above-mentioned embodiments. coding. The encoded audio signal and video signal are multiplexed by the multiplexing/demultiplexing unit ex303 and output to the outside. When multiplexing, these signals can be temporarily stored in buffers ex320, ex321, etc., so that audio signals and video signals can be synchronized. In addition, a plurality of buffers ex318 to ex321 may be provided as shown in the figure, or one or more buffers may be shared. Furthermore, data may be stored in a buffer between the modulation/demodulation unit ex302 and the multiplexing/demultiplexing unit ex303 and the like as a buffer mechanism for avoiding system overflow and underflow.

In addition, the television ex300 may include a configuration for receiving AV input from a microphone and a camera in addition to acquiring audio data and video data from broadcasting and recording media, and encode the data acquired from them. In addition, here, the television ex300 has been described as having a configuration capable of performing the encoding process, multiplexing, and external output described above, but it may be capable of performing only the reception, decoding process, and external output above without performing all of these processes. some kind of structure.

In addition, when the coded bit stream is read from or written into the recording medium by the reader/recorder ex218, the above-mentioned decoding process or encoding process may be performed by either the television ex300 or the reader/recorder ex218. Alternatively, the television ex300 and the reader/recorder ex218 may be shared.

As an example, FIG. 23 shows the configuration of the information reproducing/recording unit ex400 in the case of reading or writing data from an optical disc. The information reproducing/recording unit ex400 includes elements ex401 to ex407 described below. The optical head ex401 writes information by irradiating a laser spot on the recording surface of the recording medium ex215 which is an optical disc, and reads information by detecting reflected light from the recording surface of the recording medium ex215. The modulation recording unit ex402 electrically drives the semiconductor laser built in the optical head ex401, and modulates the laser light according to the recording data. The playback demodulator ex403 amplifies the playback signal of the reflected light from the recording surface electrically detected by the photodetector built in the optical head ex401, separates and demodulates the signal components recorded on the recording medium ex215, and reproduces necessary information. The buffer ex404 temporarily holds information to be recorded on the recording medium ex215 and information to be reproduced from the recording medium ex215. The disk motor ex405 rotates the recording medium ex215. The servo control unit ex406 moves the optical head ex401 to a predetermined information track while controlling the rotational drive of the disc motor ex405, and performs laser spot tracking processing. The system control unit ex407 controls the entire information reproduction/recording unit ex400. In the above-mentioned reading and writing process, the system control unit ex407 uses various information held in the buffer ex404, or generates and adds new information as needed, and makes the modulation recording unit ex402, reproduction demodulation unit ex403 It is realized by recording and reproducing information by the optical head ex401 while cooperating with the servo control unit ex406. The system control unit ex407 is composed of, for example, a microprocessor, and executes these processes by executing programs for reading and writing.

In the foregoing, the optical head ex401 has been described as irradiating a laser spot, but a configuration in which higher-density recording is performed using near-field light is also possible.

FIG. 24 shows a schematic diagram of a recording medium ex215 which is an optical disk. A guide groove (groove) is spirally formed on the recording surface of the recording medium ex215, and address information for identifying an absolute position on the disk is recorded in advance in the information track ex230 by changing the shape of the groove. This address information includes information for specifying the position of a recording block ex231 which is a unit of recording data, and a recording and reproducing device can specify a recording block by reproducing the information track ex230 and reading the address information. Furthermore, the recording medium ex215 includes a data recording area ex233, an inner peripheral area ex232, and an outer peripheral area ex234. The area used for recording user data is the data recording area ex233, and the inner peripheral area ex232 and the outer peripheral area ex234 arranged inside or outside the data recording area ex233 are used for specific purposes other than user data recording. The information reproducing/recording unit ex400 reads and writes encoded audio data, video data, or encoded data in which these data are multiplexed into the data recording area ex233 of the recording medium ex215.

In the above, optical discs such as DVD and BD having one layer have been exemplified, but they are not limited to these, and optical discs having a multi-layer structure and capable of recording on surfaces other than the surface may be used. In addition, it may be an optical disc with a multi-dimensional recording/reproduction structure, such as recording information using light of various wavelengths and colors at the same place on the disc, or recording layers of different information from various angles.

Furthermore, in the digital broadcasting system ex200, the car ex210 having the antenna ex205 may receive data from the satellite ex202 and the like, and reproduce video on a display device such as the car navigation system ex211 of the car ex210. In addition, the structure of the car navigation system ex211 can be considered as a structure in which a GPS receiving unit is added to the structure shown in FIG. In addition, the above-mentioned terminals such as the mobile phone ex114 can be considered as the same as the television ex300, in addition to a transmitting and receiving terminal having both an encoder and a decoder, there are also three types of a transmitting terminal with only an encoder and a receiving terminal with only a decoder. installation form.

In this way, the image encoding method or the image decoding method described in the above-mentioned embodiments may be used in any of the above-mentioned devices and systems, and by doing so, the effects described in the above-mentioned embodiments can be obtained.

In addition, this invention is not limited to the said embodiment, Various deformation|transformation and correction are possible without deviating from the range of this invention.

(Embodiment 4)

The image coding method and device, and the image decoding method and device described in each of the above embodiments are typically realized by an LSI that is an integrated circuit. As an example, FIG. 25 shows the configuration of a single-chip LSIex500. The LSI ex500 includes constituent elements ex501 to ex509 described below, and the respective constituent elements are connected via a bus ex510 . The power supply circuit unit ex505 is activated in an operable state by supplying electric power to each unit when the power is turned on.

For example, when encoding processing is performed, the LSI ex500 accepts input of AV signals from the microphone ex117 and the camera ex113 through the AV I/O ex509 under the control of the control unit ex501 including the CPU ex502, the memory controller ex503, the stream controller ex504, and the like. The input AV signal is temporarily stored in an external memory ex511 such as SDRAM. Based on the control of the control unit ex501, the stored data is appropriately divided into multiple times according to the processing capacity and processing speed, and sent to the signal processing unit ex507. The signal processing unit ex507 encodes audio signals and/or encodes video signals. Here, the encoding process of the video signal is the encoding process described in the above-mentioned embodiment. In the signal processing unit ex507, processing such as multiplexing coded audio data and coded video data is also performed depending on the situation, and is output from the stream I/O ex506 to the outside. The outputted bit stream is sent to the base station ex107 or written in the recording medium ex215. In addition, data may be temporarily stored in the buffer ex508 for synchronization during multiplexing.

Also, for example, when performing decoding processing, the LSI ex500 temporarily stores encoded data obtained from the stream I/O ex506 via the base station ex107 or encoded data read from the recording medium ex215 in the memory ex511 or the like based on the control of the control unit ex501. . Based on the control of the control unit ex501, the stored data is sent to the signal processing unit ex507 in multiple times as appropriate according to the processing capacity and processing speed. The signal processing unit ex507 decodes audio data and/or decodes video data. Here, the decoding processing of the video signal is the decoding processing described in the above-mentioned embodiment. Furthermore, depending on circumstances, each signal may be temporarily stored in the buffer ex508 or the like so that the decoded audio signal and the decoded video signal can be reproduced synchronously. The decoded output signal is output from output units such as the mobile phone ex114, the game machine ex115, and the television ex300 while appropriately passing through the memory ex511 and the like.

In addition, in the above description, the memory ex511 has been described as having a structure outside the LSI ex500, but it may be a structure included in the inside of the LSI ex500. The cache ex508 is not limited to one, and may also have multiple caches. In addition, LSIex500 can be made into one chip or multi-chip.

In addition, it is referred to as LSI here, but depending on the degree of integration, it may be called IC, system LSI, super LSI, or very large-scale LSI.

In addition, the method of circuit integration is not limited to LSI, and it may be realized by a dedicated circuit or a general-purpose processor. It is also possible to use an FPGA which can be programmed after the LSI is manufactured, or a reconfigurable processor which can reconfigure the connection and settings of circuit cells inside the LSI.

Furthermore, if an integrated circuit technology that replaces LSI appears due to progress in semiconductor technology or other derivative technologies, it is of course possible to use this technology to perform integration of functional blocks. It may be the application of biotechnology, etc.

The encoding method, encoding device, error detection method, error detection device, decoding method, and decoding device according to the present invention have been described above based on the embodiments, but the present invention is not limited to these embodiments. As long as they do not depart from the gist of the present invention, forms in which various modifications conceived by those skilled in the art are implemented in this embodiment, and other forms constructed by combining components and steps in different embodiments are also included in the present invention. within the scope of the invention.

Industrial Applicability

The present invention has the effect of reducing the amount of code required for encoding a reference index and improving encoding efficiency, and can be used in an encoding device that encodes audio, still images, and moving images, and a decoding device that decodes data encoded by the encoding device. adopted in. For example, the present invention can be employed in various AV equipment such as audio equipment, mobile phones, digital cameras, BD recorders, and digital televisions.

Symbol Description

10 access units

20 Viewpoint Components

100 encoding device

110 First View Component Coding Unit

120, 440, 740 Storage Department

130 2nd view component coding part

201 Image from base viewpoint

202 Compressed BaseView Components

203 Reconstructing the image

211 Images from non-base viewpoints

212 Compress non-baseview components

213, 503 reference images

301 Coding Department

302 header writing section

303 List Correction Division

400, 900 decoding device

410 Error detection section

420, 721 switching unit

430 MVC Decoder Section

450 error hiding part

501 MVC bitstream

502 error detection flag

504, 506 reconstructed image

505 refactored base view components

601 Parameter Judgment Unit

602 Error flag setting part

710 Analysis Department

711 ref_pic_list_modification_flag_l0 parameter analysis part

720 Forecasting Department

722 Reference list correction syntax analysis part

723 Reference List Correction Department

724 First Sports Prediction Department

725 Fundamental Viewpoint Search Department

726 Second Sports Prediction Department

730, 920 decoding part

731 Image Reconstruction Department

801 Non-baseview component

802 ref_pic_list_modification_flag_l0 parameter

803 Correct syntax with reference list

804 reference picture list

805, 807 predicted images

806 Base View Components

910 Judgment Department

ex100 content delivery system

ex101 Internet

ex102 Internet service provider

ex103 streaming media server

ex104 telephone network

ex106, ex107, ex108, ex109, ex110 base station

ex111 computer

ex112 PDA

ex113, ex116 cameras

ex114 Digital mobile phone with camera (mobile phone)

ex115 game console

ex117 microphone

ex200 system for digital broadcasting

ex201 Broadcasting Bureau

ex202 broadcast satellite (satellite)

ex203 cable

ex204, ex205, ex601 Antennas

ex210 car

ex211 car navigator (navigator)

ex212 reproduction device

ex213, ex219 monitor

ex214, ex215, ex216, ex607 recording media

ex217 Set Top Box (STB)

ex218 Reader/Recorder

ex220 remote control

ex230 information track

ex231 record block

ex232 inner peripheral area

ex233 data recording area

ex234 peripheral area

ex300 TV

ex301 tuner

ex302 modulation/demodulation section

ex303 Multiplexing/Splitting Section

ex304 Sound Signal Processing Section

ex305 Image Signal Processing Section

ex306, ex507 signal processing unit

ex307 speaker

ex308, ex602 display part

ex309 output part

ex310, ex501 control unit

ex311, ex505, ex710 power circuit part

ex312 Operation Input Section

ex313 bridge

ex314, ex606 slot part

ex315 drive

ex316 modem

ex317 interface part

ex318, ex319, ex320, ex321, ex404, ex508 cache

ex400 information reproduction/recording unit

ex401 bald head

ex402 modulation recording section

ex403 reproduction demodulation unit

ex405 disc motor

ex406 Servo Control Unit

ex407 System Control Department

ex500 LSI

ex502 CPU

ex503 memory controller

ex504 flow controller

ex506 Stream I/O

ex509 AV I/O

ex510 bus

ex511 memory

ex603 camera part

ex604 operation keys

ex605 sound input section

ex608 sound output section

ex701 transceiver circuit part

ex702 LCD control unit

ex703 Camera Interface Section (Camera I/F Section)

ex704 Operation input control section

ex705 Sound Processing Section

ex706 modem circuit part

ex707 Recording and reproduction unit

ex708 Multiplex Separator

ex709 image decoding part

ex711 main control unit

ex712 Image Coding Unit

ex713 synchronous bus

Claims (4)

1. An error detection method for detecting an error in a randomly accessible picture encoded by inter-view reference, characterized in that, include: The initialization step is to set the value indicating that no error occurs in the above-mentioned randomly accessible picture into detected_error_flag; The judging step is to read at least one parameter included in the correction syntax for modifying the reference picture list so that the inter-view reference picture is arranged at the beginning, from the slice header of the above random-accessible picture, and judge that the parameter in the read whether an error occurred in the parameters of the ; and Setting step, in the case of judging that the above-mentioned error has occurred, setting a value indicating that an error has occurred in the above-mentioned randomly accessible picture to the above-mentioned detected_error_flag; In the above-mentioned judging step, at least one of the following judging processes is performed: (i) The first judging process is to read ref_pic_list_modification_flag_l0 from the slice header as the parameter, and judge whether the read ref_pic_list_modification_flag_l0 is a value indicating that the above-mentioned reference picture list is modified, and if the above-mentioned ref_pic_list_modification_flag_l0 is not a value indicating that the above-mentioned reference picture list is modified. In the case of the corrected value, it is judged that an error has occurred; (ii) The second judgment process is to read the modification_of_pic_nums_idc from the slice header as the above parameter, judge whether the read modification_of_pic_nums_idc is a value indicating that abs_diff_view_idx_minus1 corresponds to the value added to the predicted value of the inter-view reference index, and convert the above modification_of_pic_nums_idc does not indicate that the above-mentioned abs_diff_view_idx_minus1 corresponds to the value added to the above-mentioned predicted value, and it is judged that an error has occurred; and (iii) The third determination process reads abs_diff_view_idx_minus1 from the segment header as the parameter, determines whether the value of the read abs_diff_view_idx_minus1 is 0, and determines that an error has occurred if the value of abs_diff_view_idx_minus1 is not 0. 2. error detection method as claimed in claim 1, is characterized in that, In the above-mentioned segment header, the above-mentioned ref_pic_list_modification_flag_l0, the above-mentioned modification_of_pic_nums_idc, and the above-mentioned abs_diff_view_idx_minus1 are successively written in sequence; In the above-mentioned judging step, the above-mentioned first judging process, the above-mentioned second judging process and the above-mentioned third judging process are sequentially carried out until a judgment is made in the above-mentioned first judging process, the above-mentioned second judging process and the above-mentioned third judging process. Processing judges that an error has occurred. 3. error detection method as claimed in claim 1, is characterized in that, The above random-accessible pictures are anchor pictures. 4. An error detection device for detecting an error in a random-accessible picture encoded by inter-view reference, characterized in that, have: The setting unit sets, in detected_error_flag, a value indicating that no error has occurred in the random-accessible picture; and The judging unit reads at least one parameter included in the correction syntax for modifying the reference picture list so that the inter-view reference picture is arranged at the beginning, from the slice header of the random-accessible picture, and judges that the read Whether an error has occurred in the parameters of ; When it is determined that the error has occurred, the setting unit sets, in the detected_error_flag, a value indicating that an error has occurred in the randomly accessible picture; The judging unit performs at least one of the following judging processes: (i) The first judgment process is to read ref_pic_list_modification_flag_10 from the slice header as the above parameter, and judge whether the read ref_pic_list_modification_flag_10 is a value indicating that the above reference picture list is modified, and if the above ref_pic_list_modification_flag_10 is not a value indicating that the above reference picture list is modified The value of is judged to be an error; (ii) The second judgment process is to read the modification_of_pic_nums_idc from the slice header as the above parameter, judge whether the read modification_of_pic_nums_idc is a value indicating that abs_diff_view_idx_minus1 corresponds to the value added to the predicted value of the inter-view reference index, and convert the above The modification_of_pic_nums_idc does not indicate that the above abs_diff_view_idx_minus1 corresponds to the value added to the above predicted value, and it is judged that an error has occurred; (iii) The third determination process reads abs_diff_view_idx_minus1 from the segment header as the parameter, determines whether the value of the read abs_diff_view_idx_minus1 is 0, and determines that an error has occurred if the value of abs_diff_view_idx_minus1 is not 0.