KR100922650B1 - Video information recording device and video information playback device - Google Patents

Abstract

The present invention allows to manage the security information of the AV signal appropriately. The thumbnail encoder 19 extracts the thumbnail image from the video information input from the terminal 12 and encodes it. When the content management information of the video information that is the basis of the thumbnail image input from the terminal 12 is copy once, the controller 21 controls the encryption unit 22 to encrypt the thumbnail image information, and the recording medium 26. To record. At this time, the information indicating that the encrypted thumbnail image is recorded is also recorded in the recording medium 26 as a file different from the thumbnail image. The present invention can be applied to a recording apparatus or a reproducing apparatus capable of appropriately managing security information of an AV signal.

Information recording device, information playback device

Description

VIDEO INFORMATION RECORDING APPARATUS AND VIDEO INFORMATION REPRODUCTION APPARATUS}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video information recording apparatus and a video information reproducing apparatus, and more particularly, to a video information recording apparatus and a video information reproducing apparatus capable of appropriately managing security information of an AV signal recorded on a recording medium. will be.

In recent years, various optical discs have been proposed as disc-shaped information recording media detachable from a recording / reproducing apparatus. Such recordable optical discs have been proposed as large-capacity media of several gigabytes, and have high expectations as media for recording digital video (video) signals.

One of the coding methods for digitally compressing digital video information is the Moving Picture Experts Group (MPEG) 2 method. MPEG-2 is also applied to recording digital video information on a recording medium. For example, when analog video information is recorded on a recording medium, the video information is encoded in the MPEG2 method, and an encoded bit stream is recorded on the media. In addition, in the recent digital TV broadcasting, video broadcasting programs encoded by the MPEG2 system are transmitted in a format called a transport stream. In the case of recording digital broadcast on a recording medium, a method of recording a transport stream as a digital signal without decode or re-encoding is used.

If the video information is recorded on the recording medium in the digital signal format, it is possible to copy the video information to another recording medium without any deterioration. However, this is a big problem for the copyright holder of the video content. Therefore, in order to limit the duplication of video information, the video information includes "Copy Free", "Copy once", "No More Copy", "No More Copy", A method of having a copy control information (CCI) indicating copy generation management information "Copy Prohibited" is used. For example, there is a copy generation management system (CGMS) signal. The analog interface is called CGMS-A, and the digital interface is called CGMS-D. CGMS-A for analog is also called VBID in that ID is superimposed on the vertical blanking interval (VBI) of video information. This is standardized as EIAJ CP-1204.

In addition, there is a method of encoding a descriptor having the information in order to transmit CCI in the transport stream. Descriptors of this type include DTCP descriptors prescribed by the Digital Transmission Licensing Administrator (DTLA) and digital-copy-control-descriptors used in BS digital broadcasting in Japan prescribed by ARIB. In recent years, a method of embedding duplication generation management information called a watermark into baseband video information and MPEG video stream has also been examined in order to strongly enforce duplication restrictions. The watermark is currently being promoted in standardization, and the Millennium and Galaxy methods are proposed.

In the case of recording video information on a recording medium, it is required to be able to impose recording restrictions correctly in accordance with the CCI of the input signal. In general, the user can record video information on the recording medium only in the case where the CCI of the input signal is either "Copy Free" or "Copy Once". When the CCI of the input signal is "Copy once", the CCI of the video information on the recording medium must be updated to "No More Copy".

By the way, in order to make it easier to understand the contents of the video information recorded on the recording medium, recording a still image representative of the contents or an image obtained by selecting a specific scene of the contents as a still image separately from the video information. There is this. These still images are called thumbnail images. By displaying the list of thumbnail images on a menu screen for selecting a position at which the user starts playback from video information recorded on the recording medium, the user interface can be provided as an easy-to-understand form. The thumbnail image may be an image selected from the recorded video information, or may be an image received from a personal computer, a digital camera, or the like as a recording medium.

As described in the prior art, great care has been taken in managing content protection information when recording video information on a recording medium. On the other hand, no attention is paid to the management of content protection information when recording thumbnail images. This is expected to be a problem in the future. That is, in the future, when recording in the digital video information format becomes mainstream, it is expected that it is required to correctly manage the content protection information even when recording thumbnail images. For example, it is considered that images of popular characters in movies and television programs are often copyrighted, and it is a problem for the copyright owner to copy them illegally.

When the CCI selects an image selected from the input video information of "Copy Once" as a thumbnail image and records it on any recording medium, the thumbnail image must be managed as "No More Copy" similarly to the content. The thumbnail image must be encrypted and recorded. As a result, even if a malicious person fraudulently copies the thumbnail image bit-by-bit to another recording medium with the same data, the illegally copied thumbnail image cannot be reproduced.

That is, when the CCI records video information of "Copy Once", the video recorder should have a function of encrypting and recording the video information and the thumbnail image. As the encryption method, for example, DES, Triple-DES, AES, or the like is used.

On the other hand, a video recorder in which the CCI only records video information of "Copy Free" may exist as a commodity. For example, the current terrestrial analog TV broadcast can be treated as the content of "Copy Free" when the general user only uses it. Therefore, there may be a video recorder which records only terrestrial analog TV broadcast. In this case, the video recorder need not have a function of encrypting and recording video information and its thumbnail image (of course, it may be recorded by encrypting).

Considering an application that records the thumbnail picture together with the video information, if the recording medium of the video recorder is removable, there is a possibility that the encrypted thumbnail picture and the unencrypted thumbnail picture are mixed on the recording medium. have. At this time, if a structure for distinguishing and managing encrypted thumbnail images and unencrypted thumbnail images is not provided, there is a problem that it is not possible to know which are the encrypted thumbnail images and which are the unencrypted thumbnail images on the recording medium. Occurs.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and in a case where there is a possibility that an encrypted thumbnail image and an unencrypted thumbnail image may be mixed on a recording medium, a thumbnail image recorded with encryption and a thumbnail image recorded without encryption are recorded. It is an object to provide a structure to distinguish and manage.

In addition, when the thumbnail image is reproduced from a recording medium in which a representative image of the video information or a thumbnail image representing a feature point is recorded together with the video information, information for discriminating whether or not the thumbnail image is encrypted is read and the information is read. An object of the present invention is to provide a structure for reproducing thumbnail images on the basis of the above.

The video information recording apparatus of the present invention has a first acquisition means for acquiring recorded video information, second acquisition means for acquiring thumbnail image information recorded corresponding to the video information, and second acquisition means. And encryption means for encrypting the thumbnail image information, recording means for recording the video information acquired by the first acquiring means, and the thumbnail image information encrypted by the encryption means on a recording medium.

Determination means for determining whether or not the thumbnail image information is encrypted may also be provided.

The second acquiring means can acquire thumbnail image information from the video information acquired by the first acquiring means.

The judging means can determine whether or not the thumbnail image information is encrypted based on the content protection information of the video information acquired by the first obtaining means.

The determining means can determine that the thumbnail image information is encrypted when the content protection information of the video information acquired by the first acquiring means allows one copy.

The recording means can also record the content protection information of the thumbnail image information.

The encryption means can also encrypt the content protection information of the thumbnail image information.

The recording means can record the thumbnail image information in units of predetermined blocks.

The encryption means may encrypt one piece of thumbnail image information within a unit of the predetermined block.

The recording means can also record identification information identifying that the encrypted thumbnail image information is recorded.

The recording means can record the thumbnail image information and the identification information in separate objects, respectively.

The recording means may record the encrypted thumbnail image information in a first object of the object of the thumbnail image information, and record the unencrypted thumbnail image information in a second object of the object of the thumbnail image information. .

The recording means can record the encrypted thumbnail image information and the unencrypted thumbnail image information in the same object in units of predetermined blocks.

The predetermined block may be a block in units of error correction.

The video information recording method of the present invention includes a first acquisition step of acquiring video information to be recorded, a second acquisition step of acquiring thumbnail image information recorded corresponding to the video information, and a second acquisition step. And an encoding step of encrypting the thumbnail image information obtained by the recording step, a recording step of recording the video information acquired by the processing in the first obtaining step and the thumbnail image information encrypted by the processing in the encrypting step on a recording medium. It is done.

The program of the first recording medium of the present invention includes a first acquisition step of acquiring video information to be recorded, a second acquisition step of acquiring thumbnail image information to be recorded corresponding to the video information, and a second acquisition step. An encryption step of encrypting the thumbnail image information obtained by the processing of a; and a recording step of recording the video information acquired by the processing of the first acquiring step and the thumbnail image information encrypted by the processing of the encryption step on a recording medium. Characterized in that.

The first program of the present invention includes a first acquisition step of acquiring video information to be recorded, a second acquisition step of acquiring thumbnail image information to be recorded corresponding to the video information, and a second acquisition step. And an encoding step of encrypting the thumbnail image information obtained by the recording step, a recording step of recording the video information acquired by the processing in the first obtaining step and the thumbnail image information encrypted by the processing in the encrypting step on a recording medium. It is done.

The video information reproducing apparatus of the present invention includes reproducing means for reproducing a signal recorded on a recording medium, extracting means for extracting a signal of a thumbnail image encrypted from the signal reproduced by the reproducing means, and extracted by the extracting means. And decoding means for decoding the signal of the encrypted thumbnail image, and output means for outputting the signal of the thumbnail image decoded by the decoding means.

The extracting means may also extract identification information identifying that the encrypted thumbnail image information is recorded.

Determination means for determining whether or not to decode the thumbnail image information based on the identification information extracted by the extraction means may be further provided.                 

The extracting means may also extract the content protection information of the thumbnail image information.

The decoding means can also decode the content protection information of the thumbnail image information.

The reproducing means can reproduce the thumbnail image information in units of predetermined blocks.

The decoding means can decode one thumbnail image information within the predetermined block unit.

The reproduction means can reproduce the thumbnail image information and the identification information from independent objects, respectively.

The reproduction means can reproduce the encrypted thumbnail image information from the first object of the object of the thumbnail image information, and reproduce the unencrypted thumbnail image information from the second object of the object of the thumbnail image information.

The reproducing means can reproduce the encrypted thumbnail image information and the unencrypted thumbnail image information in units of predetermined blocks of the same object.

The predetermined block may be a block in units of error correction.

The video information reproducing method of the present invention includes a reproducing step of reproducing a signal recorded on a recording medium, an extraction step of extracting a signal of an encrypted thumbnail image from the signal reproduced by the processing of the reproducing step, and a processing of the extracting step. And a decoding step of decoding the signal of the encrypted thumbnail image extracted by the step, and an output step of outputting a signal of the thumbnail image decoded by the decoding step.

The program of the second recording medium of the present invention is a program of a video information reproducing apparatus for reproducing video information recorded on a recording medium, which is reproduced by a reproducing step of reproducing a signal recorded on the recording medium and a reproducing step. An extraction step of extracting a signal of an encrypted thumbnail image from the reproduced signal, a decoding step of decoding a signal of an encrypted thumbnail image extracted by the processing of the extraction step, and a thumbnail image decoded by the processing of the decoding step It characterized in that it comprises an output step of outputting a signal of.

In the second program of the present invention, a computer controlling a video information reproducing apparatus for reproducing video information recorded on a recording medium includes a reproducing step of reproducing a signal recorded on a recording medium and a process of a reproducing step. An extraction step of extracting a signal of an encrypted thumbnail image from the encoded signal, a decoding step of decoding a signal of an encrypted thumbnail image extracted by the processing of the extraction step, and a thumbnail image decoded by the processing of the decoding step. Perform an output step that outputs a signal.

The third recording medium of the present invention is characterized in that video information, an encrypted thumbnail image relating to the video information, and identification information for identifying that an encrypted thumbnail image is recorded are recorded.                 

In the video information recording apparatus and method of the present invention, and the first program, encrypted thumbnail image information is recorded on a recording medium.

In the video information reproducing apparatus and method of the present invention and the second program, the thumbnail image information encrypted is decoded and output.

In the third recording medium of the present invention, an encrypted thumbnail image and identification information for identifying that the encrypted thumbnail image is recorded are recorded.

1 illustrates a structure of an application format.

2 is a diagram for explaining a mark on a PlayList and a mark on a Clip.

3 is a diagram illustrating menu thumbnails and mark thumbnails.

4 is a diagram illustrating a menu thumbnail.

5 is a diagram for explaining marks to be attached to a play list.

6 is a view for explaining a mark attached to a clip.

7 is a diagram for explaining a file that stores thumbnails.

8 is a diagram for explaining a directory structure created on a disc.

9 is a diagram illustrating a structure of a DVR MPEG-2 transport stream.

10 is a diagram illustrating syntax of a UIAppInfoDVR.

11 is a diagram illustrating syntax of a PlayListMark.

12 is a diagram illustrating syntax of a ClipMark.

Fig. 13 is a diagram for explaining a method of storing data of thumbnail images in tn_block.

14 is a diagram illustrating encryption.

Fig. 15 shows the syntax of an information file of thumbnails.

Fig. 16 shows the syntax of a menu thumbnail picture file.

17 illustrates the syntax of tn_block.

18 is a diagram illustrating syntax of CP_Info_thumbnail ().

19 is a diagram for explaining CCI_thumbnail.

20 is a diagram for explaining APS_thumbnail.

Fig. 21 is a view for explaining a method of storing image data of thumbnails in tn_block ().

Fig. 22 is a diagram for explaining encryption in tn_block units.

Fig. 23 is a diagram for explaining encryption in units of ECC blocks.

FIG. 24 is a diagram illustrating syntax of a thumbnail information file. FIG.

25 is a diagram illustrating syntax of a thumbnail image file.

Fig. 26 is a block diagram showing the structure of a recording apparatus to which the present invention is applied.

27 is a diagram for explaining processing of a duplicate control in the case of recording an AV stream.

Fig. 28 is a diagram explaining copy control processing when a transport stream is input.

29 is a flowchart for describing a process of encrypting and recording a thumbnail.

30 is a block diagram showing another configuration example of a recording apparatus to which the present invention is applied.                 

Fig. 31 is a flowchart for explaining a process of adding and recording thumbnails of designated images.

32 is a block diagram showing a configuration example of a playback apparatus to which the present invention is applied.

33 is a flowchart for describing processing of reproducing thumbnails.

Fig. 1 shows a simplified structure of an application format on a recording medium used in the recording and reproducing system of the present invention. This format has two layers, PlayList (play list) and Clip (clip) for managing the AV stream. The Volume Information manages all Clips and PlayLists on the disc.

A pair of one AV stream and its sub information is considered to be one object and is called Clip. The AV stream file is called a Clip AV stream file, and the sub information thereof is called a Clip Information file.

One Clip AV stream file stores data in which the MPEG2 transport stream is arranged in a structure defined by the DVR application format.

In general, a data file used by a computer or the like is treated as a byte string, but the contents of the Clip AV stream file are developed on the time axis, and the PlayList designates mainly the access point in the Clip as a time stamp. When the PlayList indicates the access point in the Clip with a time stamp, the Clip Information file helps to find the address information in which the decoding of the stream should start from the Clip AV stream file.

The PlayList was introduced for the purpose of selecting a playback section that the user wants to see from the Clip and easily editing it. One PlayList is a collection of playback sections in a Clip. One playback section of a Clip is called PlayItem, and it is represented by a pair of IN and 0UT points on the time axis. Therefore, PlayList is a collection of PlayItems.

There are two types of PlayLists. One is Real PlayList, and the other is Virtual PlayList. Real PlayList is considered to share the stream portion of the Clip it refers to. That is, Real PlayList occupies a data capacity corresponding to the stream portion of the Clip that it refers to among the disks. When the AV stream is recorded as a new Clip, a Real PlayList that automatically refers to the playable range of the entire Clip is automatically created. When a part of the playback range of the Real PlayList is erased, the stream part of the Clip to which it refers is also erased. The Virtual PlayList is considered not to share the data of the Clip. Even if the Virtual PlayList is changed or erased, the Clip does not change anything.

In the following description, Real PlayList and Virtual PlayList are collectively referred to simply as PlayList.

The marks are used to designate highlights or characteristic times in the Clip and PlayList (see Fig. 2).                 

(1) The mark added to the Clip designates a characteristic scene resulting from the content of the AV stream. For example, a scene change point. When playing a PlayList, it can refer to and use the mark of the Clip which the PlayList refers to.

(2) The mark added to the PlayList is mainly set by the user. For example, bookmarks and resume marks.

(3) Setting the mark in the Clip or PlayList is done by adding a time stamp indicating the time of the mark to the mark list. Delegating a mark also removes the mark's time stamp from the mark list. As a result, the set or delegate of the mark changes the AV stream nothing.

Thumbnails are still pictures added to the Volume (disc), PlayList, and Clip. There are two kinds of thumbnails as shown in FIG. One is a thumbnail as a representative representation of the content. This is mainly used in the menu screen for selecting what the user wants to see by operating the cursor. Another is an image representing the god that Mark is pointing to.

In addition, as shown in FIG. 3, zero or one menu thumbnail is provided for each volume or playlist, and zero or zero mark thumbnails are provided for each playlist or clip.

The Volume and each PlayList may have a representation. Volume representative is assumed to be used when the disc is inserted into a player when displaying a still image showing the disc's contents for the first time (see Memu Thumbnail in Fig. 4). Representation of the PlayList is assumed to be used as a still image for showing the contents of the PlayList in the menu screen for selecting the PlayList (see Menu Thumbnail in FIG. 5). The simplest method of realizing the PlayList representation is to make the first picture of the PlayList as a thumbnail, but the image at the beginning of the playback time 0 is not necessarily the best picture for displaying the contents. This is the purpose of determining an arbitrary image as a thumbnail of the PlayList. Although two types of thumbnails are called menu thumbnails, menu thumbnails are frequently displayed, and therefore, it is required to be able to read them from the disk at high speed. It is efficient to store all the menu thumbnails in one file to satisfy this demand (see Menu Thumbnail file in Fig. 7 described later). Not only an image picked up from a moving picture in the volume, but also an image taken from a personal computer (PC), a digital camera (DSC), or the like may be used (Fig. 4).

On the other hand, Clip and PlayList need to put a plurality of marks, and in order to know the contents of the mark position, it is necessary to easily view the image of the mark point. An image representing such mark points is called Mark Thumbnails (see Mark Thumbnail in FIG. 5 and Mark Thumbnail in FIG. 6). Therefore, the basis of the thumbnail is that the image of the mark point is selected more than the image received from the outside. Unlike menu thumbnails, mark thumbnails are used for submenus and the like used to display the details of a PlayList, so that short access time is not required. Therefore, whenever a thumbnail is needed, it does not matter even if it takes some time by the player opening a file and reading a part of the file. In addition, in order to reduce the number of files existing in the volume, it is preferable to store all mark thumbnails in one file (see Mark Thumbnail file in FIG. 7). The PlayList can have a menu thumbnail and a plurality of mark thumbnails, but since the Clip does not need to be directly selected by the user (usually specified via the PlayList), it does not have a menu thumbnail.

The necessary directories on the DVR disk are as follows: The root directory containing the "DVR" directory. "DVR" directory containing "PLAYLIST" directory, "CLIPINF" directory, and "STREAM" directory. 8 shows an example of the directory structure on the DVR disk.

The root directory contains one directory. "DVR"-All files and directories defined by the DVR application format must be stored under this directory.

The "DVR" directory stores the file shown next. "info.dvr"-A file containing global information of the application layer created under the DVR directory. There should be only one info.dvr under the DVR directory. The file name is fixed as info.dvr.

"menu.tidx", "memu.tdt1" and "memu.tdt2"-These three files store information related to menu thumbnail images.

menu.tidx is a "thumbnail information file" that stores header information of a menu thumbnail image.

menu.tdt1 is a first " thumbnail image file " that stores image data of a menu thumbnail image, and is a file for recording an encrypted thumbnail image.

menu.tdt2 is a second " thumbnail image file " that stores image data of a menu thumbnail image, and is a file for recording an unencrypted thumbnail image.

When the video recorder has a function of encrypting and recording a menu thumbnail image, the menu thumbnail image can be recorded in memu.tdt1. A menu thumbnail image created from video information whose CCI is "Copy 0nce" is stored in menu.tdt1. A menu thumbnail image created from video information whose CCI is "Copy Free" may also be stored in menu.tdt1.

If the CCI is a video recorder for recording only video information having "Copy Free", and the video recorder does not have a function of encrypting and recording a menu thumbnail image, the menu thumbnail image is recorded in menu.tdt2.

Information on whether or not each menu thumbnail image is encrypted (that is, information on which menu thumbnail image is stored in either menu.tdt1 or menu.tdt2) is stored in menu.tidx.

The thumbnail information file can be managed in a relatively small database by collecting and managing information of whether or not each thumbnail image is encrypted in a thumbnail information file called menu.tidx. Thus, when a thumbnail image is instructed to be reproduced, information on whether or not the thumbnail is encrypted can be easily obtained at high speed.

"mark.tidx", "mark.tdt1" and "mark.tdt2"-these three files store information related to mark thumbnail pictures.

mark.tidx is a "thumbnail information file" that stores header information of mark thumbnail images.

mark.tdt1 is a first " thumbnail image file " that stores image data of a mark thumbnail image, and is a file for recording an encrypted thumbnail image.

mark.tdt2 is a second " thumbnail image file " that stores image data of a mark thumbnail image, and is a file for recording an unencrypted thumbnail image.

The method of determining whether to mark mark thumbnail images to mark.tdt1 and mark.tdt2, and the effect of separating and managing the thumbnail information file and the thumbnail image file are the same as the description of the menu thumbnail described above.

The "DVR" directory contains three directories.

"PLAYLIST"-Database files for Real PlavList and Virtual PlayList should be placed under this directory.

"CLIPINF"-Clip's database should be placed under this directory.

"STREAM"-The AV stream file should be placed under this directory.

The "PLAYLIST" directory stores two kinds of PlayList files, which are Real PlayList and Virtual PlayList.

"xxxxx.rpls"-This file stores information related to a Real PlayList. One file is created for each Real PlayList. The file name is "xxxxx.rpls". Where "xxxxx" is five zero to nine numbers. The file extension must be "rpls".

"yyyyy.vpls"-This file stores information related to one Virtual PlayList. One file is created for each Virtual PlayList. The file name is "yyyyy.vpls". Where "yyyyy" is five digits 0 through 9. The file extension must be "vpls".

The "CLIPINF" directory stores one file corresponding to each AV stream file.

"zzzzz.clpi"-This file is a Clip Information file corresponding to one AV stream file (Clip AV stream file or Bridge-Clip AV stream file). The file name is "zzzzz.clpi", where "zzzzz" is five numbers from 0 to 9. The file extension must be "dlpi".

The "STREAM" directory stores files of the AV stream.

"zzzzz.m2ts"-This file is the AV stream file handled by the DVR system. This is a Clip AV stream file or a Bridge-Clip AV stream file. The file name is "zzzzz.m2ts", where "zzzzz" is five numbers from 0 to 9. The file extension must be "m2ts".

One AV stream file and the corresponding Clip Information file should use the same five numbers "zzzzz".

The structure of an AV stream file will be described. The AV stream file must have the structure of a DVR MPEG2 transport stream shown in FIG. The DVR MPEG2 transport stream has the following features.

(1) The DVR MPEG2 transport stream is composed of an integer number of aligned units.

(2) The size of the aligned unit is 6144 bytes (2048 * 3 bytes).

(3) The aligned unit starts from the first byte of the source packet.

(4) The source packet is 192 bytes long. One source packet consists of a TP_extra_header and a transport packet. TP_extra_header is 4 bytes long and the transport packet is 188 bytes long.

(5) One aligned unit consists of 32 source packets.

(6) The last Aligned unit in the DVR MPEG2 transport stream also consists of 32 source packets.

(7) If the last aligned unit is completely filled with transport packets of the input transport stream, the remaining byte area should be filled with source packets with null packets (Transport packets with PID = 0x1FFF).

The TP_extra_header includes copy restriction information of the payload of the transport packet and an arrival time stamp indicating the time when the transport packet arrived at the decoder.

Next, a description will be given of a database format for managing reproduction information of an AV stream file.

10 shows the syntax of UIAppInfpoDVR, which is part of data stored in info.dvr. ref_to_menu_thumbnail_index represents information of a thumbnail image representing a volume. If the ref_to_menu_thumbnail_index field is a value other than 0xFFFF, a thumbnail picture is added to the Volume, and the thumbnail picture is stored in the menu.tdt1 file or menu.tdt2 file. The picture is referenced using the value of thumbnail_index in the menu.tidx file (to be described later). When the ref_to_menu_thumbnail_index field is 0xFFFF, it indicates that no thumbnail picture is added to the Valume.

11 shows the syntax of PlayListMark, which is a part of data stored in the PlayList file. PlayListMark stores information of marks added to PlayList. In addition, the information of the representative picture of the PlayList is also included in the PlayListMark.

number_of_rlayList_marks represents the number of entries of marks stored in the PlayListMark.

mark-type indicates the type of mark.

refto-PlayItem_id represents the value of PlayItem_id of the point specifying the PlayItem of the point where the mark is placed.

mark_time_stamp stores a time stamp indicating the point to which the mark is assigned.

ref_to_menu_thumbnail_index represents information of a thumbnail picture indicating a representative picture of a PlayList. When the ref_to_menu_thumbnail_index field is a value other than 0xFFFF, a thumbnail picture indicating a representative picture of the PlayList exists, and the thumbnail picture is stored in the menu.tdt1 file or menu.tdt2 file. The picture is referenced using the value of thumbnail_index in the menu.tidx file (to be described later). When the ref_to_menu_thumbnail_index field is 0xFFFF, it indicates that a thumbnail picture indicating a representative picture of the PlayList does not exist.

ref_to_mark_thumbnail_index represents information of a thumbnail picture added to a mark. When the ref_to_mark_thumbnail_index field is a value other than 0xFFFF, a thumbnail picture is added to the mark, and the thumbnail picture is stored in the mark.tdt1 file or mark.tdt2 file. The picture is referenced using the value of thumbnail_index in the mark.tidx file (to be described later). When the ref_to_mark_thumbnail_index field is 0xFFFF, it indicates that no thumbnail picture is added to the mark.

12 shows the syntax of a ClipMark that is part of data stored in a Clip Information file. The ClipMark stores information of marks added to the Clip.

number_of_Clip_marks represents the number of entries of marks stored in the ClipMark.

mark-type indicates the type of mark.

ref_to_STC_id is information specifying the time base of the system time base of the Clip where the mark_time_stamp is placed.

mark_time_stamp indicates a point to which a mark is designated in the Clip AV stream based on the presentation time stamp.

ref_to_mark_thumbnail_index represents information of a thumbnail picture added to a mark. If the ref_to_mark_thumbnail_index file is a value other than 0xFFFF, a thumbnail picture is added to the mark, and the thumbnail picture is stored in the mark.tdt1 file or mark.tdt2 file. The picture is referenced using the value of thumbnail_index in the mark.tidx file (to be described later). When the ref_to_mark_thumbnail_index field is 0xFFFF, it indicates that no thumbnail picture is added to the mark.

Next, the contents of a file that stores information about thumbnails will be described.

"memu.tidx", "menu.tdt1" and "menu.tdt2" store information of a menu thumbnail, i.e., one picture representing Volume, and one picture representing it in each PlayList. Each header information of the menu thumbnail is collected and managed in one memu.tidx. Each image data of the menu thumbnail is stored in menu.tdt1 or menu.tdt2.

" mark.tidx ", " mark.tdt1 " and " mark.tdt2 " store information about mark thumbnails, i.e., images pointed at mark points. Each header information of mark thumbnails added to all Clips and PlayLists in the Volume is collected and managed in one mark.tidx. Each image data of mark thumbnails is stored in mark.tdt1 or mark.tdt2.

The thumbnail image is, for example, data obtained by encoding the image in JPEG. Since JPEG is widely used as a defect standard, inflation is relatively easy and the compatibility is high. In addition, the format of the thumbnail image is not limited to JPEG, and it is also possible to use MPEG I-picture, PNG, GIF, TIFF, or the like.

Since thumbnails are frequently added and deleted, the addition operation and the partial deletion operation should be able to be executed easily and at high speed. For this reason, menu.tdt1, memu.tdt2, mark.tdt1 and mark.tdt2 have a block structure. One thumbnail picture is stored in one block called tn_block.

13 shows an example of a method of using tn_block.                 

Here, the thumbnail images represented by (a), (b) and (c) are stored in menu.tdt1, and the thumbnail images represented by (x), (y) and (z) are stored in menu.tdt2. Among menu.tidx, (a), (b) and (c) are given two values, thumbnail_index (A, B, C) and ref_to_tn_block_id_1 (0, 1, 3) for each. Further, in menu.tidx, (x), (y) and (z) are given two values of thumbnail_index (X, Y, Z) and ref_to_tn_block_id_2 (0, 2, 3) for each. In menu.tdt1, thumbnail images (a), (b), and (c) are stored in tn_block (blocks 0, 1, 3) represented by ref_to_tn_block_id_1, respectively. Further, in menu.tdt2, (x), (y) and (z) are stored in tn_block (blocks 0, 2 and 3) represented by ref_to_tn_block_id_2, respectively. This facilitates management even when encrypted and unencrypted thumbnails are mixed.

In the arrangement of the tn_blocks included in menu.tdt1 and menu.tdt2, an unused tn_block (tn_block at menu 2 of number 2. tn_block at menu 1 of menu.tdt2) may exist. For example, when deleting a thumbnail, an unused tn_block is created in the array of tn_blocks when the thumbnail_index entered in menu.tidx is deleted and the thumbnail image file is not changed.

FIG. 14 is a diagram for explaining a method of encrypting a file (menu.tdt1 shown in FIG. 13) for encrypting and recording a thumbnail image. As shown in the figure, one tn_block is divided into one or more integer encryption blocks, and the data in the block is encrypted in units of the encryption block. As the encryption method, for example, DES, Triple-DES, AES, or the like is used. In this way, the encryption process is closed with one tn_block. As a result, when an arbitrary thumbnail image is read from the thumbnail image file, only the tn_block in which the thumbnail image is stored may be decrypted (decrypted) by the encryption, thereby minimizing the data throughput.

Next, the syntax and semantics of a file that stores information about thumbnails will be described.

"memu.tidx" and "mark.tidx" have the same syntax structure. 15 shows examples of syntax structures of "menu.tidx" and "mark.tidx".

number_of_thumbnails_1 is the number of thumbnail images stored in menu.tdt1 in the case of menu.tidx, and the number of thumbnail images stored in mark.tdt1 in the case of mark.tidx.

number_of_tn_blocks_1 represents the number of tn_blocks in menu.tdt1 in the case of menu.tidx, and the number of tn_blocks in mark.tdt1 in the case of mark.tidx.

number_of_thumbnails_2 is the number of thumbnail images stored in menu.tdt2 in the case of menu.tidx, and the number of thumbnail images stored in mark.tdt2 in the case of mark.tidx.

mmber_of_tn_blocks_2 represents the number of tn_blocks in menu.tdt2 in the case of memu.tidx, and the number of tn_blocks in mark.tdt2 in the case of mark.tidx.                 

tn_block_size represents the size of one tn_block of menu.tdt1 and menu.tdt2 in the case of menu.tidx, and the size of one tn_block of mark.tdt1 and mark.tdt2 in the case of mark.tidx. This size is the size in units of 1024 bytes. For example, tn_block_size = 16 indicates that the size of one tn_block is 16 * 1024 bytes. One thumbnail picture should be stored in one tn_block.

recording_seed is any random value used for the process of encrypting the data of menu.tdt1 in the case of menu.tidx. In addition, in the case of mark.tidx, it is any random value used for the process which encrypts the data of mark.tdt1. When the recorder first creates a menu.tdt1 file on disk, it creates its recording_seed and stores it in memu.tidx. The recorder also creates the recording_seed when the mark.tdt1 file is first created on disk, and stores it in menu.tidx.

The thumbnail_index indicates the index number for ref_to_tn_block_id_1 following that thumbnail_index when it is included in a loop of a for statement whose number_of_thumbnails_1 is a variable. Or thumbnail_index indicates the index number for ref_to_tn_block_id_2 following that thumbnail_index when it is included in the loop of the for statement with number_of_thumbnails_2 as a variable. Do not use the value 0xFFFF in thumbnail_index. In the case of menu.tidx, thumbnail_index is referred to by ref_to_menu_thumbnail_index in UIAppInfoVolume () and PlayListMark (). In the case of mark.tidx, thumbnail_index is referred to by ref_to_mark_thumbnail_index in PlayListMark () and ClipMark (). In menu.tidx, thumbnail_index of the same value should not appear in duplicate. In mark.tidx, thumbnail_index of the same value should not overlap.

ref_to_tn_block_id_1 represents one tn_block in menu.tdt1 in the case of menu.tidx, and the tn_block stores a thumbnail image for thumbnail_index which is the index number of ref_to_tn_block_id_1.

In the case of mark.tidx, one tn_block in mark.tdt1 is stored, and the tn_block stores a thumbnail image for thumbnail_index which is an index number of ref_to_tn_block_id_1.

picture_byte_size_1 [ref_to_tn_block_id_1] indicates the data length of the thumbnail image stored in tn_block indicated by ref_to-tn_block_id_1 in bytes. The value of picture_byte_size_1 [ref_to_tn_block_id_1] should be (1024 * tn_block_size-N1) bytes or less (N1 will be described later with reference to FIG. 17). That is, the recorder should encode the data length of one thumbnail picture so that it is equal to or less than (1024 * tn_block_size-N1) bytes.

horizontal_picture_size_1 [ref_to_tn_block_id_1] represents the number of pixels in the horizontal direction of the thumbnail image stored in tn_block represented by ref_to_tn_block_id_1.

vertical_picture_size_1 [ref_to_tn_block_id_1] indicates the number of pixels in the vertical direction of the thumbnail image stored in tn_block represented by ref_to_tn_block_id_1.

ref_to_n_block_id_2 represents one tn_block in memu.tdt2 in the case of menu.tidx, and the tn_block stores a thumbnail image for thumbnail_index which is the index number of ref_to_tn_block_id_2. Alternatively, in the case of mark.tidx, one tn_block of mark.tdt2 is represented, and the tn_block stores a thumbnail image for thumbnail_index which is an index number of ref_to_tn_block_id_2.

picture_byte_size_2 [ref_to_tn_block_id_2] represents the data length of the thumbnail image stored in tn_block indicated by ref_to_tn_block_id_2 in bytes. The value of picture_byte_size_2 [ref_to_tn_block_id_2] should be (1024 * tn_block_size-N1) bytes or less (N1 will be described later with reference to FIG. 17). That is, the recorder should encode the data length of one thumbnail picture to be (1024 * tn_block_size-N1) bytes or less.

horizontal_picture_size_2 [ref_to_tn_block_id_2] represents the number of pixels in the horizontal direction of the thumbnail image stored in tn_block represented by ref_to_tnblcck_id_2.

vertical_picture_size_2 [ref_to_tn_block_id_2] represents the number of pixels in the vertical direction of the thumbnail image stored in tn_block represented by ref_to_tn_block_id_2.

Fig. 16 shows the syntax structures of "menu.tdt1", "menu.tdt2", "mark.tdt1" and "mark.tdt2". These files have the same syntax structure.

tn_block (tn_block_id) represents one tn_block indicated by the argument of tn_block_id in the array of tn_block.

In the case of menu.tdt1, the value of tn_block_id is referenced by ref_to_tn_block_id_1 in menu.tidx.

In the case of menu.tdt2, the value of tn_block_id is referred to by ref_to_tn_block_id_2 in menu.tidx.

In the case of mark.tdt1, the value of tn_block_id is referred to by ref_to_tn_block_id_1 in mark.tidx.

In the case of mark.tdt2, the value of tn_block_id is referred to by ref_to_tn_block_id_2 in mark.tidx.

17 shows the syntax of tn_block (tn_block_id).

The thumbnail_picture [tn_block_id] is an area for storing one thumbnail picture indicated by the above-mentioned value of tn_block_id. The first byte of the thumbnail picture must coincide with the first byte of thumbnail_picture [tn_block_id].

CP_Info_thumbnail () is N1 byte information indicating the content protection information of the thumbnail picture stored in the thumbnail_picture [tn_block_id]. Details will be described later.

padding_byte is a value of 1 byte having an arbitrary value, and the value of NP is calculated to satisfy the following expression.

NP = tn_block_size * 1024-picture_byte_size [tn_block_id]-N1

18 shows the syntax of CP_Info_thumbnail ().

CCI_thumbnail represents copy generation management information of a copy of a thumbnail image. The meaning of the value is shown in FIG. That is, "00" represents "copy free", "01" represents "no more copy", "10" represents "copy once", and "11" represents "copy prohibited", respectively.

APS_thumbnail represents analog copy protection information at the time of analog video output of a thumbnail image. The meaning of the value is shown in FIG. The definition of each APS is described in Default Settings of the Macrovision Anti-taping Process for DVD Products, Revision 1.0, July 5, 1997. Also, the 2L / 4L Colorstripe is only applicable for NTSC analog outputs.

Since the menu.tdt1 file and mark.tdt1 file are encrypted and recorded, the following two effects are achieved.

(1) The contents of CP_Info_thumbnail () can be prevented from being altered by a malicious user.

(2) Even if a thumbnail image with CCI_thumbnail "No more copy" is illegally copied to another recording medium with the same data bit-by-bit, it can be coped so that it cannot be reproduced.

In the above description, the case where the menu thumbnail image file is divided into two for an encrypted thumbnail and a non-encrypted thumbnail is described (also for the mark thumbnail image). Next, as another example, the case of the format of switching the encrypted thumbnail portion and the non-encrypted thumbnail portion in one menu thumbnail image file will be described.

In this case, the menu thumbnail image is stored in one menu.tdat file, and the mark thumbnail image is stored in one mark.tdat file. (In the file structure of Fig. 8, menu.tdt1 and menu.tdt2 are changed to one menu.tdat, and mark.tdt1 and mark.tdt2 are changed to one mark.tdat.)

An example of how to use tn_block in tn_block in this case is shown in FIG.

Here, the thumbnail images represented by (a), (b) and (c) (of which (b) is the thumbnail images to be encrypted and recorded) are stored in menu.tdat. Among menu.tidx, (a), (b) and (c) are 3 of thumbnail-indlex (X, Y, Z), ref_to_tn_block_id (0, 1, 3) and flag_encrypted_thumbnail (0, 1, 0) for each Values are given. In menu.tdat, (a), (b) and (c) are stored in tn_block represented by ref_to_tn_block_id (0, 1, 3), respectively.

An unused tn_block may exist in the tn_block array of menu.tdat. For example, when deleting a thumbnail, an unused tn_block is created in the array of tn_blocks when the thumbnail_index entered in menu.tidx is deleted and the thumbnail image file is not changed.

Two examples of the encryption switching method in the case of the format of switching between the encrypted thumbnail portion and the non-encrypted thumbnail portion in one menu thumbnail image file will be described with reference to FIGS. 22 and 23.

22 shows a case where encryption and non-encryption are switched in units of tn_block. FIG. 23 illustrates a case where encryption and non-encryption are switched in a unit in which a plurality of tn_blocks are integrated. In the latter case, for example, when the size of the tn_block is 16 KB and the unit of the ECC block is 64 KB, encryption and non-encryption are switched in units of 64 KB.

The syntax (the same applies to mark thumbnail image files) of thumbnail information files in the case of the format of switching between encrypted thumbnail portions and non-encrypted thumbnail portions in one menu thumbnail image file.

"menu.tidx" and "mark.tidx" have the same syntax structure. 24 shows examples of syntax structures of "menu.tidx" and "mark.tidx".

number_of_thumbnails is the number of thumbnail images stored in menu.tdat in the case of menu.tidx, and the number of thumbnail images stored in mark.tdat in the case of mark.tidx.

tn_block_size represents the size of one tn_block in menu.tdat in the case of menu.tidx, and the size of one tn_block in mark.tdat in the case of mark.tidx.

number_of_tn_blocks represents the number of tn_blocks in menu.tdat in the case of menu.tidx, and the number of tn_blocks in mark.tdat in the case of mark.tidx.

In the case of menu.tidx, recording_seed is a random number used for the process of encrypting the data of menu.tdat and is calculated by a predetermined method. In addition, recording_seed is a random number value used for the process of encrypting the data of mark.tdat in the case of mark.tidx, and is calculated by a predetermined method.

The thumbnail_index represents an index number for ref_to_tn_block_id following the thumbnail_index. Do not use the value 0xFFFF by thumbnail_index. In the case of menu.tidx, thumbnail_index is referred to by ref_to_menu_thumbnail_index in UIAppInfoVolume () and PlayListMark (). In the case of mark.tidx, thumbnail_index is referred to by ref_to_mark_thumbnail_index in PlayListMark () and ClipMark (). In menu.tidx, thumbnail_index of the same value should not appear in duplicate. In mark.tidx, thumbnail_index of the same value should not overlap.

ref_to_tn_block_id represents one tn_block in menu.tdat in the case of menu.tidx, and the tn_block stores a thumbnail image for thumbnail_index which is the index number of ref_to_tn_block_id. In the case of mark.tidx, one tn_block in mark.tdat is represented, and the tn_block stores a thumbnail image for thumbnail_index which is an index number of ref_to_tn_block_id.

picture_byte_size [ref_to_tn_block_id] represents the data length of a thumbnail image stored in tn_block indicated by ref_to_tn_block_id in bytes.

horizontal_picture_size [ref_to_tn_block_id] represents the number of pixels in the horizontal direction of the thumbnail image stored in the tn_block indicated by ref_to_tn_block_id.

vertical_picture_size [ref_to_tn_block_id] represents the number of pixels in the vertical direction of the thumbnail image stored in the tn_block indicated by ref_to_tn_block_id.

flag_encrypted_thumbnail [ref_to_tn_block_id] is a flag indicating whether the thumbnail image stored in the tn_block indicated by ref_to_tn_block_id is encrypted or recorded.

25 shows the syntax structures of "menu.tdat" and "mark.tdat". These files have the same syntax structure.

tn_block (tn_block_id) represents one tn_block indicated by the argument of tn_block_id in the array of tn_block. In the case of menu.tdat, the value of tn_block_id is referred to by ref_to_tn_block_id in menu.tidx. In the case of mark.tdat, the value of tn_block_id is referred to by ref_to_tn_block_id in mark.tidx.

The content of tn_block (tn_block_id) is the same as the content described with reference to FIGS. 16 and 17.

In the above, three methods of managing encrypted and unencrypted thumbnails with a database have been described. The effect of each method is described as follows.

(1) Thumbnail image files are divided into two for an encrypted thumbnail and a non-encrypted thumbnail (Figs. 13 and 14).

Since there is no switching of encryption 0N / 0FF in the thumbnail image file, it is not necessary to switch the decryption 0N / 0FF of the encryption at the time of reading the file (at the time of reproduction), and the decryption processing of the encryption can be simplified.

(2) In the case of a format in which an encrypted thumbnail portion and an unencrypted thumbnail portion are switched in one menu thumbnail image file, encryption and non-encryption are switched in units of tn_block (FIGS. 21 and 22).

Even if there is only one thumbnail image file, it is easy to manage a database for distinguishing between encrypted and unencrypted thumbnails. If you switch encryption and non-encryption by the smallest unit of tn_block, you do not record unnecessary data on the disk.

(3) In the case of a format in which an encrypted thumbnail portion and an unencrypted thumbnail portion are switched in one menu thumbnail image file, encryption and non-encryption are switched in units in which a plurality of tn_blocks are integrated (FIG. 23).

Even if there is only one thumbnail image file, it is easy to manage a database for distinguishing between encrypted and unencrypted thumbnails. If the unit in which a plurality of tn_blocks are combined is the same as that of the ECC block, it is not necessary to switch the decryption 0N / 0FF of the encryption when the ECC block is read (at the time of reproduction), and the decryption processing of the encryption can be simplified.

Next, Fig. 26 shows a block diagram of a recording apparatus which records an AV stream and encodes and records a representative image of the AV stream or an image of a mark point to a thumbnail.

First, a case of recording an AV stream in which video and audio inputs from the terminals 12 and 16 are self-encoded will be described. The macrovision detection unit 13 detects the analog copy protection signal APS of the input video by a predetermined method and restricts recording of the video information. Only when the APS is not included in the input video information, the video information can be recorded. Therefore, if video information can be recorded, the APS is copy free (00). When the input video information does not include the APS, the macrovision detection unit 13 supplies the input video to the CGMS detection update unit 14. The CGMS detection updating unit 14 analyzes the CGMS (CGMS-A or CGMS-D) of the input video by a predetermined method, and supplies the CCI (shown as CCI_o in the figure) of the AV stream to be recorded to the controller 21. do. In addition, the CGMS detection updating unit 14 supplies the input video to the WM (Water Mark) detection updating unit 15. The WM detection updating unit 15 analyzes the water mark of the input video by a predetermined method, and supplies the controller 21 with the WM (indicated by WM_o in the figure) of the recorded AV stream. The WM detection updating unit 15 also supplies the input video to the MPEG2 AV encoder 16 and the video analyzing unit 18.

The MPEG2 AV encoder 16 encodes the input video and audio signals, and supplies the video stream and the audio stream to the multiplexed source packetizer 17.

The controller 21 determines, based on the input CCI_o and WM_o, the value of E_CCI (Embedded CCI) encoded in the multiplexed stream to the multiplexed source packetizer 17 by a predetermined method. The multiplexing source packetizer 17 multiplexes the video stream and the audio stream, and supplies the AV stream to the encryption unit 22 and the stream analyzing unit 20.

The encryption unit 22 encrypts the input AV stream by a predetermined method and supplies it to the ECC encoding unit 23. The AV stream is recorded in the recording medium 26 as an AV stream file after the ECC encoder 23, the modulator 24, and the drive 25 process.

In addition to recording the AV stream file, the recording apparatus also records application database information (info.dvr, PlayList, Clip Information, thumbnail information file, thumbnail picture file) related to the file. Application database information is created by the controller 21. The input information to the controller 21 is the feature information of the video information from the video analyzer 18, the feature information of the AV stream from the stream analyzer 20, and the user's instruction information input from the terminal 11.

The feature information of the video information from the video analysis unit 18 is automatically generated by this recording apparatus. The video analysis unit 18 analyzes the content of the input video information, and generates information related to an image that becomes a mark point as a characteristic image in the input video information. For example, the program start point, scene change point, or CM start of input video information. Instruction information of an image of a mark point such as an end point. Further, the image of the first mark point in the input video information may be used as the representative image (representative image of PlayList) of the video information. The video analysis unit 18 inputs a time stamp (mark position) indicating the image of the mark point in the video information to the controller 21. The thumbnail encoder 19 encodes the image of the mark point into the thumbnail image, and supplies the thumbnail image to the controller 21. The controller 21 associates and stores the time stamp of the mark point, CCI_o and WM_o corresponding to the image of the mark point, and the thumbnail image of the image of the mark point. The controller 21 also determines, by a predetermined method, the value of the CCI_thumbnail (FIG. 19) of CP_Info_thumbnail () (FIGS. 17 and 18) described above based on the CCI_o and WM_o corresponding to the image of the mark point.

FIG. 27 shows the duplication control process in the case of recording an AV stream in which the input video information is self-encoded.

The AV stream is recorded corresponding to the state of the input signal. Thumbnails are also recorded corresponding to the state of the input signal. That is, when the input signal is "Copy Free", the thumbnail can be recorded similarly to the AV stream, and in that case, CCI_thumbnail or APS_thumbnail is also "Copy Free". At this time, the thumbnail image need not be encrypted, but may be encrypted.

When the state of the input signal is "no more copy" or "copy prohibited", the thumbnail image cannot be recorded. When the state of the input signal is "copy once", the CCI_thumbnail is rewritten as "no more copy".

If CCI_thumbnail of a thumbnail image is "No more copy", the thumbnail must be encrypted. On the other hand, when CCI_thumbnail of a thumbnail image is "Copy free", it is not necessary to encrypt the thumbnail.

The controller 21 creates application database information about thumbnails and stores them in thumbnail information files, thumbnail picture files, and other database files (info.dvr, PlayList file, Clip Information file) based on the syntax described above. The controller 21 supplies these file information to the encryption unit 22. If it is necessary to encrypt the thumbnail, the encryption unit 22 encrypts it according to the method described above. The encryption unit 22 supplies the file information to the ECC encoding unit 23. The file information is recorded on the recording medium 26 after the ECC encoder 23, the modulator 24, and the drive 25 process.

Next, the case where the transport stream TS input from the terminal 27 is recorded will be described. The E_CCI (Embedded CCI) analysis updating unit 28 analyzes the E_CCI (Embedded CCI) encoded in the input TS by a predetermined method, and controls the CCI (shown as CCI_o in FIG. 26) of the AV stream to be recorded. It supplies to 21. In addition, the E_CCI analysis updater 28 supplies the input TS to the WM detection updater 29. The WM detection updating unit 29 analyzes the water mark of the input video by a predetermined method and supplies the controller 21 the WM (indicated by WM_o in FIG. 26) of the recorded AV stream. The WM detection update unit 29 also supplies an input TS to the multiplexed source packetizer 17. The multiplexing source packetizer 17 converts the input TS into a stream of source packet sequences and supplies it to the stream analyzing unit 20 and the encryption unit 22. The encryption unit (scrambler) 22 encrypts the input AV stream by a predetermined method and supplies it to the ECC encoder 23. The AV stream is recorded in the recording medium 26 as an AV stream file after the processing of the ECC encoder 23, the modulator 24, and the drive 25.

In addition, the input TS from the terminal 27 is input to the decoder 30. The decoder 30 decodes (decodes) the video stream of the input TS and supplies the video information to the video analyzing unit 18. The processing of the video analysis unit 18 and the thumbnail encoder 19 is similar to the case of self-encoding the above-described input video.                 

The stream analyzing unit 20 analyzes the content protection information (DTCP-descrjptor, etc.) in the input stream, extracts the analog copy protection information APS, and supplies it to the controller 21. The APS corresponding to the mark point image of the input stream and the APS_thumbnail of the thumbnail image of those images are set to the same value. The value of CCI_thumbnail is determined by the controller 21 in the same manner as in the case of self-encoding recording of the above-described input video.

28 shows a summary of the duplication control process in the case of recording the input TS.

The processing in FIG. 28 is basically the same as in the case of FIG. 27, but the APS_thumbnail of the thumbnail image is the same as that of the input signal.

If CCI_thumbnail of a thumbnail image is "Nomorecopy", the thumbnail must be encrypted. On the other hand, when CCI_thumbnail of a thumbnail image is "Copy free", it is not necessary to encrypt the thumbnail.

The controller 21 creates application database information about thumbnails and stores them in thumbnail information files, thumbnail picture files, and other database files (info.dvr, PlayList file, Clip Irformation file) based on the syntax described above. The controller 21 supplies these file information to the encryption unit 22. If it is necessary to encrypt the thumbnail, the encryption unit 22 encrypts it according to the method described above. The encryption unit 22 supplies the file information to the ECC encoding unit 23. The file information is recorded on the recording medium 26 after the ECC encoder 23, the modulator 24, and the drive 25 process.

29 shows a flowchart of a process of recording an AV stream and encoding and recording a representative image or a feature point image of the AV stream to a thumbnail.

In step S101, content protection information (CCI, etc.) of the input signal (video information or TS) is analyzed. This process is performed by the macrovision detector 13, the CGMS detection updater 14, the WM detection updater 15, the E_CCI analysis updater 28, or the WM detection updater 29.

In step S102, the input signal is encoded into the AV stream. This process is executed by the MPEG2 AV encoder 16 and the multiplexed source packetizer 17.

In step S103, the video analyzing unit 18 analyzes the video information, and detects the image (the representative image and the feature point image) of the mark point.

In step S104, the video analysis unit 18 acquires the image of the mark point.

In step S105, the thumbnail encoder 19 encodes the image of the mark point into the thumbnail image.

In step S106, the controller 21 analyzes the content protection information (CCI, etc.) at the position on the AV stream indicated by the time stamp of the mark point.

In step S107, the controller 21 creates CP_Info_thumbnail () of the thumbnail image. Specifically, as described above, the values of CCI_thumbnail (FIG. 19) and APS_thumbnail (FIG. 20) are determined.

In step S108, the controller 21 determines encryption ON / OFF of the thumbnail image. In the case of 0N, the encryption unit 22 encrypts the thumbnail image and the tn_block in which the CP_Info_thum1nail () is stored.

In step S109, the controller 21 determines a file for storing the tn_block and records the tn_block in the recording medium 26. The specific recording process is executed by the ECC encoder 23, the modulator 24, and the drive 25.

In step S110, the controller 21 stores the encrypted 0N / 0FF information of the tn_block in a thumbnail information file, and records the thumbnail information file in the recording medium 26. The specific recording process is executed by the ECC encoder 23, the modulator 24, and the drive 25.

Next, FIG. 30 shows a block diagram of a recording apparatus that adds and records thumbnails of images designated by a user to the recorded AV stream.

The application database read out from the recording medium (disk) 75 through the drive 74 is controlled by the demodulator 73, the ECC decryption unit 72, and the decryption unit 71 of the encryption. Is entered. The controller 69 creates a menu screen explaining the recording contents of the recording medium 75, and displays it on a monitor (not shown). The user selects a PlayList to be played back through a UI (User Interface) input of the terminal 61. The controller 69 instructs to read from the recording medium 75 an AV stream necessary for playing the PlayList designated by the user.

The AV stream file read out from the recording medium 75 via the drive 74 is passed through the demodulator 73, the ECC decoder 72, and the encryption decoder 71 to process the source depacketizer separation unit. It is input to (66). The video stream separated by the source depacketizer separator 66 is decoded by the MPEG2 AV decoder 65 and video information is output. The video information is subjected to predetermined processing by the CGMS inserting unit 64 and the macrovision inserting unit 63, output from the terminal 62, and displayed on a monitor (not shown).

The user instructs the controller 69 from the terminal 61 via a UI input from the terminal 61 which scenes to be marked (for example, favorite scenes) are to be displayed.

The thumbnail image to be recorded in addition to the mark point may be created from an image of the mark point, or may be created from an image received in the recording device via an external input from a personal computer or a digital camera.

When creating a thumbnail image from the image of the mark point, the controller 69 obtains the time stamp of the image marked by the user from the source depacketizer separation unit 66. Then, the image of the mark point is obtained from the MPEG2 AV decoder 65, and the image is input to the thumbnail encoder 67. The thumbnail encoder 67 encodes a thumbnail image and inputs it to the controller 69. In addition, the source depacketizer separating unit 66 extracts the content protection information (DTCP descriptor, etc.) at the position on the AV stream indicated by the time stamp of the mark point, and inputs it to the controller 69. The controller 69 interprets the content protection information (DTCP-descriptor, etc.) and extracts CCI and analog copy protection information (APS). Then, the values of CCI_thumbnail and APS_thumbnail of CP_Info_thumbnail () for the thumbnail image of the image of the mark point are set to the same values as the above-described CCI and APS, respectively.

Next, an operation in the case of creating a thumbnail image recorded in addition to the mark point from a still image received by the recording apparatus via an external input such as a personal computer or a digital camera will be described. The controller 69 acquires a still image from the external input terminal 85. Then, the content protection information detection unit 86 retrieves the content protection information (CGMS, APS, DTCP descriptor, etc.) of the input image and inputs it to the controller 69. The controller 69 interprets the content protection information and retrieves the CCI and analog copy protection information (APS). Then, the values of CCI_thumbnail and APS_thumbnail of CP_Info_thumbnail () for the thumbnail picture are set to the same values as the above-described CCI and APS, respectively. Then, the still image is input to the thumbnail encoder 67. The thumbnail encoder 67 encodes a thumbnail image and inputs it to the controller 69.

If CCI_thumbnail of a thumbnail image is "No more copy", the thumbnail must be encrypted. On the other hand, when CCI_thumbnail of a thumbnail image is "Copy free", it is not necessary to encrypt the thumbnail.

The controller 69 creates application database information about thumbnails and stores them in thumbnail information files, thumbnail picture files, and other database files (info.dvr, PlayList file, Clip Iiformation file) based on the syntax described above. The controller 69 supplies these file information to the encryption unit 76. If it is necessary to encrypt the thumbnail, the encryption unit 76 encrypts it according to the method described above. The encryption unit 76 supplies the file information to the ECC encoding unit 77. The file information is recorded in the recording medium 75 after the processing of the ECC encoder 77, the modulator 78, and the drive 74.

31 shows a flowchart of a process of adding and recording thumbnails of images designated by the user to the recorded AV stream.

If a PlayList to be played back by the user is specified in step S201 via the UI, the controller 69 acquires it.

In step S202, the controller 69 starts video playback of the specified PlayList. Specifically, the reproduction processing is performed by the recording medium 75, the drive 74, the demodulation unit 73, the ECC decryption unit 72, and the decryption unit 71 of the encryption.

When the user finds a scene that the user wants to mark in step S203 and presses the mark button during playback or pause, it is input to the controller 69 via the UI.

In step S204, the controller 69 determines the mark position based on this input.

In step S205, the controller 69 confirms with the user whether the image at the mark position is used for the thumbnail or if a still image used for the thumbnail is obtained from an external input. This confirmation is performed by displaying a predetermined message and acquiring an input corresponding to the message from the user. In the case of using the thumbnail, the flow proceeds to step S206. In the case of obtaining a still image used in the thumbnail from an external input, the flow proceeds to step S208.

In step S206, the source depacketization separator 66 acquires an image of the mark position.

In step S207, the source depacketization separator 66 acquires the content protection information of the AV stream at the mark position.

If it is determined in step S205 that the still image used for the thumbnail is obtained from the external input, the content protection information detection unit 86 acquires the still image used for the thumbnail from the external input in step S208.

In step S209, the content protection information detection unit 86 acquires the content protection information of the still image.

In step S210, the thumbnail encoder 67 encodes the image used for the thumbnail into a thumbnail image.

In step S211, the controller 69 creates CP_Info_thumbnail () of the thumbnail image. Specifically, as described above, the values of CCI_thumbnail and APS_thumbnail are determined.

In step S212, the controller 69 determines ON / OFF of encryption of the thumbnail image. In the case of ON, the encryption unit 76 encrypts the thumbnail image and the tn_block in which the CP_Info_thumbnail () is stored.

In step S213, the controller 69 determines a file for storing the tn_block and writes the tn_block to the recording medium 75. This recording is performed by the ECC encoder 77, the modulator 78, and the drive 74.

In step S214, the controller 69 stores the encrypted 0N / 0FF information of the tn_block in a thumbnail information file, and records the thumbnail information file in the recording medium 75.

Next, FIG. 32 shows a block diagram of a reproduction device for reproducing the AV stream and reproducing the thumbnail of the AV stream representative image and the feature point image.

The application database read out from the recording medium 75 via the drive 74 is transferred to the controller 69 via the demodulation unit 73, the ECC decryption unit 72, and the encryption decryption unit 71. Is entered.

The controller 69 determines the thumbnail image to be displayed on the video output. For example, it is decided to display thumbnails of representative images of a certain PlayList.

The controller 69 reads out information about the thumbnail image from the thumbnail information file. In this way, the controller 69 knows the thumbnail image file in which the thumbnail image is stored, and can also know the encryption 0N / 0FF of the thumbnail image.

Next, the controller 69 reads data of the thumbnail image from the thumbnail image file. When the thumbnail image is encrypted, the decryption unit 71 decrypts the password. In addition, the controller 69 acquires CP_Info_thumbnail () for the thumbnail image to be reproduced.

The controller 69 inputs the thumbnail image to the thumbnail decoder 80, and inputs the decoded image to the graphics image processing unit 81. The output image which has been subjected to the predetermined processing by the graphics image processing unit 81 is processed by the image blender processing unit 82 and input to the CGMS insertion unit 64.

The CGMS inserting unit 64 inserts a CGMS signal representing the same meaning as the CCI_thumbnail of CP_Info_thumbnail () for the thumbnail image into the output image. Next, the macrovision inserting unit 63 inserts an analog copy protection signal representing the same meaning as APS_thumbnail of CP_Info_thumbnail () to the output image. Then, the video is played back from the terminal 62.

33 is a flowchart of a reproduction operation for reproducing thumbnail images of AV streams and feature point images.

In step S301, the controller 69 reads the application database information file. Specifically, this reading process is executed by the drive 74, the demodulation section 73, the ECC decoding section 72, and the decoding section 71 from the recording medium 75.

In step S302, the controller 69 determines the thumbnail image to be reproduced based on the input from the UI.

In step S303, the controller 69 reads out information about the thumbnail image from the thumbnail information file.

In step S304, the controller 69 acquires a thumbnail image file in which the thumbnail image is stored, and knows 0N / 0FF of encryption of the thumbnail image.

In step S305, the controller 69 reads out the tn_block in which the thumbnail image is stored from the thumbnail image file. If tn_block is encrypted, the decryption unit 71 decrypts the password.

In step S3O6, the controller 69 obtains CP_Info-thumbnail () of the thumbnail image to be reproduced from the output of the source depacketization separation unit 66.

In step S3O7, the controller 69 supplies the thumbnail picture to the thumbnail decoder 80 and decodes it. The thumbnail image is supplied from the image blender processing unit 82 to the CGMS inserting unit 64 via the processing by the graphics image processing unit 81.

In step S3O8, the controller 69 controls the CGMS inserting unit 64 and the macrovision inserting unit 63, and adds the CGMS and the macrovision to the display image of the thumbnail in accordance with CP_Info_thumbnail () obtained in the process of step S306. .

In step S309, the controller 69 outputs a video of the thumbnail from the terminal 62.

As described above, in the present invention, the following becomes possible.

(1) Since the thumbnail image is encrypted, the copyright of the thumbnail image can be protected.

(2) In the case of recording the AV stream and recording the representative image of the AV stream or the thumbnail image representing the feature point, the recording medium is configured to record information for distinguishing whether or not the thumbnail image is encrypted or not. When there is a possibility that encrypted thumbnail images and unencrypted thumbnail images may be mixed on the image, the encrypted and recorded thumbnail images and the thumbnail images recorded without encryption can be managed separately.

(3) In (2), the thumbnail image file for storing the thumbnail image and the thumbnail information file for storing the information for distinguishing whether or not the thumbnail image is encrypted are recorded separately, so that the thumbnail Information files can be managed in a relatively small database. This makes it possible to easily obtain information at high speed that the thumbnail is encrypted / unencrypted when playback of a thumbnail image is instructed.

(4) In (3), since the thumbnail image file was recorded in two for encrypted thumbnail (menu.tdt1) and non-encrypted thumbnail (menu.tdt2), the encrypted 0N / 0FF in one thumbnail image file was recorded. Since there is no switchover, it is not necessary to switch the decryption 0N / 0FF of the encryption at the time of reading the file (at the time of reproduction), and the decryption processing of the encryption can be simplified.

(5) In (3), since the encrypted thumbnail portion and the non-encrypted thumbnail portion are recorded in a format in which one thumbnail image file is switched, one thumbnail image file becomes one, and the encrypted thumbnail and the unencrypted thumbnail are stored. Easy to manage database to distinguish If encryption and non-encryption are switched in units of tn_block, encryption and non-encryption are switched in units of tn_block, which is the minimum unit, so that unnecessary data is not recorded on the disk. In addition, encryption and non-encryption may be switched in a unit in which a plurality of tn_blocks are integrated. For example, if the unit in which a plurality of tn_blocks are combined is the same as that of an ECC block, it is not necessary to switch between decryption 0N / 0FF of the encryption when the ECC block is read (when playing), thereby simplifying the decryption processing of the encryption. Can be.

(6) In (2), the content protection information (CP_Info_thumbnail ()) is added to the thumbnail image for recording.

(7) In (6), the thumbnail image and its content protection information are recorded in units of blocks of a predetermined size (tn_block).

(8) In (6), the encryption process is closed by one tn_block.

(9) In (2), when the CCI of the original image on which the thumbnail image is created is "Copy once", the thumbnail image is encrypted and recorded.

Since (6) to (9) is performed, the contents of CP_Info_thumbnail () can be prevented from being altered by a malicious user. In addition, even if a thumbnail image having a CCI_thumbnail of "No more copy" is illegally copied to another recording medium with the same data bit-by-bit, it cannot be reproduced or decoded so that it cannot be used.

Since the encryption process is closed by one tn_block, as described in (8), when only a tn_block in which the thumbnail image is stored is read out when an arbitrary thumbnail image is read from the thumbnail image file, the encryption process (decryption) is performed. OK, the data throughput can be minimized.

(10) In (2), when the thumbnail image format is JPEG, since JPEG is widely used as a defect standard, the inflation is relatively easy and the compatibility is high.

(11) Information for distinguishing whether or not a thumbnail image is encrypted / not reproduced when a thumbnail image is reproduced from a recording medium on which a representative image of the video information or a thumbnail image indicating a feature point is recorded together with the video information. In order to reproduce a thumbnail image based on the information, the encrypted thumbnail image and the unencrypted thumbnail image may be mixed on the recording medium. The recorded thumbnail images can be distinguished and managed.                 

In the above description, the thumbnail information file and the thumbnail image file are managed as separate files, but these information may be managed in one file. For example, in one file, each thumbnail image may manage an object in which information about encryption or not is collected and an object in which thumbnail images are collected.

In addition, it is not necessary to manage data in the form of a file (managing data using a file system), and the data may be managed by an object that can be managed by a recording device / reproducing device.

In the above, the recording apparatus and the reproducing apparatus are shown in different configurations, but of course, the recording and reproducing apparatus may be integrated as a recording and reproducing apparatus capable of both recording and reproducing. In this case, among the blocks shown in FIG. 26, FIG. 30, and FIG. 32, the corresponding block is suitably common.

In the above, the AV stream is recorded or reproduced. However, the present invention can be applied to the case where only the video information is recorded or reproduced.

The above-described series of processes may be executed by hardware, but may also be executed by software.

When a series of processes are executed by software, for example, a general-purpose personal computer capable of executing various functions by installing a computer or various programs in which a program constituting the software is incorporated in dedicated hardware. It is installed in a computer or the like from a network or a recording medium.

This recording medium is a magnetic disk (including a floppy disk), an optical disk (CD-ROM (Compact Disk-Read 0nly Memory), and a DVD (Digital) in which a program distributed to supply a program to a user is stored separately from the main body of the apparatus. It includes a Versatile Disk (including Versatile Disk), a magneto-optical disk (including a Mini-Disk (trademark)), a semiconductor memory, and the like, as well as a package medium made of a semiconductor memory. It consists of a ROM, a hard disk, etc. which store the program supplied to the program.

In addition, in this specification, the step of describing the program stored in the recording medium includes the processing performed in time series according to the included order, as well as the processing executed in parallel or separately even if not necessarily in time series. It is.

According to the present invention, when there is a possibility that an encrypted thumbnail image and an unencrypted thumbnail image may be mixed on a recording medium, it is possible to distinguish and manage the encrypted and recorded thumbnail images and the unencrypted thumbnail images.

Claims (32)

First acquiring means for acquiring video information to be recorded; Second acquiring means for acquiring thumbnail image information recorded corresponding to the video information; Encryption means for encrypting the thumbnail image information acquired by the second acquisition means; And recording means for recording the video information acquired by the first acquiring means and the thumbnail image information encrypted by the encrypting means on a recording medium. The method of claim 1, And determining means for determining whether or not to encrypt the thumbnail image information. The method of claim 1, And said second acquiring means acquires said thumbnail image information from said video information acquired by said first acquiring means. The method of claim 2, And the judging means judges whether or not the thumbnail image information is encrypted based on the content protection information of the video information acquired by the first obtaining means. The method of claim 4, wherein And the determining means determines that the thumbnail image information is to be encrypted when the content protection information of the video information acquired by the first obtaining means allows one copy. The method of claim 4, wherein And the recording means also records the content protection information of the thumbnail image information. The method of claim 6, And the encryption means also encrypts the content protection information of the thumbnail image information. The method of claim 7, wherein Each of the thumbnail image information is recorded in one or more blocks having a predetermined data amount, And the recording means records the thumbnail image information in units of predetermined blocks. The method of claim 8, And said encrypting means encrypts said one thumbnail image information within a unit of said predetermined block. The method of claim 9, And the recording means further records identification information for identifying that the encrypted thumbnail image information is recorded. The method of claim 10, And the recording means records the thumbnail image information and the identification information in separate objects, respectively. The method of claim 11, The recording means records the encrypted thumbnail image information in a first object of the object of the thumbnail image information, and records the unencrypted thumbnail image information in a second object of the object of the thumbnail image information. Video information recording apparatus. The method of claim 11, And the recording means records the encrypted thumbnail image information and the unencrypted thumbnail image information in the same object in units of predetermined blocks. delete A video information recording method of a video information recording apparatus for recording video information on a recording medium, A first acquiring step of acquiring recorded video information; A second acquiring step of acquiring thumbnail image information recorded corresponding to the video information; An encryption step of encrypting the thumbnail image information acquired by the processing of the second acquisition step; And a recording step of recording the video information acquired by the processing of the first acquiring step and the thumbnail image information encrypted by the processing of the encrypting step onto the recording medium. A program of a video information recording apparatus for recording video information on a recording medium, A first acquiring step of acquiring recorded video information; A second acquiring step of acquiring thumbnail image information recorded corresponding to the video information; An encryption step of encrypting the thumbnail image information acquired by the processing of the second acquisition step; And a recording step of recording the video information acquired by the processing in the first acquiring step and the thumbnail image information encrypted by the processing in the encrypting step onto the recording medium. The recording medium on which this is recorded. delete Reproducing means for reproducing a signal recorded on the recording medium; Extraction means for extracting a signal of a thumbnail image encrypted from the signal reproduced by said reproduction means; Decoding means for decoding a signal of an encrypted thumbnail image extracted by said extraction means; And output means for outputting a signal of the thumbnail image decoded by the decoding means. The method of claim 18, And said extracting means further extracts identification information identifying that the encrypted thumbnail image information is recorded. The method of claim 19, And determining means for determining whether to decode the thumbnail image information on the basis of the identification information extracted by the extracting means. The method of claim 18, And said extracting means also extracts content protection information of said thumbnail image information. The method of claim 21, And the decoding means also decodes the content protection information of the thumbnail image information. The method of claim 22, Each of the thumbnail image information is recorded in one or more blocks having a predetermined data amount, And the reproducing means reproduces the thumbnail image information in units of predetermined blocks. The method of claim 23, wherein And said decoding means decodes one piece of said thumbnail picture information within said predetermined block unit. The method of claim 19, And the reproducing means reproduces the thumbnail image information and the identification information from independent objects, respectively. The method of claim 25, And the reproducing means reproduces the encrypted thumbnail image information from a first object of the object of the thumbnail image information, and reproduces the unencrypted thumbnail image information from a second object of the object of the thumbnail image information. Video information reproducing apparatus. The method of claim 25, And the reproducing means reproduces the encrypted thumbnail image information and the unencrypted thumbnail image information in units of predetermined blocks of the same object. delete A video information reproducing method of a video information reproducing apparatus for reproducing video information recorded on a recording medium, A reproduction step of reproducing a signal recorded on the recording medium; An extraction step of extracting a signal of an encrypted thumbnail image from the signal reproduced by the processing of the reproduction step; A decoding step of decoding a signal of an encrypted thumbnail image extracted by the processing of said extracting step; And an output step of outputting a signal of the thumbnail image decoded by the processing of the decoding step. A program of a video information reproducing apparatus for reproducing video information recorded on a recording medium, A reproduction step of reproducing a signal recorded on the recording medium; An extraction step of extracting a signal of an encrypted thumbnail image from the signal reproduced by the processing of the reproduction step; A decoding step of decoding a signal of an encrypted thumbnail image extracted by the processing of said extracting step; And an output step of outputting a signal of the thumbnail image decoded by the processing of the decoding step. delete Video information, An encrypted three-nail image relating to the video information, And identification information for identifying that the encrypted thumbnail image is recorded.

Images