RU2372674C2 - Method and device for reproducing data recorded on record medium or in local memory - Google Patents

Abstract

FIELD: information technologies.

SUBSTANCE: device for reproducing the data recorded on record medium includes recording/reading head, local memory and decoder. Recording/reading head reads the main data recorded on the record medium. Local memory stores sub-data associated with the main data. Sub-data can include flows of interactive graphics or flows of text sub-titles. Decoder decodes the main data and sub-data by using PlayList. PlayList file includes the main sequence and sub-sequence. The main sequence includes PlayItem for reproducing the main data. Sub-sequence consists of at least one SubPlayItem associated with PlayItem in order to reproduce sub-data together with the main data. In addition, PlayList file includes the information on the type of sub-sequence which specifies whether SubPlayItem included in the sub-sequence is synchronised with PlayIem.

EFFECT: possibility of reproducing the data recorded on record medium and the data stored in local memory.

30 cl, 11 dwg

Description

Technical field

The present invention relates to a recording medium, and more particularly, to a method and apparatus for reproducing data recorded on a recording medium and in local memory.

State of the art

Optical discs are widely used as recording media for recording arrays of information. Among a wide range of optical discs, a new high-density optical recording medium such as a blu-ray disc (hereinafter referred to as “BD”) is being developed for recording and storing high definition video and audio data for a long period of time. Currently, the global standard technical specifications for blu-ray disc (BD), which is known to be the next generation of recording media technology, are being developed as a next generation optical recording solution that can have significantly more data than a regular DVD, along with many other digital devices. Accordingly, optical recording and reproducing devices accepting blu-ray (BD) discs are also being developed. However, since the blu-ray disc (BD) standard is not yet fully completed, there are many difficulties in developing a complete optical recording and reproducing device.

More specifically, the optical recording and / or reproducing apparatus described above considers (considers) the main function (s) of recording and / or reproducing a blu-ray disc (BD), as well as additional functions, taking into account sharing with respective peripheral digital devices. Thus, in the general case, the optical recording and / or reproducing device should be equipped with the functions of either receiving external input signals and displaying the received signals, or applying external input signals with an integrated blu-ray disc (BD) playback signal for playback.

However, since a unified standard to achieve the additional features described above is not provided in the current blu-ray disc (BD) standard, there are many difficulties in developing a full-scale blu-ray (BD) based optical disc recording and / or playback device. More specifically, a problem may occur in an attempt to reproduce both data existing outside the recording medium and data recorded on the recording medium (eg, a blu-ray disc) as one reproducing device.

Disclosure of invention

Accordingly, the present invention is directed to a device and method for reproducing data recorded on a recording medium and in local memory, which essentially eliminate one or more problems due to limitations and disadvantages of the prior art.

An object of the present invention is to provide a method for configuring a playback control file for reproducing both data recorded on a high density recording medium and data stored in a local memory.

Additional advantages, objects and features of the invention are set forth in part in the description that follows, and in part will become apparent to those skilled in the art after checking the foregoing, or may be studied in the practice of the invention. The objectives and other advantages of the invention can be realized and achieved using the structure, in particular, given in the written description, and its claims, as well as the accompanying drawings.

In order to solve these problems and other advantages, and in accordance with the object of the invention, which is embodied and described in detail below, a method for reproducing data recorded on a recording medium includes reproducing main data recorded on a recording medium and sub-data stored in a local memory using a PlayList file (playlist), which includes a main sequence and a sub-sequence, while the main sequence contains a PlayItem (playitem) for playing back data, and the sub-sequence contains at least one SubPlayItem (sub-data play item) associated with the PlayItem for reproducing sub-data in conjunction with reproduction of the main data, wherein the PlayList file further includes sub-sequence type information which indicates whether at least one SubPlayItem included in the sub-sequence is synchronized with the PlayItem.

In another aspect of the present invention, a method for reproducing data recorded on a recording medium includes reproducing main data recorded on a recording medium and sub-data stored in a local memory using a PlayList file that includes a main sequence and a sub-sequence wherein the main sequence comprises a plurality of PlayItems (playitems) for reproducing the main data, and the sub-sequence contains at least one SubPlayItem associated with the PlayItems, A sub-data reproduction together with the main data reproduction, the PlayList file further includes information type of the sub-sequence, which indicates whether the synchronized at least one SubPlayItem, included in the sub-sequence with PlayItems.

In another aspect of the present invention, a method for reproducing data recorded on a recording medium includes reproducing AV (audio / video) data and original auxiliary data recorded on a recording medium and additional auxiliary data stored in a local memory using a PlayList file that includes the main sequence, the original sub-sequence and at least one additional sub-sequence, and the main sequence contains many PlayItems to play In case of AV data, the original sub-sequence contains a SubPlayItem associated with PlayItems for reproducing the original auxiliary data, with each additional sub-sequence containing at least one SubPlayItem associated with PlayItems for reproducing additional auxiliary data, wherein the PlayList file is additionally includes sub-sequence type information that indicates whether at least one SubPlayItem included in each additional sub-sequence is synchronized with PlayItems.

In another aspect of the present invention, a method for reproducing data recorded on a recording medium includes reproducing AV data and original auxiliary data recorded on the recording medium and additional auxiliary data stored in a local memory using a PlayList file that includes a main sequence and a sub-sequence, the main sequence containing many PlayItem elements for reproducing AV data, and the sub-sequence containing at least one SubP layItem associated with PlayItems for reproducing at least one of the source and additional auxiliary data in conjunction with reproducing AV data, the PlayList file further including sub-sequence type information that indicates whether at least one SubPlayItem included in sub-sequence, with PlayItems.

In another aspect of the present invention, a device for reproducing data recorded on a recording medium includes a write / read head for reading main data recorded on the recording medium, a local memory for storing sub-data associated with the main data, and a decoder for decoding the main data and sub-data using a PlayList file that includes a main sequence and a sub-sequence, the main sequence containing a PlayItem for reproducing the main data, sub the sequence comprises at least one SubPlayItem associated with the PlayItem for reproducing sub-data in conjunction with reproduction of the main data, wherein the PlayList file further includes sub-sequence type information that indicates whether at least one SubPlayItem is included in a sub-sequence, with PlayItem.

In another aspect of the present invention, a device for reproducing data recorded on a recording medium includes a write / read head for reading main data recorded on the recording medium, a local memory for storing sub-data associated with the main data, and a decoder for decoding the main data and sub-data, using a PlayList file that includes a main sequence and a sub-sequence, the main sequence containing many PlayItem elements for playback the main data, and the sub-sequence contains at least one SubPlayItem associated with the PlayItems for reproducing the sub-data in conjunction with the reproduction of the main data, wherein the PlayList file further includes sub-sequence type information that indicates whether at least at least one SubPlayItem included in the sub-sequence, with PlayItems.

In another aspect of the present invention, a device for reproducing data recorded on a recording medium includes a recording / reading head for reading AV data and initial auxiliary data recorded on the recording medium, wherein the original auxiliary data is associated with AV data, a local memory for storing additional auxiliary data associated with the AV data, and a decoder for decoding the AV data and at least one of the original and additional auxiliary data using PlayList, a cat The second one includes a main sequence, an initial sub-sequence and at least one additional sub-sequence, the main sequence containing a plurality of PlayItems for reproducing AV data, the original sub-sequence containing a SubPlayItem associated with PlayItems for reproducing the original auxiliary data, and each additional sub-sequence contains at least one SubPlayItem associated with PlayItems, to play additional auxiliary data, wherein the PlayList file further includes sub-sequence type information that indicates whether at least one SubPlayItem included in each additional sub-sequence is synchronized with the PlayItems.

In a further aspect of the present invention, a device for reproducing data recorded on a recording medium includes a recording / reading head for reading AV data and initial auxiliary data recorded on the recording medium, wherein the original auxiliary data is associated with AV data, a local memory for storing additional auxiliary data associated with the AV data, and a decoder for decoding the AV data and at least one of the source and additional auxiliary data using the Play file List, which includes the main sequence and the sub-sequence, the main sequence containing many PlayItem elements for playing AV data, the sub-sequence containing at least one SubPlayItem associated with PlayItems for playing at least one of the original and additional auxiliary data in conjunction with the reproduction of AV data, wherein the PlayList file further includes information such as a sub-sequence that indicates whether at least ere the SubPlayItem is one, is included in the sub-sequence with the PlayItems.

It should be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to provide an additional explanation of the invention that is claimed.

Brief Description of the Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are included in the description and form part of this application, illustrate embodiment (s) of the invention and together with the description serve to explain the principle of the invention. In the drawings:

figure 1 illustrates a General representation of the present invention;

2 illustrates an example of an AV stream and an interactive graphics stream according to the present invention provided on the same display screen;

3A and 3B illustrate a file structure and a structure of a PlayList file as a playback control file for reproducing an interactive graphics stream according to the present invention;

3C illustrates a recording structure of data recorded on a recording medium according to the present invention;

4 illustrates an optical recording and / or reproducing apparatus according to the present invention;

5A and 5B illustrate a method and apparatus for reproducing data recorded on a recording medium and data stored in a local memory according to the present invention;

6A-7H illustrate examples of a method for creating (or configuring) a playback control file according to the present invention, and more specifically, illustrate examples of a method for creating a PlayList for reproducing interactive graphics streams;

Fig. 8 illustrates an example of an AV stream and a text subtitle stream according to the present invention provided on the same display screen;

9A and 9B illustrate a file structure and a structure of a PlayList file as a playback control file for reproducing a text subtitle stream according to the present invention;

10A-10E illustrate examples of a method for creating (or configuring) a playback control file according to the present invention, and more specifically, illustrate examples of a method for creating a PlayList for reproducing text subtitle streams; and

11A-11G illustrate the syntax of a playback control file according to the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION

The following are links to a detailed description of preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers are used throughout the drawings to refer to the same or similar parts. In addition, although the terms used in the present invention are selected from well-known and used terms, some of the terms mentioned in the description of the present invention were chosen by the applicant at his or her discretion, the specific meanings of which are described in the relevant parts of the description. In addition, it is required that the present invention be understood not only in accordance with the actual terms used, but in accordance with the meaning of each term within it.

According to the present invention, a “playback control file” refers to a control file for reproducing both data recorded on a recording medium and data stored in local memory. More specifically, on a blu-ray disc (BD), a playback control file is called a “PlayList” (Playlist). A detailed description of the playback control file is given below with reference to FIG. 2A and FIG. 2B along with a description of the complete file structure. In other words, although “PlayList” refers to a playback control file in the present invention, it is obvious that different terminology can be used for a recording medium of a different standard than a blu-ray disc (BD). However, it is also apparent that the technical scope of other recording media is not outside the context or scope of the present invention.

Figure 1 illustrates a General view of the present invention. More specifically, FIG. 1 illustrates an example of combined use of an optical recording and / or reproducing apparatus 10 and other peripheral devices. Accordingly, “optical recording and / or reproducing apparatus 10” can record data on optical discs and / or reproduce data from optical discs of various standards. Depending on its design, the device can only record / play back data to / from an optical disc of a specific standard (for example, a blu-ray disc (BD)), or the device can only play back data from an optical disc. However, considering the fact that the blu-ray disc (BD) standard is expected to be completed, and the connection of the blu-ray disc (BD) with other peripheral devices, a Blu-ray disc playback device (BD player) that reproduces data, recorded on a blu-ray disc (BD), or a Blu-ray disc recorder (BD recorder) that writes data to a blu-ray disc (BD) will be given as an example for an optical recording and / or reproducing apparatus 10 according to the present invention. It is also apparent that “optical recording and / or reproducing device 10” may be referred to as a “control device” that can be equipped with computers.

In addition to the function of recording and / or reproducing the optical disc, the optical recording and / or reproducing apparatus 10 according to the present invention also has a function of receiving an external input signal and processing the received signal and outputting the signal to the viewer, transmitting the processed signal to the screen through the display 20. In this case There is no restriction on the external signal that can be input. However, the most common external input is a digital broadcast program (DTV) or the Internet. More specifically, since the Internet is an environment that can be easily accessible to the public, users can use specific data provided on the Internet by downloading such data through an optical recording and / or reproducing device 10. The present invention seeks to efficiently reproduce data by combining the main data and sub-data when the main data is recorded on an optical disc (i.e., BD), which is loaded into the optical recording and / or reproducing apparatus 10, and when the sub-data that is associated with master data exists in an external source such as the Internet.

For simplicity of description of the present invention, “main data” refers to a signal recorded on an optical disc, and “sub-data” refers to a signal existing in an external source outside the optical disc. However, this terminology is based only on the method of obtaining (capturing) data, and the main data and sub-data do not limit the data to only specific data types. Accordingly, the main data typically includes audio data, graphic presentation (PG) data, text subtitles, interactive graphics (IG) data, and so on. Without limiting the above examples, other types of data existing in an external source that are associated with the main data can be used as sub-data. In the present invention, “interactive graphics (IG) data” and “text subtitles” are given as examples of sub-data that is reproduced.

More specifically, it is assumed that a video / audio stream (AV stream) for a particular film is recorded as main data on an optical disc. It is also accepted that the "interactive graphics stream (IG)" associated with the AV stream exists on the Internet as sub-data. The user may then wish to download the interactive graphics stream, which is sub-data existing on the Internet, and then wish to play the downloaded IG stream along with the AV stream included in the main data. In order to satisfy user requests, the association between the AV stream on the optical disk and the loaded and saved interactive graphics stream must be defined, and a systematic method for managing (or controlling) and reproducing data (i.e., the AV stream and IG stream), such as desirable for the user.

Figure 2 illustrates an example of an interactive graphics stream and an AV stream displayed on the same screen. Typically, the AV stream is displayed in full screen. On the contrary, the flow of interactive graphics is displayed only on a small area (also called an “object”) within the screen. The interactive graphics stream can be provided either from the main data (e.g., the main interactive graphics stream) that are recorded on the optical disc, or provided from sub-data (e.g., the auxiliary interactive graphics stream) that are downloaded from an external source.

To satisfy user requests, a file structure is required that connects the main data and sub-data (more specifically, the auxiliary interactive graphics stream), which is described in detail with reference to FIGS. 3A-3C.

With reference to FIG. 3A, which illustrates a file structure for managing information recorded on a disk, at least one BD directory (BDMV) is included in a root directory (root). Each BD directory includes "index.bdmv" and "MovieObject.bdmv", which represent shared files that are used when interacting with one or more users. Each BD directory includes four file directories including data to be reproduced and information required to reproduce the data. The file directories included in each BD directory are the auxiliary data directory (AUXDATA), the stream directory (STREAM), the clip information directory (CLIPINF), and the playlist directory (PLAYLIST).

The auxiliary data directory (AUXDATA) includes additional data files required to play an optical disc, such as a “Sound.bdmv” file, aaaaa.otf file, and so on. The Sound.bdmv file provides sound when an interactive graphics (IG) stream is executed, and the aaaaa.otf file provides font information when playing a disc. The Stream Catalog (STREAM) includes AV stream files and interactive graphics stream files. More specifically, each of the streams may generally be in the form of MPEG2 transport packets. In the BD standard, each of the streams described above is called a clip file. With reference to FIG. 3A, among the stream files, “01000.m2ts” represents an AV stream multiplexed with an interactive graphics stream, “02000.m2ts” represents an independent AV stream that is not multiplexed with any interactive graphics stream, and “10001.m2ts "represents an interactive stream.

Further, the clip information directory (CLIPINF) includes clip information files (for example, 01000.clpi, 02000.clpi, 10001.clpi) that are in one-to-one correspondence with each of the stream files (clip files) included in the stream directory . The clip information file (* .clpi) includes property information and timing information of the stream file (clip file). In the BD standard, each pair of an AV stream (* .m2ts) and its corresponding clip information file (* .clpi), which are in one-to-one correspondence with each other, are designated as a clip. Therefore, each of the files “01000.clpi”, “02000.clpi” and “10001.clpi” included in the clip information directory (CLIPINFO) includes property information and timing information corresponding to each of the files “01000.m2ts", "02000.m2ts" and "10001.m2ts", respectively, which are included in the stream catalog (STREAM). Therefore, each pair of files "01000.clpi" and "01000.m2ts", files "02000.clpi" and "02000.m2ts" and files "10001.clpi" and "10001.m2ts" forms a clip.

More specifically, a clip formed from a pair of “01000.clpi” and “01000.m2ts” is referred to as an “AV clip multiplexed with IG” and a clip formed from a pair of “02000.clpi” and “02000.m2ts” is called "AV clip not multiplexed with IG." In addition, a clip formed from a pair of “10001.clpi” and “10001.m2ts” represents a clip formed only from an “interactive graphics stream” without any AV stream. This clip is called "IG clip". Also in the present invention, a “main clip” refers to a clip associated with the main data that is recorded on the optical disc, and a “sub-clip” refers to a clip associated with the sub-data that are downloaded and stored in local memory.

3A, a playlist directory (PLAYLIST) includes one or more PlayList files (* .mpls), in which each PlayList file (* .mpls) includes at least one PlayItem element (playitem), which determines the playback interval for a particular clip. More specifically, the PlayItem includes information indicating the start time of the presentation and the end of the presentation (In-Time and Out-Time) for playing back a particular clip, which may be referred to as “clip_Information_File_name” in the PlayItem. Accordingly, a PlayList file (* .mpls) represents a play unit (or play unit) reproducing (or playing) a desired clip from a combination of one or more PlayItems. The PlayList also includes SubPlayItem (auxiliary playback elements) for reproducing data that is different from data that is displayed through the PlayItem.

3B illustrates the relationship (or association) between a PlayList file and a main clip. More specifically, the PlayList file includes a main sequence having at least one PlayItem, and the PlayItem includes playback control information for playing a specific AV clip. In addition, whenever required, the PlayList file includes a sub-sequence including at least one SubPlayItem. Here, the SubPlayItem includes playback control information for reproducing at least one clip of interactive graphics (IG # 1, IG # 2). For example, interactive graphics clip # 1 (IG # 1) may provide menu information configured in English. And the interactive graphics clip # 2 (IG # 2) can provide menu information configured in Korean. Therefore, when playing (or playing) the PlayList according to FIG. 3B, the AV stream in the AV clip is reproduced by the PlayItem. Accordingly, the interactive graphics stream corresponds to any of the IG clip # 1 and the IG clip # 2 selected by SubPlayItem, which is not synchronized with the PlayItem. The AV stream, the playback of which is controlled by PlayItem, can be either multiplexed with interactive graphics or not multiplexed with interactive graphics. And this can be selectively applied by the author of the optical disc.

Fig. 3C illustrates the general structure of information (or data) associated with the structure of a file that is recorded on an optical disc according to the present invention. More specifically, starting from the inner circumference (or center) of the disk, the disk volume includes a file system information area occupying the most internal part of the disk volume, a stream region occupying the most external part of the disk volume, and a database area between the file information area system and data stream area. In the file system information area, system information for managing complete data files is recorded. And main data, such as audio / video / image data, is recorded in the stream area. Shared files, PlayList files, and clip information files are recorded in the database area of the disk volume. Therefore, using the information in the database area, the user is able to select the stream that the user wants to play, and decide and use the appropriate way to play the selected stream.

Accordingly, if the interactive graphics stream is multiplexed with the AV stream, and both streams are recorded on an optical disc, then these two streams are synchronized. However, if the interactive graphics stream recorded on the optical disc is not multiplexed with the AV stream, then the interactive graphics stream and the AV stream are not synchronized. In addition, since the interactive graphics stream that is stored in the local memory is stored at a location (or position) other than that of the AV stream that is recorded and stored on the optical disc, it is obvious that this interactive graphics stream is not multiplexed with the AV stream . However, when the user wants to reproduce the interactive graphics stream that is stored in local memory along with the AV stream that is recorded on the optical disc, the user must take into account the case when both streams are synchronized and played, as well as the case when both streams are not synchronized and reproduced. The present invention seeks to provide a method for creating a preferred PlayList (playlist) and method and apparatus for reproducing data using a newly created PlayList. Accordingly, a PlayList created according to the present invention is referred to as a “composite PlayList”. However, this terminology is used simply to distinguish a newly created PlayList from an existing PlayList.

4 illustrates an optical recording and / or reproducing apparatus 10 according to the present invention. The optical recording and / or reproducing device mainly includes a write / read head 11 for reproducing control information including basic data and file information recorded on the optical disc, a servo unit 14 controlling the operation of the write / read head 11, the signal processor 13 or a reproducing reconstruction signal received from the write / read head 11 to the value of the desired signal, or modulating data to be recorded on the signal recorded on the optical disc, and giving modulated data, a local memory 15, storing sub-data that is downloaded from an external source, and a microcomputer 16, organically managing the above operations. In addition, the controller 12 loads the sub-data existing in the external source according to the user command and stores the downloaded sub-data in the local memory 15. The controller 12 then creates a composite PlayList for reproducing the main data recorded on the optical disc and the sub-data, stored in the local memory 15. Then, in accordance with the user command, the controller 12 reproduces the main data and sub-data using the composite PlayList. The decoder 17 performs the final decoding of the output data (i.e., the main data and / or sub-data) in accordance with the control from the controller 12 and provides decoded data to the user. In addition, in order to record the signal on the optical disk, the encoder 18 converts the input signal into a signal of a certain format (for example, the MPEG2 transport stream) according to the control from the controller 12 and provides the converted signal to the signal processor 13.

Local memory 15 storing sub-data can also be configured, for example, as a hard disk drive (HDD, HDD). And the newly created composite PlayList can either be stored in local memory 15 for future use or can be temporarily stored in a separate dynamic memory and used. As an example of the present invention, the optical recording and / or reproducing apparatus separately creates a new composite PlayList. In another example, when loading sub-data and saving loaded sub-data, a composite PlayList can also be loaded and saved. In this case, it is not required that the optical recording and / or reproducing device 10 creates another separate composite PlayList. In addition, if the user wants to store the sub-data and the composite PlayList in the local memory 15 for future use, it is preferable to set a higher priority when using the PlayList recorded on an optical disc that only controls master data.

In the structure of the optical recording and / or reproducing apparatus 10 according to the present invention shown in FIG. 4, FIG. 5A and FIG. 5B, illustrate a data reproducing apparatus and method for reproducing data, respectively. More specifically, when an optical disc having the identification information (disc_id) of disc # 1, that is, disc_id = # 1, is loaded, the controller 12 of the optical recording and / or reproducing apparatus 10 checks the identification information of the corresponding disc using the write / read head 11 and the signal processor 13. Then, the controller 12 checks whether a set of sub-data associated with “disc_id = # 1” exists among the sub-data stored in the local memory 15 (S10).

For example, if three auxiliary interactive streams (Aux IG 1, Aux IG 2, Aux IG 3) exist in the local memory 15 for "disc_id = # 1", the controller 12 first selects the playback (or playback) stream in accordance with the user's request or system settings (S20). In other words, the controller 12 can notify the user that the auxiliary interactive graphics stream exists as sub-data, and then the controller 12 can either play only the main data recorded on the disc, or select and play the composite PlayList including the auxiliary interactive graphics stream in local memory 15, in accordance with a user command or system settings. Therefore, when the user desires to combine and play back the main data recorded on the optical disc and the sub-data stored in the local memory 15, the controller 12 creates the composite PlayList file and uses the newly created composite PlayList file to reproduce the data (S202).

Accordingly, the newly created composite PlayList file is stored in the local memory 15, which can be used again when playing back sub-data in a later process. Fig. 5A illustrates an example of a composite PlayList file already stored in the local memory 15 to reproduce an auxiliary audio stream, which is sub-data for "disc_id = # 2". Therefore, when an optical disc having a disc identifier equal to "disc_id = # 2" is loaded into the optical recording and / or reproducing apparatus 10, a composite PlayList is used, which is already stored in the local memory 15, and data reproduction can be performed immediately without need Create a new composite PlayList. In addition, as described above, the composite PlayList can also be loaded and can be used. Various methods for creating a composite PlayList object according to the present invention are described in detail below with reference to FIGS. 6A to 7H.

Features common to all methods for creating a PlayList composite object according to the present invention are described below. File information for reproducing master data and sub-data in combination is included in the PlayList file. Here, the main data is reproduced by at least one PlayItem included in the main sequence and by SubPlayItem included in the sub-sequence in the PlayList file. And the sub-data is reproduced only by the SubPlayItem included in the sub-sequence in the PlayList file.

In addition, an interactive graphics stream is given as an example of sub-data that can be applied, in FIG. 6A to FIG. 7H. More specifically, the auxiliary interactive graphics stream stored in the local memory may be configured in a language different from that of the main interactive graphics stream recorded in the main data. Alternatively, even if the sub-data is configured in the same language as the main stream, the sub-data can be configured to have a different attribute. Such an attribute may include a graphic characteristic, menu information represented by an interactive graphics stream, and so on. In other words, the auxiliary interactive graphic stream is used either to replace the main interactive graphic stream existing on the optical disk or to add a new interactive graphic stream. Alternatively, when the main interactive graphics stream does not exist on the optical disc, the auxiliary interactive graphics stream may be used to further support interactive graphics.

In addition, when the main interactive graphics stream included in the main data is multiplexed with the AV stream, the main interactive graphics stream is reproduced by PlayItem. Conversely, when the main interactive graphics stream is not multiplexed with the AV stream, the main interactive graphics stream is identified as a separate IG stream that is reproduced by SubPlayItem. Therefore, when reproducing the auxiliary interactive graphics stream along with the main data (for example, the AV stream and the main interactive graphic stream), both cases of the auxiliary IG stream synchronized with the main data and reproduced, and the auxiliary IG stream that is not synchronized with the main data and reproduced, described in the description of the present invention.

In addition, the file information used to reproduce the main data and sub-data is linked in the PlayList file. In particular, the auxiliary interactive graphics stream is configured from a separate sub-sequence in a PlayList composite object. At least one SubPlayItem is created here in a sub-sequence to control the playback of the auxiliary interactive graphics stream. Finally, in order to create a composite PlayList according to the present invention, the information associated with the composite PlayList must be previously stored in the local memory 15. More specifically, the associated information must be prepared in advance by the author of the optical disc, which is then downloaded from an external source along with sub data. With reference to FIG. 5A, the “Info” stored in the local memory 15 is the information required to create a composite PlayList. Among the methods for creating a composite PlayList according to the present invention, FIGS. 6A-6E illustrate examples of creating another sub-sequence for controlling reproduction of the “auxiliary interactive graphics stream” when the “main interactive graphics stream” is configured as a separate stream that is not multiplexed with the AV stream, and when a separate sub-sequence exists to reproduce the main stream of interactive graphics. In other words, the examples shown in FIGS. 6A-6E are mainly applied when the “auxiliary interactive graphics stream” is not synchronized (that is, is “asynchronized”) with the AV stream included in the main data. Here, the examples shown in FIGS. 6A-6E are not limited to only when the auxiliary interactive graphics stream is not synchronized with the AV stream included in the main data. Depending on the application, these examples can also be taken in cases where the auxiliary interactive graphics stream is synchronized with the AV stream included in the main data.

With reference to FIG. 6A, when creating (or configuring) a sub-sequence for an auxiliary interactive graphic stream, a sub-sequence is created for each of the auxiliary interactive graphic streams. For example, each of sub-sequence # 2, sub-sequence # 3, and sub-sequence # 4 are configured to individually and appropriately control the playback of auxiliary interactive graphics stream # 1, auxiliary interactive graphic stream # 2 and auxiliary interactive graphic stream # 3, which stored in the local memory 15. Accordingly, sub-sequence # 1 controls the reproduction of the main stream of interactive graphics recorded on the optical disc. And the method for controlling the main IG stream using sub-sequence # 1 is identical to that described in FIG. 3B. More specifically, in this example, when three auxiliary interactive graphic streams exist in local memory, as shown in FIG. 5A, a sub-sequence is created for each of the three auxiliary interactive graphic streams so that each auxiliary IG stream is controlled by a corresponding SubPlayItem, thus creating the structure "1 stream = 1 SubPlayItem = 1 sub-sequence". Therefore, when playing back the composite PlayList described above, any of the interactive graphics streams that are designated as sub-sequence # 1 ~ sub-sequence # 4 can be selectively reproduced along with the main AV data that is included in the optical disc and indicated by the main sequence. In other words, one of the main interactive graphics stream recorded on the disc and the auxiliary interactive graphics stream stored in the local memory 15 can be selectively reproduced. However, depending on the application, when the auxiliary interactive graphics stream exists, it is possible to set a higher priority when playing any of the auxiliary interactive graphics streams.

With reference to FIG. 6B, when creating (or configuring) a sub-sequence for an auxiliary interactive graphic stream, a plurality of auxiliary interactive graphic streams are combined to be controlled by a single sub-sequence. For example, each of the auxiliary interactive graphic stream # 1, auxiliary interactive graphic stream # 2 and auxiliary interactive graphic stream # 3 stored in the local memory 15 is respectively designated SubPlayItem # 2, SubPlayItem # 3 and SubPlayItem # 4. In addition, SubPlayItem # 2, SubPlayItem # 3, and SubPlayItem # 4 are collectively denoted by a single sub-sequence (e.g., sub-sequence # 2). Accordingly, sub-sequence # 1 controls the reproduction of the main stream of interactive graphics recorded in the optical disc. And the method controlling the main IG stream using sub-sequence # 1 is identical to that described in FIG. 3B.

More specifically, in this example, when three auxiliary interactive graphic streams exist in local memory, as shown in FIG. 5A, each of the auxiliary interactive graphic streams is respectively designated SubPlayItem # 2, SubPlayItem # 3 and SubPlayItem # 4. Here, the three SubPlayItems streams are combined to create a single sub-sequence (for example, sub-sequence # 2), thus creating a structure of “1 stream = 1 SubPlayItem”, which is also the structure of “many SubPlayItems = 1 sub-sequence”. Therefore, when playing the composite PlayList described above, any of sub-sequence # 1 and sub-sequence # 2 is selected to perform playback. Then, any of the SubPlayItems that is indicated by the selected sub-sequence can be selectively reproduced along with the main AV data that is included in the optical disc and indicated by the main sequence.

With reference to FIG. 6C, when creating (or configuring) a sub-sequence for an auxiliary interactive graphic stream, a plurality of auxiliary interactive graphic streams are combined to create a single SubPlayItem. For example, the auxiliary interactive graphics stream # 1, the auxiliary interactive graphics stream # 2 and the auxiliary interactive graphics stream # 3, which are stored in the local memory 15, are combined to have playback control by a single SubPlayItem (e.g., SubPlayItem # 2). Here, SubPlayItem # 2 is configured to be included in a single sub-sequence (sub-sequence # 2). Accordingly, sub-sequence # 1 controls the reproduction of the main stream of interactive graphics recorded in the optical disc. And the method for controlling the main IG stream using sub-sequence # 1 is identical to that described in FIG. 3B.

More specifically, in this example, when three auxiliary interactive graphic streams exist in local memory, as shown in FIG. 5A, each of the auxiliary interactive graphic streams is respectively designated SubPlayItem # 2, SubPlayItem # 3 and SubPlayItem # 4. Here, three SubPlayItems are combined and denoted by one SubPlayItem (e.g., SubPlayItem # 2). Then, SubPlayItem includes a single sub-sequence (for example, sub-sequence # 2), thus creating the structure of "many streams = 1 SubPlayItem = 1 sub-sequence". Therefore, when playing back the composite PlayList described above, any of sub-sequence # 1 and sub-sequence # 2 is selected to perform playback. Then, any of the interactive graphics streams, which is indicated by the selected sub-sequence, can be selectively reproduced along with the main AV data, which are included in the optical disc and indicated by the main sequence.

Among the methods for creating a composite PlayList according to the present invention, FIGS. 6D and 6E illustrate examples of integrating a sub-sequence to control the “mainstream interactive graphic stream” and a sub-sequence to control the “secondary interactive graphic stream” in a single sub-sequence. With reference to FIG. 6D, a plurality of SubPlayItems is configured in a single sub-sequence to control reproduction of a main interactive graphic stream and an auxiliary interactive graphic stream. More specifically, in a single sub-sequence, SubPlayItem # 1 denotes a plurality of main interactive graphic streams (main interactive graphic stream # 1, main interactive graphic stream # 2, main interactive graphic stream # 3), thereby controlling playback of the main interactive graphic stream. In the same single sub-sequence, a SubPlayItem (SubPlayItem # 2, SubPlayItem # 3, SubPlayItem # 4) is created for each auxiliary interactive graphics stream stored in the local memory 15, thereby controlling the playback of the auxiliary interactive graphics stream. And thus, each of SubPlayItem # 2, SubPlayItem # 3 and SubPlayItem # 4 is created to individually designate each of the auxiliary interactive graphics stream # 1, auxiliary interactive graphics stream # 2 and auxiliary interactive graphics stream # 3. Here, the main streams of interactive graphics are configured to be indicated by SubPlayItem # 1. In other words, SubPlayItem # 1, SubPlayItem # 2, SubPlayItem # 3 and SubPlayItem # 4 are configured in a single sub-sequence.

With reference to FIG. 6E, a single SubPlayItem is configured in a single sub-sequence to control reproduction of the main interactive graphics stream and the auxiliary interactive graphics stream. More specifically, a single SubPlayItem (SubPlayItem # 1), combining the main interactive graphics stream and the auxiliary interactive graphics stream to control playback, is included in a single sub-sequence. Therefore, SubPlayItem # 1 combines all of the many main streams of interactive graphics (main stream of interactive graphics # 1, main stream of interactive graphics # 2, main stream of interactive graphics # 3) recorded on the optical disc, and many auxiliary streams of interactive graphics (auxiliary stream of interactive graphics # 1, auxiliary stream of interactive graphics # 2, auxiliary stream of interactive graphics # 3) stored in the local memory 15, so as to control the playback of streams of interactive graphics and thereby creating a structure of "all the main / subsidiary streams, interactive graphic = 1 SubPlayItem = 1 sub-sequence."

Among the methods for creating a composite PlayList according to the present invention, FIGS. 7A-7H illustrate examples of creating a sub-sequence for controlling reproduction of the “auxiliary interactive graphics stream” when the “main interactive graphics stream” is multiplexed with the AV stream, or when the “main interactive stream graphics "is not recorded on an optical disc. In other words, the examples shown in FIGS. 7A-7H are mainly applied when the “auxiliary interactive graphics stream” is synchronized with the AV stream included in the main data. In addition, in order to synchronize the "auxiliary interactive graphics stream" with the AV stream included in the main data, it is obvious that synchronization information is required indicating at which position of the main AV stream the auxiliary interactive graphics stream is synchronized. Synchronization information should be provided from a SubPlayItem included in a sub-sequence, as described in detail below with reference to FIGS. 7A-7H. Here, the examples shown in FIGS. 7A-7H are not limited to only when the auxiliary interactive graphics stream is synchronized with the AV stream included in the main data. Depending on the application, these examples can also be taken in cases where the auxiliary interactive graphics stream is not synchronized with the AV stream included in the main data.

With reference to FIG. 7A, when creating (or configuring) a sub-sequence for an auxiliary interactive graphics stream, a SubPlayItem is created in a sub-sequence in which a SubPlayItem corresponding according to one-to-one correspondence with each PlayItem in the main sequence is created (or configured ) individually. More specifically, by designating SubPlayItem as simultaneously corresponding to all PlayItems in the PlayList, the main interactive graphic stream that is included in the main clip and designated by each PlayItem can be replaced by the auxiliary interactive graphic stream that is included in the sub-clip and indicated by each of the respective SubPlayItems. This simplifies the system and makes it easy to manage every PlayItem. Therefore, when playing an optical disc using the composite PlayList described above, the video / audio (A / V) signal is provided by the main AV stream recorded on the disc, and the main interactive graphics stream is provided by the auxiliary interactive graphics stream stored in the local memory 15. In other words , the main interactive graphics stream recorded on the optical disc is replaced by the auxiliary interactive graphics stream stored in the local memory 15.

With reference to FIG. 7B, when creating (or configuring) a sub-sequence for an auxiliary interactive graphics stream, a SubPlayItem is created in a sub-sequence in which a SubPlayItem corresponding according to one-to-one correspondence with each PlayItem in the main sequence is created (or configured ) individually. However, the corresponding SubPlayItem may not exist for all PlayItems. In other words, by designating a SubPlayItem corresponding to a specific PlayItem in a PlayList, only the main interactive graphic stream that is included in the main clip and designated by the specific PlayItem can be replaced by the auxiliary interactive graphic stream that is included in the sub-clip and indicated by the corresponding SubPlayItem. Therefore, when playing an optical disc using the composite PlayList described above, the interactive graphics stream is provided by an auxiliary interactive graphics stream stored in the local memory 15. However, when the SubPlayItem does not exist, the interactive graphics stream is provided by the main interactive graphics stream, which is included in the main clip and marked with the corresponding PlayItem. Video / audio (A / V) signal is provided by the main AV stream, which is recorded on an optical disc.

With reference to FIG. 7C, when creating (or configuring) a SubPlayItem in a sub-sequence for an auxiliary interactive graphics stream, a SubPlayItem corresponding according to one-to-one correspondence with each PlayItem in the main sequence is created (or configured) individually. However, many matching SubPlayItems may exist for a single PlayItem. In other words, in FIG. 7A and FIG. 7B, one corresponding SubPlayItem exists for each PlayItem. In contrast, in FIG. 7C, a plurality of corresponding SubPlayItems exists for a single PlayItem. 7C here only illustrates an example for a single PlayItem (PlayItem # 1). However, it is obvious that this aspect of the present invention can be identical applied also to other PlayItems (PlayItem # 2, PlayItem # 3).

More specifically, by designating a plurality of SubPlayItems corresponding to a specific PlayItem in a PlayList, the main interactive graphic stream that is included in the main clip and designated by the PlayItem can be replaced by an auxiliary interactive graphic stream that is included in the many sub-clips and indicated by the corresponding set of SubPlayItems. For example, the main interactive graphic stream that is reproduced by PlayItem # 1 can be reproduced by replacing two auxiliary interactive graphic streams for each section, both streams having a different attribute (for example, language). Therefore, when playing an optical disc using the composite PlayList described above, the interactive graphics stream is provided by an auxiliary interactive graphics stream stored in the local memory 15. However, when SubPlayItem does not exist, the interactive graphics stream is provided by the main interactive graphics stream, which is included in the main clip and is indicated through PlayItem. Video / audio (A / V) signal is provided by the main AV stream, which is recorded on an optical disc.

With reference to FIG. 7D, when creating (or configuring) a SubPlayItem in a sub-sequence for an auxiliary interactive graphics stream, a SubPlayItem corresponding according to one-to-one correspondence with each PlayItem in the main sequence is created (or configured) individually. However, SubPlayItems that match PlayItem can only exist in a partial section among the entire playback section (or presentation) that is played using PlayItem. More specifically, in FIG. 7A, FIG. 7B and FIG. 7C, one or more SubPlayItems coincide with one full PlayItem section.

However, in FIG. 7D, a SubPlayItem corresponding to one PlayItem exists only in a partial section. In other words, by designating a SubPlayItem corresponding to a specific PlayItem included in the PlayList during only a partial section, each of the main interactive graphics stream that is included in the main clip and specified by the PlayItem, and the auxiliary interactive graphic stream that is included in the sub-clip and indicated by SubPlayItem, alternately played throughout the playback section, which is played through the corresponding PlayItem.

Therefore, since it is not required that the playback section (or presentation section) of the SubPlayItem in the sub-sequence is identical to the PlayItem in the main sequence, SubPlayItem can use the auxiliary audio stream more diversely. However, in this case, a boundary is created between the reproduction (or presentation) of the main clip and the reproduction (or presentation) of the sub-clip. Here, the main clip is reproduced by the PlayItem (e.g., PlayItem # 1), and then the playback of the main clip is changed to the sub-clip. At this point, the system must be supported so that a “smooth” presentation between interactive graphic flows can be made even at the border.

With reference to FIG. 7E, when creating (or configuring) a SubPlayItem in a sub-sequence for an auxiliary interactive graphic stream, a SubPlayItem matching one-to-one correspondence with each PlayItem in the main sequence is created (or configured) individually. However, each of the SubPlayItems matches its corresponding PlayItem in various ways. More specifically, in FIG. 7E, examples of creating a SubPlayItem, as shown in FIGS. 7A-7D, can be applied to each PlayItem. For example, a method of replacing an entire section of PlayItem # 1 with SubPlayItem (as shown in FIG. 7A or FIG. 7B), a method of replacing an entire section of PlayItem # 2 with a plurality of SubPlayItems (as shown in FIG. 7C), and a method of replacing only part of an entire section of PlayItem # 3 on the SubPlayItem (as shown in FIG. 7D) all apply in FIG. 7E.

With reference to FIG. 7F, when creating (or configuring) a SubPlayItem in a sub-sequence for an auxiliary interactive graphics stream, a SubPlayItem matching the entire PlayList presentation section is created (or configured) individually. More specifically, by indicating a SubPlayItem that matches all PlayItems in the PlayList at the same time, the main interactive graphics streams included in the main clip and indicated by each PlayItem can be replaced by the auxiliary interactive graphic stream included in the single sub-clip and indicated by the corresponding single SubPlayItem. Thus, the system can be simplified.

With reference to FIG. 7G, when creating (or configuring) a SubPlayItem in a sub-sequence for an auxiliary interactive graphics stream, a SubPlayItem matching the entire PlayList presentation section is created (or configured) individually. Here, the presentation section is chronologically defined in the SubPlayItem, which includes information about the start time of the presentation (In-time) and the end time of the presentation (Out-time) of the sub-clip whose playback is controlled. In the case of FIG. 7F, SubPlayItem includes In-time and Out-time matching the In-time and Out-time of the playback (or presentation) of the main sequence included in the PlayList. However, in the case of FIG. 7G, the SubPlayItem includes a plurality of In-time and Out-time. Accordingly, each section defined as In-time and Out-time is called a “time interval”. For example, FIG. 7G illustrates the three time slots “time slot # 1”, “time slot # 2”, and “time slot # 3” included in the SubPlayItem. A time interval can be created from a random section. However, the time interval may also coincide with PlayItem # 1, PlayItem # 2 and PlayItem # 3 in the main sequence.

With reference to FIG. 7H, when creating (or configuring) a SubPlayItem in a sub-sequence for an auxiliary interactive graphics stream, a SubPlayItem matching only a partial section of the entire PlayList section is created (or configured) individually. More specifically, in the case of FIG. 7F, a single SubPlayItem is created having In-time and Out-time matching the entire PlayItem section (i.e., the presentation (or recording) of the PlayList section). However, in FIG. 7H, a SubPlayItem is created having an In-time and Out-time corresponding to a partial section in the entire PlayItem section (i.e., the presentation (or record) of the PlayList section). Accordingly, it is obvious that the concept of “time interval”, which is applied in FIG. 7G, can also be applied identically in FIG. 7H.

In other words, part of the full presentation section of the main data reproduced (or represented) by the PlayList is replaced by sub-data. For example, the part of the full section that is played using the composite PlayList reproduces the main stream of interactive graphics, and the other part of the entire section reproduces the auxiliary stream of interactive graphics. Therefore, since it is not required that the playback section (or presentation section) of the SubPlayItem in the sub-sequence is identical to the PlayItem in the main sequence, SubPlayItem can use the auxiliary interactive graphics stream more diversely. However, in this case, a boundary is created between the reproduction (or presentation) of the main clip and the reproduction (or presentation) of the sub-clip. Here, the main clip changes to sub-clip playback during the playback of the main clip. At this point, the system should be supported so that a smooth presentation can be performed between audio streams even at the border.

As described above, figa-7H illustrate examples of creating a single sub-sequence. Obviously, the methods described in FIGS. 6A-6C can be used to create multiple sub-sequences. More specifically, when the "main interactive graphics" exists as a separate stream that is not multiplexed with the main AV stream, it is preferable to apply any of the methods described in figa-6E. Alternatively, when the "main interactive graphics" is multiplexed with the main AV stream, it is preferable to apply any of the methods described in figa-7H. On the other hand, when the "auxiliary interactive graphics" is not synchronized with the main AV stream, it is preferable to apply any of the methods described in figa-6E. Alternatively, when the "auxiliary interactive graphics" is synchronized with the main AV stream, it is preferable to apply any of the methods described in figa-7H.

Methods for creating and playing back (or reproducing) a PlayList for controlling reproduction of a text subtitle stream as auxiliary data together with the main data with reference to FIGS. 8 to 10E are described in detail below. Accordingly, a text subtitle stream, which is a set of information provided in text form, is generally used as an imposed dialogue in a movie. Therefore, the text subtitle stream according to the present invention should be provided after synchronization with the AV stream. This is different from the interactive graphics stream described above, which includes the case where the interactive graphics stream is synchronized with the AV stream, and the case where the interactive graphics stream is not synchronized (i.e., asynchronized) with the AV stream. In addition, the text subtitle stream according to the present invention corresponds to the entire PlayList presentation section. In other words, the text subtitle stream is not provided for each PlayItem, and the playback of the text subtitle stream is controlled by SubPlayItem, which is synchronized with the main sequence. This is in contrast to examples of creating a SubPlayItem for each PlayItem when the interactive graphics stream is synchronized with the AV stream (shown in FIGS. 7A-7E).

8 illustrates an example of an AV stream and a text subtitle stream provided on a display screen. Text subtitles can be provided either from the master data or through the sub-data. 9A and 9B illustrate a file structure according to the present invention and a structure of a PlayList file as a playback control file for reproducing a text subtitle stream. More specifically, compared with FIG. 3A, the text subtitle stream shown in FIG. 9A is configured from a separate text subtitle clip that is not multiplexed with the AV stream. In addition, with reference to FIG. 9B, playback of a text subtitle clip is controlled by a SubPlayItem included in a sub-sequence. 10A-10E illustrate examples of creating (or configuring) a playback control file according to the present invention. More specifically, FIGS. 10A-10E illustrate methods for creating a PlayList for reproducing a text subtitle stream. Accordingly, the examples shown in FIGS. 10A to 10E have the same structure as each of the examples used in the interactive graphics stream shown in FIGS. 6A to 6E, respectively. However, since the text subtitle stream is reproduced after synchronization with the main AV stream, as described above, it is obvious that each SubPlayItem provided in the examples shown in FIGS. 10A-10E has a set of synchronization information for synchronization with the AV stream. Therefore, since the examples shown in FIGS. 10A-10E have a structure like the example shown in FIGS. 6A-6E, a description thereof is omitted for simplicity.

11A-11G illustrate the syntax of a composite PlayList file for reproducing auxiliary data stored in local memory 15 through each hierarchy. 11A illustrates the syntax of a portion of the header of a PlayList file (xxxxx.mpls). Identification information, such as the MPLS character code identifying the current file as a PlayList file, is recorded in the type_indicator field. Information indicating the version of the PlayList file is recorded in the "version_number" field. Position information indicating at which position the PlayList () field starts is recorded in the PlayList_start_address field, and position information indicating at which position the PlayListMark () field starts is recorded in the PlayListMark_start_address field. In addition, the PlayList file (xxxxx.mpls) includes the "AppInfoPlayList ()" field, the "PlayList ()" field, and the "PlayListMark ()" field. The "AppInfoPlayList ()" field includes information regarding a method of reproducing (or playing) (i.e., PlayList_playback_type). The "PlayList ()" field includes PlayItem information and sub-sequence information, and the "PlayListMark ()" field includes a label pointer that is used for special playback (or playback). A detailed description of the "PlayList ()" field according to the present invention is given below.

11B illustrates the syntax of the header of the "PlayList ()" field included in the PlayList file. Here information about the size of the "PlayList ()" field is recorded in the "length" field. Information on the number of PlayItems included in the PlayList file is recorded in the number_of_PlayItem field, and information on the number of sub-sequences included in the PlayList file is recorded in the number_of_SubPaths field. Accordingly, the "PlayItem ()" and the "SubPath ()" fields are created based on the quantity information described above. The "PlayItem ()" field includes the "STN_table ()" field, in which all the stream information that can be used in the corresponding PlayItem. When reproducing the "PlayItem ()" field and the "SubPath ()" field associated with it, the optical recording and / or reproducing device 10 can select and play stream information defined in the "STN_table ()" field. Therefore, all of the above flow information (shown in FIG. 6A to FIG. 10E) is recorded in the “STN_table ()” field.

Below, the syntax for the “STN_table ()” field in the “PlayItem ()” field is described in detail with reference to FIGS. 11C and 11E, and the syntax for the “SubPath ()” field is described in detail with reference to FIG. 11F. And the syntax for the “SubPlayItem ()” field is described with reference to FIG. 11G. 11C illustrates the syntax of the header of the STN_table () field included in the PlayItem () field. More specifically, the size information of the "STN_table ()" field is recorded in the "length" field. The number of playable video streams associated with the PlayItem is recorded in the number_of_video_stream_entries field (the number of video stream entries), and the number of playable audio streams associated with the PlayItem is recorded in the number_of_audio_stream_entries field (number of audio stream entries). The number of playable text subtitle streams that are associated with the PlayItem is recorded in the number_of_PG_textST_stream_entries field. And finally, the number of playable interactive graphics streams that are associated with the PlayItem is recorded in the number_of_IG_stream_entries field. The flow information is recorded in accordance with the quantity information described above for each corresponding field. However, each of the stream information is respectively recorded in the field "stream_entry ()" and "stream_attributes ()". Here, the stream type, the main clip information and the sub-clip information are recorded in the stream_entry () field, and the attribute information of each stream is recorded in the stream_attributes () field.

11D illustrates the syntax of the stream_entry () field, which is included in the STN_table () field. More specifically, the size information of the stream_entry () field is recorded in the length field, and the source information of the corresponding stream is recorded in the type field. For example, type “1” represents the type of stream that is included in the main clip and indicated by PlayItem. Type "2" represents the type of stream, which is denoted by a sub-sequence and is recorded on an optical disc. And type "3" represents the type of stream, which is denoted by a sub-sequence and stored in local memory 15. Therefore, when the type of the current field "stream_entry ()" is "1", the packet identifier information (PID) of the corresponding main clip is recorded in the field " ref_to_stream_PID_of_mainclip ". And when the type of the current field "stream_entry ()" is "2" or "3", the packet identifier (PID) information of the corresponding sub-clip is recorded in the "ref_to_stream_PID_of_subclip" field. Obviously, when a plurality of sub-sequences are included, the identification information of the corresponding sub-sequence is recorded in the "ref_to_SubPath_id" field, and the identification information of the corresponding sub-sequence is recorded in the "ref_to_Subclip_entry_id" field.

11E illustrates the syntax of the stream_attributes () field, which is included in the STN_table () field. More specifically, the size information of the stream_attributes () field is recorded in the length field, and stream type information is recorded in the stream_coding_type field. For example, "stream_coding_type = 0 × 02" represents a video stream (more specifically, an MPEG2 video stream), and attribute information is recorded in the "frame_rate" field. In addition, "stream_coding_type = 0 × 80 or 0 × 81 or 0 × 82" represents an audio stream that is encoded according to various types. Here, the attribute information includes “audio_presentation_type”, where information is recorded regarding the number of channels when playing back (or presenting) the audio stream, and an “audio_language_code” field in which audio stream language information is recorded.

In addition, "stream_coding_type = 0 × 90" represents a stream of graphical representation. The attribute information includes "PG_language_code", in which information of the language used in the graphical representation is recorded. Also, "stream_coding_type = 0 × 91" represents an interactive graphics stream. The attribute information includes “IG_language_code”, in which information about a language used in interactive graphics is recorded. Finally, “stream_coding_type = 0 × 92” represents a text subtitle stream. The attribute information includes “textST_language_code”, in which information of the language used in the text subtitles is recorded, and a “character_code” field, in which information of the character code used in the text subtitles is recorded. Accordingly, only a limited type of attribute information for each stream is illustrated in FIG. 11E. However, it is obvious that a wider range of attribute information may be included in each type of stream.

11F illustrate the syntax of the header of the "SubPath ()" field, which is included in the "PlayList ()" field. More specifically, the size information of the SubPath () field is recorded in the length field, and the stream type information is recorded in the stream_coding_type field, and the source information of the corresponding sub-sequence is recorded in the SubPath_type field. For example, when a SubPath_type equal to "n" represents a sub-sequence recorded on the optical disc and a SubPath_type equal to "m" represents a sub-sequence stored in the local memory 15.

Depending on the embodiment, a plurality of sub-sequences may be configured for each stream attribute. In this case, the types of sub-sequences are described in more detail. More specifically, SubPath_type "n1" or "m1" may represent an audio stream, SubPath_type "n2" or "m2" may represent a text subtitle stream, SubPath_type "n3" or "m3" may represent an interactive graphics stream that is not synchronized with the AV stream SubPath_type "n4" or "m4" may represent a graphic presentation stream, and SubPath_type "n4" or "m5" may represent an interactive graphics stream that is synchronized with the AV stream. Additionally, flag information indicating whether the sub-sequence presentation should be repeated or not is recorded in the is_repeat_SubPath field. The number of SubPlayItems included in the sub-sequence is recorded in the number_of_SubPlayItems field. Information corresponding to each SubPlayItem is recorded in the "SubPlayItem ()" field.

11G illustrates the syntax of the "SubPlayItem ()" field, which is included in the "SubPath ()" field. More specifically, the size information of the "SubPlayItem ()" field is recorded in the "length" field, and the name of the sub-clip that is controlled by the corresponding SubPlayItem is recorded in the "Clip_information_file_name" field, and the encoding type of the corresponding clip is recorded in the "Clip_codec_identifier" field. The STC_id of the specified sub-clip is assigned in the "ref_to_STC_id" field. Both the start time of the presentation (IN_time) and the end time of the presentation (OUT_time) of the represented (or reproduced) SubPlayItem are recorded in the SubPlayItem_IN_time field and the SubPlayItem_OUT_time field, respectively.

In addition, information identifying whether one or more clips is controlled by SubPlayItem is recorded in the is_multi_clip_entries field. Accordingly, the above examples include examples where only one interactive graphic clip or text subtitle clip exists in SubPlayItem, and examples where a plurality of interactive graphic clips or text subtitle clips exist in SubPlayItem. Therefore, when "is_multi_clip_entries = 0b", only one interactive graphic clip or text subtitle clip exists in SubPlayItem. And when "is_multi_clip_entries = 1b", a lot of interactive graphic clips or text subtitle clips exist in SubPlayItem. Accordingly, when "is_multi_clip_entries = 1b" represents the plurality of interactive graphic clips or text subtitle clips existing in the SubPlayItem, the corresponding quantity information is recorded in the number_of_clip_entries field. Information for each corresponding number of clips is recorded in the field "Clip_information_file_name", the field "Clip_codec_identifier" and the field "ref_to_STC_id".

In addition, among the examples described above, when interactive graphics or text subtitle clips are required to be synchronized with the main AV stream, the sync_PlayItem_id field and the sync_start_PTS_of_PlayItem field are used. More specifically, the PlayItem identification information (for example, any of PlayItem # 1, PlayItem # 2 and PlayItem # 3) associated with the start time of the presentation for SubPlayItem is recorded in the “sync_PlayItem_id” field. Also, among the start time of the presentation of the specified PlayItem, timing information indicating why time synchronization should be performed is recorded in the "sync_start_PTS_of_PlayItem" field. Therefore, based on the information recorded in the "sync_PlayItem_id" field and the "sync_start_PTS_of_PlayItem" field, when the representation of the designated PlayItem reaches a certain time position (that is, the time recorded in the "sync_start_PTS_of_PlayItem" field), the SubPlayItem view starts and thus reconciles the synchronization of PlayItemP .

Industrial applicability

It will be apparent to those skilled in the art that various modifications and changes can be made to the present invention without departing from the scope or context of the inventions. Thus, it is intended that the present invention cover the modifications and variations of the present invention if they fall within the appended claims and their equivalents.

Claims (30)

1. A method of reproducing data recorded on a recording medium, the method comprising the steps of:
reproducing the main data recorded on the recording medium and the subdata stored in the local memory using a PlayIist file (playlist), which includes a main sequence and a subsequence, the main sequence containing a PlayItem (playitem) for reproducing the main data, the subsequence contains at least one SubPlayItem (sub-data play item) associated with a PlayItem for reproducing master data, wherein the PlayList file further includes includes information such as a subsequence, which indicates whether at least one SubPlayItem included in the subsequence is synchronized with the PlayItem. 2. The method of claim 1, wherein the subsequence comprises a single SubPlayItem associated with a PlayItem. 3. The method according to claim 2, in which the playback interval SubPlayItem coincides with the full part of the playback interval PlayItem. 4. The method according to claim 2, in which the playback interval ubPlayItem coincides with the selected part of the playback interval PlayItem. 5. The method of claim 1, wherein the subsequence comprises a plurality of SubPlayItems (sub-data playitems) associated with a PlayItem. 6. The method according to claim 5, in which the playback interval of at least one of the many SubPlayItems coincides with the full part of the playback interval PlayItem. 7. The method according to claim 5, in which the playback interval of at least one of the many SubPlayItems coincides with the selected part of the playback interval PlayItem. 8. The method according to claim 1, in which the subdata stored in the local memory include auxiliary streams of interactive graphics. 9. The method of claim 8, wherein the PlayItem is further configured to reproduce the original interactive graphics streams recorded on the recording medium and auxiliary interactive graphics streams. 10. The method of claim 8, in which PlayItem is further configured to play the original interactive graphics streams recorded on the recording medium and auxiliary interactive graphic streams added to the original interactive graphic streams. 11. The method of claim 1, wherein the subdata stored in the local memory include auxiliary text subtitle streams. 12. The method according to claim 1, in which the PlayList file further includes information such as a stream that distinguishes the main data and subdata from each other. 13. The method of claim 1, wherein each SubPlayItem included in the subsequence includes synchronization information that indicates identified PlayItem information and synchronization start time in the PlayItem playback interval. 14. A method for reproducing data recorded on a recording medium, the method comprising the steps of:
reproducing the main data recorded on the recording medium and the subdata stored in the local memory using a PlayList file (playlist), which includes a main sequence and a subsequence, the main sequence containing many PlayItems (playitems) for reproducing the main data, and the subsequence comprises at least one SubPlayItem (sub-data play item) associated with the PlayItems for reproducing the sub-data together with the playback the master data, wherein the PlayIist file further includes information about the type of the subsequence, which indicates whether at least one SubPlayItem included in the subsequence is synchronized with the PlayItems. 15. The method according to 14, in which the subdata stored in the local memory include auxiliary streams of interactive graphics. 16. The method of claim 14, wherein the subdata stored in the local memory include auxiliary text subtitle streams. 17. The method according to 14, in which the PlayList file further includes information about the type of stream that distinguishes the main data and subdata from each other. 18. The method of claim 15, wherein each SubPlayItem included in the subsequence includes synchronization information that indicates identification information of a selected one of PlayItems and a synchronization start time in a playback interval of a selected PlayItem. 19. A method of reproducing data recorded on a recording medium, the method comprising the steps of:
reproducing the AV data and the original auxiliary data recorded on the recording medium, and additional auxiliary data stored in the local memory using a PlayList file (playlist), which includes a main sequence, an initial subsequence and at least one additional subsequence, moreover, the main sequence contains many PlayItems (play items) for playing AV data, the original subsequence contains SubPlayItem (play item sub-data) associated with the PlayItems for reproducing the original auxiliary data, each additional subsequence contains at least one SubPlayItem associated with the PlayItems for reproducing the additional auxiliary data, wherein the PlayList file further includes information about the type of the subsequence, which indicates whether at least one SubPlayItem included in each additional subsequence is synchronized with PlayItems. 20. The method according to claim 19, in which the source and additional auxiliary data includes streams of interactive graphics. 21. The method according to claim 19, in which the source and additional auxiliary data includes streams of text subtitles. 22. The method according to claim 19, in which each SubPlayItem included in each additional subsequence includes synchronization information that indicates the identification information of the selected one of the PlayItems and the synchronization start time in the playback interval of the selected PlayItem. 23. A method for reproducing data recorded on a recording medium, the method comprising the steps of:
reproduce the AV data and the original auxiliary data recorded on the recording medium, and additional auxiliary data stored in the local memory using the PlayList file (playlist), which includes the main sequence and subsequence, while the main sequence contains many PlayItems (playitems ) for reproducing AV data, the subsequence comprises at least one SubPlayItem (sub-data playlist) associated with PlayItems for reproducing maintaining at least one of the source and additional auxiliary data in conjunction with the reproduction of the AV data, the PlayIist file further including sub-sequence type information that indicates whether at least one SubPlayItem included in the subsequence is synchronized with the PlayItems . 24. The method according to item 23, in which the source and additional auxiliary data includes streams of interactive graphics. 25. The method according to item 23, in which the source and additional auxiliary data includes streams of text subtitles. 26. The method according to item 23, in which the SubPlayItem file included in the subsequence includes synchronization information that indicates the identification information of the selected PlayItems and the synchronization start time in the playback interval of the selected PlayItem. 27. A device for reproducing data recorded on a recording medium, comprising:
a write / read head for reading main data recorded on the recording medium;
local memory for storing subdata associated with master data; and
a decoder for decoding the main data and subdata using a PlayList file (playlist), which includes a main sequence and a subsequence, the main sequence containing a PlayItem (playitem) for reproducing the main data, the subsequence contains at least one SubPlayItem (element sub-data playback) associated with the PlayItem for reproducing sub-data in conjunction with reproduction of the main data, wherein the PlayList file further includes and Subsequence type information that indicates whether at least one SubPlayItem included in the subsequence is synchronized with the PlayItem. 28. A device for reproducing data recorded on a recording medium, comprising:
a write / read head for reading main data recorded on the recording medium;
local memory for storing subdata associated with master data; and
a decoder for decoding the main data and subdata using a PlayList file (playlist), which includes a main sequence and a subsequence, the main sequence containing many PlayItems (playitems) for reproducing the main data, and the subsequence contains at least one SubPlayItem (sub-data play item) associated with the PlayItems for reproducing the sub-data together with the reproduction of the main data, wherein the PlayList file is further Luciano a subsequence type information that indicates whether the synchronized at least one SubPlayItem, included in the sub-sequence, with PlayItems. 29. A device for reproducing data recorded on a recording medium, comprising:
a write / read head for reading the AV data and the source auxiliary data recorded on the recording medium, the source auxiliary data being associated with the AV data;
local memory for storing additional auxiliary data associated with the AV data; and
a decoder for decoding AV data and at least one of the source and additional auxiliary data using a PlayList (playlist), which includes a main sequence, an initial subsequence and at least one additional subsequence, the main sequence comprising a plurality PlayItems (playitems) for reproducing AV data, the original subsequence contains a SubPlayItem (subdata playitem) associated with PlayItems for playing of the source auxiliary data, each additional subsequence contains at least one SubPlayItem associated with the PlayItems for reproducing additional auxiliary data, the PlayList file further including information on the type of the subsequence that indicates whether at least one SubPlayItem included in each additional subsequence, with PlayItems. 30. A device for reproducing data recorded on a recording medium, comprising:
a write / read head for reading the AV data and the source auxiliary data recorded on the recording medium, the source auxiliary data being associated with the AV data;
local memory for storing additional auxiliary data associated with the AV data; and
a decoder for decoding AV data and at least one of the source and additional auxiliary data using a PlayList file (playlist), which includes a main sequence and a subsequence, the main sequence containing many PlayItems (play elements) for playing AV data , the subsequence contains at least one SubPlayItem (subdata play item) associated with PlayItems for reproducing at least one of the source and additional final auxiliary data in conjunction with the reproduction of AV data, wherein the PlayList file further includes subsequence type information that indicates whether at least one SubPlayItem included in the subsequence is synchronized with PlayItems.

Images