JP2004120099A - Information processing apparatus and method, program, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To cope with the increase in sub streams subjected to after recording without the need for limiting a coding bit rate of a main AV stream to be low in advance. <P>SOLUTION: A flowchart denoting a processing flow of a method for performing after recording includes: a step S101 of receiving after-recording data and encoding the data by an encoder; a step S102 of checking whether or not a play list going to be subjected to after recording has already a sub path; a step S103 of reading an AUX stream referenced by the sub path already possessed by the play list from a disk; a step S104 of multiplexing the read AUX stream with a stream to be subjected to after recording this time to generate a new AUX stream; and a step S106 of recording the newly generated AUX stream, wherein the AUX stream is generated by using the stream subjected to after recording this time when the play list has no sub path and the generated AUX stream is recorded on a recording medium. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an information processing apparatus and method for recording sub-data reproduced in synchronization with main audio / video data, a program, and a recording medium.
[0002]
[Prior art]
When post-editing audio or graphics on a video signal recorded on a recording medium, some methods for virtually realizing post-record editing without changing the original video signal have been proposed. It should be noted that the post-recording is Japanese English produced from after recording, and means that additional data is recorded in addition to or replacement of already recorded data.
[0003]
For example, a method of a sub-path (sub-play item) of System Description Blu-ray Disc Rewritable Format part 3 AudioVisual Basic Specification (hereinafter referred to as BDAV) has been proposed. Patent Document 1 below relates to this BDAV. BDAV uses a method in which play items and sub-play items are arranged in parallel on a time axis, and they refer to different AV streams. QuickTime employs a method in which a plurality of tracks are arranged in parallel on a time axis, and each track refers to a different AV stream.
[0004]
[Patent Document 1]
JP-A-2002-158972
[0005]
Patent Document 1 describes that when an AV stream file is recorded on a recording medium such as a disk-shaped recording medium, application database information describing the file is also recorded. The application database information includes an AV stream database (referred to as a clip), playback control information (referred to as a play list) in which playback sections (referred to as play items) of the AV stream are grouped, management information of recorded contents of a recording medium, and The thumbnail image information is included. The application database information is recorded on a recording medium by undergoing recording processing similar to that for an AV stream.
[0006]
As described above, when reproducing the AV stream file and the application database information recorded on the recording medium, the application database information is reproduced first, and the read information is taken into the control unit of the player. A list of playlists recorded on the recording medium is displayed on the user interface based on the application database information, and the user selects a playlist to be reproduced from the list of playlists. An AV stream file required for the selected playlist is read from the recording medium and subjected to a reproduction process to obtain a reproduced video signal and a reproduced audio signal.
[0007]
Further, the user can edit the AV stream recorded on the recording medium. For example, it is possible to create a reproduction path in which the part of the singer a is reproduced from the song program of the program A, and thereafter, the part of the singer a of the song program of the program B is reproduced. In this case, a database of a playlist in which the playback section (play item) of the AV stream is grouped by the control unit from information on the start point (in point) and end point (out point) of the playback section specified by the user with respect to the program A. Create
[0008]
FIG. 1 shows a structure of an application format described in Patent Document 1 described above. The application format has two layers of a playlist and a clip for managing an AV stream. The volume information manages all clips and playlists in the database. A pair of one AV stream and its accompanying information is considered as one object, and is called a clip. The AV stream file is called a clip AV stream file, and its attached information is called a clip information file.
[0009]
One clip AV stream file stores data in which an MPEG2 (Moving Picture Experts Group Phase 2) transport stream is arranged in a structure defined by an application format. Generally, a file is treated as a sequence of bytes. The content of the clip AV stream file is developed on the time axis, and the entry points in the clip are mainly specified on a time basis. When a time stamp of an access point to a predetermined clip is given, the clip information file is useful for finding address information to start reading data in the clip AV stream.
[0010]
The play list is prepared in order to allow a user to select a playback section desired to be viewed from the clips and easily edit the selected playback section. One playlist is a set of playback sections in a clip. One playback section in a predetermined clip is called a play item, and is represented by a pair of an in point and an out point on a time axis.
[0011]
There are two types of playlists. One is a real playlist and the other is a virtual playlist. A real playlist shares the stream portion of the clip it references. That is, the real playlist occupies the data capacity of the disc corresponding to the stream portion in the clip referred to by the real playlist, and when the real playlist is deleted, the stream portion of the clip referred to by the real playlist is deleted. Is also erased.
[0012]
The virtual playlist does not share clip data. Therefore, even if the virtual playlist is changed or deleted, no change occurs in the content of the clip.
[0013]
FIG. 2 shows an example of assemble editing. As shown in FIG. 2A, when there are two real playlists 1 and 2 and clips 1 and 2 corresponding to the respective real playlists, the user can enter a predetermined section (IN1) in the real playlist 1 To OUT1) as a playback section (play item 1), and as a section to be continuously played back, a predetermined section (IN2 to OUT2) in the real playlist 2 is designated as a playback section (play item 2). In this example, as shown in FIG. 2B, one virtual play list including play item 1 and play item 2 is created. The created virtual playlist can be re-edited. Re-editing includes changing the IN point and the OUT point, and inserting or adding a new play item to the virtual playlist.
[0014]
FIG. 3 illustrates audio dubbing to a virtual playlist. The audio dubbing is executed by an operation of registering the audio audio dubbing as a sub path in the virtual playlist. Audio dubbing is supported by the application format. An additional sub audio stream is added as a sub path to the main stream AV stream of the virtual playlist.
[0015]
FIG. 4 shows an example of a playlist in which an audio sub-path and a graphics sub-path are arranged on a main path (main reproduction path) of an original audio / video using the BDAV sub-path method described in Patent Document 1 described above. Show. In the following description, for the sake of simplicity, the virtual playlist is simply called a playlist, the real data corresponding to the real playlist referenced by the main path is called the main AV stream, and the real playlist Actual data corresponding to the list will be referred to as an AUX audio stream or an AUX graphics stream.
[0016]
The main path has data IN1 and OUT1 indicating a playback section (play item) selected from the referenced main AV stream data. It has data IN2, IN3, OUT2, and OUT3 that indicate a playback section (play item) of stream data that also refers to each of the sub audio path and the sub graphics path. A player that reproduces a playlist reproduces the main path in synchronization with the sub path. The audio stream and the graphics stream referred to by the sub path have been dubbed. For example, in a camera-integrated disk recorder, a sub-path is formed when the user has dubbed audio data and a title screen with respect to a captured main AV stream. The dubbed audio data and the title screen correspond to the AUX audio stream and the AUX graphics stream, respectively.
[0017]
FIG. 5 shows a player system for playing a playlist as shown in FIG. 4 using two streams of audio and graphics in the sub-path. The player needs to read three streams of a main AV stream, an AUX audio stream, and an AUX graphics stream from a recording medium, for example, the disc 1, and decode them simultaneously.
[0018]
In FIG. 5, reference numerals 2a, 2b, and 2c denote buffer memories into which streams read from the disk 1 are input. The respective outputs of the buffer memories 2a, 2b, 2c are input to the demultiplexers 3a, 3b, 3c, and are separated into packets with reference to the packet ID. The output of the demultiplexer 3a is decoded by the AV decoder 4a, and video data V and audio data A1 are obtained. The output of the demultiplexer 3b is decoded by the audio decoder 4b, and audio data A2 is obtained. The output of the demultiplexer 3c is decoded by the graphics decoder 4c, and the graphics data G is obtained.
[0019]
The video data V, the audio data A1 and A2, and the graphics data G obtained by each decoder are supplied to the audio MIX / select, the video MIX and the synchronization control unit 5, and a video output and an audio output are formed. The video output is, for example, a video display signal for displaying a post-recorded title screen at a designated reproduction time. The audio output is one in which one of the main audio signal and the post-recorded audio signal is selected in the reproduction time specified by the main path and the sub path, or a mixture of both.
[0020]
By the operation schematically shown in FIG. 6, it is possible to reproduce three streams from the disk 1 substantially simultaneously. In the example of FIG. 6, for simplicity, it is assumed that the data rates of the streams are equal to each other. In the first read, the main AV stream is reproduced by, for example, an optical head, and the reproduced main AV stream is input to the buffer 2a. The main AV stream reproduced from the buffer 2a is output.
[0021]
When the reading of the main AV stream ends, the reading position jumps to the recording area of the AUX audio stream, the AUX audio stream is reproduced, and the reproduced AUX audio stream is input to the buffer 2b. The reproduced AUX audio stream is output from the buffer 2b. Next, the reading position jumps to the recording area of the AUX graphics stream, and the AUX graphics are reproduced. The reproduced AUX graphics stream is input to the buffer 2c.
[0022]
Then, jump to the recording area of the main AV stream again and read the main AV stream. Each of the buffers 2a, 2b, and 2c is almost empty when the reading of the data stored in the previous read is completed and the data read in the next read is stored. The state shown in FIG. 6 represents a severe state with no room. By repeating such three jump operations, three streams can be reproduced substantially simultaneously.
[0023]
FIG. 7 shows a conventional example of a recorder system for dubbing stream data referred to by a sub path. When audio data or graphics data for dubbing is input, the encoder 6 encodes the input data, and the output of the encoder 6 is encoded into a transport stream by the multiplexer 7, and the transport stream is recorded on a recording medium. For example, it is recorded on the disk 1.
[0024]
[Problems to be solved by the invention]
In the method of arranging play items and sub play items that refer to different streams, as described with reference to FIG. 6, it is necessary to sequentially read out each stream by performing a jump operation. As the number of items increases, the number of jumps required to read each stream increases. As the number of jumps increases, it is necessary to keep the bit rate of the stream low in order to guarantee that the stream is supplied to the decoder so that each stream can be played back continuously.
[0025]
As a result, it is necessary to lower the encoding bit rate of the main AV stream in advance in preparation for an increase in the number of sub-playitems, which causes a problem that the encoded image quality of video and the like is deteriorated. If the encoding bit rate of the main AV stream is not limited without preparing for an increase in the number of sub-playitems, there is a problem that the number of sub-playitems cannot be increased. For example, after the audio sub-path is added by post-recording, there is a problem that a graphics sub-path cannot be added.
[0026]
Accordingly, it is an object of the present invention to provide an information processing apparatus and method, a program, and a recording medium that do not need to limit the encoding bit rate of a main AV stream to a low level and that can cope with an increase in the number of sub play items. It is in.
[0027]
[Means for Solving the Problems]
In order to solve the above-mentioned problem, the invention according to claim 1 synchronizes with an audio video stream on a recording medium on which reproduction control information for controlling reproduction of the main audio video stream is recorded together with main audio video stream data. An information processing apparatus for recording sub-data to be reproduced by
The reproduction control information is read from the recording medium, and it is determined from the read reproduction control information whether a predetermined number of first sub data streams to be reproduced in synchronization with the audio / video stream have already been recorded on the recording medium. Determining means;
Encoding means for generating a second sub-data stream from the input sub-data;
When the determining unit determines that the predetermined number of the first sub data is not recorded, the second sub data stream generated by the encoding unit is recorded on a recording medium,
When the determining unit determines that the predetermined number of first sub-data is recorded, one of the predetermined number of first sub-data and the second sub-data stream generated by the encoding unit are combined. Means for combining and recording one combined stream on a recording medium;
An information processing apparatus comprising:
[0028]
According to a fifth aspect of the present invention, together with main audio / video stream data, sub-data to be reproduced in synchronization with the audio / video stream is recorded on a recording medium on which reproduction control information for controlling reproduction of the main audio / video stream is recorded. In the information processing method,
The reproduction control information is read from the recording medium, and it is determined from the read reproduction control information whether a predetermined number of first sub data streams to be reproduced in synchronization with the audio / video stream have already been recorded on the recording medium. A determining step;
An encoding step of generating a second sub-data stream from the input sub-data;
When the determining step determines that the predetermined number of the first sub data is not recorded, the second sub data stream generated in the encoding step is recorded on a recording medium,
When the determining step determines that the predetermined number of first sub-data is recorded, one of the predetermined number of first sub-data and the second sub-data stream generated in the encoding step are combined. Combining and recording one combined stream on a recording medium;
The information processing method comprises:
[0029]
According to a ninth aspect of the present invention, together with the main audio / video stream data, sub data to be reproduced in synchronization with the audio / video stream is recorded on a recording medium on which reproduction control information for controlling reproduction of the main audio / video stream is recorded. In the program of the information processing device,
In a program of an information processing device for reproducing or receiving
The reproduction control information is read from the recording medium, and it is determined from the read reproduction control information whether a predetermined number of first sub data streams to be reproduced in synchronization with the audio / video stream have already been recorded on the recording medium. A determining step;
An encoding step of generating a second sub-data stream from the input sub-data;
When the determining step determines that the predetermined number of the first sub data is not recorded, the second sub data stream generated in the encoding step is recorded on a recording medium,
When the determining step determines that the predetermined number of first sub-data is recorded, one of the predetermined number of first sub-data and the second sub-data stream generated in the encoding step are combined. Combining and recording one combined stream on a recording medium;
Is a program for an information processing apparatus comprising:
[0030]
According to a tenth aspect of the present invention, together with main audio / video stream data, sub-data to be reproduced in synchronization with the audio / video stream is recorded on a recording medium on which reproduction control information for controlling reproduction of the main audio / video stream is recorded. In the program of the information processing device,
In a program of an information processing device for reproducing or receiving
The reproduction control information is read from the recording medium, and it is determined from the read reproduction control information whether a predetermined number of first sub data streams to be reproduced in synchronization with the audio / video stream have already been recorded on the recording medium. A determining step;
An encoding step of generating a second sub-data stream from the input sub-data;
When the determining step determines that the predetermined number of the first sub data is not recorded, the second sub data stream generated in the encoding step is recorded on a recording medium,
When the determining step determines that the predetermined number of first sub-data is recorded, one of the predetermined number of first sub-data and the second sub-data stream generated in the encoding step are combined. Combining and recording one combined stream on a recording medium;
And a computer-readable recording medium storing a computer-readable program.
[0031]
According to an eleventh aspect of the present invention, main audio / video stream data, a predetermined number of sub data streams to be reproduced in synchronization with the audio / video stream, and reproduction control information for controlling reproduction of the main audio / video stream are recorded, At least one of the data streams is a recording medium in which two or more sub-data are combined.
[0032]
According to the present invention, each stream data referred to by a plurality of sub-playitems reproduced at the same time is multiplexed and recorded. Therefore, even if the number of sub-playitems increases, the encoding bit rate of the main AV stream is limited in advance in advance. Since there is no necessity, it is possible to improve the encoding quality of a video or the like. Since there is no need to limit the number of sub play items, there is no problem that, for example, after adding an audio sub path, it is not possible to add a graphics sub path.
[0033]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 8 shows a relationship between a playlist and actual data referred to by the playlist according to the embodiment of the present invention. Actual data is data recorded on a recording medium, for example, a disk. In one embodiment, the present invention is applied to a playlist specified in the BDAV format. As described above, BDAV uses a method in which play items and sub play items are arranged in parallel on the time axis, and they refer to different AV streams.
[0034]
The main path of the playlist refers to the main AV stream of the actual data, and has data (IN1-OUT1) indicating a playback section selected from the main AV stream. The sub audio path and the sub graphics path of the playlist refer to one multiplexed stream, for example, a stream in which AUX audio and AUX graphics are multiplexed. The sub audio path has data (IN2-OUT2) indicating a playback section selected from the multiplexed stream. The sub-graphics path has data (IN3-OUT3) indicating a playback section selected from the multiplexed stream. A player that reproduces this play list reproduces the main path and the sub path in synchronization.
[0035]
As an example, there are two streams that can be reproduced substantially simultaneously. That is, as the capability of the disc player, one AUX stream that can be referred to by the sub-path besides the main AV stream referred to by the main path. When one AUX stream has already been recorded, dubbing of a new AUX stream can be realized without any trouble by the present invention.
[0036]
As shown in FIG. 8, even when two sub-paths exist, only one multiplexed stream is recorded on the recording medium. As a synthesizing method for forming a multiplexed stream, any of a time-division multiplexing method and an interleaving method of arranging data for a predetermined time, for example, one GOP can be used. As will be described later, in one embodiment of the present invention, when performing post-recording, based on the information of the playlist, it is checked whether or not a sub-path already exists. The recorded AUX stream and the newly recorded AUX stream are multiplexed to create a multiplexed stream, and the created multiplexed stream is recorded.
[0037]
FIG. 9 shows a player system in which a playlist in which two sub-paths refer to one multiplexed stream in which an audio and graphics stream is multiplexed is recorded, and a playback operation can be performed according to the playlist. . Two streams are played from the disc 11 substantially simultaneously.
[0038]
In FIG. 9, reference numeral 12a denotes a buffer memory to which a main AV stream read from the disk 11 is input, and reference numeral 12b denotes an AUX audio and graphics stream (multiplexed stream) read from the disk 11. Buffer memory to be input. The respective outputs of the buffer memories 12a and 12b are input to the demultiplexers 13a and 13b, and are separated into packets by referring to the packet ID. The output of the demultiplexer 13a is decoded by the AV decoder 14a, and video data V and audio data A1 are obtained.
[0039]
The demultiplexer 13b separates the multiplexed stream into an audio stream and a graphics stream. The audio stream is decoded by the audio decoder 14b, and audio data A2 is obtained. The graphics stream is decoded by the graphics decoder 14c, and graphics data G is obtained.
[0040]
The video data V, the audio data A1 and A2, and the graphics data G obtained by each decoder are supplied to the audio MIX / select, the video MIX and the synchronization control unit 15, and a video output and an audio output are formed. The video output is, for example, a video display signal for displaying a post-recorded title screen at a designated reproduction time. The audio output is such that the audio signal dubbed during the designated reproduction time is mixed with the main audio signal or the dubbed audio signal is selected instead of the main audio signal.
[0041]
In the player system, information of a playlist is first reproduced from the disc 11, and the information of the playlist is read by a control unit (not shown). As described with reference to FIG. 8, the playlist information specifies a playback section of the main AV stream and a playback section of the sub-multiplexed stream. The control unit controls the audio MIX / select, the video MIX, and the synchronization control unit 15 according to the information of the playlist. Thereby, a video output and an audio output reproduced according to the information of the playlist are obtained.
[0042]
By the operation schematically shown in FIG. 10, it is possible to reproduce two streams from the disc 1 substantially simultaneously. In the example of FIG. 10, for simplicity, it is assumed that the data rates of the streams are equal to each other. At the first read, the main AV stream is reproduced by, for example, an optical head, and the reproduced main AV stream is input to the buffer 12a. The reproduced main AV stream is output from the buffer 12a.
[0043]
When the reading of the main AV stream is completed, the read position jumps to the recording area of the multiplexed stream (AUX audio and graphics stream), the multiplexed stream is reproduced, and the reproduced multiplexed stream is stored in the buffer 12b. Will be entered. The reproduced multiplexed stream is output from the buffer 12b. Next, jump to the recording area of the main AV stream again, and the main AV stream is read. Each of the buffers 12a and 12b is almost empty when the reading of the data stored in the previous read is completed and the data read in the next read is stored. The state in FIG. 10 represents a severe state with no room. By repeating such two jump operations, two streams can be reproduced substantially simultaneously.
[0044]
In FIG. 9, the multiplexed stream is recorded on the disk 11 so as to have a physically continuous arrangement. However, if the jump operation hardly occurs, the multiplexed stream may be recorded on the disk 11 in a fragmentary arrangement instead of a continuous arrangement.
[0045]
FIG. 11 shows a configuration example of a recorder system that records stream data referred to by a sub path. When the user instructs the recorder to perform audio or graphics post-recording on a certain playlist, audio or graphics data for post-recording is supplied to the encoder 16, and the data for post-recording is encoded by the encoder 16. Is done. The stream encoded by the encoder 16 is supplied to the multiplexer 17.
[0046]
The recorder reproduces the information of the playlist from the disk 11 before the dubbing, and reads the information into the control unit 19. The information of the playlist is read at a timing such as when the power is turned on or a disc is inserted, and the read information of the playlist is stored in the memory of the control unit 19. The control unit 19 checks whether the recorder already has the audio or graphics sub-path in the playlist. If the playlist has a sub-path, the recorder reads from the disk 11 the stream referred to by the sub-path. Then, the read stream is supplied to the demultiplexer 18. The output of the demultiplexer 18 is supplied to the multiplexer 17. The multiplexer 17 multiplexes the stream from the demultiplexer 18 and the stream from the encoder 16 into a transport stream. The transport stream from the multiplexer 17 is recorded on the disk 11.
[0047]
On the other hand, if the playlist does not have a sub-path, the multiplexer 17 encodes the stream from the encoder 16 into a transport stream, and the transport stream output from the multiplexer 17 is recorded on the disc 11. . When the post-recording data is recorded on the disc 11, the contents of the playlist are rewritten, and the information of the rewritten playlist is recorded on the disc 11.
[0048]
FIG. 12 is a flowchart illustrating a flow of a recording method of a stream referred to by a sub path. In the first step S101, audio or graphics data for dubbing is input, encoded by an encoder, and a stream from the encoder is input to a multiplexer.
[0049]
In step S102, the recorder checks whether the playlist to be dubbed already has an audio or graphics sub-path. For example, the recorder reads information of a playlist from the disk 11 before recording, and checks whether or not the read playlist already has a sub-path. If the determination result in step S102 is yes, the process proceeds to step S103. If the determination result is no, the process proceeds to step S105.
[0050]
In step S103, the AUX stream referred to by the sub path already possessed by the playlist is read from the disc.
[0051]
In step S104, the read AUX stream and the stream to be dubbed this time are multiplexed to create a new AUX stream.
[0052]
Then, in step S106, the newly created AUX stream is recorded on a recording medium.
[0053]
If the determination result in step S102 is no, that is, if the play list does not have a sub path, an AUX stream is created using the stream to be dubbed this time. Then, in step S106, the created AUX stream is recorded on a recording medium.
[0054]
FIG. 13 is a flowchart showing a flow of a reproducing method performed according to a playlist having a main path and a sub path. In step S201, a stream referred to by the main path is read from a recording medium, and the read stream is decoded.
[0055]
In step S202, the stream referred to by the sub path is read from the recording medium, and the read stream is decoded.
[0056]
In step S203, the main path and the sub path are synchronously reproduced.
[0057]
The present invention is not limited to the above-described embodiment and the like, and various modifications and applications are possible without departing from the gist of the present invention. For example, the present invention can be applied to a playlist in a format other than BDAV. For example, the present invention is also applicable to QuickTime (trademark). QuickTime (trademark) is software that manages various data such as video and audio along the time axis, and is an OS extension function for synchronously reproducing moving images, voices, and texts without using special hardware. It is.
[0058]
【The invention's effect】
According to the present invention, each stream data referred to by a plurality of sub-playitems reproduced at the same time is multiplexed and recorded. Therefore, even if the number of sub-playitems increases, the encoding bit rate of the main AV stream is limited in advance in advance. Since there is no necessity, it is possible to improve the encoding quality of a video or the like. Since there is no need to limit the number of sub play items, there is no problem that, for example, after adding an audio sub path, it is not possible to add a graphics sub path. To simply suppress the increase in the number of streams, it is conceivable to multiplex the dubbing stream with the main stream.However, the main stream usually has a large amount of data, which makes rewriting difficult. Since the list may refer to the list, multiplexing the after-recording stream on the main stream causes inconvenience.
[Brief description of the drawings]
FIG. 1 is a schematic diagram for explaining a playlist as reproduction control information proposed earlier.
FIG. 2 is a schematic diagram illustrating a method of creating a playlist when assemble editing is performed.
FIG. 3 is a schematic diagram for explaining a playlist when dubbing is performed.
FIG. 4 is a schematic diagram illustrating a conventional playlist in which two streams of audio and graphics are used for a sub path.
FIG. 5 is a block diagram of a player system for playing a conventional playlist using two streams of audio and graphics in a sub path.
FIG. 6 is a schematic diagram illustrating a conventional model of a player that simultaneously reproduces three streams.
FIG. 7 is a block diagram illustrating an example of a conventional recorder that performs post-recording.
FIG. 8 is a schematic diagram for explaining a playlist according to the present invention using two streams of audio and graphics for a sub path.
FIG. 9 is a block diagram of a player system for playing a playlist according to the present invention using two streams of audio and graphics in a sub-path.
FIG. 10 is a schematic diagram for describing a model of a player for simultaneously reproducing two streams according to the present invention.
FIG. 11 is a block diagram of an example of a recorder that performs post-recording according to the present invention.
FIG. 12 is a flowchart showing a processing flow of a method for performing after-recording according to the present invention.
FIG. 13 is a flowchart showing a processing flow of a main path and sub path reproducing method according to the present invention.
[Explanation of symbols]
11: disk, 12a, 12b: buffer, 13a, 13b, 18: demultiplexer, 17: multiplexer, 19: control unit

Claims (11)

An information processing device that records sub-data that is reproduced in synchronization with the audio video stream on a recording medium on which reproduction control information for controlling reproduction of the main audio video stream is recorded together with main audio video stream data.
The reproduction control information is read from the recording medium, and from the read reproduction control information, it is determined whether or not a predetermined number of first sub data streams to be reproduced in synchronization with the audio video stream have already been recorded on the recording medium. Determining means for determining;
Encoding means for generating a second sub-data stream from the input sub-data;
When the determination unit determines that the predetermined number of the first sub data is not recorded, the second sub data stream generated by the encoding unit is recorded on a recording medium,
When the determining unit determines that the predetermined number of the first sub data is recorded, one of the predetermined number of the first sub data and the second sub data generated by the encoding unit are determined. Means for combining a sub data stream and recording one combined stream on a recording medium. In claim 1,
An information processing apparatus, wherein the playback control information includes a main path indicating a selected playback section of the main audio / video stream and a subpath indicating a playback section of the first sub data stream. In claim 2,
An information processing apparatus, wherein the determining means determines whether the main path has a predetermined number of the sub paths. In claim 2,
An information processing apparatus configured to record the reproduction control information having two or more sub paths indicating a reproduction section of the composite stream when recording the composite stream on a recording medium. An information processing method for recording, together with main audio video stream data, sub-data to be reproduced in synchronization with the audio video stream on a recording medium on which reproduction control information for controlling reproduction of the main audio video stream is recorded,
The reproduction control information is read from the recording medium, and from the read reproduction control information, it is determined whether or not a predetermined number of first sub data streams to be reproduced in synchronization with the audio video stream have already been recorded on the recording medium. A determining step of determining;
An encoding step of generating a second sub-data stream from the input sub-data;
When it is determined by the determining step that the predetermined number of first sub-data is not recorded, the second sub-data stream generated in the encoding step is recorded on a recording medium,
When it is determined by the determining step that the predetermined number of the first sub-data is recorded, one of the predetermined number of the first sub-data and the second sub-data generated in the encoding step are used. Combining the sub data stream and recording one combined stream on a recording medium. In claim 5,
An information processing method, wherein the playback control information includes a main path indicating a selected playback section of the main audio / video stream and a subpath indicating a playback section of the first sub-data stream. In claim 6,
The information processing method, wherein the determining step determines whether the main path has a predetermined number of the sub paths. In claim 5,
An information processing method for recording the reproduction control information having two or more sub-paths indicating a reproduction section of the composite stream when recording the composite stream on a recording medium. A program for an information processing apparatus for recording sub-data to be reproduced in synchronization with the audio video stream on a recording medium on which reproduction control information for controlling reproduction of the main audio video stream is recorded together with main audio video stream data. At
In a program of an information processing device for reproducing or receiving
The reproduction control information is read from the recording medium, and from the read reproduction control information, it is determined whether or not a predetermined number of first sub data streams to be reproduced in synchronization with the audio video stream have already been recorded on the recording medium. A determining step of determining;
An encoding step of generating a second sub-data stream from the input sub-data;
When it is determined by the determining step that the predetermined number of first sub-data is not recorded, the second sub-data stream generated in the encoding step is recorded on a recording medium,
When it is determined by the determining step that the predetermined number of the first sub-data is recorded, one of the predetermined number of the first sub-data and the second sub-data generated in the encoding step are used. Combining the sub data stream and recording one combined stream on a recording medium. A program for an information processing apparatus for recording sub-data to be reproduced in synchronization with the audio video stream on a recording medium on which reproduction control information for controlling reproduction of the main audio video stream is recorded together with main audio video stream data. At
In a program of an information processing device for reproducing or receiving
The reproduction control information is read from the recording medium, and from the read reproduction control information, it is determined whether or not a predetermined number of first sub data streams to be reproduced in synchronization with the audio video stream have already been recorded on the recording medium. A determining step of determining;
An encoding step of generating a second sub-data stream from the input sub-data;
When it is determined by the determining step that the predetermined number of first sub-data is not recorded, the second sub-data stream generated in the encoding step is recorded on a recording medium,
When it is determined by the determining step that the predetermined number of the first sub-data is recorded, one of the predetermined number of the first sub-data and the second sub-data generated in the encoding step are used. Combining a sub-data stream and recording one combined stream on the recording medium. Main audio video stream data, a predetermined number of sub data streams that are reproduced in synchronization with the audio video stream, and reproduction control information for controlling reproduction of the main audio video stream are recorded, and at least one of the sub data streams is recorded. A recording medium in which one is a stream in which two or more sub-data are combined.

Images