CN100448285C - Information processing device and information processing method - Google Patents

Abstract

An information processing device, which works as a recording device, creates a Clip Information file of a still image file (TS file) composed of a plurality of still images, creates a Playlist composed of a plurality of PlayItems indicating the reproduction path of a slide show, and records this information and the TS file on a DVD. The Clip Information file includes an EP_map, which is a table indicating the correspondence between the values of presentation type stamps PTS of the TS and the source packet numbers SPN in the TS indicated by the values. An information processing device, which works as a reproduction device, obtains the data addresses of the TS indicated by the Play Item reproduction start time, IN_time, and the reproduction end time, OUT_time, and reproduces still images by referencing the EP_map of the Clip Information and reading information therefrom.

Description

Information processing device and information processing method

technical field

The present invention relates to a recording medium having recorded thereon data consisting of still images for a so-called slide show suitable for continuous reproduction of still images and auxiliary information thereof for recording and/or reproducing the data Information processing methods, information processing equipment and programs.

This application claims Japanese Patent Application No. 2002-367235 filed in Japan on December 18, 2002, Japanese Patent Application No. 2003-067025 filed in Japan on March 12, 2003, and Japanese Patent Application No. 2003-067025 filed in Japan on May 9, 2003 priority of Japanese Patent Application No. 2003-132193, the entire contents of which are incorporated herein by reference.

Background technique

The DVD-Video standard has realized continuous reproduction of still images (so-called slide show). Each still picture signal is encoded into an intra picture (I picture) of MPEG2 (Moving Picture Experts Group 2) video, and is multiplexed in an MPEG2 program. By multiplexing I pictures with audio data and sub-pictures into an MPEG2 program stream, the audio data and sub-pictures can be synchronized and reproduced in a slide show. The slide show is reproduced at a preset timing based on the presentation time stamp.

The program stream of DVD-Video has a structure in units of VOBU (Video Object Unit). The conventional DVD data structure is described in, for example, published Japanese patent document H10-271444. FIG. 1 here schematically shows the structure of a DVD-Video program stream of Conventional Example 1. As shown in FIG. Referring to FIG. 1, DVD-Video program streams are managed in units of VOBS (Video Object Sets), which are used as units in, for example, moving picture workpieces. The VOBS is composed of a plurality of video objects (VOBs), and is a data unit recorded on a disc as a set or a group. A VOB is composed of a plurality of cells each of which is a unit corresponding to, for example, a scene or a cut in a moving image. Each partition is composed of a plurality of VOBUs (Video Object Units). In terms of moving pictures, the duration of VOBU is 0.4 to 1.2 seconds. In this VOBU, one or more GOPs (Group of Pictures) in MPEG2 format are contained.

A VOBU includes a navigation pack (N-PCK) which is a pack containing VOBU management information. The Navigation Pack is placed at the front of each VOBU. The navigation package includes VOBU_SRI (VOBU search information) and SP_SYNCA. The VOBU_SRI includes the leading address of the VOBU reproduced in N seconds (N is an integer) before and after the playback time of the VOBU containing the VOBU_SRI. The SP_SYNCA includes address information of a sub-picture reproduced in synchronization with the video of the VOBU including the SP_SYNCA. In reproducing, for example, a moving image, this navigation pack is first read in, and playback is performed based on management information specified by the navigation pack.

In addition to this NV-PCK, the VOBU includes video packs (V_PCK) as packs with main picture, audio packs (A_PCK) A as packs containing voice data, and sub-picture packs as packs containing sub-video data (SP_PCK)S. V_PCK, A_PCK, and SP_PCK are compressed in a preset format such as MPEG2, and recorded in this form on a recording medium. The VOBU can be exemplified by, for example, VOBU1 including a video packet (including data of an I picture and a sequence end code (Sequence_end_code)) and VOBU2 not including a video packet as shown in FIG. 1 .

A VOBU used in a slideshow may not contain a video pack (a video pack containing MPEG2 video). For VOBUs that do not contain video packs, such as VOBU2 in Figure 1, continue the still video from the previous VOBU. The duration of the static display of the I-picture can be controlled by navigation commands.

The program stream of DVD-Audio basically has the same structure as that shown in FIG. 1 . The DVD-Audio format implements a mode in which audio playback is asynchronous to the progress of the slideshow (browsable slideshow). In the browsable slideshow, if the user commands the player to continue displaying the next still image through, for example, a remote controller to change the still display time of each still image, audio playback is not interrupted so that audio data is continuously reproduced. Therefore, in DVD-Audio, there is a mode in which video playback is not synchronized with audio playback.

Meanwhile, Published Japanese Patent Publication No. 2002-158972 previously filed in the name of the present inventor states data having a format different from that of FIG. 1 . This publication is hereinafter referred to as Prior Art Example 2. The application format of data recorded in the information processing device disclosed in this prior art example 2 has two layers for managing AV streams, namely PlayList and Clip. Playlists in the playlist layer are referenced only by users who can refer to the playlists to reproduce and edit data such as video data. On the other hand, when the player reproduces the AV stream specified by the playlist, the clip layer is used. Here, the AV stream and its auxiliary information are combined into one object, which is managed in units of clips. An AV stream file is called a clip AV stream file, and its auxiliary information is called a clip information file. The clip AV stream file and the clip information file are separately recorded on the recording medium. Data management is facilitated by separately recording and supervising streaming data and its auxiliary information.

However, with the data form shown in FIG. 1, the address information is embedded in the MPEG program stream, so that reading becomes time-consuming. That is, in determining the readout address of the still image, stream data is read out from the disc, the data is analyzed by the main CPU of the player, and then the address of the access point of the still image is determined, thus delaying the readout operation. If a slideshow can be realized in a format similar to audiovisual data as described in the aforementioned prior art example 2, data management can be facilitated, while a recording and/or reproducing device having a similar structure can be easily employed.

Contents of the invention

It is an object of the present invention to provide a recording medium recording data for realizing a so-called slide show in a simplified manner using still images and their auxiliary information in a format comparable to that of audio-visual data for recording And/or an information processing method, an information processing device, and a program for reproducing the data.

The present invention provides an information processing device, comprising: attribute information formulating means for formulating and managing image attribute information of each still image in a still image set composed of one or more still images; playback control information formulating means for creating playback control information specifying a playback path of the still image set; and recording means for recording the still image set, image attribute information associated with the still image set, and Associated playback control information. The still picture whose playback is controlled by the playback control information is correlated with the still picture recorded on the recording medium according to the picture attribute information.

According to the present invention, image attribute information and playback control information are recorded on a recording medium separately from a set of still images. Therefore, when a still image is read out and reproduced from the recording device, the image attribute information and the playback control information can be read out first, and the individual still images of the still image set can be generated in a preset order, thereby making it possible to utilize the A format similar to the traditional format used in , enables continuous playback of still images (so-called slide show).

The present invention also provides an information processing method, including: an attribute information creating step, creating and managing the image attribute information of each still image in a still image set composed of one or more still images; a playback control information creating step, creating a specified playback control information of a playback path of the still image set; and a recording step of recording the still image set, image attribute information associated with the still image set, and playback control information associated with the still image set. The still picture whose playback is controlled by the playback control information is correlated with the still picture recorded on the recording medium according to the picture attribute information.

The present invention also provides an information processing method, including: a reproducing step of reproducing the still image from a recording medium on which a still image set composed of one or more still images, corresponding image attribute information, and playback control information are recorded. at least a part of the still images of the image set; and a control step of controlling the reproducing step with reference to the image attribute information based on the playback control information. The image attribute information includes information for managing individual still images in the still image set. The playback control information includes information indicating a playback path created using image attribute information. A playback path specifies playback of at least a portion of still images of the set of still images.

The present invention also provides a program for causing a computer to execute a preset operation, wherein the program includes: a reproducing step from which a still image set composed of one or more still images and corresponding image attribute information thereof are recorded; A recording medium of the playback control information reproduces at least a part of the still images of the still image set; and a control step of controlling the reproduction step with reference to the image attribute information based on the playback control information. The image attribute information includes information for managing individual still images in the still image set. The playback control information includes information indicating a playback path created using image attribute information. A playback path specifies playback of at least a portion of still images of the set of still images.

The present invention also provides an information processing apparatus, comprising: attribute information creating means for creating and managing image attribute information of each of one or more still images forming a still image set; playback control information creating means , for creating playback control information representing a playback path, wherein the playback path specifies playback of at least a part of still images in the still image set; recording means for recording the still image set on a recording medium, together with corresponding image attribute information and playback control information; reproducing means for reading and reproducing still images from the recording medium; and control means for controlling the reproducing means by referring to the image attribute information based on the playback control information. The playback control information creation means creates playback control information using the image attribute information.

The present invention also provides an information processing method, comprising: an attribute information creating step of creating and managing image attribute information of each still image in one or more still images forming a still image set; a playback control information creating step of creating playback control information representing a playback path, wherein the playback path specifies playback of at least a portion of still images in the still image set; a recording step of recording the still image set, image attribute information corresponding thereto, and playback control information; a reproducing step of reading out and reproducing a still image from the recording medium; and a control step of referring to the image attribute information based on the playback control information to control the reproducing step. The playback control information creation step creates playback control information using the image attribute information.

The present invention also provides a program for causing a computer to execute a preset operation, wherein the program includes: an attribute information creating step of creating and managing an image attribute of each of one or more still images forming a still image set information; playback control information creating step, creating playback control information representing a playback path, wherein the playback path specifies the playback of at least a part of the still image in the still image set; recording step, recording the still image on a recording medium set, image attribute information corresponding thereto, and playback control information; a reproducing step of reading and reproducing a still image from a recording medium; and a control step of referring to the image attribute information based on the playback control information to control the reproducing step. The playback control information creation step creates playback control information using the image attribute information.

The present invention also provides a still picture set composed of one or more still pictures, picture attribute information for managing individual still pictures in the still picture set, and playback control information formed using the picture property information recorded thereon. . The playback control information indicates a playback path that specifies playback of at least a part of the still images in the still image set.

Description of drawings

FIG. 1 is a schematic diagram showing the structure of a program stream of a conventional DVD-Video;

Fig. 2 shows a simplified structure of a still image application format on a recording medium used in the information processing apparatus according to the first embodiment of the present invention.

Fig. 3 shows an example of an image file group and its clip information.

4 shows an example of a playlist of a slide show in which the reproduction start time of each still picture is predetermined, and the relationship between still pictures and reproduction times in the first embodiment of the present invention.

FIG. 5 shows the relationship between the playlist and clips of FIG. 4 .

FIG. 6 shows an explanatory structure of a playlist in the first embodiment of the present invention in the case of reproducing audio data in synchronization with a slide show in which the playback start time of each still image is predetermined.

7 shows an example of a playlist in which only the playback order of individual still images is a predetermined slide show in the first embodiment of the present invention, and the relationship between still images and reproduction times.

Fig. 8 shows an example of the relationship between the playlist and the clips shown in Fig. 7 .

FIG. 9 shows the relationship among playlists, clip information files, and audio streams.

Fig. 10 is a block diagram showing an information processing device in the first embodiment of the present invention.

Fig. 11 shows an illustrative structure of directories and files recorded on a recording medium.

FIG. 12A shows clip information in the first embodiment of the present invention, and FIG. 12B shows an example of data arrangement on a recording medium (disc) of a still image file related to FIG. 12A.

13 is a flowchart showing a method of creating a playlist in a recording operation of the information processing apparatus according to the first embodiment of the present invention.

FIG. 14 is a block diagram showing an information processing device for reproducing data recorded by the information processing device shown in FIG. 10 .

Fig. 15 is a flowchart showing a reproduction operation in the information processing device according to the first embodiment of the present invention.

Fig. 16 shows an example of the relationship between playlists and clips in a modification of the first embodiment of the present invention.

FIG. 17A shows clip information shown in FIG. 16 .

Fig. 17B shows an example of the data arrangement on the recording medium (disc) of the still picture file related to Fig. 17A.

Fig. 18A shows clip information shown in the second embodiment of the present invention.

Fig. 18B shows the data arrangement on the recording medium (disc) of the still picture file related to Fig. 18A.

FIG. 19 shows the relationship among playlists, clip information files, and audio streams in the case of asynchronously reproducing audio data in a browsable slide show in the second embodiment of the present invention.

20 is a diagram showing an example of a playlist in a slide show in which only the playback order of individual still images is predetermined and the relationship between still images and playback time in the third embodiment of the present invention.

21 is a diagram showing another example of a playlist in a slide show in which only the playback order of individual still images is predetermined and the relationship between still images and playback time in the third embodiment of the present invention.

FIG. 22 shows the relationship between the playlist shown in FIG. 20, its clip information, and the data arrangement of the related still picture files on the recording medium (disc).

FIG. 23 shows the relationship between the playlist shown in FIG. 21, its clip information, and the data arrangement of the relevant still picture files on the recording medium (disc).

FIG. 24 shows another example of the third embodiment of the present invention, and specifically shows the relationship between a playlist, its clip information, and the data arrangement of related still picture files on a recording medium (disc).

25 shows a playlist of a slide show in which audio data is reproduced in a synchronous relationship with playback of still images, its clip information, and the arrangement of related still image files on a recording medium (disc) in a third embodiment of the present invention. Relationships between data arrangements.

Fig. 26 is a schematic diagram showing an example of source packets indexed in a transport stream file (still image file).

Fig. 27 is a diagram showing another example of source packets indicated in a transport stream file (still image file).

FIG. 28 shows the relationship between playlists of a slideshow that reproduces audio data in an asynchronous relationship with playback of still images in the third embodiment of the present invention.

29 is a block diagram showing a reproducing device in the case of reading out two files, a still image file referred to by a PlayItem and an audio stream referred to by a SubPlayItem, alternately with each other in a time-sharing manner from a recording medium.

FIG. 30A is a block diagram showing a BDAV MPEG2TS player model 1, and FIG. 30B is a block diagram showing a BDAV MPEG2TS player model 2.

Figure 31 is a block diagram of a buffer model for a browsable slide show.

FIG. 32A shows the bit amount occupied by the EB buffer (video code buffer) during a slideshow in the browseable mode, and FIG. 32B shows the bit amount occupied by the B4 buffer (audio code buffer).

FIG. 33 is a diagram for illustrating a method of simultaneously reading out a main TS and an audio TS in a browsable slide show.

Fig. 34 shows the relationship between the data arrangement of a playlist, a clip information file, and related still image files on a recording medium (disc) in the case of using an I picture as still image data.

Fig. 35 is a schematic diagram showing an example of source packets indicated in a transport stream file (still image (I-picture) file).

Fig. 36 is a diagram showing another example of source packets indicated in a transport stream file (still picture (I picture) file).

37 is a flowchart showing a method for creating a playlist in a recording operation of the information processing apparatus according to the third embodiment of the present invention.

Fig. 38 is a flowchart showing a reproduction operation in the information processing device according to the third embodiment of the present invention.

Detailed ways

Preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In these embodiments, the present invention is applied to an information processing apparatus for recording data of a slide show for realizing continuous playback of still images under a format used for recording and/or reproducing moving images on a DVD and using An information processing device for reproducing the data.

(1) The first embodiment

(1-1) Data structure

Here, the structure of data recorded and/or reproduced by the information processing apparatus in the first embodiment of the present invention is explained. Fig. 2 shows a simplified structure of a still image application format on a recording medium used in a recording and/or reproducing system according to the present invention. This format has a structure similar to the application format described in the aforementioned Conventional Example 2, and has two layers, PlayList (PlayList) and Clip (Clip), for overseeing AV streams.

In the present first embodiment, a pair formed by a still picture group (picture file group) as a still picture set composed of one or more source groups and its auxiliary information is regarded as one object, which is referred to as clip unit to manage. Auxiliary information (image attribute information) of a still picture group is called clip information.

A collection of playback domains of a slide show with still images in a clip is called a playlist. The playlist is playback control information representing, for example, a playback path (reproducing route) that specifies, for example, the playback order of still images. Therefore, a playlist is formed by a group of playitems.

There are two types of playlists, one of which is a real playlist and the other is a virtual playlist. A real playlist is considered to be part of a still image group that jointly owns the clip it is referencing. That is, a real playlist occupies a data capacity on disc equal to a portion of the group of still images of the clip it is referencing. If a new picture group is recorded, it is automatically added to the live playlist. If a part of the playback range of the real playlist is deleted, the data of that part of the still picture group of the clip it is referencing is also deleted. On the contrary, the virtual playlist is regarded as not co-owning the clip data. If a virtual playlist is modified or deleted, nothing changes in the clip. In the following description, the real playlist and the virtual playlist are collectively referred to as a playlist.

Fig. 3 shows an example of an image file group and its clip information. In this embodiment, one or more still image files are managed as a single image file group. A clip information file corresponding to the image file group is provided. This clip information includes, for each still picture file included in the picture file group, an ID (file_id) as still picture identification information when referring to the still picture file, a file name (file_name) corresponding to the file_id, a byte of the file size (file_size), the number of pixels in the horizontal direction (horizontal_size) and the number of pixels in the vertical direction (vertical_size) for each still image.

Although the data format of the still image is JPEG, PNG in FIG. 3, the data format may of course be any other suitable data format as long as the data format used is the still image data format.

In this embodiment, two kinds of slide shows are explained. The first slide show is a type in which the playback start time of each still image is predetermined, which is also referred to as a time-based slide show or time-base mode hereinafter, and the second slide show is A type in which the playback start time of each still image is not predetermined but the playback order is predetermined will also be referred to as a browsable slideshow hereinafter.

For a time-based slide show, playback of individual slides is automatically performed except when the user instructs the reproducing device (player) to go to the next slide, which reproduces the timing of a predetermined slide on the time axis at a predetermined timing. mode is automatically reproduced. Therefore, the playback time of each slideshow (the duration of the still image of the slideshow) is limited. In the case of reproducing audio data simultaneously with still images, audio reproduction can be synchronized with playback of still images in a time-based slide show.

For browsable slide shows, the playback order is predetermined, and the playback time of individual slides is limited or unlimited. If a given slideshow has infinite playback time, the playback does not advance to the next slideshow except in the case where the user commands the rendering device (player) to advance to the next slideshow. Therefore, individual slides are not reproduced with preset timing on the time axis. If audio data is reproduced simultaneously with still images in a browsable slide show, playback of the audio data and still images is not synchronized.

(1-2) Slideshow with scheduled playback start time

A first slide show having predetermined playback start timings of respective still images will now be described with reference to FIGS. 4 to 6. FIG.

(1-2-1) Slideshow: Still images only

FIG. 4 shows a slide show in which the reproduction start time of each still image is predetermined, and an example of a playlist in the slide show in which the reproduction start time of each still image is predetermined is shown in the upper and lower parts of the figure, and Relationship between still images and playback time. In a slide show in which the reproduction start time of each still image is predetermined, each still image is reproduced at a preset timing on the time axis.

A playlist is composed of a plurality of play items. Referring to FIG. 4, each playitem has data representing IN_time (in time) and OUT_time (out time) of the playback domain of the slide show. The playback start time and playback end time are specified by the data of IN_time and OUT_time. Each PlayItem has data for each still image constituting the slide show. This data is hereinafter referred to as a scene (Scene). This scene includes an ID (file_id) as still image identification information when referring to an image file group in a clip. These scenes also contain the playback start time (start_time_stamp) in the PlayItem. These scenes also include a playback time in each scene, that is, a display duration as a still image playback time of each still image.

Playback times in each scene can overlap in play items. Each scene can have multiple file_ids. For example, in the case shown in Figure 4, scene[2] overlaps scene[1] and scene[3]. In this case, the image of scene [2] is displayed with it overlapping the images of scene [1] and scene [2]. The number marked in each image of Fig. 4 indicates the file_id. Although the information about the overlapping positions of the respective images, that is, the information about the image display position of the scene [2] and the image display position of the scene [1] can be expressed in the playlist, it can also be expressed in a different file than the playlist. file or group of image files referenced by the scene [2].

FIG. 5 shows the relationship between the playlist and the clips shown in FIG. 4 . A playlist references a still image in a clip, here the file ID. Clip information indicates the relationship between a still image (file ID) referred to by a playlist and its entity (here, a file name). That is, the clip information is referenced to identify the file name File_name which is the ID (file_id) of the still image identification information expressed in the playlist. Reads the still image file of the file name from the image file group.

(1-2-2) Slideshow: still image + audio data

Now, the case of synchronously reproducing audio data in a slide show in which the playback start time of each still image is predetermined will be described. FIG. 6 shows an illustrative structure for reproducing audio data in a slide show in a timing relationship with still images. When synchronizing audio data in a slideshow in which the playback start time of each still image is predetermined, in addition to the play item (main path) indicating the playback path of the still image, an A sub-playitem (sub-path) of a path, where the sub-playitem is audio playback control information indicating a playback path of audio data.

The Sub PlayItem includes a playback start time (sync_start_PTS_of_PlayItem) on the time axis. The SubPlayItem also includes the playback start time (SubPlayItem_IN_time) on the Clip referenced by it. The SubPlayItem also includes the playback start time (SubPlayItem_OUT_time) on the Clip referenced by it.

When the SubPlayItem expresses an access point inside a Clip using a presentation time stamp (PTS), the ClipInfo file has address information for finding by which to start stream decoding in the AV stream file. The AV stream file of the clip referred to by the SubPlayItem is an audio stream (auxiliary audio stream). This auxiliary audio stream is hereinafter referred to as a sub audio stream.

That is, the clip information file includes a table (EP_map of audio) expressing the start time of the audio stream and information indicating addresses of source packets (minimum access units) corresponding to the start time and end time. This table can be referred to to acquire an address corresponding to a specified presentation time PTS, thereby reading out and reproducing audio data indicated by the address. Since the Sub PlayItem has the playback start time on the time axis of the playback time to represent the playback path of the still image, it is possible to reproduce audio data in a slide show in a timing relationship with the still image.

(1-3) Slide show with specified playback order of still images only

A second type of slide show (browsable slide show) in which only the playback order of still images is specified will be described with reference to FIGS. 7 to 9 .

(1-3-1) Slideshow: Still images only

FIG. 7 shows an example of a browsable slideshow and the relationship between still images and playback time. In this case, unlike the cases of FIGS. 4 to 6 , as shown in the upper part of FIG. 7 , the scene of the play item of the browsable slide show does not designate the playback start time of the still image. In place of the playback start time information (start_time_stamp) in the PlayItem of each still image, only information specifying the playback order of the respective still images on the PlayItem is provided. Also, unlike the cases of FIGS. 4 to 6, PlayItem has neither IN_time nor OUT_time. The playback time (display time) of the still images constituting the slide show is not determined. In this case, the user can specify the playback time of each scene to the player.

In addition, each scene of the playlist may have information representing a default playback time corresponding to the playback order in the play item of each still image instead of the predetermined playback time (playback duration) as in FIG. 4 . In this case, the player can reproduce still images only in the default playback time in the absence of a user's instruction. Therefore, with a structure that provides a default playback time, it is possible for the user to command the player to shift to the next still picture using, for example, a remote controller by freely performing control of a still picture.

That is, each scene of the PlayItem includes information (playing_order) specifying the playback order of the scenes in the PlayItem, an ID (file_ID) as still image identification information when referring to a group of image files in a clip, and a default value of each scene. Save playback time (default_duration). Meanwhile, the default playback time of each still image may be the same as or different from each other.

In the case of a browsable slide show, as in the case of a slide show in which a playback start time is specified, a plurality of still images can be displayed in an overlapping manner in one scene. For example, if file_id=1 and file_id=2 are expressed in scene [1] in the case of FIG. 7 , the image of file_id=2 is displayed among the images of file_id=1. In Figure 7, numbers in the image represent file_id. Although the information on the display positions of the image of file_id=2 and the image of file_id=1 can be expressed in the playlist, the information can also be expressed in a file different from the playlist, or can be expressed in the image referenced by file_id=2 stated in the document.

FIG. 8 shows a typical relationship between the playlist shown in FIG. 7 and the clips. A playlist references still images in a clip. The clip information represents the relationship between the still image referred to by the playlist and its entity. That is, clip information is referenced based on a file ID for identifying a still image in a clip indicated by the playlist, and a file name corresponding to the file ID is acquired to read out and reproduce a still image of the file name from the image file group. .

(1-3-2) Slideshow: still image + audio data

Now, the case of asynchronously reproducing audio data with respect to a browsable slide show will be described. FIG. 9 shows the relationship between a playlist of a browsable slide show for asynchronously reproducing audio data, a clip information file, and an audio stream. Although the playlist is composed of playitems representing the playback path of still images and playitems representing the playback path of audio data, in the case of asynchronously reproducing audio data, unlike the case of FIG. playback path, and the SubPlayItem indicates a playback path of a still image.

In this browsable slide show, if the user commands the player to go to the next still image through, for example, a remote controller, thereby changing the still playback time of each still image, the audio data is reproduced without interruption because it is relative to The progress of the slide show is asynchronous.

The structure of the sub play item designating the playback route of the slide show is the same as that of the play item designating the playback route of the slide show already described with reference to FIG. 7 . That is, the Sub PlayItem is composed of the playback order (playing_order) of the scenes in the PlayItem, the ID (file_id) required to refer to the file of the picture file group in the clip, and the default playback time (default_duration) of the scenes.

In the play item specifying the audio playback route of the browsable slideshow shown in FIG. 9, the playback start time (IN_time) on the clip referenced by the play item and the playback start time (IN_time) on the clip referenced by the play item are expressed. End time (OUT_time).

In the case where the PlayItem specifying the audio playback route indicates an access point inside the sub audio stream (auxiliary audio stream) of the clip according to the time stamp, the clip information file is useful for finding out the audio stream in the AV stream file of the clip. Address information for the address to decode.

That is, the Clip Information file referred to by the PlayItem has a table (EP_map of audio) expressing the correspondence between the start time and the address of each playback domain. Therefore, the reproducing device converts the specified time stamp into an address of the audio stream of the playback target playback domain to read out and reproduce.

Since the playback start time and playback end time are determined here in the PlayItem specifying the audio playback route, the slide show can be terminated at, for example, the audio data playback end time. Alternatively, the audio data reproduced up to the end time may be reproduced again to reproduce the audio data a plurality of times.

(1-4) Structure of information processing device (recording device)

Information processing for implementing the present invention for recording data as described above for realizing a slide show in which the playback start time of each still image is predetermined or a slide show in which only the playback order of still images is predetermined will be described below. equipment.

FIG. 10 is a block diagram showing an information processing apparatus 1 embodying the present invention. Referring to FIG. 10 , the information processing apparatus 1 includes: a still image encoder 14 to which a still image is supplied from a terminal 13 and encodes the still image; an audio encoder 11 to which audio data is supplied from a terminal 10 and which encodes the audio data encoding; the controller 16 provides it with information related to the playback content of the slide show through the terminal 15, and also provides it with image attribute information and audio attribute information from the still image encoder 14 and the audio encoder 11, respectively, to generate the aforementioned playlist and clip information; and a recorder 17 to which the playlist and clip information are supplied from the controller 16 to record the playlist and clip information on a recording medium in a preset format.

In the case where the playback start time of each still image is predetermined, the controller 16 receives information on the playback start time and playback duration (display time) of each still image as playback contents related to the slide show The relevant information is shown in Figure 4. In the case of reproducing audio data in a timed relationship in a slide show, the controller 16 receives a play item representing a still image playback path in addition to the playback start time and playback duration (display time) of each still image as audio playback time information, and receives information specifying a playback domain in an audio stream as shown and described with reference to FIG. 6 . In the case of a slide show in which the playback start time of the still images is not predetermined and only the playback order thereof is predetermined, as shown and described with reference to FIG. Save playback time. In the case of reproducing audio data not synchronized with a slide show, the controller 16 receives information specifying a playback domain in the audio stream, in addition to the playback order and default playback time of the respective still images. The data size of each still image and data such as the number of vertical and horizontal pixels are also supplied from the still image encoder 14 to the controller 16 as image attribute information to create images corresponding to the respective still images contained in the image file group. 3 shows clip information.

Based on the supplied information, the controller 16 uses the ID (file_id) expressed in the clip information to create a playlist representing the playback path of the aforementioned still image and audio data. The controller 16 also creates clip information (audio attribute information) of audio data having a table (audio EP_map of the data).

The recorder 17 records clip information and play items on the recording medium 18, and records data based on these information. Fig. 11 shows an illustrative structure of recorded directories and data files. In FIG. 11 , route 100 has directories of BDAV 110 and PICTURE 120 , and BDAV 110 has directories of PLAYLIST 111 , CLIPINF 112 and STREAM 113 . The playlist 111 includes a plurality of playlist files 111a to 110c. The CLIPINF 112 includes a clip information file 112a of an audio stream and a clip information file 112b of an image file group. The STREAM 113 includes a sub audio stream (auxiliary audio stream) file 113a as an option. In addition, the PICTURE 120 includes, for example, a plurality of image file groups 120a composed of a group of still image files 121 to 125.

12A and 12B show examples of the data arrangement of clip information and related still image files on a recording medium (disc). In this embodiment, the reproduction device (player) reads out and reproduces still image files in the order of image file names (image identification information ID (file_id)) appearing in clip information as shown in FIGS. 4 and 7 . That is, in the case where the still picture data is arranged on the recording medium (disc) in the order in which the player reads out the still picture files, the time required to seek the player data can be minimized. It is therefore desirable that still image data can be written on a recording medium in the order in which the still image files are read out.

The recording operation of the recording processing apparatus of this embodiment will be described below. FIG. 13 is a flowchart showing a method for creating a playlist in the recording operation of the present embodiment of the information processing device. First, the still image encoder 14 encodes a still image supplied through the terminal 13 to generate image data, which is then supplied to the recorder 17 . The still image encoder also sends image attribute information to the controller 16 . The audio encoder 11 encodes audio data supplied through the terminal 10 to generate an audio stream sent to the recorder 17 . Still image encoder 14 also sends stream attribute information to controller 16 .

Referring to FIG. 13, the controller 16 acquires the playback content of the slide show (step S1). That is, in the case where the slideshow and audio data are in the AV sync state, as described above, the controller receives the playback start time and playback duration of each still image and The playback duration information of the audio data. If instead the slide show and audio data are not in AV synchronization, the controller 16 receives through terminal 15 information on the playback order and default playback duration of the respective still pictures and information on the playback time direction of the audio data.

Then, the controller 16 receives image attribute information from the still image encoder 14 (step S2), and at the same time receives audio stream attribute information such as EP_map of audio data from the audio encoder 11 (step S3). Then, the controller 16 creates clip information as auxiliary information related to the aforementioned image attribute information (step S4). That is, attribute data of still images are registered in the order of images reproduced in the slide show. In addition, the controller refers to the file_id of the image file of the clip information to create a playlist specifying a playback domain (playback path) of a slide show based on external information supplied from the outside, and to create a playlist specifying a playback path of audio data (step S5). The controller 16 also instructs the recorder 17 to record playlist and clip information therein.

The recorder 17 records the playlist and clip information created by the controller 16 on a recording medium, while recording image data and audio data respectively generated by the still image encoder 14 and the audio encoder on the recording medium. The recorder 17 records the image data such that the image data is arranged in the order of the image files appearing in the play item of the clip information.

The information processing apparatus as a recording apparatus configured as described above manages an image file group generated by collecting one or more still image files into one file, and at the same time manages information such as identification information (file_id) as clip information, where the The information manages each still image contained in this file, and uses a PlayItem that designates reproduction of each still image in the slideshow. Therefore, it is possible to record and realize a slide show while ensuring interchangeability with a moving picture recording apparatus such as that described in Example 2 of the prior art. That is, a still picture group file (picture file group) is provided instead of an AV stream file in a moving picture. A clip information file for referring to a file within a picture file group is provided, and its playback is ordered by a playlist so that it can be used in the same format as clip (information file) or playlist in the format of moving picture data.

(1-5) Structure of information device (recording device)

Fig. 14 is a block diagram showing an information processing device for reproducing data recorded on the aforementioned recording device. Referring to FIG. 14 , the information processing device 20 includes: a readout unit 21 for reading out data from a recording medium; a controller 22 for providing it with playlist and clip information read out by the readout unit 21; a still image decoder 23 and an audio decoder 26 to which the still picture data and audio data read out by the readout unit 21 are supplied; a frame buffer 24 for temporarily storing the decoded still picture; and a processor 25 for controlling the still picture of the still picture replay.

The controller 22 refers to the playlist to obtain the ID (file_id) or still image data to be reproduced, and causes the still image decoder 23 to read and decode the still image data specified by the ID of the still image. If the playback start time for reproducing the still image is not the predetermined slide show, a command is given from the user to the controller 22 through the user interface 27 so that the ID of the still image data can be acquired and read out at the timing commanded by the user. When the reproduction time (duration) expressed in the playlist or the default playback time (default_duration) elapses without a user command, the controller 22 performs an operation of acquiring a still image ID and a readout operation.

The controller 22 refers to the playlist to acquire the playback time of the audio data to be reproduced. The controller also refers to the clip information of the audio stream to acquire the address of the audio stream corresponding to the playback time, thereby instructing the readout unit 21 to read out the relevant audio data.

Now, the playback operation of the information processing apparatus will be described in detail. Fig. 15 is a flowchart showing playback operation in the present embodiment of the information processing device. In FIG. 15 , the readout unit 21 reads out playlist and clip information to send the readout information to the controller 22 . The controller 22 acquires the file_id of the still image of the play item that identifies the playback path of the still image of the playlist. The controller 22 refers to the clip information of the image file group to cause the readout unit 21 to read out the still image file from the image file group (step S12).

The controller 22 also acquires the audio playback time based on the play item representing the audio playback path of the playlist (step S13). The controller 22 also refers to the clip information of the image file group to designate the still image file indicated by the aforementioned file_id of the still image, thereby reading out the still image file from the readout unit 21 (step S12).

The controller 22 also acquires the audio playback time from the play item representing the playback path of the play list (step S13). The controller also refers to the audio stream as a sub stream (auxiliary audio stream) to acquire address information to start decoding the stream data in the audio stream file. Then, the controller manages control of reading out audio data from the audio stream file by the reading unit 21 based on the acquired information.

The still image decoder 23 decodes the still image data read out at step S12 (step S15 ) to input the decoded data to the frame buffer 24 . The audio decoder 26 decodes the audio data read out at step S14 (step S16) to output the decoded audio data. The controller 22 issues preset commands to the processor 25 and the frame buffer 24 . The frame buffer 24 reproduces the image stored therein at preset timing according to the command (step S17).

In step S11, the controller 22 acquires the file_id of the still image at the next timing t1 or t2. The timing t1 is the time when the playback duration of the elapsed still image becomes longer than the playback duration expressed in the relevant scene of the playitem of the playback path of the designated playlist. Timing t2 is the time when a command to switch still images is received from the user interface 27 . When the playback of the last still image of the PlayItem ends, the controller 22 terminates the playback of the PlayList.

In the case where the playback start timing of each still image shown in FIGS. 4 and 6 is predetermined, the controller 22 can read out the file_id at the aforementioned timing t1, that is, when the time length described in the scene of the play item elapses, The corresponding still image is read out with the command readout unit 21 . When the user designates the playback start time of each still image shown in FIGS. Corresponds to the readout of still images. In the case where a still image switching command is not provided, a time point when a preset default playback time (default_duration) elapses may be set as the readout timing of the next file_id.

In the information processing device as a reproducing device configured as described above, two layers consisting of playlists and clips for managing still image and audio data are provided as the data for realizing a slideshow, that is, continuous reproduction of still images. Format. Since the collection of still pictures in a clip, the audio stream in a clip, and the clip information file as its auxiliary information are managed using separate files, it is possible to provide and apply the moving picture recording and/or The reproduced data format is the same format. That is, since an image file group composed of one or more still images and a clip information file for managing the image file group are provided in a clip, the playback domain of the slide show is specified by the play item of the playlist, so it is possible to Enables slideshows, which are continuous playback of multiple still images, while maintaining compatibility with information processing devices that process moving images.

Also, the seek time involved in readout can be shortened by recording still images in the order of the playback path expressed in the PlayItem of the PlayList.

Variation of (1-6)

In the above embodiments, one or more still images contained in a picture file group are given different picture file names, and the picture file group is managed as separate picture file sets. Alternatively, these still image files may be managed as a single image file. A variation in the first implementation in which one or more still images contained in an image file group are managed as a single image file will be described below.

In this variation, the image files of the image file group are divided into a plurality of image file groups containing one or more still images. The files of these still picture file groups are hereinafter referred to as still picture group files. ID numbers are assigned sequentially from the beginning of the playback order of the still picture groups.

In the present variation in which one or more still images contained in an image file group are managed as a single image file, it is possible to group together simultaneously expressed still images to manage as a group. In the specified case of the slideshow shown above with reference to FIG. 8, two still images reproduced at the same time, that is, file_id=1 and file_id=2, are arranged in one group, and a still image of file_id=3 is arranged in one group. , and two still images reproduced at the same time, file_id=4 and file_id=5, are arranged in one group.

In this case, the structure is different from that of the playlist shown in FIG. 7 . FIG. 16 shows the relationship between PlayList and Clips of this modification. Referring to FIG. 16 , like FIG. 7 , the playlist is composed of playitems representing playback paths of still images. However, the PlayItem has a page (Page) instead of the scene shown in FIG. 7 . Note that the scenes shown in FIG. 7 include information specifying the playback order of the scenes in the PlayItem, the still image identification information ID (file_id) when referring to the image file group in the clip, and the default playback time. The page in this modification differs from the page in the previous embodiment in that ID (file_id) as identification information of each still image group is expressed instead of ID (file_id) as still image identification information of a scene. In other respects, pages have the same functionality as scenes. That is, the page includes information specifying the playback order of pages in the PlayItem, still image group identification information ID (file_id) when referring to image file groups in a clip, and default playback time (default_duration) for each group.

In this embodiment, the playlist again refers to still images in the clip. The clip information specifies the relationship between the still image referred to by the playlist and its entity. That is, the PlayList refers to still picture group identification information ID (group_id) for identifying a still picture in a Clip. The clip information designates address information on a recording medium of still images grouped by still image group identification information ID (group_id). The reproducing device acquires this address information to read out and reproduce still images.

17A and 17B show typical data arrangements on a recording medium (disc) of clip information and related still picture files in the present embodiment shown in FIG. 16 . As described above, clip information includes address information (ads1, ads2, ads3) of grouped still images corresponding to each still image group identification information ID (group_id). Still picture group data is recorded on the recording medium in the playback order of PlayItems, that is, in the order of still picture group identification information IDs (group_id=1, 2, 3).

The reproduction device (player) reads out and reproduces the still picture data in the order of the still picture group identification information ID (group_id) appearing in the clip information. By utilizing this still image file structure, it is possible to reduce the amount of file system data used for file management, compared to the case where the image file group is a set of discrete image files.

(2) The second embodiment

Next, a second embodiment of the present invention will be described. In the above-described embodiments, the still images of the image file group or the image data in each still image group are directly recorded on the recording medium. In this second embodiment, image data is recorded in the form of a transport stream (TS). When a plurality of still images are multiplexed within one transport stream, the still images are multiplexed by the recorder 17 as described with reference to FIG. 10 .

(2-1) Slideshow: Still images only

18A and 18B show the data arrangement on the recording medium (disc) of clip information and related still image files of the present embodiment, respectively. Here again, a slide show in which one or more still images reproduced at the same time are managed as a still image group, the playback order is specified, and the playback time is the playback time of each still image in which (still images in a slide show) duration of the picture) is the limited default playback time.

In the present embodiment in which the image data of each still picture group is multiplexed in the transport stream, the clip information includes EP_map as the identification information (group_id) specifying the grouped still picture and the corresponding start in the transport stream in which the grouped still picture is multiplexed. The address is the table of start source packet numbers (SPN_start). At the same time, the source packet number is the number provided to each source packet in the transport stream file in the manner of incrementing by 1 each time, wherein the initial source packet number in the transport stream file is zero.

Like the first embodiment described above, when image data is multiplexed in a stream, the recording device records image data in still image groups in playback order (readout order). The reproducing device (player) reads out and reproduces still picture data in the order of still picture group identification information ID (group_id) appearing in the clip information. With this structure of the still picture file, the structure of the transport stream can be conveniently similar to that of the AV stream file explained in the aforementioned prior art example 2, so that a recording and/or reproducing device having similar characteristics can be conveniently used.

With the modification shown in FIG. 17 and the embodiment shown in FIG. 18, in which data are arranged in the data reproduction order, advantageous effects similar to the case of FIG. 12 can be obtained. That is, by arranging the still picture data on the recording medium (disc) in the order in which the still picture files are read by the player, and by writing the still picture data in the order of the still picture files to be read out, it is possible to minimize the The time involved in finding data in .

(2-2) Slide show: still image and audio data

Now, the case of a slide show in which audio data is reproduced asynchronously with the slide show will be described. FIG. 19 shows a playlist in the case of asynchronously reproducing audio data in this embodiment. The playlist is composed of play items indicating a playback path of still images and play items indicating a playback path of audio data. This slideshow differs from that shown in FIG. 9 in that the playback path of still images is a PlayItem, and the playback path of audio data is a SubPlayItem. Therefore, in this embodiment, the SubPlayItem has a playback start time In-time and a playback end time Out-time, and refers to the playback start and playback end timestamps in the audio stream. The PlayItem includes pages that are individual still image data constituting a slideshow.

The reproduction device refers to the clip information to acquire address information on the recording medium of the audio stream data corresponding to the playback start time IN-time and the playback end time OUT-time. Using the address information, the reproducing device reads out and reproduces the address information. The scheme of audio playback is similar to the first embodiment shown in FIG. 9 .

In addition to the information exemplified by the playback path, auxiliary information, hereinafter referred to as playback auxiliary information, may be appended to the SubPlayItem and the SubItem as playback control information. The sub play item in this embodiment is appended with first information (SubPlayItem_type) as playback auxiliary information, which indicates that the playback of the sub play item is asynchronous with the playback of the play item. The SubPlayItem in this embodiment is also appended with a flag (second information) (is_repeat_SubPlayItem flag) as playback auxiliary information, which represents the audio represented by the playback start time IN-time and the playback end time OUT-time. Whether the stream playback domain is reproduced repeatedly or only once. Based on this first information SubPlayItem_type, the reproducing device determines that the sub play item is to be reproduced asynchronously with the play item. For example, if is_repeat_SubPlayItem is 0 or 1, the playback field is reproduced once or repeatedly, respectively.

In the foregoing, it is assumed that these two kinds of playback auxiliary information have a static data format and are auxiliary to SubPlayItem. Alternatively, these two kinds of playback assistance information may be subordinate to the SubPlayItem in a command format of a playback control (so-called PBC) command format. For example, the command Repeat_SubPlayItem may be used instead of the flag is_repeat_SubPlayItem to subordinate two kinds of auxiliary information to the SubPlayItem.

(3) The third embodiment

A third embodiment of the present invention will be described below. In this third embodiment, if the playback time of still images is predetermined, in the first embodiment of the above-mentioned slide show of FIG. 4 or in the slide show of FIG. 7 or FIG. As described in the scene or page in the show, playback control information designating a single playback path is a single play item, and a plurality of play items corresponding to the number of scenes or pages are provided. The structure is similar to the structure of the play item in the information processing device described in prior art example 2 by employing each play item to represent a playback path (one playback domain), in prior art example 2, providing Playback domains of AV streams (play items represented by a pair of IN-point (in point) and OUT-point (out point) on the time axis) arranged into groups are defined, thereby further improving compatibility.

(3-1) Slideshow: Still images only

20 shows a slide show in which the playback order is specified and the playback time of each slide (the duration of the slideshow) is limited, and specifically shows the relationship between the playlist, still images, and playback duration, where using Play item instead of the scene shown in FIG. 7 or the page shown in FIG. 19 . In this embodiment, each PlayItem specifies still images of respective still images or still image groups reproduced simultaneously using playback start time IN_time and playback end time OUT_time as shown in FIG. 20 . More specifically, each scene or page designation in the play item shown in Figure 7 or 19 represents the default playback duration (display duration) default_duration of the duration of each scene or page, and in the present embodiment, the playback Item 1 corresponds to page [1] of FIG. 19, as shown in FIG. 20, and IN_time and OUT_time are set to t1 and t2, respectively. Therefore, the playback duration indicated by t1 to t2 is equivalent to the default playback duration d1 (default_duration). On the other hand, IN_time and OUT_time of PlayItem 2 are set to t2 and t3, respectively. Therefore, the playback duration indicated by t2 to t3 is equivalent to the default playback duration d2 (default_duration). Also, IN_time and OUT_time of PlayItem 3 are set to t3 and t4, respectively. Therefore, the playback duration indicated by t3 to t4 is equivalent to the default playback duration d3 (default_duration).

IN_time and OUT_time of each PlayItem indicate the playback range of the AV stream, that is, reproduce still image data from the PTS of IN_time up to the PTS of OUT_time in the AV stream. In a slide show of the type shown in FIG. 20 , when reproducing still image data from the PTS of IN_time up to the PTS of OUT_time of a given play item, the player automatically proceeds to reproduction of the next play item.

In the PlayItem shown in FIG. 20, the default playback time of still images is limited. However, if the producer of the playlist desires to set the default playback time to an infinite length, the default playback time can be set to the information of the play item by adding information indicating that the playback image is continuously displayed at the playback end time OUT_time to the information of the play item. The time is set to an infinite length. As in the case of the information processing apparatus described in Prior Art Example 2 above, information as playback auxiliary information can be newly added to the PlayItem. As shown in, for example, FIG. 21 , a flag Is_Playtime_Still as playback auxiliary information indicating whether or not images of OUT_time are to be continuously reproduced may be subordinate to the PlayItem. If the flag is_Playtime_Still is set to 1 (that is, if the default_duration is infinite), the reproducing device continues to display the image when the image of the PTS at the playback end time OUT_time of the PlayItem is reproduced. In this case, the player does not proceed to playback of the next slide except in the case where the user commands the player to proceed to the next slide of the slideshow. If the user commands the player to go to the next slide, the player starts reproducing the next play item.

By subjecting the flag is_Playtime_Still to a PlayItem, a PlayItem with a limited default playback time and a PlayItem with an infinite default playback time can coexist in a single PlayItem. FIG. 21 shows an example in which the playback time of PlayItem 1 and PlayItem 3 is infinite and the playback time of PlayItem 2 is limited. The playback time of all play items can also be set to infinite.

In the foregoing, the playback auxiliary information indicating that the playback image for OUT_time continues to be displayed is data in the form of a static flag belonging to the PlayItem. Alternatively, playback assistance information can also be assigned to the play item in the form of playback control commands (so-called PBC). Specifically, playback auxiliary information can also be subordinated to a play item using, for example, the command Still_PlayItem.

A still image file composed of one or more still images referred to by one or more still images of FIGS. 20 and 21 is recorded on a recording medium in the form of a transport stream shown in FIG. 18 . The data address of the transport stream indicated by the playback start time IN_time and the playback end time OUT_time of the PlayItem can be acquired by referring to the EP_map of the clip information. 22 and 23 schematically show a playlist and its clip information and data recorded on a recording medium.

FIG. 22 shows a case where the playback duration of the play item shown in FIG. 20 is limited. In the still image file in transport stream form, the transport stream consisting of ABCD0001.JPG and ABCD0001.PNG multiplexed together corresponds to the presentation time stamp PTS from t1 to t2, and the transport stream composed of ABCD0002.JPG multiplexed together The transport stream corresponds to the presentation time stamp PTS from t2 to t3, and the transport stream composed of ABCD0003.JPG and ABCD0003.PNG multiplexed together corresponds to the presentation time stamp PTS from t3 to t4. In the PTS range from t1 to t4, still images and graphics or subtitles overlaid thereon are multiplexed on the transport stream.

The EP_map of the clip information file recorded on the recording medium in association with the transport stream of the still image file is a table representing the relationship between the value of the presentation time stamp PTS and the source packet number in the transport stream it represents. That is, the EP_map in this embodiment holds the values of the source packet numbers indicated by the IN_time values of PlayItem1, PlayItem2, and PlayItem3, ie, t1, t2, and t3. It should be noted that the EP_map shown in FIG. 18 in the above-mentioned second embodiment is a table representing the relationship between a plurality of still picture group identification information IDs (Group_id) and the source group number SPN_start at the beginning of the currently discussed information, and this The EP_map shown in FIG. 22 in the embodiment has a structure similar to the EP_map shown in the above-mentioned prior art example 2, that is, the interval between the time stamp PTS_start representing a still image and the source packet number SPN_start where the time stamp in question starts. The structure of the table corresponding to the relationship.

The reproducing device (player) reads out and reproduces the still image data referred to by the PlayItem, that is, the data designated by the source packet number SPN_start. With this structure of a still picture file, in which the transport stream is structurally the same as the AV stream file described in the above-mentioned prior art example 2, it is possible to easily use a recording and/or reproducing apparatus having a similar structure.

For the PlayList shown in FIG. 22, the default playback time of still images is set to a limited value, where the default playback duration is the time field specified by the playback start time IN_time and playback end time OUT_time of the PlayItem. On the other hand, the PlayList shown in FIG. 23 contains PlayItems in which the default playback time of still images is set to an infinite length. The default playback time is infinite indicated by is_PlayList_Still attached to the PlayItem.

The user can instruct the rendering device to enter playback of the next still image without waiting for the default playback time to elapse, or halfway through the default playback time if the default playback time is set to an infinite value . For example, if the reproducing device is reproducing play item 1, and the user instructs the reproducing device to reproduce the next still image, the reproducing device starts reproducing play item 2. The playback start time IN_time=t2 in this case. The recording device reads out and reproduces data from the source packet indicated by the source packet number spn2 corresponding to t2 of the EP_map.

The default playback time of a still image of a PlayItem may be indicated using information specifying playback pause of an image of OUT_time and information indicating a still image duration.

For example, the above-mentioned flag is_PlayItem_Still is used as the information representing the pause of playback of the image of OUT_time, and the information Still_duration designating the duration of the still image is added to the is_PlayItem_Still flag. Specifically, when the flag is_PlayItem_Still is 1, it indicates that the playback of the OUT_time image is suspended so that the duration of the still image can be specified by Still_duration. If the duration of the still image Still_duration is set to a preset value, the duration of the still image may represent an infinite duration. For example, if the still picture duration of the 8-bit value is 0xFF, it indicates that the still picture duration is infinite, otherwise the value of Still_duration specifies a finite duration of the still picture. The unit of the still image duration value may be, for example, seconds (sec).

If random access to selectable PlayItems is considered, it is more convenient that the parts of the Transport Stream referenced by the individual PlayItems are not multiplexed in the Transport Stream file at the source packet level, because the data readout required to playback the PlayItem amount can thus be minimized. To this end, the synchronization signal (SystemTimeClock) STC that forms the basis of the Transport Stream is independent for the part of the Transport Stream referenced by each PlayItem. The Transport Stream section referenced by the PlayItem is independent within the Transport Stream file.

The clip information file shown in FIG. 24 has SequenceInfo (sequence information) similar to the above-described prior art example 2. SequenceInfo is auxiliary information of the clip information file, and represents the correspondence between the source packet number (SPN_STC_start) of the continuous system timing clock STC starting in the transport stream file and the system timing clock index number (stc_id) of the system timing clock STC relational table. A string of source packets with a continuous system timing clock STC is called an STC-sequence (STC-sequence).

In this case, in addition to the playback start time IN_time and playback end time OUT_time, the PlayItem has a reference value (ref_to_stc_id) to STC referred to by these timestamps, as shown in FIG. 24 . The reproduction device (player) uses EP_map and Sequence_Info to read out still image data referred to by PlayItem.

(3-2) Slide show: still image+audio data

Each playback domain reproduces a case of audio data along with a slideshow represented by a playlist.

(3-2-1) Still image and audio data to be reproduced synchronously

First, a case where audio data is reproduced in synchronization with a still picture playlist as shown in FIG. 22 will be described. In the above-described first embodiment shown in FIG. 6, the playback start time and playback duration of each still image in the slide show are determined. The sub play item is used for audio playback control information indicating a playback path of audio data reproduced in synchronization with playback of a still image. Although SubPlayItem can be used as a playback part of audio data, in the case of multiplexing a still picture to a transport stream, audio data reproduced in synchronization with a still picture can also be multiplexed out a stream, and facilitates replay processing.

FIG. 25 shows a playlist of a slide show in which audio data reproduced in synchronization with a still image is multiplexed in a transport stream and the audio data is reproduced in synchronization with playback of the still image. In the case of Fig. 22, one or more still images are multiplexed in the transport stream. In this embodiment, an audio stream reproduced in synchronization with a slide show is multiplexed together with still images in a transport stream. Using EP_map of clip information, a reproduction device (player) reads out still image data and audio data referenced by PlayItem according to presentation time stamp PTS, thereby reproducing and outputting the still image and audio data in a time relationship with each other.

Two methods in which EP_map of FIGS. 22 to 25 point to source packets in a transport stream file (still picture file) are explained below.

In EP_map shown in FIG. 26, the first video packet 'V' containing still picture data corresponding to the playback start time PTS (=t2) of the still picture is pointed to by the source packet number spn2. In this case, sub-picture information such as graphic 'G' or subtitle 'S' overlaid on a still picture (synchronous reproduction) is multiplexed behind the video packet specified by EP_map.

PAT (Program Association Table) and PMT (Program mapping table) is multiplexed in the TS file, as shown in Figure 27. A packet containing PAT can be represented by source packet number spn2 of EP_map, for example.

(3-2-2) Still image reproduced asynchronously with playback of audio data

Next, a case where audio data is reproduced asynchronously with a playlist of still images will be described. FIG. 28 shows a playlist of a browsable slide show in which audio data is reproduced asynchronously. The playlist is composed of a plurality of playitems specifying a playback path of still images and subplayitems specifying a playback path of audio data. Similar to the second embodiment shown in FIG. 19 , the playback start time IN_time and the playback end time OUT_time of the Sub PlayItem are respectively indicated by the playback start time stamp and the playback end time stamp in the audio stream.

The reproducing apparatus refers to the clip information to acquire data address information on the recording medium of the audio stream corresponding to the IN_time and OUT_time of the Sub PlayItem. Using this address information, the reproducing device reads out and reproduces audio data. The scheme of audio playback is similar to the first embodiment shown in FIG. 9 . As with the embodiment shown in FIG. 19, the creator of the playlist can add playback assistance information to the playitem. Specifically, a flag (is_repeat_SubPlayItem flag) indicating whether the playback domain specified by the playback start time IN_time and playback end time OUT_time of the audio stream is repeatedly reproduced or only once reproduced and the Information (SubPlayItem_type) of the asynchronously reproduced sub play item is played as playback auxiliary information. Playback auxiliary information can also be attached to the subplay item in the form of playback control commands as described above.

In this case, the recording device can reproduce the Sub PlayItem by the following three methods. The first method alternately reads out the respective files in a time-sharing manner while reading out data of two files, namely, a still image file referred to by a playitem and an audio stream file referred to by a subplayitem. When the data of these two files are alternately read out from the recording medium, the reproducing device reproduces still image and audio data in this case.

The second method first reads out all the data of the audio stream file referenced by the SubPlayItem to store the read out data in the buffer memory of the reproduction device. Then, the still image data referred to by the PlayItem is read from the recording medium. The reproducing device reads out still image data from the recording medium and at the same time reads out audio data from the buffer memory to reproduce the still image and audio data.

The third method first reads out all the data of the still picture file referred to by the PlayItem to store the read out data in the buffer memory of the reproduction device. Then, the audio stream referred to by the SubPlayItem is read out from the recording medium. The reproduction device reads out the audio stream from the recording medium, and when it reads out the still picture from the buffer memory, reproduces the still picture and audio data.

The above second and third methods are respectively effective in the case where the byte size of the audio stream file referred to by the subplayitem is large and in the case where the byte size of the still image file referred to by the subplayitem is small.

As a practical example, if the data size is on the order of several megabytes (Mbyte), the entire file data can be read out into the buffer memory before playback. If the audio playback is BGM (background music) and the playback of the sub play item is repeatedly performed when the browsable slide show is applied, the second method above is effective because the bit rate is 256kbps for about 65 seconds of the audio stream The data size is approximately 2 megabytes (Mbyte).

Now, the player model in the case of reading by the first method described above will be described. Fig. 29 is a block diagram showing a reproducing apparatus employing the first readout and reproducing method described above. With this method, when two files are read from the drive (recording medium), that is, the main transport stream (still image file) referred to by the play item (hereinafter referred to as the main TS) and the audio transport stream referred to by the sub play item (hereinafter referred to as When making audio TS) data, each file is read alternately. The structure of the transport stream of this embodiment will be described in detail later.

The reproducing device alternately reads out two files (main TS and audio TS) from the recording medium to reproduce still image and audio data. The document data read out by the readout unit 31 is demodulated by the demodulator-ECC decoder 32 . Error correction is performed on the demodulated multiplexed stream. The source packet data of the main TS file is buffered by the read buffer 33 of the main TS, and the source packet data of the audio TS file is buffered by the read buffer 34 of the audio TS.

The stream data read out from the read buffer 33 of the main TS is supplied to a player 35 of the main TS (BDAV MPEG2 TS player model 1) to be described later. The player 35 of the main TS outputs the stream data read out from the read buffer 33 of the main TS at the transmission rate R _MAX to the PID (packet ID) filter of the main TS at a preset timing (transmission rate R _{TS_m} ). )37. The stream data read out from the read buffer 34 of the audio TS is supplied to an audio data player 36 (BDAV MPEG2TS player model 2) to be described later. The audio data player 36 outputs the stream data read out from the read buffer 34 of the audio TS at the transfer rate _RA at a preset timing (transfer rate R _{TS_a} ) to the audio data downstream side PID filter 39 of the downstream side stage.

The PID filter 37 of the main data distributes and outputs the input main TS to the downstream side decoder of each elementary stream according to the PID (packet ID). That is, system information such as still images (video), sub-picture information such as graphics and subtitles, PSI (Program Specific Information) or SI (Service Information) of the main TS are allocated to the transmission buffers TB1, TB2, and TB _sys1 . Meanwhile, SI is also packetized into transport packets, and can be exemplified by SIT (Selection Information Table). Transport packets of still images are sent from the transport buffer TB1 to the multiplexing buffer MB at a preset rate Rx ₁ , and thus are transmitted as an elementary stream EB at a preset rate Rbx ₁ to be output after being decoded by the decoder D1. Transport packets of sub-picture information are sent from the transport buffer TB2 to the buffer B2 at a preset rate Rx ₂ to be output after being decoded by the decoder D2. Transmission packets of system information are transmitted from the transmission buffer TB _sys1 to the buffer B _sys1 at a preset rate Rx _sys to be output after being decoded by the decoder D _sys1 .

In a similar manner, the PID filter 38 for audio data distributes and outputs the input audio transport stream to downstream-side decoders of the respective elementary streams according to the PID (packet ID). That is, transport packets of audio are transmitted from the transport buffer TB4 to the main buffer B4 at a preset rate, and are output after being decoded by the decoder D4. The transmission packets of the system information of the audio TS are transmitted at the preset rate Rx _sys2 from the transmission buffer TB _sys2 to the buffer B _sys2 , and thus are transmitted at the preset rate R _sys to the decoder D _sys2 , where it is decoded and output.

An audio switch (audio SW) 39 is installed between the PID filter 38 for audio data and the transmission buffers TB4 and TB _sys . The audio switch 39 performs switching control between a case of reproducing a slide show in a time base mode such as shown in FIG. 25 and a case of reproducing a slide show in a browse mode such as shown in FIGS. 23 and 24 . That is, the audio switch 39 includes a time-base mode switch SW _T supplied with data from the read buffer 33 of the main TS, connected to the PID filter 37 of the main data, and supplied from the read buffer 34 of the audio TS. Provides data, browsable mode switch _SWB of PID filter 38 connected to audio data. Audio Switch Toggle between these switches to send the audio stream to transmit buffer TB4. For example, in the case of a browsable slide show, the audio switch 39 is set to the side of the browsable mode switch SW _B , in which case the audio stream passes through the audio data filter 38 from the read buffer of the audio TS 34 is supplied to audio decoder D4. In the case of a time-based slide show such as that shown in Fig. 25, where the audio stream is multiplexed on the main TS, the audio switch 39 is set to the side of the time-based mode switch SW _T , in which case the main data The filter 37 of provides the audio stream from the read buffer 33 of the main TS to the transport buffer TB4 or TB _sys2 .

The decoder of the elementary stream will now be described. The representation methods of TBn, MB, EB, TBsys, Bsys, Rxn, Rbxn, Rxsys, Dn, and Dsys are the same as those defined in T-SCD (System Target Decoder) ISO/IEC13818-1 (MPEG2 System Standard), and are as follows Said:

TBn (n=1 to 5): Transmission buffers for elementary streams

MB: Multiplexing buffer for video stream

EB: Elementary stream buffer for video streams

TBsys: Input buffer for system information of the program being decoded

Bsys: The main buffer in the system target decoder for the system information of the program being decoded

Rx _n : transfer rate of data removed from TBn

Rbx _n : transfer rate for removing PES packet payload from MBn (valid only for video streams)

Rx _sys : transfer rate of data removed from TBsys

Dn: decoder in elementary stream n

D _sys : the decoder related to the system information of the program being decoded

The main TS player 35 (BDAV MPEG2TS player 1) and the audio data player 36 (BDAV MPEG2TS player 2) shown in FIG. 29 will now be described. 30A and 30B are block diagrams showing the player 35 of the main TS and the player 36 of audio data.

Referring to FIG. 30A, the source packet data read out from the main TS read buffer 33 of the preceding stage in the player 35 of the main TS is supplied to a source depacketizer (depacketizer) 41 at a bit rate Rmax, where Rmax is the main TS file The bit rate of the source packet stream.

The arrival timing clock counter 42 is a binary counter for counting pulses at a frequency of 27 MHz output from the pulse oscillator 43 (27 MHz crystal oscillator (X-tal). The arrival timing clock counter outputs the count value Arrival_time_clock at time (i) (i).

Both the main TS and the audio TS are composed of data strings in units of source packets including transport packets and their arrival time stamps. A source packet includes a transport packet and its arrival_time_stamp (ATS). arrival_time_stamp is a timestamp representing the time when the corresponding transport packet arrived at the decoder. A time axis formed from the arrival_time_stamp of each source packet constituting each flow is called an arrival time base, and its clock is called an ATC (Arrival Timing Clock).

When the arrival_time_stamp of the current source packet read from the main TS is equal to the LSB-side 30 bits of the count value arrival_time_clock(i) of the arrival timing clock counter 42 , the transport packet of the source packet is output from the source depacketizer 41 . R _{TS_m} is the bit rate of the main TS.

In the audio data player 36, the source packet data read from the audio TS read buffer 34 of the previous stage is sent to the source depacketizer 44 at the bit rate _RA , as shown in FIG. 30B. The bit rate R _A is the bit rate of the source packet stream of the audio TS file.

The arrival timing clock counter 45 and pulse oscillator 46 operate similarly to the player 35 of the main TS. The source depacketizer 44 works similarly to the player 35 of the main TS. That is, when the arrival_time_stamp of the current source packet is equal to 30 bits on the LSB side of the count value arrival_time_clock(i) of the arrival timing clock counter 45 , the transport packet of the source packet is output from the source depacketizer 44 . R _{TS_A} is the bit rate of the audio TS.

FIG. 31 shows the concept of a buffer model of a slide show in browsable mode. In browsable mode, when a main TS file referred to by a play item as a still image file and an audio TS file referred to by a sub play item are alternately read out from the drive at the rate of _RUD , it is necessary to ensure that the source packet stream of the main TS The bit rate R _MAX of the audio TS and the bit rate _RA of the source packet stream of the audio TS. For this reason, when the main TS and the audio TS are recorded after being encoded by the still image encoder 14 and the audio encoder 11 of FIG. 10 , respectively, it is necessary to impose restrictions on the upper limit values of the respective bit rates.

32A and 32B are diagrams showing typical bit occupancy amounts of the elementary stream buffer EB (video code buffer) and audio code buffer B4 during the slide show in the browseable mode shown in FIG. 29 . In FIGS. 32A and 32B, the ordinate represents the buffer occupancy of the video code buffer and the buffer occupancy of the audio code buffer, while the abscissa represents the system timing clock STC of the main TS and audio TS.

In FIG. 32A, the start-up delay represents from the input time _tv of the first video packet until the time when the I-picture is buffered in the elementary stream buffer EB, ie the time stamp (DTS) is decoded. When the user skips to the next slide in the browsable mode, the input of the aforementioned first video group starts. In FIGS. 32A and 32B, the slope k _EB represents the input rate of the video buffer EB, and the slope k _B4 represents the input rate of the audio buffer B4. Meanwhile, the time when the slope k _EB is zero and the video code occupancy rate is constant means the time when auxiliary image information such as graphics or subtitles is being read out.

If it is guaranteed to read out the source packet stream of the main TS at the bit rate R _MAX , the still picture can be decoded in the video decoder D1 of the downstream side stage shown in Fig. 29, so that the decoded still picture will be in the preset decoding within the timed period. Also, if it is ensured that the source packet stream of the audio TS is read out at the bit rate _RA , in the audio decoder D4 of the downstream side stage shown in FIG. 29, the audio data can be decoded within the time of preset decoding timing.

FIG. 33 schematically shows a model of a method for simultaneously reading out a main TS and an audio TS in a slide show in a browseable mode.

It is assumed that main TSs and audio TSs are arranged consecutively on the disc. In this case, the main TS and audio TS are read out alternately as follows:

(1) Read out the preset data volume X from the main TS;

(2) Jump to the preset data position of the audio TS;

(3) Read out the preset data volume Y from the audio TS;

(4) Jump to the preset data position of the main TS, and read out the preset data amount X from the main TS.

The data amount X read from the main TS in one read operation is the necessary size of the main TS read buffer 33 . The data amount Y read from the audio TS in one read operation is the necessary size of the audio TS read buffer 34 . The equation shown below describes an equation for calculating the sizes required for the read buffer 33 of the main TS and the read buffer 34 of the audio TS:

$\mathrm{<span\; class="notranslate">\; x</span>}<span\; class="notranslate">\; =</span>{\mathrm{<span\; class="notranslate">\; R</span>}}_{\mathrm{<span\; class="notranslate">\; MAX</span>}}<span\; class="notranslate">\; \&times;</span><span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; 2</span>}<span\; class="notranslate">\; \&times;</span>\mathrm{<span\; class="notranslate">\; Tj</span>}<span\; class="notranslate">\; +</span>\frac{\mathrm{<span\; class="notranslate">\; the\; y</span>}}{{\mathrm{<span\; class="notranslate">\; R</span>}}_{\mathrm{<span\; class="notranslate">\; UD</span>}}}<span\; class="notranslate">\; )</span>$

$\mathrm{<span\; class="notranslate">\; the\; y</span>}<span\; class="notranslate">\; =</span>{\mathrm{<span\; class="notranslate">\; R</span>}}_{\mathrm{<span\; class="notranslate">\; A</span>}}<span\; class="notranslate">\; \&times;</span><span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; 2</span>}<span\; class="notranslate">\; \&times;</span>\mathrm{<span\; class="notranslate">\; Tj</span>}<span\; class="notranslate">\; +</span>\frac{\mathrm{<span\; class="notranslate">\; the\; y</span>}}{{\mathrm{<span\; class="notranslate">\; R</span>}}_{\mathrm{<span\; class="notranslate">\; UD</span>}}}<span\; class="notranslate">\; )</span>$

Wherein, x is the size required for the read buffer 33 of the main TS=the amount of data read from the main TS by one read operation;

y is the size required for the read buffer 34 of the audio TS = the amount of data read from the audio TS by one read operation;

T _j : jump time;

R _UD is the bit rate read from the drive;

R _MAX is the bit rate of the source packet stream of the audio TS; and

R _A is the bit rate of the source packet stream of the audio TS.

For example, if the bit rate R _UD read out from the drive is 54 Mbps, the jump time T _j is 0.8 seconds, the bit rate R _MAX of the source packet stream of the audio TS = 20 Mbps, and the bit rate R _A of the source packet stream of the audio TS is 640 kbps, the size x required for the read buffer 33 of the main TS is 4.06 megabytes, and the size y required for the read buffer 34 of the audio TS is 0.176 Mbps.

(3-3) Other examples of still image data

In the description with reference to FIG. 23, the data format of the still image is JPEG, PNG. However, the data format may also be other still image data formats such as MPEG2I image, GIF or JPEG 2000. Fig. 34 shows a case where an MPEG2I picture (intra-coded picture) is multiplexed on a transport stream. Specifically, FIG. 34 shows a playlist, clip information, and data structures recorded on a recording medium when an I picture (intra-coded picture) is used as still picture data. This data structure is different from that shown in FIG. 23 only in that the picture is an I picture (intra-coded picture) in which the relationship between the PlayList and EP_map and the transport stream is unchanged. In this case, it is possible to add a SubPlayItem indicating a playback path of audio data with respect to the PlayList as in the case shown in FIG. 28 .

In a similar manner, the data format of the still image in the description of FIG. 22 is JPEG, PNG. However, a still image data format such as MPEG1I image, GIF, or JPEG2000 may also be used. Also, in this case, audio data can be multiplexed on the transport stream file (still image file) in the same manner as in the case shown in FIG. 25 .

Two methods in which EP_map of FIG. 34 points to source packets in a transport stream file (still image file) will be described below. In the transport stream file shown in FIG. 35, each I picture starts with a sequence header, and, as explained in the aforementioned prior art example 2, the packet including the first packet of the sequence header is pointed to by EP_map.

In this case, graphics 'G' or subtitle 'S' overlaid on a still image (synchronous reproduction) are multiplexed behind the video packet specified by EP_map.

In the transport stream file shown in FIG. 36, PAT and PMT, which are system information of the MPEG2 transport stream, are multiplexed before a packet including the first byte of the sequence header, and the packet including the packet is pointed to by EP_map.

If an I picture and graphics or subtitles overlaid thereon are multiplexed on a transport stream in a transport stream file (still picture file), the data structure expressed as an I picture may have either of the following two structures. The first structure is such a structure that a sequence end code immediately follows a single I picture. The second structure is a structure in which a still image is encoded as a video sequence, in which a plurality of images corresponding to the playback time of a PlayItem are encoded. That is, the second structure is such a structure composed of an I picture, a plurality of P pictures (intra forward predictive coded pictures), and a plurality of B pictures (intra bidirectional predictive coded pictures). P-pictures and B-pictures predicted from I-pictures encode still pictures that are video and therefore have no prediction data, so they are encoded using so-called skipped MPEG2 macroblocks. In the first and second structures described above, the I picture is preceded by a sequence header.

The playitem for slide show of this embodiment and the playitem for reproducing a moving image as described in prior art example 2 above can coexist in a single playlist. Thus, the user may be able to enjoy playback of moving images and playback of still images in reproducing a single playlist.

(3-4) Structure of information processing device (recording device)

In the above-described third embodiment of the present invention shown in FIGS. 20 to 36, the recording device (information processing device) can be constructed like the first embodiment. That is, referring to FIG. 10 , the information processing apparatus 1 includes: a still image encoder 14 to which a still image is supplied through a terminal 13 to encode the image; an audio encoder 11 to which a still image is supplied through a terminal 11 to encode the image; The data is encoded; the controller 16 is supplied with the image attribute information and the audio attribute information from the still image encoder 14 and the audio encoder 11 to generate the aforementioned playlist and clip information; and the recorder 17 is supplied from the controller 16 to it Playlist and clip information are provided for recording on a recording medium such as Blu-ray, and for recording still image and audio data in a preset format on the recording medium.

In a case where the playback start time of each still image is predetermined, the controller 16 receives the playback start time and playback duration (display duration) of each still image as information on the playback content of the slide show. If audio is reproduced in synchronization with a slide show as shown in FIG. 25, the controller receives the playback start time and playback duration (display duration) of the audio data reproduced in synchronization with each still image. If the slide show as shown in the aforementioned FIG. 21 is a slide show in which the playback start time of each still image is not predetermined but only the playback order thereof is predetermined, the controller receives the playback order of each still image and Default replay time. In the case where the slide show is a slide show that reproduces audio data that is not synchronized with the slide show, the controller receives, in addition to the playback order and default playback time of the individual still images, the Release the domain information, as shown in Figure 28. The playback time (PTS_start) of each picture and the corresponding source packet number (SPN_start) are also supplied to the controller 16 as picture attribute information to create clip information corresponding to EP_map shown in FIG. 22 .

Based on the supplied information, the controller 16 refers to the playback time (PTS_start) of each image expressed in the clip information to create a playlist representing playback paths of still images and audio data. In the case of a browsable slide show, the controller creates clip information (audio attribute information) of audio data including specifying the relationship between the playback time of the audio data and the address (access point) of the smallest access unit of the audio stream table (EP_map of audio data).

The recorder 17 records clip information and playitems on the recording medium 18, while recording data based on the information.

The recording operation of the information processing apparatus of this embodiment will now be described. FIG. 37 is a diagram showing a method for creating a playlist in a recording operation of the information processing apparatus of the present embodiment. First, the still image encoder 14 encodes a still image supplied through the terminal 13 to generate image data, which is then sent to the recorder 17 . The image attribute information is sent to the controller 16 . The audio encoder 11 encodes the audio data supplied through the terminal 10 to generate an audio stream, which is then supplied to the recorder 17 . The audio encoder also sends image attribute information to the controller 16 .

Referring to FIG. 37, the controller 16 acquires the playback content of the slideshow (step S21). That is, when the slide show and the audio data are AV-synchronized with each other, as described above, the controller receives the playback start time and playback duration of each still image and the time associated with the audio data reproduced in a timing relationship thereto. Information about playback time. In the case where the slide show and the audio data are not AV-synchronized with each other, the controller receives the playback order and default playback time of the respective still images and the audio playback time information through the terminal 15 .

Then, the controller 16 receives image attribute information such as EP_map from the still image encoder 14 (step S22), and simultaneously receives audio attribute information such as EP_map of audio from the audio encoder 11 (step S23). The controller 16 creates clip information as attribute information related to the transport stream file (still image file) based on the image attribute information (step S24). That is, the controller registers the image playback time (PTS_start) reproduced in the slideshow and the corresponding source packet number (SPN_start) in the EP_map. The controller also refers to the picture playback time (PTS_start) of the EP_map of the clip information to create a playlist indicating the playback domain (playback path) of the slide show based on external information supplied from the outside, while creating an audio data playback path playlist (step S25). In addition, the controller 16 also instructs the recorder 17 to record playlist and clip information.

The recorder 17 records the playlist and clip information created in the controller 16 on the recording medium 18 while also recording the image data and audio data generated in the still image encoder 14 and the audio encoder on the recording medium. At this time, the recorder 17 continuously records the transport stream file (still image file) on the recording medium 18 .

In the information processing apparatus as a recording apparatus configured as described above, as a transport stream file (still image file) composed of one or more still images collected together in one file, one or more still images are managed while As clip information, information of EP_map managing individual still images contained in the file is managed. Use the play item that specifies the playback of each still image in the slide show. Therefore, it is possible to record data realizing a slide show while maintaining compatibility with the moving picture recording apparatus described in the aforementioned prior art example 2. That is, transport stream files for still images are provided instead of AV stream files for moving images. By providing a clip information file for referencing a still picture in a transport stream file, and by specifying its playback by a playlist, the clip (information file) and playlist can be used like a clip (information file) in a moving picture data format. ) and playlists.

(3-5) Structure of information processing device (reproducing device).

An information processing device as a recording device of this embodiment can be constructed similarly to the first embodiment. That is, referring to FIG. 14 , the information processing apparatus 20 includes: a readout unit 21 for reading out data from a recording medium; a controller 22 for supplying it with playlist and clip information read out from the readout unit 21; a still image A decoder 23 and an audio decoder 26 are provided with still image data and audio data read out by the readout unit 21, respectively; a frame buffer 24 for temporarily storing the decoded still images; and a processor 25 for Controls playback of still images.

The controller 22 refers to the playlist to obtain the IN_time of still image data to be reproduced, and causes the still image decoder 23 to read out and decode the still image data specified by the IN_time of the obtained still image data. It should be noted that, in a slide show in which the playback time of reproduced still images is set to be infinite, a user command is supplied to the controller 22 through the user interface 27, so that the timing of the next reproduced still image data can be acquired by the timing of the user command. IN_time for read operations. In the absence of a user command, the IN_time of next reproduced still image data is acquired to realize a readout operation.

In the case of a browsable slideshow, the controller 22 refers to the playlist to acquire the playback time of the reproduced audio data. The controller 22 refers to the clip information of the audio stream to acquire the address of the audio stream corresponding to the playback time and instructs the readout unit 21 to read out the relevant audio data.

The operation of the present information processing apparatus will now be described in detail. Fig. 38 is a flowchart showing playback operation in the present embodiment of the information processing device. Referring to FIG. 14, the readout unit 21 reads out playlist and clip information to transmit the readout information to the controller. The controller 22 acquires the IN_time for discriminating the still image of the play item specifying the still image playback path in the playlist (step S31). The controller 22 refers to the EP_map of the clip information to designate the still image file indicated by the IN_time of the still image, thereby reading out the still image file from the transport stream file by the readout unit 21 (step S32).

In the case where the slide show is browsable, the controller 22 acquires the audio playback time from the play item specifying the audio playback path in the play list (step S33). The controller 22 refers to clip information of the sub audio stream (auxiliary audio stream) to acquire address information by which decoding of the stream in the audio stream file is initiated. Then, the controller manages the control of reading out the audio data by the reading unit 21 based on the acquired address information (step S34).

In step S35 , the still image decoder 23 decodes the still image data read out in step S32 , and sends the decoded image to the frame buffer 24 . In step S36, the audio decoder 26 decodes the audio data read out in step S14 to output the decoded audio data. The controller 22 sends preset commands to the processor 25 . The frame buffer 24 reproduces the image stored therein at preset timing according to the command (step S37).

In step S31, the controller 22 acquires the IN_time of the still image of the PlayItem reproduced next at timing x1 or x2, where timing x1 is the elapsed default playback time of the still image of the currently reproduced PlayItem and timing x2 is The time when a command to switch still images is received from the user interface 27 . When the last still image of the PlayItem is reproduced, playback of the PlayList ends.

That is, if the playback start time of each still image shown in FIG. 20 is predetermined, the still image of the play item to be reproduced next is read out at timing x1, that is, when the limited time of the default_duration of the play item elapses. The IN_time of the image. Then, the controller 22 can issue a command to the readout unit 21 to read out the corresponding still image. If the user is allowed to instruct switching of still images in a playitem in which an infinite default_duration is set as shown in FIG. IN_time to instruct the readout of the corresponding still image.

The present invention is not limited to the above-described embodiments, and it can be changed as necessary within a range not departing from the gist of the invention. For example, although the recording device and the reproducing device are separated in the above-described embodiments, it is also possible to use a recording and/or reproducing device. Although the above-described embodiments refer to a hardware structure, this is only illustrative, and optional processing can be realized by having a CPU (Central Processing Unit) execute a corresponding computer program. In this case, the computer program may be provided in a form recorded on a recording medium or transmitted through a transmission medium such as the Internet.

Industrial applicability

The information processing apparatus detailed above includes: attribute information creating means for creating and managing image attribute information for each of the one or more still images forming the still image set; playback control information creating means for creating Playback control information representing a playback path, wherein the playback path specifies playback of at least a portion of still images in the still image set; recording means for recording the still image set and image attributes corresponding thereto on a recording medium information and playback control information; reproducing means for reading and reproducing still images from the recording medium; and control means for controlling the reproducing means by referring to the image attribute information based on the playback control information. The playback control information creation means creates playback control information using the image attribute information. Therefore, the image attribute information and the playback control information are recorded on the recording medium separately from the still image set, so that, in reading out and reproducing the still image from the recording device, the image attribute information and the playback control information can be first read out, and Individual still images of a still image set can be generated in a preset order, which makes it easy to realize continuous playback of still images (so-called slide show).

Claims (62)

1. An information processing device, comprising: attribute information creating means for creating and managing image attribute information of each still image in a still image set composed of one or more still images; playback control information creating means for creating playback control information specifying a playback path of said still picture set; and recording means for recording the set of still images, the image attribute information associated with the set of still images, and the playback control information associated with the set of still images; wherein The still image whose playback is controlled by the playback control information is associated with the still image recorded on the recording medium based on the image attribute information. 2. The information processing apparatus according to claim 1, wherein said image attribute information includes identification information, file name, data size, and number of pixels in vertical and horizontal directions of each still image contained in said still image set. 3. The information processing apparatus according to claim 1, wherein the playback control information includes information specifying a playback start time of each still image, and information specifying a display time of each still image. 4. The information processing apparatus according to claim 3, wherein the playback control information includes information indicating simultaneous playback of a plurality of still images. 5. The information processing apparatus according to claim 3, wherein said playback control information creation means creates audio playback control information specifying playback of an audio stream reproduced simultaneously with said still image; The recording means records the audio stream and its corresponding audio playback control information on the recording medium. 6. The information processing apparatus according to claim 5, wherein said attribute information creating means creates a correspondence between a representation time stamp indicating a playback start time of said audio stream and an address in said audio stream corresponding thereto Audio attribute information of the relationship; The playback control information creation means employs the audio attribute information to create the audio playback control information. 7. The information processing apparatus according to claim 1, wherein the playback control information includes information specifying a playback order of each still image. 8. The information processing apparatus according to claim 7, wherein the playback control information includes information specifying a default display time of each still image. 9. The information processing apparatus according to claim 7, wherein said playback control information creating means creates audio playback control information indicating a playback path specifying a playback start time on the audio stream time axis and playback end time; The recording means records the audio stream and its corresponding audio playback control information on the recording medium. 10. The information processing apparatus according to claim 1, wherein said playback control information creating means creates playback control information according to an external command. 11. The information processing apparatus according to claim 1, wherein said recording means records said still images in a playback order indicated by said playback control information. 12. The information processing apparatus according to claim 1, wherein said playback control information includes information designating simultaneous playback of a plurality of said still images, and wherein said image attribute information is composed of one or more The still image group composed of simultaneously reproduced still images manages the still image groups composed of the simultaneously reproduced still images one by one. 13. The information processing device according to claim 1, further comprising: Multiplexing means for multiplexing said set of still pictures into a transport stream. 14. The information processing device according to claim 13, further comprising: The encoding device is used to encode the transport stream, and at the same time impose restrictions so as to realize the preset bit rate of the transport stream. 15. The information processing apparatus according to claim 13, wherein the picture attribute information includes identification information indicating a group of still pictures whose playback is controlled on the same time axis section and start recording each of the still picture groups in the transport stream. A table of correspondence between addresses of still picture groups, wherein the still picture group is composed of one or more simultaneously reproduced still pictures. 16. The information processing apparatus according to claim 1, wherein said playback control information creating means creates playback control information indicating a playback path for controlling playback of an audio stream reproduced simultaneously with said still image; the recording means records the audio stream and its corresponding audio playback control information on the recording medium; The audio playback control information includes first auxiliary information indicating that it is not synchronized with playback of the still image or whether the playback indicating control of playback of an audio stream reproduced simultaneously with the still image is to be reproduced repeatedly. The second auxiliary information of the path. 17. The information processing apparatus according to claim 7, wherein the playback control information includes information specifying a playback start time and a playback end time of each still image. 18. The information processing apparatus according to claim 8, wherein the default display time of the still image is set to a finite or infinite value. 19. The information processing apparatus according to claim 13, wherein the image attribute information includes a table representing a correspondence relationship between a presentation time stamp indicating a playback start time of each still image and an address in the streaming data. 20. The information processing apparatus according to claim 19, wherein said multiplexing means multiplexes, on said transport stream, auxiliary information reproduced with a timing relationship with each still picture. 21. The information processing apparatus according to claim 19, wherein said multiplexing means multiplexes, on said transport stream, subtitle information reproduced with a timing relationship with each still picture. 22. The information processing apparatus according to claim 19, wherein said multiplexing means multiplexes, on said transport stream, audio information reproduced with a timing relationship with each still picture. 23. The information processing apparatus according to claim 19, wherein the still image is encoded in an intra-coded image. 24. The information processing apparatus according to claim 19, wherein said playback control information creating means creates audio playback control information indicating a playback path for controlling playback of an audio stream reproduced asynchronously with said still image; The recording means records the audio stream and its corresponding audio playback control information on the recording medium. 25. The information processing apparatus according to claim 19, wherein said image attribute information includes information on a system timing clock corresponding to said presentation time stamp. 26. The information processing device according to claim 17, wherein the playback control information includes first auxiliary information indicating whether reproduction of the image at the playback end time can be continued and when the playback can be continued by the first auxiliary information. In the case of displaying an image, the second auxiliary information indicates the display time. 27. The information processing apparatus according to claim 1, wherein said still image set and said image attribute information are one object, and are managed in units of clips. 28. An information processing method comprising: an attribute information creating step of creating and managing image attribute information for each of the still images in a still image set composed of one or more still images; a playback control information creating step of creating playback control information specifying a playback path of the still picture set; and a recording step of recording the set of still images, the image attribute information associated with the set of still images, and the playback control information associated with the set of still images; wherein The still image whose playback is controlled by the playback control information is associated with the still image recorded on the recording medium based on the image attribute information. 29. The information processing method according to claim 28, wherein said image attribute information includes identification information, file name, data size, and number of pixels in vertical and horizontal directions of each still image included in said still image set. 30. The information processing method according to claim 28, wherein the playback control information includes information specifying a playback start time of each still picture, and information specifying a display time of each still picture. 31. The information processing method according to claim 30, wherein said playback control information creating step creates audio playback control information specifying a playback path of playback of an audio stream reproduced in synchronization with said still image; and wherein The recording step records the audio stream and its corresponding audio playback control information on the recording medium. 32. The information processing method according to claim 28, wherein said playback control information includes information specifying a playback order of respective still images. 33. The information processing method according to claim 32, wherein said playback control information creating step creates audio playback control information representing a playback path specifying a playback start time on the audio stream time axis and playback end time, and where The recording step records the audio stream and its corresponding audio playback control information on the recording medium. 34. The information processing method according to claim 28, wherein, in said recording step, said still images are recorded in a playback order specified by said playback control information. 35. An information processing device comprising: reproducing means for recording thereon a still image set consisting of one or more still images, image attribute information associated with the still image set, and playback control information associated with the still image set the recording medium reproduces at least a portion of still images of said still image set consisting of one or more of said still images; and control means for controlling said reproducing means with reference to said image attribute information according to said playback control information; The image attribute information includes information for managing individual still images in the still image set; The playback control information indicates a playback path of the still picture set; which plays back the still pictures controlled by the playback control information in association with the still pictures recorded on the recording medium according to the picture attribute information . 36. The information processing apparatus according to claim 35, wherein said image attribute information includes identification information of each still image included in said still image set, a file name, a data size, and the number of pixels in vertical and horizontal directions. 37. The information processing apparatus according to claim 35, wherein the playback control information includes information specifying a playback start time of each still image, and information specifying a display time of each still image. 38. The information processing apparatus according to claim 37, wherein an audio stream and audio playback control information indicating a playback path specifying playback of the audio stream reproduced simultaneously with the still image are recorded in the recording medium superior; said reproducing means reproduces said audio stream together with said still image; The control means controls playback of the still picture set and the audio stream based on the playback control information and the audio playback control information. 39. The information processing apparatus according to claim 38, wherein audio attribute information and audio playback control information created using the audio attribute information are recorded; The audio attribute information includes a table representing a correspondence relationship between a presentation time stamp indicating a playback start time of audio data and its corresponding address in the audio stream. 40. The information processing apparatus according to claim 35, wherein said playback control information includes information specifying a playback order of respective still images. 41. The information processing apparatus according to claim 40, wherein the playback control information includes information specifying a playback start time and a playback end time of each still image. 42. The information processing apparatus according to claim 41, wherein said playback control information includes image playback control information; The image playback control information includes first auxiliary information indicating whether the image at the playback end time can be continuously reproduced, and second auxiliary information indicating a display time if the image can be continuously displayed by the first auxiliary information. . 43. The information processing apparatus according to claim 40, wherein the playback control information includes information specifying a default display time of each still image. 44. The information processing device according to claim 40, wherein the audio stream and the audio playback control information represent a playback path specifying a playback start time and a playback end time on a time axis of the audio stream; said reproducing means reproduces said audio stream together with said still image; The control means controls playback of the still picture set and the audio stream based on the playback control information and the audio playback control information. 45. The information processing device according to claim 44, wherein said playback control information includes the audio playback control information; The audio playback control information includes first auxiliary information indicating asynchronous playback of the still image and/or second auxiliary information indicating whether to repeatedly reproduce the playback path included in the audio playback control information. 2. Auxiliary information. 46. The information processing apparatus according to claim 40, wherein said control means determines a display time of each still image by a user command. 47. The information processing apparatus according to claim 35, wherein the set of still images is recorded by multiplexing on a transport stream. 48. The information processing apparatus according to claim 47, wherein an audio stream reproduced in synchronization with playback of the still image is multiplexed on the transport stream. 49. The information processing apparatus according to claim 35, wherein a main transport stream having said set of still images and an audio transport stream having audio data are recorded on said recording medium; and wherein The reproducing means alternately reads out the main transport stream and the audio transport stream in a time-division manner. 50. The information processing apparatus according to claim 35, wherein said still image set and said image attribute information are one object, and are managed in units of clips. 51. An information processing method, comprising: a reproducing step of reproducing at least a part of the still images of the still image set from a recording medium on which a still image set composed of one or more still images and its corresponding image attribute information and playback control information are recorded; and a controlling step of controlling said reproducing step with reference to said image attribute information based on said playback control information; The image attribute information includes information for managing individual still images in the still image set; The playback control information includes information indicating a playback path created using the image attribute information, the playback path specifying playback of at least a part of still images of the still image set. 52. The information processing method according to claim 51, wherein said image attribute information includes identification information, file name, data size, and number of pixels in vertical and horizontal directions of each still image contained in said still image set. 53. The information processing method according to claim 51, wherein the playback control information includes information specifying a playback start time of each still picture, and information specifying a display time of each still picture. 54. The information processing method according to claim 53, wherein an audio stream and audio playback control information indicating a playback path of the audio stream reproduced simultaneously with the still image are recorded on the recording medium; reproducing said audio stream along with said still image in said reproducing step; and wherein In the controlling step, playback of the set of still images and the audio stream is controlled based on the playback control information and audio playback control information. 55. The information processing method according to claim 54, wherein audio attribute information and audio playback control information formed using said audio attribute information are recorded on said recording medium; The audio attribute information includes a table representing a correspondence relationship between a presentation time stamp indicating a playback start time of audio data and its corresponding address in the audio stream. 56. The information processing method according to claim 54, wherein said playback control information includes information specifying a playback order of respective still images. 57. The information processing method according to claim 56, wherein the audio stream and the audio playback control information represent a playback path specifying playback start time and playback end time on the time axis of the audio stream; the reproducing step reproduces the audio stream along with the still image; The controlling step controls playback of the still picture set and the audio stream based on the playback control information and the audio playback control information. 58. An information processing device comprising: attribute information creating means for creating and managing image attribute information for each of the one or more still images forming the still image set; playback control information creating means for creating playback control information indicative of a playback path specifying playback of at least a portion of still images in said set of still images; recording means for recording the set of still images, the image attribute information corresponding thereto, and playback control information on a recording medium; reproducing means for reading out and reproducing still images from said recording medium; and control means for referring to said image attribute information based on said playback control information to control said reproducing means; The playback control information creation means creates the playback control information using the image attribute information. 59. The information processing apparatus according to claim 58, wherein said image attribute information includes identification information, file name, data size, and number of pixels in vertical and horizontal directions of each still image included in said still image set. 60. The information processing apparatus according to claim 58, wherein the playback control information includes information specifying a playback start time of each still image, and information specifying a display time of each still image. 61. The information processing apparatus according to claim 58, wherein said playback control information includes information specifying a playback order of respective still images. 62. An information processing method comprising: an attribute information creating step of creating and managing image attribute information for each of the one or more still images forming the still image set; a playback control information creating step of creating playback control information indicating a playback path specifying playback of at least a part of still images in said still image set; a recording step of recording the still image set, the image attribute information corresponding thereto, and playback control information on a recording medium; a reproducing step of reading and reproducing a still image from said recording medium; and a controlling step of referring to said image attribute information based on said playback control information to control said reproducing step; The playback control information creating step creates the playback control information using the image attribute information.

Images