JP2004363825A - Recording and reproducing device, recording and reproducing method, and recording medium and program therefor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a recording and reproducing device that can manage metadata in a file separately from a moving picture file, a recording and reproducing method, and a recording medium and a program therefor. <P>SOLUTION: Video files and metadata files can be written to and read out of recording media 400. A camera unit 410 images a subject and outputs digital video data. An encoding unit 420 converts digital video data that the camera unit 410 outputs into a stream file. A drive unit 430, when recording the video file outputted by the encoding unit 420 to the recording media 400, records metadata being information attached to the picked-up image from the camera unit 410 as a metadata file to the recording media 400. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a recording / reproducing apparatus, a recording / reproducing method, a recording medium, and a program for recording image data and audio data as a file on a randomly accessible recording medium and reproducing the recorded image data and audio data. .
[0002]
[Prior art]
2. Description of the Related Art Conventionally, for example, in a digital camera that stores a still image in a memory card, a DCF (Design rule for Camera File system) standard is used as a method for storing a still image. Further, as a method of storing the metadata as information related to the still image, there is an Exif (exchangeable image file format) standard for embedding the metadata of the still image in the still image file itself.
[0003]
As a method for storing a moving image and metadata related to the moving image, there are various standards including a Synchronized Multimedia Integration Language (SMIL) such as a DVD standard, a Moving Picture Expert Group (MPEG) 7, and the like. Furthermore, it seems that a unique standard for embedding moving image metadata in the moving image file itself has been proposed.
[0004]
As a method of storing such metadata, for example, a system that enhances an existing moving image viewing method by incorporating additional information together with a moving image stream is disclosed (for example, see Patent Document 1).
[0005]
[Patent Document 1]
JP-A-2000-69442
[0006]
[Problems to be solved by the invention]
However, according to the above-described method, it is possible to display metadata information to a user or to search by a keyword, but when combining or partially deleting a plurality of metafiles causes inconsistency. There is a problem that it is difficult to edit metadata or the like, for example, there is some information or information is missing. Further, in an embedded device such as a home video camera, when the metadata is text as described above, there is also a problem that the cost of a function of processing the text in the metadata is high.
[0007]
In the method of embedding a moving image and metadata related to the moving image in the moving image file itself, the moving image file is embedded in a moving image file having a very large file size as compared with the metadata. There is a problem that it will take. Furthermore, there is a problem that inconsistency occurs in embedded metadata by performing editing processing such as combining or partial deletion on a moving image. Furthermore, by embedding in a moving image, when transmitting a moving image file, a part of the signal band required for transmission is used by the metadata, so that the transmission efficiency is lower than when only the moving image file is transmitted. There is a problem that it gets worse.
[0008]
Also, this is particularly noticeable in home video cameras. Regarding the storage of metadata including information on the state of the video camera, it is desirable to store various information as metadata as much as possible at the time of shooting. Then, there is an increasing demand for deleting metadata so as to save file capacity because it becomes unnecessary.
[0009]
The present invention has been made in view of the above problems, and has as its object to provide a recording / reproducing apparatus, a recording / reproducing method, a recording medium, and a program capable of managing metadata in a file different from a moving image file. I do.
[0010]
[Means for Solving the Problems]
SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problems. In a recording / reproducing apparatus according to the present invention, there is provided a recording medium on which various information can be written / read, an imaging apparatus for imaging a subject and outputting digital video data. Means, conversion means for converting digital video data output by the imaging means into a video file, and information accompanying imaging from the imaging means when the video file output by the conversion means is recorded on the recording medium. Recording means for recording certain metadata as a metadata file on the recording medium.
[0011]
Further, the recording / reproducing method according to the present invention is a recording / reproducing method using a recording / reproducing apparatus provided with a recording medium capable of writing / reading various information, wherein a digital video data is output by imaging a subject. Step 1, a second step of converting digital video data output in the first step into a video file, and a step of recording the video file output in the second step on the recording medium. And a third step of recording metadata, which is information accompanying the imaging in the step (i), as a metadata file on the recording medium.
[0012]
Further, a recording medium according to the present invention is a computer-readable recording medium storing a program for a recording / reproducing apparatus provided with a recording medium capable of writing / reading various kinds of information. A first step of outputting digital video data output in the first step to a video file; and a step of recording the video file output in the second step on the recording medium. A computer-readable recording of a program for causing the recording / reproducing apparatus to execute a third step of recording, on the recording medium, metadata that is information accompanying the imaging in the first step as a metadata file. Recording medium.
[0013]
Further, the program according to the present invention is a program for a recording / reproducing apparatus provided with a recording medium capable of writing / reading various information, wherein a first step of imaging a subject and outputting digital video data; A second step of converting the digital video data output in step 1 into a video file; and a step of recording the video file output in the second step on the recording medium. And a third step of recording metadata, which is incidental information, as a metadata file on the recording medium, by the recording / reproducing apparatus.
[0014]
Accordingly, in the recording / reproducing apparatus, the recording / reproducing method, the recording medium, and the program according to the present invention, when the digital video data captured by the imaging unit is converted into a video file and recorded on the recording medium, information accompanying the imaging is provided. Is recorded on the same recording medium as a metadata file, so that the metadata can be managed in a file different from the video file. This makes it possible to prevent the metadata from being lost due to editing of the video file or the like, as compared with the case where the metadata is embedded in the video file as in the related art.
[0015]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
First, a method for managing files such as image data and audio data (hereinafter referred to as video / audio files) stored on a randomly accessible recording medium such as a disk or a memory according to the present invention will be described with reference to the drawings. I do.
[0016]
First, a directory configuration in a recording medium according to the present embodiment will be described. FIG. 1 is a diagram showing the structure of video / audio files stored in a recording medium and files and directories for managing the files. As shown in FIG. 1, the recording medium according to the present embodiment includes a root directory 1, a video directory 2, a system directory 3 or a content directory 4, and has a three-layer directory structure. A file layer 5 is provided below the system directory 3 or the content directory 4, and stores various files.
[0017]
1 is attribute information 6, in which information indicating the attribute of each file is described. In the attribute information 6, in particular, the attribute of video / audio (data of image and audio) is set as an attribute 7, and the attribute of camera metadata (metadata about a camera) is set as an attribute 8. As shown in FIG. 1, a file having an attribute 7 which is a video / audio file and a file having an attribute 8 which is a camera metadata file are stored under a content directory 4 to be written as a set.
[0018]
The video directory 2 is stored in the root directory 1 of the target recording medium. The video directory 2 stores all relevant system directories 3, content directories 4, and files. Hereinafter, the system directory 3, the content directory 4, and the files stored in the video directory 2 will be described.
[0019]
The system directory 3 is a directory stored immediately below the video directory 2. The system directory 3 stores files necessary for managing the entire recording medium. Specifically, the system directory 3 stores the file name clip0000. Two files, smi and clip0008, are stored. Here, clip0000. smi is a default playlist file. The contents of this file are rewritten based on the operation of changing the order of the video clips by the user. Further, the contents of the default playlist file are contents for determining the order in which video clips are reproduced when the entire recording medium is reproduced. A video clip is composed of a plurality of files, and these files are particularly called video clip files. Similarly, the playlist is also composed of a plurality of files, and these files are particularly called a playlist file group.
[0020]
Clip0008 is a base file name generation file. The base file name generation file is a base file name (a file name excluding an extension) when a new video clip or playlist file is generated. This base file name generation file is used to make the file names of video clips and playlists unique. In the present embodiment, the name of the file generated by the base file name generation file has a structure of clip followed by four digits. Each time the base file name is used, the part of the four-digit number included in the base file name changes.
[0021]
The base file name clip0008 shown in FIG. 1 is a base file name that has already been used, as shown in the file name at the bottom of the file layer 5 in FIG. Here, in order to give a file name to each file of a new video clip or playlist, it is necessary to update the base file name.
[0022]
Specifically, the four-character number included in the base file name is regarded as a four-digit number, and a file name including a numerical value obtained by adding 1 to the numerical value is used as a new base file name. Is rewritten. Each time a new base file name is requested, the name of each file of the newly generated video clip file group and playlist file group is determined according to the above-described procedure. As described above, a unique file name can be given to a newly generated video clip file or playlist file automatically. In this embodiment, the initial value of the numerical part of the base file name is 0000, and the base file name at that time is clip0000.
[0023]
Also, as shown in FIG. 1, directories having eight-digit numbers, such as 20030301, 20033030, 2003324, 2003041, and 20030408, are stored immediately below the video directory 2 as the content directory 4. The directory name of the content directory 4 indicates a date. That is, in the present embodiment, files related to video clips and playlists are classified and managed by date. The name of the content directory 4 is automatically determined from the date of recording the video clip or the date of saving the playlist.
[0024]
Specifically, as shown by an eight-digit number such as 20030301, 23030305, 2003324, 2003041, and 20030408 in FIG. 1, a four-digit number which is the year of the day of recording and saving and a January of the date A two-digit number, from 01 to 12 for the month from December to December, and a two-digit number (supplemented with 0 if necessary) that is the date of the date, concatenated in this order to eight digits Column. As described above, by using the name of the eight-digit number, for example, the file recorded and saved on March 1, 2003 is stored in the content directory 4 having the directory name 20030301 in FIG. I understand. All files recorded and stored on the same day are stored in the content directory 4 having the same directory name.
[0025]
Next, the types of files stored in the content directory 4 will be described. In the present embodiment, the content directory 4 stores a group of video clip files and a group of playlist files including MPEG video / audio files (hereinafter, referred to as stream files).
[0026]
First, the video clip file group includes five files: a stream file, a time map table file, a thumbnail file, a camera metadata file, and a clip information file. Here, the stream file is an MPEG2 program stream. In other words, the stream file is a video / audio file including the image and the sound of the attribute 7.
[0027]
The time map table file is a table in which the reproduction time represented by the frame and the position of the packet in the stream file correspond to each other, and is a file for enabling special reproduction and jumping. That is, the time map table file is not an indispensable file when special reproduction or jump is not performed.
[0028]
The thumbnail file is image data of a small file size compressed by the JPEG method representing each video clip, and is displayed in a list on the user interface. Specifically, in most cases, the thumbnail file is image data obtained by reducing the first image of each video clip in the JPEG format. In the above-described embodiment, an example has been described in which the thumbnail file is image data reduced in the JPEG format. However, the present invention is not limited to this, and other types of image data may be used. The above-mentioned thumbnail file is not an essential file unless it is necessary to display a list at a high speed on an index screen such as a user interface.
[0029]
The camera metadata file is information in which the playback time represented by a frame is associated with metadata including shooting information regarding shooting of the image, and is a file of attribute 8. By referring to this camera metadata file, when a stream file is played back, it is possible to display the playback image with shooting information added. Further, by referring to the camera metadata file, when editing the stream file, it is possible to search for or select an image based on the shooting information. Note that the camera metadata file need not be created if there is no shooting information. When it is no longer necessary, the camera metadata file may be deleted.
[0030]
The clip information file stores information on the video clip, such as the reproduction start position and the reproduction end position of the video clip. Note that the clip information file is not indispensable when information such as a reproduction start position and a reproduction end position is not required.
[0031]
Based on the above description, each file stored in the five content directories 4 shown in FIG. 1 will be described.
<First content directory 4 from the top>
The video clip whose base file name is clip0001 is stored in the content directory 4 with the directory name 200303001. This video clip is a stream file clip0001. mpg, time map table file clip0001. tbl, thumbnail file clip0001. thm, camera metadata file clip0001. cam, clip information file clip0001. inf. Further, it can be seen from the directory name of the content directory 4 in which five files are stored that the file was recorded on March 1, 2003.
[0032]
<The second content directory 4 from the top>
Next, the video clip whose base file name is clip0002 is stored in the content directory 4 with the directory name 20030305. This video clip is a stream file clip0002. mpg, time map table file clip0002. tbl, thumbnail file clip0002. thm, clip information file clip0002. inf. Further, it can be seen from the directory name of the content directory 4 in which four files are stored, that the file is recorded on March 5, 2003. In the content directory 4 with the directory name 20030305, no camera metadata file exists. This is because it was not created from the beginning, or it was created but was later deleted.
[0033]
<3rd content directory 4 from the top>
Next, the video clip whose base file name is clip0003 and the video clip whose base file name is clip0004 are stored in the content directory 4 with the directory name 200303324. A video clip whose base file name is clip0003 is a stream file clip0003. mpg, time map table file clip0003. tbl, thumbnail file clip0003. thm, camera metadata file clip0003. cam, clip information file clip0003. inf. In addition, a video clip whose base file name is clip0004 is also a stream file clip0004. mpg, time map table file clip0004. tbl, thumbnail file clip0004. thm, camera metadata file clip0004. cam, clip information file clip0004. inf. From the directory names of the content directory 4 in which these two video clips (ten files) are stored, it can be seen that they were recorded on March 24, 2003.
[0034]
<4th content directory 4 from the top>
Next, the playlist with the base file name clip0005 and the rendering clip with the base file name clip0006 are stored in the content directory 4 with the directory name 200304401. This playlist is a playlist file clip0005. smi, thumbnail clip0005. thm, camera metadata file clip0005. cam. The rendering clip whose base file name is clip0006 is a rendering clip file clip0006. ren, time map table clip0006. tbl, camera metadata file clip0006. cam. It can be seen from the name of the directory of the content directory 4 in which the playlist and the rendering clip are stored that the playlist and the rendering clip were saved on April 1, 2003.
[0035]
<First content directory 4 from the bottom>
Next, the playlist with the base file name clip0007 and the post-record audio clip with the base file name clip0008 are stored in the content directory 4 with the directory name 20030408. This playlist is a playlist file clip0007. smi, thumbnail clip0007. thm, camera metadata file clip0007. cam. The post-record audio clip whose base file name is clip0008 is a post-record audio file clip0008. dub, time map table clip0008. tbl. From the names of the directories of the content directory 4 in which these playlists and post-record audio clips are stored, it can be seen that they were saved on April 8, 2003.
[0036]
With the configuration shown above, even if multiple metadata files are combined or partially deleted, each metadata file is independent, preventing inconsistencies and missing information. Can be. Also, since the metadata file is not embedded in the stream file itself, it is possible to save metadata search time as compared with the case where the metadata file is embedded. Further, even if the editing process is performed on the stream file, no inconsistency occurs in the metadata. Also, when a stream file is transmitted, only the stream file is transmitted, so that an effect of improving transmission efficiency can be obtained as compared with the case of transmitting metadata embedded together with the stream file. Further, as described above, unnecessary metadata files may be deleted to save file capacity.
[0037]
Next, an operation in which a recording / reproducing apparatus described later displays a list of contents recorded on a recording medium will be described with reference to FIGS. FIG. 2 is a diagram showing the contents of a content list generated from the data configuration shown in FIG. FIG. 3 is an image diagram of a user interface screen which is a list of contents to be displayed based on the contents of the content list shown in FIG.
[0038]
First, the operation of the recording / reproducing apparatus for generating the content list shown in FIG. 2 will be described. When a directory structure and a file structure as shown in FIG. 1 are formed on a recording medium provided in the recording / reproducing apparatus, the recording / reproducing apparatus performs a content file (for example, a stream file or a playlist in FIG. 1) by the following processing. Get list information (content list) of files. First, the recording / reproducing apparatus has to find the video directory 2 and search for a content file included in the video directory 2 from all the video clip file groups and the playlist file group.
[0039]
For this purpose, first, the recording / reproducing apparatus sets the root directory 1 of the recording medium to a current directory (a directory for performing processing). Next, the recording / reproducing apparatus obtains a list of directories in the root directory, and searches the video directory 2. If the video directory 2 cannot be detected, the recording / reproducing device determines that no video clip file or playlist file exists. If the video directory 2 has been detected, the recording / reproducing apparatus sets the video directory 2 as the current directory. Next, the recording / reproducing device acquires a list of directories in the video directory 2 and searches the content directory 4. The content directory 4 is a directory name composed of eight numbers as shown in FIG. Next, the recording / reproducing device sequentially searches for the content files in the content directory 4 based on the list of the searched content directories 4. However, the recording / reproducing apparatus leaves the content list empty before searching the content directory 4.
[0040]
Next, in order to search for a content file in the content directory 4, the recording / playback apparatus sequentially sets each content directory 4 as a current directory. First, the recording / reproducing apparatus obtains a list of files in the content directory 4 with the top content directory 4 in FIG. 1 as a current directory. Next, the recording / reproducing apparatus extracts a stream file having an extension of “mpg” and a playlist file having an extension of “smi” from the acquired list of files, and extracts the full path of the file as shown in FIG. Add the name (for example, /video/20030301/clip0001.mpg) to the content list. By performing the above-described processing sequentially for each content directory 4, the full path names of all stream files and playlist files included in the video directory 2 are added to the content list.
[0041]
Next, the recording / reproducing device arranges the content list in the order of date by rearranging the content list by the full path name. As described above, the recording / reproducing apparatus creates a content list as shown in FIG. Further, the recording / reproducing apparatus displays a content list screen serving as a user interface as shown in FIG. 3 using the content list shown in FIG. As described above, the recording / reproducing apparatus generates a content list having contents as shown in FIG. 2 based on the data structure as shown in FIG. 1, and displays a contents list screen as shown in FIG. can do. The image displayed in FIG. 3 is the image data of the thumbnail file.
[0042]
Next, a hardware configuration of a video camera (recording / reproducing device) according to an embodiment of the present invention will be described.
FIG. 4 is a diagram illustrating a hardware configuration of the video camera according to the embodiment of the present invention. In FIG. 4, reference numeral 400 denotes a recording medium that can be randomly accessed when recording or reproducing data. The recording medium 400 stores data such as video clips in the data configuration shown in FIG.
[0043]
Reference numeral 410 denotes a video camera unit that outputs a captured video as a digital signal, and can simultaneously output camera metadata. A decoding unit 420 encodes the digital video signal transmitted from the video camera unit 410 in the MPEG (Moving Picture Expert Group) 2 format. The decoding unit 420 outputs an MPEG2 stream and simultaneously outputs side information to the system control 470. Can be output to Reference numeral 430 denotes a so-called drive unit, which performs a process of recording the MPEG2 stream sent from the encoding unit 420 and the camera metadata given from the camera unit 410 on the recording medium 400. The drive unit 430 can reproduce and output an MPEG2 stream from the recording medium 400.
[0044]
A decoding unit 440 decodes an MPEG2 stream reproduced and output by the drive unit 430, and can output a decoded digital video signal. An OSD unit 450 outputs a digital video signal obtained by synthesizing a display such as a character or a symbol for a user interface or a warning with the digital video signal from the decoding unit 440 based on an instruction from the system control 470. is there. Reference numeral 460 denotes a liquid crystal panel that performs display based on a digital video signal sent from the OSD unit 450.
[0045]
Reference numeral 470 denotes a system control, which controls the entire video camera system. Reference numeral 480 denotes an operation unit provided with a start / stop switch (not shown) and the like for inputting an instruction from a user. 490 is a clock unit that counts the current date and time.
With the above configuration, the video camera shown in FIG. 4 constructs the content having the data configuration shown in FIG. 1 on the recording medium 400 or uses the content having the data configuration shown in FIG. Or
[0046]
Next, a functional configuration realized by the system control 470 in the video camera shown in FIG. 4 executing a program or the like will be described.
FIG. 5 is a diagram showing a functional configuration realized by the system control 470 in the video camera shown in FIG. 4 executing a program or the like. Reference numeral 501 denotes a system control object that controls the entire video camera. Reference numeral 502 denotes an operation detection object that monitors the operation unit 480 and generates a message from an event generated by a user operation. A camera control object 503 controls the camera unit 410. Reference numeral 504 denotes an encoding / decoding control object that controls the encoding unit 420 and the decoding unit 440.
[0047]
Reference numeral 505 denotes a content file object for managing the relationship between a single video clip and a playlist, each of which is composed of a plurality of files. Reference numeral 506 indicates that a different character string is returned each time the file is generated, and a base file name generation for generating a unique base file name required when recording a plurality of video clips and playlists on the recording medium 400 Object. A file system object 507 controls the drive control object 508 to manage directories and files in the recording medium 400. Reference numeral 508 denotes a drive control object that controls the drive unit 430.
[0048]
An OSD driving object 509 controls the OSD unit 450. A date object 510 manages the current date and time using the clock unit 490. A thumbnail object 511 generates a thumbnail image and generates a thumbnail file. Reference numeral 512 denotes a clip information object that collects information about clips, playlists, and the like to generate a clip information file.
[0049]
Hereinafter, an operation related to a file recording process in the video camera of the present embodiment will be described with reference to FIGS. 4, 5, and FIGS. 6A to 6C. First, the state of each unit shown in FIG. 4 corresponding to the state of each object shown in FIG. 5 of the video camera in the camera imaging standby state will be described. The initial state of the system control object 501 in camera shooting is a standby state. The operation detection object 502 monitors the operation unit 480. The camera control object 503 controls the camera unit 410 in a shooting state, and the camera unit 410 outputs a shot image as a digital video signal.
[0050]
The code decoding control object 504 controls both the coding unit 420 and the decoding unit 440 to operate. Accordingly, the encoding unit 420 outputs the digital video signal input from the camera unit 410 encoded into an MPEG2 stream. The decoding unit 440 outputs an MPEG2 stream input from the drive unit 430, which is decoded into a digital video signal.
[0051]
The drive control object 508 controls the drive unit 430 in a standby state. Thus, the drive unit 430 is in a standby state, and outputs the MPEG2 stream input from the encoding unit 420 as it is. The OSD control object 509 controls the OSD unit 450. The OSD unit 450 combines the digital video signal input from the decoding unit 440 with a display for a user interface, and outputs the digital video signal as a digital video signal. Displayed on panel 460.
[0052]
Next, assuming that the recording medium 400 has the data configuration as shown in FIG. 1 and the shooting date is May 5, 2003, an operation of starting shooting with a video camera will be described. First, when the operation detection object 502 detects an operation of the start / stop switch in the operation unit 480 in the standby state, it sends a message to the system control object 501 that the start / stop switch has been operated. Next, upon receiving the message, the system control object 501 sends a message to start recording to the content file object 505, and transitions from the standby state to the recording state.
[0053]
Next, upon receiving the message, the content file object 505 sends a message for acquiring an unused base file name to the base file name generation object 506. Next, upon receiving the message, the base file name generation object 506 sends a message to the file system object 507 to obtain the name of the base file name generation file in the system directory.
[0054]
Next, upon receiving the message, the file system object 507 returns, for example, clip0008 to the base file name generation object 506 as the name of the base file name generation file in the system directory. Accordingly, the base file name generation object 506 updates the file name from clip0008 to clip0009 according to the procedure for generating an unused base file name.
[0055]
Next, the base file name generation object 506 sends a message to the file system object 507 to update the name of the base file name generation file in the system directory. Next, upon receiving the message, the file system object 507 updates the name of the base file name generation file in the system directory to clip0009. Next, the base file name generation object 506 returns clip0009 as the unused base file name generated in the content file object 505. Next, the content file object 505 sends a message for obtaining the current date and time to the date and time object 510.
[0056]
Next, when receiving the message, the date and time object 510 returns May 5, 2003 to the content file object 505 as the current date and time. Next, the content file object 505 generates “2003505” as the eight-character directory name of the content directory 4 from the returned current date and time. Next, the content file object 505 sends a message to the file system object 507 to search the content directory 4 having the name generated in the video directory 2.
[0057]
Next, upon receiving the message, the file system object 507 searches the directory and returns a result to the content file object.
If the directory is found by the returned search result, the content file object 505 moves to the directory. If the directory is not found, create a directory with that name and change to that directory. In this case, since it cannot be found, a message for creating a content directory 4 named 2003505 is sent to the file system object 507, and the directory is moved to that directory.
[0058]
FIG. 6A is a diagram showing the state of directories and files on the recording medium 400 at this point. As shown in FIG. 6A, a content directory 4 having a directory name “2003505” is formed under the video directory 2. At this point, the content directory 4 having the directory name “2003505” (hereinafter referred to as directory 2003505) is empty.
[0059]
Next, the content file object 505 converts the name of the stream file into clip0009. Generate mpg. Then, a message for generating a stream file with the name is sent to the file system object 507. As a result, when the file system object 507 receives the message, the file 0009. Generate mpg.
[0060]
In addition, the content file object 505 is obtained from the base file name as clip0009. Generate tbl. Then, a message for generating a time map table file with that name is sent to the file system object 507. As a result, when the file system object 507 receives the message, the file system object 507 stores the clip 0009. Generate tbl.
[0061]
In addition, the content file object 505 is obtained from the base file name as clip0009. generate cam. Then, a message for generating a camera metadata file by that name is sent to the file system object 507. As a result, when the file system object 507 receives the message, the file system object 507 stores clip0009. generate cam.
[0062]
Next, the content file object 505 sends a message to the file system object 507 to start recording the stream. Accordingly, upon receiving the message, the file system object 507 sends a message to the drive control object 508 to start processing for recording an MPEG2 stream into a stream file.
[0063]
Next, upon receiving the message, the drive control object 508 controls the drive unit 430 to write the MPEG2 stream from the encoding unit 420 into an area of the recording medium 400 corresponding to the stream file. Further, the drive control object 508 writes the time map table information from the encoding unit 420 into an area of the recording medium 400 corresponding to the time map table file. Further, the drive control object 508 starts writing the camera metadata from the camera unit 410 to an area of the recording medium 400 corresponding to the camera metadata file, and transitions to a so-called recording state.
[0064]
FIG. 6B is a diagram showing the state of directories and files on the recording medium 400 at this point. As shown in FIG. 6B, under the directory 200305505, the stream file clip0009. mpg and a time map table file clip0009. tbl and the camera metadata file clip0009. cam has been generated. However, all files are being written (recording).
[0065]
Next, an operation in which the video camera ends shooting will be described.
First, when the operation detection object 502 detects the operation of the start / stop switch in the operation unit 480 in the recording state by the camera shooting, it sends a message to the system control object 501 that the start / stop switch has been operated. When the system control object 501 receives the message, it sends a message to end the recording to the content file object 505, and the video camera shifts from the recording state to the standby state.
[0066]
Next, upon receiving the message, the content file object 505 sends a message to the file system object 507 to end the stream recording. When the file system object 507 receives the message, the drive control object 508 stores the MPEG2 stream in the stream file clip0009. Send a message to end the process of recording to mpg.
[0067]
Further, upon receiving the message, the drive control object 508 controls the drive unit 430 to control the stream file clip0009. mpg in the area corresponding to the time map table file clip0009.mpg. tbl, and further, a camera metadata file clip0009. The writing to the area corresponding to cam ends, and the state transits to a so-called standby state.
[0068]
Next, the content file object 505 converts the file name “clip0009. generate thm. Then, a message for generating a thumbnail file with the name is sent to the thumbnail object 511. Accordingly, upon receiving the message, the thumbnail object 511 generates thumbnail image data from the image data at the head of the clip file. Then, a message for generating a thumbnail file is sent to the file system object 507 under the name specified by the content file object 505.
[0069]
Next, upon receiving the message, the file system object 507 stores the clip 0009. generate thm. Next, the content file object 505 converts the base file name to clip0009. Generate inf. Then, a message for generating a clip information file by that name is sent to the clip information object 512.
[0070]
Thus, when the clip information object 512 receives the message, the clip information object 512 generates clip metadata in which information on the clip file is collected. Then, a message for generating a clip information file is sent to the file system object 507 using the clip metadata with the name specified by the content file object 505. Next, when the file system object 507 receives the message, the file system object 507 stores clip0009. Generate inf.
[0071]
FIG. 6C is a diagram showing the state of directories and files on the recording medium 400 at this point. As shown in FIG. 6C, the thumbnail file clip0009. thm and the clip information file clip0009. Inf has been created under the directory 200305505. Also, the stream file clip0009. mpg and the time map table file clip0009. tbl and the camera metadata file clip0009. The writing process of cam has also been completed.
[0072]
Finally, the data structure of the camera metadata file which is the attribute 8 shown in FIG. 1 will be described with reference to FIGS.
FIG. 7 is a diagram illustrating a data structure of a camera metadata file according to the present embodiment. As shown in FIG. 7, the camera metadata includes a header portion 71 and a body portion 72. The header part 71 is composed of a type header followed by a type list. The type header has a length of 1 byte as indicated by the data length 73, and the type list has a byte length corresponding to the number of types as indicated by the data length 74.
[0073]
Here, the type header shown in FIG. 7 will be further described. FIG. 8 is a diagram showing the structure of the type header. As shown in FIG. 8, the type header is composed of 2 bits for the version number and 6 bits for indicating the number of types in 1 byte. The data length of the type header is fixed at 1 byte. The version number is fixed such that bit 7 is 1 and bit 6 is 0. The number of types is any value of 0 to 63, and is stored in bit 5 to bit 0 as 6 bits without sign.
[0074]
Next, the type list shown in FIG. 7 will be described. The type list is an array in which 1-byte fixed type codes are arranged by the same number as the number of types specified in the type header shown in FIG. FIG. 9 is a diagram illustrating an example of a type code. As shown in FIG. 9, the contents shown in column 92 are associated with the type codes expressed in hexadecimal numbers in column 91. The data length 74, which is the length of the type list, is 0 to 63 bytes according to the number of types, and the length of the header portion 71 is the number of types + 1 bytes.
[0075]
Next, the body portion 72 shown in FIG. 7 will be described. As shown in FIG. 7, the body part 72 is composed of basic camera metadata having a length of 1 byte and a camera metadata list. The body part 72 is stored for each frame, and stores the same number of camera metadata lists as the number of frames of the corresponding image.
[0076]
First, the basic camera metadata shown in FIG. 7 will be described. FIG. 10 is a diagram illustrating the meaning of each bit of the basic camera metadata. As shown in FIG. 10, the meaning is associated with each or a combination of 0 to 7 bits. In the basic camera metadata, meaning is given to each bit, and the length is fixed at 1 byte. The camera metadata list is an array of camera metadata fixed at 1 byte, and the corresponding camera metadata is arranged in the same order as the type indicated by the type code arranged in the type list. Therefore, the type list and the camera metadata list have the same length.
[0077]
The value stored as the camera metadata is determined for each type of camera metadata. Among the values, FFH (hexadecimal notation; hereinafter, hexadecimal notation is indicated by adding H) is reserved for meaning without information, and therefore becomes a problem when combining a plurality of camera metadata files. The missing part of the metadata information can be filled.
[0078]
Further, since the body portion 72 is continuously stored with no space between the body portion 72 and the header portion 71, if a camera metadata dump list is created, if the width is the number of types + 1, it is arranged in a fine grid. The byte position of the camera metadata in the file is represented by the following equation 1, and can be easily accessed.
Byte position = (number of types + 1) × (frame number + 1) (Equation 1)
[0079]
Next, an example of a camera metadata file will be described using a dump list.
FIG. 11A is a diagram showing a dump list in which a total of seven types of data are stored in the audio mode, the AE mode, and only the upper ones normalized for iris, gain, shutter, focus, and zoom. The numbers in the dump list of the present embodiment shown in FIG. 11 are all in hexadecimal notation, the left side of the colon represents the offset position from the beginning of the file, and the right side of the colon represents the data arrangement for each byte. The width of the dump list in the figure is set to the number of types + 1 so that it is easy to see.
[0080]
Further, the header portion 111 is from the offset position 00000000H to 00000007H, and the body portion 112 is from the offset position 00000008H. 87H at the offset position 00000000H is a type header, and indicates that the number of types is 7. The following 7 bytes are a type list, and the type codes of the camera metadata stored in this file are arranged, such as 10H for audio mode, 20H for AE mode, and 40H for iris (the same applies hereinafter) according to the type code. I have.
[0081]
At the position (xx in FIG. 11A) where the offset position is a multiple of (the number of types + 1), basic camera metadata is arranged. In FIG. In line. The camera metadata other than the basic camera metadata is arranged vertically from the corresponding type code in the type list (yy in FIG. 11A). In the data arrangement of FIG. 11A, the type list is arranged on the first line, and the camera metadata corresponding to the type code of the type list is arranged for each frame on the second and subsequent lines.
[0082]
Next, camera metadata storing only basic camera metadata will be described. FIG. 11B is a diagram illustrating a data example of camera metadata storing only basic metadata. In FIG. 11B, the header portion 113 has only the offset position 00000000H, and the body portion 114 has the offset position of 00000001H or later.
[0083]
80H at the offset position 00000000H indicates that the number of types is 0 in the type header. There is no type list following it. In the data arrangement in FIG. 11B, only the type header is arranged in the first line (header portion 113), and only the basic camera metadata is arranged in each frame in the second and subsequent lines (body portion 114).
[0084]
As described above, in the video camera of the present embodiment, a camera metadata file is provided for each of the moving image file, the playlist file, and the rendering clip file, and the camera metadata is stored therein. ing. The camera metadata file is a binary file that is stored in a two-dimensional array by making the length of the stored metadata all fixed. Accordingly, it is easy to generate metadata in a device (for example, a video camera) that shoots.
[0085]
Also, in the video camera according to the present embodiment, even when a moving image file, a playlist file, and a rendering clip file are combined or partially deleted, since the camera metadata file is independent of the moving image file, the related camera meta It is easy to combine and delete data files.
[0086]
Further, since the video camera according to the present embodiment uses a binary file as the metadata file as described above, the processing for handling text is not required, and the processing cost can be reduced. Furthermore, since the video camera according to the present embodiment uses the camera metadata file as a separate file without embedding it in the moving image file, the metadata does not use a part of the band in the transmission of the moving image file, which is unnecessary. In such a case, transmission is not required, and may be deleted at any time.
[0087]
Further, the various processing units of the digital video camera shown in FIG. 5 are not limited to the configuration of the combination of hardware and software described above, and may be realized by dedicated hardware. A part or the whole of is constituted by a memory and a CPU (Central Processing Unit), and realizes the processing by reading a program for realizing various processes in each processing unit into the memory and executing the program. Is also good.
The memory is a non-volatile memory such as a hard disk device, a magneto-optical disk device, or a flash memory, a recording medium such as a CD-ROM, which is readable only, or a volatile memory such as a RAM (Random Access Memory). Or a computer-readable and writable recording medium by a combination thereof.
[0088]
Also, based on the instructions of the program read by the computer, an operating system (OS) or the like running on the computer performs part or all of the actual processing. Is realized.
[0089]
Further, after the program code read from the storage medium is written into the memory provided on the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. A CPU or the like provided in the board or the function expansion unit may perform some or all of the actual processing, and the various functions of the above-described embodiments may be realized by the processing.
[0090]
As described above, the embodiments of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to the embodiments, and includes a design and the like within a range not departing from the gist of the present invention.
[0091]
【The invention's effect】
As described above, in the recording / reproducing apparatus, the recording / reproducing method, the recording medium, and the program of the present invention, when the digital video data captured by the imaging unit is converted into a video file and recorded on the recording medium, the digital Since the metadata that is the accompanying information is recorded on the same recording medium as the metadata file, the metadata can be managed in a file different from the video file. This makes it possible to prevent the metadata from being lost due to editing of the video file or the like, as compared with the case where the metadata is embedded in the video file as in the related art. If the metadata file becomes unnecessary, only the metadata file can be easily deleted.
[Brief description of the drawings]
FIG. 1 is a diagram showing a configuration of video / audio files stored in a recording medium and files and directories for managing the video / audio files.
FIG. 2 is a diagram showing the contents of a content list generated from the data configuration shown in FIG.
FIG. 3 is an image diagram of a user interface screen which is a list of contents to be displayed based on the contents of the content list shown in FIG. 2;
FIG. 4 is a diagram illustrating a hardware configuration of a video camera according to an embodiment of the present invention.
5 is a diagram showing a functional configuration realized by executing a program or the like by a system control 470 in the video camera shown in FIG.
FIG. 6 is a diagram showing the states of directories and files on the recording medium 400 at three different times.
FIG. 7 is a diagram illustrating a data structure of a camera metadata file according to the present embodiment.
FIG. 8 is a diagram showing the structure of a type header.
FIG. 9 is a diagram showing an example of a type code.
FIG. 10 is a diagram illustrating the meaning of each bit of basic camera metadata.
FIG. 11 is a diagram illustrating a data example of camera metadata according to the present embodiment.
[Explanation of symbols]
400: Recording media
410 ... Camera unit
420 ... coding unit
430 ... Drive unit
440... Decoding unit
450 ... OSD unit
460 ... Liquid crystal panel
470 ... System control
480 ... Operation unit
490: Clock unit
501: System control object
502 ... operation detection object
503: Camera control object
504: code decoding control object
505: Content file object
506: Base file name generation object
507 ... File system object
508: Drive control object
509 OSD driven object
510: Date and time object
511: Thumbnail object
512: clip information object

Claims (11)

A recording medium capable of writing / reading various information;
Imaging means for imaging a subject and outputting digital video data;
Conversion means for converting the digital video data output by the imaging means into a video file,
When the video file output by the conversion unit is recorded on the recording medium, the recording unit records metadata, which is information accompanying the imaging by the imaging unit, as a metadata file on the recording medium. A recording / reproducing apparatus characterized by the above-mentioned. 2. The recording / reproducing apparatus according to claim 1, wherein the conversion unit outputs a stream file as the video file by encoding and compressing the digital video data. The recording / reproducing apparatus according to claim 1, wherein the recording unit further includes information attached to the video file in the metadata file and records the information on the recording medium. 4. The recording device according to claim 3, wherein the recording unit records information on the correspondence between the reproduction time and the video data in the video file in the metadata file as information accompanying the video file, and records the information on the recording medium. 5. The recording / reproducing apparatus according to any one of the preceding claims. When the recording medium hierarchically records various information, the recording unit records the video file and the metadata file corresponding to the video file on the same hierarchy of the recording medium. The recording / reproducing apparatus according to any one of claims 1 to 4, wherein 2. The recording device according to claim 1, wherein the recording unit records the file name of the video file and a file name of the metadata file corresponding to the video file with a same file name. The recording / reproducing apparatus according to any one of claims 1 to 5. 7. The recording apparatus according to claim 1, wherein the recording unit records all the plurality of metadata included in the metadata file with the same data length on the recording medium. 8. Recording and playback device. The method according to claim 1, further comprising: a file creation unit that creates a second metadata file corresponding to the reference file when creating a reference file that indirectly refers to the video file. 8. The recording / reproducing device according to any one of items 7 to 7. A recording / reproducing method using a recording / reproducing apparatus having a recording medium capable of writing / reading various information,
A first step of imaging a subject and outputting digital video data;
A second step of converting the digital video data output in the first step into a video file;
When the video file output in the second step is recorded on the recording medium, metadata that is information accompanying the imaging in the first step is recorded on the recording medium as a metadata file. And a recording / reproducing method. A computer-readable recording medium recording a program for a recording / reproducing apparatus including a recording medium capable of writing / reading various information,
A first step of imaging a subject and outputting digital video data;
A second step of converting the digital video data output in the first step into a video file;
When the video file output in the second step is recorded on the recording medium, metadata that is information accompanying the imaging in the first step is recorded on the recording medium as a metadata file. And a computer-readable recording medium on which a program for causing the recording / reproducing apparatus to execute the above steps is recorded. A program for a recording / reproducing device provided with a recording medium capable of writing / reading various information,
A first step of imaging a subject and outputting digital video data;
A second step of converting the digital video data output in the first step into a video file;
When the video file output in the second step is recorded on the recording medium, metadata that is information accompanying the imaging in the first step is recorded on the recording medium as a metadata file. And a program for causing the recording / reproducing apparatus to execute the above steps.

Images