JP2001075846A - Device and method for recording, and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To save the trouble of metadata input by preparing information which is already known as a template for metadata and connecting it to image data at the time of photography. SOLUTION: A user before starting taking a picture inserts a memory card into a computer system, etc., and records previously known information such as the name, place, date of an event to be photographed to the template of metadata by using XML. The generated XML data are recorded in the root directory of the memory card 403 by a recording part 402 while given a file name. Then the user extracts the memory card 403 from the computer system and inserts it into a camera system. When the user presses the shutter release button of the camera on the photography site, an image signal is stored in a CCD and also converted into an image and compressed to the JPEG format. The file name of the XML is read out of the memory card 403 through a read part 404, combined with the image data, and overwritten to the memory card 403.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a recording apparatus and a recording method for adding ancillary information related to a still image or a moving image photographed by a digital still camera, a digital video camera or the like.

[0002]

2. Description of the Related Art With the spread of digital still cameras and digital video cameras, the amount of still images and moving images handled in ordinary homes is increasing dramatically. In order to use these digital contents, some search method or management method is required. In the case of performing search and management, efficiency is high if there is auxiliary information describing the image, such as the name of the person appearing in the image, the name of the event, the date, a keyword, and the like, that is, so-called metadata.

In the case where one image server is used by a plurality of persons, the protection of privacy is also required.
I want to distinguish who the image is. In this case,
When an image is taken into the server, a personal folder is prepared and the image data is put in this folder, so that each person can manage the image.

[0004]

However, in the conventional example, it is very complicated to input, for example, ancillary information such as a title and a keyword for each image after taking in the image taken at an athletic meet. In general, such work is not performed, and at present, even if there is an application that handles metadata, it is not effectively used.

Similarly, even when a single image server is used by a plurality of persons, since information for identifying an individual is not attached to each image in a state where the image server is taken out of the folder, no one can use the image server. Since it is not possible to recognize whether the image is an image, if the personal information is stored for each image when the image is taken into the server, the input operation is very similar to the above-mentioned keyword input. It is complicated.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a recording apparatus, a recording method, and a recording medium for recording data that can reduce the trouble of inputting a title, a keyword, personal identification information, and the like for each image. .

[0007]

SUMMARY OF THE INVENTION In view of the above-mentioned problems, the present invention reads out first data recorded in advance on a first recording medium, and generates second data to be recorded. When the second data is recorded on the second recording medium, the read first data and the second data are recorded in association with each other.

[0008]

Preferred embodiments of the present invention will be described below with reference to the accompanying drawings.

(First Embodiment) FIG. 1 is a diagram showing a hardware configuration of a computer system for performing first data generation and first recording according to a first embodiment. 10
1 is a CPU, 102 is a ROM, 103 is a RAM, 104 is a hard disk, 105 is a display, 106 is a keyboard, 107 is a mouse, and 108 is a memory card interface. Figure 1 shows the memory card interface
By using an adapter as shown in FIG. 0, a PCMCIA card, compact flash, smart media, and Memory Stick (registered trademark) can be used.

FIG. 2 is a diagram showing a hardware configuration of a camera system for generating second data, reading out first data, and performing second recording according to the first embodiment. 2
01 is a CPU, 202 is a ROM, 203 is a RAM, 204 is an LCD,
205 is a shutter button, 206 is a memory card interface, and 207 is a CCD.

FIG. 3 is a block diagram of a recording apparatus according to the first embodiment.

Numerals 401 and 402 are configured by the computer system shown in FIG. 1. Numeral 401 denotes a title in the form of text or personal identification information (metadata) as first data, and numeral 402 denotes a meta data generated by the meta data generator. A recording unit that records the metadata that has been recorded on the recording medium 403 through the memory card interface 108.

Reference numerals 404, 405, and 406 constitute the camera system shown in FIG.

A reading unit 404 reads metadata from the recording medium 403.

Reference numeral 405 denotes an image in RGB format from a video signal obtained by the CCD 207 and, if necessary, a JPEG image.
And an image data generating unit that performs compression.

Reference numeral 406 denotes a recording unit that associates image data with metadata and records the image data on a memory card as a first or second recording medium.

In the following, an actual use mode will be described. Before starting shooting using the camera system, for example, in a preparation stage for going out to an athletic meet, a user inserts a memory card into a computer system or the like to name an event to be shot, Information that is known in advance, such as location and date, is recorded as a metadata template.

At this time, XML is used to describe the metadata. XML (Extensible Markup Language)
This is a markup language for use in applications that require functions beyond the ypertext Markup Language (HTML), and was developed by the World Wide Web Consortium and has the following main features.

1. The information provider can define a new tag or attribute name at will. 2. Document structures can be nested in any complexity. 3. The grammar description can be embedded as an option in the XML document, and the grammar can be used by the application to verify the validity of the structure.

For example, when it is known that the date is June 14, 1999, the photographer is Taro, the event name is athletic meet, and the location is athletic park, the metadata is written as follows.

<? Xml version = "1.0" encoding = "Shift_JIS"?> <PHOTO> <ITEM ATTR = "Photographer"> Taro </ ITEM> <ITEM ATTR = "Date"> 1999-06-14 </ ITEM > <ITEM ATTR = "Event"> Sports Day </ ITEM> <ITEM ATTR = "Location"> Sports Park </ ITEM> </ PHOTO>

The above XML description can be written using a general-purpose text editor program.
Use an editor program for XML to generate so-called Wellformd XML, such as that <PHOTO> and </ PHOTO> or <ITEM> and </ ITEM> correspond correctly.

The created XML data is stored in Car
It is recorded in the root directory of the memory card 403 with a file name of dInfo.XML.

At the end of this operation, the user removes the memory card 403 from the computer system and inserts it into the camera system.

At a shooting site, that is, at a sports day, a user takes an image using a camera system. When the shutter button 205 is pressed, the image signal is stored in the CCD 207 and
Conversion to a G-format image and compression to JPEG are performed. When the compression is completed, the memory cards 403 to 40
4 CardInfo.XML is read through the reading unit. CardInfo.XML is linked to image data and memory card 403
Data is written to

Next, the details of a method of linking image data and metadata will be described with reference to FIG. 8. Here, a process of adding metadata to obtained image data after photographing with a digital camera will be described. I have.

In FIG. 8, first, in step S801,
Then, binary data which is image data captured by the user is read into the memory (RAM 203).

Next, in step S802, the metadata previously stored in the memory card by the user is read into the memory (RAM 203).

Next, in step S803, it is checked whether the XML file in which the metadata is described is XML data in a proper format. In the determination of the appropriate format, it is checked whether the description format of the XML file is satisfied (for example, whether the parentheses on the left and right of the tag form a correct pair, whether the tagging format is correct, and the like). It should be noted that whether or not the XML data is in a proper format is determined by valid XML data.
It may be a check including whether or not it is data.
Here, the determination as to whether the data is valid XML data is performed by, for example,
This is performed by checking whether the XML data is described according to a schema such as DTD (Document Type Definition).

In step S803, the proper format of XM
If it is determined that the data is not L data, step S805
Proceed to. In step S805, the fact that there is an error in the XML data is displayed on the display unit 103, and this processing ends.

On the other hand, if it is determined in step S803 that the XML file is XML data in a proper format, the process proceeds to step S804. Step S8
In step 04, the metadata is registered by connecting the metadata after the binary data read in the memory in step S801.

After that, in step S806, the binary data in which the metadata is registered is output, and the process ends. By the data output in step S806, the data having the data structure shown in FIG. 4 is stored in the memory card as one file.

For a more detailed description of the combination of metadata and image data, refer to Japanese Patent Application No. 11-105741.

FIG. 4 shows an example of a method of connecting image data and metadata. 4, reference numeral 501 denotes image data generated by the camera system, for example, data in a JPEG compression format. 502, 503, and 504 are metadata blocks, 502 is a metadata block header, 503 is a metadata body, and 504 is a metadata footer. The metadata header 502 and the metadata footer 504 record the identification information and the size of the metadata block in order to correctly recognize whether the metadata is linked to the image data. In the metadata body 503, CardInfo.XML shown above is recorded.

Thus, at the end of the binary data, X
By connecting the metadata described in the ML data, the metadata can be registered without affecting other applications. That is, since the information of the header portion of the binary data does not change before the connection of the metadata, for example, when the binary data is image data, the image can be reproduced by a general browser (the connected metadata is ignored). Is done).

Furthermore, by using text data, especially XML format for metadata, many devices can easily read the information of this metadata.

Also, since the metadata is described in XML, by extracting this XML data portion, if there is a tool that understands the XML data, it is possible to add / change / reference the metadata. It is very versatile.

As described above, information known in advance is prepared as a metadata template, and is linked to image data at the time of photographing, so that the trouble of inputting metadata can be reduced.

Since the present invention is preferably used for transferring data between a computer system and a digital camera, etc., it is preferable to use a recording medium which can be inserted into and removed from the recording apparatus. In addition, since a normal digital camera can mount only one scale card, it is preferable to record both metadata and image data on the same recording medium.

By embedding the metadata in the image data, even when the image data is transferred, the metadata can always be transferred together with the image data.

(Second Embodiment) The structure is the same as that of the first embodiment.

In the present embodiment, the metadata itself is not embedded in the image data, but is associated using information indicating the storage location of the file storing the metadata and a unique name such as a file name.

Before starting work using the camera system, for example, in preparation for going out for an athletic meet, the user inserts a memory card into the computer system and meta-information such as the event name, location, date, etc., to be photographed is recorded. Record as a data template.

At the shooting site, that is, at the athletic meet, the user shoots an image using the camera system. When the shutter button 205 is pressed, the image signal is stored in the CCD 207 and
Conversion to a G-format image and compression to JPEG are performed. When the compression is completed, the memory cards 403 to 40
4 CardInfo.XML is read through the reading unit.

The name of the image data recorded by shooting is AU
When T_001.JPG is used, CardInfo.XML is copied to AUT_001.XML, and AUT_001.XML is added as a metadata template file name in the image data.
Image data and AUT_001.XML are recorded on the memory card. In other words, AUT_001.X which is the metadata of AUT_001.JPG
The file name ML is stored in the image data, and at the time of image reproduction, the stored metadata file is read out,
Used for inputting keywords and the like. It should be noted that the AUT_001 is commonly used for the metadata and the image data, and only the extension is changed, so that the correspondence between the files is easy to understand.

As a method of recording metadata in such image data, a URL (Uniform Resource Location) for specifying a physical position of data on the Web or a unique name is used to store data. URN (Uniform Resour
A standard called ce Name), or a standard URI (Uniform Resource Identifier) currently under consideration, which includes these standards, can be used. If URIs will spread in the future,
By using this, it is most suitable for specifying data on the Web, for example.

As a method for recording the metadata, when JPEG is used as the image compression method, the JPEG
It is preferable to use an APP marker defined in the standard.

As described above, since the URI for specifying the attached information is recorded as the metadata, it is easy to handle the image data and the attached information separately. In particular, the present invention is widely used, for example, by storing auxiliary information on a network and reading the information using a URI.

The URI of metadata and the URI of image data
By giving a certain relation to the image data and the metadata, the correspondence between the image data and the metadata can be easily understood. For example, the correspondence can be understood by looking at the file name.

(Third Embodiment) A computer system for creating metadata is the same as that of the first embodiment.

FIG. 5 is a hardware configuration diagram of a digital video camera system with a memory card according to the third embodiment.

601 is a CPU, 602 is a ROM, 603 is RA
M and 604 are CCDs, 605 is an LCD, 606 is a start button, 607 is a memory card interface, and 608 is a tape drive.

FIG. 6 is a block diagram of a recording apparatus according to this embodiment.

Numerals 701 and 702 are constituted by the computer system shown in FIG. 1. Numeral 701 denotes a metadata generating unit in a text format as first data. Numeral 702 denotes metadata generated by the metadata generating unit. A recording unit that records on the recording medium 703 through the interface 607.

Reference numerals 704, 705, and 706 constitute the digital video camera system shown in FIG.

A reading unit 704 reads metadata from the recording medium 703.

Reference numeral 705 denotes generation of an image in the RGB format from the video signal obtained by the CCD 604, and furthermore, if necessary,
An image data generation unit that performs compression such as n-JPEG.

A recording unit 706 records image data and metadata in a memory card in association with each other.

Before starting work using the video camera system, for example, in preparation for going out for an athletic meet or charging the battery, the user inserts the memory card into the computer system and names the event to be photographed. Information that is known in advance, such as location and date, is recorded as a metadata template.

XML is used to describe the metadata. The following is an example where the date is June 14, 1999, the photographer is Taro, the event name is athletic meet, and the location is athletic park.

<? Xml version = "1.0" encoding = "Shift_JIS"?> <PHOTO> <ITEM ATTR = "Photographer"> Taro </ ITEM> <ITEM ATTR = "Date"> 1999-06-14 </ ITEM > <ITEM ATTR = "Event"> Sports Day </ ITEM> <ITEM ATTR = "Location"> Sports Park </ ITEM> </ PHOTO>

The above XML description can be written using a general-purpose text editor program.
Use an editor program for XML to generate so-called Wellformd XML, such as that <PHOTO> and </ PHOTO> or <ITEM> and </ ITEM> correspond correctly.

The created XML data is stored in Car
It is recorded in the root directory of the memory card 703 under the file name dInfo.XML.

When this operation is completed, the user removes the memory card 703 from the computer system and inserts it into the camera system.

At a shooting site, that is, a sports day, the user shoots an image using a camera system. When the start button 606 is pressed, the image signal is stored in the CCD 604 and R
It is converted to GB format images, compressed to Motion-JPEG, and recorded on a tape device.
At this point, a pointer to CardInfo.XML is recorded in the DV format.

As described above, for a moving image, information that is known in advance is prepared as a metadata template, and is linked to moving image data at the time of shooting, thereby reducing the trouble of inputting metadata.

It should be noted that data obtained by voiceprint analysis and data obtained by retinal pattern can be used to store a voiceprint or retinal pattern or a personal identifier based on information corresponding to the data as accessory information.

The present invention can be applied to a system composed of a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.) or an apparatus composed of one device (for example, a copying machine, a facsimile machine). May be applied.

Further, software for realizing the functions of the above-described embodiment is installed in an apparatus or a computer in the system connected to the various devices so as to operate the various devices so as to realize the functions of the above-described embodiment. The present invention includes a program code supplied and executed by operating a computer (CPU or MPU) of the system or apparatus according to a stored program to operate the various devices.

In this case, the software program code itself implements the functions of the above-described embodiment, and the program code itself and means for supplying the program code to a computer, such as the program code The storage medium storing the information constitutes the present invention.

As a storage medium for storing such a program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, magnetic tape, nonvolatile memory card, ROM or the like can be used.

When the computer executes the supplied program code, not only the functions of the above-described embodiment are realized, but also the program code
Needless to say, even when the functions of the above-described embodiments are realized in cooperation with an OS (operating system) running on a computer or other application software, such program codes are included in the embodiments of the present invention. No.

Further, the supplied program code is stored in a memory provided in a function expansion board of a computer or a function expansion unit connected to the computer, and then stored in the function expansion board or the function storage unit based on an instruction of the program code. It is needless to say that the present invention also includes a case where a provided CPU or the like performs a part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

[0074]

As described above, according to the present invention, it is possible to reduce the complexity of inputting additional information such as a title and a keyword for each image.

Also, the metadata is text data, especially
By using the XML format, other devices can easily read the information of the metadata.

Further, by using a removable recording medium for the recording apparatus, data can be easily transferred, which is more suitable for the present invention.

Further, since a normal digital camera can mount only one memory card, it is preferable to store both metadata and image data on the same memory card.

It is preferable that a digital video tape is used as a recording medium for the digital video camera.

Further, as a recording medium, a medium such as a still image, a moving image, and a sound can be used.

By embedding the metadata in the image data, even when the image data is transferred, the metadata can always be transferred together with the image data.

Also, since the URI for specifying the additional information is recorded as the metadata, it is easy to handle the image data and the additional information separately. In particular, the present invention is used to store additional information on a network and to read the additional information using a URI.

Also, the URI of the metadata and the URI of the image data
By giving a certain relation to the image data and the metadata, the correspondence between the image data and the metadata can be easily understood. For example, the correspondence can be understood by looking at the file name.

[Brief description of the drawings]

FIG. 1 is a diagram showing a configuration of a computer system in an embodiment.

FIG. 2 is a diagram illustrating a configuration of a digital camera system according to an embodiment.

FIG. 3 is a block diagram of the first and second embodiments.

FIG. 4 is a diagram showing a method of connecting image data and metadata in the embodiment.

FIG. 5 is a diagram illustrating a configuration of a digital video camera system according to a third embodiment.

FIG. 6 is a block diagram of a third embodiment.

FIG. 7 shows usage examples of various recording media.

FIG. 8 shows a conventional example.

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/781 H04N 5/91 J 5/91 (72) Inventor Kunihiro Yamamoto 3-30 Shimomaruko, Ota-ku, Tokyo No. 2 Canon Co., Ltd. F-term (reference)

Claims (19)

[Claims] 1. A reading means for reading first data recorded in advance on a first recording medium, a generating means for generating second data to be recorded, and the second data generated by data generating means And a recording unit for recording the first data read by the reading unit in association with the second data when recording on the second recording medium. 2. The recording apparatus according to claim 1, wherein the first data is text data. 3. The recording apparatus according to claim 1, wherein the first data is text data in an XML format. 4. The recording apparatus according to claim 1, wherein the first data is binary data. 5. The recording apparatus according to claim 1, wherein the first recording medium and the second recording medium are recording media that can be inserted into and removed from the recording apparatus. 6. The recording apparatus according to claim 1, wherein the first recording medium and the second recording medium are the same memory card. 7. The recording apparatus according to claim 1, wherein said first recording medium is a memory card, and said second recording medium is a tape. 8. The recording apparatus according to claim 1, wherein the data generated by said generating means is still image data. 9. The data generated by the generating means is moving image data.
The recording device according to any one of the above. 10. The data according to claim 1, wherein the data generated by said generating means is audio data.
The recording device according to any one of the above. 11. The recording apparatus according to claim 1, wherein the first data is a URI for specifying information to be attached to the second data. 12. The method according to claim 1, wherein the association between the first data and the second data is performed by embedding the first data in the second data. The recording device according to any one of the above. 13. The second data includes a URI that is information for specifying designated data, and the association between the first data and the second data is based on the URI of the first data and the second data. 13. The recording apparatus according to claim 1, wherein a certain association is provided with the URI of the data. 14. The recording apparatus according to claim 1, wherein the first data is a personal identifier based on a voiceprint. 15. The recording apparatus according to claim 1, wherein the first data is a personal identifier based on a retinal pattern. 16. A recording device for recording, together with recording data, ancillary data accompanying the recording data, wherein a reading means for reading the ancillary data recorded in advance on a first recording medium; Recording means for recording the first data read by the reading means and the information in association with each other when recording the information. 17. The recording apparatus according to claim 16, wherein the first recording medium is detachable from the recording apparatus. 18. A recording method for recording, together with recording data, ancillary data accompanying the recording data, comprising: a reading step of reading ancillary data recorded in advance on a first recording medium; A recording step of recording the first data read by the reading means and the information in association with each other when recording the information. 19. A storage medium for storing a program for causing a computer to read and execute a recording method for recording ancillary data accompanying the recording data together with the recording data, the recording medium being recorded in advance on a first recording medium. A program that causes a reading step of reading attached data and a recording step of recording the first data read by the reading means and the information in association with each other when recording data on a second recording medium. A storage medium for storing.