KR101449862B1 - Photographing apparatus, control method, and recording medium thereof for matching and saving photograph and voice recognition information - Google Patents

Abstract

The present invention relates to a photographing apparatus, a control method thereof, and a recording medium for matching photographed images with voice-recognized information. A control method of a photographing apparatus according to the present invention includes the steps of activating a photographing function; Activating a voice input function; Extracting voice tag information from a voice signal input through a microphone in a state where the voice input function is activated; And matching and storing the extracted voice tag information and the photographed image.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a photographing apparatus for matching photographed images with voice-recognized information and storing the photographed images, a control method therefor, and a recording medium. 2. Description of the Related Art [0002] Photographed images,

The present invention relates to a photographing apparatus, a control method thereof, and a recording medium for extracting information from a voice signal recognized at the time of photographing and storing the information by matching with the photographing photograph.

Recently, digital cameras have been widely used and camera modules have been installed in mobile phones.

Unlike a film camera, a digital camera (including a cell phone including a digital camera module) can be stored as a file immediately after shooting. Also, even if the photographer does not print it, Which is widely used.

Because of the simplicity and low cost of such a digital camera, users have taken more pictures and accordingly the amount of stored picture files is increasing.

That is, there is a problem in management due to frequent photographing.

For example, if you have hundreds of photos in one folder, you can not easily find out where you want to go if you do not have a distinction.

To this end, a method of utilizing tag information has been proposed.

That is, by matching and storing specific tag information for each photograph, it is possible to easily select the photographs desired by searching for the tag.

However, in general, a tag has a problem in that the process is cumbersome and inconvenient when a photograph is taken and then input is performed using a separate touch (when the input device is a touch screen) or a button is pressed (when the input device is composed of a key button) .

Therefore, it is desired to present a technique for simplifying the input of the tag information for classifying the photographs.

Patent Document 10-2013-0005904

It is an object of the present invention to provide a photographing apparatus, a control method thereof, and a recording medium for more easily inputting and storing tag information matched to photographed photographs.

According to an aspect of the present invention, there is provided a photographing apparatus comprising: a camera module;

A photographing unit photographing an image through the camera module; A microphone for receiving a voice signal; A function activating unit for activating a photographing function and a voice input function; A tag information extracting unit for extracting voice tag information from a voice signal inputted through the microphone in a state where the voice input function is activated; And a storage control unit for storing the voice tag information extracted by the tag information extracting unit and the image captured through the photographing unit so as to be stored in a matching manner.

According to another aspect of the present invention, there is provided a method of controlling a photographing apparatus, comprising: activating a photographing function; Activating a voice input function; Controlling so that voice tag information is extracted from a voice signal input through a microphone in a state where the voice input function is activated; And controlling the extracted voice tag information to be stored and matched with the captured image.

As described above, according to the present invention, voice tag information can be extracted from a voice signal inputted through a microphone while being photographed by a photographing apparatus, and can be stored as tag information matched with the photographed photograph.

In particular, since the voice input function is automatically activated at a specific time point, no user operation is required to select the voice input function, thereby enhancing user convenience.

1 is a schematic configuration diagram of an entire system including a photographing apparatus according to an embodiment of the present invention,
Fig. 2 is a functional block diagram of the photographing apparatus of Fig. 1,
3 to 5 are flowcharts of control of the photographing apparatus according to an embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

The entire communication system including the photographing apparatus 100 according to an embodiment of the present invention may be configured to include the photographing apparatus 100, the tag reading server 200, and the album server 300 as shown in FIG. 1 .

The tag reading server 200 extracts voice tag information from the voice signal received from the photographing apparatus 100 and transmits a response signal including the extracted voice tag information to the photographing apparatus 100. [

Here, the voice signal is recorded by the user of the photographing apparatus 100 at the time of photographing, and the tag reading server 200 can extract the voice tag information by performing a syntax analysis on the received voice signal.

For example, when the tag reading server 200 receives the voice signal "at Jessica and Sandcastle", the tag reading server 200 can extract the words "Jessica" and "Sandcastle" excluding the search by voice tag information.

Explaining an example of a method of excluding an inquiry, the tag reading server 200 is segmented according to the presence or absence of a voice signal (for example, in the above example, a slight silence is found between "Jessica" and " ), And the last syllable "and" in the first segment, "Jessica", can be deleted and compared with the existing survey.

The album server 300 performs a function of receiving an image file from the image pickup apparatus 100, storing the image file, and managing the image file.

At this time, the album server 300 may match and store the photographing file and the voice tag information received from the photographing apparatus 100, and further may record at least one of the current time and the position information received from the photographing apparatus 100, It can be stored in a matching file.

The photographing apparatus 100 includes all kinds of apparatuses provided with a function capable of photographing according to a user's operation. For example, the photographing apparatus 100 may be a cellular phone or the like having the camera module 110 as well as a camera Or may be the same mobile communication terminal.

The photographing apparatus 100 activates the photographing function and the voice input function, extracts the voice tag information from the voice signal inputted through the microphone 130 after the voice input function is activated, And performs a function of matching and storing images.

The detailed functions of the photographing apparatus 100 will be described with reference to the functional blocks of FIG.

The photographing apparatus 100 according to an embodiment of the present invention includes a camera module 110, a photographing unit 120, a microphone 130, a function activating unit 140, A storage control unit 160, an event sensing unit 170, and a display unit 180. The display unit 180 may include a display unit 150, a storage control unit 160, an event sensing unit 170,

Here, the display unit 180 displays an image according to various function operations of the photographing apparatus 100. For example, a menu button may be displayed, and in particular, an image of a subject to be photographed may be displayed. For example, the display unit 180 may include a liquid crystal display (LCD) having low power consumption. The display unit 180 may be combined with a touch panel, which is one of the input devices, .

The camera module 110 performs a function of photographing a subject. The camera module 110 may include an optical device for photographing a subject such as a lens, and an imaging device for converting light into an electrical signal.

The configuration and function of the camera module 110 are well-known, and a detailed description thereof will be omitted.

The event detecting unit 170 detects various events occurring in the photographing apparatus 100.

For example, the event detection unit 170 may detect a shooting event according to a shooting command of a user or a focus selection event according to a user's focus selection command.

In addition, the event detection unit 170 may sense a user selection event for a built-in voice recognition menu (not shown) or a user selection event for a built-in imaging function activation menu.

That is, the event sensing unit 170 performs a function of sensing various command events according to an operation of a user's input unit (not shown).

The photographing unit 120 controls the camera module 110 to photograph an external subject. For example, the photographing unit 120 may perform a photographing function when a photographing event corresponding to a user's photographing button is sensed by the event sensing unit 170. [

At this time, the photographing unit 120 may generate a digital photographing file corresponding to the subject.

The microphone 130 receives a voice signal. The microphone 130 may include a diaphragm (not shown) for sensing a sound wave and a coil (not shown) for converting the vibration of the diaphragm into an electrical signal. 130, and their functions are well known, and thus their detailed description will be omitted.

The function activating unit 140 performs a function of activating the photographing function.

For example, when the photographing mode of the menu is selected from the user, the function activating unit 140 can activate the photographing function. Here, activating the photographing function means preparing the photographing of an external subject, for example, preparing the camera module 110 to photograph an external subject. That is, when the photographing function is activated by the function activating unit 140, a subject recognized through the camera module 110 may be displayed on the display unit 180. [

For example, the function activation unit 140 may activate the voice input function according to the selection of the voice recognition menu of the user. Here, the voice activation function 140 may be a voice recognition function, The menu is a menu selected for activation of the voice input function. When the photographing function is activated, the voice recognition menu may be displayed in the form of a button in one area of the display unit 180.

As another example, the function activating unit 140 may automatically activate the voice input function when the event detecting unit 170 detects at least one of a focus selection event and a photographing event.

Here, the focus selection event is an event that occurs as the user adjusts the focus of the camera module 110, and the shooting event is an event that occurs as the user operates to photograph a subject currently displayed on the display unit 180. [

An example of a method of adjusting the focus of the camera module 110 may be a method of selecting (touching) a specific point on a display made up of a touch screen in a state in which the user has activated the photographing function. In this case, the photographing apparatus 100 focuses on a subject in a predetermined lattice based on a position touched by the user. This method is mainly used in a cellular phone equipped with a camera function.

Another way to adjust the focus is to press the shutter button halfway (half-shutter), which is the way the camera is used for shooting purposes.

As described above, it is a well-known technique that a focus selection event for focus adjustment is generated according to user's manipulation, so that a detailed description will be omitted.

It should be noted that the focus selection event may occur according to the user's operation as described above, but may be automatically performed. For example, the photographing apparatus 100 can automatically focus on the closest subject among a variety of subjects displayed on the display unit 180, focus on the most centrally located subject, And focus on a human face. A focus selection event may occur as the auto focus function is performed.

That is, the voice input function can be automatically activated according to the focus selection event occurring at the time when the auto focus is set.

The shooting event occurs as the user selects the shooting button, where the shooting button may consist of physical buttons or software buttons that can be selected on the touch screen.

In a mobile phone equipped with a camera function, there may be a photographing button separately from the focus selection, and in a photographing-only camera, there may be a photographing button having a focus selecting function (half-shutter function) at the same time. A shooting event may occur. Also, the generation of a shooting event according to the shooting button selection corresponds to a known technique, and thus a detailed description thereof will be omitted.

However, the function activating unit 140 is characterized in that it automatically activates the voice input function when at least one of a focus selection event and a photographing event is detected, as described above.

Here, activating the voice input function means making the external audio signal temporarily acceptable through the microphone 130. For example, when the microphone 130 is activated and input from the outside through the microphone 130 Which means that the audio signal can be recorded.

At this time, the function activating unit 140 can display the icon of the microphone 130 fixedly or blinking in one area of the display unit 180 so that the user can know the voice recording state. The activation of the voice input function can be maintained until the shooting is performed or until a predetermined time elapses after the shooting.

For example, after activating the voice input function, the function activating unit 140 can maintain the voice input function activated until the photographing is performed according to the selection of the photographing button, or until the predetermined time The voice input function can be kept activated.

Also, when the user selection event for the photographing function activation menu provided in the function activating unit 140 is sensed by the event sensing unit 170, the photographing function may be activated and the voice input function may be activated.

For example, when the user selects a predetermined menu for activating the photographing function, that is, the photographing function activating menu, the function activating unit 140 not only activates the photographing function, but also automatically activates the voice input function .

The tag information extracting unit 150 extracts voice tag information from a voice signal input through the microphone 130 in a state where the voice input function is activated.

For example, the tag information extraction unit 150 transmits a voice signal input through the microphone 130 to a predetermined tag reading server 200, and extracts voice tag information from the response signal of the tag reading server 200 can do.

As another example, the tag information extracting unit 150 can extract the voice tag information from the voice signal itself without the help of the tag reading server 200. [

For example, the tag information extraction unit 150 extracts the voice tag information by performing a syntax analysis on the voice signal inputted through the role of the microphone 130. As described in the tag reading server 200, Is inputted through the microphone 130, the tag information extracting unit 150 can extract the words "Jessica" and "sand cast" excluding the survey through the syntax analysis as voice tag information will be.

At this time, the tag information extracting unit 150 may use the algorithm of the tag reading server 200 described above as it is.

The storage control unit 160 performs a function of matching the voice tag information extracted by the tag information extraction unit 150 and the image photographed through the photographing unit 120 and storing the same.

Here, the matching of the voice tag information and the photographed image means that the photographed image is generated as a single photographed image file, and then the generated photographed file and the voice tag information are stored in the database unit (not shown) Or may generate a photo file including both the voice tag information and the photographed image. In the latter case, the voice tag information may be included in the header information of the picture file.

Furthermore, the storage control unit 160 may store at least one of the current time and the position information by matching with the voice tag information extracted by the tag information extraction unit 150 and the captured image. Here, the current time and position information may also be extracted by the tag information extracting unit 150. [ That is, the current time and location information may correspond to a kind of tag information as well as the voice tag information, and may assist the search using the tag information of the user in the future.

The storage control unit 160 may store the current time and position information or the voice tag information and the photographed image in a storage unit (not shown) ) And request the storage.

For example, the storage control unit 160 matches the photographing file corresponding to the image photographed through the photographing unit 120 with the voice tag information extracted by the tag information extracting unit 150, And may request storage.

In this case, the album server 300 can match and store the photographing file and the voice tag information received from the photographing apparatus 100.

Hereinafter, a control flow of the photographing apparatus 100 according to an embodiment of the present invention will be described with reference to FIGS. 3 to 5. FIG. In the following description of the embodiments, the description of the overlapping parts can be simplified or omitted.

First, referring to FIG. 3, the following will be described.

The photographing apparatus 100 activates the photographing function according to the user's selection (step S1).

When the focus selection event is detected (step S3), the photographing apparatus 100 focuses and activates the voice input function (step S5). 6 (a) shows a screen in which a photographing function is activated and a subject is displayed on the display unit 180, and a microphone 130 icon indicating activation of a voice input function is displayed on the upper right of the display unit 180.

Voice recording starts after the voice input function is activated.

In this embodiment, the voice input function is activated when a focus selection event is detected. However, it is needless to say that the voice input function may be activated according to the user's voice recognition menu selection.

When a photographing event is detected by a user pressing the photographing button or the like (step S7), the photographing apparatus 100 photographs the subject and terminates the voice recording (step S9).

In this embodiment, voice recording is terminated (i.e., voice input function is disabled) after the photographing is performed. However, the end of voice recording may be performed after a predetermined time elapses after the voice input function is activated.

Subsequently, the photographing apparatus 100 extracts voice tag information from the recorded voice signal (step S11). At this time, the photographing apparatus 100 may extract only nouns excluding the search according to the syntax analysis in the voice signal. For example, in the case where a voice of "Jessica and Sandcastle" is recorded, the photographing apparatus 100 can extract "Jessica" and "Sandcastle" excluding the survey as voice tag information.

In addition, the photographing apparatus 100 extracts the current time and position information (step S13), and can extract, for example, a specific region name corresponding to GPS (Global Position System) information or GPS information as position information. 6 (b) shows a state in which "August 30, 2012" as the time information, "East Coast" as the location information, and "Jessica" and "Sand castle" as the voice tag information are extracted.

The photographing apparatus 100 stores the extracted photographed image, the voice tag information, the current time, and the position information in a matching manner (step S15).

As a method for storing the photographed image, there may be a method for storing the voice tag information, the current time, and the position information in the header information of the photo file corresponding to the photographed image as described above, The file and voice tag information, the current time, and the location information may be stored in a separate storage space.

6 (c) shows a state in which the photo file and each tag information (time, position information, voice tag information) are matched.

When the photograph file and the tag information are matched and stored as described above, the user can search for desired pictures through the input of the tag word. An example of such an example is shown in FIG. 6 (d).

4 is different from FIG. 3 in that the activation point of the voice function is detected after the shooting event is detected.

That is, when the photographing event is sensed after the photographing function is activated (step S21) (step S23), the photographing apparatus 100 photographs the subject, activates the voice input function, and starts voice recording S25).

At this time, when a predetermined time has elapsed since the start of voice recording (step S27), the photographing apparatus 100 ends voice recording (step S29), and extracts voice tag information from the recorded voice signal (step S31). At this time, it is needless to say that the voice recording may be terminated according to the depression of the predetermined voice recording end button.

Since the subsequent steps are the same as those in FIG. 3, redundant description will be omitted.

5 is an embodiment in which the photographing apparatus 100 communicates with an external server to store a photographed image.

In the present embodiment, the process of activating the photographing function and the voice function to perform voice recording is the same as in the previous embodiments.

The photographing apparatus 100 transmits the recorded voice input through the microphone 130 to the tag reading server 200 (step S41).

Here, the recording voice may be a voice signal inputted through the microphone 130 and temporarily stored in the photographing apparatus 100, or may be a voice signal input in real time through the microphone 130 without being temporarily stored in the photographing apparatus 100 have.

The tag reading server 200 extracts the voice tag information from the recorded voice (step S43). At this time, only the nouns excluding the search through the voice parsing process can be extracted as the voice tag information.

The tag reading server 200 transmits the extracted voice tag information to the photographing apparatus 100 (step S45), and the photographing apparatus 100 extracts the current time and position information (step S47).

Then, the photographing apparatus 100 requests the storage while transmitting the photographed image, the voice tag information received from the tag reading server 200, and the extracted current time and position information to the album server 300 (that is, a kind of file storage server) (Step S49).

The album server 300 stores the photo file corresponding to the photographed image by matching with the voice tag information, the current time, and the position information (step S51).

Needless to say, the process of performing each of the above-described embodiments can be performed by a program stored in a predetermined recording medium (for example, a computer readable medium).

The present invention is not limited to the above-described specific embodiments, and various modifications and changes may be made without departing from the gist of the present invention. It is to be understood that such variations and modifications are intended to be included in the scope of the appended claims.

100: photographing apparatus 200: tag reading server
300: Album server 110: Camera module
120: photographing part 130: microphone
140: function activation unit 150: tag information extraction unit
160: Storage controller 170: Event detector
180:

Claims (17)

(a) activating a photographing function;
(b) activating a voice input function when a focus selection event is detected;
(c) controlling voice tag information to be extracted from a voice signal input through a microphone in a state in which the voice input function is activated;
and (d) controlling the voice tag information extracted in the step (c) to be stored and matched with the captured image. delete delete delete The method according to claim 1,
The step (c)
(c1) transmitting a voice signal input through the microphone to a predetermined tag reading server;
(c2) extracting voice tag information from the response signal of the tag reading server. The method according to claim 1,
Wherein, in the step (d), the photographing file corresponding to the photographed image and the voice tag information extracted in the step (c) are matched and transmitted to the preset album server for requesting storage . The method according to claim 1,
Wherein, in the step (d), an image file including the voice tag information extracted in the step (c) and the image to be photographed is generated and stored. The method according to claim 1,
Wherein the step (d) matches at least one of the current time and the position information with the voice tag information extracted in the step (c) and the captured image. A computer-readable recording medium storing a program for executing the method according to any one of claims 1 to 8. A camera module;
An event detection unit;
A photographing unit photographing an image through the camera module;
A microphone for receiving a voice signal;
A function activating unit for activating a photographing function and activating a voice input function when the event detecting unit detects a focus selection event;
A tag information extracting unit for extracting voice tag information from a voice signal inputted through the microphone in a state where the voice input function is activated;
And a storage control unit for storing the voice tag information extracted by the tag information extracting unit and the image captured through the photographing unit so as to be matched and stored. delete delete delete 11. The method of claim 10,
Wherein the tag information extracting unit extracts voice tag information from a response signal of the tag reading server by transmitting a voice signal inputted through the microphone to a predetermined tag reading server. 11. The method of claim 10,
Wherein the storage control unit transmits the photographing file corresponding to the image photographed through the photographing unit to the preset album server by matching the voice tag information extracted by the tag information extracting unit, . 11. The method of claim 10,
Wherein the storage control unit generates a photographing file including the voice tag information extracted by the tag information extracting unit and a video image photographed through the photographing unit, and stores the generated photographing file in a storage unit. 11. The method of claim 10,
Wherein the storage control unit stores at least one of the current time and the position information by matching with the voice tag information extracted by the tag information extracting unit and the captured image.

Images