KR20090129745A - Digital recording device, control method thereof, and recording medium storing program for executing same - Google Patents

Abstract

According to the present invention, an image capturing unit receives an input image, a display unit displaying a display image which is a part of the input image, detects a face of a person from the input image, and recognizes the detected face to form a composition of the person. A digital image photographing apparatus having a digital signal processing unit for resetting a display image to maintain a composition of the set person, a control method thereof, and a recording medium storing a program for executing the same.

Description

Digital imaging apparatus, method for controlling the same, and recording medium storing program to implement the method

The present invention relates to a digital image photographing apparatus, a control method thereof, and a recording medium storing a program for executing the same. More particularly, the present invention relates to a digital image photographing apparatus capable of receiving an image and detecting a face of a person from the received image. An apparatus, a control method thereof, and a recording medium storing a program for executing the same.

Typically, the digital image capturing apparatus includes all devices that process images such as a digital camera, a personal digital assistant (PDA), a phone camera, a PC camera, or use an image recognition sensor.

The digital image photographing apparatus may generate an image file by image processing and compressing the image received through the image pickup device in a digital signal processor, and may store the image file in a memory.

In addition, the digital imaging apparatus may display and display an image of an image file input through an imaging device or stored in a storage medium on a display device such as a liquid crystal display (LCD).

The input image may include a face of a person. In this case, a face of a person is often of interest in an image to be photographed. In this case, the face may be detected to take a portrait picture better. In this case, a picture may be taken by focus and exposure that match the detected face.

It is a main object of the present invention to provide a digital imaging apparatus capable of capturing a constant composition of image regardless of a person's movement using face recognition, a control method thereof, and a recording medium for storing a program for executing the same.

A digital image photographing apparatus according to an embodiment of the present invention includes an image capturing unit receiving an input image, a display unit displaying a display image which is a part of the input image, and detecting and detecting a face of a person from the input image. And a digital signal processing unit for recognizing the face and setting a set composition of the person and resetting a display image to maintain the set composition.

The digital signal processor may include: a face detector configured to detect a face of the person from the input image; a composition setter configured to recognize the detected face and set the set composition; When there is a movement of the person, a display controller may be configured to reset the display image to have the same composition as the set composition and to display the reset display image on the display unit.

In the present invention, the display control unit may determine the movement of the person by tracking the recognized face.

In the present invention, when the first shutter-release signal is input, the digital signal processor may set the setting structure at the time of inputting the first shutter-release signal.

In the present invention, the composition of the person may include location information of the face.

A control method of a digital image photographing apparatus according to an embodiment of the present invention includes the steps of (a) receiving an input image, (b) detecting a face of a person from the input image, and (c) detecting the face of the person. (D) setting a setup composition for the face region of the recognized face in the input image, (d) tracking the recognized face in the newly input image; and e) displaying a display image in which the area of the tracked face has the same composition as the set composition in the newly input input image.

In the present invention, the display image is a portion of the input image, and may be an image displayed on the digital imaging apparatus.

In the present invention, the step (e) comprises: (e1) determining the movement of the person by the face tracking; and (e2) determining that there is the movement of the person. And setting the display image having the same composition as the set composition from the newly input image, and (e3) displaying the display image on a display unit of the digital imaging apparatus.

In the present invention, the setting composition may include location information of the face.

A recording medium according to an embodiment of the present invention is a recording medium storing a program for executing the method.

According to the digital image photographing apparatus of the present invention, a control method thereof, and a recording medium storing a program for executing the same, the moving image can be easily captured according to a set composition using face recognition.

Hereinafter, with reference to the embodiments of the present invention shown in the accompanying drawings will be described in detail the present invention. But. The present invention may be modified in various other forms, and the scope of the present invention is not limited to the embodiments described below. The embodiments of the present invention are provided to more completely explain the present invention to those skilled in the art. Accordingly, the shape and size of elements in the drawings may be exaggerated for clarity, and the elements denoted by the same reference numerals in the drawings are the same elements.

1 is a perspective view showing the front of a digital imaging apparatus according to an embodiment of the present invention, Figure 2 is a rear view showing the back of the digital imaging apparatus of FIG.

1 and 2, the digital image photographing apparatus 100 includes a shutter release button 101, a power button 103, a flash 105, an auxiliary light 107, a lens unit 109, and a wide angle. ) -Zoom button 111w, telephoto-zoom button 111t, display unit 113, and function button 121 may be provided.

The shutter-release button 101 is an aperture (not shown) such that an image sensor (not shown) such as a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) may be exposed to light for a predetermined time. ) And a shutter (not shown) can be opened and closed.

The shutter release button 101 may generate first and second image capturing signals by a photographer input. When the first shutter-release signal as the half-shutter signal is input, the digital imaging apparatus focuses and adjusts the amount of light, and when the focus is achieved, the display 113 displays a constant display such as a green light. . When the focus is achieved by the input of the first shutter release signal and the amount of light is adjusted, the second shutter release signal as a full shutter signal is input to capture an image.

The power button 103 is input to operate by supplying power to the digital image photographing apparatus 100.

The flash 105 brightens the bright light instantly when shooting in a dark place, and the flash mode may include auto flash, forced flash, flash off, red-eye reduction, slow synchro, and the like.

The auxiliary light 107 supplies light to the person so that the digital image capturing apparatus 100 can focus quickly and accurately when the amount of light is insufficient or at night.

The lens unit 109 receives light from an external light source to form an image on the image sensor.

The wide-angle zoom button 111w or the tele-zoom button 111t increases the angle of view or narrows the angle of view according to an input, particularly when the size of the selected exposure area is to be changed. When the wide-zoom button 111w is input, the size of the selected exposure area is reduced, and when the tele-zoom button 111t is input, the size of the selected exposure area is increased.

The function button 121 may include a total of five buttons including an up button, a down button, a left button, a right button, and a menu / OK button. The present invention is not limited thereto, and the function button may include five or more buttons, and the arrangement may be variously arranged according to the user's convenience. In addition, the function button may be implemented as a touch sensor or a contact switch, and may be implemented as a touch screen method on the display 113. The function button 121 is input to execute various menus related to the operation of the digital imaging apparatus, and each of the keys may be used as a shortcut key.

3 is a block diagram illustrating a configuration of a digital image capturing apparatus according to an exemplary embodiment of the present invention, wherein the display unit 113, the user input unit 121, the image capturing unit 123, the image capturing unit 125, and the storage unit are provided. 127 and a digital signal processing unit 129.

The user input unit 121 may include a shutter-release button 101 for opening and closing the shutter and the aperture so that light is exposed to an image sensor such as a CCD or a CMOS for a predetermined time, a power button 103 for inputting power, and an input. Wide angle-zoom button (111w) and telephoto-zoom button (111t) to widen the view angle or narrow the angle of view according to, and may be composed of a function button 115 for text or menu settings.

The imaging unit 123 may include a lens unit 109, a shutter, an aperture, an image sensor, and an analog-to-digital converter (ADC), which are not shown in the drawing. The shutter is a mechanism for adjusting the amount of light exposed together with the aperture. The lens unit 109 receives light from an external light source and causes light to form on the image sensor. At this time, the aperture adjusts the amount of light (light quantity) incident on the degree of opening and closing of the aperture. The opening and closing degree of the iris is controlled by the controller 129.

The image sensor accumulates the amount of light input through the lens unit 109 and outputs the image captured according to the accumulated light amount in accordance with the vertical synchronization signal. Image acquisition of the digital imaging apparatus 100 is performed by an image sensor that converts light reflected from a person into an electrical signal. Image sensors used in the digital imaging apparatus 100 include a CMOS image sensor and a CCD image sensor. In order to obtain a color image using a CCD image sensor, a color filter is required, and generally, a filter (not shown) called a color filter array (CFA) is employed. CFA has a structure arranged regularly by passing only one color light per pixel, and has various shapes according to the arrangement structure. The ADC converts an analog video signal output from the CCD into a digital signal.

The image processor 125 performs signal processing to display a digitally converted image signal. Devices used in CCD and CFA filters are sensitive to a change in temperature and generate a dark current according to the changing temperature, which includes an unwanted black level in the image signal. The image processor 125 may remove the black level generated by the dark current as described above.

The image processor 125 may also perform gamma correction. Since human vision reacts nonlinearly to brightness according to Weber's law, when a limited bit depth is given, linearly recording the brightness of the light can cause posterization. This happens. Therefore, in order to show the maximum image quality under a given bit depth, it is necessary to encode using a nonlinear function. Thus, encoding information according to nonlinearity of human vision is called gamma correction. The gamma correction of the image capturing unit 125 gamma corrects and outputs an image signal input by the gamma curve. For example, the input luminance level of the 12-bit image signal may be corrected to an 8-bit luminance level.

The image processor 125 performs CFA interpolation for interpolating a Bayer pattern implemented with RGRG lines and GBGB lines of gamma-corrected predetermined data into RGB lines. The CFA interpolation of the image processing unit 125 restores the G channel first from pixels having only the R or B channel value, and then fills the empty values in the order of the B channel, the R channel, or the R channel and the B channel, and then R, G , B three channels can be restored.

The image processing unit 125 converts the interpolated RGB signal into a YUV signal, sharpens the image by filtering the Y signal by a high band filter, and uses the standard color coordinate system to adjust the color values of the U and V signals. Color correction is performed to correct, and noise of these can be removed.

The image processor 125 compresses and signals the Y, U, and V signals from which the noise is removed to generate an Exif (Exchangeable image file format) file, and the generated Exif file is displayed on the display unit 113 and the storage unit ( 127). All of the operations of the image capturing unit 125 operate under the control of the digital signal processing unit 129.

The storage unit 127 is a space for finally storing the image file, and may include a memory card of various standards such as a smart card, a compact flash (CF) memory, a memory stick, and a secure digital (SD) memory card. .

In addition, the digital image capturing apparatus 100 used in the present invention is not only a memory card storing an image file, but also an EEPROM (Electrically Erasable and Programmable Read Only Memory) and a digital signal processor that store algorithms necessary for the operation of the digital signal processor. Of course, it may further include a flash memory (flash memory) for storing the setting data required for the operation of.

The digital signal processor 129 may control the entire digital imaging apparatus 100. In particular, the digital signal processor 129 may detect a face of a person from an input image, recognize the detected face, set a composition of the person, and set the person. The composition can be controlled to be maintained.

To this end, the digital signal processor 129 may include a face detector 129-1, a composition setting unit 129-2, and a display controller 129-3.

The face detector 129-1 may detect a face of the person 155a from the input image 151a. The face of the person 155a may be detected in consideration of the color or shape of the face of the person in the input image 155a. When the detected face is in the display image 152, the face detector 129-1 may display the FD window 156a on the display image 155a to indicate an area of the detected face.

5 and 6, the input image 151a is an image input through the imaging unit 123, and the display image 155a is an image displayed on the display 113 as a part of the input image 151a. . In detail, not all portions of the input image 151a are displayed on the display 113, but only a portion of the input image 151a is displayed on the display 113. A portion of the input image 151a that is displayed on the display 113 is called a display image 152. The display image 152 may be an image of a central portion of the input image 151a. However, the display image 153 may be reset to another portion of the input image 151b as shown in FIG. 5 by the display controller 129-3 to be described later. This will be described later.

The composition setting unit 129-2 may recognize a face detected by the face detector 129-1 and set a composition of the person 155a based on the recognized face. Face recognition is a different concept from face detection. Face detection is to find a face included in the input image. Face recognition may give information to know whose face is detected in the input image. However, a face must be detected first to recognize a face with respect to the detected face.

The composition setting unit 129-2 may perform face recognition based on a 2D image as in a conventional face recognition system. In this case, an error may be compensated for by receiving a 3D distance image, extracting facial feature points, and extracting a 3D face pose so as to improve a recognition rate for variously changed face poses.

The composition setting unit 129-2 also sets a configuration composition for the face region of the face recognized in the input image 151a. The setting composition refers to the arrangement of faces in the display image 152. The composition setting unit 129-2 may set a configuration according to the input of the first shutter-release signal as a half shutter signal. Referring to FIG. 4, the detected face is located on the upper right side of the display image 152. When the user wants the image of the composition as shown in FIG. 4, the user presses the shutter button halfway, and the composition setting unit 129-2 sets the display image 155a by the first shutter-release signal corresponding to the shutter button halfway. You will set the composition.

When there is movement of the person 155b in the newly input image 151b, the display control unit 129-3 has the same composition as the setting structure set by the composition setting unit 129-2. The display image 153 may be reset to display the reset display image 153 on the display 113.

In detail, the display controller 129-3 may determine the movement of the person 155b in the input image 151b newly input by the imaging unit 123. The display controller 129-3 may determine the movement of the person 155b using face tracking. The display controller 129-3 searches for a face detected and recognized by the face detector 129-1 and the composition setting unit 129-2 from the newly input input image 151b, and displays the previous input image 151a. The movement of the person who is the subject may be determined by comparing the position of the face with the position of the face of the newly input image 151b.

When the display controller 129-3 determines that there is a movement of a person, the display controller 129-3 may reset the display image 153 to have the same composition as that set by the composition setting unit 129-2.

4 and 5, the person 155a is positioned on the right side of the display image 152, and the composition setting unit 129-2 displays a composition in which the person 155a is located on the right side of the display image 152. Set it. Subsequently, when the person 155b moves to the left side as shown in FIG. 5, the display control unit 129-3 may determine the movement of the person 155b by face tracking, and also, the display control unit 129-3. Moves the display image 153 to the left rather than the center of the input image 151b so that the person 155b has a composition located on the right side of the display image 153. That is, even when the person 155b moves, the display image 153 displayed on the display 113 has the same composition as the set composition. Accordingly, in the present invention, even when the subject moves, the user can capture an image according to a structure set by the user without moving the digital image photographing apparatus 100.

Hereinafter, a control method of the digital imaging apparatus 100 according to the present invention will be described. The control method of the digital image capturing apparatus 100 according to the present invention may be performed in the digital image capturing apparatus 100 as shown in FIG. 3. It may be performed inside the digital signal processor 129 with the help of the components.

Referring to FIG. 7, in the method of controlling a digital image photographing apparatus according to an embodiment of the present disclosure, the method may include receiving an input image (S101), detecting a face (S102), and recognizing a face (S103). ), Setting the set composition (S104, S105), tracking the face in the newly input image (S106), and resetting and photographing the display image (S107, S108, S109).

First, an input image is received through the imaging unit 123 (S101). Not all portions of the input image 151a are displayed on the display 113, but only a portion of the input image 151a is displayed on the display 113. A portion of the input image 151a that is displayed on the display 113 is called a display image 152. As shown in FIG. 4, the display image 152 may be an image of a central portion of the input image 151a. However, the display image 153 may be reset to another portion of the input image 151b as shown in FIG. 5 by the display controller 129-3 to be described later.

Next, a face is detected from the input image 151a (S102). In detail, the face detector 129-1 may detect the face of the person 155a from the input image 151a. The face of the person 155a may be detected in consideration of the color or shape of the person's face in the input image 155a. When the detected face is in the display image 152, the face detector 129-1 may display the FD window 156a on the display image 155a to indicate an area of the detected face. However, when no face is detected in the input image 151a or when a face is detected in a portion other than the display image 152, the face detector 129-1 does not display the FD window.

Next, the detected face is recognized (S103). Face recognition is a different concept from face detection. Face detection is to find a face included in the input image. Face recognition may give information to know whose face is detected in the input image. However, a face must be detected first to recognize a face with respect to the detected face. The composition setting unit 129-2 may perform face recognition based on a 2D image as in a conventional face recognition system. In this case, an error may be compensated for by receiving a 3D distance image, extracting facial feature points, and extracting a 3D face pose so as to improve a recognition rate of variously changed face poses.

Next, a first shutter-release signal (S1 signal) is input (S104). The first shutter-release signal is generated by the user pressing the shutter button halfway. The user presses the shutter halfway when the person 155a, which is the subject, is positioned in the predetermined composition while looking at the display image 155a displayed on the display 113.

Next, the composition of the display image 155a is set (S105). The composition setting unit 129-2 performs the composition setting according to the input of the first shutter-release signal as the half shutter signal.

Next, the face is tracked (S106). The face tracking may determine the movement of the person 155b as the subject. In detail, the display controller 129-3 searches for a face detected and recognized by the face detector 129-1 and the composition setting unit 129-2 from the newly inputted input image 151b, and displays a previous input. The position of the face of the image 151a and the position of the face of the newly input input image 151b may be compared to determine the movement of the person who is the subject.

Next, it is determined whether there is a change in composition (S107). This determines that there is a change in composition when there is movement of the subject as a result of face tracking. When the composition is changed by the movement of the person 155b, the display control unit 129-3 resets the display image to have the same composition as the setting composition set by the composition setting unit 129-2 (S108). As shown in FIG. 4, the already set configuration has the person 155a positioned on the right side of the display image 152. However, the person 155b is moved to move the person 155b in the input image 151b as shown in FIG. If the display image is located at the center of the input image 151b when the display image is located on the left side, the display image has a different composition from the set composition, and thus the display control unit 129-3 displays the display image 153 as shown in FIG. 5. ) Is moved to the left so that the composition of the display image 153 has the same composition as the set composition.

Finally, photographing is performed by the input of the second shutter-release signal (S109).

A program for executing the method of controlling the digital image photographing apparatus according to the above-described embodiments and variations thereof in the digital image capturing apparatus may be stored in a recording medium. The recording medium may be a storage unit 127 as shown in FIG. 2, or may be a separate recording medium. The recording medium may be a storage medium such as a magnetic storage medium (for example, a ROM, a floppy disk, a hard disk, etc.) and an optical reading medium (for example, a CD-ROM, a DVD (Digital Versatile Disc)). Include.

The present invention is not limited by the above-described embodiment and the accompanying drawings, but is intended to be limited by the appended claims, and various forms of substitution and modification within the scope not departing from the technical spirit of the present invention described in the claims. And it will be apparent to those skilled in the art that changes are possible.

1 is a front perspective view schematically showing a digital image capturing apparatus according to an embodiment of the present invention.

FIG. 2 is a rear view schematically illustrating the digital imaging apparatus of FIG. 1.

3 is a configuration diagram schematically illustrating a configuration of the digital image photographing apparatus of FIG. 1.

4 is a diagram illustrating an input image and a display image of a digital imaging apparatus.

5 is a diagram illustrating an input image and a display image when a person moves.

6 is a flowchart schematically illustrating a control method of a digital imaging apparatus according to an embodiment of the present invention.

<Description of the symbols for the main parts of the drawings>

100: digital video recording device 101: shutter-release button

103: power button 105: flash

107: auxiliary light 109: lens unit

113: display unit 121: user input unit

123: imaging unit 125: image processing unit

127: storage unit 129: digital signal processing unit

Claims (10)

An imaging unit which receives an input image; A display unit configured to display a display image which is a part of the input image; And And a digital signal processor for detecting a face of a person from the input image, recognizing the detected face to set a set composition of the person, and resetting a display image to maintain the set composition. The method of claim 2, The digital signal processing unit, A face detector for detecting a face of the person from the input image; A composition setting unit for recognizing the detected face and setting the set composition; And a display control unit configured to reset the display image to have the same composition as the set composition and to display the reset display image on the display unit when the person's movement is in the newly input image. Device. The method of claim 2, And the display control unit determines the movement of the person by tracking the recognized face. The method of claim 2, And the digital signal processor is configured to set the set composition at the time of inputting the first shutter release signal when a first shutter release signal is input. The method of claim 2, And the composition of the person includes location information of the face. (a) receiving an input image; (b) detecting a face of a person in the input image; (c) recognizing the detected face; (d) setting a setup composition for a face area of the recognized face in the input image; (d) tracking the recognized face in a newly input input image; and (e) displaying a display image in which the area of the tracked face has the same composition as the set composition in the newly input input image. The method of claim 6, And the display image is a portion of the input image and is an image displayed on the digital image photographing apparatus. The method of claim 6, In step (e), (e1) determining the movement of the person by the face tracking; (e2) if it is determined that there is movement of the person, setting the display image having the same composition as the set composition as the tracked face in the newly input image; And (e3) displaying the display image on a display unit of the digital image capturing apparatus. The method of claim 6, And the setting composition comprises position information of the face. A recording medium storing a program for executing the method of any one of claims 6 to 9.

Images