JP4697461B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus, and more particularly to an imaging apparatus having an image blur correction function and a face detection function.

  In general, when photographing a person, it is required to focus on the face of the person who is the subject and to shoot with the optimal exposure on the face of the person.

  Therefore, various digital cameras have been proposed in which a person's face is detected from an image obtained from the image sensor before the actual photographing, and the focus and exposure are automatically adjusted to the person's face (see, for example, Patent Documents 1 to 3). ).

In addition, various digital cameras having an image blur correction function have been proposed in order to reduce blurring of captured images based on camera shake (for example, Patent Documents 4 to 6).
JP 2006-208443 A JP 2006-018246 A JP 2005-318554 A JP 2006-259567 A JP 2006-215393 A JP 2006-208570 A

  However, when performing a human face detection process, there is a drawback in that the human face detection process cannot be performed with high accuracy if the image obtained from the image sensor is blurred.

  Further, in the case of a digital camera having an image blur correction function, since a centering operation or the like is performed immediately after startup, there is a drawback that the image is not stabilized and the detection accuracy is lowered.

  The present invention has been made in view of such circumstances, and an object thereof is to provide an imaging apparatus capable of detecting a specific subject with high accuracy.

According to a first aspect of the present invention, in order to achieve the above object, in an imaging apparatus including subject detection means for detecting a specific subject from an image obtained from an imaging element via a photographing lens, the subject detection function is turned on / off. A means for switching OFF, a detection means for detecting the presence or absence of blurring of an image formed on the light receiving surface of the image sensor, and a subject detection process when the subject detection function is turned on, while the detection means Control means for controlling the subject detection means so as to resume the subject detection processing when the detection means stops the subject detection processing. Provided is an imaging apparatus characterized by comprising the above.

  According to the first aspect of the invention, while the blur of the image formed on the light receiving surface of the image sensor is detected by the detection unit, the subject detection process by the subject detection unit is stopped. As a result, it is possible to detect a specific subject (for example, a human face) based only on a stable image, and to perform the subject detection processing with high accuracy.

  According to a second aspect of the present invention, in order to achieve the above object, the detection means detects a motion vector of an image obtained from the image sensor, and blurs an image formed on the light receiving surface of the image sensor. The imaging apparatus according to claim 1, wherein the presence or absence of the image is detected.

  According to the second aspect of the present invention, the presence or absence of blurring of the image formed on the light receiving surface of the image sensor is detected by detecting the motion vector of the image obtained from the image sensor.

According to a third aspect of the present invention, in order to achieve the above object, an image formed on the light receiving surface of the image pickup device by moving a part of the taking lens or the image pickup device in a direction to cancel the blur generated in the apparatus main body. the blur have a shake correction means for correcting the detection means detects that some or imaging element of the imaging lens is positioned at the predetermined position, the image formed on the light receiving surface of the imaging device The imaging apparatus according to claim 1 , wherein the presence or absence of blurring is detected .

  According to the third aspect of the present invention, there is provided the blur correction means for correcting the blur of the image formed on the light receiving surface of the image sensor, and even when the blur correction means is functioned, the image sensor While the blur of the image formed on the light receiving surface is detected, the subject detection process is stopped. Thus, the subject detection process can be performed with high accuracy.

According to a fourth aspect of the present invention, in order to achieve the above object, an image formed on the light receiving surface of the image pickup device by moving a part of the taking lens or the image pickup device in a direction to cancel the blur generated in the apparatus main body. In an imaging apparatus comprising a blur correction unit that corrects a blur of a subject and a subject detection unit that detects a specific subject from an image obtained from the imaging device, a unit that switches ON / OFF of a subject detection function, and the imaging device Detecting means for detecting the presence or absence of blurring of an image formed on the light receiving surface, switching means for switching ON / OFF of blur correction by the blur correction means, and blur correction is switched from OFF to ON by the switching means. and when a detection means for detecting the completion of the centering operation of a part or the imaging element of the imaging lens to be performed by the shake correction means, when the object detection function is turned ON, While starting the Utsushitai detection process, when the shake correction is switched from OFF to ON by the switching means, the object detecting means so that the subject detection processing is suspended until completion of the centering operation is detected by said detecting means When the image blur is detected by the detection means, the subject detection process is stopped. When the image blur is not detected by the detection means, the subject detection means is restarted. And an image pickup apparatus characterized by comprising: a control means for controlling

According to the fourth aspect of the present invention, in the imaging apparatus provided with the shake correction means, when the shake correction is switched from OFF to ON, the subject detection process is stopped until the centering operation is completed. Accordingly, the subject detection process can be performed based only on a stable image, and the subject detection process can be performed with high accuracy.

According to a fifth aspect of the present invention, in order to achieve the above object, an image formed on the light receiving surface of the image pickup device by moving a part of the taking lens or the image pickup device in a direction to cancel the blur generated in the apparatus main body. In an image pickup apparatus including a shake correction unit that corrects a blur of a subject and a subject detection unit that detects a specific subject from an image obtained from the image sensor, a unit that switches ON / OFF of a subject detection function, and the blur correction Switching means for switching on / off of blur correction by the means, first detection means for detecting pan and / or tilt operation, and first for detecting the presence or absence of blurring of an image formed on the light receiving surface of the image sensor. When the second detection means and the subject detection function are turned on, subject detection processing is started. On the other hand, when panning and / or tilting operations are detected by the first detection means, subject detection processing is started. When the panning and / or tilting operation is no longer detected by the first detection unit, the subject detection unit is controlled to resume the subject detection process, and an image blur is caused by the second detection unit. And a control means for controlling the subject detection means so as to resume the subject detection processing when the second detection means stops detecting blurring of the image when the subject detection processing is stopped . An imaging apparatus is provided.

According to the fifth aspect of the present invention, the subject detection process is stopped while the panning and / or tilting operations are detected in the imaging apparatus including the image blur correction unit. Thus, the subject detection process can be performed based only on a stable image, and the subject detection process can be performed with high accuracy.
According to a sixth aspect of the present invention, in order to achieve the above object, an image formed on the light receiving surface of the image pickup device by moving a part of the taking lens or the image pickup device in a direction to cancel out the blur generated in the apparatus main body. In an image pickup apparatus including a shake correction unit that corrects a blur of a subject and a subject detection unit that detects a specific subject from an image obtained from the image sensor, a unit that switches ON / OFF of a subject detection function, and the blur correction Switching means for switching on / off of blur correction by the means, first detection means for detecting pan and / or tilt operation, and first for detecting the presence or absence of blurring of an image formed on the light receiving surface of the image sensor. 2 and when the subject detection function is turned on, the subject detection process is started. On the other hand, when the blur correction is switched from OFF to ON by the switching unit, the detection unit When the subject detection means is controlled to stop the subject detection process until the completion of the talling operation is detected, and the pan and / or tilt action is detected by the first detection means, the subject detection process When the panning and / or tilting operation is no longer detected by the first detection unit, the subject detection unit is controlled to resume the subject detection process, and the second detection unit blurs the image. And a control unit that controls the subject detection unit to resume the subject detection process when the second detection unit stops detecting the blur of the image. An imaging apparatus characterized by the above is provided.

  With the imaging apparatus according to the present invention, it is possible to detect a specific subject with high accuracy.

  The best mode for carrying out an imaging apparatus according to the present invention will be described below with reference to the accompanying drawings.

  1 and 2 are a front perspective view and a rear perspective view, respectively, showing the external configuration of a digital camera to which the present invention is applied.

  As shown in the figure, the digital camera 10 is configured as a so-called compact camera, and the camera body 12 is formed in a shape that can be held with one hand.

  As shown in FIG. 1, a photographing lens 14, a strobe 16, a speaker 18, an AF auxiliary light lamp 20, and the like are provided on the front surface of the camera body 12, and a shutter button 22, a mode lever 24, a power source are provided on the upper surface. A button 26 and the like are provided.

  On the other hand, on the back of the camera body 12, as shown in FIG. 2, a monitor 28, a zoom button 30, a playback button 32, a camera shake correction button 34, a cross button 36, a MENU / OK button 38, a DISP / BACK button 40, A face detection button 42 and the like are provided.

  Although not shown, a tripod screw hole and an openable / closable battery cover are provided on the bottom surface of the camera body 12, and a battery storage chamber and a memory card for storing the battery are provided inside the battery cover. Is provided with a memory card slot.

  The taking lens 14 is constituted by a retractable zoom lens having an optical camera shake correction function, and is extended from the camera body 12 when the digital camera 10 is turned on. Since the zoom mechanism and the retracting mechanism of the photographic lens 14 are well-known techniques, a description of their specific configuration is omitted here.

  The strobe 16 is composed of a xenon tube, and emits light as necessary when shooting a dark subject or when backlit.

  The AF auxiliary light lamp 20 is composed of, for example, a high-intensity LED, and emits light as necessary during AF. The AF auxiliary light lamp 20 is configured to change the amount of AF auxiliary light to be emitted.

  The shutter button 22 is constituted by a two-stage stroke type switch composed of so-called “half press” and “full press”. When the shutter release button 22 is half-pressed, the digital camera 10 performs shooting preparation processing, that is, each of AE (Automatic Exposure), AF (Auto Focus), and AWB (Automatic White Balance). When the image is processed and fully pressed, the image is captured and recorded.

  The mode lever 24 is used for setting the shooting mode. The mode lever 24 is provided so as to be swingable around the shutter button 22 within a predetermined angle range, and can be set to “SP position”, “AUTO position”, “M position”, and “moving picture position”. Is provided. The digital camera 10 is set to the “scene program shooting mode” by setting the mode lever 24 to the “SP position”, and is set to a mode for performing exposure control and shooting control according to the shooting scene. Also, by setting the “AUTO position”, the “auto shooting mode” is set, and the mode is set to perform the exposure control fully automatically. Also, by setting the “M position”, the “manual shooting mode” is set, and the exposure setting is manually set. Also, by setting the “moving image position”, the “moving image shooting mode” is set, and the moving image shooting mode is set. As the “scene program shooting mode”, for example, “portrait mode” for shooting a person, “landscape mode” for shooting a landscape, “sport mode” for shooting a sport, “night view mode” for shooting a night scene, “Underwater mode” for shooting is prepared.

  The power button 26 is used to turn on / off the power of the digital camera 10, and is turned on / off when pressed for a predetermined time (for example, 2 seconds).

  The monitor 28 is composed of a color LCD. The monitor 28 is used as an image display unit for displaying captured images, and is used as a GUI during various settings. Further, at the time of shooting, an image captured by the image sensor is displayed through and used as an electronic viewfinder.

  The zoom button 30 is used for a zoom operation of the photographic lens 14 and includes a zoom tele button for instructing zooming to the telephoto side and a zoom wide button for instructing zooming to the wide angle side.

  The playback button 32 is used for an instruction to switch to the playback mode. That is, the digital camera 10 is switched to the playback mode when the playback button 32 is pressed during shooting. When the playback button 32 is pressed while the power is off, the digital camera 10 is activated in the playback mode.

  The camera shake correction button 34 is used to turn on / off the camera shake correction function, and the camera shake correction function is turned on / off each time the camera shake correction button 34 is pressed. When the power is turned on, the camera shake correction function is set to the state at the end of the previous time. In other words, if the camera is turned off with the camera shake correction function set to ON, the camera shake correction function will be activated with the camera shake correction function set to OFF when the power is turned on next time. Then, when the power is turned on next time, the camera shake correction function is started in a state set to OFF.

  The cross button 36 is provided so that it can be pressed in four directions, up, down, left, and right, and a function corresponding to the setting state of the camera is assigned to the button in each direction. For example, at the time of shooting, a function for switching on / off of the macro function is assigned to the left button, and a function for switching the strobe mode is assigned to the right button. In addition, a function for changing the brightness of the monitor 28 is assigned to the upper button, and a function for switching ON / OFF of the self-timer is assigned to the lower button. Further, during playback, a frame advance function is assigned to the left button, and a frame return function is assigned to the right button. Also, a function for changing the brightness of the monitor 28 is assigned to the upper button, and a function for deleting the image being reproduced is assigned to the lower button. In various settings, a function for moving the cursor displayed on the monitor 28 in the direction of each button is assigned.

  The MENU / OK button 38 is used to call a menu screen (MENU function), and is used to confirm selection contents, execute a process, etc. (OK function), and is assigned according to the setting state of the digital camera 10. Is switched.

  On the menu screen, for example, all adjustment items that the digital camera 10 has such as image quality adjustment such as exposure value, hue, ISO sensitivity, number of recorded pixels, self-timer setting, photometry method switching, and whether or not to use digital zoom. Settings are made. The digital camera 10 operates according to the conditions set on this menu screen.

  The DISP / BACK button 40 is used for a display content switching instruction (DISP function) of the monitor 28 and an instruction for canceling an input operation (BACK function), and is assigned according to the setting state of the digital camera 10. The function is switched.

  The face detection button 42 is used to turn on / off the face detection function, and the face detection function is turned on / off each time the face detection button 42 is pressed. When this face detection function is turned on, the face of a person on the screen is detected, the detected face is focused, and exposure is set so that the face has an appropriate brightness. In addition, image processing suitable for a person image is performed on an image obtained by shooting (for example, color adjustment processing or the like is performed so that the skin of the person is clean).

  When the power is turned on, the face detection function is set to the state at the end of the previous time. In other words, if the power is turned off with the face detection function set to ON, the next time the power is turned on, the face detection function is activated with the face detection function set to ON. When the power is turned on, the face detection function is activated while being set to OFF.

  Further, when this face detection function is ON, if it is determined that a person's face is not included in the image to be shot (when a person's face is not detected), a warning is given (for example, An error message is displayed on the monitor 28 or an alarm is sounded). The photographer can know from the warning that the face detection function is erroneously set to ON, and can appropriately turn off the face detection function. Accordingly, it is possible to prevent the image processing suitable for the person image from being performed even though the face of the person is not copied, resulting in an unnatural image.

  If the face detection function is set to ON and an image is taken without detecting a face, this type of image processing function may be automatically stopped.

  FIG. 3 is a block diagram showing an electrical configuration of the digital camera 10.

  As shown in the figure, the digital camera 10 includes a CPU 110, an operation unit (shutter button 22, mode lever 24, power button 26, zoom button 30, playback button 32, camera shake correction button 34, cross button 36, MENU / OK. Button 38, DISP / BACK button 40, face detection button 42, etc.) 112, ROM 116, flash ROM 118, memory (SDRAM) 120, VRAM 122, photographic lens 14, zoom control unit 203, aperture / shutter control unit 205, camera shake correction control Unit 207, focus motor control unit 209, image sensor 134, image sensor control unit 136, analog signal processing unit 138, A / D converter 140, digital signal processing unit 142, AF detection unit 144, AE / AWB detection unit 146, Compression / decompression processing unit 148, media controller 150, a storage medium (memory card) 152, a display control unit 154, a monitor 28, a strobe control circuit 156, a strobe 16, and a face detection unit 160 or the like.

  The CPU 110 functions as a control unit that performs overall control of the overall operation of the digital camera 10, and controls each unit according to a predetermined control program based on an input from the operation unit 112.

  The ROM 116 connected via the bus 114 stores a control program executed by the CPU 110 and various data necessary for the control. The flash ROM 118 stores various types of operations related to the operation of the digital camera 10 such as user setting information. Setting information and the like are stored.

  The memory (SDRAM) 120 is used as a calculation work area for the CPU 110 and is also used as a temporary storage area for image data, and the VRAM 122 is used as a temporary storage area dedicated to image data for display.

  The photographing lens 14 includes a zoom lens group 202, an aperture / shutter unit 204, a camera shake correction unit 206, a focus lens group 208, an infrared cut filter 131, an optical low-pass filter 132, and the like.

  The zoom lens group 202 is driven by a zoom lens actuator (not shown) to move back and forth along the optical axis, thereby changing the focal length. The CPU 110 controls the movement of the zoom lens group 202 by controlling the driving of the zoom lens actuator via the zoom control unit 203 and performs zooming.

  The focus lens group 208 is driven by a focus lens actuator (not shown) to move back and forth along the optical axis, thereby changing the imaging position. The CPU 110 controls the movement of the focus lens group 208 by controlling the drive of the focus lens actuator via the focus motor control unit 209, and performs focusing.

  The aperture / shutter unit 204 includes an aperture and a mechanical shutter (not shown).

  The diaphragm operates by being driven by a diaphragm actuator (not shown) built in the diaphragm / shutter unit 204, and thereby the amount of light incident on the image sensor 134 is adjusted. The CPU 110 controls the operation of the diaphragm by controlling the driving of the diaphragm actuator via the diaphragm / shutter control unit 205 and controls the amount of light incident on the image sensor 134 (aperture value).

  The mechanical shutter operates by being driven by a shutter actuator (not shown) built in the aperture / shutter unit 204, whereby the image sensor 134 is exposed / light-shielded. The CPU 110 controls the operation of the mechanical shutter by controlling the driving of the shutter actuator via the aperture / shutter control unit 205 to control the exposure / light shielding of the image sensor 134.

  The infrared cut filter 131 cuts infrared light in a specific wavelength region in the light incident on the image sensor 134 to prevent ghosting and fogging due to infrared light.

  The optical low-pass filter 132 cuts a high frequency component in the light incident on the image sensor 134 to prevent generation of false colors and color moire.

  The camera shake correction unit 206 includes a correction lens, an angular velocity sensor, and the like. The camera shake correction unit 206 moves the correction lens so as to cancel vibrations in the pan direction and the tilt direction, and corrects image blur that occurs on the light receiving surface of the image sensor 134.

  FIG. 4 is a front view showing a schematic configuration of the camera shake correction unit 206.

  As shown in the figure, the camera shake correction unit 206 has a main body frame 210 formed in a frame shape. The main body frame 210 is screwed to the lens barrel of the taking lens 14 with screws or the like, and is integrally assembled inside the lens barrel.

  A correction lens 212 is disposed inside the main body frame 210. The correction lens 212 is held by a lens frame 214 and is moved in a direction to correct image blur in a plane orthogonal to the photographing optical axis L by the X-axis linear motor 216 and the Y-axis linear motor 218. The correction lens 212 is movably supported on the main body frame 210 via a parallel link mechanism including four arms 220 and 222.

  The X-axis linear motor 216 moves the correction lens 212 in the X-axis direction (pan direction) in the figure, and mainly includes a motor main body 216A and a rod 216B.

  The motor main body 216A is fixed to the main body frame 210. The tip of the rod 216B is engaged with a long hole 224 formed in the lens frame 214 via a roller 226. The long hole 224 is formed along the Y-axis direction in the drawing, whereby the long hole 224 and the roller 226 are engaged with each other so as to be relatively movable in the Y-axis direction in the drawing.

  When the rod 216B of the motor body 216A expands and contracts, the lens frame 214 is pushed by the rod 216B or pulled by the rod 216B and moves in the X-axis direction in the drawing. On the other hand, when a force in the Y-axis direction is applied to the lens frame 214, the long hole 224 is guided by the roller 226, and the correction lens 212 moves in the Y-axis direction.

  A connecting frame 228 is fixed to the rod 216B of the X-axis linear motor 216. The connecting frame 228 is disposed along the Y-axis direction, and the upper end portion and the lower end portion thereof are supported by linear guides 230 and 230 so as to be slidable in the X-axis direction. The linear guides 230 and 230 are provided in parallel with the rod 216B. With this, when the rod 216B is expanded and contracted, the connecting frame 228 moves in parallel in the X-axis direction while maintaining its posture.

  The distal end of the detection contact needle 232B of the X-axis position sensor 232 attached to the main body frame 210 is pressed against the connection frame 228. The detection contact needle 232B is provided in parallel with the rod 216B, and the X-axis position sensor 232 detects the amount of movement of the connecting frame 228 that moves together with the rod 216B.

  In FIG. 4, reference numeral 234 denotes an X-axis speed generator, which includes a bobbin 234A and a core 234B. The core 234B of the X-axis speed generator 324 is fixed to the connecting frame 228.

  In FIG. 4, reference numeral 248 denotes an X-axis angular velocity sensor that is attached to the main body frame 210. The X-axis angular velocity sensor 248 detects the vibration of the X-axis direction component among the vibrations transmitted to the main body frame 210 (= vibration generated in the camera main body 12).

  The Y-axis linear motor 218 moves the correction lens 212 in the Y-axis direction (tilt direction), and includes a motor body 218A and a rod 218B. The motor main body 218 </ b> A is fixed to the main body frame 210, and the rod 218 </ b> B is engaged with a long hole 236 formed in the lens frame body 214 via a roller 238. The long hole 236 is formed along the X-axis direction, whereby the long hole 236 and the roller 238 are engaged with each other so as to be relatively movable in the X-axis direction.

  When the rod 218B is expanded and contracted by the driving force of the motor body 218A, the lens frame 214 is pushed by the rod 218B or pulled by the rod 218B and moves in the Y-axis direction.

  When a force in the X-axis direction is applied to the lens frame 214, the long hole 236 is guided by the roller 238, and the correction lens 212 moves in the X-axis direction.

  A connecting frame 240 is fixed to the rod 218B of the Y-axis linear motor 218. The connecting frame 240 is disposed along the X-axis direction, and the right end portion and the left end portion thereof are supported by linear guides 242 and 242 so as to be slidable in the X-axis direction. The linear guides 242 and 242 are provided in parallel with the rod 218B, so that when the rod 218B is expanded and contracted, the connecting frame 240 is translated in the Y-axis direction while maintaining its posture.

  The distal end of the detection contact needle 44 </ b> B of the Y-axis position sensor 244 attached to the main body frame 210 is pressed against the connection frame 240. The detection contact needle 244B is provided in parallel with the rod 218B, and the Y-axis position sensor 244 detects the amount of movement of the connecting frame 240 that moves in parallel by the expansion and contraction of the rod 218B.

  In FIG. 4, reference numeral 246 denotes a Y-axis speed generator 246, which includes a bobbin 246A and a core 246B. The core 246A of the Y-axis speed generator 246 is fixed to the connection frame 240.

  In FIG. 4, reference numeral 250 denotes a Y-axis angular velocity sensor that is attached to the main body frame 210. The Y-axis angular velocity sensor 250 detects the vibration of the Y-axis direction component among the vibrations transmitted to the main body frame 210 (= vibration generated in the camera main body 12).

  FIG. 5 is a block diagram showing a drive control system of the camera shake correction unit 206.

  Information on the angular velocities in the X-axis direction and the Y-axis direction detected by the X-axis angular velocity sensor 248 and the Y-axis angular velocity sensor 250 is output to the CPU 310 via the A / D converters 252 and 254, respectively.

  The CPU 310 calculates the correction movement amount in the X-axis direction to be given to the correction lens 212 based on the information on the angular velocity in the X-axis direction obtained from the X-axis angular velocity sensor 248, and the Y-axis direction obtained from the Y-axis angular velocity sensor 250. The correction movement amount in the Y-axis direction to be applied to the correction lens 212 is calculated based on the angular velocity information. Then, a signal (drive signal) indicating the obtained corrected movement amount in the X-axis direction is output to the X-axis drive circuit 260 via the D / A converter 256, and a signal indicating the corrected movement amount in the Y-axis direction is output to the D / A. The data is output to the Y-axis drive circuit 262 via the A converter 258.

  The X-axis drive circuit 260 drives and controls the X-axis linear motor 216 based on the given drive signal, and moves the correction lens 212 in a direction that prevents image blur in the X-axis direction. The X-axis drive circuit 260 is fed back the position of the correction lens 212 in the X-axis direction by the X-axis position sensor 232, and the X-axis drive circuit 260 performs feedback control to determine the position of the correction lens 212. The correction lens 212 is appropriately moved so that the correction movement amount instructed by the drive signal from the CPU 110 is obtained. Thereby, image blurring in the X-axis direction that occurs on the light receiving surface of the image sensor 134 is corrected.

  Similarly, the Y-axis drive circuit 262 controls the drive of the Y-axis linear motor 218 based on the given drive signal, and moves the correction lens 212 in a direction that prevents image blur in the Y-axis direction. The Y-axis drive circuit 262 feeds back the position of the correction lens 212 in the Y-axis direction by the Y-axis position sensor 244. The Y-axis drive circuit 262 performs feedback control so that the position of the correction lens 212 is adjusted. The correction lens 212 is appropriately moved so that the correction movement amount instructed by the drive signal from the CPU 110 is obtained. Thereby, image blurring in the Y-axis direction that occurs on the light receiving surface of the image sensor 134 is corrected.

  The detection results of the X-axis position sensor 232 and the Y-axis position sensor 244 are also output to the CPU 110 via A / D converters 264 and 266, respectively. The CPU 110 detects the position of the correction lens 212 based on outputs from the X-axis position sensor 232 and the Y-axis position sensor 244.

  The camera shake correction unit 206 is configured as described above. When camera shake is detected by the X-axis angular velocity sensor 248 and the Y-axis angular velocity sensor 250, the X-axis linear motor 216 and the Y-axis linear motor are based on the information. The image blur generated on the light receiving surface of the image sensor 134 is corrected by driving the 218.

  The image sensor 134 is configured by a honeycomb array color CCD, a Bayer CCD, a CMOS sensor, or the like. The CPU 110 drives the image sensor 134 via the image sensor control unit 136 and outputs a subject image captured through the photographing lens 14 as an image signal.

  The analog signal processing unit 138 performs correlated double sampling processing and amplifies the image signal output from the image sensor 134.

  The A / D converter 140 converts the analog image signals of R, G, and B colors output from the analog signal processing unit 138 into digital image signals.

  The digital signal processing unit 142 takes in image signals of R, G, and B colors output from the A / D converter 140 in accordance with a command from the CPU 110, performs predetermined signal processing, and performs luminance signal Y and color difference signal Cr. , Cb is generated.

  FIG. 6 is a block diagram showing a schematic configuration of the digital signal processing unit 142.

  As shown in the figure, the digital signal processing unit 142 includes a white balance gain calculation circuit 142a, an offset correction circuit 142b, a gain correction circuit 142c, a gamma correction circuit 142d, an RGB interpolation calculation unit 142e, an RGB / YC conversion circuit 142f, noise A filter 142g, a contour correction circuit 142h, a color difference matrix circuit 142i, and a light source type determination circuit 142j are provided.

  The white balance gain calculation circuit 142a takes in the integrated value calculated by the AE / AWB detection unit 146 and calculates a gain value for white balance adjustment.

  The offset correction circuit 142b takes in the image signals of R, G, and B colors output from the A / D converter 140 and performs offset processing.

  The gain correction circuit 142c takes in the image signal that has been subjected to the offset processing, and performs white balance adjustment using the gain value calculated by the white balance gain calculation circuit 142a.

  The gamma correction circuit 142d takes in an image signal that has undergone white balance adjustment, and performs gamma correction using a predetermined γ value.

  The RGB interpolation calculation unit 142e interpolates the gamma-corrected R, G, and B color signals to obtain R, G, and B3 color signals at each pixel position. That is, in the case of a single-plate image sensor, each pixel outputs only a signal of any one color of R, G, and B. Therefore, a color that is not output is obtained from the color signals of surrounding pixels by a complementary operation. For example, in a pixel that outputs R, the level of G and B color signals at this pixel position is determined by interpolation from the G and B signals of surrounding pixels. As described above, the RGB complementary calculation is peculiar to the single-plate image sensor, and thus is not necessary when a three-plate image sensor is used as the image sensor 134.

  The RGB / YC conversion circuit 142f generates a luminance signal Y and color difference signals Cr and Cb from the R, G, and B signals after the RGB interpolation calculation.

  The noise filter 142g performs noise reduction processing on the luminance signal Y and the color difference signals Cr and Cb generated by the RGB / YC conversion circuit 142f.

  The contour correction circuit 142h performs contour correction processing on the luminance signal Y after noise reduction, and outputs a luminance signal Y ′ whose contour has been corrected.

  On the other hand, the color difference matrix circuit 142i performs color correction by multiplying the color difference signals Cr and Cb after noise reduction by the color difference matrix (C-MTX). That is, the color difference matrix circuit 142i is provided with a plurality of types of color difference matrices corresponding to the light sources, and the color difference matrix to be used is switched according to the light source type obtained by the light source type determination circuit 142j. The input color difference signals Cr and Cb are multiplied, and color-tone-corrected color difference signals Cr ′ and Cb ′ are output.

  The light source type determination circuit 142j determines the light source type by taking in the integrated value calculated by the AE / AWB detection unit 146, and outputs a color difference matrix selection signal to the color difference matrix circuit 142i.

  In the digital camera of this embodiment, the digital signal processing unit is configured by a hardware circuit as described above, but the same function as that of the hardware circuit can be configured by software.

  The AF detection unit 144 captures R, G, and B color image signals output from the A / D converter 140 and calculates a focus evaluation value necessary for AF control. The AF detection unit 144 includes a high-pass filter that allows only a high-frequency component of the G signal to pass, an absolute value processing unit, a focus area extraction unit that extracts a signal within a predetermined focus area set on the screen, and a focus area An integration unit for integrating the absolute value data is included, and the absolute value data in the focus area integrated by the integration unit is output to the CPU 110 as a focus evaluation value.

  During the AF control, the CPU 110 searches for a position where the focus evaluation value output from the AF detection unit 144 is maximized, and moves the focus lens group 208 to the position, thereby performing focusing on the main subject. That is, during the AF control, the CPU 110 first moves the focus lens group 208 from the close range to the infinity, sequentially acquires the focus evaluation value from the AF detection unit 144 in the moving process, and the position where the focus evaluation value becomes maximum. Is detected. Then, the position where the detected focus evaluation value is maximum is determined as the in-focus position, and the focus lens group 208 is moved to that position. Thereby, the subject (main subject) located in the focus area is focused.

  If the position at which the focus evaluation value is maximum is not detected (for example, at low contrast), the CPU 110 determines that an AF error has occurred and issues a predetermined warning (for example, displaying an error message on the monitor 28).

  The AE / AWB detection unit 146 takes in the image signals of R, G, and B colors output from the A / D converter 140 and calculates integrated values necessary for AE control and AWB control. That is, the AE / AWB detection unit 146 divides one screen into a plurality of areas (for example, 8 × 8 = 64 areas), and calculates an integrated value of R, G, and B signals for each divided area.

  At the time of AE control, the CPU 110 acquires an integrated value of R, G, B signals for each area calculated by the AE / AWB detection unit 146, obtains the brightness (photometric value) of the subject, and obtains an appropriate exposure amount. Set the exposure to obtain That is, sensitivity, aperture value, shutter speed, and necessity of strobe light emission are set.

  In addition, during the AWB control, the CPU 110 calculates the integrated values of the R, G, and B signals for each area calculated by the AE / AWB detection unit 146, the white balance gain calculation circuit 142a and the light source type determination circuit 142j of the digital signal processing unit 142. Add to.

  The white balance gain calculation circuit 142a calculates a gain value for white balance adjustment based on the integrated value calculated by the AE / AWB detection unit 146.

  The light source type determination circuit 142j detects the light source type based on the integrated value calculated by the AE / AWB detection unit 146.

  The compression / decompression processing unit 148 performs compression processing in a predetermined format (for example, JPEG) on the input image data in accordance with a command from the CPU 110 to generate compressed image data. Further, in accordance with a command from the CPU 110, the input compressed image data is subjected to a decompression process in a predetermined format to generate uncompressed image data.

  The media controller 150 controls reading / writing of data with respect to the storage medium 152 in accordance with a command from the CPU 110. In the digital camera 10 of the present embodiment, a memory card is used as the storage medium 152, and the memory card is detachably loaded in a media slot provided in the camera body 12. However, it may be recorded in the built-in memory.

  The display control unit 154 controls display on the monitor 28 in accordance with a command from the CPU 110. That is, in accordance with a command from the CPU 110, the input image signal is converted into a video signal (for example, NTSC signal, PAL signal, SCAM signal) for display on the monitor 28 and output to the monitor 28. The graphic information is output to the monitor 28.

  The strobe control circuit 156 controls the light emission of the strobe 158 in accordance with a command from the CPU 110.

  The face detection unit 160 detects a face included in the image from the input image data in accordance with a command from the CPU 110. In this face detection, for example, a template image having a plurality of face shapes is prepared, a correlation between the template image and the image is calculated, and a human face is detected by using the correlation value as a face candidate region.

  Hereinafter, a face detection method using this template image will be described.

  As shown in FIG. 7, the template image is for detecting a correlation value with an image (detection target image) from which a face image is to be detected, and is stored in the ROM 116.

  While the template image scans the detection target image, the correlation value at each position is detected, and the detected correlation value is compared with the threshold value. The position of the search window when the coefficient value is equal to or greater than the threshold value is determined as the position of the face image in the detection target image.

  First, when a detection target image is obtained, a search window is defined. The search window has a rectangular shape and is the same size as the template image.

  The normalized cross-correlation coefficient r between the image in the search window and the template image is expressed by the following equation [r = {<T · I> − <T> · <I>} / {□ (t) · □ (I) }: Where T is the template image, I is the image in the search window, <> is the average of those enclosed in <and>, and □ represents the standard deviation] Are compared. As described above, the position of the search window when the coefficient value is equal to or greater than the threshold is determined as the position of the face image in the detection target image.

  The search window is moved within the detection target image by a small distance in the horizontal direction and the vertical direction, and the normalized cross-correlation coefficient is calculated again at the position after the movement. The movement of the search window is repeated, and the normalized cross-correlation coefficient calculation process at the position after the movement is performed. A face image portion (face region) in the target image is detected based on the obtained normalized cross-correlation coefficient.

  As described above, face detection is performed. Note that the method for detecting a face from an image is not limited to this. In addition, for example, skin color data is extracted from the original image, and a cluster of photometric points determined to be in the skin color range is extracted as a face, or photometric data is converted into hue and saturation, and the converted hue / saturation is converted. A method for judging a face area by creating and analyzing a two-dimensional histogram, a method for extracting a face candidate area corresponding to the shape of a human face, and determining a face area from features in the area, from an image Methods for extracting the outline of a human face and determining a face area are known, and can be detected using these methods.

  When the face detection function is turned on, the CPU 110 adds an image (for example, an image for a through image) obtained from the image sensor 134 before the actual photographing to the face detection unit 160, and performs face detection processing. Then, AF control is performed so that the detected face is in focus, and AE control is performed so that the face has appropriate brightness. In addition, image processing suitable for a person image is performed on an image obtained by shooting.

  The digital camera 10 of the present embodiment is configured as described above.

  Next, photographing and recording processing operations by the digital camera 10 of the present embodiment configured as described above will be described.

  Shooting is performed by setting the mode of the digital camera 10 to the shooting mode. The shooting mode is set by pressing the power button 26 while the power is off. Alternatively, it is performed by pressing the shutter button 22 in the playback mode.

  When the mode of the digital camera 10 is set to the shooting mode, first, an image captured by the image sensor 134 is displayed through on the monitor 28. That is, images are continuously picked up by the image pickup device 134, and the images are continuously processed to generate image data for through images. The generated image data is sequentially added to the display control unit 154 via the VRAM 122, converted into a display signal format, and output to the monitor 28. As a result, the image captured by the image sensor 134 is displayed through on the monitor 28. The photographer determines the composition by looking at the through image displayed on the monitor 28 and presses the shutter button 22 halfway.

  When the shutter button 22 is half-pressed, an S1 ON signal is input to the CPU 110. In response to the input of the S1 ON signal, the CPU 110 executes shooting preparation processing, that is, AE, AF, and AWB processing.

  First, the image signal output from the image sensor 134 is added to the AE / AWB detection unit 146 and the AF detection unit 144 via the analog signal processing unit 138 and the A / D converter 140.

  The AE / AWB detection unit 146 calculates an integrated value necessary for AE control and AWB control from the input image signal, and outputs the integrated value to the CPU 110. The CPU 110 calculates subject brightness based on the integrated value obtained from the AE / AWB detection unit 146, and determines sensitivity, aperture value, shutter speed, and the like for obtaining proper exposure. The integrated value obtained from the AE / AWB detection unit 146 is added to the digital signal processing unit 142 for white balance correction.

  In addition, the AF detection unit 144 calculates an integrated value necessary for AF control from the input image signal and outputs it to the CPU 110. The CPU 110 controls the movement of the focus lens group 208 via the focus motor control unit 209 based on the output from the AF detection unit 144, and focuses the photographing lens 14 on the main subject.

  The photographer looks at the through image displayed on the monitor 28, confirms the focus state and the like, and instructs the execution of photographing. That is, the shutter button 22 is fully pressed.

  When the shutter button 22 is fully pressed, an S2 ON signal is input to the CPU 110. In response to the S2 ON signal, the CPU 110 executes the main photographing process.

  First, the image sensor 134 is exposed with the sensitivity, aperture value, and shutter speed obtained as a result of the AE control, and a recording image is captured.

  The recording image signal output from the image sensor 134 is added to the digital signal processing unit 142 via the analog signal processing unit 138 and the A / D converter 140. The digital signal processing unit 142 performs predetermined signal processing on the input image signal to generate image data (YUV data) including the luminance data Y and the color difference data Cr and Cb.

  The generated image data is added to the compression / decompression processing unit 148, subjected to predetermined compression processing, and then stored in the memory 120. The CPU 110 records the compressed image data stored in the memory 120 as a still image file (for example, Exif) in a predetermined format on the memory card 152 via the media controller 150.

  The image recorded on the memory card 152 as described above is reproduced and displayed on the monitor 28 by setting the mode of the digital camera 10 to the reproduction mode. That is, when the playback button 32 is pressed and the mode of the digital camera 10 is set to the playback mode, the CPU 110 stores the compressed image data of the image file last recorded on the memory card 152 via the media controller 150. read out.

  The compressed image data read from the memory card 152 is added to the compression / decompression processing unit 148, converted into non-compressed image data, and then added to the VRAM 122. Then, the data is output from the VRAM 122 to the monitor 28 via the display control unit 154. As a result, the image recorded on the memory card 152 is reproduced and displayed on the monitor 28.

  The frame advance of the image is performed by the right key and the left key of the cross button 36. When the right key is pressed, the next image is read from the memory card 152 and reproduced and displayed on the monitor 28. When the left key is pressed, the previous image is read from the memory card 152 and reproduced and displayed on the monitor 28.

  As described above, the digital camera 10 according to the present embodiment records an image by setting the camera mode to the shooting mode and pressing the shutter button 22 fully. The recorded image is reproduced and displayed on the monitor 28 by setting the camera mode to the reproduction mode.

  By the way, the digital camera 10 according to the present embodiment is provided with a camera shake correction function and a face detection function. When the camera shake correction function is turned on, correction is performed in a direction to cancel the vibration generated in the camera body 12. The lens 212 is driven, and the image blur generated on the imaging surface of the image sensor 134 is corrected. When the face detection function is turned on, the face of a person on the screen is detected, AF control is performed so that the detected face is in focus, and the detected face becomes appropriate brightness. AE control is performed.

  However, since the camera shake correction function has a time lag from when it is turned on until the image is actually stabilized, if face detection is performed during that time, the accuracy of face detection decreases.

  Therefore, in the digital camera 10 of the present embodiment, when the face detection function and the camera shake correction function are turned ON, the face detection process is started after the image is stabilized by the camera shake correction function.

  FIG. 8 is a flowchart illustrating a procedure of face detection processing when the camera shake correction function is turned on.

  When the power of the digital camera is turned on (step S10), first, the CPU 110 performs centering processing of the correction lens 212 (step S11). That is, the driving of the X-axis linear motor 216 and the Y-axis linear motor 218 is controlled via the camera shake correction control unit 207, and the center of the correction lens 212 is positioned on the optical axis L.

  Next, the CPU 110 determines whether or not the face detection function is set to ON (step S12). As described above, if the digital camera 10 is turned off while the face detection function is set to ON, the next time the power is turned on, the face detection function is activated and the face detection function is turned off. If the power is turned off while the power is turned on, the face detection function is activated with the power turned off the next time the power is turned on. The ON / OFF setting state of the face detection function is recorded in the flash ROM 118, and the CPU 110 determines whether or not the face detection function is set to ON based on the information recorded in the flash ROM 118.

  If it is determined that the face detection function is set to ON, the CPU 110 determines whether or not the camera shake correction function is turned on (step S13). This camera shake correction function is also set to the state at the end of the previous time similarly to the face detection function. In other words, if the camera is turned off with the camera shake correction function set to ON, the camera shake correction function will be activated with the camera shake correction function set to OFF when the power is turned on next time. Then, when the power is turned on next time, the camera shake correction function is started in a state set to OFF. The setting state of ON / OFF of the camera shake correction function is recorded in the flash ROM 118 similarly to the setting state of the face detection function, and the CPU 110 performs the camera shake correction function based on the information recorded in the flash ROM 118. It is determined whether or not it is set to ON.

  In this determination, if it is determined that the camera shake correction function is set to OFF, the CPU 110 starts the face detection process as it is (step S14). That is, an image obtained from the image sensor 134 is added to the face detection unit 160 to perform face detection processing. Then, it is determined whether or not a face has been detected as a result of the face detection process (step S15). If it is determined that a face has been detected, the process ends. If it is determined that no face is detected, the process returns to step S14, and the face detection process is performed again.

  On the other hand, when determining in step S12 that the camera shake correction function is set to ON, the CPU 110 starts camera shake correction processing (step S16). That is, camera shake is detected by the X-axis angular velocity sensor 248 and the Y-axis angular velocity sensor 250, and the X-axis linear motor 216 and the Y-axis linear motor 218 are driven based on the information, and are generated on the light receiving surface of the image sensor 134. Correct image blur.

  Simultaneously with the start of the camera shake correction process, the CPU 110 determines whether or not the correction lens 212 is located at a certain position based on the position information of the correction lens 212 obtained from the X-axis position sensor 232 and the Y-axis position sensor 244. (Step S17). When it is determined that the correction lens 212 is located at a certain position, the face detection process is started (step S18). That is, when the correction lens 212 is located at a certain position, it is determined that the camera shake correction process is complete (the image is stable), and the face detection process is started. Accordingly, it is possible to prevent the face detection process from being performed and the face detection accuracy from being lowered before the camera shake correction is completed.

  Even after the start of the face detection process, the CPU 110 determines whether or not the correction lens 212 is located at a certain position based on the position information of the correction lens 212 obtained from the X-axis position sensor 232 and the Y-axis position sensor 244 ( Step S19). If it is determined that the face is not located at a certain position, the face detection process is stopped (step S20).

  As described above, the face detection process is performed only when the correction lens 212 is positioned at a constant value, and when the correction lens 212 is not positioned at the fixed value, the face detection process is stopped. Accordingly, it is possible to prevent the face detection process from being performed based on the blurred image during the camera shake correction operation, and it is possible to prevent the face detection accuracy from being lowered.

  In step S19, when it is determined that the correction lens 212 is located at a certain position and the face detection process is continued, the CPU 110 determines whether or not a face has been detected from the result of the face detection process. Determination is made (step S21). If it is determined that a face is detected, the process ends. If it is determined that no face is detected, the process returns to step S18 to perform face detection processing again.

  As described above, in the digital camera 10 according to the present embodiment, when the face detection function and the camera shake correction function are turned on, the digital camera 10 waits until the correction lens 212 of the camera shake correction unit 206 is positioned at a certain position. Perform detection processing. Accordingly, it is possible to prevent the face detection process from being performed based on the blurred image during the camera shake correction operation, and it is possible to prevent the face detection accuracy from being lowered.

  In this embodiment, the case where the face detection function and the camera shake correction function are simultaneously turned on at the time of startup has been described. However, the correction lens 212 is constant even when the camera shake correction function is turned on after the face detection function is turned on. The face detection process is performed after waiting for the position.

  FIG. 9 is a flowchart showing the procedure of face detection processing when the camera shake correction function is turned on after the face detection function is turned on.

  The CPU 110 determines whether or not the face detection function is set to ON (step S30). When the CPU 110 determines that the face detection function is set to ON, the CPU 110 starts face detection processing (step S31). Then, it is determined whether or not a face has been detected from the detection result (step S32), and if it is determined that a face has been detected, the process ends.

  On the other hand, if it is determined that no face is detected, it is determined whether or not the camera shake correction function is turned on (step S33).

  If it is determined that the camera shake correction function is not turned on, the CPU 110 returns to step S31 and performs face detection processing again.

  On the other hand, when determining that the camera shake correction function is turned on, the CPU 110 temporarily stops the face detection process (step S34). Then, the camera shake correction process is started (step S35). Accordingly, it is possible to prevent the face detection process from being performed based on the blurred image during the camera shake correction operation, and it is possible to prevent the face detection accuracy from being lowered.

  Simultaneously with the start of the camera shake correction process, the CPU 110 determines whether or not the correction lens 212 is located at a certain position based on the position information of the correction lens 212 obtained from the X-axis position sensor 232 and the Y-axis position sensor 244. (Step S36). When it is determined that the correction lens 212 is located at a certain position, the face detection process is resumed (step S37).

  Even after resuming the face detection process, the CPU 110 determines whether or not the correction lens 212 is located at a certain position based on the position information of the correction lens 212 obtained from the X-axis position sensor 232 and the Y-axis position sensor 244 (step S38). If it is determined that the face is not located at a certain position, the face detection process is stopped again (step S39).

  As described above, the face detection process is performed only when the correction lens 212 is positioned at a constant value, and when the correction lens 212 is not positioned at the fixed value, the face detection process is stopped. Accordingly, it is possible to prevent the face detection process from being performed based on the blurred image during the camera shake correction operation, and it is possible to prevent the face detection accuracy from being lowered.

  When it is determined in step S38 that the correction lens 212 is located at a certain position and the face detection process is continued, the CPU 110 determines whether or not a face has been detected from the result of the face detection process. Determine (step S40). If it is determined that a face is detected, the process ends. If it is determined that no face is detected, the process returns to step S37 to perform face detection again.

  As described above, even when the camera shake correction function is turned on after the face detection function is turned on, the face detection process is performed after the correction lens 212 is positioned at a certain position. Accordingly, it is possible to prevent the face detection process from being performed based on the blurred image during the camera shake correction operation, and it is possible to prevent the face detection accuracy from being lowered.

  In the above embodiment, it is determined that the image is stable when the correction lens 212 is positioned at a certain position. However, the method for detecting that the image is stable is not limited to this. . For example, a motion vector of an image may be detected, and if no motion is detected, it may be determined that the image is stable.

  FIG. 10 is a block diagram showing an electrical configuration of the digital camera 10A when the motion vector is detected to execute / stop the face detection process.

  3 is different from the digital camera 10 shown in FIG. 3 in that a motion vector detection unit 162 is provided.

  The motion vector detection unit 162 detects a motion vector representing the motion between fields of the image acquired by the image sensor 134 based on a command from the CPU 110. As a motion vector detection method, for example, a known method such as a spatiotemporal gradient method or a block matching method can be used. The CPU 110 determines whether or not the image is stabilized based on the motion vector detected by the motion vector detection unit 162.

  FIG. 11 is a flowchart illustrating a procedure of face detection processing when the camera shake correction function is turned on.

  When the power of the digital camera is turned on (step S50), first, the CPU 110 performs centering processing of the correction lens 212 (step S51).

  Next, the CPU 110 determines whether or not the face detection function is set to ON (step S52).

  If it is determined that the face detection function is set to ON, the CPU 110 determines whether or not the camera shake correction function is turned on (step S53).

  If it is determined in this determination that the camera shake correction function is set to OFF, the CPU 110 starts the face detection process as it is (step S54), and determines whether or not a face has been detected from the detection result (step S54). S55). If it is determined that a face is detected, the process ends. If it is determined that a face is not detected, the process returns to step S54, and the face detection process is performed again.

  On the other hand, when determining that the camera shake correction function is set to ON, the CPU 110 starts camera shake correction processing (step S56). At the same time, the CPU 110 starts detecting a motion vector at the motion vector detecting unit 162 (step S57). Then, the presence or absence of motion is determined based on the detection result of the motion vector detection unit 162 (step S58).

  If it is determined that there is no movement in this determination, the CPU 110 determines that the image is stable and starts face detection processing (step S59). Accordingly, it is possible to prevent the face detection process from being performed based on the blurred image during the correction operation, and it is possible to prevent the face detection accuracy from being lowered.

  Even after the start of the face detection process, the CPU 110 detects the motion vector of the image by the motion vector detection unit 162 (step S60), and determines the presence or absence of motion based on the detection result (step S61). If it is determined that there is a motion, the face detection process is stopped (step S62).

  As described above, the face detection process is performed only when there is no image movement, and when there is a movement, the face detection process is stopped. Accordingly, it is possible to prevent the face detection process from being performed based on the blurred image during the camera shake correction operation, and it is possible to prevent the face detection accuracy from being lowered.

  If it is determined in step S61 that there is no movement and the face detection process is continued, the CPU 110 determines whether or not a face has been detected from the result of the face detection process (step S63). If it is determined that a face has been detected, the process ends. If it is determined that no face has been detected, the process returns to step S60 and the face detection process is performed again.

  As described above, a motion vector may be detected, and if no motion is detected, it may be determined that the image is stable and face detection may be performed. Accordingly, it is possible to prevent the face detection process from being performed based on the blurred image during the camera shake correction operation, and it is possible to prevent the face detection accuracy from being lowered.

  In the above example, the case where the face detection function and the camera shake correction function are simultaneously turned on at the time of startup has been described. However, even when the camera shake correction function is turned on after the face detection function is turned on, no motion is detected. Wait for the face detection process.

  FIG. 12 is a flowchart showing the procedure of face detection processing when the camera shake correction function is turned on after the face detection function is turned on.

  The CPU 110 determines whether or not the face detection function is set to ON (step S70). When the CPU 110 determines that the face detection function is set to ON, the CPU 110 starts face detection processing (step S71). Then, it is determined whether or not a face has been detected from the detection result (step S72). If it is determined that a face has been detected, the process ends.

  On the other hand, if it is determined that no face is detected, it is determined whether or not the camera shake correction function is turned on (step S73).

  If it is determined that the camera shake correction function is not turned on, the CPU 110 returns to step S71 and performs face detection processing again.

  On the other hand, when determining that the camera shake correction function is turned on, the CPU 110 temporarily stops the face detection process (step S74). Then, the camera shake correction process is started (step S75). Accordingly, it is possible to prevent the face detection process from being performed based on the blurred image during the camera shake correction operation, and it is possible to prevent the face detection accuracy from being lowered.

  Simultaneously with the start of the camera shake correction process, the CPU 110 detects a motion vector with the motion vector detection unit 162 (step S76), and determines the presence or absence of motion (step S77). If it is determined that there is no movement, the face detection process is resumed (step S78).

  Even after resuming the face detection process, the CPU 110 detects a motion vector with the motion vector detection unit 162 (step S79) and determines the presence or absence of motion (step S80). If it is determined that there is a motion, the face detection process is stopped again (step S81). Accordingly, it is possible to prevent the face detection process from being performed based on the blurred image during the camera shake correction operation, and it is possible to prevent the face detection accuracy from being lowered.

  When the face detection process is stopped, the process returns to step S79, and the motion vector detection unit 162 detects the motion vector again (step S79), and determines the presence or absence of motion (step S80).

  As described above, the face detection process is performed only when there is no motion of the image, that is, when the image is stable, and it is determined from the result of the detection process whether or not the face is detected (step S82). If it is determined that a face is detected, the process ends. If it is determined that no face is detected, the process returns to step S78, and the face detection process is performed again.

  As described above, even when the camera shake correction function is turned on after the face detection function is turned on, the motion vector of the image is detected, and the face detection process is performed after the motion disappears. Accordingly, it is possible to prevent the face detection process from being performed based on the blurred image during the camera shake correction operation, and it is possible to prevent the face detection accuracy from being lowered.

  In the digital camera of the above embodiment, the centering process of the correction lens 212 is performed when the power is turned on, but the camera shake correction unit 206 includes a holding mechanism for holding the correction lens 212 on the optical axis. Therefore, this process becomes unnecessary. Alternatively, even when the power is turned off, this process becomes unnecessary by using an actuator that can hold the correction lens 212 on the optical axis.

  However, when the correction lens 212 cannot be held on the optical axis when the power is turned off, the correction lens 212 needs to be centered at the same time as the power is turned on, as in the digital camera of the above embodiment.

  In this case, if the face detection process is performed during the centering process, the face detection process is performed based on the blurred image, and the face detection accuracy is significantly reduced.

  Therefore, when face detection processing is performed in the case of a digital camera that requires centering of the correction lens, it is preferable to start the face detection processing after completion of centering.

  FIG. 13 is a flowchart illustrating a processing procedure when face detection processing is performed by a digital camera that requires centering of the correction lens.

  When the power of the digital camera is turned on (step S90), the CPU 110 performs centering processing of the correction lens 212 (step S91). Then, based on the positional information of the correction lens 212 obtained from the X-axis position sensor 232 and the Y-axis position sensor 244, whether or not the centering of the correction lens 212 is completed, that is, the center of the correction lens 212 is on the optical axis L. It is determined whether or not it is positioned (step S92).

  If it is determined that centering of the correction lens 212 has been completed, the CPU 110 determines whether or not the face detection function is set to ON (step S93). If it is determined that the face detection function is set to ON, face detection processing is started (step S94). Thereafter, it is determined whether or not a face has been detected from the result of the face detection process (step S95). If it is determined that a face has been detected, the process ends.

  Thus, in the case of a digital camera that requires centering of the correction lens, the face detection process is started after the centering of the correction lens is completed. Thereby, the face detection process is performed based on the blurred image during the centering operation, and it is possible to effectively prevent the face detection accuracy from being lowered.

  When face detection processing is performed with a camera that automatically focuses on the main subject when the power is turned on, the face detection processing may be started after the main subject is in focus.

  When the power is turned on, when the face detection process is performed with a camera in which the zoom lens group automatically moves to the zoom position at the end of the previous shooting, the zoom lens group moves to the zoom position at the end of the previous shadow. The face detection process may be started after waiting.

  In general, the photographing lens of a compact digital camera automatically retracts to a predetermined storage position when the power is turned off, and moves to a predetermined photographing standby position when the power is turned on. When face detection processing is performed by a camera using a lens, the face detection processing may be started after the photographing lens moves to the photographing standby position.

  By performing such processing, it is possible to effectively prevent a reduction in face detection accuracy.

  In addition, since an image flows when an abrupt angle-of-view changing operation such as panning or tilting is performed, it is preferable to stop the face detection process even in such a case. That is, during the face detection process, a pan / tilt operation is detected, and when a pan / tilt operation is detected, the face detection process is stopped.

  Hereinafter, a process in the case of detecting the pan / tilde operation and stopping the face detection process will be described.

  FIG. 14 is a block diagram showing a drive control system of a camera shake correction unit 206A having a pan / tilt motion detection mechanism.

  This is different from the drive control system of the camera shake correction unit 206 shown in FIG. 5 in that it includes a panning detection unit 270 and a tilting detection unit 272.

  Information on angular velocities in the X-axis direction (pan direction) and Y-axis direction (tilt direction) detected by the X-axis angular velocity sensor 248 and the Y-axis angular velocity sensor 250 is detected by panning via A / D converters 252 and 254, respectively. Input to the unit 270 and the tilting detection unit 272.

  The panning detection unit 270 detects the start and end of the panning operation based on the input angular velocity information in the X-axis direction, and outputs the detection result to the CPU 110.

  The tilting detection unit 272 detects the start and end of the tilting operation based on the input angular velocity information in the Y-axis direction, and outputs the detection result to the CPU 110.

  When the panning / tilting operation is detected by the panning detection unit 270 and the tilting detection unit 272, the CPU 110 stops the face detection process.

  FIG. 15 is a flowchart illustrating a processing procedure when performing / stopping the face detection processing according to the pan / tilt operation.

  When the power of the digital camera is turned on (step S100), first, the CPU 110 performs centering processing of the correction lens 212 (step S101).

  Next, the CPU 110 determines whether or not the face detection function is set to ON (step S102).

  If it is determined that the face detection function is set to ON, the CPU 110 detects the pan / tilt operation by the panning detection unit 270 and the tilting detection unit 272 (step S103). Then, it is determined whether panning or tilting is performed based on the detection result of the pan / tilt operation (step 104).

  If it is determined in this determination that the panning or tilting operation has not been performed, the CPU 110 starts a face detection process (step S105).

  On the other hand, if it is determined that the panning or tilting operation is being performed, the process returns to step S103 to detect the pan / tilt operation again. That is, the pan / tilt motion detection process is repeatedly performed until no panning or tilting motion is detected.

  When the panning or tilting operation is not performed and the face detection process is started, the CPU 110 detects the pan / tilt operation again by the panning detection unit 270 and the tilting detection unit 272 (step S106). Then, it is determined whether panning or tilting is performed based on the detection result of the pan / tilt operation (step 107).

  If it is determined that the panning or tilting operation is being performed in this determination, the CPU 110 stops the face detection process (step S108). If the face detection process is stopped, the process returns to step S106 to detect the pan / tilt operation again. That is, the face detection process is stopped until no panning or tilting operation is detected.

  On the other hand, when determining that the panning or tilting operation is not performed, the CPU 110 determines whether or not a face has been detected from the result of the face detection process (step S109). If it is determined that a face has been detected, the process ends.

  As described above, when performing the face detection process, the pan / tilt operation is detected. When the pan / tilt operation is detected, the face detection process is stopped, and the face detection process is stopped. The detection process can be prevented from being performed, and the face detection accuracy can be prevented from being lowered. In particular, when face detection is performed based on a through image, the panning / tilting operation makes it easier for the image to flow when the pan / tilt operation is performed due to the limitation of the shutter speed (1/60 sec), and the present invention works particularly effectively.

  In the above example, a case where pan / tilt operation is detected separately from camera shake correction and face detection processing is executed / stopped based on the detection result has been described as an example. The face detection process may be executed / stopped based on the detection result of the pan / tilt operation detected in step. In this case, as described in the above embodiment, the presence or absence of blurring of the image is detected, and when the image is not stable, the face detection process is stopped. As a result, the face detection accuracy can be further improved.

  Further, the panning and tilting detection methods are not limited to those in the above embodiment, and other known detection methods may be used.

  In the above-described series of embodiments, the case of detecting a human face has been described as an example. However, the detection target is not limited to this, and the present invention is also applied to the case of detecting other subjects. can do.

  In the digital camera of the above embodiment, the face detection function can be arbitrarily switched ON / OFF, but face detection may always be performed. Similarly, camera shake correction may always be performed.

  In the case of always detecting a face, if a person shooting mode (mode for performing image processing suitable for person shooting) is prepared, the mode is set to the person shooting mode and other modes are set. It is preferable to change the threshold value used for the detection of the face image depending on the case where it is set. That is, when the person photographing mode is set, the probability that the subject is included in the subject is high, so the threshold used for detecting the face is set high. As a result, the face can be detected with higher accuracy.

  Further, when a mode other than the portrait shooting mode is set, the face detection process may be automatically stopped. Thereby, useless processing can be omitted.

  In the above-described embodiment, as a camera shake correction method, a method of moving a part of the photographing lens is employed, but the camera shake correction method is not limited to this. For example, the image sensor 134 is held so as to be movable in the X-axis direction and the UY-axis direction within a plane orthogonal to the optical axis L, and the image sensor 134 is moved in a direction to cancel the blur, thereby correcting image blur generated on the light receiving surface. You may make it do.

  Further, in the above series of embodiments, the case where the present invention is applied to a digital camera has been described as an example. However, the application of the present invention is not limited to this, and in addition to a digital video camera, a camera-equipped mobile phone. The present invention can be similarly applied to a device having a camera function such as a telephone.

The front perspective view which shows the external appearance structure of the digital camera to which this invention was applied The rear perspective view showing the appearance composition of the digital camera to which the present invention is applied Block diagram showing the electrical configuration of the digital camera Front view showing schematic configuration of camera shake correction unit Block diagram showing drive control system of camera shake correction unit Block diagram showing schematic configuration of digital signal processor Explanatory diagram of face detection method using template image Flowchart showing the procedure of face detection processing when the camera shake correction function is turned on Flowchart showing the procedure of face detection processing when the camera shake correction function is turned on after the face detection function is turned on A block diagram showing an electrical configuration of a digital camera when a motion vector is detected to execute / stop a face detection process Flowchart showing the procedure of face detection processing when the camera shake correction function is turned on Flowchart showing the procedure of face detection processing when the camera shake correction function is turned on after the face detection function is turned on A flowchart showing a processing procedure when face detection processing is performed by a digital camera that requires centering of a correction lens. Block diagram showing a drive control system of a camera shake correction unit having a pan / tilt motion detection mechanism The flowchart which shows the procedure of the process in the case of performing / stopping face detection processing according to pan / tilt operation

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Digital camera, 14 ... Shooting lens, 28 ... Monitor, 34 ... Camera shake correction button, 42 ... Face detection button, 110 ... CPU, 112 ... Operation part, 203 ... Zoom control part, 204 ... Aperture / shutter control part, 207: Camera shake correction control unit, 209: Focus motor control unit, 134: Image sensor, 138: Analog signal processing unit, 142: Digital signal processing unit, 144: AF detection unit, 146: AE / AWB detection unit, 148 ... Compression / decompression processing unit, 150 ... media controller, 152 ... storage medium, 202 ... zoom lens group, 204 ... aperture / shutter unit, 206 ... camera shake correction unit, 208 ... focus lens group, 210 ... body frame, 212 ... correction lens , 214 ... Lens frame, 216 ... X-axis linear motor, 218 ... Y-axis linear motor, 2 2 ... X-axis position sensor, 244 ... Y-axis position sensor, 248 ... X-axis angular velocity sensor, 250 ... Y-axis angular velocity sensor, 260 ... X-axis drive circuit, 262 ... Y-axis drive circuit, 270 ... Panning detector, 272 ... Tilting detector

Claims (6)

In an imaging apparatus provided with subject detection means for detecting a specific subject from an image obtained from an imaging element via a photographing lens,
Means for switching ON / OFF of the subject detection function;
Detecting means for detecting the presence or absence of blurring of an image formed on the light receiving surface of the image sensor;
When the subject detection function is turned on, subject detection processing is started. On the other hand, when image blur is detected by the detection means, the subject detection processing is stopped and image blur is not detected by the detection means. Control means for controlling the subject detection means so as to restart the subject detection processing ;
An imaging apparatus comprising:   2. The detection unit according to claim 1, wherein the detection unit detects a motion vector of an image obtained from the image sensor and detects presence or absence of blurring of an image formed on a light receiving surface of the image sensor. Imaging device. Device is moved partially or imaging element in a direction to the photographing lens to cancel out the shake occurring in the body have a shake correction means for correcting the blur of the image formed on the light receiving surface of the imaging device, the detecting device The presence or absence of blurring of an image formed on the light receiving surface of the image sensor is detected by detecting that a part of the photographing lens or the image sensor is located at a certain position. 2. The imaging device according to 2. A blur correction unit that corrects a blur of an image formed on the light receiving surface of the image sensor by moving a part of the photographing lens or the image sensor in a direction to cancel the blur generated in the apparatus main body, and obtained from the image sensor In an imaging apparatus comprising subject detection means for detecting a specific subject from an image,
Means for switching ON / OFF of the subject detection function;
Detecting means for detecting the presence or absence of blurring of an image formed on the light receiving surface of the image sensor;
Switching means for switching ON / OFF of blur correction by the blur correction means;
Detecting means for detecting completion of a centering operation of a part of the photographing lens or the image sensor performed by the blur correction means when the blur correction is switched from OFF to ON by the switching means;
When the subject detection function is turned on, the subject detection process is started. On the other hand, when the blur correction is switched from OFF to ON by the switching unit, subject detection processing is performed until the detection unit detects completion of the centering operation. The subject detection means is controlled so as to be stopped, and subject detection processing is stopped when image blur is detected by the detection means, and subject detection processing is stopped when image blur is no longer detected by the detection means. Control means for controlling the subject detection means so as to resume
An imaging apparatus comprising: A blur correction unit that corrects a blur of an image formed on the light receiving surface of the image sensor by moving a part of the photographing lens or the image sensor in a direction to cancel the blur generated in the apparatus main body, and obtained from the image sensor In an imaging apparatus comprising subject detection means for detecting a specific subject from an image,
Means for switching ON / OFF of the subject detection function;
Switching means for switching ON / OFF of blur correction by the blur correction means;
First detection means for detecting a pan and / or tilt operation;
Second detection means for detecting the presence or absence of blurring of an image formed on the light receiving surface of the image sensor;
When the subject detection function is turned on, the subject detection process is started. On the other hand, when the pan and / or tilt operation is detected by the first detection unit, the subject detection process is stopped and the first detection unit is started. When the panning and / or tilting operation is no longer detected, the subject detection unit is controlled to resume the subject detection processing, and the subject detection processing is performed when image blur is detected by the second detection unit. Control means for controlling the subject detection means so as to resume the subject detection processing when the second detection means stops detecting an image blur , and
An imaging apparatus comprising: A blur correction unit that corrects a blur of an image formed on the light receiving surface of the image sensor by moving a part of the photographing lens or the image sensor in a direction to cancel the blur generated in the apparatus main body, and obtained from the image sensor In an imaging apparatus comprising subject detection means for detecting a specific subject from an image,
Means for switching ON / OFF of the subject detection function;
Switching means for switching ON / OFF of blur correction by the blur correction means;
First detection means for detecting a pan and / or tilt operation;
Second detection means for detecting the presence or absence of blurring of an image formed on the light receiving surface of the image sensor;
When the subject detection function is turned on, the subject detection process is started. On the other hand, when the blur correction is switched from OFF to ON by the switching unit, subject detection processing is performed until the detection unit detects completion of the centering operation. When the subject detection unit is controlled to be stopped and the pan and / or tilt operation is detected by the first detection unit, the subject detection process is stopped and the first detection unit performs panning and panning. When the tilt operation is no longer detected, the subject detection unit is controlled to resume the subject detection process, and when the image blur is detected by the second detection unit, the subject detection process is stopped, Control means for controlling the subject detection means to resume subject detection processing when image blur is no longer detected by the second detection means;
An imaging apparatus comprising:

Images