JP2024145730A - Image capture device, image capture device control method and program - Google Patents

Abstract

To provide an imaging apparatus, a method for controlling the imaging apparatus, and a program, capable of displaying any other object than a face in an easily confirmable way, when any other object than the face is included in an image displayed on a display part.SOLUTION: A digital camera 100 includes an imaging part 106 for capturing the image, a subject recognition part 128 for detecting a subject including the face and any other object than the face from the image obtained by capturing by the imaging part 106, and a system control part 101 for controlling so as to display the image captured by the imaging part 106 on the display part in either one of a first display state where the image is displayed as a first live view image or in a second display state where a second live view image obtained by turning the first live view image right-side left is displayed. When any other object than the face detected by the subject recognition part 128 becomes an AF target during the display of the image in the second display state, the system control part 101 controls so as to switch to the first display state.SELECTED DRAWING: Figure 4B

Description

The present invention relates to an imaging device, a control method for an imaging device, and a program.

In recent years, video posting sites have become widespread. These video posting sites have provided more opportunities for people to publish video content that they have personally shot. In addition to video content that they have personally shot, videos that review products such as cosmetics may also be published on video posting sites. Some cameras have a shooting mode suitable for product reviews (hereinafter referred to as "product review mode"). When a single person shoots a product review video and performs the video, the camera fixed to a tripod or the like is pointed toward the performer, i.e., the person who shot the video, and the monitor of the camera is also rotated to face the performer and shoot the video. This allows the performer to check the review video on the monitor. In addition, the monitor generally displays the review video in a mirror image that is reversed from left to right so that the performer's own movements displayed on the monitor do not appear strange. For example, Patent Document 1 discloses a configuration in which the display of an image on a display panel is switched between a normal display (normal image display) and a mirror image display that is reversed from the normal display to the mirror image display. When the display panel is used as a hand mirror, it switches to a mirror image display.

JP 2009-204817 A

However, when a product review video is filmed with a mirror image, if the displayed image contains subjects other than a face, such as a subject that contains text, the text will appear in mirror image, making it difficult for the person taking the review to read.

The present invention has been made in consideration of the above problems. The present invention aims to provide an imaging device, a control method for an imaging device, and a program that can display objects other than a face in an easy-to-identify manner when the object is included in an image displayed on a display unit.

In order to achieve the above object, the imaging device of the present invention comprises an imaging section that captures an image, a detection means that detects subjects, including faces and objects other than faces, from an image captured by the imaging section, an AF processing means that sets the subject detected by the detection means as an AF target and focuses on the AF target, and a control means that controls the display section to display the image captured by the imaging section in either a first display state in which the image is displayed as a first live view image, or a second display state in which a second live view image that is a horizontally inverted version of the first live view image is displayed, and the control means controls the display section to switch to the first display state when an object other than a face detected by the detection means becomes an AF target while an image is being displayed in the second display state.

According to the present invention, when an image displayed on a display unit includes objects other than a face (e.g., a subject including text), the objects other than the face can be displayed in a manner that makes them easy to identify.

FIG. 2 is a block diagram showing an example of a hardware configuration of a digital camera that is an imaging apparatus. FIG. 1 is a perspective view of the appearance of a digital camera, which is an imaging device. 11A and 11B are diagrams illustrating an example of a display displayed on a display unit of a digital camera in a product review mode. 13 is a flowchart showing periodic processing during and after photographing in the product review mode. 4B is a flowchart showing the processes in steps (subroutines) S416 and S420 in the flowchart shown in FIG. 4A.

The following describes in detail the embodiments of the present invention with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited to the configurations described in the embodiments. For example, each part constituting the present invention can be replaced with any configuration that can perform the same function. In addition, any component may be added.

Figure 1 is a block diagram showing an example of the hardware configuration of a digital camera, which is an imaging device. As shown in Figure 1, the digital camera 100, which is an imaging device, has a system control unit 101, an image processing unit 102, a barrier 103, a photographing lens 104, a shutter 105, an imaging unit 106, an A/D converter 107, a memory control unit 108, and a memory 109. The digital camera 100 also has a D/A converter 110, a display unit 111, a system memory 112, a system timer 113, a non-volatile memory 114, a shutter button 115, a mode switching dial 118, a power button 119, and an operation unit 120. The digital camera 100 also has a power control unit 121, a battery 122, a recording medium I/F 123, a recording medium 124, an audio control unit 125, a speaker 126, a rotation detection unit 127, a subject recognition unit 128, and a subject distance acquisition unit 129.

The photographing lens 104 is a lens group including a zoom lens and a focus lens. The shutter 105 is a shutter with an aperture function. In the AF processing of the system control unit 101, the focus lens of the photographing lens 104 is driven to focus on the subject to be the AF target. The imaging unit 106 captures an image of the subject. The imaging unit 106 has an imaging element composed of a CCD or CMOS element that converts an optical image into an electrical signal. The barrier 103 covers the imaging system including the photographing lens 104, the shutter 105, and the imaging unit 106 to prevent the imaging system from becoming dirty or damaged. The A/D converter 107 converts the analog signal output from the imaging unit 106 into a digital signal. The image processing unit 102 performs predetermined pixel interpolation, resizing such as reduction, and color conversion processing on the data from the A/D converter 107 or the data from the memory control unit 108. Furthermore, the image processing unit 102 performs a predetermined calculation process using the data of the image captured by the imaging unit 106. The system control unit 101 then performs exposure control and distance measurement control based on the calculation results of this image processing unit 102. This results in AF (autofocus) processing, AE (autoexposure) processing, and EF (pre-flash) processing. Furthermore, TTL-type AWB (auto white balance) processing is also performed based on the calculation results of the image processing unit 102.

The output data from the A/D converter 107 is written directly to the memory 109 via the image processing unit 102 and the memory control unit 108, or via the memory control unit 108. The memory 109 stores image data converted into digital data by the A/D converter 107 and image data to be displayed on the display unit 111. The memory 109 has a storage capacity sufficient to store a predetermined number of still images and a predetermined amount of moving images and audio. The memory 109 also serves as a memory (video memory) for storing data for image display. The D/A converter 110 converts the image display data stored in the memory 109 into an analog signal and transmits it to the display unit 111. As a result, the image display data written to the memory 109 is displayed as an image on the display unit 111. The display unit 111 has a monitor 111a (see FIG. 2) such as an LCD, and displays an image on the monitor 111a according to the analog signal from the D/A converter 110. In the digital camera 100, the digital signal is first A/D converted by the A/D converter 107 and stored in the memory 109, and then converted to analog by the D/A converter 110, and then sequentially transferred to and displayed on the display unit 111. This allows the display unit 111 to function as an electronic viewfinder and display a through image (hereinafter referred to as a "live view image").

The non-volatile memory 114 is an electrically erasable and recordable memory, and is composed of, for example, an EEPROM. The non-volatile memory 114 stores constants and programs for the operation of the system control unit 101. The programs include programs for the system control unit 101 to cause each unit of the digital camera 100 to execute various processes and execute various arithmetic processes. The system control unit 101 is a computer that controls the entire digital camera 100. The system memory 112 is composed of a RAM. The system memory 112 can expand constants and variables for the operation of the system control unit 101, programs read from the non-volatile memory 114, and the like. The system control unit 101 also controls the display of images, etc. by controlling the memory 109, the D/A converter 110, the display unit 111, and the like. The system timer 113 also functions as a timekeeping unit that measures the time used for various controls and the time of a built-in clock.

The subject recognition unit 128 detects a subject (for example, a person or an object other than a person) having a pre-specified characteristic from a live view image. In addition, the subject recognition unit 128 measures the size of the detected subject, recognizes characters in the image, and detects the movement of the detected subject. The system control unit 101 can automatically set the subject recognized by the subject recognition unit 128 as an AF target. The system control unit 101 drives the focus lens of the shooting lens 104 so that the subject set as the AF target is focused (in focus), and performs AF processing to focus (focus) on the AF target subject. As a result of the AF processing, the system control unit 101 can output the position of the AF target subject, the type of subject (face, non-face, etc.) detected by the subject recognition unit 128 of the AF target subject, and the result of the AF processing for the AF target (in focus/out of focus). The subject distance acquisition unit 129 can acquire the distance to the subject focused in the AF processing. The shutter button 115, the mode switching dial 118, the power button 119, and the operation unit 120 are various operation units for inputting various operation instructions to the system control unit 101. The operation unit 120 has multiple operation members. Each operation member is assigned an appropriate function for each scene by selecting various function icons displayed on the display unit 111, and acts as various function buttons. Examples of the function buttons include an end button, a back button, an image forward button, a jump button, a filter button, and an attribute change button. The mode switching dial 118 switches the operation mode of the system control unit 101 to a still image recording mode, a video recording mode, and the like. Each mode also includes more detailed modes, and the more detailed modes can also be switched using the mode switching dial 118.

The shutter button 115 includes a first shutter switch 116 and a second shutter switch 117. The first shutter switch 116 is turned ON when the shutter button 115 provided on the digital camera 100 is pressed halfway (instruction to prepare for shooting) and generates a first shutter switch signal SW1. The first shutter switch signal SW1 starts operations such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing. The second shutter switch 117 is turned ON when the shutter button 115 is pressed fully (instruction to shoot) and generates a second shutter switch signal SW2. The second shutter switch signal SW2 starts a series of shooting processing operations from reading out the signal from the imaging unit 106 to writing image data to the recording medium 124.

The power supply control unit 121 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching the blocks to be energized, and the like. The power supply control unit 121 detects the state of the power button 119, whether a battery is attached, the type of battery, and the remaining battery level. Based on the detection result and the instruction of the system control unit 101, the power supply control unit 121 controls the DC-DC converter and can supply the required voltage to each unit including the recording medium 124 for the required period. The battery 122 is a primary battery such as an alkaline battery or a lithium battery, or a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, and together with the AC adapter, etc., constitutes the power supply unit. In this embodiment, a secondary battery is used for the battery 122. The recording medium I/F 123 is an interface with the recording medium 124 such as a memory card or a hard disk. The recording medium 124 is a recording medium such as a memory card for recording images captured by the imaging unit 106, and is composed of a semiconductor memory, a magnetic disk, etc. The audio control unit 125 generates audio for notifications such as warnings. The speaker 126 can emit sound.

2 is an external perspective view of a digital camera, which is an imaging device. As shown in FIG. 2, the digital camera 100 has a menu button 201, a cross button 202, a SET button 203, a controller wheel 204, an electronic dial 205, a playback button 206, a video recording start button 207, a cover 208, and a hinge 209. By operating the menu button 201, a menu screen in which various settings can be made is displayed on the display unit 111. The user can perform various settings in the digital camera 100 using the menu screen displayed on the display unit 111, the cross button 202, and the SET button 203. The controller wheel 204 and the electronic dial 205 are rotatable operation members, and are used together with the cross button 202 when specifying a selection item. The controller wheel 204 and the electronic dial 205 are also members that constitute the operation unit 120. By operating the playback button 206, the digital camera 100 can be switched between a shooting mode and a playback mode. Operating the video recording start button 207 starts recording a video. Operating the video recording start button 207 again while recording a video stops recording the video. An openable cover 208 is provided on the bottom of the digital camera 100.

When the cover 208 is open, the battery 122 and the recording medium 124 can be inserted into the digital camera 100. After that, by opening the cover 208, the battery 122 and the recording medium 124 can be protected and the battery 122 and the recording medium 124 can be prevented from falling off. The hinge 209 is a rotation mechanism that rotatably supports the display unit 111. This allows the display unit 111 (monitor 111a) to change its posture between a rear-facing state and a facing state (front-facing state). The rear-facing state is a state in which the display screen of the display unit 111 faces the opposite side to the subject, that is, facing the rear (back side) of the digital camera 100. The facing state is achieved by rotating the display unit 111 180 degrees from the rear-facing state. The facing state is a state in which the display screen of the display unit 111 faces the subject side, that is, facing the front (shooting direction) of the digital camera 100. In the facing state, when the photographer is taking a picture of himself as a subject, that is, when taking a selfie, he can check the image on the display unit 111. The hinge 209 has a built-in rotation detection unit 127 that detects the rotation of the display unit 111. Based on the detection result of the rotation detection unit 127, the system control unit 101 can determine the attitude of the display unit 111, that is, whether the display unit 111 is in the rear facing state or the facing state.

As mentioned above, the digital camera 100 can switch between operating modes by operating the mode switching dial 118. The operating modes include, for example, a still image recording mode and a video recording mode, and in this embodiment, a product review mode. The "product review mode" is a shooting mode suitable for product reviews, and is a type of video recording mode intended for a single photographer to shoot a video reviewing a product. In this embodiment, the "product" includes not only commercial items (commonly referred to as "products"), but also "products" that do not have a physical form, that is, services. When shooting a product review video, one photographer shoots and appears in the video. In this case, the digital camera 100 is fixed to a tripod or the like, and the display unit 111 is placed in a facing state. Then, if the photographer is positioned facing the front of the digital camera 100, he or she can check the review video on the display unit 111. When the AF target is automatically set in the AF process in the system control unit 101, in normal shooting mode, if multiple subjects are detected by the subject recognition unit 128, a face subject is given priority and set as the AF target. However, in product review mode, if the subject recognition unit 128 detects a subject (product) other than a face that is closer to or larger than a face, the face is not given priority and the subject other than the face is set as the AF target.

3 is a diagram showing an example of a display displayed on the display unit of the digital camera in the product review mode. FIG. 3(a) is a diagram showing an example of a menu screen. FIG. 3(b) is a diagram showing an example of a detailed setting screen. FIG. 3(c) is a diagram showing an example of a first live view image. FIG. 3(d) is a diagram showing an example of a second live view image. FIG. 3(e) is a diagram showing an example of a first live view image. FIG. 3(f) is a diagram showing an example of a second live view image. In the product review mode, the display unit 111 can take two display states. The first display state, which is the first display state, is a state in which the review video (image) captured by the imaging unit 106 is displayed as it is as the first live view image (normal image) (see FIG. 3(c) and FIG. 3(e)). The second display state, which is the second display state, is a state in which the second live view image (mirror image) obtained by flipping the first live view image horizontally is displayed (see FIG. 3(d) and FIG. 3(f)). The subject in the image shown in FIG. 3(c) is the photographer (performer) P himself. In the image shown in FIG. 3(c), the face P1 of the photographer P detected by the subject recognition unit 128 is set as the AF target M, and the AF target M, i.e., the face P1, is in focus. The image shown in FIG. 3(d) is a state in which the image shown in FIG. 3(c) is inverted horizontally. In the image shown in FIG. 3(d), the face P1 of the photographer P detected by the subject recognition unit 128 is set as the AF target M, and the AF target M, i.e., the face P1, is in focus, as in the image shown in FIG. 3(c). The subjects in the image shown in FIG. 3(e) include the photographer P (face P1) and the commodity Q (object other than the face P1) held by the photographer P. In the image shown in FIG. 3(e), of the face P1 and the commodity Q detected by the subject recognition unit 128, the one closer to the digital camera 100 (imaging unit 106), i.e., the commodity Q, is set as the AF target M. And, the AF target M, i.e., the commodity Q, is in focus. The image shown in FIG. 3(f) is a state where the image shown in FIG. 3(e) is reversed from left to right. In the image shown in FIG. 3(f), as in the image shown in FIG. 3(e), of the face P1 and the product Q detected by the subject recognition unit 128, the product Q closer to the digital camera 100 is set as the AF target M. The product Q, which is the AF target M, is in focus. Also, as shown in FIG. 3(e) and FIG. 3(f), the product Q, which is the AF target M, is marked with the letter Q1. In the digital camera 100, the display unit 111 can be switched to one of the first display state and the second display state. The switching control for switching the display state is executed by the system control unit 101. In a normal face-to-face state, the photographer can view the image shown in FIG. 3(d) or the image shown in FIG. 3(f). However, in the image shown in FIG. 3(f), the letter Q1 appears as a mirror image, making it difficult for the photographer to read the letter Q1.

Therefore, the digital camera 100 of this embodiment is configured to reduce the difficulty in reading the character Q1. The configuration and operation are described below. The menu screen 300A shown in FIG. 3(a) is a mirror image display setting menu screen in the product review mode, and includes buttons 301, 302, and 303. By selecting button 301 and setting it to "OFF", the first live view image, which is a normal image, is displayed on the display unit 111 even when the display unit 111 is in the facing state. By selecting button 302 and setting it to "ON", the second live view image, which is a mirror image, is displayed on the display unit 111 when the display unit 111 is in the facing state. By selecting button 303 and setting it to "ON (custom)", the second live view image is temporarily released and the first live view image is displayed when the display unit 111 is in the facing state and the following conditions are met.

Detail setting screen 300B shown in FIG. 3(b) is a condition setting screen for temporarily canceling the second live view image and displaying the first live view image. Detail setting screen 300B includes check boxes 304, 305, 306, 307, adjustment units 308, and 309.

By checking the check box 304, it is possible to set "focus on something other than the face". As a result, when something other than the face of the subject is in focus (the product Q is in focus), the second live view image can be temporarily released and the first live view image can be displayed on the display unit 111 in the facing state. In this way, depending on whether the check box 304 is checked or not, it is possible to select an enabled state in which the display unit 111 can be switched to the first display state when an object other than the face is in focus, and a released state in which the enabled state is released. This allows the photographer to display the first live view image in the facing state (see FIG. 3(e)) as necessary. Therefore, the digital camera 100 has a feature that when the display unit 111 is in the facing state, when an object other than the face is detected as an AF target and the object other than the face is in focus, the display unit 111 can be switched to the first display state. In addition, this switching is performed based on the "display switching determination process in the product review mode" described later.

By checking the checkbox 305, the "distance to the subject" can be set. As a result, if the distance to the subject (AF target) measured by the subject distance acquisition unit 129 is less than a predetermined distance, the second live view image can be temporarily canceled and the first live view image can be displayed on the display unit 111 in the facing state. The adjustment unit 308 also realizes a distance change function by performing a process to change the predetermined distance as a threshold. The predetermined distance can be changed to a shorter distance by changing the position of the slider 308a of the adjustment unit 308 to the left side in the detailed setting screen 300B. In contrast, the predetermined distance can be changed to a longer distance by changing the position of the slider 308a of the adjustment unit 308 to the right side in the detailed setting screen 300B. Since the distance between the photographer and the digital camera 100 when reviewing a product varies depending on, for example, the product, it is preferable that the predetermined distance can be changed arbitrarily. It is preferable that the predetermined distance is changed while checking the image displayed on the display unit 111 and then confirmed with the SET button 203.

By checking the checkbox 306, the "subject size" can be set. As a result, if the size of the subject in the display unit 111 measured by the subject recognition unit 128 is equal to or larger than a predetermined size, the second live view image can be temporarily canceled and the first live view image can be displayed on the display unit 111 in the facing state. The adjustment unit 309 also performs a process of changing the predetermined size as a threshold value. By changing the position of the slider 309a of the adjustment unit 309 to the left side in the detailed setting screen 300B, the predetermined size can be changed to a smaller size. In contrast, by changing the position of the slider 309a of the adjustment unit 309 to the right side in the detailed setting screen 300B, the predetermined size can be changed to a larger size. Since the distance between the photographer and the digital camera 100 when performing a product review varies depending on, for example, the product, it is preferable that the predetermined size can be changed arbitrarily.

By checking the checkbox 307, "character recognition" can be set. This allows the second live view image to be temporarily canceled and the first live view image to be displayed on the display unit 111 in the facing state when the subject recognition unit 128 recognizes characters on the display unit 111.

The check boxes 304 to 307 may be checked or unchecked in any combination. This allows images to be switched according to the shooting conditions, improving the convenience of the digital camera 100. Furthermore, if the check boxes 304 to 307 are not checked (if the conditions are no longer met), the second live view image that was temporarily deactivated is displayed on the display unit 111 in the facing state.

Figure 4A is a flowchart showing periodic processing during standby and during shooting in product review mode. The flowchart shown in Figure 4A explains processing related to display switching in product review mode, so processing unrelated to display switching is omitted. As shown in Figure 4A, in step S401, the system control unit 101 determines whether the video recording start button 207 of the digital camera 100 has been operated. If it is determined in step S401 that the video recording start button 207 has been operated, the process proceeds to step S407. On the other hand, if it is determined in step S401 that the video recording start button 207 has not been operated, the process proceeds to step S402.

In step S407, the system control unit 101 determines whether the digital camera 100 is currently waiting to shoot or is currently recording a moving image. If the result of the determination in step S407 is that the digital camera 100 is currently waiting to shoot, the process proceeds to step S409. On the other hand, if the result of the determination in step S407 is that the digital camera 100 is currently recording a moving image, the process proceeds to step S408.

In step S408, the system control unit 101 stops video recording.

In step S409, the system control unit 101 starts video recording.

In step S402 after step S401, step S408, or step S409, the system control unit 101 determines whether the display unit 111 has been changed from a rear-facing state to a facing state based on the detection result of the rotation detection unit 127. If the result of the determination in step S402 is that the display unit 111 has been changed to the facing state, the process proceeds to step S410. On the other hand, if the result of the determination in step S402 is that the display unit 111 has not been changed to the facing state, the process proceeds to step S403.

In step S410, the system control unit 101 determines whether or not either button 302 (the "On" button) or button 303 (the "On (Custom)" button) on the menu screen 300A has been selected. If the result of the determination in step S410 is that either button 302 or button 303 has been selected, the process proceeds to step S411. On the other hand, if the result of the determination in step S410 is that neither button 302 nor button 303 has been selected, the process proceeds to step S403.

In step S411, the system control unit 101 switches the display state on the display unit 111 to a second display state in which a second live view image (mirror image) is displayed.

In step S403 after executing steps S402 and S411, the system control unit 101 determines whether the position of the display unit 111 has been changed from the facing-to-face state to the rear-facing state (normal position state) based on the detection result of the rotation detection unit 127. If it is determined in step S402 that the display unit 111 has been changed to the rear-facing state, the process proceeds to step S412. On the other hand, if it is determined in step S402 that the display unit 111 has not been changed to the rear-facing state, the process proceeds to step S404.

In step S412, the system control unit 101 determines whether the display state on the display unit 111 is the second display state in which the second live view image (mirror image) is displayed. If the result of the determination in step S412 indicates that the display state is the second display state, the process proceeds to step S413. On the other hand, if the result of the determination in step S412 indicates that the display state is not the second display state, the process proceeds to step S404.

In step S413, the system control unit 101 switches the display state on the display unit 111 to a first display state in which the first live view image (normal image) is displayed.

In step S404 after step S403 or step S413, the system control unit 101 determines whether or not the display unit 111 is in a face-to-face state based on the detection result of the rotation detection unit 127. If the result of the determination in step S404 is that the display unit 111 is in a face-to-face state, the process proceeds to step S414. On the other hand, if the result of the determination in step S404 is that the display unit 111 is not in a face-to-face state, the process proceeds to step S405.

In step S414, the system control unit 101 determines whether button 303 (the "On (Custom)" button) on the menu screen 300A is selected.

In step S415, the system control unit 101 determines whether the display state on the display unit 111 is the second display state in which the second live view image (mirror image) is displayed. If the result of the determination in step S415 is that the display state is the second display state, the process proceeds to step S416. On the other hand, if the result of the determination in step S415 is that the display state is not the second display state, the process proceeds to step S419.

In step S416, the system control unit 101 executes a display switching determination process in the product review mode. As described above, the digital camera 100 has a feature that, when the display unit 111 is in the facing state, if an object other than a face is detected as the AF target and the object other than the face is focused on, the display unit 111 can be switched to the first display state. This switching is executed based on a display switching determination process in the product review mode. Details of the display switching determination process will be described with reference to FIG. 4B.

In step S417, the system control unit 101 determines whether the display unit 111 can be switched to the first display state (normal display state). If the result of the determination in step S417 indicates that switching is possible, the process proceeds to step S418. On the other hand, if the result of the determination in step S417 indicates that switching is not possible, the process proceeds to step S405.

In step S418, the system control unit 101 switches the display unit 111 to the first display state (normal display state).

In step S419 after executing step S415, the system control unit 101 determines whether or not there is lateral movement of the subject based on the identification result in the subject recognition unit 128. If the result of the determination in step S419 is that there is lateral movement, the process proceeds to step S422. On the other hand, if the result of the determination in step S419 is that there is no lateral movement, the process proceeds to step S420.

In step S422, the system control unit 101 switches the display unit 111 to the second display state (mirror image display state).

In step S420, similar to step S416, the system control unit 101 executes the display switching determination process in the product review mode.

In step S421, the system control unit 101 determines whether or not the display unit 111 can be switched to the second display state (mirror image display state). If the result of the determination in step S421 indicates that switching is possible, the process proceeds to step S422. On the other hand, if the result of the determination in step S421 indicates that switching is not possible, the process proceeds to step S405.

In step S405 after step S404, step S418, or step S419, the system control unit 101 determines whether the digital camera 100 is currently waiting to shoot or is currently recording a moving image. If the result of the determination in step S405 is that the digital camera 100 is currently waiting to shoot, the process proceeds to step S423. On the other hand, if the result of the determination in step S405 is that the digital camera 100 is currently recording a moving image, the process proceeds to step S406.

In step S423, the system control unit 101 determines whether the menu button 201 of the digital camera 100 has been operated. If it is determined in step S423 that the menu button 201 has been operated, the process proceeds to step S424. On the other hand, if it is determined in step S423 that the menu button 201 has not been operated, the process proceeds to step S406.

In step S424, the system control unit 101 transitions the display unit 111 to a menu setting screen. This allows the photographer to operate the menu setting screen. Then, processing to change the settings of various menus is executed in accordance with this operation.

In step S406 after step S405 or step S424, the system control unit 101 determines whether the shooting mode has been changed. If the result of the determination in step S406 is that the shooting mode has been changed, the process ends. On the other hand, if the result of the determination in step S406 is that the shooting mode has not been changed, the process returns to step S401, and the subsequent steps are executed in sequence.

Figure 4B is a flowchart showing the processing in each step (subroutine) of step S416 and step S420 of the flowchart shown in Figure 4A. The flowchart shown in Figure 4B is a flowchart showing the display switch determination process in product review mode. As shown in Figure 4B, in step S451, the system control unit 101 determines whether or not check boxes 304 to 307 on the detailed setting screen 300B are checked. If it is determined in step S451 that none of check boxes 304 to 307 are checked, the process proceeds to step S465. On the other hand, if it is determined in step S451 that at least one of check boxes 304 to 307 is checked, the process proceeds to step S452.

In step S465, the system control unit 101 switches the display unit 111 to the second display state (mirror image display state), and the process ends.

In step S452, the system control unit 101 determines whether the check box 304 is checked and the setting "focus on object other than face" is performed. If the result of the determination in step S452 is that the setting "focus on object other than face" is performed, the process proceeds to step S453. On the other hand, if the result of the determination in step S452 is that the setting "focus on object other than face" is not performed, the process proceeds to step S455.

In step S453, the system control unit 101 obtains the focusing result of the AF process, i.e., which of the face and non-face objects in the subject is the AF target and which is in focus.

In step S454, the system control unit 101 determines whether or not an object other than the face (product Q in this embodiment) is in focus based on the focus result obtained in step S453. If the result of the determination in step S454 is that an object other than the face is in focus, the process proceeds to step S455. On the other hand, if the result of the determination in step S454 is that an object other than the face is not in focus, the process proceeds to step S465.

In step S455, the system control unit 101 determines whether the check box 305 is checked and the "distance to subject" is set. If the result of the determination in step S455 is that the "distance to subject" has been set, the process proceeds to step S456. On the other hand, if the result of the determination in step S455 is that the "distance to subject" has not been set, the process proceeds to step S458.

In step S456, the system control unit 101 acquires the distance to the subject measured by the subject distance acquisition unit 129.

In step S457, the system control unit 101 determines whether the distance acquired in step S456 is less than the predetermined distance. If the result of the determination in step S457 is that the distance is less than the predetermined distance, the process proceeds to step S458. On the other hand, if the result of the determination in step S457 is that the distance is not less than the predetermined distance, the process proceeds to step S465.

In step S458, the system control unit 101 determines whether the check box 306 has been checked and the "subject size" has been set. If the result of the determination in step S458 is that the "subject size" has been set, the process proceeds to step S459. On the other hand, if the result of the determination in step S458 is that the "subject size" has not been set, the process proceeds to step S461.

In step S459, the system control unit 101 acquires the size of the subject recognized by the subject recognition unit 128.

In step S460, the system control unit 101 determines whether the size of the subject acquired in step S459 is equal to or larger than the predetermined size. If the result of the determination in step S460 is that the size is equal to or larger than the predetermined size, the process proceeds to step S461. On the other hand, if the result of the determination in step S460 is that the size is not equal to or larger than the predetermined size, the process proceeds to step S465.

In step S461, the system control unit 101 determines whether the check box 307 is checked and "character recognition" is set. If it is determined in step S461 that "character recognition" is set, the process proceeds to step S462. On the other hand, if it is determined in step S461 that "character recognition" is not set, the process proceeds to step S464.

In step S462, the system control unit 101 acquires the characters recognized by the object recognition unit 128.

In step S463, the system control unit 101 determines whether the characters acquired in step S462 satisfy a condition, such as being a mirror image. If the result of the determination in step S463 indicates that the conditions are satisfied, the process proceeds to step S464. On the other hand, if the result of the determination in step S463 indicates that the conditions are not satisfied, the process proceeds to step S465.

In step S464, the system control unit 101 determines that the display unit 111 can be switched to the first display state (normal display state), and the process ends.

As described above, in the digital camera 100, the check boxes 304 to 307 can be arbitrarily checked, that is, enabled. Then, when all the checked conditions are satisfied, the display unit 111 can be switched to the first display state. This allows the first live view image to be displayed on the display unit 111 in the facing state. For example, the first live view image is the image shown in FIG. 3(e). In the image shown in FIG. 3(e), the character Q1 is displayed in the same orientation as when it was photographed. This allows the photographer to easily read the character Q1. In contrast, if the display unit 111 is not switched to the first display state and is left in the second display state, for example, the image shown in FIG. 3(f) is displayed. In the image shown in FIG. 3(f), the character Q1 appears as a mirror image, making it difficult for the photographer to read the character Q1. Also, even when the display unit 111 is in the rear view state, the image displayed on the display unit 111 becomes the image shown in FIG. 3(e), and the photographer can easily read the character Q1. In this way, when an image displayed on the display unit 111 includes text, for example, the digital camera 100 can make the text Q1 easy to read regardless of the position of the display unit 111.

When the digital camera 100 detects left-right movement of the subject in the image with the display unit 111 switched to the first display state, the display unit 111 can be switched to the second display state. This can reduce the discomfort felt when the photographer's own left-right movement is reversed when looking at the display unit 111. Also, when the photographer's own left-right movement stops for a certain period of time, the display unit 111 is returned from the second display state to the first display state. Note that in the digital camera 100, it is preferable that the priority setting between switching to the first display state when an object other than a face is in focus and switching to the second display state when left-right movement of the subject is detected can be changed as appropriate.

Furthermore, when the distance to the subject measured by the subject distance acquisition unit 129 changes from less than the predetermined distance to equal to or greater than the predetermined distance, the digital camera 100 can switch the display unit 111 from the first display state to the second display state. This is because when the subject moves away from the digital camera 100, it is considered that it would be difficult for the photographer to read the text even if the display unit 111 was in the first display state, so it may be possible to switch to the second display state. Note that when the distance to the subject measured by the subject distance acquisition unit 129 returns to less than the predetermined distance, the display unit 111 is returned from the second display state to the first display state.

In the above embodiment, the user can set the conditions for temporarily canceling the second display state and switching to the first display state using a setting screen such as that shown in FIG. 3(b). However, without making the setting as shown in FIG. 3(b), when the product review mode is set, the second display state may be temporarily canceled and switched to the first display state in response to an object other than a face becoming the AF target, and when the product review mode is not set, the display state may not be switched in response to a change in the AF target. Alternatively, the user may be allowed to set the switching of the display state using a setting screen such as that shown in FIG. 3(b), and the second display state may be temporarily canceled and switched to the first display state in response to a change in the AF target not only in the product review mode but also in other display modes.

In addition, when the second display state is temporarily released and switched to the first display state, the switching may be performed at the timing when an object other than a face is set as the AF target, or when an object other than a face is set as the AF target and the set AF target is brought into focus by AF processing. In addition, even if an object other than a face is set as the AF target, if the object cannot be brought into focus by AF processing, the display state may not be switched.

(Configuration 1) An imaging unit that captures an image;
a detection means for detecting a subject including a face and a non-face object from an image captured by the imaging unit;
an AF processing means for setting the subject detected by the detection means as an AF target and focusing on the AF target;
a control means for controlling the display unit to display an image captured by the imaging unit in either a first display state in which the image is displayed as a first live view image or a second display state in which a second live view image obtained by horizontally inverting the first live view image is displayed,
The control means controls the imaging device to switch to the first display state when an object other than a face detected by the detection means becomes an AF target while an image is being displayed in the second display state.
(Configuration 2) The imaging device according to Configuration 1, wherein when the detection means detects a plurality of subjects, including a face and a non-face object, the AF processing means selects a subject closer to the imaging unit as the AF target.
(Configuration 3) A distance acquisition unit is provided for measuring a distance to a subject detected by the detection unit,
The imaging device described in configuration 2, characterized in that when there is a subject whose distance to the subject measured by the distance acquisition means is less than a predetermined distance, the AF processing means sets the subject as an AF target, and the control means controls to switch to the first display state when the subject is an object other than a face.
(Configuration 4) The imaging device according to Configuration 3, wherein the control means controls to switch to the second display state when the distance to the subject changes from less than the predetermined distance to equal to or greater than the predetermined distance.
(Configuration 5) The imaging device according to configuration 3 or 4, further comprising a change unit that changes the predetermined distance in accordance with a user setting.
(Configuration 6) A detection unit for detecting an attitude of the display unit rotatably supported with respect to the imaging device,
The imaging device described in any one of configurations 1 to 5, characterized in that the control means controls the display unit to switch from the first display state to the second display state in response to a change in attitude of the display unit from a first attitude in which the display screen of the display unit faces the rear side of the imaging device to a second attitude in which the display screen of the display unit faces the shooting direction side.
(Configuration 7) A mode switching means for switching to a specific photographing mode is provided,
The imaging device described in any one of configurations 1 to 6, characterized in that, in the case of the specific shooting mode, the control means controls to switch to the first display state in response to an object other than a face detected by the detection means becoming an AF target, and, in the case of not the specific shooting mode, controls not to switch to the first display state even if an object other than a face detected by the detection means becomes an AF target.
(Configuration 8) A size measuring means for measuring a size of the detection object in the image,
3. The imaging device according to claim 2, wherein the control means is capable of switching to the first display state when a size of the detection object in the image is a predetermined size.
(Configuration 9) The imaging device according to configuration 8, further comprising a size changing means for performing an operation to change the predetermined size.
(Configuration 10) The detection object is provided with a character,
a recognition means for recognizing the character in the image;
3. The imaging device according to configuration 2, wherein the control means is capable of switching to the first display state when the character is recognized in the image.
(Configuration 11) A movement detection unit is provided for detecting the movement of the detection object,
The imaging device described in any one of configurations 1 to 10, characterized in that the control means is capable of switching to the second display state when left-right movement of the detection object within the image is detected while the display state is switched to the first display state.
(Configuration 12) The display unit has a monitor that can take the first display state and the second display state and can change its posture between a front state facing the subject and a rear state facing an opposite side to the subject,
An imaging device described in any one of configurations 1 to 11, characterized in that when the monitor is in the front state, the control means is capable of switching the monitor to the first display state when an object other than the face is detected as the detection object and the object other than the face is focused on.
(Configuration 13) An imaging device as described in any one of configurations 1 to 12, further comprising a selection means for selecting between an effective state in which the display unit can be switched to the first display state when an object other than the face is detected and the object other than the face is focused on, and a release state in which the effective state is released.
(Method 1) A method for controlling an imaging device including an imaging unit that captures an image, comprising:
a detection step of detecting a subject including a face and a non-face object from an image captured by the imaging unit;
an AF processing step of setting the subject detected by the detection step as an AF target and focusing on the AF target;
a control step of controlling the display unit to display an image captured by the imaging unit in either a first display state in which the image is displayed as a first live view image or a second display state in which a second live view image obtained by horizontally inverting the first live view image is displayed;
A control method for an imaging device, characterized in that, in the control process, when an object other than a face detected by the detection process becomes an AF target while an image is being displayed in the second display state, the control process controls to switch to the first display state.
(Program 1) According to any one of configurations 1 to 14, a program for causing a computer to execute each means of the imaging apparatus according to the above.

Other Embodiments
Although the preferred embodiment of the present invention has been described above, the present invention is not limited to the above-mentioned embodiment, and various modifications and changes are possible within the scope of the gist of the present invention. The present invention can also be realized by supplying a program that realizes one or more functions of the above-mentioned embodiment to a system or device via a network or storage medium, and having one or more processors of a computer in the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

100 Digital camera 101 System control unit 104 Taking lens 105 Shutter 106 Image capture unit 111 Display unit 128 Subject recognition unit

In order to achieve the above object, an imaging device of the present invention includes an imaging section that captures an image, a detection means that detects subjects including faces and objects other than faces from an image captured by the imaging section, an AF processing means that sets the subject detected by the detection means as an AF target and focuses on the AF target, a distance acquisition means that acquires a distance to the subject detected by the detection means, and a control means that controls a display section to display an image captured by the imaging section in either a first display state in which the image is displayed as a first live view image, or a second display state in which a second live view image that is an inverted version of the first live view image is displayed, The control means controls to switch to the first display state when an object other than a face detected by the detection means becomes an AF target while an image is being displayed in the second display state, and the control means controls to switch to the first display state when, while an image is being displayed in the second display state, the subject detected by the detection means is an object other than a face and the distance to the subject acquired by the distance acquisition means is less than a predetermined distance, and controls not to switch to the first display state when the subject detected by the detection means is a face or the distance to the subject acquired by the distance acquisition means is equal to or greater than the predetermined distance .

(Configuration 1) An imaging unit that captures an image;
a detection means for detecting a subject including a face and a non-face object from an image captured by the imaging unit;
an AF processing means for setting the subject detected by the detection means as an AF target and focusing on the AF target;
a distance acquisition means for acquiring a distance to a subject detected by the detection means;
a control means for controlling the display unit to display an image captured by the imaging unit in either a first display state in which the image is displayed as a first live view image or a second display state in which a second live view image obtained by inverting the first live view image is displayed;
the control means controls to switch to the first display state when an object other than a face detected by the detection means becomes an AF target while an image is being displayed in the second display state,
the control means controls to switch to the first display state when, during display of an image in the second display state, the subject detected by the detection means is an object other than a face and the distance to the subject acquired by the distance acquisition means is less than a predetermined distance, and controls not to switch to the first display state when the subject detected by the detection means is a face or the distance to the subject acquired by the distance acquisition means is equal to or greater than the predetermined distance.
1. An imaging device comprising:
(Configuration 2) The imaging device according to Configuration 1, wherein when the detection means detects a plurality of subjects, including a face and a non-face object, the AF processing means selects a subject closer to the imaging unit as the AF target.
(Configuration 3) An imaging device as described in configuration 1 or 2, characterized in that when there is a subject whose distance to the subject acquired by the distance acquisition means is less than the predetermined distance, the AF processing means sets the subject as the AF target, and the control means controls to switch to the first display state when the subject is an object other than a face, and controls to switch to the second display state when the distance to the subject changes from less than the predetermined distance to greater than or equal to the predetermined distance .
(Configuration 4) The imaging device according to any one of configurations 1 to 3, further comprising a change unit for changing the predetermined distance in accordance with a user setting.
(Configuration 5) A detection unit for detecting an attitude of the display unit rotatably supported with respect to the imaging device,
The imaging device described in any one of configurations 1 to 4, characterized in that the control means controls the display unit to switch from the first display state to the second display state in response to a change in attitude of the display unit from a first attitude in which the display screen of the display unit faces the rear side of the imaging device to a second attitude in which the display screen of the display unit faces the shooting direction side.
(Configuration 6) A mode switching means for switching to a specific photographing mode is provided,
The imaging device described in any one of configurations 1 to 5, characterized in that, in the case of the specific shooting mode, the control means controls to switch to the first display state in response to an object other than a face detected by the detection means becoming an AF target, and, in the case of not the specific shooting mode, controls not to switch to the first display state even if an object other than a face detected by the detection means becomes an AF target.
(Configuration 7) A size measuring means for measuring a size of the subject in the image is provided,
3. The imaging apparatus according to configuration 2, wherein the control means is capable of switching to the first display state when the size of the subject in the image is a predetermined size.
(Configuration 8) The imaging device according to configuration 7 , further comprising a size changing means for performing an operation to change the predetermined size.
(Configuration 9) The subject has text written on it,
a recognition means for recognizing the character in the image;
3. The imaging device according to configuration 2, wherein the control means is capable of switching to the first display state when the character is recognized in the image.
(Configuration 10) A movement detection means for detecting the movement of the subject is provided,
The imaging device described in any one of configurations 1 to 9, characterized in that the control means is capable of switching to the second display state when left-right movement of the subject within the image is detected while the image is switched to the first display state.
(Configuration 11) The display unit has a monitor that can take the first display state and the second display state and can change its posture between a front state facing the subject and a rear state facing the opposite side to the subject,
An imaging device described in any one of configurations 1 to 10, characterized in that when the monitor is in the front state , the control means is capable of switching the monitor to the first display state when an object other than the face is detected as the detection object and the object other than the face is focused on.
(Configuration 12) An imaging device described in any one of configurations 1 to 11, characterized in that it is provided with a selection means for selecting between an effective state in which the display unit can be switched to the first display state when an object other than the face is detected and the object other than the face is focused on, and a release state in which the effective state is released .
(Method 1) A method for controlling an imaging device including an imaging unit that captures an image, comprising:
a detection step of detecting a subject including a face and a non-face object from an image captured by the imaging unit;
an AF processing step of setting the subject detected by the detection step as an AF target and focusing on the AF target;
a distance acquisition step of acquiring a distance to a subject detected by the detection step;
a control step of controlling the display unit to display an image captured by the imaging unit in either a first display state in which the image is displayed as a first live view image or a second display state in which a second live view image obtained by inverting the first live view image is displayed;
In the control step, when an object other than a face detected in the detection step becomes an AF target while an image is being displayed in the second display state, the display state is switched to the first display state,
In the control step, while an image is being displayed in the second display state, if the subject detected in the detection step is an object other than a face and the distance to the subject acquired in the distance acquisition step is less than a predetermined distance, control is performed to switch to the first display state, and if the subject detected in the detection step is a face or the distance to the subject acquired in the distance acquisition step is equal to or greater than the predetermined distance, control is performed not to switch to the first display state.
23. A method for controlling an imaging apparatus comprising the steps of:
(Program 1) A program for causing a computer to execute each means of the imaging device described in any one of configurations 1 to 12 .

Claims (15)

An imaging unit that captures an image;
a detection means for detecting a subject including a face and a non-face object from an image captured by the imaging unit;
an AF processing means for setting the subject detected by the detection means as an AF target and focusing on the AF target;
a control means for controlling the display unit to display an image captured by the imaging unit in either a first display state in which the image is displayed as a first live view image or a second display state in which a second live view image obtained by horizontally inverting the first live view image is displayed,
The control means controls the imaging device to switch to the first display state when an object other than a face detected by the detection means becomes an AF target while an image is being displayed in the second display state. The imaging device according to claim 1, characterized in that, when the detection means detects multiple subjects, including faces and objects other than faces, the AF processing means selects the subject closest to the imaging unit as the AF target. a distance acquisition unit that measures a distance to a subject detected by the detection unit,
3. The imaging device according to claim 2, characterized in that, when there is a subject whose distance to the subject measured by the distance acquisition means is less than a predetermined distance, the AF processing means sets the subject as the AF target, and the control means controls to switch to the first display state when the subject is an object other than a face. The imaging device according to claim 3, characterized in that the control means controls to switch to the second display state when the distance to the subject changes from less than the predetermined distance to equal to or greater than the predetermined distance. The imaging device according to claim 3, further comprising a change means for changing the predetermined distance according to a user setting. a detection unit that detects an attitude of the display unit that is rotatably supported with respect to the imaging device;
2. The imaging device according to claim 1, wherein the control means controls the display unit to switch from the first display state to the second display state in response to a change in attitude of the display unit from a first attitude in which the display screen of the display unit faces a rear side of the imaging device to a second attitude in which the display screen of the display unit faces a shooting direction side. A mode switching means for switching to a specific photographing mode is provided,
2. The imaging device according to claim 1, wherein the control means controls to switch to the first display state when an object other than a face detected by the detection means becomes an AF target when the specific shooting mode is selected, and controls not to switch to the first display state when an object other than a face detected by the detection means becomes an AF target when the specific shooting mode is not selected. a size measuring means for measuring a size of the detection object in the image;
3. The imaging apparatus according to claim 2, wherein the control means is capable of switching to the first display state when a size of the detection object in the image is a predetermined size. The imaging device according to claim 8, further comprising a size changing means for performing an operation to change the predetermined size. The detection object is labeled with a letter,
a recognition means for recognizing the character in the image;
3. The imaging device according to claim 2, wherein the control means is capable of switching to the first display state when the character is recognized in the image. a movement detection means for detecting the movement of the detection object,
2. The imaging device according to claim 1, wherein the control means is capable of switching to the second display state when left-right movement of the detection object within the image is detected while the display state is switched to the first display state. the display unit has a monitor that can take the first display state and the second display state and has a posture that can be changed between a front state facing the subject and a rear state facing the opposite side to the subject,
2. The imaging device according to claim 1, characterized in that, when the monitor is in the front state, the control means is capable of switching the monitor to the first display state when an object other than the face is detected as the detection object and the object other than the face is focused on. The imaging device according to claim 1, further comprising a selection means for selecting between an effective state in which the display unit can be switched to the first display state when an object other than the face is detected and the object other than the face is brought into focus, and a release state in which the effective state is released. A method for controlling an imaging device including an imaging unit that captures an image, comprising:
a detection step of detecting a subject including a face and a non-face object from an image captured by the imaging unit;
an AF processing step of setting the subject detected by the detection step as an AF target and focusing on the AF target;
a control step of controlling the display unit to display an image captured by the imaging unit in either a first display state in which the image is displayed as a first live view image or a second display state in which a second live view image obtained by horizontally inverting the first live view image is displayed;
A control method for an imaging device, characterized in that, in the control process, when an object other than a face detected by the detection process becomes an AF target while an image is being displayed in the second display state, the control process controls to switch to the first display state. A program for causing a computer to execute each means of the imaging device described in claim 1.