JP6188455B2 - Control apparatus, imaging system, angle of view control method, program, and storage medium - Google Patents

Description

The present invention relates to a control device having a zoom function.

  2. Description of the Related Art Conventionally, there has been an imaging apparatus having a function of driving a zoom lens to perform optical zooming (optical zoom) and a function of enlarging a part of a captured image to perform electronic zooming (electronic zoom). Are known. Patent Document 1 discloses an imaging apparatus having a framing support zoom function (FA zoom function) as a function of quickly capturing a subject when the subject is out of frame. According to the configuration of Patent Literature 1, when the start of FA zoom is instructed, the zoom position is zoomed out in the wide-angle direction, and when the end of the FA zoom function is instructed, the zoom position is zoomed in to the zoom position at the start of FA zoom. Can do.

  There is also known an imaging apparatus having an auto zoom function that automatically changes the zoom position according to subject detection information. Patent Document 2 discloses a method of zooming out the zoom position in the wide-angle direction when the subject reaches the limit position of a specific area in the screen. Patent Document 2 discloses a method of zooming in on the zoom position in the telephoto direction when the subject is in the center of the screen.

JP 2012-60595 A Patent No. 2052653

  With the FA zoom function of Patent Document 1, zooming out and zooming in are performed in accordance with a photographer's operation. Here, in order to improve the convenience of the photographer, it is assumed that the zoom operation can be automatically performed in the FA zoom function according to the state of the subject. In that case, when the FA zoom function is used, it is desirable that the user can easily switch to an operation desired by the shooting scene.

Therefore, the present invention provides a control device with high user operability in the operation of re-interpreting a subject when the subject deviates from the angle of view during telephoto shooting.

A control device according to one aspect of the present invention includes a first operation unit for a user to instruct a change in an angle of view, subject detection means for detecting a subject from an image, and an operation of the first operation unit. Control means for controlling the angle of view, and the control means executes a first mode in response to a first operation via the first operation unit, and is different from the first operation. The second mode is executed in response to the operation of No. 2, and in the first mode, the control unit controls to change the angle of view based on the detection result of the subject detection unit, and the second mode The control means controls to change the angle of view to the wide-angle side according to the second operation, and when the second operation is executed during the execution of the first mode, The mode is shifted to the second mode .

An imaging system according to another aspect of the present invention includes a lens device and an imaging device including the control device .

An angle of view control method as another aspect of the present invention includes a reception step of receiving an instruction to change an angle of view via a first operation unit, a detection step of detecting a subject from an image, and the first operation A control step for controlling the angle of view according to the operation of the unit, and in the control step, the first mode is executed according to the first operation via the first operation unit, and the first The second mode is executed in response to a second operation different from the above operation, and the angle of view is changed based on the detection result in the detection step in the first mode, and the second mode is controlled. In this case, when the second operation is executed during execution of the first mode, the second mode is changed from the first mode to the second. Transition to mode .

A program according to another aspect of the present invention is configured to cause a computer to execute the angle-of-view control method.

  A storage medium according to another aspect of the present invention stores the program.

  Other objects and features of the present invention are illustrated in the following examples.

According to the present invention, it is possible to provide a control device with high user operability in an operation of re-capturing a subject when the subject deviates from the angle of view during telephoto shooting.

It is a block diagram which shows the structure of the imaging device (digital camera) in a present Example. FIG. 4 is a relationship diagram between a focal length of a zoom lens and a focus position for each subject distance in the present embodiment. It is explanatory drawing of the angle of view ((B), (C)) in the to-be-photographed object search state in this Example, and the angle of view ((A), (D)) in a photography preparation state. In this example, it is explanatory drawing of the process which prevents the frame out of the screen of a subject (thing) outside the screen. In this example, it is explanatory drawing of the process which prevents the size change within the screen of a to-be-photographed object (person). It is a flowchart which shows the process of FA zoom function in a present Example. It is a flowchart of FA zoom start determination in the present embodiment. It is a flowchart of the FA zoom end determination in the present embodiment. It is a flowchart of the subject designation processing in the present embodiment. It is a flowchart of the subject designation processing in the present embodiment. It is a flowchart of the subject designation processing in the present embodiment. It is a flowchart of FA zoom-out operation | movement in a present Example. It is a flowchart of FA zoom-in operation in a present Example. It is a flowchart of the zoom return position change process in the present embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In each figure, the same members are denoted by the same reference numerals, and redundant description is omitted.

  First, with reference to FIG. 1, the structure of the imaging device in a present Example is demonstrated. FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus (digital camera 100) in the present embodiment. The digital camera 100 is configured to be able to execute a framing assist zoom (framing assist zoom, hereinafter referred to as FA zoom) for assisting a framing by a photographer (user).

  The lens barrel 101 (lens device) holds a lens (lens group) therein. The zoom lens 102 adjusts the focal length by moving in the optical axis direction, and optically changes the angle of view (moves the zoom position). The focus lens 103 adjusts the focus by moving in the optical axis direction. The anti-vibration lens 104 is a correction lens that corrects image blur caused by camera shake. The diaphragm and shutter 105 are configured to be able to adjust the amount of light, and are used for exposure control. In the present embodiment, the digital camera 100 is an imaging device in which the lens barrel 101 and the camera body (imaging device body) are integrally configured, but the present invention is not limited to this. The present embodiment can also be applied to an imaging system including a camera body and a lens device (interchangeable lens) that can be attached to and detached from the camera body.

  The light (optical signal) that has passed through the lens barrel 101 is received by an imaging device 106 that includes a CCD (charge coupled device) or a CMOS (complementary metal oxide semiconductor). The imaging element 106 generates an imaging signal by converting a received optical signal into an electrical signal by photoelectric conversion. The imaging signal is input to the image processing circuit 107. The image processing circuit 107 performs various processes such as a pixel interpolation process and a color conversion process on the input imaging signal, and outputs image data (image data after various processes) to the image memory 108. The image memory 108 is a storage unit that includes a DRAM (Dynamic Random Access Memory), a SRAM (Static Random Access Memory), and the like.

  The display unit 109 (display unit) includes a TFT type LCD (thin film transistor driving type liquid crystal display) and the like, and displays a photographed image (an image obtained by photographing, image data). The display unit 109 displays specific information (for example, shooting information and an FA zoom frame described later) along with the shot image. Such information display such as live view realizes an electronic viewfinder (EVF) function for the photographer to adjust the angle of view.

  The aperture shutter driver 110 calculates an exposure control value (aperture value and shutter speed) based on the luminance information obtained by the image processing of the image processing circuit 107, and drives the aperture and shutter 105 based on the calculation result. . Thereby, AE (automatic exposure) control is performed. The anti-vibration lens driving unit 111 calculates an amount of shake applied to the digital camera 100 based on information from an angular velocity sensor such as a gyro sensor, and drives the anti-vibration lens 104 so as to cancel (reduce) the shake amount.

  The focus lens driving unit 112 drives the focus lens 103. In the present embodiment, the digital camera 100 performs AF (autofocus) control using a contrast method. For this reason, the focus lens driving unit 112 drives the focus lens 103 so that the subject is in focus based on the focus adjustment information (contrast evaluation value) of the photographing optical system obtained by the image processing of the image processing circuit 107. However, the present embodiment is not limited to this, and AF control other than the contrast method such as the phase difference method, or AF control using a plurality of methods such as a combination of the contrast method and the phase difference method is performed. You may comprise.

  The zoom lens driving unit 113 drives the zoom lens 102 in accordance with a zoom operation instruction. The operation unit 117 (operation means) includes a zoom lever, a zoom button, or the like as a zoom operation member that instructs the digital camera 100 to perform zooming (used for zooming instruction operation). Based on the operation amount and operation direction of the zoom operation member, the system control unit 114 calculates the zoom drive speed and drive direction, and the zoom lens 102 moves along the optical axis according to the calculation result.

  The image data generated by the shooting operation is sent to the recording unit 116 via the I / F unit 115 (interface unit) and recorded. The image data is recorded on an external recording medium such as a memory card used by being mounted on the digital camera 100, a nonvolatile memory 118 built in the digital camera 100, or both the external recording medium and the memory 118.

  The operation unit 117 includes, in addition to the above-described zoom operation member, a release switch for instructing start of photographing, an FA zoom operation switch (first operation unit) for instructing start and end of FA zoom (framing support zoom), and the like. . A signal (operation signal) from the operation unit 117 is sent to a system control unit 114 (control means) described later. In addition to program data and image data, the memory 118 stores information such as setting information of the digital camera 100 and a zoom-in position in an FA zoom function described later. Here, the zoom-in position is a zoom return position that is a target when zooming in at the end of FA zooming, and details thereof will be described later.

  The system control unit 114 (control means) includes an arithmetic processing device such as a CPU (central processing unit), and sends a control command to each unit in response to an operation of a photographer (user) to thereby control the digital camera 100. Control the whole. The system control unit 114 executes various control programs stored in the memory 118, for example, programs for performing control of the image sensor 106, AE control, AF control, zoom control (including FA zoom processing), and the like.

  Next, control related to the FA zoom function in the system control unit 114 will be described. As shown in FIG. 1, the system control unit 114 includes a CZ control unit 119, an electronic zoom control unit 120, an FA zoom frame control unit 121, an FA zoom control unit 122, and a subject detection unit 123. .

  In order to maintain the in-focus state when the angle of view is changed by the optical zoom, in the case of a rear focus type lens barrel such as the lens barrel 101, the focus lens 103 is moved to an appropriate focus position according to the position of the zoom lens 102. Must be moved. Such control is called computer zoom (CZ) control.

  FIG. 2 is a relationship diagram between the focal length of the zoom lens and the focus position for each subject distance. In FIG. 2, the relationship between the focal length of the zoom lens and the in-focus focus position is graphed as a data table indicating each distance to the subject. In this embodiment, this data table is called a focus cam table. In FIG. 2, the horizontal axis indicates the focal length corresponding to the zoom position, and the vertical axis indicates the focus position. Next to each graph line, the distance from the digital camera 100 to the subject (subject distance) is shown.

  The system control unit 114 controls the focus lens driving unit 112 when performing AF control, and performs a scanning operation by moving the focus lens 103 within a predetermined range. A focus position that is a focal point is detected by a known method using a contrast evaluation value or the like obtained during this operation. The subject distance can be measured by referring to the focus cam table using the zoom position and the focus position at that time.

  The digital camera 100 has optical zoom and electronic zoom functions. The CZ control unit 119 and the zoom lens driving unit 113 perform optical zoom. The CZ control unit 119 detects the zoom position of the zoom lens 102 at every predetermined control period during the zoom operation. Then, the CZ control unit 119 drives the focus lens 103 so as to follow the focus cam table according to the zoom position. Thereby, the optical zoom can be performed while maintaining the in-focus state.

  On the other hand, the electronic zoom control unit 120 and the image memory 108 perform electronic zoom. The electronic zoom control unit 120 implements an electronic zoom function by cutting out a target area from the image data transferred to the image memory 108. In addition, the electronic zoom control unit 120 realizes a smooth electronic zoom display by causing the display unit 109 to display the image (video) to be captured by the image sensor 106 on the display unit 109 while gradually increasing a range to be extracted at a frame rate cycle.

  The subject detection unit 123 (subject detection means) detects a desired subject region from the image data stored in the image memory 108. In this embodiment, a subject detection method (face detection process, color detection process) for detecting a subject (face or object) based on face information or color information included in image data will be described.

  The face detection process is a process for detecting a face area existing in image data by a known algorithm. For example, the subject detection unit 123 extracts a feature amount (extracted feature amount) from a square partial region on the image data, and compares the feature amount with a face feature amount (reference feature amount) prepared in advance. If the correlation between the two (extracted feature value and reference feature value) exceeds a predetermined threshold, the subject detection unit 123 determines that the partial region is a face region. By repeating this determination while changing the combination of the size, the arrangement position, and the arrangement angle of the partial areas, various face areas existing in the image data can be detected.

  In the color detection process, the color information of the subject area designated according to the subject designation method described later is stored as a characteristic color. The color detection process is executed when the subject to be detected is an object (a “thing” other than a person). As the color information, RGB, luminance Y, and color differences RY, BY, which are output signals from the image processing circuit 107, are used. At the time of subject detection, the subject detection unit 123 divides the image data into a plurality of partial areas, and calculates an average value of luminance and color difference for each partial area. In addition, the subject detection unit 123 compares the characteristic color information stored in advance with the color information of each region at the time of subject detection, and sets a partial region in which the difference in luminance and color difference is equal to or less than a predetermined amount as a subject region candidate. A group of partial areas adjacent to each other in this area candidate is defined as the same color area, and an area where the same color area falls within a predetermined size range is defined as a final subject area.

  The subject detection unit 123 estimates the size of the subject region on the image data by using the subject distance information measured by the CZ control unit 119 and the focal length information of the zoom lens 102 together with the face information and the color information. be able to.

  Next, the FA zoom frame control unit 121 and the FA zoom control unit 122 for executing the FA zoom function will be described. The digital camera 100 according to the present embodiment includes two modes, a manual search mode (second mode) and an automatic tracking mode (first mode), as modes for executing FA zoom. These two modes are modes in which the photographer operates the FA zoom operation switch to catch the subject when the subject is out of the frame, or the digital camera 100 automatically detects the subject and adjusts the angle of view. It is different in whether it is a mode to support.

  As described above, in the present embodiment, the system control unit 114 (FA zoom control unit 122) performs FA zoom in either the first mode or the second mode. The second mode is a mode in which FA zooming is performed based on the operation of the operation unit 117 by the photographer. The first mode is a mode for performing FA zoom based on the detection result of the subject. The system control unit 114 (FA zoom control unit 122) sets the mode to either the first mode or the second mode based on the state of the operation unit 117. Hereinafter, an overview of the functions of each mode will be described.

  In a camera not equipped with the FA zoom function, the photographer needs to perform the following operations when the subject moves out of frame while framing in the telephoto state and waiting for a photo opportunity. That is, first, the subject is searched after zooming out by operating the zoom operation member. Then, after searching for the subject, the angle of view is adjusted by zooming until the desired angle of view is reached again.

  On the other hand, in the digital camera 100 having the manual search mode of the FA zoom function, if the subject loses sight in a state in which the angle of view is adjusted before photographing (hereinafter referred to as “photographing preparation state”), the photographer switches the FA zoom operation switch. Can be operated. This FA zoom operation switch is a switch assigned for the FA zoom function, and is a member different from the zoom operation member. By pressing the FA zoom operation switch, the FA zoom control unit 122 is instructed to start the FA zoom function. The FA zoom control unit 122 causes the memory 118 to store each zoom position (zoom-in position) of the electronic zoom and the optical zoom in response to an FA zoom start instruction from the FA zoom operation switch. Further, the FA zoom control unit 122 instructs the CZ control unit 119 or the electronic zoom control unit 120 to zoom out in the wide angle direction (wide angle side) according to the processing procedure shown in FIG. Also, the view angle is zoomed out (subject search state).

  Next, with reference to FIG. 3, each angle of view in the shooting preparation state and the subject search state will be described. FIG. 3 is an explanatory diagram of the angle of view in the subject search state and the angle of view in the shooting preparation state. 3A and 3D show the angle of view in the zoom-in state (shooting preparation state), and FIGS. 3B and 3C show the angle of view in the zoom-out state (subject search state). Is shown.

  When the subject is out of frame as shown in FIG. 3A, the photographer presses the FA zoom operation switch to search for the subject. While the FA zoom operation switch is pressed, the zoom-out state (subject search state) is maintained, and the FA zoom frame 300 indicating the zoom-in position is displayed on the display unit 109 so as to be superimposed on the image. When a desired subject is found in the zoom-out state (subject search state) as shown in FIG. 3 (B), framing is performed so that the subject fits inside the FA zoom frame 300 as shown in FIG. 3 (C). I do. Thereafter, the photographer releases the FA zoom operation switch to instruct the FA zoom control unit 122 to end the FA zoom. At this time, the FA zoom control unit 122 performs a zoom-in operation by electronic zoom or optical zoom up to the stored zoom position (zoom-in position) in the shooting preparation state. Thereby, the optimal framing state as shown in FIG. 3D is obtained.

  As shown in FIGS. 3B and 3C, the FA zoom frame control unit 121 calculates the size indicating the angle of view in the stored shooting preparation state, and the EVF center of the display unit 109 is calculated. The FA zoom frame 300 is displayed on the screen. The size of the FA zoom frame 300 is calculated based on the zoom magnification at the time of zooming out. For example, when the subject search state is entered by zooming out from the shooting preparation state at 2 × electronic zoom magnification and 3 × optical zoom magnification, the angle of view displayed on the EVF in the subject search state is (1 / 2) The FA zoom frame 300 having a size of (1/3) = 1/6 times is displayed. By such processing, the photographer can shoot at a desired angle of view while re-framing the subject out of the frame with a simple operation.

  Also, when shooting a scene where the subject is likely to be out of frame, such as when shooting a moving subject, the digital camera 100 can automatically prevent the out of frame by automatically changing the zoom position. In particular, when shooting in the telephoto state, since the angle of view is narrow, the subject may be out of frame even with a slight movement of the digital camera 100 due to camera shake or the like.

  The digital camera 100 of the present embodiment has an automatic tracking mode with an FA zoom function. For this reason, after the automatic tracking mode is set, an object to be photographed may be specified by performing an operation for specifying the object with a touch panel or the like. As a method for specifying a subject, a method for designating a subject near the center when a specific button is pressed, or a method for automatically selecting a main subject from subjects detected by the digital camera 100, other than touch panel operation. And so on.

  The subject detection unit 123 calculates the position and size of the subject region designated from the image memory 108 on the image data. It is possible to track the movement of the subject by continuously performing this on each sampled image data displayed as a live view. When the subject being tracked is detected in a zoom-out area, which will be described later, or when the subject is larger than a predetermined size (FIG. 3A), the FA zoom control unit with respect to the CZ control unit 119 or the electronic zoom control unit 120 122 instructs to zoom out in the wide-angle direction (FIG. 3B).

  When the subject is detected within the zoom-in area of the FA zoom frame 300 and falls within a predetermined size range (FIG. 3C), the zoom-in operation is performed to the zoom position indicated by the FA zoom frame 300 (FIG. 3). 3 (D)). With such processing, the photographer only needs to move the digital camera 100 so that the subject is displayed on the screen without worrying about the zoom operation. Even if the subject is about to be out of frame, the zoom position is automatically changed, so that the angle of view can be adjusted more easily. In this embodiment, the photographer can easily perform framing by performing the zoom-out operation and the zoom-in operation in the automatic tracking mode at the optimum timing.

  Next, the start conditions for the zoom-out operation and the zoom-in operation will be described with reference to FIGS. FIG. 4 is an explanatory diagram of processing for preventing the subject (thing) from being out of the frame. FIG. 5 is an explanatory diagram of processing for preventing a change in size (a change in size) within the screen of a subject (person).

  4 and 5, 400 is a mono tracking frame for tracking a subject (thing other than a person), and 500 is a face tracking frame for tracking a subject (person's face). In this embodiment, when the subject is applicable to both a person and a thing, the mono tracking frame 400 and the face tracking frame 500 may be collectively referred to as a subject tracking frame. The subject tracking frame is displayed on the EVF of the display unit 109 so as to surround the subject so that the subject designated by the photographer can be seen. The position and size of the subject tracking frame on the screen are calculated by the subject detection unit 123 based on the face information and the color information, and are updated at a frame rate cycle.

  FIG. 4 is an explanatory diagram of a process for preventing the subject (airplane) from being out of the screen. FIG. 4A shows a predetermined ratio with respect to the entire angle of view (the entire screen) displayed in the EVF. The outer region is also shown as a zoom-out region ZO. For example, when the center point of the screen is set to 0%, the entire screen is set to 100%, and a position that is 80% of the entire screen is set as the boundary of the zoom-out area ZO, the area of 80 to 100% in the entire screen is zoomed. It becomes the out area ZO. When a part of the mono tracking frame 400a enters the zoom-out area ZO, the zoom-out operation starts. The zoom magnification and zoom speed during the zoom-out operation are preset according to the size and moving speed of the subject. Further, the zoom magnification and the zoom speed may be appropriately calculated according to the size and moving speed of the subject. The zoom-out operation is executed according to the zoom magnification and zoom speed. Thereby, it is possible to effectively prevent the subject from being out of frame.

  FIG. 4B shows, as a zoom-in area ZI, an area inside a predetermined ratio with respect to the zoom-in angle of view indicated by the FA zoom frame 300 in the subject search state. For example, when the center point of the screen is set to 0%, the FA zoom frame 300 (zoom-in angle of view) is set to 100%, and a position that is 70% of the zoom-in angle of view is set as the boundary of the zoom-in area ZI, The entire area of 0 to 70% is the zoom-in area ZI. At this time, when the zoom magnification (zoom-out magnification) is 1/2, for example, the FA zoom frame 300 is 50% of the entire screen. Therefore, it can be said that the zoom-in area ZI is an area of 0 to 35% (= 70% × (1/2)) with respect to the entire screen. When the photographer changes the orientation of the digital camera 100 so that the mono tracking frame 400b fits within the zoom-in area ZI, the zoom-in operation starts.

  Here, the relationship between the lower limit ratio (80% in the above example) of the zoom-out area ZO and the upper limit ratio (70% in the above example) of the zoom-in area ZI will be described. The zoom-out operation is started when the mono tracking frame 400 is detected at the position near the lower limit ratio of the zoom-out area ZO in the shooting preparation state, and the direction of the digital camera 100 itself is changed with the subject stopped at that position. Think about when not. Here, when the lower limit ratio of the zoom-out area ZO and the upper limit ratio of the zoom-in area ZI are set to the same ratio, almost the entire mono tracking frame 400 is within the zoom-in area ZI immediately after the zoom-out operation. It becomes a state. Further, when the lower limit ratio of the zoom-out area ZO is set to be equal to or lower than the upper limit ratio of the zoom-in area ZI, immediately after the zoom-out operation, the entire mono tracking frame 400 is within the zoom-in area ZI, and the zoom-in operation is immediately performed. Start. That is, a hunting phenomenon that repeats the zoom-out operation and the zoom-in operation occurs. Therefore, in order to prevent such a hunting phenomenon, the lower limit ratio of the zoom-out area ZO is set to be larger than the upper limit ratio of the zoom-in area ZI (ZO lower limit ratio> ZI upper limit ratio).

  FIG. 5 shows an example in which when the subject (person) approaches the digital camera 100, the digital camera 100 performs a zoom operation so that the proportion of the subject is automatically within a predetermined ratio. The face tracking frame 500 (500a, 500b, 500c) is displayed so as to surround the face area as a characteristic area of the subject (person). Here, the size of the face tracking frame 500 is described as the subject size (the size of the face tracking frame 500 = the subject size). FIG. 5A shows the angle of view when a subject is designated according to a subject designation method described later. In this embodiment, the size of the face tracking frame 500a at the time of subject designation is stored in advance in the memory 118 as a reference subject size.

  FIG. 5B shows the angle of view when the subject approaches the digital camera 100 without changing the zoom position from the state of FIG. For example, a size that is 150% of the size of the face tracking frame 500a that is the reference subject size is set as the start size of the zoom-out operation. When the relationship of the subject tracking frame (face tracking frame) is such that the face tracking frame 500b> the face tracking frame 500a × 150%, the zoom-out operation starts.

  FIG. 5C shows an image obtained when the zoom magnification is zoomed out in the wide-angle direction by 1 / 1.5 times equivalent to the amount of change in the subject size changed from the state of FIG. 5A to FIG. 5B. A corner and a face tracking frame 500c at this time are shown. Thereafter, when the subject further approaches, the subject can be kept within a predetermined ratio by performing the zoom-out operation until the optical zoom position reaches the wide end. For this reason, the photographer can concentrate on the operation of the release switch. 4 and 5, the processing for preventing frame-out when the subject is a mono object and the processing for keeping the size of the subject within a predetermined ratio when the subject is a person have been described. The zoom operation start determination process may be any combination.

  Next, an outline of processing of the FA zoom function will be described with reference to FIG. FIG. 6 is a flowchart showing processing of the FA zoom function. The FA zoom function of FIG. 6 is performed based on a command from the FA zoom control unit 122.

  First, in step S100, the FA zoom control unit 122 determines whether or not to start FA zoom (FA zoom start determination). In the FA zoom start determination, the FA zoom control unit 122 performs mode determination as to whether the mode is the manual search mode or the automatic tracking mode. In the manual search mode, the FA zoom start determination is performed based on the state of the FA zoom operation switch of the operation unit 117. In the automatic tracking mode, the FA zoom start determination is performed based on the subject detection result. The mode determination will be described later. If it is determined in step S100 that the FA zoom is started, the process proceeds to step S101.

  In step S101, the FA zoom control unit 122 stores the optical zoom position and the electronic zoom position (zoom return position) at the start of zoom-out. The FA zoom control unit 122 instructs the CZ control unit 119 or the electronic zoom control unit 120 with a predetermined drive amount to perform the FA zoom-out operation. When the FA zoom-out operation ends, the process proceeds to step S102.

  In step S102, the FA zoom frame control unit 121 displays the FA zoom frame 300 (index) indicating the stored zoom return position on the display unit 109 (FA zoom frame display). Using the FA zoom frame 300 as a guide, the photographer performs a framing operation so that the subject to be photographed is placed near the center of the screen. At this time, if the subject does not fit within the FA zoom frame 300 or if the subject is too small, the process proceeds to step S103. In step S103, the FA zoom frame 300 is changed to an appropriate size, and the stored zoom position information is updated (zoom return position change).

  Subsequently, in step S104, the FA zoom control unit 122 determines whether or not to end the FA zoom (FA zoom end determination). In the FA zoom end determination, when the FA zoom start mode is the manual search mode, the FA zoom end is determined based on the state of the FA zoom operation switch of the operation unit 117. If the FA zoom start mode is the automatic tracking mode, the end of the FA zoom is determined based on the subject detection result. If the FA zoom end determination is made in the FA zoom end determination in step S104, the process proceeds to step S105.

  In step S105, the FA zoom control unit 122 instructs the CZ control unit 119 or the electronic zoom control unit 120 to drive to the stored optical zoom position and electronic zoom position (zoom position), and performs the FA zoom-in operation. Thereby, the FA zoom function ends.

  Next, each process of the FA zoom function shown in FIG. 6 will be described in detail with reference to FIGS. 7A to 10. FIG. 7A is a flowchart of the FA zoom start determination (step S100) of FIG. In step S200, the FA zoom control unit 122 determines whether or not the FA zoom operation switch of the operation unit 117 is pressed. When the FA zoom operation switch is pressed, in step S201, the FA zoom control unit 122 measures the pressing time of the FA zoom operation switch.

  In step S201, the FA zoom control unit 122 determines whether or not the FA zoom operation switch is released within a predetermined time after the FA zoom operation switch is pressed. That is, the FA zoom control unit 122 determines whether the FA zoom operation switch is long-pressed or short-pressed, and changes the mode to be executed depending on the pressing time. When the FA zoom operation switch is pressed long (second operation), the process proceeds to step S202, the manual search mode is selected, and the selected mode is stored in the memory 118. On the other hand, when the FA zoom operation switch is short-pressed (first operation), the process proceeds to step S203, the automatic tracking mode is selected, and the selected mode is stored in the memory 118.

  In the manual search mode, the process proceeds to step S208 when a predetermined time elapses after the FA zoom operation switch is continuously pressed since the start of pressing the FA zoom operation switch, that is, when it is determined that the long press is performed. It is determined to start. On the other hand, in the case of the automatic tracking mode, the process proceeds to step S204 to perform subject specification processing for tracking. That is, when the pressing time (operation time) of the operation unit 117 (FA zoom operation switch) is longer than the first time, the FA zoom control unit 122 (system control unit 114) sets the mode to the second mode (manual search mode). ). On the other hand, when the pressing time of the operation unit 117 is less than the first time, the FA zoom control unit 122 sets the mode to the first mode (automatic tracking mode).

  In the present embodiment, the manual search mode or the automatic tracking mode is determined based on the switch pressing time, but the mode determination method is not limited to this as long as the zoom operation switch is used. For example, when the zoom operation switch is pressed once and then pressed again within a predetermined time, any mode may be determined. Moreover, you may make it determine in any mode by simultaneous operation with a zoom operation switch and another member. In addition, the zoom operation switch is not limited to a pressing type, but instead, a rotatable ring member or the like may be used to instruct the FA zoom operation.

  Here, with reference to FIGS. 8A to 8C, step S204 (subject designation processing) in FIG. 7A will be described. FIG. 8A shows a flowchart of an operation example in which a subject displayed on the display unit 109 is touched and specified using a touch panel which is a member constituting the operation unit 117. In step S300, the FA zoom control unit 122 determines whether the touch panel has been pressed. When the touch panel is pressed, the process proceeds to step S301, and the FA zoom control unit 122 acquires a touched position (touch position). Subsequently, in step S302, the FA zoom control unit 122 notifies the subject detection unit 123 of the touch position, and the subject detection unit 123 performs face detection near the touch position. If a face is detected near the touch position, it is determined that the main subject is a person, and the process proceeds to step S303. In step S <b> 303, the FA zoom control unit 122 stores the face information of the person who is the target of automatic tracking in the memory 118. Specific face information includes the face size, face detection position, face orientation, etc. when the subject is designated. Further, in a camera having a face authentication function, an authentication ID is also stored.

  On the other hand, if no face is detected in the vicinity of the touch position in step S302, it is determined that the main subject is something other than a person, and the process proceeds to step S304. In step S304, the FA zoom control unit 122 stores the characteristic color in the vicinity of the touch position in the memory 118 as color information for the automatic tracking target. Specific color information includes the color and brightness of the characteristic color when the subject is designated, the value of the color difference, the size of the same color area, the center of gravity position of the same color area, and the like. The face information and color information are collectively referred to as subject information (subject size, subject detection position, etc.) in the following description.

  When the subject information is stored in step S303 or step S304, the process proceeds to step S305. In step S305, the FA zoom control unit 122 displays a subject tracking frame (mono tracking frame 400 or face tracking frame 500) having a size corresponding to the subject size with the subject detection position as the center on the display unit 109. Thus, the subject designation process ends.

  As described above, when the mode is the automatic tracking mode (first mode), the system control unit 114 (subject detection unit 123) performs the subject detection at the position designated by the photographer on the display unit 109 or in the vicinity of the designated position. Is detected. Then, the system control unit 114 (FA zoom control unit 122) displays the subject tracking frame on the display unit 109. According to the flowchart of FIG. 8A, the photographer can easily specify the subject to be tracked by an intuitive specification method.

  FIG. 8B shows a flowchart of an operation example in which a subject is designated by a switch (subject designation switch) different from the FA zoom operation switch which is a member constituting the operation unit 117. First, in step S <b> 306, the FA zoom control unit 122 displays a frame serving as a guide for specifying the subject near the center of the screen of the display unit 109. The photographer adjusts the direction of the camera so that the subject to be tracked is located near the center using this frame as a guide. Subsequently, in step S307, the FA zoom control unit 122 determines whether or not the subject specifying switch has been pressed. If the subject designation switch is pressed, the process proceeds to step S308.

  In step S308, the subject detection unit 123 performs face detection near the center of the screen. If a face is detected near the center of the screen, it is determined that the main subject is a person, and the process proceeds to step S309. On the other hand, if no face is detected near the center of the screen, the main subject is determined to be something other than a person, and the process proceeds to step S310. When the subject information is stored in step S309 or step S310, the process proceeds to step S311. In step S311, the subject tracking frame (mono tracking frame 400 or face tracking frame 500) is displayed, and the subject designation process is terminated. The basic processes in steps S309, S310, and S311 are the same as steps S303, S304, and S305 in FIG. 8A, respectively.

  As described above, when the mode is the automatic tracking mode (first mode), the system control unit 114 (subject detection unit 123) detects the subject at the screen center position of the display unit 109 or in the vicinity of the screen center position. The system control unit 114 (FA zoom control unit 122) displays a subject tracking frame indicating the position of the subject on the display unit 109. According to the flowchart of FIG. 8B, it is possible to easily specify a subject even in a camera not equipped with an operation member such as a touch panel.

  FIG. 8C shows a flowchart of an example in which the subject to be tracked is automatically selected from the faces detected when the FA zoom operation switch which is a member constituting the operation unit 117 is pressed for a short time. First, in step S312, the subject detection unit 123 performs face detection on the entire screen. If even one person is detected on the entire screen, the main subject is determined to be a person, and the process proceeds to step S313. In step S313, if the detected face is one person, the subject detection unit 123 sets that face as the main face. When there are a plurality of detected faces, the subject detection unit 123 selects a main face as a subject to be tracked from the faces. As a determination criterion for main face selection, for example, a face whose face detection position is located closer to the center of the screen is used. If there are a plurality of faces at the same position, a larger face is selected as the main face. In addition, in a camera having a face authentication function, if there is a face registered for authentication, that face is given priority as the main face. In step S314, the FA zoom control unit 122 stores the face information of the selected main face in the memory 118. When the face information is stored in step S314, the process proceeds to step S315, and the face tracking frame 500 is displayed.

  Subsequently, in step S316, if the main face automatically selected from the plurality of faces is a face not intended by the photographer, the photographer can change the main face. At this time, when a switch on the operation unit 117 (which may be an FA zoom operation switch or another switch) is pressed, the main face is changed to a face not selected as the main face from the detected faces, and the face tracking frame 500 is changed. Update. When the main face is changed, the process proceeds to step S314 again, and the stored face information is updated. In step S315, the face tracking frame 500 is changed to the size and detection position of the newly selected main face.

  On the other hand, if no face is detected on the entire screen in step S312, it is determined that the main subject is something other than a person, and the process proceeds to step S317. In step S317, the FA zoom control unit 122 stores the characteristic color near the center of the screen in the memory 118 as the color information for the automatic tracking target. When the color information is stored in step S317, the process proceeds to step S318, and the mono tracking frame 400 is displayed. Thus, the subject designation process ends. Basic processes in steps S314, S317, and S315 (S318) are the same as steps S303, S304, and S305 in FIG. 8A, respectively.

  As described above, the system control unit 114 (subject detection unit 123) performs face detection on the entire screen of the display unit 109 when the mode is the automatic tracking mode (first mode). When a plurality of faces are detected, the system control unit 114 (FA zoom control unit 122) displays a subject tracking frame indicating the position of the first face as a subject on the display unit 109 from among the plurality of faces. In addition, when the first face is changed to the second face as the subject, the system control unit 114 (FA zoom control unit 122) displays a subject tracking frame indicating the position of the second face on the display unit 109. According to the flowchart of FIG. 8C, the subject can be easily specified with a smaller number of operations.

  When the subject designation process shown in any of FIGS. 8A to 8C is completed, the process proceeds to step S205 in FIG. 7A. In steps S205 to S207, the FA zoom control unit 122 determines whether or not to start FA zoom based on the reference subject information at the time of subject designation and the subject information periodically detected. This determination is repeated at a predetermined control cycle until the condition for starting FA zoom is satisfied.

  In step S205, the subject detection unit 123 displays a subject having the same characteristics as the reference subject information from the entire screen, that is, the face is the same when the reference subject is a person, and the same characteristic color when the subject is a mono object. It is determined whether or not it is detected. If the subject to be tracked is not detected, the process proceeds to step S209. On the other hand, when the subject to be tracked is detected, the process proceeds to step S206. In step S206, it is determined whether or not the subject tracking frame of the subject to be tracked is included in the zoom-out area ZO (outside the first area in the image) shown in FIG. If the tracking frame is included in the zoom-out area ZO in step S206, that is, if there is a high possibility that the subject is near the periphery of the screen and the frame is out, the process proceeds to step S208, and FA zoom (zoom-out operation) is started.

  On the other hand, if the subject tracking frame is not included in the zoom-out area ZO in step S206, that is, if the subject is captured near the center of the screen, the process proceeds to step S207. In step S207, the subject size in the reference subject information is compared with the subject size detected in step S205. When the size of the subject detected in step S205 is equal to or larger than a predetermined size with respect to the size of the reference subject (the size of the subject has greatly changed by a predetermined size or more), that is, the ratio of the subject to the screen is equal to or larger than the predetermined value. If so, the process proceeds to step S208, and FA zooming starts. If it is determined in step S208 that the FA zoom is started, the process proceeds to step S101 in FIG. 6 to start the zoom-out operation.

  On the other hand, if no subject is detected in step S205, the FA zoom control unit 122 determines whether a predetermined time has elapsed in step S209. If the predetermined time has not elapsed, the FA zoom control unit 122 determines whether or not the FA zoom operation switch has been pressed in step S210. Also, when the subject detected in step S205 is near the center of the screen and the subject size is less than a predetermined multiple of the reference subject size (“no” in step S207), the FA zoom operation switch is pressed in step S210. judge. If the FA zoom operation switch is not pressed in step S210, the process returns to the subject detection process in step S205, and the loop of steps S205, S209, and S210 is repeated. If a predetermined time has elapsed in the state where no subject is detected in step S209, the process proceeds to step S204, and subject designation processing is performed again. If the FA zoom operation switch is pressed in step S210, the process proceeds to step S211.

In step S211, it is determined whether or not the FA zoom operation switch has been released within a predetermined time after being pressed. If the FA zoom operation switch is released within a predetermined time, the automatic zoom mode is canceled and the FA zoom function is terminated. On the other hand, if the switch is not opened within the predetermined time, the process proceeds to step S202, and the manual search mode is stored. That is, in this embodiment, when the FA zoom operation switch is pressed for a predetermined time or more during the automatic tracking mode, the FA mode is changed to the manual search mode.

  FIG. 9A is a flowchart of step S101 (FA zoom-out operation) in FIG. First, in step S400, the FA zoom control unit 122 acquires the optical zoom position in the shooting preparation state from the CZ control unit 119, and acquires the electronic zoom position from the electronic zoom control unit 120. Further, the FA zoom control unit 122 stores the data of the optical zoom position and the electronic zoom position in the memory 118. The optical zoom position represents the position of the zoom lens corresponding to the zoom magnification that can be changed by the optical zoom function. The electronic zoom position represents a control position corresponding to the magnification of image enlargement and reduction that can be changed by the electronic zoom function. In the manual search mode, the zoom position stored here is set as the zoom return position (second zoom position).

  Subsequently, in step S <b> 401, the FA zoom control unit 122 acquires the zoom-out drive amount stored in the memory 118. The zoom-out drive amount in the automatic tracking mode is set according to the detected subject size. Specifically, the zoom-out drive amount is set smaller as the subject size is smaller. In consideration of the minimum size that can be detected by the subject, if the size of the subject is smaller than a predetermined size, the zoom-out is not performed. Further, the zoom-out drive amount in the manual search mode may be changed by the photographer by an operation from the setting menu.

  In step S402, the FA zoom control unit 122 determines whether the zoom state in the shooting preparation state is an electronic zoom state. In a general zoom operation, when the zoom operation switch of the operation unit 117 is pressed, if the optical zoom position is between the wide end and the tele end, the CZ control unit 119 drives the optical zoom. When the optical zoom position is at the telephoto end and an operation instruction is further given in the telephoto direction, the electronic zoom control unit 120 drives the electronic zoom to enable super telephoto shooting. In order to maintain consistency between the zoom operation by the operation of the zoom operation switch and the FA zoom operation, even in the FA zoom operation, when the zoom state in the shooting preparation state is the electronic zoom state, the electronic zoom is driven first. That is, it is determined whether or not the zoom position stored in the memory 118 is within the zoom area in the zoom state to be prioritized. In this embodiment, since electronic zoom is prioritized, it is determined in step S402 whether or not the zoom position is in the electronic zoom area. If the zoom state at the start of FA zoom is the electronic zoom state, the process proceeds to step S403.

  In step S403, the FA zoom control unit 122 calculates the zoom-out position of the electronic zoom based on the electronic zoom position acquired in step S400 and the zoom-out drive amount acquired in step S401, and the electronic zoom control unit. Set to 120. Subsequently, in step S404, the FA zoom control unit 122 instructs the electronic zoom control unit 120 to perform the scaling process up to the zoom-out position of the electronic zoom set in step S403. The electronic zoom control unit 120 performs a zoom-out operation by electronic zoom. When it is determined in step S402 that the zoom position in the shooting preparation state is in the optical zoom region, or after an electronic zoom zoom-out operation is performed in step S404, the process proceeds to step S405.

  In step S405, the FA zoom control unit 122 determines whether or not zoom-out by optical zoom is further necessary. That is, if the electronic zoom alone is not sufficient for the zoom drive of the set zoom-out drive amount, it is necessary to supplement the remaining zoom-out drive amount with the optical zoom. If it is determined that zoom-out by optical zoom is necessary, the process proceeds to step S406. In step S406, the FA zoom control unit 122 calculates the zoom-out position of the optical zoom based on the optical zoom position and the zoom-out drive amount, and sets the calculated zoom-out position in the CZ control unit 119.

  In step S407, the FA zoom control unit 122 instructs the CZ control unit 119 to perform zoom driving to the zoom-out position of the optical zoom set in S406. The CZ control unit 119 controls the zoom lens driving unit 113 to perform a zoom-out operation of optical zoom. When the FA zoom-out operation ends, the process proceeds to step S102 in FIG. In step S102, the FA zoom control unit 122 instructs the FA zoom frame control unit 121 to display the FA zoom frame 300 corresponding to the zoom return position. In the automatic tracking mode, the zoom position at the predetermined magnification telephoto side with respect to the current angle of view (zoom position before movement) is stored in the memory 118 as the zoom return position (first zoom position), and the corresponding image is also displayed. Corners are displayed as FA zoom frames. On the other hand, in the manual search mode, the angle of view corresponding to the zoom position at the start of FA zoom-out stored in step S400 of FIG. 9A is displayed as the FA zoom frame. When the FA zoom frame is displayed, the process proceeds to zoom return position change processing in step S103 as the subject search state.

  FIG. 10 is a flowchart of step S103 (change zoom return position) in FIG. First, in step S500, it is determined whether the mode stored in step S202 or step S203 in FIG. 7A is the automatic tracking mode or the manual search mode. If the stored mode is the manual search mode, the process proceeds to step S506. In the manual search mode, it is possible for the photographer to change the zoom return position and the FA zoom frame 300 stored in step S400 of FIG. 9A by operating the zoom lever. In step S506, it is determined whether or not the zoom lever of the operation unit 117 has been operated in either the telephoto direction or the wide-angle direction. If the zoom lever has been operated, the process proceeds to step S507. If the zoom lever operation is not performed, this flow ends.

  In step S507, the zoom return position stored in the memory 118 in step S400 of FIG. 9A before the zoom-out operation is changed by a predetermined amount in the telephoto direction or the wide-angle direction according to the operation direction determined in step S506. Update to Subsequently, in step S508, the display of the FA zoom frame 300 is updated to indicate the angle of view corresponding to the zoom return position (second zoom position) updated in step S507, and the process proceeds to step S509.

  In step S509, it is determined whether or not the zoom lever of the operation unit 117 has been released. If the zoom lever is not released, the processes in steps S507 and S508 are repeated. On the other hand, when the zoom lever is released, this flow ends.

  With the above processing, even when the size of the subject displayed on the display unit 109 changes due to the subject approaching after the zoom-out operation, the photographer can change the zoom return position with a simple operation. The framing operation becomes easier.

  On the other hand, when the mode is determined to be the automatic tracking mode in step S500, the process proceeds to step S501. In the automatic tracking mode, the zoom return position and the FA zoom frame 300 can be automatically changed based on the subject size detected by the camera so that the subject falls within an appropriate angle of view after the zoom-in operation. Here, “appropriate angle of view” is to hold an angle of view in which the ratio of the subject to the entire screen is approximately the same as the reference subject size specified in step S204 of FIG. 7A. . In step S501, it is determined whether or not a subject having face information or color information corresponding to the reference subject information is detected. If the subject to be tracked is not detected, the process proceeds to step S510, and the FA zoom control unit 122 determines whether or not a predetermined time has passed without the subject being detected. If the predetermined time has not elapsed, the present flow is terminated. If the predetermined time has elapsed, the process proceeds to step S204 in FIG. 7A to perform subject designation processing again.

  On the other hand, when the subject to be tracked is detected, the process proceeds to step S502. In step S502, the ratio of the reference subject size to the entire screen is compared with the ratio of the subject detected in step S501 to the FA zoom frame 300, that is, the angle of view after the zoom-in operation. As a result of the comparison, when the difference between the two ratios is within a predetermined range, this flow ends. On the other hand, if the difference between the two ratios exceeds the predetermined range, the process proceeds to step S503. In step S503, the zoom return position stored in the memory 118 is updated. Specifically, when the subject size detected in step S511 is larger than the reference subject size, the zoom return position is updated by a predetermined amount in the wide angle direction. On the other hand, when the subject size is smaller than the reference subject size, the zoom return position is updated by a predetermined amount in the telephoto direction. Then, the process proceeds to step S504. In step S504, the display of the FA zoom frame 300 is updated to show the same angle of view as the zoom return position (first zoom position) updated in step S503, and the process proceeds to step S505.

  In step S505, it is determined whether the difference between the ratio of the reference subject size to the entire screen and the ratio of the subject to the FA zoom frame 300 indicating the updated zoom return position is within a predetermined range. If the difference between the ratio of the subject to the FA zoom frame 300 and the ratio of the reference subject exceeds the predetermined range even when the zoom return position is updated by a predetermined amount, steps S503, S504, and S505 are further performed so as to change the zoom return position. Repeat the process. On the other hand, when the difference between the subject with respect to the FA zoom frame 300 and the ratio of the reference subject is within the predetermined range, this flow ends.

  As described above, in this embodiment, the display unit 109 performs the FA zoom-out operation in the framing assistance zoom, and displays the FA zoom frame indicating the zoom position at the start of zoom-out. When the mode is the manual search mode (second mode), the system control unit 114 (FA zoom control unit 122) changes the zoom return position and the FA zoom frame display based on the operation of the operation unit 117. On the other hand, when the mode is the automatic tracking mode (first mode), the system control unit 114 performs the zoom-out operation based on the detection result of the subject, and the FA zoom frame corresponding to the zoom position on the predetermined magnification telephoto side. Is displayed. Further, the zoom return position and the FA zoom frame display are changed based on the detection result of the subject.

  With the above processing, the zoom return position can be changed even when the size of the subject displayed on the display unit 109 changes due to the subject approaching after the FA zoom-out operation. It becomes easier. FIG. 10 shows an example in which the zoom return position is changed by manual operation of the zoom lever in the manual search mode, and is automatically changed according to the subject size in the automatic tracking mode. However, the automatic return or automatic tracking in the manual search mode is shown. It is good also as a structure which can be changed manually at the time of a mode.

  FIG. 7B is a flowchart of step S104 (FA zoom end determination) in FIG. First, in step S212, it is determined in the FA zoom start determination whether the mode stored in step S202 or step S203 is the automatic tracking mode or the manual search mode. When the mode is the manual search mode, the process proceeds to step S216. When the mode is the manual search mode, the pressed state continues after detecting the pressing of the FA zoom operation switch in step S200 or S210 during the subject search state.

  In step S216, it is determined whether or not the FA zoom operation switch is released from the long-pressed state. When the FA zoom operation switch is opened (third operation), the process proceeds to step S213, and the end of the FA zoom is determined. That is, the FA zoom control unit 122 starts a zoom-in operation when the pressing of the operation unit 117 is completed in the manual search mode (second mode), and ends the framing support zoom. On the other hand, if the FA zoom operation switch is not opened in step S210, the subject search state continues, so the process returns to step S500 in FIG. 10 to repeat the zoom return position change flow.

  On the other hand, when the mode is the automatic tracking mode in step S212, the process proceeds to step S213. Whether or not a subject having the same characteristics as the reference subject information specified in step S204 is detected in step S213, that is, a face is detected when the reference subject is a person, and a corresponding feature color is detected when the subject is a thing. Determine. If the subject to be tracked is not detected, the process proceeds to step S217. On the other hand, when the subject to be tracked is detected, the process proceeds to step S214. In step S214, it is determined whether or not the subject tracking frame of the subject to be tracked is included in the zoom-in area ZI (second area in the image) shown in FIG. If the tracking frame (subject) is included in the zoom-in area ZI in step S214, that is, if the subject is captured so that the subject size is near the center of the screen and within the angle of view at the zoom return position, step S215 is performed. Proceed to When it is determined in step S215 that the FA zoom has ended, the process proceeds to step S105 in FIG. 6 to start a zoom-in operation.

  On the other hand, if no subject is detected in step S213, the FA zoom control unit 122 determines whether a predetermined time has elapsed in step S217. If the predetermined time has not elapsed, the FA zoom control unit 122 determines whether or not the FA zoom operation switch has been pressed in step S218. Even when the subject tracking frame of the subject detected in step S213 is not included in the zoom-in area ZI (no in step S214), it is determined in step S218 that the FA zoom operation switch has been pressed. If the FA zoom operation switch is not pressed in step S218, the process returns to step S500 in FIG. 10 to repeat the zoom return position change process. If a predetermined time has passed in a state where no subject is detected in step S217, the process proceeds to step S204 in FIG. 7A to perform subject designation processing again. If the FA zoom operation switch is pressed in step S218, the process proceeds to step S219.

In step S219, it is determined whether or not the FA zoom operation switch has been released within a predetermined time after being pressed. If the FA zoom operation switch is released within a predetermined time, the automatic zoom mode is canceled and the FA zoom function is terminated. On the other hand, if the switch is not opened within the predetermined time, the process proceeds to step S202 in FIG. 7A and the manual search mode is stored. That is, in this embodiment, when the FA zoom operation switch is pressed for a predetermined time or more during the automatic tracking mode, the FA mode is changed to the manual search mode.

  FIG. 9B is a flowchart of step S105 (zoom-in operation) in FIG. First, in step S <b> 408, the FA zoom control unit 122 reads the stored zoom position (zoom return position) data from the memory 118. Subsequently, in step S409, the FA zoom control unit 122 determines whether or not the zoom state in the subject search state is the optical zoom state. If the zoom state is the optical zoom state, the process proceeds to step S410 in order to zoom in with priority on the optical zoom. On the other hand, when the zoom state is the electronic zoom state, the process proceeds to step S412 in order to perform zoom-in only with the electronic zoom.

  In step S410, the FA zoom control unit 122 sets the zoom-in position by optical zoom in the CZ control unit 119 among the zoom return positions read in step S408. Subsequently, in step S411, the FA zoom control unit 122 instructs the CZ control unit 119 to drive the zoom lens 102 to the zoom-in position by the optical zoom set in step S410. Then, the CZ control unit 119 controls the zoom lens driving unit 113 to perform a zoom-in operation with optical zoom.

  When it is determined in step S409 that the zoom position in the subject search state is within the electronic zoom area, or after the zoom-in operation is performed with the optical zoom in step S411, the process proceeds to step S412. In step S <b> 412, the FA zoom control unit 122 determines whether it is necessary to further zoom in by electronic zoom. If zooming in by electronic zoom is necessary, the process proceeds to step S413. On the other hand, when the zoom-in by the electronic zoom is not necessary, the photographing preparation state is set and the process ends.

  In step S413, the FA zoom control unit 122 sets the electronic zoom control unit 120 to a zoom-in position by electronic zoom among the zoom return positions read in step S408. Subsequently, in step S414, the FA zoom control unit 122 instructs the electronic zoom control unit 120 to perform the scaling process up to the zoom-in position by the electronic zoom set in step S413. Then, the electronic zoom control unit 120 performs an electronic zoom-in operation, and thereby returns to the zoom return position. When this operation is completed, the zoom-in operation is completed in the shooting preparation state.

(Other embodiments)
The object of the present invention can also be achieved as follows. That is, a storage medium in which a program code of software in which a procedure for realizing the functions of the above-described embodiments is described is recorded is supplied to the system or apparatus. A computer (or CPU, MPU, etc.) of the system or apparatus reads out and executes the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the novel function of the present invention, and the storage medium and program storing the program code constitute the present invention.

  Examples of the storage medium for supplying the program code include a flexible disk, a hard disk, an optical disk, and a magneto-optical disk. Further, a CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD-R, magnetic tape, nonvolatile memory card, ROM, or the like can also be used.

  Further, by making the program code read by the computer executable, the functions of the above-described embodiments are realized. Furthermore, when the OS (operating system) running on the computer performs part or all of the actual processing based on the instruction of the program code, the functions of the above-described embodiments are realized by the processing. Is also included.

  Furthermore, the following cases are also included. First, the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program code, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing.

  Further, the present invention is not limited to a device mainly intended for shooting such as a digital camera, and includes an imaging device such as a mobile phone, a personal computer (laptop type, desktop type, tablet type, etc.), a game machine, or the like. Applicable to any device to be connected. Therefore, the “imaging device” in this specification is intended to include any electronic device having an imaging function.

  According to the present embodiment, it is possible to provide an imaging apparatus, an imaging system, an imaging apparatus control method, a program, and a storage medium that can easily switch between execution of automatic or manual framing assistance zoom.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

  6 to 10 show examples in which the zoom-out operation is performed after the zoom-out operation is performed in the automatic tracking mode. However, only the zoom-out operation may be performed. Similarly, when the subject is within a predetermined area, the zoom-out operation may be performed by a predetermined amount without performing the zoom-out operation. Further, as an application scene, it may be performed not only during angle adjustment for still image shooting but also during angle adjustment during moving image recording.

  The system control unit 114 (FA zoom control unit 122) switches the mode from the automatic tracking mode when the operation unit 117 is pressed for a time longer than the second time while the mode is set to the automatic tracking mode. You can also change to manual search mode.

100 Digital Camera 109 Display Unit 114 System Control Unit 117 Operation Unit 122 FA Zoom Control Unit 123 Subject Detection Unit

Claims (17)

A first operation unit for the user to instruct a change in the angle of view;
Subject detection means for detecting a subject from an image;
Control means for controlling the angle of view in accordance with the operation of the first operation unit,
The control means executes a first mode in response to a first operation via the first operation unit, and executes a second mode in response to a second operation different from the first operation. ,
In the first mode, the control means controls to change the angle of view based on the detection result of the subject detection means,
In the second mode, the control means controls to change the angle of view to the wide angle side according to the second operation ,
When the second operation is executed during execution of the first mode , the control device shifts from the first mode to the second mode . Having display means for displaying an image;
In the first mode, when the subject detected by the subject detection means satisfies a predetermined condition, the control means controls to change the angle of view to the wide angle side and sets the angle of view before the change to the first angle of view. 2. The control device according to claim 1, wherein the control unit controls the display unit so as to display the first angle of view.   In the second mode, the control means controls to change the angle of view to the wide angle side according to the second operation, sets the angle of view before the change to the second angle of view, and The control device according to claim 2, wherein the display unit is controlled so as to display the angle of view.   In the second mode, the control means changes the angle of view according to a third operation via the first operation unit from a state where the angle of view is changed to the wide angle side according to the second operation. The control device according to claim 3, wherein control is performed so as to change to the second angle of view.   5. The control apparatus according to claim 2, wherein the predetermined condition is that the subject detected by the subject detection unit is included outside the first region in the image. 6. .   5. The control device according to claim 2, wherein the predetermined condition is that a size of a subject detected by the subject detection unit is greatly changed by a predetermined value or more. 6.   The control means is configured to display the angle of view when the subject detected by the subject detection means is included in the second region in the image while displaying the first angle of view. The control device according to claim 2, wherein control is performed so that the angle of view is changed to a predetermined angle of view.   The said control means determines either the said 1st operation or the said 2nd operation according to the operation time of the said 1st operation part, The any one of Claim 1 thru | or 7 characterized by the above-mentioned. The control device described in 1.   9. The subject detection unit according to claim 1, wherein the subject detection unit sets a subject detected based on an area designated by a user as a reference subject as a detection target in the first mode. The control device described in 1.   10. The subject detection unit according to claim 1, wherein the subject detection unit sets a subject detected in a predetermined area on the screen as a reference subject as a detection target in the first mode. Control device.   11. The object detection unit according to claim 1, wherein the subject detection unit selects a main subject when a plurality of subjects are detected, and sets the main subject as a reference subject as a detection target in the first mode. The control device according to any one of claims.   The control device according to claim 1, wherein the control unit optically controls a change in a field angle by changing a focal length.   The control device according to any one of claims 1 to 12, wherein the control unit controls a change in an angle of view by an electronic zoom. A lens device;
An imaging system comprising: an imaging device comprising the control device according to claim 1. A receiving step for receiving an instruction to change the angle of view via the first operation unit;
A detection step of detecting a subject from the image;
A control step for controlling the angle of view in accordance with the operation of the first operation unit,
In the control step, a first mode is executed in response to a first operation via the first operation unit, and a second mode is executed in response to a second operation different from the first operation. ,
In the first mode, control to change the angle of view based on the detection result in the detection step,
In the second mode, control to change the angle of view to the wide angle side according to the second operation ,
An angle-of-view control method , wherein when the second operation is executed during execution of the first mode, the mode is shifted from the first mode to the second mode .   A program configured to cause a computer to execute the angle-of-view control method according to claim 15.   A storage medium storing the program according to claim 16.