JP6862225B2 - Imaging device, control method of imaging device, and program - Google Patents

Description

The present invention relates to an image pickup apparatus, a control method for the image pickup apparatus, and a program.

In an imaging device having a function of capturing a moving image, a technique has been proposed in which the contrast of the image is evaluated during the imaging of the moving image to perform autofocus (AF) control (see, for example, Patent Document 1). Further, when capturing a moving image in which the subject moves smoothly, it is desirable to capture the image with a long exposure time.

Japanese Unexamined Patent Publication No. 2009-141538

When evaluating an image during imaging of a moving image, for example, when evaluating the contrast of the image and performing autofocus control, the evaluation value related to the autofocus control may not be reflected in the imaging of the next frame. Therefore, an object of the present invention is to provide an image pickup device, a control method of the image pickup device, and a program that shortens the processing time until an evaluation value related to autofocus control is obtained and enables autofocus control for each frame. To do.

The image pickup apparatus according to the present invention includes an image pickup means for capturing an image of a subject, an image pickup on the image pickup means at a first exposure time and a first focus position, and a second exposure longer than the first exposure time. The control means for performing imaging at a second focus position different from the time and the first focus position, and the first image data imaged by the imaging means at the first exposure time. For autofocus control using a correction means that performs gain correction and image magnification correction according to the second image data captured in the second exposure time, the first image data, and the second image data. It is characterized by having an evaluation means for performing the image evaluation and an acquisition means for acquiring a plurality of the second image data as moving image data.

According to the present invention, the processing time until the evaluation value related to the autofocus control is obtained can be shortened, and the autofocus control for each frame becomes possible.

It is a figure which shows the configuration example of the image pickup apparatus in this embodiment. It is a figure which shows the operation example at the time of moving image imaging of the image pickup apparatus in this embodiment. It is a figure explaining the frame image to be imaged. It is a flowchart which shows the operation example of the image pickup apparatus in this embodiment. It is a figure which shows the other operation example at the time of moving image imaging of the image pickup apparatus in this embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following, the case where the imaging device according to the embodiment of the present invention is applied to a digital camera will be described as an example, but the present invention is not limited to this. The imaging device in the present embodiment can be applied to, for example, various mobile devices such as smartphones and tablet terminals, industrial cameras, in-vehicle cameras, medical cameras, and the like.

FIG. 1 is a block diagram showing a configuration example of a digital camera 101 as an imaging device according to the present embodiment. The digital camera 101 includes an image pickup lens 102, a lens drive unit 103, an aperture 104, an image sensor 105, an image sensor drive unit 106, a timing generator (TG: Timing Generator) 107, and a unit circuit (CDS / AD) 108. Further, the digital camera 101 has a CPU (Central Processing Unit) 109, an operation unit 110, a memory 111, and a memory (DRAM) 112. The digital camera 101 also includes an image generation unit 113, a display unit 114, a compression / expansion unit 115, a flash memory 116, a face detection unit 117, an autofocus control unit (AF control unit) 118, and a bus 119.

The image pickup lens 102 includes a focus lens and a zoom lens composed of a plurality of lens groups (not shown). The image pickup lens 102 is connected to a lens drive unit 103 that drives a focus lens and a zoom lens in the optical axis direction according to a control signal sent from the AF control unit 118. The aperture 104 is driven according to a control signal sent from the CPU 109, and controls the amount of light incident on the image sensor 105. The amount of exposure in imaging is determined by the aperture value (degree of aperture) and shutter speed.

The image sensor 105 is, for example, a CMOS sensor or the like. The image sensor 105 is scanned and driven by the image sensor drive unit 106, and the intensity of light of each RGB color of the subject image is photoelectrically converted and output to the unit circuit (CDS / AD) 108 as an image pickup signal at regular intervals. Further, the image sensor 105 has a function as an electronic shutter. The function of the electronic shutter of the image sensor 105 is controlled by the CPU 109 via the image sensor drive unit 106 and the timing generator 107. The exposure time changes depending on the shutter speed of this electronic shutter. The timing generator 107 controls the operation timing of the image sensor driving unit 106 and the unit circuit (CDS / AD) 108 according to the instruction from the CPU 109.

The unit circuit (CDS / AD) 108 sequentially reads out the image pickup signals output from the image pickup element 105 by line exposure, and pixels by a column circuit (CDS circuit, correlated double sampling circuit) arranged for each vertical signal line. Removes noise that varies between them. Further, the unit circuit (CDS / AD) 108 converts the noise-removed imaging signal from an analog signal to a digital signal by an analog / digital converter (A / D converter) via a horizontal transfer circuit. The image pickup signal obtained by the image pickup element 105 is stored in the buffer memory (memory 112) as image data of the Bayer array after passing through the unit circuit (CDS / AD) 108. The unit circuit (CDS / AD) 108 realizes the function of the correction means for gain-correcting the image data captured by the image sensor 105.

The CPU 109 is a one-chip microcomputer that controls each part of the digital camera 101. The CPU 109 has, for example, a function of performing recording processing and the like, and also has a function of performing display control for displaying moving image data on the display unit 114. Further, the CPU 109 has a function of alternately executing continuous imaging at two different exposure times and a function of identifying and displaying a face region detected by the face detection unit 117. The operation unit 110 includes a plurality of operation keys such as a shutter button for instructing imaging such as still image imaging and moving image imaging, a display mode switching key, a cross key, and a SET key, and outputs an operation signal corresponding to the user's operation to the CPU 109. Output.

The memory 111 stores control programs and data for the CPU 109 to control each part of the digital camera 101. The CPU 109 executes the control process related to each part of the digital camera 101 by reading and executing the control program stored in the memory 111. The memory (DRAM) 112 is used as a buffer memory for temporarily storing image data captured by the image sensor 105, and is also used as a working memory for the CPU 109.

The image generation unit 113 performs image processing on the image data. The image generation unit 113 performs processing such as pixel interpolation processing, γ correction processing, and white balance processing on the image data, and also generates a luminance color difference signal (YUV data). The image generation unit 113 realizes the function of the correction means for correcting the image magnification with respect to the image data captured by the image sensor 105. The display unit 114 includes, for example, a color liquid crystal panel and its drive circuit, and displays an image or the like related to image data. The compression / decompression unit 115 compresses or decompresses image data (for example, compression or decompression in JPEG format or MPEG format). The face detection unit 117 performs face detection processing for detecting a face region in the captured image data. That is, the face detection unit 117 evaluates whether or not there is a face and whether or not there are several faces. Since the face detection process is a well-known technique, it will not be explained in detail. ) And the image data are compared and collated to detect in which area of the image the face is located.

The autofocus control unit (AF control unit) 118 performs autofocus control based on a plurality of captured image data. Specifically, the AF control unit 118 moves the focus lens within the drive range by sending a control signal to the lens drive unit 103, and AF evaluation of the AF area of the image data captured by the image pickup element 105 at the lens position. Calculate the value (evaluate the image). Then, the AF control unit 118 focuses by moving the focus lens to the in-focus lens position based on the calculated AF evaluation value. This AF evaluation value is calculated based on the high frequency component of the AF area of the image data, and the higher the AF evaluation value, the more in focus the lens position.

The operation of the digital camera 101 at the time of capturing a moving image in this embodiment will be described. The digital camera 101 in this embodiment includes two types of exposure conditions, a first exposure condition and a second exposure condition. The first exposure condition is an exposure condition when "0" is set as the exposure condition value, and is a setting for exposure with an exposure time A shorter than the exposure time B of the second exposure condition. The second exposure condition is an exposure condition when "1" is set as the exposure condition value, and is a setting for exposure with an exposure time B suitable for moving image imaging. The exposure condition value is set and stored in the exposure condition storage area in the memory (DRAM) 112, for example.

In the present embodiment, the focus position of the image captured under the second exposure condition is controlled by using the DFD (Depth From Defocus) detection result so as to match the subject. That is, the autofocus control is performed by the DFD method. Further, the focus control is performed so that the focus position of the image captured under the first exposure condition is different from the focus position of the image captured under the second exposure condition. Here, DFD detection is a process of recognizing a space from images having different focus positions, calculating the distance to an object, and determining the focus position of the next frame image. Further, in the present embodiment, the exposure conditions are switched each time an image is taken. That is, when an image is taken under the first exposure condition, then an image is taken under the second exposure condition, then an image is taken under the first exposure condition, and so on, and the exposure condition values are 0 → 1 → 0 → ... It switches like this.

Further, the image sensor 105 can image the subject at a frame cycle of at least 240 fps (240 frames per second). The image sensor 105 performs exposure with an exposure time A (1 / 300 s in this example) of less than one frame period under the first exposure condition, and an exposure time B for a 2.4 frame period under the second exposure condition. It is assumed that the exposure (1 / 100s in this example) is performed. The one frame period is 1 / 240s.

FIG. 2 is a time chart showing an operation example of the digital camera 101 at the time of capturing a moving image in the present embodiment. As shown in FIG. 2, the digital camera 101 alternately repeats imaging under the first exposure condition (exposure time 1 / 300s) and imaging under the second exposure condition (exposure time 1 / 100s). In the following, for convenience of explanation, the image captured under the first exposure condition that is out of focus on the main subject is referred to as a defocus image A, and the image captured under the second exposure condition is focused on the main subject. The image is called the focus image B.

Further, as shown in FIG. 2, it takes less than one frame period (less than 1 / 240s) from the start of reading the image data from the image sensor 105 to the completion of the image magnification correction process or the DFD detection process by the image generation unit 113. It is done in a period. The signal (image data of the Bayer arrangement) read from the image sensor 105 is stored in the buffer memory (memory 112) via the unit circuit (CDS / AD) 108 or the like, and the image of the luminance color difference signal is stored by the image generation unit 113. Data is generated. A series of operations in which the image data of the generated luminance color difference signal is stored in the buffer memory is performed in a period of less than one frame period (less than 1 / 240s).

At this time, assuming that the same subject is photographed, the brightness level of the image data of the defocus image A captured under the first exposure condition and the image data of the focus image B captured under the second exposure condition are the same. Adjust the aperture and sensitivity (for example, gain) so that Here, it is assumed that only the gain correction is performed. Since the exposure time of the first exposure condition is 1/3 of the exposure time of the second exposure condition, the gain value when imaging under the second exposure condition is multiplied by 1, and the image is captured under the first exposure condition. The gain value at that time is tripled. As a result, the brightness levels of the image data of the defocus image A captured under the first exposure condition and the image data of the focus image B captured under the second exposure condition can be made uniform.

Further, since the focus position of the subject is different between the imaging under the first exposure condition and the imaging under the second exposure condition, the image magnification between the imaging under the first exposure condition and the imaging under the second exposure condition Adjust the image magnification so that In the present embodiment, the defocus image A is enlarged or reduced in order to adjust the image magnification of the defocus image A with reference to the image magnification when the focus image B is captured. As a result, the image magnifications of the image data of the defocus image A captured under the first exposure condition and the image data of the focus image B captured under the second exposure condition can be made uniform.

In addition, face detection processing for detecting a face in the image data of the luminance color difference signal, compression of the image data of the luminance color difference signal, and recording of the compressed image data are also processed. That is, the face detection process of the image data of the luminance color difference signal stored in the buffer memory (memory 112) is performed by the face detection unit 117. Further, the image data of the luminance color difference signal stored in the buffer memory (memory 112) is compressed by the compression / decompression unit 115. The series of operations related to the storage of the compressed image data in the buffer memory (memory 112) and the series of operations of recording the compressed image data stored in the buffer memory (memory 112) in the flash memory 116 are as follows. It will be done in less than 4 frames.

Further, in FIG. 2, in order to show the number of times the captured frame image data is captured, the number of times is attached to the frame image data. This number is counted from 0. For example, the defocus image A0 indicates that it is a frame image captured at the 0th time and is a frame image captured under the first exposure condition. Further, for example, the focus image B1 is a frame image captured at the first time and is a frame image captured under the second exposure condition.

Further, in the example shown in FIG. 2, the imaging is performed under the first exposure condition first, and then the imaging is performed by controlling the order of imaging so that the exposure conditions are alternately switched. Therefore, the frame image (defocus image) captured under the first exposure condition is represented by the image A (2n), and the frame image (focus image) captured under the second exposure condition is represented by the image B (2n + 1). expressed. However, n = 0, 1, 2, 3, ... Further, as shown in FIG. 2, the defocus image A captured under the first exposure condition is used for DFD detection, and the focus image B captured under the second exposure condition is used for DFD detection, display, and DFD detection. Used for recording.

FIG. 3 is a diagram showing an example of the state of the captured frame image. From FIG. 3, it can be seen that the defocus image A captured under the first exposure condition and the focus image B captured under the second exposure condition are alternately captured. The number (number) attached to each frame image indicates how many times the frame image was captured.

It should be noted that the imaging under the first exposure condition and the imaging under the second exposure condition are alternately performed, and the exposure time under the first exposure condition is less than one frame period, and the exposure time under the second exposure condition. Is for the 2.4 frame period. From this, the imaging cycle of the frame image captured under the first exposure condition and the imaging cycle of the frame image captured under the second exposure condition are both 1 / 60s, which is a four-frame period.

Further, as shown in FIG. 2, in the real-time display of the captured frame image, only the focus image B is sequentially displayed. That is, the focus image B captured under the second exposure condition is acquired and displayed as moving image data. Further, the AF process (DFD detection) is performed by combining the defocus image A captured under the first exposure condition and the focus image B captured under the second exposure condition. That is, the AF processing is performed based on the AF evaluation values of the frame images A and B captured during 1 / 60s. In the example shown in FIG. 2, the AF process is performed by combining the defocus image A0 captured at the 0th time and the focus image B1 captured at the first time. Further, the AF process is performed by combining the defocus image A2 captured the second time and the focus image B3 captured the third time.

Hereinafter, the operation of the digital camera 101 at the time of capturing a moving image in the present embodiment will be described with reference to the flowchart shown in FIG. FIG. 4 is a flowchart showing an operation example of the digital camera 101 at the time of capturing a moving image in the present embodiment. First, when the moving image imaging mode is set and the imaging of the moving image is started, in step S401, the CPU 109 determines whether or not it is the AF priority mode that prioritizes the processing related to the autofocus control based on the set mode. I do.

When the CPU 109 determines that the AF priority mode is set (YES), in step S402, the CPU 109 sets the exposure condition as the first exposure condition and sets “0” as the exposure condition value in the exposure condition storage area of the buffer memory. To memorize. On the other hand, when the CPU 109 determines that the mode is not the AF priority mode (NO), the CPU 109 sets the exposure condition as the second exposure condition in step S403, and sets “1” as the exposure condition value as the exposure condition of the buffer memory. Store in the storage area.

Next, in step S404, the CPU 109 determines whether or not the currently set exposure condition is the first exposure condition. This determination is made based on the information stored in the exposure condition storage area. That is, the CPU 109 determines whether or not the exposure condition value stored in the exposure condition storage area is “0”.

As a result of the determination, when the CPU 109 determines that it is the first exposure condition (exposure condition value = 0) (YES), the process proceeds to step S405. In step S405, the CPU 109 sets the exposure time to 1 / 300s, sets the gain value to three times the normal gain value, and proceeds to step S407. The normal gain value is a gain value when an image is taken under the second exposure condition. Here, since the exposure time of the first exposure condition is 1 / 300s and the exposure time of the second exposure condition is 1 / 100s, the exposure time of the first exposure condition is the exposure of the second exposure condition. It will be 1/3 of the time. Therefore, by trebling the gain value, the brightness levels of the image data A captured under the first exposure condition and the image data B captured under the second exposure condition can be made uniform.

On the other hand, if the CPU 109 determines that it is not the first exposure condition (exposure condition value ≠ 0), that is, it is the second exposure condition (exposure condition value = 1), the process proceeds to step S406. In step S406, the CPU 109 sets the exposure time to 1 / 100s, sets the gain value to 1 times the normal gain value, and proceeds to step S407.

Next, in step S407, the CPU 109 executes imaging with the set exposure time and gain value. That is, according to the control by the CPU 109, the image pickup signal (image data) accumulated in the image pickup device 105 after being exposed for the set exposure time is read out, and the unit circuit 108 reads out the image data and sets the gain value. The gain is corrected and the automatic gain is adjusted according to the above. After that, the image data of the luminance color difference signal is generated by the image generation unit 113 from the image data whose automatic gain is adjusted, and is stored in the buffer memory (memory 112).

Next, in step S408, the CPU 109 determines whether or not the currently set exposure condition is the second exposure condition (exposure condition value = 1). When the CPU 109 determines that the currently set exposure condition is not the second exposure condition (exposure condition value ≠ 1), that is, the first exposure condition (exposure condition value = 0), the process proceeds to step S409. In step S409, the CPU 109 instructs the execution of the image magnification correction process for the image captured under the first exposure condition. As a result, the image generation unit 113 corrects the image magnification on the image data captured under the first exposure condition. Here, the image generation unit 113 corrects the image magnification of the image captured under the first exposure condition so as to match the image magnification of the image captured under the second exposure condition (enlargement processing according to the image magnification). And reduce processing).

If the CPU 109 determines in step S408 that the currently set exposure condition is the second exposure condition (exposure condition value = 1), the process proceeds to step S410. In step S410, the CPU 109 instructs the execution of the AF control process. As a result, the AF control unit 118 performs the DFD detection process using the images taken under the first exposure condition and the images taken under the second exposure condition, which have different focus positions. Next, in step S411, the AF control unit 118 determines the focus position of the frame image to be acquired next based on the evaluation value calculated by the DFD detection process in step S410, and determines the focus position of the frame image to be acquired next via the lens drive unit 103. Move the focus lens to move the focus.

In step S412, the CPU 109 stores, as the image data to be displayed next, information for identifying the most recently captured frame image data (address information of the frame image data, etc.) stored in the display storage area of the buffer memory. Then, the process proceeds to step S413. That is, the memory of the display storage area is updated. As a result, only the frame image B captured under the second exposure condition is specified as the frame image to be displayed next, and only the frame image B is displayed in order. At this time, the CPU 109 holds the frame image in the buffer memory until the specified frame image is displayed.

In step 413, the CPU 109 determines whether or not to end the imaging process of the moving image. This determination is made based on, for example, whether or not an operation signal corresponding to the pressing of the shutter button has been sent from the operation unit 110. When the CPU 109 determines that the moving image imaging process is completed (YES), the CPU 109 ends the moving image imaging process.

On the other hand, when the CPU 109 determines that the imaging process of the moving image is not completed, in step S414, the CPU 109 determines whether or not the currently set exposure condition is the first exposure condition (exposure condition value = 0). judge. When the CPU 109 determines that the currently set exposure condition is the first exposure condition, in step S415, the CPU 109 sets the exposure condition to the second exposure condition (exposure condition value = 1). Return to step S404. On the other hand, when the CPU 109 determines that the currently set exposure condition is not the first exposure condition, the CPU 109 sets the exposure condition to the first exposure condition (exposure condition value = 0) in step S416. Then, the process returns to step S404.

By performing such an operation, as shown in FIG. 3, the frame image data A captured at the exposure time 1 / 300s and the frame image data B captured at the exposure time 1 / 100s are alternately imaged. Will be done. Further, only the images related to the frame image data B captured at the exposure time of 1 / 100s are sequentially displayed. As a result, it is possible to record moving image data in which the movement of the subject is smooth. Further, since the frame image A having a short exposure time is used as the defocus image A for image magnification correction and gain correction, the frame image B having a long exposure time can be used as a display image.

As described above, in the present embodiment, imaging with a short exposure time and imaging with a long exposure time are alternately repeated, and frame image data captured with a long exposure time is recorded and displayed as moving image data. The frame image data captured in a short exposure time is used for AF processing. Therefore, it is possible to record and display moving image data with smooth movement using the frame image data captured with a long exposure time. Further, in the AF priority mode in which the processing related to the autofocus control is prioritized, the defocus image and the focus image are used, and the DFD detection process is performed during the exposure period of the next defocus image until the AF evaluation value is obtained. Processing time can be shortened. In addition, since the focus lens is moved to an appropriate position before the exposure of the next focus image is started, AF control for each frame becomes possible, and the accuracy of AF evaluation value calculation (image evaluation accuracy) can be improved. Can be improved.

When the CPU 109 determines in step S401 that the AF priority mode does not prioritize the processing related to the autofocus control, the operation of the digital camera 101 at the time of capturing a moving image is as shown in FIG. FIG. 5 is a time chart showing another operation example of the digital camera 101 at the time of capturing a moving image in the present embodiment.

As shown in FIG. 5, the digital camera 101 alternately repeats imaging under the second exposure condition (exposure time 1 / 100s) and imaging under the first exposure condition (exposure time 1 / 300s). Further, from the start of reading the image data from the image sensor 105 to the completion of the image magnification correction process or the DFD detection process by the image generation unit 113 is performed in less than a 2.4 frame period (less than 1 / 10s).

At this time, similarly to the example shown in FIG. 2, the gain value when the image is taken under the second exposure condition is set to 1 time, and the gain value when the image is taken under the first exposure condition is set to 3 times. As a result, the brightness levels of the image data captured under the first exposure condition and the image data captured under the second exposure condition can be made uniform. Further, for example, an image when the focus image B is imaged so that the defocus image A captured under the first exposure condition and the focus image B captured under the second exposure condition have the same image magnification. The image magnification of the defocused image A is adjusted with reference to the magnification.

In FIG. 5, for example, the focus image B0 is a frame image captured at the 0th time, and is a frame image captured under the second exposure condition. Further, for example, the defocus image A1 indicates that it is a frame image captured for the first time and is a frame image captured under the first exposure condition.

Further, in the case of not in the AF priority mode, as shown in FIG. 5, the imaging is performed under the second exposure condition first, and then the imaging is controlled and the imaging is performed so as to switch the exposure conditions alternately. I will go. Therefore, the frame image (focus image) captured under the second exposure condition is represented by image B (2n), and the frame image (defocus image) captured under the first exposure condition is represented by image A (2n + 1). expressed. However, n = 0, 1, 2, 3, ... Further, as shown in FIG. 5, the defocus image A captured under the first exposure condition is used for DFD detection, and the focus image B captured under the second exposure condition is DFD detection, display, and recording. Used for.

In the case of not the AF priority mode as described above, when the frame image data captured with a long exposure time and a short exposure time are combined, the frame image captured with a long exposure time is displayed first. This makes it possible to record and display moving image data with smooth movement of the subject while reducing the display delay when displaying the captured moving image.

(Other Embodiments of the present invention)
The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

It should be noted that the above-described embodiments are merely examples of embodiment of the present invention, and the technical scope of the present invention should not be construed in a limited manner by these. That is, the present invention can be implemented in various forms without departing from the technical idea or its main features.

101: Digital camera (imaging device) 102: Imaging lens 103: Lens drive unit 105: Image sensor 106: Image sensor drive unit 107: Timing generator 108: Unit circuit (CDS / AD) 109: CPU 111, 112: Memory 113: Image generation unit 114: Display unit 118: Autofocus control unit

Claims (10)

An imaging means for capturing a subject image and
The imaging means is imaged at the first exposure time and the first focus position, and at a second exposure time longer than the first exposure time and at a second focus position different from the first focus position. And the control means to take an image of
A correction means for performing gain correction and image magnification correction on the first image data captured in the first exposure time by the imaging means in accordance with the second image data captured in the second exposure time. When,
An evaluation means for performing image evaluation related to autofocus control using the first image data and the second image data, and
An acquisition means for acquiring a plurality of the second image data as moving image data, and
An imaging device characterized by having. The imaging device according to claim 1, wherein the evaluation means performs the image evaluation for performing autofocus control by the DFD method. The imaging device according to claim 1 or 2, wherein the control means controls the first focus position and the second focus position based on the result of the image evaluation. The imaging device according to any one of claims 1 to 3, further comprising a display control means for displaying the moving image data on a display unit. The control means has a first mode in which the first image data and the second image data are imaged in this order, and an image evaluation is performed using a set of the two image data. The imaging device according to any one of claims 1 to 4. The control means has a second mode in which the second image data and the first image data are imaged in this order, and an image evaluation is performed using a set of the two image data. The imaging device according to any one of claims 1 to 5. The imaging device according to claim 5 or 6, wherein the first mode is a mode in which the process related to the autofocus control is prioritized as compared with the case where the first mode is not set. .. The evaluation means is characterized in that, in the first mode, an image evaluation calculation using the pair of the two image data is performed during the exposure period at the time of capturing the next first image data. The imaging device according to claim 5 or 7. An imaging means for imaging a subject image has an image pickup at a first exposure time and a first focus position, and a second exposure time longer than the first exposure time and a second exposure time different from the first focus position. The control process that allows the image to be taken at the focus position of
A correction step of performing gain correction and image magnification correction on the first image data captured in the first exposure time by the imaging means in accordance with the second image data captured in the second exposure time. When,
An evaluation step of performing image evaluation related to autofocus control using the first image data and the second image data, and
An acquisition step of acquiring a plurality of the second image data as moving image data, and
A method for controlling an imaging device, which comprises. To the computer that the image pickup device has
An imaging means for imaging a subject image has an image pickup at a first exposure time and a first focus position, and a second exposure time longer than the first exposure time and a second exposure time different from the first focus position. A control step that allows you to take an image at the focus position of
A correction step of performing gain correction and image magnification correction on the first image data captured in the first exposure time by the imaging means in accordance with the second image data captured in the second exposure time. When,
An evaluation step of performing image evaluation related to autofocus control using the first image data and the second image data, and
An acquisition step of acquiring a plurality of the second image data as moving image data, and
A program to execute.

Images