JP7175941B2 - IMAGE PROCESSING APPARATUS, CONTROL METHOD FOR IMAGE PROCESSING APPARATUS, AND PROGRAM - Google Patents

Description

The present invention relates to an image processing apparatus, an image processing apparatus control method, and a program.

2. Description of the Related Art There is an imaging apparatus capable of performing so-called slow-motion playback by reproducing a moving image (high-speed moving image) obtained by imaging a subject with a high frame rate set, at a lower frame rate than when the image was captured. Are known. By playing back high-speed movies at a low frame rate, changes in the subject and scene can be recorded accurately and with more emphasis than normal recording. etc.
On the other hand, when processing such as AE (AutoExposure)/AF (AutoFocus)/WB (WhiteBlance) is executed in accordance with changes in the subject or scene, the processing is played back in slow motion, giving the user a sense of discomfort. put away.
Japanese Patent Application Laid-Open No. 2004-200002 discloses a technique of switching the frame rate during video recording according to the movement of an imaged subject, and restricting AE/WB tracking when imaging at a high frame rate. Further, Japanese Patent Application Laid-Open No. 2002-200001 discloses a technique for changing the AE/WB tracking speed in consideration of the frame rate during imaging and during playback.

JP 2012-151706 A JP 2012-156886 A

However, with the technique described in Japanese Patent Laid-Open No. 2002-200011, when the movement of the subject is large, the change in AE/WB cannot be followed, so there is a high possibility that the state of image quality will fluctuate. In this case, a moving image is acquired in which the brightness changes unnaturally with respect to changes in the brightness of the subject. In addition, the technique described in Patent Document 2 cannot obtain the effect when the frame rate setting at the time of imaging and at the time of reproduction exceeds the range in which the following speed of AE/WB can be handled.

SUMMARY OF THE INVENTION An object of the present invention is to provide an image processing apparatus capable of reproducing high-quality moving images.

In order to solve the above problems, an image processing apparatus according to one aspect of the present invention comprises first detection means for detecting a subject from a moving image acquired using an imaging means, and the moving image. second detection means for detecting, from among a plurality of frames, a frame in which the amount of movement of the subject detected by the first detection means exceeds a predetermined value; and setting means for setting a frame rate when reproducing the moving image. and evaluation means for evaluating an image quality state of the moving image , wherein the setting means determines the moving image according to a scene change of the moving image based on the detection result of the second detecting means. Divided into a plurality of periods, and based on the detection result of the second detection means and the evaluation result of the evaluation means for each of the plurality of periods, a frame rate for reproduction is set, and the moving image is reproduced in the first period. A period for reproducing at a frame rate and a period for reproducing at a second frame rate lower than the first frame rate can be set.

According to the present invention, it is possible to provide an image processing apparatus capable of reproducing high-quality moving images.

3 is a block diagram showing the configuration of a camera; FIG. 4 is a flow chart showing the operation of the camera during high-speed video shooting. FIG. 10 is a flowchart for explaining an evaluation operation for each imaging frame; FIG. FIG. 11 is a table for explaining evaluation for each imaging frame; FIG. FIG. 4 is a diagram for explaining the operation of dividing a moving image into segments; It is a figure explaining operation|movement of area evaluation. FIG. 10 is a diagram for explaining the frame rate setting operation during playback; FIG. 10 is a diagram for explaining the frame rate setting operation during playback; FIG. 4 is a flow chart showing the operation of the camera during high-speed moving image shooting; FIG. 10 is a flowchart for explaining an evaluation operation for each imaging frame; FIG. FIG. 11 is a table for explaining evaluation operations for each imaging frame; FIG.

(First embodiment)
FIG. 1 is a block diagram showing the configuration of a digital camera (hereinafter simply referred to as camera) 100. As shown in FIG. One or more of the functional blocks shown in FIG. 1 may be implemented by hardware such as an ASIC or programmable logic array (PLA), or implemented by a programmable processor such as a CPU or MPU executing software. may It may also be implemented by a combination of software and hardware. Therefore, in the following description, even when different functional blocks are described as main entities, the same hardware can be implemented as the main entities.

A lens 101 is an imaging lens including a zoom mechanism. A diaphragm and shutter 102 controls the amount of light. A focus lens 104 is a focus lens for focusing on an image sensor, which will be described later. The imaging device 108 includes a light receiving means or a photoelectric conversion means for converting reflected light from an object into an electrical signal. The A/D conversion unit 109 includes a CDS circuit that removes output noise from the image sensor 108 and a nonlinear amplifier circuit that performs prior to A/D conversion. The image processing unit 110 performs signal processing such as forming a luminance signal and a color signal, and predetermined image processing such as gamma correction and compression processing on the image signal output from the A/D conversion unit 109 . A format conversion unit 112 converts the format of the image data output from the image processing unit 110 into a format such as MP4, for example.

A DRAM 113 is a high-speed built-in memory such as a random access memory that temporarily stores data. The image recording unit 114 is an image recording unit including a recording medium such as a memory card and its interface. The VRAM 116 is an image display memory and temporarily stores image data as display image data. In addition to image display, the operation display unit 117 displays an image pickup screen during image pickup such as display for operation assistance and display of the camera state. The image data converted by the format conversion unit 112 is recorded in the image recording unit 114 via the DRAM 113 and displayed on the operation display unit 117 via the DRAM 113 and VRAM 116 . A CPU 115 is a system control unit that controls the system such as an imaging sequence.

The AE processing unit 103, AF processing unit 105, WB processing unit 111, and IS processing unit 125 control imaging settings such as exposure settings, autofocus settings, white balance settings, and image blur correction settings. Specifically, the AE processing unit 103 performs control related to AutoExposure. The AF processing unit 105 controls autofocus settings (AutoFocus). The WB processing unit 111 performs control related to white balance setting (WhiteBlance). The IS processing unit 125 performs control related to image blur correction settings (IMAGE STABILIZER). An operation unit 118 receives an operation from the outside. A main switch 120 is a main switch for turning on power to the system, and a photographing switch 122 is a switch to be pressed when imaging is started or when imaging is finished.

The subject detection module 123 performs subject detection using the image signal processed by the image processing unit 110 and sends information (position, size, reliability) of one or more detected subjects to the CPU 115 . Here, the following method can be given as an example of the subject detection method. As a method for detecting a person's face, an image is searched for portions that characterize the face, such as eyes and eyebrows, and the position of the person's face on the image is obtained. Furthermore, the size and inclination of the face are obtained from the positional relationship such as the interval between the parts that characterize the face. Also, as a method of detecting subjects other than people, there is a method of extracting a characteristic area in an image from the distribution of color and brightness, and obtaining the position and size of the subject. The acceleration sensor unit 124 detects acceleration of the camera 100 itself.

Next, the operation of the camera during high-speed moving image shooting will be described with reference to the flowchart of FIG. Here, a high-speed moving image is a moving image obtained by capturing an image of a subject by setting a high-speed frame rate.
In step S201, the CPU 115 checks whether the shooting switch 122 has been pressed, and if it has been pressed, the process proceeds to step S202.

In step S202, imaging processing for high-speed moving image shooting is performed, and the process proceeds to step S203. In the imaging process, the AE processing unit 103, the AF processing unit 105, the WB processing unit 111, and the IS processing unit 125 perform image quality control at the time of imaging according to the situation of the subject, and the image sensor 108 detects each frame of the moving image. is imaged. At that time, the control state of each process is temporarily stored in the DRAM 113 as to whether the control state is "appropriate", "matching (in control)", or "non-appropriate (matching failure)".

In step S203, the CPU 115 evaluates the image quality and the condition of the subject for each imaging frame, and proceeds to step S204. Detailed processing of step S203 will be described later using the flowchart of FIG.
In step S204, the image obtained by imaging the subject is recorded in the image recording unit 114, and the process proceeds to step S205.
In step S205, the CPU 115 checks whether a trigger for ending imaging, such as the photography switch 122 being pressed again, has been pulled.

In step S206, the CPU 115 divides the acquired moving image into one or more sections, and proceeds to step S207. Details of the moving image division in step S206 will be described later with reference to FIG.
In step S207, the CPU 115 evaluates image quality and scene change status for each section divided in step S206, and proceeds to step S208. Detailed processing of step S207 will be described later using the flowchart of FIG.
In step S208, the CPU 115 sets the playback frame rate for each divided section according to the evaluation result in step S207, and ends the operation during high-speed moving image shooting.

Next, referring to the flowchart of FIG. 3, the operation of evaluating the image quality and the condition of the subject for each imaging frame in step S203 of FIG. 2 will be described.
In step S301, the CPU 115 reads an image obtained by imaging the subject from the DRAM 113, and proceeds to step S302.
In step S302, the CPU 115 acquires image quality information from the DRAM 113 for the image read out in step S301. Here, the image quality information is the control state of each process of AF, AE, WB, and IS during imaging, which is stored in step S202.
In step S303, the CPU 115 sets the image quality evaluation value of the captured image based on the image quality information acquired in step S302, and proceeds to step S304. The image quality evaluation value is obtained, for example, by determining an evaluation value according to the control state as shown in FIG. 4 and adding the respective evaluation values of AF, AE, WB, and IS. It should be noted that the evaluation of each process in FIG. is determined by comparing the For example, if the set exposure conditions deviate from the pre-recorded proper exposure due to changes in subject brightness, it will be classified as "inappropriate." The case where it is substantially the same as the exposure is defined as "appropriate".

In step S304, the CPU 115 acquires subject information of the image acquired in step S301, and proceeds to S305. Here, subject information is the result of subject detection by the subject detection module 123, and is, for example, whether or not a subject such as a person or an object is detected and the detection position.
In step S305, the CPU 115 calculates the difference between the subject information and the previous frame. Specifically, regarding the subject information acquired in step S304, from the difference in the subject information acquired between the captured images in the current frame and the previous frame, whether or not the subject has been switched from the previous time and the amount of movement of the subject (difference in detection position) ) is calculated, and the process proceeds to step S306. Note that any known method for calculating the amount of movement of the subject may be employed.

In step S306, the image quality evaluation value calculated in step S303, the amount of movement of the subject calculated in step S305, and whether or not detection of the subject has been switched are linked to the captured image and recorded in the image recording unit 114. End the evaluation operation.

Next, the moving image division processing in step S206 of FIG. 2 will be described with reference to the drawing of FIG.
Graphs 5-1A (dotted line) and 5-1B (solid line) in FIG. ). The change of scene is determined by whether or not the detection state of the subject has changed (if the graph is interrupted, it indicates that the detection is no longer performed). Also, it is determined whether or not the amount of motion of each subject exceeds the motion determination threshold indicated by 5-1C (long dashed line). A moving image is divided into a plurality of sections based on the change of scene and determination of the amount of motion.
In FIG. 5A, section 5-1 is a scene in which subjects A and B are moving, section 5-2 is a scene in which subjects A and B are not moving, and section 5-3 is a scene in which subject B is no longer detected. is divided into three sections as

Next, the process of evaluating divided sections in step S207 of FIG. 2 will be described with reference to the drawing of FIG. 5 and the flowchart of FIG. Evaluation of the divided sections is performed by the CPU 115 functioning as moving image dividing means.
In steps S601 to S606, the scene change state and image quality state are evaluated for each section divided in step S206 of FIG.
In step S601, it is determined whether or not the maximum value of the amount of motion of the detected subject is greater than or equal to a predetermined threshold for the N-th (N is a natural number) section. If the amount of motion is equal to or greater than the threshold, the process proceeds to step S602, and if the amount is less than the threshold or the subject is not detected, the process proceeds to step S603.
In step S602, the N-th section is set as a section with a large scene change, and the process proceeds to step S604. On the other hand, in step S603, the N-th section is set as a section with a small scene change, and the process proceeds to step S604.

In FIG. 5B, graphs 5-2A (dotted line) and 5-2B (solid line) represent the amount of movement of subjects A and B detected in the video, and 5-2C (long dashed line) indicates the amount of change determination. represents the threshold for For the threshold, for example, the reference amount of motion in a scene with a large amount of movement is set as the case where there is a movement of 10% or more of the detected size of the subject in 0.1 seconds, and the reference amount of motion is set as the movement in units of one frame. A value normalized to the amount is used as a threshold value for determining the amount of change. Alternatively, the average amount of motion between a predetermined number of consecutive frames may be averaged and compared with a threshold value for determining the amount of change.
In section 5-1, the maximum amount of motion for both subjects A and B exceeds the threshold, so the section is set as a section with a large scene change. Since it is not exceeded, it is set as an interval with a small change.

In step S604, if the number of frames in which the image quality evaluation value set in S303 is equal to or less than the threshold for image quality determination is less than a predetermined percentage of the total number of frames in the N-th section, the process proceeds to step S605. If so, the process proceeds to step S606.
In step S605, the Nth segment is set as a segment with good image quality. On the other hand, in step S606, the Nth section is set as a section with poor image quality, and the process proceeds to step S607.

In FIG. 5C, the graph 5-3A (solid line) represents the image quality evaluation value, and the graph 5-3C (long dashed line) represents the threshold value for image quality determination. The vertical axis represents the image quality evaluation value, and the horizontal axis represents the imaging frame (time). For example, when the image quality evaluation value is calculated according to the table of FIG. 4, 20 is set as the threshold for image quality determination. Then, when there is a process whose control state is inappropriate, or when there are three or more processes in a matching state, it falls below the threshold for image quality determination. In addition, if the ratio of frames whose image quality evaluation value is lower than the threshold value for image quality determination in the section is set to be a section with poor image quality when the ratio is less than 30%, in FIG. 5C, section 5-1, The section 5-3 is judged to be of poor image quality, and the section 5-2 is judged to be of good image quality.

In step S607, an optimum frame rate (hereinafter referred to as scene-prioritized frame rate) is calculated according to the scene change state of the N-th interval, and the process proceeds to step S608. For example, according to the maximum value of the change amount of the movement of the subject within the section, the larger the value, the lower the frame rate during playback is set so that the playback is performed in slower motion.

In step S608, the upper limit frame rate at which image quality is acceptable (hereinafter referred to as image quality priority frame rate) is calculated according to the image quality state of the N-th section, and this processing ends. For example, the frame rate during playback may be set low, assuming that the lower the ratio of frames below the threshold for image quality determination, the more acceptable the image quality. Also, the frame rate during playback may be set so that the playback time of frames below the threshold falls within a predetermined time.

Next, the operation of setting the frame rate during reproduction in step S208 of FIG. 2 will be described with reference to the flowchart of FIG. The CPU 115 sets the frame rate during playback.
In steps S701 to S705, the frame rate for playback is set for each section divided in step S206 of FIG. At this time, the scene change state/image quality state for each section and the frame rate during reproduction with scene change priority/image quality priority set in the evaluation for each section in step S207 of FIG. 2 are referred to.

In step S701, the scene change priority frame rate setting set in step S607 of FIG. 6 is compared with the image quality priority frame rate setting set in step S608 of FIG. If the image quality priority frame rate is lower, the process proceeds to step S704, and if the scene change priority frame rate setting is lower, the process proceeds to step S702. Here, if the frame rate prioritizing image quality is lower, it is considered that the image quality is guaranteed even in the frame rate setting prioritizing scene change.

In step S702, the image quality state is determined. If it is determined in step S604 in FIG. 6 that the image quality is good, the process proceeds to step S704, and if it is determined that the image quality is poor, the process proceeds to step S703. Here, if the image quality state is good, it is considered that image quality is guaranteed to some extent even if the frame rate is set according to the scene.

In step S703, the scene change state is determined. If it is determined in step S601 in FIG. 6 that the scene change is large, the process proceeds to step S704, and if it is determined that the scene change is small, the process proceeds to step S705. Here, if the change in scene is large, give priority to the effect of slow motion playback and set the scene-priority frame rate. set the frame rate of the

In step S704, the scene change priority frame rate is set as the playback frame rate. If it is necessary to process the next section, the process returns to step S701.
In step S705, the frame rate giving priority to image quality is set as the frame rate for reproduction. If it is necessary to process the next section, the process returns to step S701.
When the processing for all sections ends, the frame rate setting flow ends.

As described above, in the present embodiment, by setting the frame rate during playback in consideration of the image quality control result for each imaged frame, the image quality of the moving image is guaranteed, and high-quality high-speed moving image playback is performed. It can be performed.

(Second embodiment)
A second embodiment will be described with reference to the flowchart of FIG. The second embodiment differs from the first embodiment in the operation of setting the frame rate during reproduction in step S208 of FIG. 2, and this difference will be described. In the second embodiment, the user designates the frame rate at the time of reproduction in advance, and the frame rate set by the user is set when the image quality is good and when the scene change is large. On the other hand, when the image quality is poor and the change in scene is small, the frame rate is set with priority given to image quality.

In step S801, the frame rate for playback specified in advance by the user is obtained, and the process proceeds to step S802.
In steps S802 to S806, the frame rate for playback is set for each section divided in step S206 of FIG. At this time, the scene change/image quality state for each section and the frame rate during playback with image quality priority set in the evaluation for each section in step S207 of FIG. 2 are referred to.

In step S802, the user-specified frame rate setting set in step S801 is compared with the image quality-priority frame rate setting set in step S608 of FIG. If the image quality priority frame rate is lower, the process proceeds to step S804, and if the user setting frame rate setting is lower, the process proceeds to step S802. Here, if the frame rate prioritizing image quality is lower, it is considered that the image quality is guaranteed even at the frame rate setting specified by the user.

In step S803, the image quality state is determined. If it is determined in step S604 in FIG. 6 that the image quality is good, the process proceeds to step S805, and if it is determined that the image quality is poor, the process proceeds to step S804. Here, if the image quality state is good, it is considered that the image quality is guaranteed even with the frame rate setting specified by the user.

In step S804, the scene change state is determined. If it is determined in step S601 in FIG. 6 that the scene change is large, the process proceeds to step S805, and if it is determined that the scene change is small, the process proceeds to step S806. Here, when the change in scene is large, priority is given to the effect of slow motion playback, and the user-specified frame rate is set. set the frame rate of the

In step S805, the frame rate specified by the user is set as the frame rate for playback. If it is necessary to process the next section, the process returns to step S802.
In step S806, the frame rate giving priority to image quality is set as the frame rate for reproduction. If it is necessary to process the next section, the process returns to step S802.
When the processing for all sections ends, the frame rate setting flow ends.

As described above, in this embodiment, when the user designates the frame rate for playback, the frame rate for playback is set in consideration of the image quality control result for each imaged frame. As a result, it is possible to achieve both the intention of the user and the guarantee of the image quality of moving images, and to reproduce high-quality high-speed moving images.

(Third embodiment)
Unlike the first and second embodiments, the third embodiment does not store the control state during imaging and evaluate the image quality state based on the control state. In the present embodiment, after the imaging is completed, the image quality state and the situation of the subject are calculated based on the captured moving image. Differences from the first embodiment will be described below, but the frame-by-frame evaluation of this embodiment can also be applied to the second embodiment in which a user-defined frame rate is set.

The operation of the camera according to the third embodiment during high-speed moving image shooting will be described below with reference to FIG.
In step S901, the CPU 115 checks whether the shooting switch 122 has been pressed, and if it has been pressed, the process proceeds to step S902.
In step S902, processing for capturing a moving image is performed, and the process proceeds to step S903. Here, the AE processing unit 103, the AF processing unit 105, the WB processing unit 111, and the IS processing unit 125 perform image quality control at the time of imaging according to the situation of the subject, and then each frame of the moving image is captured. .

In step S903, the captured image is recorded in the image recording unit 114, and the process proceeds to step S904.
In step S904, the CPU 115 checks whether a trigger for ending imaging, such as the shooting switch 122 being pressed again, has been pulled.

In step S905, the CPU 115 evaluates each captured frame according to the processing described later, and proceeds to step S906.
Step S906 is the same process as S206 in FIG. 2. According to the process described with reference to FIG. 5, the captured moving image is divided into one or more sections, and the process proceeds to step S907.
Step S907 is the same process as S207 in FIG. 2. Image quality and scene change status are evaluated for each section divided in step S906 according to the process described using the flowchart in FIG. 6, and the process proceeds to step S908. .
In step S908, which is the same processing as in S208 in FIG. 2, the frame rate during playback is set for each section divided in S906 according to the processing described using the flowchart in FIG. 7, and the operation during imaging ends. do.

Next, referring to the flowchart of FIG. 10, the operation of evaluating the image quality of each frame of the captured image and the condition of the subject in step S905 of FIG. 9 will be described.
In step S1001, the N-th frame image in the captured moving image is acquired, and the process proceeds to step S1002.

In step S1002, image quality information is calculated from the image acquired in step S1001. Here, image quality information is, for example, image contrast, brightness, color, noise, and the like. Regarding the brightness of the image, the average brightness value is calculated for the entire captured image or the area of the subject detected by the subject detection module 123, and it is determined whether or not it is within a preset target brightness range. As for the contrast of the image, the high-frequency component in the entire captured image or the detected subject area is extracted, and it is determined whether or not the extracted signal value is within a preset target value range. As for the color tone of the image, the color signal in the entire captured image or the detected subject area is calculated, and it is determined whether or not the color signal is within a preset target color signal range. As for the noise in the image, the noise level is calculated from the signal value of the area in the captured image where the subject is not exposed, and it is determined whether or not it is within a predetermined range.

In step S1003, the image quality evaluation value of the captured image is set based on the image quality state acquired in step S1002, and the process proceeds to step S1004. For example, as shown in FIG. 11, target values in multiple stages and image quality evaluation values corresponding to each target value are determined in advance for each of contrast, brightness, tint, and noise. Then, the sum of the image quality evaluation values of contrast, brightness, color, and noise is used as the image quality evaluation value of the imaging frame.
In step S1004, subject information is acquired for the image acquired in step S1001, and the process proceeds to S1005. Here, from the subject detection result by the subject detection module 123, whether or not a subject such as a person or an object is detected and the detection position are acquired.

In step S1005, regarding the information acquired in step S1004, from the difference in information acquired between the current and previous captured images, whether or not the subject has been switched from the previous time and the amount of motion of the subject (difference in detection position) are calculated, The process advances to step S1006.
In step S1006, the image quality evaluation value calculated in step S1003, whether or not detection of the subject has been switched and the amount of movement of the subject calculated in step S1005 are linked to the captured image and stored. If the captured image of the next frame needs to be processed, the process returns to step S1001, and if there is no captured image of the next frame, the evaluation operation for each frame ends.

Note that steps S905 to S908 in FIG. 9 may be performed by an image processing apparatus independent of the imaging apparatus. The image processing device evaluates each frame of the acquired moving image, divides the moving image, and sets a frame rate for each divided section based on the image quality and subject evaluation. The image processing device may have a display section for reproducing moving images, or may output moving images with a set frame rate to an external display device.

As described above, image quality evaluation results can be obtained by evaluating each frame of the captured moving image after capturing the moving image. By setting the frame rate at the time of playback in consideration of the image quality evaluation result thus obtained, it is possible to guarantee the image quality of moving images and to perform high-quality high-speed playback of moving images.

(Other examples)
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by processing to It can also be implemented by a circuit (for example, ASIC) that implements one or more functions.

Although preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist thereof.

103 AE processing unit 105 AF processing unit 108 image sensor 110 image processing unit 111 WB processing unit 114 image recording unit 115 system control unit 117 operation display unit 118 operation unit 122 imaging switch 123 subject detection module 125 IS processing unit

Claims (6)

a first detection means for detecting a subject from the moving image acquired using the imaging means;
a second detection means for detecting a frame in which an amount of motion of the subject detected by the first detection means exceeds a predetermined value, among a plurality of frames constituting the moving image;
setting means for setting a frame rate when reproducing the moving image;
and evaluation means for evaluating the image quality state of the moving image,
The setting means divides the moving image into a plurality of periods according to the scene change of the moving image based on the detection result of the second detecting means, and the second detecting means detects the moving image for each of the plurality of periods. Based on the result and the evaluation result of the evaluation means, a frame rate for reproduction is set, and a period during which the moving image is reproduced at a first frame rate and a second frame rate lower than the first frame rate. An image processing apparatus characterized by being able to set a period for reproduction at a rate. The setting means sets the second frame rate for a period including a frame corresponding to a movement amount exceeding the predetermined value of the moving image based on the detection result of the second detection means. The image processing apparatus according to claim 1. The setting means sets the first frame rate for a period including a frame corresponding to a movement amount of the moving image equal to or less than the predetermined value based on the detection result of the second detection means. 3. The image processing apparatus according to claim 2. The evaluation means includes exposure setting, autofocus setting, white balance setting, image blur correction setting when capturing a subject to obtain a moving image, and brightness, color, contrast, and noise for each frame of the moving image. 4. The image processing apparatus according to any one of claims 1 to 3, wherein the state of the moving image is evaluated based on any of information relating to the moving image. a first detection step of detecting a subject from the moving image acquired using the imaging means;
a second detection step of detecting a frame in which the amount of motion of the subject detected in the first detection step exceeds a predetermined value, among a plurality of frames constituting the moving image;
a setting step of setting a frame rate when reproducing the moving image;
and an evaluation step of evaluating the image quality state of the moving image,
In the setting step, the moving image is divided into a plurality of periods according to a scene change of the moving image based on the detection result in the second detecting step, and the second detecting step is performed for each of the plurality of periods. Based on the detection result and the evaluation result of the evaluation step , a frame rate for reproduction is set, and a period during which the moving image is reproduced at a first frame rate and a second frame rate lower than the first frame rate are set. A control method for an image processing apparatus, characterized by being able to set a period for reproduction at a frame rate. A program that causes a computer to function as each means of the image processing apparatus according to any one of claims 1 to 4.

Images