JP2014049882A - Imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To shorten a processing time.SOLUTION: An imaging apparatus includes: imaging means 2 for capturing the image of a subject; reduction processing means 3 for performing reduction processing with respect to RAW data 100 of a moving image captured by the imaging means 2 and generating reduction RAW data 101; and frame rate determination means 3 for detecting the motion of a subject on the basis of reduction RAW data 101 and determining a first reproduction frame rate 121 in a moving image on the basis of the detected motion of a subject.

Description

  The present invention relates to an imaging apparatus.

  An imaging device that sets a frame rate of a moving image in accordance with the movement of a subject is known (see Patent Document 1).

JP 2010-50877 A

  In the captured image, for example, when the background sky is overexposed or the shadow portion is blackened as a result of the image processing, it is necessary to perform the image processing again. The same applies when it is desired to readjust the shadow image to the desired color. In order to cope with such a case, it is conceivable to record RAW data which is data before image processing. However, when the frame rate of the moving image is set according to the movement of the subject as in the conventional technique, it takes a long time to perform the process of detecting the movement of the subject based on the RAW data of the moving image. There was a problem.

  An imaging apparatus according to the present invention includes an imaging unit that images a subject, a reduction processing unit that generates reduced RAW data by performing reduction processing on RAW data of a moving image captured by the imaging unit, and reduced RAW data. And a frame rate determining unit configured to detect a motion of the subject based on the detected motion of the subject and determine a first reproduction frame rate in the moving image based on the detected motion of the subject.

  According to the present invention, the processing time can be shortened.

It is a block diagram explaining the structure of the imaging device by one embodiment of this invention. It is a figure explaining the imaging | photography timing in short video recording mode. It is a figure explaining the recording process in 1st Embodiment. It is a figure explaining the reproduction | regeneration processing in 1st Embodiment. It is a figure explaining the reproduction | regeneration processing in 1st Embodiment. It is a figure explaining an image processing parameter and a reproduction frame rate. It is a figure explaining the recording process in 2nd Embodiment. It is a figure explaining the reproduction | regeneration processing in 2nd Embodiment. It is a figure explaining the recording process in the modification 5. FIG.

-First embodiment-
A first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram illustrating a configuration of the imaging apparatus according to the first embodiment. The imaging device 1 includes an imaging element 2, a control unit 3, a storage unit 4, an operation unit 5, and a display unit 6. A memory card 7 can be attached to and detached from the imaging device 1.

  The image pickup device 2 is an image sensor such as a CMOS, for example, picks up a subject image formed by an image pickup optical system (not shown), and outputs an image signal obtained by the image pickup to the control unit 3. A well-known color filter is provided on the light receiving surface of the image sensor 2. The color filter is a color separation filter in which primary color filters that pass any one of red (R), blue (B), and green (G) light are configured in a Bayer arrangement corresponding to pixel positions. . The imaging device 2 outputs a color image signal for each of the three primary colors of light by capturing a subject image through such a color filter.

  The control unit 3 includes a CPU and other peripheral circuits, and controls the entire imaging device 1. In the still image shooting mode, the control unit 3 performs predetermined image processing on the image signal output from the image sensor 2 to generate still image data, and performs compression processing using a predetermined method such as JPEG. To record in the memory card 7. Further, in the moving image shooting mode, the control unit 3 performs predetermined image processing on the image signal output from the image sensor 2 to generate moving image data, and performs compression processing by a predetermined method such as MPEG. To the memory card 7.

  The storage unit 4 is configured by a semiconductor memory built in the imaging device 1. The storage unit 4 includes a first storage area 41 and a second storage area 42. Note that the first storage area 41 and the second storage area 42 are described separately for the sake of convenience, but need not be physically separated.

  The storage unit 4 is used when temporarily storing image data before image processing, after image processing, and during image processing. The storage unit 4 also stores an image (pre-capture image) acquired by the imaging device 2 at a predetermined frame rate before a shooting instruction (before the shutter button is fully pressed), or after a shooting instruction (after the shutter button is fully pressed). ) Is also used for temporarily storing an image (post-capture image) acquired by the image sensor 2 at a predetermined frame rate.

  The operation unit 5 includes various input members operated by the user, such as a mode switching button, a shutter button, a recording button, a cross key, and a determination button. The operation unit 5 sends an operation signal corresponding to each operation to the control unit 3 when each button is pressed.

  The display unit 6 includes a liquid crystal monitor (rear monitor) mounted on the rear surface of the imaging apparatus 1 and displays a live view image, a reproduced image, and the like.

  In the imaging apparatus 1 of the present embodiment, a normal still image shooting mode for recording a still image of one frame in response to an operation of the shutter button and a normal moving image shooting mode for recording a moving image in response to an operation of pressing the recording button. In addition, a short-time moving image shooting mode for recording a short-time moving image is provided.

  Unlike the normal movie shooting mode in which the recording button is operated at the start and end of recording, the short-time movie shooting mode is a mode in which a movie is shot for a short time (for example, 1 second) according to the operation of the shutter button. . Since the present embodiment is characterized by the operation in the short-time moving image shooting mode, the following description will be focused on the short-time moving image shooting mode.

<Short-time movie shooting mode>
FIG. 2 is a diagram illustrating the shooting timing in the short-time moving image shooting mode. A black band in FIG. 2 represents a section in which image data is recorded on the memory card 7. The hatched band represents a section in which image data is temporarily stored in the storage unit 4 but is not recorded in the memory card 7.

  When the shutter button is half-pressed at time t0, the control unit 3 performs AF lock for fixing the focus adjustment state, AE lock for fixing exposure, and AWB lock for fixing white balance. Then, the control unit 3 starts the pre-capture process. In the pre-capture process, a subject image is captured at a predetermined frame rate, and the acquired image data is temporarily stored in the storage unit 4 sequentially. Note that when the number of frame images stored in the storage unit 4 after the time t0 reaches a predetermined number, the control unit 3 overwrites and erases the oldest frame images in order.

  Even after the shutter button is fully pressed at time t2, the control unit 3 continues to store images in the storage unit 4 until time t3 (after a predetermined time from time t2). Then, the control unit 3 combines the frame image (pre-capture image) captured from time t1 (predetermined time before time t2) to time t2 with the frame image (post-capture image) captured from time t2 to time t3. To the memory card 7. That is, the control unit 3 records a moving image of a predetermined time Tw (for example, 1 second) on the memory card 7 with respect to the time t2.

<Recording process>
Next, recording processing in the short-time moving image shooting mode will be described in detail with reference to FIG. An image signal picked up by the image pickup device 2 is converted into a digital signal by an A / D conversion unit (not shown) and output to the control unit 3 as RAW data 100. RAW data is a digital image in which the relationship between the amount of incident light and the output signal value is a linear relationship, and is image data that has not been subjected to Bayer interpolation, white balance conversion, γ conversion, or the like.

  When the shutter button is half-pressed, the control unit 3 temporarily stores the RAW data 100 captured by the image sensor 2 at a predetermined frame rate in the first storage area 41 of the storage unit 4 sequentially. At the same time, the control unit 3 generates reduced RAW data 101 obtained by performing reduction processing 31 on the RAW data 100 output from the image sensor 2, and sequentially stores the reduced RAW data 101 in the second storage area 42 of the storage unit 4. To do. In the present embodiment, it is assumed that the RAW data 100 and the reduced RAW data 101 are stored uncompressed.

  The control unit 3 performs AE calculation or AWB calculation at the time of half-pressing the shutter button, and sets an image processing parameter (hereinafter referred to as default image processing parameter) 110 based on the result. The default image processing parameter 110 may be a predetermined parameter.

  The control unit 3 performs image processing 32 on the reduced RAW data 101 using the default image processing parameter 110. Then, the control unit 3 uses the preset playback frame rate for live view display (hereinafter referred to as a live view playback frame rate) 120 for the image after the image processing 32 to perform playback frame rate control processing. 33 is performed. Thus, live view moving image data 102 for reproducing an image that has been subjected to the image processing 32 using the default image processing parameter 110 at a live view reproduction frame rate 120 is generated. The control unit 3 reproduces and displays the generated live view moving image data 102 on the display unit 6.

  The live view playback frame rate 120 is the same frame rate as the imaging frame rate. That is, a live view image based on an image captured by the image sensor 2 is displayed on the display unit 6 in real time.

  When the shutter button is fully pressed, the control unit 3 executes the reproduction frame rate determination process 34 based on the time when the shutter button is fully pressed and the reduced RAW data 101 corresponding to the frame images before and after the time. . In the reproduction frame rate determination process 34, an optimum reproduction frame rate is determined based on the movement of the subject. Note that the reproduction frame rate determined here is referred to as a default reproduction frame rate.

  Specifically, based on the reduced RAW data, the control unit 3 obtains a difference between images at the time when the shutter button is fully pressed and the frames before and after that, and detects the movement of the subject from the difference. At this time, the part with the largest movement in the image may be determined as the subject, and the other part may be determined as the background. Alternatively, the movement of the subject may be detected by other methods. For example, it is possible to detect a part showing the feature of a person's face or a part matching a predetermined target feature by pattern matching and track the movement of that part.

  Then, the control unit 3 determines the default playback frame rate 121 based on the detection result of the movement of the subject. At this time, the control unit 3 causes the default playback frame rate 121 so that the greater the movement of the subject (ie, the faster the subject speed), the lower the playback frame rate (for example, slower than the imaging frame rate). To decide. That is, the control unit 3 determines the default playback frame rate 121 such that the smaller the movement of the subject (that is, the slower the subject speed), the higher the playback frame rate (for example, close to the imaging frame rate). To do.

  Further, the control unit 3 reads out the RAW data 100 of the frame image for a predetermined time Tw based on the time point when the shutter button is fully pressed from the first storage area 41 and records it in the memory card 7. Further, the control unit 3 reads the reduced RAW data 101 corresponding to the RAW data 100 from the second storage area 42 and records it in the memory card 7 in association with the RAW data 100. Further, the control unit 3 records the default image processing parameter 110 and the default playback frame rate 121 in the memory card 7 in association with the RAW data 100. Note that the default image processing parameter 110 and the default playback frame rate 121 are associated with the RAW data 100 by being written in a tag of a moving image file including the RAW data 100, for example.

<Reproduction processing>
Next, a reproduction process for reproducing an image shot in the short-time moving image shooting mode will be described with reference to FIGS. When the user gives an instruction to reproduce the captured image in the short-time moving image capturing mode via the operation unit 5, the control unit 3 reads the reduced RAW data 101 from the memory card 7 as shown in FIG. Image processing 32 is performed using default image processing parameters 110 associated with data 100. Then, the control unit 3 performs a playback frame rate control process 33 on the image after the image processing 32 using the default playback frame rate 121 associated with the RAW data 100. As a result, the default moving image data 103 for reproducing the image subjected to the image processing 32 using the default image processing parameter 110 at the default reproduction frame rate 121 is generated. The control unit 3 reproduces and displays the generated default moving image data 103 on the display unit 6. As a result, the user can check the moving image that has been subjected to the image processing using the image processing parameters set at the time of shooting at the playback frame rate corresponding to the movement of the subject at the time of shooting.

  While the default moving image data 103 is being reproduced and displayed, the imaging apparatus 1 accepts an instruction to change the image processing parameter and the reproduction frame rate by the user. At this time, the user operates the cross key or the enter button of the operation unit 5 while confirming the default moving image data 103 displayed on the display unit 6, and the image processing parameters and the reproduction frame rate are given to the imaging apparatus 1. Can be freely instructed. Note that the image processing parameters and the playback frame rate are not necessarily displayed during playback, but may be changed after playback has ended, or playback may be temporarily stopped with a playback stop button (not shown) during playback, The parameters may be changed while checking the display image by performing frame advance or the like.

  When the user instructs to change the image processing parameter and the playback frame rate via the operation unit 5, as shown in FIG. 5, the control unit 3 applies the image processing parameter after the change by the user to the reduced RAW data 101. (Hereinafter referred to as a post-change image processing parameter) 111 is used to perform image processing 32. Then, the control unit 3 performs a playback frame rate control process 33 on the image after the image processing 32 by using a playback frame rate after being changed by the user (hereinafter referred to as a post-change playback frame rate) 122. Thereby, the after-change moving image data 104 for reproducing the image subjected to the image processing 32 using the after-change image processing parameter 111 at the after-change reproduction frame rate 122 is generated. The control unit 3 reproduces and displays the generated changed moving image data 104 on the display unit 6.

  Then, the control unit 3 records the changed image processing parameter 111 and the changed playback frame rate 122 in the memory card 7 in association with the RAW data 100. Here, the default image processing parameter 110 and the default playback frame rate 121 associated with the RAW data 100 are rewritten to the changed image processing parameter 111 and the changed playback frame rate 122.

  Thereafter, when the user instructs to change the image processing parameter and the playback frame rate via the operation unit 5, the image processing 32 is performed using the new changed image processing parameter 111 and the changed playback frame rate 122. Then, the reproduction frame rate control processing 33 is performed, and the changed moving image data 104 is generated and reproduced and displayed on the display unit 6. Then, the control unit 3 rewrites the new post-change image processing parameter 111 and the post-change playback frame rate 122 with the previous post-change image processing parameter 111 and the post-change playback frame rate 122 and records them in the memory card 7.

  Thus, in the reproduction process, the image processing parameter and the reproduction frame rate can be changed a plurality of times.

<Image processing parameters and playback frame rate>
6A and 6B are diagrams for explaining the image processing parameters and the playback frame rate described above. FIG. 6 illustrates white balance coefficients, color reproduction matrix coefficients, gamma tables, and edge enhancement coefficients as image processing parameters. 6A shows an example of the default image processing parameter and the default playback frame rate, and FIG. 6B shows an example of the changed image processing parameter and the changed playback frame rate. In FIG. 6B, the white balance coefficient, the gamma table, and the reproduction frame rate are changed from FIG.

  Here, the default image processing parameters and the default playback frame rate shown in FIG. 6A are fixed values during the recording time Tw. However, as shown in FIG. 6B, the changed image processing parameter and the changed playback frame rate do not have to be fixed values during the recording time Tw, and different values are set according to the time (frame number). it can. That is, the user can set the image processing parameter and the playback frame rate for each frame as desired.

  Further, the image processing parameters are not limited to the contents illustrated in FIG. The image processing parameter may include, for example, a parameter in color image signal generation processing (such as Bayer interpolation processing), a parameter in gradation processing, a parameter in color processing, and a coefficient of blurring due to electronic defocusing. Further, the image processing parameters may include a parameter in enlargement / reduction processing (such as a magnification factor of electronic zoom), a parameter in partial cutout processing (such as a cutout position), and a parameter in partial cutout movement processing (such as movement information of the cutout position). The partial cutout process is, for example, a process of cutting out a part to be displayed on the display unit 6 in a photographed image, and the partial cutout movement process is a process of, for example, moving a part displayed on the display unit 6 in a photographed image. is there.

  Further, when the control unit 3 records the RAW data 100 on the memory card 7, the parameters (shooting parameters) of the optical conditions at the time of shooting (for example, the F value of the lens, the shutter speed, the set color temperature, etc.) It may be recorded in association with the data 100.

According to the first embodiment described above, the following operational effects can be obtained.
(1) The imaging apparatus 1 performs the reduction process 31 on the imaging element 2 that captures the subject and the RAW data 100 of the moving image captured by the imaging element 2, and generates the reduced RAW data 101. And a control unit 3 that detects the movement of the subject based on the reduced RAW data 101 and determines the default playback frame rate 121 in the moving image based on the detected movement of the subject. As a result, a playback frame rate suitable for the movement of the subject can be determined. In addition, since the subject motion detection process is performed using the reduced RAW data 101, the processing time can be shortened compared to the case where the RAW data 100 is used.

(2) In the imaging apparatus 1 of the above (1), a predetermined time Tw based on the operation unit (shutter button) 5 instructing photographing and the instruction timing (full pressing of the shutter button) instructed by the operation unit 5 And a control unit 3 that acquires the captured moving image. The control unit 3 performs the reduction process 31 on the RAW data 100 of the acquired moving image to generate the reduced RAW data 101, and the moving image The movement of the subject is detected based on the reduced RAW data 101 of the previous and next frame images based on the instruction timing in, and the default playback frame rate 121 is determined based on the detected movement of the subject. Thereby, it is possible to determine a playback frame rate suitable for the movement of the subject at the timing of the shooting instruction by the user.

(3) In the imaging device 1 of (2) above, the control unit 3 records the reduced RAW data 101, the default playback frame rate 121, and the default image processing parameter 110 in the memory card 7 in association with the RAW data 100. When the reproduction instruction of the moving image is instructed by the user, the reduced RAW data 101 is subjected to the image processing 32 using the default image processing parameter 110, and the moving image after the image processing (default moving image data 103) is set as the default. The playback frame rate 121 is used for playback and display on the display unit 6. As a result, the user can check the moving image that has been subjected to the image processing 32 using the default image processing parameter 110 at the default playback frame rate 121 suitable for the movement of the subject. Further, by performing the image processing 32 and the reproduction frame rate control processing 33 on the reduced RAW data 101, the processing time can be shortened as compared with the case where the RAW data 100 is used.

(4) In the imaging device 1 of (3), the operation unit 5 that instructs the post-change playback frame rate 122 different from the default playback frame rate 121 and the post-change image processing parameter 111 different from the default image processing parameter 110 In addition, the control unit 3 performs image processing 32 on the reduced RAW data 101 using the changed image processing parameter 111, and reproduces and displays the moving image after the image processing 32 at the changed playback frame rate 122. The changed playback frame rate 122 and the changed image processing parameter 111 are rewritten with the default playback frame rate 121 and the default image processing parameter 110 and recorded in the memory card 7 in association with the RAW data 100. It was configured as follows. As described above, when there is an instruction to change the image processing parameter and the reproduction frame rate, the image processing and the reproduction frame rate control process are performed on the reduced RAW data 101 using the image processing parameter and the reproduction frame rate after the change. Thus, the processing time can be shortened as compared with the case where the RAW data 100 is used.

-Second embodiment-
Next, a second embodiment of the present invention will be described with reference to the drawings. In the second embodiment, the recording process and the reproduction process in the short-time moving image shooting mode are different from those in the first embodiment, and this point will be mainly described. Note that the imaging apparatus of the second embodiment is the same as the configuration of the imaging apparatus 1 of the first embodiment, and a description thereof will be omitted. In addition, in the second embodiment, description and illustration of the same parts as those in the first embodiment are omitted.

<Recording process>
First, recording processing in the short-time shooting mode of the second embodiment will be described. When the shutter button is pressed halfway, the control unit 3 temporarily stores the RAW data 100 and the reduced RAW data 101 in the storage unit 4 as in the first embodiment. Further, as in the first embodiment, the control unit 3 uses the default image processing parameter 110 and the live view playback frame rate 120 for the reduced RAW data 101 to perform image processing 32 and playback frame rate control processing. 33, the live view moving image data 102 is generated and reproduced and displayed on the display unit 6.

  When the shutter button is fully pressed, the control unit 3 executes the playback frame rate determination process 34 based on the reduced RAW data 101 as shown in FIG. A reproduction frame rate 121 is determined.

  Here, unlike the first embodiment, the control unit 3 uses the default image processing parameter 110 and the default playback frame rate 121 for the reduced RAW data 101 to perform image processing 32 and playback frame rate control processing 33. To generate the default moving image data 103.

  The control unit 3 records the default moving image data 103 in association with the RAW data 100 in the memory card 7 in addition to the reduced RAW data 101, the default image processing parameter 110, and the default playback frame rate 121. The control unit 3 performs data compression processing by the image compression unit on the default moving image data 103 and records the data on the memory card 7. In this way, by associating the default moving image data 103 with the RAW data 100 as well, the default moving image data 103 can be reproduced and displayed immediately during the reproduction process.

<Reproduction processing>
Next, playback processing for playing back images shot in the short-time shooting mode of the second embodiment will be described. When the user gives an instruction to reproduce the shot image in the short-time shooting mode through the operation unit 5, the control unit 3 reads the default moving image data 103 from the memory card 7, and performs data expansion processing by the image expansion means. Then, it is reproduced and displayed on the display unit 6.

  Thereafter, when the user instructs to change the image processing parameter and the reproduction frame rate via the operation unit 5, the control unit 3 reduces the reduced RAW data as in the first embodiment, as shown in FIG. 101 is subjected to image processing 32 and playback frame rate control processing 33 using the post-change image processing parameter 111 and post-change playback frame rate 122 to generate post-change video data 104. The control unit 3 reproduces and displays the generated changed moving image data 104 on the display unit 6.

  Then, the control unit 3 rewrites the changed image processing parameter 111 and the changed reproduction frame rate 122 with the default image processing parameter 110 and the default reproduction frame rate 121 associated with the RAW data 100.

  The control unit 3 rewrites the changed moving image data 104 with the default moving image data 103 associated with the RAW data 100. That is, the control unit 3 records the changed moving image data 104 in the memory card 7 in association with the RAW data 100. The control unit 3 performs data compression processing by the image compression unit on the changed moving image data 104 and records it in the memory card 7.

  Further, the control unit 3 deletes the reduced RAW data 101 associated with the RAW data 100 from the memory card 7. Thereby, the capacity of the memory card 7 can be saved.

  Note that after the deletion of the reduced RAW data 101, if the user instructs to change the image processing parameters and the playback frame rate via the operation unit 5, the control unit 3 reads the RAW data 100 from the memory card 7. The reduction RAW data 101 may be generated again by performing reduction processing.

  Then, the control unit 3 performs image processing 32 and playback frame rate control processing 33 on the reduced RAW data 101 generated again, using the new post-change image processing parameter 111 and the post-change playback frame rate 122, and creates a new The changed moving image data 104 is generated and reproduced and displayed on the display unit 6.

  At this time, the control unit 3 rewrites the new post-change image processing parameter 111, the post-change playback frame rate 122, and the post-change video data 104 with the previous one and records them in the memory card 7, but the reduced RAW generated here The data 101 is not recorded.

  Thus, in the reproduction process, the image processing parameter and the reproduction frame rate can be changed a plurality of times.

According to the second embodiment described above, the following operational effects can be obtained.
(1) In the imaging apparatus 1, the control unit 3 performs image processing 32 on the reduced RAW data 101 using the default image processing parameter 110, and a moving image after the image processing 32 is processed as a default playback frame rate 121. Since the default video data 103 that is played back in the above manner is recorded on the memory card 7 in association with the RAW data 100, the default video data 103 is played back and displayed immediately when the user gives a playback instruction. Can do.

(2) In the imaging device 1 of (1) above, when the user gives an instruction to change the image processing parameter and the playback frame rate, the control unit 3 uses the changed image processing parameter 111 for the reduced RAW data 101. Then, the modified moving image data 104 in which the image processing 32 is performed and the moving image after the image processing 32 is reproduced at the modified reproduction frame rate 122 is rewritten with the default moving image data 103 and associated with the RAW data 100 in the memory. It was configured to record on the card 7. As a result, the changed moving image data 104 can be reproduced and displayed immediately when the user gives a reproduction instruction.

(3) In the imaging device 1 of (2) above, the control unit 3 records the changed moving image data 104 in association with the RAW data 100 on the memory card 7 and the reduced RAW recorded in association with the RAW data 100. Since the configuration is such that the data 101 is deleted, the capacity of the memory card 7 can be saved.

(Modification 1)
In the short-time shooting mode described above, HDR (High Dynamic Range) image generation processing for shooting an image with an expanded apparent dynamic range may be performed. In this case, the control unit 3 controls the imaging process by the imaging device 2 to set at least two or more frames close in time (continuous) as a set, and in each set, exposure time ( That is, frame images with different exposure amounts are acquired by changing the shutter speed. And the control part 3 produces | generates the frame image for 1 sheet by synthesize | combining 1 set of frame images image | photographed with different exposure amount. At this time, the control unit 3 reproduces the dark part using the data of the frame image with the longer exposure time, and reproduces the bright part using the data of the frame image with the shorter exposure time. The middle part between the dark part and the bright part is reproduced using both frame images. Thereby, the apparent dynamic range of the frame image can be expanded.

  The control unit 3 performs the HDR image generation process using the RAW data 100 or the reduced RAW data 101 recorded in the storage unit 4 or the memory card 7. In the HDR image generation process, information indicating the exposure amount in each frame is necessary. Therefore, the control unit 3 associates the shutter speed information with the RAW data 100 or the reduced RAW data 101 and records it in the storage unit 4 or the memory card 7 for each frame.

(Modification 2)
In the above-described embodiment, the example in which the default playback frame rate 121 is set uniformly during the recording time Tw has been described. However, the default playback frame rate 121 may be changed according to the frame.

  For example, the default playback frame rate 121 is changed according to the size of the subject with respect to the shooting screen. In this case, when the shooting of the recording time Tw is completed, the control unit 3 analyzes the reduced RAW data 101 of the shot image and, for each frame, according to the size of the subject with respect to the shooting screen, the default playback frame rate 121. To decide. At this time, the default playback frame rate 121 is determined so that the frame rate decreases as the size of the subject with respect to the shooting screen increases, and the frame rate increases as the size of the subject with respect to the shooting screen decreases. By doing so, for example, it is possible to generate a moving image in which the frame rate decreases as the subject approaches the imaging device 1.

  For example, when the main subject is switched during the recording time Tw, the default playback frame rate 121 is changed according to the movement information of the main subject at that time. In this case, when the shooting of the recording time Tw is completed, the control unit 3 analyzes the reduced RAW data 101 of the shot image, detects the main subject for each frame, and uses the default object according to the detected motion information of the main subject. A playback frame rate 121 is determined. By doing this, it is possible to generate a moving image with a frame rate that matches the movement of the main subject.

(Modification 3)
When the default moving image data 103 is reproduced and displayed in the reproduction processing, the control unit 3 highlights the subject used to determine the default reproduction frame rate 121 on the default moving image data 103 (for example, by enclosing it with a frame or the like). Display). By doing so, it is possible to notify the user of which subject's motion information the default playback frame rate 121 has been determined.

  Then, the user designates a subject other than the subject used to determine the default playback frame rate 121 via the operation unit 5 on the default moving image data 103, so that a frame corresponding to the motion of the designated subject is obtained. It may be possible to designate the playback frame rate 122 after changing the rate. In this case, the control unit 3 performs the reproduction frame rate determination process 34 based on the movement of the subject designated via the operation unit 5 and determines the post-change reproduction frame rate 122.

(Modification 4)
In the above-described embodiment, the example in which the default reproduction frame rate 121 is determined based on the motion information of the subject in the frame before and after the shutter button full press operation has been described. However, the control unit 3 selects one frame of the best shot from the frames of the recording time Tw, and determines the default playback frame rate 121 based on the motion information of the subject in the frame of the best shot and the preceding and subsequent frames. You may make it do. As a method of selecting one frame of the best shot, for example, a method of determining blur, blurring, brightness, composition, etc., and selecting based on the determination result may be used, or other known methods may be used. Good. Further, the frame number selected as the best shot may be recorded in association with the RAW data 100.

(Modification 5)
In the above-described embodiment, the example in which the storage unit 4 built in the imaging apparatus 1 is used as a buffer memory that temporarily stores the RAW data 100 and the reduced RAW data 101 during the pre-capture processing has been described. However, as shown in FIG. 9, a first storage area 71 and a second storage area 72 may be set in a part of the memory card 7 that is an external memory of the imaging apparatus 1. In this case, the first storage area 71 is used as a buffer memory for the RAW data 100, and the second storage area 72 is used as a buffer memory for the reduced RAW data 101.

(Modification 6)
In the second embodiment described above, an example is described in which once the image processing parameter and the playback frame rate are instructed after shooting, the reduced RAW data 101 is deleted after the image processing parameter and the playback frame rate are changed. did. However, the reduced RAW data 101 may not be deleted even if an instruction to change the image processing parameter and the playback frame rate is given.

  For example, when the remaining capacity of the memory card 7 is equal to or less than a predetermined value, the control unit 3 according to the modification 6 deletes the reduced RAW data 101 associated with the RAW data 100. The control unit 3 may automatically delete the reduced RAW data 101 when deleting the reduced RAW data 101. In addition, the control unit 3 displays a message asking whether or not to delete the reduced RAW data 101 on the display unit 6, and deletes the reduced RAW data 101 when instructed to delete via the operation unit 5. May be.

(Modification 7)
In the above-described embodiment, the example in which the RAW data 100 and the reduced RAW data 101 are recorded in the memory card 7 without compression has been described. However, the RAW data 100 and the reduced RAW data 101 may be recorded on the memory card 7 by performing data compression processing by an image compression unit. In this case, when the RAW data 100 and the reduced RAW data 101 are read, data expansion processing is performed by the image expansion means.

(Modification 8)
In the above-described embodiment, the example in which the present invention is applied in the short-time moving image shooting mode in which a short-time moving image is recorded in response to the full pressing operation of the shutter button has been described. However, in response to a full press of the shutter button, a still image at the time of the full press of the shutter button is recorded together with a short video, and image data that reproduces the still image for a predetermined time after the short video is recorded. The present invention may also be applied in a shooting mode for shooting.

  The above description is merely an example, and is not limited to the configuration of the above embodiment. Moreover, you may combine the structure of each modification suitably with the said embodiment.

DESCRIPTION OF SYMBOLS 1 ... Imaging device, 2 ... Image sensor, 3 ... Control part, 4 ... Memory | storage part, 5 ... Operation part, 6 ... Display part, 7 ... Memory card

Claims (8)

Imaging means for imaging a subject;
Reduction processing means for performing reduction processing on the RAW data of the moving image captured by the imaging means to generate reduced RAW data;
Frame rate determining means for detecting a movement of the subject based on the reduced RAW data and determining a first playback frame rate in the moving image based on the detected movement of the subject;
An imaging apparatus comprising: The imaging device according to claim 1,
Photographing instruction means for instructing photographing;
An acquisition unit for acquiring a moving image captured by the imaging unit for a predetermined time based on an instruction timing instructed by the imaging instruction unit;
Further comprising
The reduction processing unit performs reduction processing on the RAW data of the moving image acquired by the acquisition unit to generate reduced RAW data,
The frame rate determining means detects the movement of the subject based on the reduced RAW data of the previous and next frame images based on the instruction timing in the moving image, and based on the detected movement of the subject, the first An image pickup apparatus for determining a reproduction frame rate of the image pickup apparatus. The imaging device according to claim 2,
A recording control means for recording the reduced RAW data, the first reproduction frame rate, and a first image processing parameter used for image processing on the moving image in a recording means in association with the RAW data;
Playback control means for performing image processing on the reduced RAW data using the first image processing parameter, playing back the moving image after the image processing at the first playback frame rate and displaying it on a display means; ,
An image pickup apparatus further comprising: The imaging device according to claim 3.
An instruction means for instructing a second reproduction frame rate different from the first reproduction frame rate and a second image processing parameter different from the first image processing parameter;
The reproduction control means performs image processing on the reduced RAW data using the second image processing parameter, reproduces the moving image after the image processing at the second reproduction frame rate, and displays it on the display means. Display
The recording control unit rewrites the second reproduction frame rate and the second image processing parameter with the first reproduction frame rate and the first image processing parameter, and records the second reproduction frame rate and the second image processing parameter in association with the RAW data. An image pickup apparatus that records in The imaging apparatus according to claim 4,
The recording control means performs image processing on the reduced RAW data using the first image processing parameter, and reproduces the moving image after the image processing at the first reproduction frame rate. One moving image data is recorded on a recording means in association with the RAW data. The imaging apparatus according to claim 5,
The recording control means performs image processing on the reduced RAW data using the second image processing parameter, and reproduces the moving image after the image processing at the second reproduction frame rate. An image pickup apparatus, wherein the second moving image data is rewritten with the first moving image data and recorded in a recording unit in association with the RAW data. The imaging device according to claim 6,
The recording control unit records the second moving image data in the recording unit in association with the RAW data, and deletes the reduced RAW data recorded in association with the RAW data. apparatus. In the imaging device according to any one of claims 3 to 7,
In the imaging of the moving image, an imaging control unit that controls the imaging unit so as to capture at least two frame images close in time with different exposure amounts;
Image synthesizing means for generating a synthesized image based on the frame images captured at different exposure amounts;
Further comprising
The image recording apparatus, wherein the recording control unit records information indicating an exposure amount at the time of image capturing on the recording unit in association with RAW data for each frame image.

Images