JP2014007622A - Image pick-up device and program - Google Patents

Abstract

An imaging condition can be updated following a change in shooting environment faster than a recording frame rate.
First frames f12, f22. . . The automatic exposure adjustment processing (AE) is performed based on the image data (YUV data) of the luminance color difference signal of the frame image included in. In parallel with this processing, the next frames f13, f23. . . The automatic white balance adjustment process (AWB) is performed based on the image data (YUV data) of the luminance color difference signal of the frame image included in. Further, in parallel with this processing, the last frames f14, f24. . . AF processing is performed based on the sharpness (contrast) of the subject detected from the frame images included in.
[Selection] Figure 3

Description

  The present invention relates to an imaging apparatus and a program.

  Conventionally, an image recording apparatus capable of recording at a normal frame rate and recording at a higher frame rate is known. This image recording apparatus is provided with a program diagram for a normal frame rate and a high frame rate in advance, and when recording at a corresponding frame rate, the program diagram corresponding to the mode is read and the photographing conditions Is set (see, for example, Patent Document 1).

JP 2008-278316 A

  However, even when the above technique is adopted, when shooting at a normal frame rate, a relatively large time interval is left in the frame image to be recorded. There was a problem that the process of updating could not catch up.

  The present invention has been made in view of such a problem, and enables the shooting conditions to be updated following even when the shooting environment changes faster than the recording frame rate. For the purpose.

In order to solve the above problems, an imaging apparatus according to the present invention provides:
Imaging means; output means for driving the imaging means at a predetermined frame rate to sequentially output frame image data; and frame image data output by the output means is regularly thinned to obtain frame image data for recording. An acquisition means for acquiring, and a setting means for setting a shooting condition for the next frame image data for recording using the thinned frame image data.

The program of the present invention is
An apparatus having an imaging unit includes: an output unit that drives the imaging unit at a first frame rate and sequentially outputs frame image data; and the frame image data output by the output unit is regularly thinned out. An acquisition unit that acquires recording frame image data, and a setting unit that sets shooting conditions of the next recording frame image data using the thinned frame image data. To do.

  According to the present invention, it is possible to follow and update the shooting conditions even when the change rate of the shooting environment is faster than the recording frame rate.

It is a block diagram which shows schematic structure of the imaging device of Embodiment 1 and 2 to which this invention is applied. 3 is a flowchart illustrating an example of an operation related to an imaging process performed by the imaging apparatus in FIG. 1 according to the first embodiment. It is a figure for demonstrating the imaging process of FIG. 10 is a flowchart illustrating an example of an operation related to an imaging process performed by the imaging apparatus in FIG. 1 according to the second embodiment. It is a figure for demonstrating the imaging process of FIG.

Hereinafter, embodiments of the present invention will be described.
[Embodiment 1]
FIG. 1 is a block diagram showing a schematic configuration of an imaging apparatus 100 common to Embodiments 1 and 2 to which the present invention is applied.
While the moving image of the subject is recorded as one continuous moving image data, the imaging apparatus 100 according to the first embodiment adjusts the imaging condition of the subject in accordance with a change in the state of the captured image, and records the moving image data. If the frame rate for recording a moving image is switched from a high-speed recording frame rate to a lower normal recording frame rate, the imaging conditions during recording at the normal recording frame rate are adjusted. .

Specifically, as illustrated in FIG. 1, the imaging apparatus 100 includes a lens unit 1, an electronic imaging unit 2, a unit circuit unit 3, an image generation unit 4, a subject detection unit 5, an imaging control unit 6, and an image processing unit 7. A display control unit 8, a display unit 9, a recording medium control unit 10, an operation input unit 11, a buffer memory 12, a program memory 13, a central control unit 14, and the like.
The image generation unit 4, the subject detection unit 5, the imaging control unit 6, the image processing unit 7, the display control unit 8, the recording medium control unit 10, the buffer memory 12, the program memory 13, and the central control unit 14 are connected via a bus line 15. Connected.

  Although not shown, the lens unit 1 includes a zoom lens, a focus lens, a diaphragm, and the like, and forms an optical image of a subject that has passed through these lenses.

  The electronic imaging unit 2 is disposed on the optical axis of the lens unit 1. The electronic imaging unit 2 is composed of an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-oxide Semiconductor), for example, and an optical image that has passed through various lenses of the lens unit 1 according to the imaging frame rate. Then, it is converted into a two-dimensional image signal (RGB image data) every predetermined period and output to the unit circuit unit 3.

  Although not shown, the unit circuit unit 3 includes a CDS (Correlated Double Sampling), an AGC (Auto Gain Control), an ADC (Analog to Digital Converter), and the like. It has. The unit circuit unit 3 holds an analog image signal corresponding to the optical image of the subject output from the electronic image pickup unit 2 and input by the CDS at a predetermined period corresponding to the recording frame rate, and stores the image signal. After amplification by AGC, the amplified image signal is converted into a digital image signal by ADC. The unit circuit unit 3 transmits a digital image signal to the image generation unit 4.

  As described above, the lens unit 1, the electronic imaging unit 2, and the unit circuit unit 3 constitute output means for imaging a subject and sequentially outputting frame image data.

The image generation unit 4 generates a digital luminance signal Y and color difference signals Cb, Cr (YUV data) from the digital image signal sent from the unit circuit unit 3.
Specifically, the image generation unit 4 performs pixel interpolation processing and γ on the digital image data of each frame image sent from the unit circuit unit 3 at predetermined intervals by a color process circuit (not shown). After performing color process processing including correction processing, a digital luminance signal Y and color difference signals Cb and Cr (YUV data) are generated.

Here, the frame rate when the imaging apparatus 100 performs processing for capturing a moving image and recording it as moving image data includes an imaging frame rate indicating a frame rate at which the electronic imaging unit 2 captures a moving image, and imaging conditions. There are an adjustment frame rate indicating a frame rate at which the adjustment unit 6c adjusts an imaging condition, a recording frame rate indicating a frame rate at which the image generation unit generates an image of each frame and records it as moving image data on the recording medium M, and the like. . In the first embodiment, the imaging frame rate is fixed to 120 fps, and the adjustment frame rate and the recording frame rate are changed by 30 fps by thinning out the frame used for adjustment and the frame used for recording.
By performing such an operation, it is possible to easily and quickly switch the adjustment frame rate and the recording frame rate without causing a frame shift or the like when switching the adjustment frame rate or the recording frame rate.

The recording frame rate includes a frame rate corresponding to normal moving image shooting (the normal recording frame rate) and a frame rate corresponding to moving image shooting at a higher speed than the normal moving image shooting (the high speed recording frame rate). In this embodiment, the normal recording frame rate corresponding to normal moving image shooting is 30 fps, and the high speed recording frame rate corresponding to high speed moving image shooting is 120 fps, which is four times that. However, these are examples and are not limited to these, and can be arbitrarily changed as appropriate.
Then, the image generation unit 4 outputs the generated image data of the luminance color difference signal to the subject detection unit 5, the imaging control unit 6, and the image processing unit 7.

  The subject detection unit 5 detects a specific subject from the image data of the luminance color difference signal of each frame image output from the image generation unit 4.

  That is, the subject detection unit 5 acquires image data (YUV data) of each frame image, and performs various image processing such as face detection processing, edge detection processing, and feature extraction processing on the image data. Then, an area including a specific subject (for example, a face area) is detected. Specifically, the subject detection unit 5 extracts candidate regions that are candidates for a specific subject by various image processing such as face detection processing, edge detection processing, and feature extraction processing, and the like. Then, those satisfying a predetermined identification condition are detected as specific subjects.

The predetermined identification conditions include, for example, a size based on a shape such as “human face” or “animal”, or a ratio (for example, half or more) of the entire angle of view with respect to the image. On the basis of color, and on the basis of color tone such as whether the color is bright or bright with high brightness and saturation or whether it is a skin color.
Further, the face detection process, the edge detection process, and the feature extraction process are known techniques, and thus detailed description thereof is omitted here.

The imaging control unit 6 controls operations of the lens unit 1, the electronic imaging unit 2, the unit circuit unit 3, and the like.
In other words, the imaging control unit 6 includes, for example, a drive source such as a motor and a driver (not shown) for driving the drive source, and drives the zoom lens and the focus lens of the lens unit 1 in the optical axis direction. . In addition, the imaging control unit 6 includes, for example, a diaphragm driving unit (not shown) that expands and contracts the aperture of the lens unit 1 and responds to the exposure adjustment condition adjusted by the imaging condition adjustment unit 6c (described later). To increase or decrease the diameter of the diaphragm.

  The imaging control unit 6 includes, for example, a TG (Timing Generator), a driver for driving the electronic imaging unit 2, and the like (both not shown), and the imaging conditions adjusted by the imaging frame rate and the imaging condition adjustment unit 6c ( For example, the operation timing of the electronic imaging unit 2 is controlled via the TG and the driver according to the exposure time and the like. Further, the imaging control unit 6 controls the operation timing of the unit circuit unit 3 in accordance with the recording frame rate.

  That is, the imaging control unit 6 operates the electronic imaging unit 2 at a predetermined timing according to the imaging frame rate and imaging conditions (for example, exposure time, etc.) to convert the optical image of the subject into an analog image signal. The circuit unit 3 is operated at a predetermined timing in accordance with a predetermined recording frame rate (a normal recording frame rate corresponding to normal moving image shooting), and according to an optical image of a subject output and input from the electronic imaging unit 2 An analog image signal is converted into a digital image signal (frame image).

  At this time, when a recording frame rate switching instruction is input based on a predetermined operation of the operation input unit 11 by the user, the imaging control unit 6 switches the recording frame set by a recording frame rate setting unit 6a (described later). The unit circuit unit 3 outputs an analog image signal corresponding to the optical image of the subject output and input from the electronic imaging unit 2 at a predetermined period corresponding to the rate (high-speed recording frame rate corresponding to high-speed moving image shooting). It is converted into a digital image signal (frame image).

  The imaging control unit 6 includes a recording frame rate setting unit 6a, a state detection unit 6b, and an imaging condition adjustment unit 6c.

The recording frame rate setting unit 6a sets a recording frame rate.
That is, the recording frame rate setting unit 6 a sets the recording frame rate related to the driving cycle of the unit circuit unit 3 based on a predetermined operation of the operation input unit 11 by the user. Specifically, among the recording frame rates corresponding to each of the normal moving image shooting and the high-speed moving image shooting, a recording frame rate setting signal designated based on a predetermined operation of the selection determination button 11b of the operation input unit 11 by the user. Is output to the central control unit 14. The central control unit 14 outputs the input setting signal output from the operation input unit 11 to the imaging control unit 6, and the recording frame rate setting unit 6a of the imaging control unit 6 records frames corresponding to the input setting signal. Set the rate. That is, the recording frame rate setting unit 6a causes the recording frame rate to be set to the normal recording frame rate and the high-speed recording frame rate by a predetermined operation of the selection decision button 11b by the user during recording of one continuous moving image data. Switch to and set.

The state detection unit 6b detects the state of the subject based on a plurality of frame images constituting a moving image generated by capturing the subject. That is, the state detection unit 6b detects the brightness and hue of each frame image based on the image data (YUV data) of the luminance / color difference signal of each frame image output from the image generation unit 4.
Specifically, for example, when detecting the brightness of a frame image, the state detection unit 6b uses a predetermined photometry method (for example, center-weighted photometry method, spot photometry method, average photometry method, multi-division photometry method, etc.). Accordingly, the brightness of the frame image is detected based on the luminance signal (Y) of each frame image. For example, when detecting the hue of a frame image, the state detection unit 6b converts the YUV data of each frame image into image data in the HSV color space, and then uses a light source (for example, a saturation S and brightness V histogram). The gray pixel estimation condition corresponding to the color temperature of sunlight, fluorescent light, clear sky, cloudy sky, etc.) is calculated. And the state detection part 6b estimates the gray component contained in each frame image based on a gray pixel estimation condition.

At this time, the state detection unit 6b may detect the brightness and hue of each frame image based on a specific subject (for example, a human face area) detected by the subject detection unit 5 from each frame image. .
Note that the center-weighted metering method is a metering method that focuses on the center of the frame image, and the spot metering method is a metering method that performs metering only on a predetermined area of the frame image. The method is a photometry method in which photometry is performed on the entire surface of the frame image and an average value thereof is obtained. The multi-division photometry method is a photometry method in which the frame image is divided into a plurality of areas and independently metered.

  Further, the state detection unit 6b detects the sharpness of the subject and the size of the subject based on a plurality of frame images constituting a moving image generated by imaging the subject.

The imaging condition adjusting unit 6c constitutes setting means for setting shooting conditions of the next recording frame image data using the thinned frame image data described later, and the thinned frame image The imaging condition of the subject set by the imaging control unit 6 is adjusted in accordance with the change in the state of the subject in the data. In other words, the imaging condition adjustment unit 6c adjusts various imaging conditions based on the state of the subject detected by the state detection unit 6b.
The photographing conditions include, for example, automatic exposure adjustment processing (AE) by the imaging control unit 6, exposure adjustment conditions and white balance adjustment conditions related to automatic white balance adjustment processing (AWB), auto focus adjustment processing (AF), and zoom processing. This is a focus adjustment condition or zoom adjustment condition related to (ZOOM).

  Specifically, when adjusting the exposure adjustment condition related to the automatic exposure adjustment process (AE), the imaging condition adjustment unit 6c uses a predetermined program diagram based on the brightness of the subject detected by the state detection unit 6b. The aperture value of the diaphragm in the lens unit 1, the shutter speed of the electronic imaging unit 2, the AGC signal amplification factor (ISO sensitivity) of the unit circuit, and the like are adjusted. When adjusting the white balance adjustment condition related to the automatic white balance adjustment process (AWB), the imaging condition adjustment unit 6c uses the gray component color (hue) of the subject detected by the state detection unit 6b as a reference. The gain amount of each color component of RGB of each pixel is adjusted.

  Here, the imaging condition adjustment unit 6c may adjust at least one of the exposure adjustment condition and the white balance adjustment condition with reference to a specific subject (for example, a human face area) detected by the subject detection unit 5. good. That is, for example, the imaging condition adjustment unit 6c may adjust the exposure adjustment condition based on the brightness of the human face area detected by the subject detection unit 5, or adjust the white balance based on the hue of the face area. Conditions may be adjusted.

  Further, when adjusting the focus adjustment condition related to the autofocus adjustment process (AF), the imaging condition adjustment unit 6c is based on a predetermined program diagram with reference to the sharpness of the subject detected by the state detection unit 6b. The focus motor in the lens unit 1 is driven. When adjusting the focus adjustment condition or zoom adjustment condition related to zoom processing (ZOOM), the imaging condition adjustment unit 6c drives the zoom motor in the lens unit 1 based on the size of the subject detected by the state detection unit 6b. To do.

  Further, the imaging control unit 6 limits the adjustment of the imaging condition by the imaging condition adjustment unit 6c according to the recording frame rate. Specifically, when recording a moving image at the normal recording frame rate, the imaging control unit 6 sequentially adjusts the imaging condition of the subject by the imaging condition adjustment unit 6c so as to follow the state change of the subject. That is, the imaging control unit 6 captures an object such as an exposure adjustment condition and a white balance adjustment condition by the imaging condition adjustment unit 6c with respect to a frame image captured at a period corresponding to a recording frame rate corresponding to normal moving image shooting. The condition is sequentially adjusted so as to follow the state change of the subject.

  The image processing unit 7 includes an encoding unit (not shown) that compresses and encodes image data (YUV data) generated by the image generation unit 4 using a predetermined encoding method (for example, Motion-JPEG method), A decoding unit (not shown) for decoding the encoded image data read from the recording medium control unit 10 using a decoding method corresponding to the encoding method is provided.

The display control unit 8 performs control to read display image data temporarily stored in the buffer memory 12 and display the read image data on the display unit 9.
Specifically, the display control unit 8 includes a VRAM (Video Random Access Memory), a VRAM controller, a digital video encoder, and the like. The digital video encoder receives the luminance signal Y and the color difference signals Cb and Cr of the plurality of frame images constituting the moving image read from the buffer memory 12 and stored in the VRAM (not shown) via the VRAM controller. The data is read from the VRAM at a predetermined reproduction frame rate, and a video signal is generated based on these data and output to the display unit 9.

  The display unit 9 is a liquid crystal display panel, and displays an image captured by the electronic imaging unit 2 on the display screen based on the video signal from the display control unit 8. Specifically, the display unit 9 sequentially updates a plurality of frame images generated by imaging the subject by the electronic imaging unit 2 and the imaging control unit 6 at a predetermined frame rate in the still image capturing mode and the moving image capturing mode. While displaying the live view image. Further, the display unit 9 displays a plurality of frame images being recorded as moving images, or displays an image (rec view image) recorded as a still image.

The recording medium control unit 10 is configured such that the recording medium M is detachable, and controls reading of data from the loaded recording medium M and writing of data to the recording medium M.
Specifically, the recording medium control unit 10 records image data encoded in a predetermined compression format (for example, Motion-JPEG format) by an encoding unit (not shown) of the image processing unit 7, that is, Then, a moving image of a subject composed of a plurality of frame images sequentially captured by the lens unit 1, the electronic imaging unit 2, and the unit circuit unit 3 is recorded on the recording medium M as one continuous moving image data.
The recording medium M is composed of, for example, a non-volatile memory (flash memory) or the like. However, the recording medium M is an example and is not limited to this, and can be arbitrarily changed as appropriate.

  The operation input unit 11 is for performing a predetermined operation of the imaging apparatus 100. Specifically, the operation input unit 11 is related to a subject shooting instruction, a shutter button 11a that can be half-pressed and fully pressed, a selection determination button 11b that is related to a selection instruction such as an imaging mode or a function, and a zoom amount adjustment. A zoom button (not shown) or the like according to instructions is provided, and a predetermined operation signal is output to the central control unit 14 in response to the operation of these buttons.

The buffer memory 12 is a buffer for temporarily storing image data and the like, and is also used as a working memory for the central control unit 14.
The program memory 13 stores various programs and data related to the functions of the imaging apparatus 100.

  The central control unit 14 controls each unit of the imaging device 100. Specifically, the central control unit 14 includes a CPU (not shown) that controls each unit of the imaging apparatus 100, and performs various control operations according to various processing programs (not shown).

  Next, imaging processing by the imaging apparatus 100 will be described with reference to FIGS.

  FIG. 2 is a flowchart illustrating an example of an operation related to the imaging process in the first embodiment. FIG. 3 is a diagram for explaining the imaging process.

  In FIG. 3, 1s indicates a time length of 1 second, and 120 frames at 120 fps are divided into frame groups f11 to f14 configured by 30 frames in 1s. Yes. Therefore, the time length of each frame group f is 250 msec, and each frame group f includes 30 frame images.

  The following imaging processing is executed when a moving image imaging mode is selected from a plurality of imaging modes based on a predetermined operation of the selection determination button 11b of the operation input unit 11 by the user. The imaging process is started when a moving image imaging instruction is input, and the process of each step is repeatedly executed until a moving image imaging end instruction is input.

  First, as shown in FIG. 2, the imaging control unit 6 drives the image sensor of the electronic imaging unit 2 at a predetermined imaging frame rate (120 fps) to generate two optical images of the subject imaged by the lens unit 1. A frame image is captured by converting it into a three-dimensional image signal (RGB image data) (step S1).

  Next, the imaging control unit 6 branches the process according to the recording frame rate (step S2). Specifically, when the recording frame rate is the normal recording frame rate (30 fps) (step S2; normal moving image shooting frame rate), the imaging control unit 6 shifts the processing to step S3 while recording frames. If the rate is the high-speed recording frame rate (120 fps) (step S2; high-speed moving image shooting frame rate), the process proceeds to step S9.

<Normal movie shooting frame rate>
If the normal recording frame rate (30 fps) corresponding to normal moving image shooting is set in step S2 (step S2; normal moving image shooting frame rate), the imaging control unit 6 responds to the recording frame rate of the normal moving image shooting. The frame image to be processed is thinned out from the frame images successively captured at a predetermined imaging frame rate (120 fps in this embodiment) (in this example, three frame groups are compared to four frame groups). (Select by percentage) to substantially the normal recording frame rate. The imaging control unit 6 operates as an acquisition unit that acquires frame image data for recording by regularly thinning out the frame image data.

  As shown in FIG. 3, the image sensor of the electronic imaging unit 2 operates at a fixed speed of 120 fps, and thus, the frame composed of the first 30 frames among the frame images output from the image sensor at the same speed. f11, f21. . . Are specified as recording frames, while the following three frame groups f12, f22. . . To f13, f23. . . ~, F14, f24. . . Specify ~ as a decimation frame.

  Subsequently, the state detection unit 6b of the imaging control unit 6 outputs the first frames f12, f22. . . Based on the image data (YUV data) of the luminance and color difference signals of the frame images included in ˜, an automatic exposure adjustment process (AE) by the imaging control unit 6 is performed (step S4).

  In parallel with the processing of step S4, the next frames f13, f23. . . The automatic white balance adjustment processing (AWB) is performed based on the image data (YUV data) of the luminance color difference signals of the frame images included in (step S5).

  Further, in parallel with the processing of steps S4 and S5, the last frames f14, f24. . . AF processing is performed based on the sharpness (contrast) of the subject detected from the frame images included in (step S6).

  That is, as described in the “shooting condition” column in FIG. . . AE processing is executed based on the frames f13, f23. . . AWB processing is executed based on the frames f14, f24. . . The AF process is executed and updated based on.

  Note that the detection in steps S4 to S6 may be performed based on a specific subject (for example, a face area) detected from a frame image stored before the processing target frame image.

  In addition, since the detection processes in steps S4 to S6 are performed almost in parallel, there is substantially no influence even if the processing order is changed. In this case, a specific subject detected from one processing target frame image is used as a reference. As such, the brightness, hue, etc. of the one processing target frame image may be detected.

  Next, the imaging condition adjustment unit 6c of the imaging control unit 6 updates the contents of the imaging conditions based on the results processed by the state detection unit 6b by the processes in steps S4 to S6 (step S4).

  Thus, the frame image group (frame F21... In FIG. 3) stored immediately after the thinned frame group to be processed is a frame image captured in a state where the updated imaging conditions are reflected.

  That is, according to the present embodiment, the shooting conditions updated and set in step S7 by the parallel processing in steps S4 to S6 can be reliably reflected in the recording of the frame image data stored in step S8. .

  Next, the central control unit 14 stores the frame image to be processed generated by the image generation unit 4 as a recording frame image, and stores the YUV data of the frame image in the buffer memory 12 (step S8). That is, in the case of the normal moving image shooting frame rate, frame images selected at a rate of 1/4 from the frame images successively captured at 120 fps are stored in the buffer memory 12 at a recording frame rate of 30 fps. .

<High-speed movie shooting frame rate>
On the other hand, when the recording frame rate (120 fps) corresponding to high-speed moving image shooting is set in step S2 (step S2; high-speed moving image shooting frame rate), the imaging control unit 6 records the recording frame corresponding to the high-speed moving image shooting. The imaging condition adjustment unit 6c adjusts so as to maintain a predetermined imaging condition before switching to the frame rate (step S9). Specifically, the imaging control unit 6 applies the frame image captured at a period corresponding to the recording frame rate corresponding to normal moving image shooting before the recording frame rate is switched to the recording frame rate corresponding to high speed moving image shooting. Then, the imaging condition adjusting unit 6c sequentially adjusts and holds the imaging conditions of the subject such as the exposure adjustment condition and the white balance adjustment condition stored in the predetermined storage area.

  Thereafter, the central control unit 14 shifts the processing to step S8, and uses the frame image that is captured at a cycle according to the recording frame rate corresponding to high-speed moving image shooting and generated by the image generation unit 4 as a recording frame image. The YUV data of the frame image is stored in the buffer memory 12. In other words, in the case of a high-speed moving image shooting frame rate, the frame images that are successively captured at 120 fps are not thinned out and are stored in the buffer memory 12 as they are at a recording frame rate of 120 fps.

  Each of the above processes is repeatedly executed until a moving image capturing end instruction is input.

  When a moving image capturing end instruction is input, the recording medium control unit 10 records the moving image data stored in the buffer memory 12 at the recording frame rate set at the start of recording of the moving image data. (30 fps in this example) is added as a recording frame rate attribute and stored in the recording medium M.

  As described above, according to the imaging apparatus 100 of Embodiment 1, shooting and recording are performed while adjusting the imaging conditions so that the exposure, white balance, and focus suitable for the state of the subject are always maintained throughout the moving image shooting. In this way, shooting and recording are performed to record moving image data. Therefore, when shooting is performed at the normal recording frame rate and then played back, it is possible to always see an image adjusted to an appropriate exposure, white balance and focus suitable for the situation of the subject throughout the moving image shooting.

  That is, for example, when imaging is performed while the imaging apparatus 100 is panned by a photometric method that takes into consideration the brightness of the entire frame image, the brightness of the main subject is changed by changing the background even though the state of the main subject is not changed. The hue can be prevented from fluctuating, and then the brightness and hue of the main subject can be made appropriate when the moving image is reproduced at a predetermined reproduction frame rate. In addition, when imaging a main subject that is rotated by a photometric method based on the brightness of the main subject, the imaging condition of the subject is not changed according to the degree of light reflection that changes due to the rotation of the main subject. When a moving image is reproduced at a predetermined reproduction frame rate, the light reflection degree of the main subject can be made appropriate. Further, even when the main subject moves, it is possible to make the main subject have an appropriate focus.

[Embodiment 2]
FIG. 4 is a flowchart showing an example of an operation related to an imaging process in the second embodiment to which the present invention is applied. In this flowchart, steps S11 to S13 and S17 to S19 other than steps S14 to S16 are the same as steps S1 to S3 and S7 to S9 in the flowchart of the first embodiment shown in FIG. Omitted.

  In step S14, which is different from the flowchart of the first embodiment, the state detection unit 6b of the imaging control unit 6 outputs the first frames f12, f22. . . Are subjected to automatic exposure adjustment processing (AE) and automatic white balance adjustment processing (AWB) based on the image data (YUV data) of the luminance color difference signals of the frame images included in (step S14).

  In parallel with the processing of step S14, the next frames f13, f23. . . AF processing is performed with reference to the sharpness (contrast) of the subject detected from the frame images included in (step S15).

  Further, in parallel with the processing of steps S14 and S15, the last frames f14, f24. . . The size of the subject detected by the state detection unit 6b is recognized from the frame images included in, and processing for changing the zoom lens position in the lens unit 1 is performed.

  That is, as described in the “shooting condition” column in FIG. 5, the frames f12, f22. . . AE processing and AWB processing are executed based on the frames f13, f23. . . To execute the AF processing based on the frames f14, f24. . . The ZOOM process is executed and updated based on.

  Therefore, according to the present embodiment, it is possible to reliably reflect the shooting conditions detected in steps S14 to S16 and updated and set in step S17 in the recording of the frame image data stored in step S18.

  As described above, according to the imaging apparatus 100 of the second embodiment, while adjusting the imaging conditions so that the exposure, white balance, focus, and zoom suitable for the state of the subject are always maintained throughout the video recording. While performing shooting recording, shooting recording is performed to record moving image data. Therefore, when taking a picture at the normal recording frame rate and then playing it back, the video is adjusted to the appropriate exposure, white balance, focus, and the size of the main subject. Can watch appropriate videos.

  In the embodiment, only the process related to the shooting condition is performed in steps S4 to S6 or steps S14 to S16, and the detected shooting condition is set by updating in step S7 or step S17. However, without providing step S7 or step S17 separately, not only the detection of the shooting conditions but also the setting by updating may be performed in steps S4 to S6 or steps S14 to S16. In this way, decentralization is achieved by avoiding centralization of update processing, and the set contents can be reflected with sufficient margin in the recording timing of the next frame image data.

  Furthermore, in the embodiment, although it is parallel processing, the AE processing, AWB processing, AF processing, and ZOOM processing are performed in order from the first frame image. This is also the result of separating the case where it is better to use a thinned frame that is close to the recording frame in timing and the case where there is no necessity, but the frame used is changed based on the time required for processing. You may do it.

  For example, for AE processing, it is better to use a thinned frame that is closer to the recording frame, but for AWB processing, it is difficult to be influenced by the time distance from the recording frame, so the thinning out that is farthest in timing is important. A frame may be adopted.

  Considering the time required for main subject detection processing and recognition processing and lens movement position adjustment time, a thinned frame is used for AF processing and ZOOM processing as far as possible from the next recording frame acquisition timing. There are cases where it is good to do.

  Accordingly, there are various possible relationships between the thinned frame and the imaging condition to be processed, but in any case, the process is performed using a thinned frame other than the recording frame.

As mentioned above, although embodiment of this invention was described, this invention is not limited to these, The invention described in the claim and its equal range are included.
The claims appended at the time of filing this application will be appended below.

<Claim 1>
Imaging means;
Output means for driving the imaging means at a predetermined frame rate and sequentially outputting frame image data;
Acquisition means for regularly thinning out the frame image data output by the output means to acquire frame image data for recording;
Using the thinned frame image data, setting means for setting shooting conditions of the next frame image data for recording;
An imaging apparatus comprising:

<Claim 2>
The acquisition means regularly thins out a plurality of temporally continuous frame image data, and the setting means sets shooting conditions for the next frame image data for recording using these frame image data. The imaging apparatus according to claim 1.

<Claim 3>
There are a plurality of types of shooting conditions set by the setting unit, and a plurality of types of shooting conditions for the next frame image data for recording are set using each of the frame image data. Item 3. The imaging device according to Item 2.

<Claim 4>
The imaging apparatus according to claim 3, wherein the photographing condition includes an exposure time.

<Claim 5>
The imaging apparatus according to claim 3 or 4, wherein the photographing condition includes color adjustment.

<Claim 6>
The imaging apparatus according to claim 3, wherein the imaging condition includes a focus lens position.

<Claim 7>
The imaging apparatus according to claim 3, wherein the photographing condition includes a zoom lens position.

<Claim 8>
A computer included in an apparatus including an imaging unit,
Output means for driving the imaging unit at a first frame rate and sequentially outputting frame image data;
Acquisition means for regularly thinning out the frame image data output by the output means to acquire frame image data for recording;
Using the thinned frame image data, setting means for setting shooting conditions of the next frame image data for recording;
A program characterized by functioning as

DESCRIPTION OF SYMBOLS 100 Imaging device 1 Lens part 2 Electronic imaging part 5 Subject detection part 6 Imaging control part 6a Recording frame rate setting part 6b State detection part 6c Imaging condition adjustment part 8 Display control part 9 Display part 11 Operation input part 14 Central control part 16 Movement Detection unit

Claims (8)

Imaging means;
Output means for driving the imaging means at a predetermined frame rate and sequentially outputting frame image data;
Acquisition means for regularly thinning out the frame image data output by the output means to acquire frame image data for recording;
Using the thinned frame image data, setting means for setting shooting conditions of the next frame image data for recording;
An imaging apparatus comprising:   The acquisition means regularly thins out a plurality of temporally continuous frame image data, and the setting means sets shooting conditions for the next frame image data for recording using these frame image data. The imaging apparatus according to claim 1.   There are a plurality of types of shooting conditions set by the setting unit, and a plurality of types of shooting conditions for the next frame image data for recording are set using each of the frame image data. Item 3. The imaging device according to Item 2.   The imaging apparatus according to claim 3, wherein the photographing condition includes an exposure time.   The imaging apparatus according to claim 3 or 4, wherein the photographing condition includes color adjustment.   The imaging apparatus according to claim 3, wherein the imaging condition includes a focus lens position.   The imaging apparatus according to claim 3, wherein the photographing condition includes a zoom lens position. A computer included in an apparatus including an imaging unit,
Output means for driving the imaging unit at a first frame rate and sequentially outputting frame image data;
Acquisition means for regularly thinning out the frame image data output by the output means to acquire frame image data for recording;
Using the thinned frame image data, setting means for setting shooting conditions of the next frame image data for recording;
A program characterized by functioning as

Images