JP2012124624A - Imaging device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device which even when capturing a moving image by performing electronic zooming operation, records a moving image having a full-screen field angle without image deterioration at the same time of recording a moving image having an electronically zoomed field angle.SOLUTION: The imaging device is provided with: imaging means 102 for generating image information; image processing means 113 for processing the image information with the full-screen field angle; magnification processing means 123 for processing the image information with the electronically zoomed field angle; recording means 129 for recording the processed image information as a moving image; and control means 111 and 121 which control the recording means to record the image information having the full-screen field angle processed by the image processing means and the image information having the electronically zoomed field angle processed by the magnification processing means.

Description

  The present invention relates to an imaging apparatus having an electronic zoom function.

  An imaging apparatus such as a digital camera or a digital video camera generally has an electronic zoom function for enlarging an image by extracting only a signal in a desired range from an imaging area in an imaging element.

  However, in general, in the case of electronic zoom, the image quality deteriorates because an image captured in a partial pixel range of the image sensor is enlarged.

  Therefore, the image data of the entire pixel range obtained from all the effective pixels of the image sensor is recorded on the recording medium, and the pixel range (zoom range) of the image to be enlarged and displayed by the electronic zoom is recorded on the recording medium as zooming information. This technique is disclosed in Japanese Patent Laid-Open No. 2005-12423 (Patent Document 1).

JP 2005-12423 A

  However, the above-described conventional technique has a problem that recording cannot be performed at a user's desired angle of view. That is, when the image is taken with the electronic zoom, the image data to be recorded is actually the image data of the entire pixel range, and there is a problem that the image data cannot be reproduced as the image data that has been electronically zoomed when reproduced by another device.

(Object of invention)
An object of the present invention is to provide an imaging apparatus capable of recording a moving image with an electronic zoom angle of view and recording a moving image with a full screen angle of view without image deterioration even when shooting a moving image by performing an electronic zoom operation. Is to provide.

  In order to achieve the above object, an imaging apparatus of the present invention includes an imaging unit that generates image information, an image processing unit that processes the image information at a full screen angle of view, and a process that processes the image information at an electronic zoom angle of view. Scaling processing means for recording, recording means for recording the processed image information as a moving image, image information of a full screen angle of view processed by the image processing means, and an electronic zoom image processed by the scaling processing means And control means for causing the recording means to record corner image information.

  According to the present invention, when a moving image is shot by performing an electronic zoom operation, a moving image with an electronic zoom angle of view can be recorded, and at the same time, a moving image with a full screen angle of view without image deterioration can be recorded.

It is a figure which shows the structure of the imaging device which is Example 1 of this invention. 3 is a timing chart of moving image recording in the first embodiment. 6 is a diagram illustrating an example of an angle of view in which a moving image is recorded in Embodiment 1. FIG. FIG. 6 is a diagram illustrating the operation content in a moving image recording mode according to the first embodiment. 6 is a diagram illustrating a configuration of an imaging apparatus that is Embodiment 2. FIG. It is a figure which shows the operation | movement content of the moving image recording mode in Example 2. FIG. 6 is a timing chart of moving image recording in the second embodiment. FIG. 10 is a diagram illustrating an example of an angle of view in which a moving image is recorded in Example 2.

  The mode for carrying out the invention is as described in Examples 1 and 2 below.

  Hereinafter, an image pickup apparatus that is Embodiment 1 of the present invention will be described with reference to FIG.

  The imaging apparatus 100 is an imaging apparatus having an electronic zoom function that can update the magnification for each frame. The imaging apparatus 100 includes an optical unit 101, an area sensor 102, a timing generator (TG) 103, an A / D conversion unit 104, a master unit 110, and a slave unit 120.

  The master unit 110 includes a master control unit 111, a master memory 112, a master image processing unit 113, and a master compression processing unit 114.

  The slave unit 120 includes a slave control unit 121, a slave memory 122, a slave scaling processing unit 123, a slave compression processing unit 124, an operation unit 125, a display circuit 126, a display unit 127, and a recording circuit 128. And a recording medium 129. In addition, the master unit 110 and the slave unit 120 are connected via the inter-control unit communication bus 140, and the data stored in the master memory 112 and the slave memory 122 are mutually connected via the inter-control unit communication bus 140. It is possible to communicate.

  The optical unit 101 includes an imaging lens, an imaging optical system, and the like, and images light from a subject on the area sensor 102. In other words, the optical unit 101 forms an optical image of the subject on the area sensor 102.

  The area sensor 102 corresponds to an imaging unit, and generates image data (image signal) based on the optical image of the subject formed by the optical unit 101. In the first embodiment, the area sensor 102 has a plurality of pixels (image array) for converting an input optical signal into an electrical signal and storing the electrical signal, and the electrical signal stored in the plurality of pixels (pixel array). To generate image data. The area sensor 102 includes a solid-state image sensor such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) image sensor. The area sensor 102 is driven by a clock signal supplied from the TG 103, and an image signal from the area sensor 102 is output to the A / D conversion unit 104.

  The A / D conversion unit 104 converts the image signal output from the area sensor 102 from an analog signal to a digital signal according to the clock signal supplied from the TG 103.

  The master memory 112 and the slave memory 122 temporarily hold the image signal (image information) converted into a digital signal by the A / D conversion unit 104 for each frame.

  The master image processing unit 113 performs processing such as color processing, white balance, and gamma correction on the image signal read from the master memory 112 to convert it into YCrCb luminance and color difference signals. In addition, the master image processing unit 113 performs image processing of the full screen angle of view and writes it as “master side recorded image” in the master memory 112.

  The master compression processing unit 114 reads out the image signal processed by the master image processing unit 113 from the master memory 112, performs processing such as compression, converts the image signal into a predetermined format, and converts the “master side compressed image” into a moving image. To the master memory 112. Thereafter, the “master side compressed image” is transferred to the slave memory 122 via the inter-control unit communication bus 140 at a predetermined timing.

  The slave scaling unit 123 performs processing such as color processing, white balance, and gamma correction on the image signal read from the slave memory 122, and converts it into YCrCb luminance and color difference signals. Also, the slave scaling processing unit 123 performs scaling processing according to the image size recorded on the recording medium 129 and the image size displayed on the display unit 127 according to the magnification of the electronic zoom, The “image” and “display image” are written in the slave memory 122.

  The slave compression processing unit 124 reads out the recording image signal processed by the slave scaling processing unit 123 from the slave memory 122, performs a process such as compression, converts the image signal into a predetermined format, and performs “slave side compression”. “Image” is written to the slave memory 122.

  The recording circuit 128 outputs the “master side compressed image” and the “slave side compressed image” stored in the slave memory 122 to the removable recording medium 129.

  The recording medium 129 is configured to be detachable from the imaging apparatus 100 and records image data output from the recording circuit 128. As the recording medium 129, for example, a CD-R, a DVD-R, a nonvolatile memory card, or the like is used.

  The display circuit 126 performs processing such as superimposing on the “display image” generated by the slave scaling processing unit 124, and converts it to, for example, an NTSC analog signal and outputs it to the display unit 127. .

  The display unit 127 displays images and characters of image data output from the display circuit 126. The display unit 127 uses, for example, an LCD (Liquid Crystal Display).

  The operation unit 125 receives an instruction from the user. By operating the operation unit 125, the user can, for example, image the subject, update (change) the magnification of the electronic zoom, zoom direction, start or end of moving image recording, turn the display unit 127 on or off, and the imaging apparatus 100. Can be instructed to turn on or off the power source. The electronic zoom magnification set by the user can be arbitrarily changed during moving image recording.

  When the display unit 127 is turned on by the operation unit 125, the setting item can be displayed on the display unit 127 and the item can be selected by the operation unit 125. For example, selection using an electronic zoom, selection of a moving image recording mode, and the like are possible.

  The master control unit 111 and the slave control unit 121 control the whole (operation) of the imaging apparatus 100. In the first embodiment, in particular, the operation related to electronic zoom and moving image recording is controlled.

  The slave control unit 121 monitors the operation state of the operation unit 125, and notifies the master control unit 111 of the operation state when an operation by the user is detected. For example, the slave control unit 121 monitors the operation state of the operation unit 125 and, when detecting an electronic zoom operation, the image data trimming area held in the slave memory 122 and the slave according to the electronic zoom magnification. The scaling factor of the scaling process in the scaling unit 123 is controlled to generate a “display image”. At the same time, the master control unit 111 is notified of the operation state of the electronic zoom.

  In addition, the slave control unit 121 monitors the operation state of the operation unit 125, and when the start of moving image recording is detected, the slave compression processing unit 124 generates a “slave-side compressed image”. In addition, the master control unit 111 is notified of the start of moving image recording. Alternatively, the slave control unit 121 monitors the operation state of the operation unit 125, and notifies the master control unit 111 when it detects a change in the moving image recording mode. The master control unit 111 performs processing according to various operation information notified from the slave control unit 121. For example, when the change of the moving image recording mode is notified from the slave control unit 121, the master control unit 111 switches the reading mode of the area sensor 104 or the frame rate according to the moving image recording mode.

  When the start of moving image recording is notified from the slave control unit 121, the master control unit 111 captures image data into the master memory 112 according to the frame rate at that time, and performs image processing in the master image processing unit 113. And “master side recorded image” is generated. Thereafter, the master compression processing unit 114 generates a “master side compressed image”.

  Further, the master control unit 111 reads out the “master side compressed image” stored in the master memory 112 at a predetermined timing, and transfers it to the slave memory 122 via the inter-control unit communication bus 140.

  FIG. 2 is a timing chart illustrating moving image data generated by the master unit 110 and the slave unit 120 when the electronic zoom is operated during moving image recording in the first embodiment.

  In FIG. 2, VD indicates a vertical synchronization signal. The “exposure number” is a number indicating the order in which each frame is exposed at each vertical synchronization timing.

  An oblique solid line indicated by “reading” indicates a timing at which reading scanning is completed in each line. A diagonal broken line indicated by “reset” indicates a timing at which reset scanning of a plurality of pixels (pixel array) of the area sensor 102 is completed in each line. The time from the oblique broken line indicating the reset scanning timing to the oblique solid line indicating the readout scanning timing is the exposure time for each line.

  A down arrow in “memory update” indicates a timing at which the holding (writing) of image data to the master memory 112 and the slave memory 122 is completed.

  The image data that has been written is sequentially processed by the master image processing unit 113 and the slave scaling processing unit 123 to generate a recorded image and a display image. Since the display unit 127 is connected only to the slave unit 121, the display image is not generated in the master unit 110.

  The number at the center of the solid rectangle indicates the corresponding exposure number, where “M” before the number represents the master portion and “S” represents the slave portion. Further, “−D” after the number indicates a display image, and “−R” indicates a recorded image.

  Now, when moving image recording is started at the timing of exposure number 2, moving image recording is performed from the image data exposed at exposure number 3 (FIG. 3A).

  The master unit 110 starts fetching the image data M3 exposed with the exposure number 3 into the master memory 112, performs image processing in the master image processing unit 113, and displays “master side recorded image” of “full screen angle of view”. “M3-R” is written into the master memory 112 (FIG. 3B).

  The slave unit 120 performs image processing on the image data S3 exposed with the exposure number 3 in the slave magnification processing unit 123, and displays “slave display image S3-D” and “slave side recording” of “full screen angle of view”. “Image S3-R” is written into the slave memory 122 (FIGS. 3C and 3D).

  Next, when the electronic zoom operation is performed at the timing of the exposure number 4, the electronic zoom is applied from the image data exposed at the exposure number 4.

  The slave unit 120 performs image processing on the image data S4 exposed with the exposure number 4 by the slave scaling unit 123, and then performs scaling processing according to the designated electronic zoom magnification. “Slave display image S4-D” and “Slave-side recorded image S4-R” of “zoom angle of view” are written in the slave memory 122. After that, during the electronic zoom, the scaling process is performed according to the designated electronic zoom magnification.

  The rectangles (S4-D to S6-D and S4-R to S6-R) indicated by diagonal lines in FIG. 2 represent the frame of “electronic zoom field angle” (FIGS. 3E and 3). (F)).

  On the other hand, the master unit 110 does not perform the scaling process according to the magnification of the electronic zoom in the master image processing unit 113, but performs only the image processing in the same manner as the image before M3, and the "master screen angle" Side recording image M4-R "is written into the master memory 112 (FIG. 3B).

  Thereafter, both the “master side recorded image” and the “slave side recorded image” are processed into the “master side compressed image” and the “slave side compressed image” by the compression processing units 114 and 124, respectively. The “master side compressed image” is read at a predetermined timing by the master control unit 111 and transferred to the slave memory 122 via the inter-control unit communication bus 140.

  The slave control unit 121 writes each of the “master side compressed image” and the “slave side compressed image” to the recording medium 129 via the recording circuit 128. According to the first embodiment, even when the moving image is recorded using the electronic zoom, the moving image having the “full-screen angle of view” that is not subjected to the electronic zoom is also recorded. Is possible.

  FIG. 4 is a diagram illustrating the operation content in the moving image recording mode in the imaging apparatus 100 according to the first embodiment. In the first embodiment, image data is read from the area sensor 102 at a frame rate of 60 fps, and in the moving image recording mode, the moving image frame rate to be recorded is “1920 × 1080 60 fps”, which is the same as the read frame rate. The field angle to be recorded is a full screen field angle and an electronic zoom field angle of the electronic zoom magnification set by the user.

  Hereinafter, an image pickup apparatus that is Embodiment 2 of the present invention will be described with reference to FIGS.

  In the first embodiment, two types of moving images, “full-screen angle of view” and “electronic zoom angle of view”, are recorded at the same time, but “electronic zoom angle of view” different from the captured “electronic zoom angle of view”. In many cases, recording with a better angle of view results.

  Therefore, in the second embodiment, a moving image having a plurality of angles of view is recorded according to the frame rate set by the user, so that not only “full screen angle of view” and “electronic zoom angle of view” but also predetermined values are set. An imaging apparatus capable of simultaneously recording a moving image of “intermediate electronic zoom field angle” with an electronic zoom magnification will be described. The predetermined electronic zoom magnification cannot be changed during moving image recording.

  The second embodiment is different from the first embodiment in that a master scaling processing unit 115 serving as a first scaling processing unit is provided instead of the master image processing unit 113. The master scaling processing unit 115 performs processing such as color processing, white balance, and gamma correction on the image signal read from the master memory 112 to convert it into YCrCb luminance and color difference signals. Further, the master scaling processing unit 115 performs image processing of the full screen angle of view, and writes it in the master memory 112 as “master side recorded image”. Further, the master scaling processing unit 115 performs scaling processing according to the image size recorded on the recording medium 129 in accordance with a predetermined electronic zoom magnification (5 times), and “master side recorded image”. Is written into the master memory 112.

  The configuration other than the magnification processing unit 115 of the imaging apparatus 100 according to the second embodiment is the same as the configuration according to the first embodiment, and thus the description thereof is omitted. Note that the slave scaling processing 123 is a second scaling processing means.

  FIG. 6 is a diagram illustrating the operation content in the moving image recording mode in the imaging apparatus 100 according to the second embodiment. In the second embodiment, it is assumed that image data is read out from the area sensor 102 at a frame rate of 60 fps, and “1920 × 1080 60 fps” and “1920 × 1080 30 fps” can be selected as the moving image recording mode. When the latter is selected, the sensor readout frame rate is higher than the frame rate of the moving image recorded on the recording medium 129. The frame rate of the moving image to be recorded is not limited to ½ of the sensor readout frame rate, and may be 1 / integer.

  Now, when the user selects “1920 × 1080 30 fps” as the moving image recording mode, the master unit 110 and the slave unit 120 change the angle of view every other frame for image data input at 60 fps. A moving image with two types of angles of view is generated. FIG. 6 illustrates this operation.

  The master unit 110 generates a 30-fps frame rate movie of “full screen field angle” and “× 5 electronic zoom field angle”, and the slave unit 120 generates “actual electronic zoom field angle” and “× 10 electronic zoom field angle”. Is generated at a frame rate of 30 fps. The electronic zoom magnification of 10 times is predetermined.

  If the user has selected “1920 × 1080 60 fps” as the moving image recording mode, the master unit 110 generates a moving image of “1920 × 1080 60 fps full screen” as already described in the first embodiment. The slave unit 120 generates a moving image of “1920 × 1080 60 fps actual angle of view”.

  In FIG. 7, the number at the center of the solid rectangle indicates the corresponding exposure number, where “M” before the number represents the master part and “S” represents the slave part. Further, “−D” after the number indicates a display image, and “−R” indicates a recorded image.

  Now, when moving image recording is started at the timing of exposure number 2, moving image recording is performed from the image data exposed at exposure number 3 (FIG. 8A).

  The master unit 110 starts fetching the image data M3 exposed with the exposure number 3 into the master memory 112, performs image processing in the master scaling processing unit 115, and displays “master side recording” of “full screen angle of view”. “Image M3-R” is written into the master memory 112 (FIG. 8B).

  The master unit 110 performs image processing on the image data M4 exposed with the exposure number 4 that is subsequently input by the master scaling processing unit 115, and then performs scaling processing equivalent to 5x electronic zoom. , “× 5 times master side recorded image M4-R” is written into the master memory 112. A rectangle (M4-R) indicated by vertical hatching in FIG. 7 represents a frame of “× 5 times electronic zoom field angle” (FIG. 8C).

  The master unit 110 alternately generates a master side recorded image of the full screen angle of view and a master side × 5 times recorded image, and generates a moving image file for each angle of view.

  The slave unit 120 performs image processing on the image data S3 exposed with the exposure number 3 in the slave magnification processing unit 123, and displays “slave display image S3-D” and “slave side recording” of “full screen angle of view”. “Image S3-R” is written into the slave memory 122 (FIG. 8D and FIG. 8E).

  Next, when the electronic zoom operation is performed at the timing of the exposure number 4, the electronic zoom is applied from the image data exposed at the exposure number 4.

  The slave unit 120 performs image processing on the image data S4 exposed with the exposure number 4 in the slave scaling processing unit 123, and then performs scaling processing according to the electronic zoom magnification designated by the user, Write “slave display image S4-D” and “slave-side recorded image S4-R” of “electronic zoom field angle” to slave memory 122. After that, during the electronic zoom, the scaling process is performed according to the designated electronic zoom magnification.

  In addition, the slave unit 120 performs image processing on the image data S5 exposed with the exposure number 5 by the slave scaling processing unit 123, and then performs scaling processing equivalent to 10x electronic zoom. "10 times recorded image S5-R" is written to the slave memory 122.

  The rectangles (S4-D, S6-D and S4-R, S6-R) indicated by oblique hatching in FIG. 7 represent the frame of “electronic zoom field angle” (FIG. 8F and FIG. 8 (G)), a rectangle (S5-R) indicated by horizontal hatching represents a frame of “× 10 × electronic zoom field angle” (FIG. 8H).

  The slave unit 120 alternately generates image data of an electronic zoom angle of view corresponding to a user operation and image data equivalent to electronic zoom × 10 times, and generates a moving image file for each angle of view.

  Thereafter, both the “master side recorded image” and the “slave side recorded image” are processed into the “master side compressed image” and the “slave side compressed image” by the compression processing units 114 and 124, respectively.

  The “master side compressed image” is read at a predetermined timing by the master control unit 111 and transferred to the slave memory 122 via the inter-control unit communication bus 140.

  The slave control unit 121 writes each of the “master side compressed image” and the “slave side compressed image” to the recording medium 129 via the recording circuit 128.

  According to the second embodiment, even when a moving image is recorded using the electronic zoom, a “full-screen angle of view” moving image not subjected to the electronic zoom and a moving image having a zoom magnification other than the actual angle of view are recorded. Therefore, it is possible to record a scene outside the zoom angle of view and to record a moving image with a better angle of view.

  As mentioned above, although the preferable Example of this invention was described, this invention is not limited to these Examples, A various deformation | transformation and change are possible within the range of the summary.

102 area sensor 111 master control unit 113 master image processing unit 115 master scaling processing unit 121 slave control unit 123 slave scaling processing unit 129 recording medium

Claims (5)

Imaging means for generating image information;
Image processing means for processing the image information at a full screen angle of view;
Scaling processing means for processing the image information with an electronic zoom angle of view;
Recording means for recording the processed image information as a moving image;
And a control unit that causes the recording unit to record the image information of the full-screen field angle processed by the image processing unit and the image information of the electronic zoom field angle processed by the scaling processing unit. An imaging device.   The imaging apparatus according to claim 1, wherein the electronic zoom magnification processed by the scaling processing unit is an electronic zoom magnification set by a user and can be arbitrarily changed during moving image recording. Imaging means for generating image information;
First scaling processing means for processing the image information at a full screen angle of view and processing the image information at an electronic zoom angle of view;
Second scaling processing means for processing the image information with an electronic zoom angle of view;
Recording means for recording the processed image information as a moving image;
When the readout frame rate of the imaging means is faster than the frame rate of the moving image recorded in the recording means, the image information of the full screen angle of view processed by the first scaling processing means, and the first Control means for causing the recording means to record the image information of the electronic zoom field angle processed by the first magnification processing means and the image information of the electronic zoom field angle processed by the second magnification processing means. An imaging apparatus comprising:   One of the electronic zoom magnification processed by the first magnification processing means and the electronic zoom magnification processed by the second magnification processing means is an electronic zoom magnification set by the user, and can be arbitrarily changed during moving image recording. The imaging apparatus according to claim 3, wherein the imaging apparatus is provided.   One of the electronic zoom magnification processed by the first magnification processing means and the electronic zoom magnification processed by the second magnification processing means is a predetermined electronic zoom magnification, and cannot be changed during moving image recording. The imaging apparatus according to claim 3.

Images