JP2012105059A - Imaging device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device capable of simultaneously recording images of different angles of view with a single image sensor.SOLUTION: The imaging device divides a light-receiving surface of a solid state image sensor (image sensor)1 into at least two, images an optical image from an imaging lens part 101 onto each light-receiving surface, and switches drive so as to perform one light-receiving surface readout with a pixel mixed readout and the other readout with an all pixels readout, respectively.

Description

  The present invention relates to an imaging apparatus such as a digital still camera and a digital video camera. Specifically, the present invention relates to an imaging apparatus capable of simultaneously recording wide-angle shooting and high-magnification shooting.

  In recent years, a dramatic increase in the number of pixels has been realized in the photoelectric conversion element array of an imaging device due to the development of semiconductor technology.

  In still image shooting, shooting is performed using pixel data of all pixels of the photoelectric conversion element array. This is the all-pixel reading mode, and pixel data read from the photoelectric conversion element array is sequentially output for all pixels one by one. This enables high-definition still image shooting.

  On the other hand, there is an image pickup apparatus configured to be able to switch between both still image shooting and moving image recording modes. At present, there is a certain limit to the operation speed of the digital signal processing circuit, and from the viewpoint of power consumption, it is difficult to record in the all-pixel readout mode similar to still image shooting in moving image recording. Therefore, it is common to perform pixel data processing by thinning out pixels during moving image recording and increasing the number of frames per unit time. This is the vertical and horizontal pixel mixed readout mode.

  The pixel data read from the photoelectric conversion element array is mixed for a plurality of pixels in the vertical and horizontal directions of the array, and the mixed pixel data is output as one unit of pixel data. As a result, the number of frames per unit time is increased, and smooth and high-speed moving image shooting is possible even in an imaging apparatus equipped with a high-pixel photoelectric conversion element array.

  Switching between pixel thinning and pixel mixed readout as described above is particularly good for MOS (Metal Oxide Semiconductor) image sensors. A MOS image sensor does not require charge transfer by moving a potential well unlike a CCD (Charge Coupled Device) image sensor, and can read pixel data of an arbitrary line using a signal line (wire). is there. The advantages of the MOS image sensor include low voltage operation, low leakage current, a larger aperture ratio with the same size as the CCD, high sensitivity, and easier data reading than the CCD. In particular, the advantages of arbitrary pixel extraction and pixel mixing are great.

  However, simultaneous recording of a high-definition still image and a moving image that secures the number of frames per unit time is a time-sharing process due to different reading methods, and a higher-speed device is required to realize both. .

  Further, even in an imaging device capable of simultaneous recording, when recording a still image of a region of interest during moving image recording or moving image recording, since digital zoom is usually used, the resolution decreases as the magnification increases.

  For example, in Patent Document 1, the first and second image sensors are provided, the second image sensor includes a zoom lens, and the first and second image sensors alternately emit light using a light reflecting member. Incident light makes it possible to perform wide-angle shooting with the first image sensor and high-magnification shooting with the second image sensor.

  Patent Document 2 discloses moving image recording in a 9-pixel mixture.

  Patent Document 3 discloses a MOS image sensor in which an AD conversion circuit and other signal processing units for performing signal processing are arranged for each vertical column (column).

JP 2010-016659 A Japanese Patent Laying-Open No. 2005-107252 JP 2006-033454 A

  However, in Patent Document 1, two image sensors, a reflecting member, a mechanical zoom lens control mechanism, and a mechanical second image sensor control mechanism are necessary for high-angle and high-magnification photography, and the cost is high. . Further, since light is alternately input to the two sensors by the reflecting member, each exposure time is shortened to ½ compared to the individual recording, and pure simultaneous recording is impossible. Moreover, in order to enable simultaneous recording, even if the reflecting member is used as a light modulation element, either light quantity decreases.

  The same applies to Patent Document 2, and of course, the readout timing of the solid-state imaging device is different for both moving image shooting and still image shooting. That is, because the exposure timing is different, the same subject image cannot be captured for the moving image and the still image.

  An object of the present invention is to provide an imaging apparatus that simultaneously records images with different angles of view using a single image sensor.

  In order to solve the above problems, the imaging apparatus of the present invention includes an image sensor having one light receiving surface and an imaging lens unit including an optical system that forms at least two optical images of one subject. One light-receiving surface is divided into at least two, and an optical image from the imaging lens unit is formed on each light-receiving surface. Reading of one light-receiving surface is performed by pixel mixture reading, and the other reading is performed by all-pixel reading. Switch drive to read.

  In this imaging apparatus, a moving image that can secure a frame per unit time can be recorded with an image captured by pixel mixture readout, and a high-definition still image can be recorded with an image captured by all pixel readout.

  Also provided is an imaging device that cuts out an arbitrary region from the all-pixel readout side and outputs it. In this imaging apparatus, it is possible to record an image having a resolution different from that of an image captured by pixel mixture readout as a moving image that can secure a frame per unit time.

  Furthermore, a moving body detection means is further provided, and an arbitrary area designation on the all pixel readout side is designated based on moving body detection information. In this imaging apparatus, for example, it is possible to record simultaneously by gazing at an object that has moved in the recorded image with a monitoring camera or the like.

  Furthermore, a person recognition unit is further provided, and an arbitrary area designation on the all pixel readout side is designated based on information of the person recognition unit. In this imaging apparatus, simultaneous recording can be performed while paying attention to a designated person.

  In addition, an output system for driving readout of all pixels and pixel mixture readout is individually provided. In this imaging apparatus, since it becomes possible to read out in parallel, it is possible to record a moving image that can secure a frame per unit time.

  Further, in addition to the simultaneous recording of the pixel mixture read image and the all pixel read image, there is provided a means for switching the image encoding based on the information of the moving object detection or the person recognition means. In this imaging apparatus, two images can be recorded as one moving image encoded data.

  As described above, according to the present invention, it is possible to simultaneously record images of at least two different resolutions with one image sensor while ensuring exposure at the same time and during the same period.

It is a block diagram which shows the structure of the imaging device in Embodiment 1 of this invention. It is an external view of the solid-state image sensor (image sensor) in FIG. It is a block diagram which shows the detailed structural example of the image sensor in FIG. 4 is a timing chart showing the operation of the image sensor in FIG. 3. FIG. 5 is a timing chart following FIG. 4. It is a timing chart following FIG. It is explanatory drawing of the output image by the pixel mixing readout in the image sensor of FIG. It is explanatory drawing of the output image by all the pixel reading in the image sensor of FIG. It is a block diagram which shows the structural example of the H addition control part in FIG. FIG. 4 is a block diagram illustrating a configuration example of a V drive control unit in FIG. 3. It is a block diagram which shows the structural example of the camera signal processing part in FIG. It is an external view concerning the modification of the image sensor of FIG. It is a block diagram which shows the other detailed structural example of the image sensor in FIG. FIG. 14 is a timing chart showing a read operation of a region B in FIG. 13. It is a timing chart following FIG. It is a timing chart following FIG. FIG. 14 is a timing chart showing a read operation of a region A in FIG. 13. It is a timing chart following FIG. It is a timing chart following FIG. It is a block diagram which shows the detailed structure of the image sensor in Embodiment 2 of this invention. FIG. 21 is a timing chart illustrating a normal all-pixel reading operation in the image sensor of FIG. 20. FIG. 21 is a timing chart showing an arbitrarily designated read operation in the image sensor of FIG. 20. It is a block diagram which shows the structure which added the moving body detection part to the image sensor of FIG. It is a control flowchart of the moving body detection part in FIG. It is a block diagram which shows the structure which added the person recognition part to the image sensor of FIG. It is a block diagram which shows the detailed structure of the image sensor in Embodiment 3 of this invention. It is a block diagram which shows the structure of the imaging device in Embodiment 4 of this invention. It is a control flowchart of the moving body detection part in FIG.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, description of each following embodiment and each modification is for the purpose of illustration, and the present invention is not intended to be limited to these. In addition, components having the same functions as those described once are denoted by the same reference numerals and description thereof is omitted.

Embodiment 1
FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus according to Embodiment 1 of the present invention. The imaging apparatus of FIG. 1 includes an imaging lens unit 101, an image signal processing unit 100, a storage unit 102, and a record storage unit 103. The image signal processing unit 100 includes a solid-state imaging device (image sensor) 1, a control unit 2, a camera signal processing unit 3, a resolution conversion unit 4, and an image encoding unit 5.

  As shown in FIG. 2, the imaging lens unit 101 forms the same optical image of the incident subject on the areas A and B of the light receiving surface of the solid-state imaging device 1. Regions A and B are regions in the image circle 1011 and are not affected by the optical images of the image circles 1011. The area C is an area that is not used for subsequent image processing because the optical images formed in the areas A and B overlap each other.

  As shown in FIG. 3, the solid-state imaging device 1 has a solid-state imaging device (g: R row G) having three color filters of R (red), G (green), and B (blue) in a Bayer array. The pixel 201 made up of a plurality of photoelectric conversion elements is arranged in a horizontal and vertical array form (matrix form) to form a light receiving surface. Further, an AD conversion circuit 202, a V adder 203, and a line memory 204 are configured for each vertical column.

  Pixel signals generated in the pixels 201 are sequentially output in units of rows by the vertical drive circuit 205, AD conversion is executed by the AD conversion circuit 202, and sequentially through the H adder 207 by the horizontal drive circuit 206. Is output from. At this time, the vertical drive circuit 205 controls the readout of the pixel 201 and the AD conversion circuit 202 and the V adder 203 in the vertical unit by the V drive control unit 209. On the other hand, in the H adder 207, the H addition control unit 208 determines whether horizontal addition is performed in units of horizontal transfer pixels.

  Next, driving of the solid-state imaging device 1 will be described using the configuration diagram shown in FIG. 3 and the timing charts shown in FIGS. 4, 5, and 6. Here, the region A is read as a pixel mixture, and the region B is read as a whole pixel, and the pixel mixture reading is described as an example of horizontal two pixels and vertical two pixels.

  First, in the horizontal period 2 ′ in FIG. 4, the AD0 conversion circuit 202 performs AD conversion on the pixel signals in the V0 row (AD0 portion) in synchronization with the vertical transfer pulse. When AD conversion of all the pixels in the V0 row is completed, the line memory 204 is cleared (CLR part), and then the AD conversion result is transferred to the line memory 204 (MEM part).

  In the subsequent horizontal period 1 in FIG. 5, the pixel signals in the V2 row are AD-converted in synchronization with the vertical transfer pulse (AD2 portion). At this time, the CLR operation is performed on the line memories 204 attached to the regions B and C, and the line memory 204 in the region A is not cleared. At the same time, the pixel signal data of the V0 row in the line memory 204 is horizontally transferred and input to the H adder 207. In accordance with the horizontal transfer pulse counter in the H addition control unit 208, the H adder 207 does not output image data up to the number of areas B, and when it reaches the number of areas B, the H adder control signal becomes an H addition control signal. Based on 'L', the input signal is output as it is. By this operation, all pixel data V0 rows in the region B in FIG. 8 are output. When the AD conversion (AD2 portion) of all the pixels in the V2 row is completed, the AD conversion result in the V2 row is transferred to the inside of the line memory 204. However, since the area A is not cleared, data is added ( MEM part).

  In the subsequent horizontal period 2 in FIG. 6, the pixel signals in the V1 row are AD-converted in synchronization with the vertical transfer pulse (AD1 portion). At this time, the CLR operation is performed on the line memory 204 in the entire area. At the same time, the pixel mixed signal data of the V0 and V2 rows for the region A in the line memory 204 and the pixel signal data of the V2 row for the region B are horizontally transferred and input to the H adder 207. The H adder 207 outputs “H” as the H addition control signal in accordance with the horizontal transfer pulse counter, and outputs the pixel signal of the region A from the solid-state imaging device 1 while adding every two pixels.

  By this operation, the pixel mixed signal of the V0 ′ row in FIG. 7 is output. Thereafter, the input signal is output as it is for the region B, and all the pixel data V2 rows of the region B in FIG. 8 are output. Subsequently, by repeating the horizontal periods 1 and 2 with respect to the vertical odd columns, the V1 'row of FIG. 7 and the V1 and V3 rows of FIG. 8 can be obtained. By repeating the following, all the R, G, g, and B colors of the pixel mixture data in the region A and all the pixel data in the region B can be obtained.

  As shown in the timing charts of FIGS. 4, 5, and 6, the V drive control unit 209 controls the vertical drive circuit 205 to repeatedly change even rows and odd rows twice to clear the line memory 204. The control is performed so that the region A is cleared every two horizontal periods, and the regions B and C are cleared every horizontal period.

  The pixel signal in the region C may not be output from the H adder 207, and may be discarded by the camera signal processing unit 3 when output.

  FIG. 9 is a block diagram illustrating a configuration example of the H addition control unit 208. First, the horizontal positions of the region A and the region B on the light receiving surface formed of pixels arranged in an array in the region determination unit 2081 are set. For example, in FIG. 3, assuming that the lower left pixel position B00 is 0 and increments by 1 to the right, the horizontal start position of the area A is 0, the horizontal start position of the area B is 12, and the horizontal start position of the area C is 8

  The horizontal counter 2082 is incremented by one every time the horizontal transfer pulse shown in FIGS. 4, 5, and 6 is generated, and is reset for each vertical transfer pulse. The vertical counter unit 2083 is incremented by 1 every time the vertical transfer pulse shown in FIGS. 4, 5, and 6 is generated, and is reset when it is counted for one frame.

  The area determination unit 2081 receives the horizontal count value from the horizontal counter unit 2082 and the vertical count value from the vertical counter unit 2083. The area determination unit 2081 sets the H addition control signal 2084 to “H” only during the horizontal count value 0 to 7 for even lines except the vertical count value 0, and enables the operation of the H adder 207. Otherwise, 'L' is output to disable the operation of the H adder 207 (through operation: the input signal is output as it is). In addition, an H addition stop signal 2085 for stopping the H adder 207 is output until the horizontal count value that is the position of the region C changes from 8 to the count value 12 of the next region B. Can be stopped. The H adder 207 does not output while receiving the stop signal 2085.

  FIG. 10 is a block diagram illustrating a configuration example of the V drive control unit 209. First, in the area determination unit 2091, the horizontal positions of the area A and the area B on the light receiving surface formed of pixels arranged in an array are set. For example, in FIG. 3, assuming that the lower left pixel position B00 is 0 and increments by 1 to the right, the horizontal start position of the area A is 0, the horizontal start position of the area B is 12, and the horizontal start position of the area C is 8

  The vertical counter unit 2093 is incremented by 1 every time the vertical transfer pulse shown in FIGS. 4, 5, and 6 is generated, and is reset when it is counted for one frame.

  The area determination unit 2091 receives the vertical count value from the vertical counter unit 2093. Then, with 4 vertical lines as 1 set (0 to 3 lines are set 1 and 4 to 7 lines are set 2), every time the vertical count value is updated by 4, the next target set is updated, and the vertical count value is updated by 1. Each time, a V drive control signal 2094 for driving the 0 → 2 → 1 → third line in the set is output. The vertical drive circuit 205 reads out the pixels 201 on the same line as the value of the V drive control signal 2094 to the AD conversion circuit 202.

  The area determination unit 2091 controls the AD conversion circuit 202, the V adder 203, and the line memory 204 from the horizontal position 0 set as the area A to the horizontal position 11 before the horizontal position 12 set as the area B. And a control signal 2096 for controlling the AD conversion circuit 202, the V adder 203, and the line memory 204 from the horizontal position 12 to the right end position 19 designated as the region B are output. The control signal 2095 for area A enables the V adder 203 for each even line and simultaneously clears the line memory 204. A control signal 2096 for controlling the region B invalidates the V adder 203 for each line and clears the line memory 204.

  A control unit 2 in FIG. 1 controls operations of the solid-state imaging device 1, the camera signal processing unit 3, the resolution conversion unit 4, and the image encoding unit 5. The imaged subject is converted into an electrical signal (hereinafter referred to as a pixel signal) by the solid-state imaging device 1 and input to the camera signal processing unit 3.

  FIG. 11 is a block diagram illustrating a configuration example of the camera signal processing unit 3. In general, the camera signal processing unit 3 includes an image rearrangement circuit 720, a white balance processing circuit (abbreviated as WB in the drawing) 721, a luminance signal generation circuit 722, a color separation circuit 723, and an aperture correction process. A circuit (abbreviated as AP in the drawing) 724 and a matrix processing circuit 725 are provided. The image rearrangement circuit 720 has a function of rearranging all the pixel read data of the region B from the solid-state imaging device 1 into even, odd, even, and odd numbers according to the image image because the even number 2 lines and odd number 2 lines are alternately output. Have The white balance processing circuit 721 generates the correction signal 731 by correcting the color component by the color filter of the solid-state imaging device 1 at a correct ratio so that a white subject is photographed white under any light source. The luminance signal generation circuit 722 generates a luminance signal (Y signal) 732 from the correction signal (RAW data) 731. The color separation circuit 723 generates a color difference signal (Cr / Cb signal) 733 from the correction signal (RAW data) 731. The aperture correction processing circuit 724 performs processing for adding a high frequency component to the luminance signal 732 generated by the luminance signal generation circuit 722 to make the resolution appear high. The matrix processing circuit 725 adjusts the spectral characteristics of the solid-state imaging device 1 and the hue balance that has been corrupted by image processing, with respect to the color difference signal 733 generated by the color separation circuit 723.

  The resolution conversion unit 4 performs image enlargement and reduction processing. The image encoding unit 5 generates image data by compressing and converting data stored in the storage unit 102 according to a predetermined standard such as JPEG, and outputs the generated image data to the recording storage unit 103.

  Here, the image rearrangement circuit 720 performs rearrangement. However, when the output data from the solid-state imaging device 1 is temporarily held in the storage unit 102, the function of rearranging writing to the storage unit 102 in the order shown in FIG. You may have. In that case, the image rearrangement circuit 720 becomes unnecessary.

  Here, the pixel mixing method is configured by the AD conversion circuit 202, the V adder 203, and the line memory 204. However, even a counter-type AD conversion circuit as disclosed in Patent Document 3 can be configured similarly. . The feature of the present invention resides in that the pixel mixed readout and the all pixel readout are changed from arbitrary positions, and can be realized without depending on the AD conversion system and the configuration of the line memory.

  In FIG. 3, each color of the areas A and B is shown as four horizontal pixels and four vertical pixels, but the present invention is not limited to this.

  In addition, the readout of the area A and the area B is the pixel mixed readout for the area A and the all-pixel readout for the area B, but is not limited thereto.

  Further, the pixel mixture readout may be a 9-pixel mixture as disclosed in Patent Document 2.

  As shown in FIG. 12, the areas A and B may be arranged in the vertical direction. The driving of the solid-state imaging device 1 in this case will be described with reference to FIGS. 13 and 14 to 19. However, in FIG. 13, the region C between the region A and the region B is omitted.

  First, transfer of the area B will be described. In the horizontal period 2B 'in FIG. 14, the AD conversion circuit 202 AD-converts the pixel signals in the V0 row (AD0 portion) in synchronization with the vertical transfer pulse. When AD conversion of all the pixels in the V0 row is completed, the line memory 204 is cleared (CLR part), and then the AD conversion result is transferred to the line memory 204 (MEM part).

  In the subsequent horizontal period 1B in FIG. 15, the pixel signals in the V1 row are AD-converted in synchronization with the vertical transfer pulse (AD1 portion). When AD conversion of all the pixels in the V1 row is completed, the line memory 204 is cleared (CLR portion), and then the AD conversion result is transferred to the line memory 204 (MEM portion). At the same time, the pixel signal data of the V0 row in the line memory 204 is horizontally transferred and input to the H adder 207 to output the input signal as it is. By this operation, all pixel data V0 row is output.

  In the subsequent horizontal period 2B in FIG. 16, the same operation as in the horizontal period 1B is repeated, and AD conversion of the V2 row and horizontal output of the V1 row are performed.

  Next, transfer of the area A will be described. In the horizontal period 2A 'in FIG. 17, the AD conversion circuit 202 AD-converts the pixel signals in the V4 row in synchronization with the vertical transfer pulse (AD4 portion). When AD conversion of all the pixels in the V4 row is completed, the line memory 204 is cleared (CLR unit), and then the AD conversion result is transferred to the line memory 204 (MEM unit).

  Subsequently, in the horizontal period 1A in FIG. 18, the pixel signals in the V5 row are AD-converted in synchronization with the vertical transfer pulse (AD5 portion). When the AD conversion of all the pixels in the V5 row is completed, the AD conversion result in the V5 row is transferred to the inside of the line memory 204, but since it is not cleared, data is added to the V4 row and the V5 row (MEM section). ).

  In the subsequent horizontal period 2A in FIG. 19, the pixel signals in the V6 row are AD-converted in synchronization with the vertical transfer pulse (AD6 portion). At this time, the CLR operation is performed on the line memory 204 in the entire area. At the same time, the pixel mixed signal data of the V4 and V5 rows in the line memory 204 are horizontally transferred and input to the H adder 207. The H adder 207 outputs “H” as an H addition control signal in accordance with the horizontal transfer pulse counter, and outputs all pixel signals from the solid-state imaging device 1 while adding every two pixels. With this operation, a pixel mixture signal is output.

  By repeating the steps below, it is possible to obtain the pixel mixture data of region A and region B and all R, G, g, and B colors of all pixel data.

  As described above, the V drive control unit 209 controls the vertical drive circuit 205 to change every row when the line is in the region B, and repeatedly change the even row and the odd row twice each time the line is in the region A. The clear control of the line memory 204 is performed so that the area A is cleared every two horizontal periods and the area B is cleared every horizontal period.

  The H addition control unit 208 outputs “H” as the H addition control signal every two horizontal periods for the region A, controls the pixel addition by the H adder 207, and for the region B as “H addition control signal”. L ′ is output and output without being added.

  The pixel signal in the region C may not be output from the H adder 207, and may be discarded by the camera signal processing unit 3 when output.

<< Embodiment 2 >>
FIG. 20 shows a block diagram of the second embodiment. As shown in FIG. 20, a region specifying unit 210 is newly provided. The area designating unit 210 designates, for example, the area D on the all pixel readout side.

  By designating the area D, the V drive control unit 209 does not perform AD conversion and line memory transfer for the V0, 1, 6, and 7th rows not corresponding to the area D. Further, as shown in FIGS. 21 and 22, the horizontal drive circuit 206 normally counts from HB0 (FIG. 21), but at the time of reading the designated area, it counts from the designated count value HB2 and reads from the pixel corresponding to HB2. (FIG. 22).

  With the above configuration, it is possible to read at a higher speed than the reading of all pixels.

  The area specifying unit 210 is disposed on the solid-state imaging device 1 side, but may be included in the control unit 2 of FIG.

  Moreover, you may provide the moving body detection part 211 as shown in FIG. There are various prior examples of moving object detection. For example, a region where the motion is large is designated by using motion detection based on the inter-frame difference used in moving image coding (MPEG).

  The operation will be described with reference to the flowchart of FIG. At the start, an arbitrary initial area D is set (S101), and at the same time, the acquisition frame number counter is initialized (S102). First, an nth frame image and an (n + 1) th image of the area A where the entire subject is recorded are acquired (S103, S104). A difference between frames of the (n + 1) th and nth images is acquired (S105), and a maximum difference area Dnew is acquired (S106). If there is no difference or there is no difference from the initial setting area D, the area is not updated, and if it is different, it is updated (S107, S108). The acquisition frame number counter is updated (S109), and the process is repeated until the moving object detection is completed.

  Further, as shown in FIG. 25, a person recognition unit 212 may be provided. There are various precedents for human recognition. For example, if the feature extraction function by face detection is used, the acquired feature is retained, and compared with the feature acquired each time the face is detected, Update.

  With the above configuration, it is possible to automatically specify an area without the user selecting it.

<< Embodiment 3 >>
FIG. 26 shows a block diagram of the third embodiment. As shown in FIG. 26, a second vertical drive circuit 215, a second horizontal drive circuit 216, a second H adder 217, a second H addition control unit 218, and a second V drive control unit 219 are newly provided.

  The second vertical drive circuit 215, the second horizontal drive circuit 216, the second H adder 217, the second H addition control unit 218, and the second V drive control unit 219 control the driving of the region B to read out simultaneously with the region A. It becomes possible. As for the read timing, the areas A and B in FIGS. 4, 5 and 6 are driven at independent timings.

<< Embodiment 4 >>
FIG. 27 shows a block diagram of the fourth embodiment. In the imaging apparatus of FIG. 27, the image encoding unit 5 switches the target image to be encoded based on information from the moving object detection unit 211.

  The operation will be described with reference to the flowchart of FIG. At the start, the area A is set as an image encoding target (S201), and at the same time, the acquisition frame number counter is initialized (S202). First, an nth frame image and an (n + 1) th image of the area A where the entire subject is recorded are acquired (S203, 204). A difference between frames of the (n + 1) th and nth images is acquired (S205), and a maximum difference area Dnew is acquired (S206). If the difference is greater than or equal to an arbitrary set threshold value (S207), the image encoding target is switched to the image of region B (S208). If there is no difference and the value is equal to or smaller than the threshold value, the area A is recorded (S210). The acquisition frame number counter is updated (S209), and the process is repeated until the moving object detection is completed.

  With the above configuration, it is possible to automatically record an image to be watched even when the image encoding unit 5 has one system.

  Although the moving object detection is described above, the person recognition unit 212 may be replaced. Further, the user may arbitrarily switch the recorded image.

  The present invention is an imaging apparatus that can be applied to a mobile camera such as an integrated video camera, a digital still camera, or a movie camera, and can acquire a high-resolution image even if the number of readout pixels is reduced. In particular, it can be used for network cameras such as surveillance cameras and WEB cameras, and in-vehicle cameras such as in-vehicle cameras and drive recorders.

1 Solid-state image sensor (image sensor)
2 Control unit 3 Camera signal processing unit 4 Resolution conversion unit 5 Image encoding unit 100 Image signal processing unit 101 Imaging lens unit 102 Storage unit 103 Recording storage unit 201 Pixel 202 AD conversion circuit 203 V adder 204 Line memory 205 Vertical drive circuit 206 Horizontal drive circuit 207 H Adder 208 H Addition control unit 209 V drive control unit 210 Region designation unit 211 Moving object detection unit 212 Person recognition unit 215 Second vertical drive circuit 216 Second horizontal drive circuit 217 Second H adder 218 Second H Addition control unit 219 Second V drive control unit 720 Image rearrangement circuit 721 White balance processing circuit 722 Luminance signal generation circuit 723 Color separation circuit 724 Aperture correction processing circuit 725 Matrix processing circuit 731 Correction signal 732 Luminance signal 733 Color difference signal 1011 Image circle 2081 Area size Section 2082 Horizontal counter section 2083 Vertical counter section 2084 H addition control signal 2085 H addition stop signal 2091 Area determination section 2093 Vertical counter section 2094 V drive control signal 2095 Area A AD conversion circuit and line memory control signal 2096 Area B AD Control signal A for conversion circuit and line memory Arbitrary drive region B Arbitrary drive region C Optical image overlap portion D Specified region

Claims (12)

An image sensor having a plurality of pixels having one light-receiving surface;
An imaging lens unit including an optical system that forms at least two optical images of one subject,
The light receiving surface of the image sensor is divided into at least two, and an optical image from the imaging lens unit is formed on each light receiving surface,
An image pickup apparatus, further comprising: a read driving unit that individually switches read driving of image data on each light receiving surface. The imaging device according to claim 1,
The image pickup apparatus, wherein the readout driving unit switches between pixel mixture readout and all pixel readout. The imaging device according to claim 1 or 2,
The read drive unit includes a horizontal addition control unit and a vertical drive control unit,
The horizontal addition control unit includes a vertical counter unit and a horizontal counter unit, and an area determination unit that receives output count values from these counter units,
The vertical drive control unit includes a vertical counter and an area determination unit that receives an output count value thereof.
An imaging apparatus, wherein driving is switched in accordance with position information indicating the area of the light receiving surface specified by the both area determination units. The imaging device according to any one of claims 1 to 3,
An image pickup apparatus comprising the read drive unit in the image sensor. In the imaging device according to any one of claims 1 to 4,
An imaging apparatus, further comprising means for designating a readout area for the all-pixel readout. The imaging device according to claim 5.
The imaging apparatus according to claim 1, wherein the readout region designation is designated based on information on motion detection. The imaging device according to claim 5.
The imaging apparatus according to claim 1, wherein the reading area is specified based on person recognition information. In the imaging device according to any one of claims 1 to 4,
An image pickup apparatus having the read drive unit for each read drive. In the imaging device according to any one of claims 1 to 8,
An imaging apparatus, further comprising: a camera signal processing unit, a resolution conversion unit, and an image encoding unit. The imaging apparatus according to claim 9, wherein
The image coding unit, wherein the image coding unit individually records image data of each light receiving surface. The imaging apparatus according to claim 9, wherein
The image encoding unit is configured to select an image of the light receiving surface to be recorded based on the moving object detection information. The imaging apparatus according to claim 9, wherein
The image encoding unit selects an image of the light receiving surface to be recorded based on the person recognition information.

Images