JP3652123B2 - Image sensor, image processing apparatus, image processing system, and storage medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention particularly relates to an image pickup device for obtaining a color image signal, an image processing apparatus using the image pickup device, an image processing system, and a storage medium in which processing steps for implementing the same are stored in a computer-readable manner. It is.
[0002]
[Prior art]
Conventionally, an image signal (color image signal) of a subject is obtained by an image sensor that receives subject light through a color filter, and image processing such as compression processing and expansion processing is performed on the image signal. There are image processing apparatuses that display a screen or record on a recording medium.
For example, in such compression processing of an image processing apparatus, a signal output from an image sensor is blocked in a predetermined pixel block size, and processing such as DCT conversion, quantization, and variable length encoding is performed on a block basis. , Compressed data is obtained.
[0003]
Here, as a pre-stage process (hereinafter referred to as “pre-process”) for performing image processing such as compression processing, the output signal of the image sensor (for example, if the color filter used in the image sensor is a complementary color filter, Ye, Cy, Mg, Gr original signals, and R, G, B original signals in the case of primary color filters) are temporarily stored in a frame memory, and color processing such as white balance and γ correction is performed on the original signals. After that, processing for obtaining a luminance signal (Y) and color difference signals (U, V) is performed. Therefore, the above image processing is performed on the luminance signal (Y) and the color difference signals (U, V) obtained by such preprocessing.
[0004]
[Problems to be solved by the invention]
However, since the output of the conventional image sensor is a serial output, a frame memory for the above preprocessing is necessary, and until the output of the image sensor necessary for the preprocessing is accumulated in the frame memory. Wasted time. Furthermore, the above pre-processing requires enormous computations, and it is very difficult to increase the processing speed accordingly.
[0005]
Therefore, the conventional image sensor cannot efficiently perform image processing such as subsequent compression processing and expansion processing.
Therefore, the present invention was made to eliminate the above-mentioned drawbacks, and a computer reads out an image sensor capable of efficiently performing high-accuracy image processing and processing steps for implementing the image sensor. It is an object to provide a storage medium that can be stored.
Another object of the present invention is to provide an image processing apparatus and an image processing system that efficiently perform high-precision image processing.
[0006]
[Means for Solving the Problems]
Under such an object, the first invention receives subject light through a predetermined color filter by a plurality of pixels arranged two-dimensionally, and outputs an original signal corresponding to the amount of light received by the plurality of pixels. An image pickup device comprising an image pickup means, further comprising a signal processing means for generating and outputting a pseudo luminance signal and a pseudo color difference signal from an original signal output from the image pickup means.
[0007]
According to a second invention, in the first invention, the signal processing means includes a first storage means for storing the original signal output from the imaging means in units of first pixel blocks, and the first And an arithmetic means for performing the predetermined arithmetic processing on the original signal stored in the storage means to generate the pseudo luminance signal and the pseudo color difference signal.
[0008]
According to a third aspect, in the second aspect, the signal processing means stores a pseudo luminance signal and a pseudo color difference signal generated by the arithmetic means in units of second pixel blocks. Further comprising means.
[0009]
According to a fourth invention, in the first invention, the signal processing means outputs the pseudo luminance signal and the pseudo color difference signal for each second pixel block.
[0010]
According to a fifth invention, in the third or fourth invention, the second pixel block size is a size corresponding to processing at an output destination of the signal processing means.
[0011]
According to a sixth aspect of the present invention, there is provided an image processing apparatus that images a subject with a color image sensor and performs predetermined image processing on an output signal of the image sensor. The image pickup device according to any one of the above.
[0012]
According to a seventh aspect of the invention, there is provided an image processing system in which an imaging device including a color imaging device and an image processing device that performs predetermined image processing on an output signal of the imaging device are connected. A color image sensor is an image sensor according to any one of claims 1 to 5.
[0013]
According to the eighth aspect of the invention, the imaging unit having a plurality of two-dimensionally arranged pixels on which subject light is incident via a predetermined color filter, and a signal processing unit that performs predetermined signal processing on the output of the imaging unit Is a storage medium in which processing steps for carrying out the operation of the imaging device provided on the same chip are stored in a computer-readable manner, and the processing steps are performed by each of the plurality of pixels in the imaging unit. An imaging step for outputting an original signal corresponding to the amount of received light, and a pseudo luminance signal and a pseudo color difference signal are generated and output from the original signal output from the imaging unit in the first step by the signal processing unit. And a signal processing step.
[0014]
According to a ninth invention, in the eighth invention, the signal processing step includes a first storage step of storing the original signal output in the first step in units of a first pixel block; And a calculation step of performing a predetermined calculation process on the original signal stored in the first storage step to generate the pseudo luminance signal and the pseudo color difference signal.
[0015]
According to a tenth aspect, in the ninth aspect, the signal processing step stores a pseudo luminance signal and a pseudo color difference signal generated by the calculation step in units of a second pixel block. The method further includes a step.
[0016]
According to an eleventh aspect, in the eighth aspect, the signal processing step includes a step of outputting the pseudo luminance signal and the pseudo color difference signal for each second pixel block.
[0017]
According to a twelfth aspect, in the tenth or eleventh aspect, the signal processing step includes a step of setting the second pixel block size to a size corresponding to processing at an output destination of the image sensor. It is characterized by that.
[0018]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0019]
(First embodiment)
The present invention is applied to, for example, an image processing system 100 as shown in FIG.
This image processing system 100 includes an image sensor IC chip (hereinafter referred to as an “imaging unit”) 10 and a compression processing device 20, a transmission side (imaging device), an expansion processing device 30, a color processing device 40, and a display / Data communication is performed with a receiving side (reproducing device) comprising the recording device 50.
First, a series of operations of the image processing system 100 will be described.
[0020]
On the transmission side, the imaging unit 10 is described in detail later, but is simulated (simple) from an imaging element (light receiving element) 11 on which subject light is incident via a color filter and an original signal output from the imaging element 11. And a luminance / color difference preprocessing (signal processing) unit 13 for generating and outputting pseudo luminance difference signals Y ′ and pseudo color difference signals U ′ and V ′.
Here, four color complementary filters of yellow (Ye), cyan (Cy), magenta (Mg), and green (G) are used as color filters. Accordingly, the imaging unit 10 outputs the pseudo luminance signal Y ′ and the pseudo color difference signals U ′ and V ′ generated from the four complementary color original signals Ye, Cy, Mg, and Gr.
[0021]
The compression processing device 20 applies JPEG, MPEG, H.264 to the pseudo luminance signal Y ′ and the pseudo color difference signals U ′, V ′ output from the imaging unit 10. 261, compression processing using an information compression technique such as vector quantization is performed.
Specifically, for example, first, DCT (Discrete Cosine Transform) is performed for each predetermined pixel block. Next, the DCT pseudo luminance signal Y ′ and pseudo color difference signals U ′ and V ′ are quantized to obtain compressed data from which high frequency components have been removed. Then, the compressed data is encoded. Various methods can be used for the encoding process here, but it is possible to further increase the compression rate by using variable-length encoding that assigns a code length according to the frequency of data generation.
The data compressed and encoded in this way by the compression processing device 20 is transmitted to the decompression processing device 30 on the reception side via a medium such as a communication line.
[0022]
On the reception side, the information decompression device 30 performs the reverse processing of the DCT and the quantization processing in the above-described compression device 20 on the data sent from the transmission side, so that the pseudo luminance signal Y ′ and the pseudo luminance signal Y ′ are simulated. The color difference signals U ′ and V ′ are restored.
[0023]
The color processing device 40 provides good image quality such as color processing such as white balance correction and γ correction to the pseudo luminance signal Y ′ and the pseudo color difference signals U ′ and V ′ obtained by the information expansion device 30. The luminance signal Y and the color difference signals U and V are generated by performing various corrections necessary for obtaining.
[0024]
The display / recording device 50 displays the luminance signal Y and the color difference signals U and V generated by the color processing device 40 on a screen or records them on a recording medium.
[0025]
Here, the most characteristic feature of the image apparatus system 100 as described above lies in the imaging unit 10.
[0026]
Specifically, first, the imaging unit 10 includes an image sensor IC chip as illustrated in FIG. 2, and includes a sensor 201 including a plurality of pixels (photodiodes) that receive subject light via a complementary color filter, and a sensor 201. A readout circuit 202 that scans each pixel above to convert the accumulated charge of the pixel into an electrical signal (original signal) Ye, Cy, Mg, G and outputs it, and a signal that is sequentially output by the readout circuit 202 is held. 2 × 2 analog memory 203 and matrix circuit 204 that performs a predetermined matrix operation on the signal held in analog memory 203 to generate and output pseudo luminance signal Y ′ and pseudo color difference signals U ′ and V ′. ₁ ~ 204 _Three Are provided on the same imaging device IC chip.
Note that the sensor 201 and the readout circuit 202 correspond to the image pickup device 11 in FIG. 1, and the analog memory 203 and the matrix circuit 204. ₁ ~ 204 _Three Corresponds to the luminance / color difference preprocessing unit 13 of FIG.
Such an imaging unit 10 operates as follows.
[0027]
First, subject light is incident on the sensor 201. At this time, the subject light is incident on the sensor 201 via four color complementary filters (not shown) of yellow (Ye), cyan (Cy), magenta (Mg), and green (G).
[0028]
The readout circuit 202 scans each pixel on the sensor 201 and converts (photoelectric conversion) the electric charge accumulated in each pixel into an electric signal (original signal). Therefore, in the readout circuit 202, the original signal Ye of the pixel incident through the yellow filter, the original signal Cy of the pixel incident through the cyan filter, and the magenta filter are input. The original signal Mg of the pixel and the original signal G of the pixel incident through the green color filter are obtained.
At this time, the readout circuit 202 scans the sensor 201 in units of 2 × 2 4-pixel blocks from the sensor 201. For example, as shown in FIG. ₁ Next block B scanned by one pixel and then shifted by one pixel ₂ Next block B scanned by one pixel and then shifted by one pixel _Three Each pixel is scanned.
In this way, the readout circuit 202 obtains the original signals Ye, Cy, Mg, G in units of 4 pixel blocks and stores them in the 2 × 2 analog memory 203 as shown in FIG.
[0029]
The four original signals Ye, Cy, Mg, and G stored in the analog memory 203 are converted into a matrix circuit 204. ₁ ~ 204 _Three Are output in parallel.
Matrix circuit 204 ₁ ~ 204 _Three Each perform a matrix operation on the four original signals Ye, Cy, Mg, G from the analog memory 203 to obtain a pseudo luminance signal Y ′, a color difference signal U ′, and a color difference signal V ′.
That is, the matrix circuit 204 ₁ For example,
Y ′ = Ye + Mg + Cy + G (1)
The pseudo luminance signal Y ′ is obtained by the following equation (1), and the matrix circuit 204 is obtained. ₂ For example,
U ′ = (Ye + Mg) − (Cy + G) (2)
The pseudo color difference signal U ′ is obtained by the following equation (2), and the matrix circuit 204 is obtained. _Three For example,
V ′ = (Cy + Mg) − (Ye + G) (3)
The pseudo color difference signal V ′ is obtained by the following equation (3).
[0030]
Therefore, the matrix circuit 204 ₁ ~ 204 _Three The pseudo luminance signal Y ′, the pseudo color difference signal U ′, and the pseudo color difference signal V ′ obtained in the above are output from the imaging unit 10 and supplied in parallel to the compression processing device 20 in FIG.
[0031]
As described above, in the present embodiment, the luminance / color difference for obtaining the pseudo luminance signal Y ′ and the pseudo color difference signals U ′, V ′ from the original signals Ye, Cy, Mg, G output from the image sensor 11. The pre-processing unit 13 is configured to be provided on the same chip as the image sensor 11. Thereby, it is possible to speed up the arithmetic processing for obtaining the pseudo luminance signal Y ′ and the pseudo color difference signals U ′ and V ′. Therefore, image processing such as subsequent compression processing and expansion processing can be performed efficiently.
Further, since the processing speed can be increased to improve the accuracy of image processing such as compression processing and decompression processing, high-quality image quality can be obtained.
[0032]
Further, the pseudo luminance signal Y ′ and the pseudo color difference signals U ′ and V ′ obtained by the imaging unit 10 are compressed and encoded by the compression processing device 20 and expanded by the expansion processing device 30. Later, the color processing device 40 is configured to perform color processing such as white rose correction and γ correction in order to obtain high quality image quality. As a result, it is possible to minimize deterioration in image quality due to block noise and high-frequency noise that occur in association with decompression processing after compression processing. Accordingly, it is possible to greatly reduce the amount of information when the display / recording device 50 stores the data in a recording medium or transmits the data via a communication line, and prevents the deterioration of the image quality as much as possible, and the high quality image quality. You can also get
[0033]
In this embodiment, the readout circuit 202 in FIG. 2 uses a 2 × 2 4-pixel block unit (B ₁ , B ₂ , B _Three ,..., And the sensor 201 is scanned to obtain four original signals Ye, Cy, Mg, and G. For example, by scanning in units of 2 × 8 8-pixel blocks, eight original signals are obtained. Ye, Cy, Mg, G, Ye, Cy, G, Mg may be obtained.
In this case, as shown in FIG. 4, the readout circuit 202 performs eight arithmetic signals Ye, Cy, Mg, G, and so on read from the sensor 201 by performing a predetermined arithmetic process (addition process for every two vertical pixels). Four signals (Ye + Mg), (Cy + G), (Ye + G), and (Cy, Mg) are obtained from Ye, Cy, G, and Mg, and stored in the 2 × 2 analog memory 203. Matrix circuit 204 ₁ ~ 204 _Three Respectively, from the four signals (Ye + Mg), (Cy + G), (Ye + G), and (Cy, Mg) stored in the analog memory 203, for example, the pseudo luminance signal Y according to the above formulas (1) to (3). 'And color difference signals U' and V 'are obtained.
[0034]
Further, the sensor 201 is scanned in units of 2 × 2 4 pixel blocks while shifting one pixel, but may be simply scanned sequentially in units of 4 pixel blocks (that is, while shifting 2 pixels). Scan).
[0035]
In the sensor 201 shown in FIG. 2, a complementary color filter is used as the color filter. However, for example, a primary color filter may be used.
In this case, in the readout circuit 202, the original signal R of the pixel that has entered through the red filter, the original signal G of the pixel that has entered through the green filter, and the blue filter The original signal B of the incident pixel is obtained. Therefore, the analog memory 203 stores the original signals R, G, G, and B as shown in FIG. Matrix circuit 204 ₁ For example,
Y ′ = R + 2G + B (1 ′)
The pseudo luminance signal Y ′ is obtained by the following equation (1 ′), and the matrix circuit 204 is obtained. ₂ The matrix circuit 204 ₁ Using the pseudo luminance signal Y ′ obtained in
U ′ = R−Y ′ (2 ′)
The pseudo color difference signal U ′ is obtained by the following equation (2 ′) and the matrix circuit 204 is obtained. _Three The matrix circuit 204 ₁ Using the pseudo luminance signal Y ′ obtained in
V ′ = BY− (3 ′)
The pseudo color difference signal V ′ is obtained by the following equation (2 ′).
[0036]
Further, although DCT and variable length coding are used as the compression processing in the compression processing apparatus 20, the present invention is not limited to this, and for example, a codebook compression technique (vector quantization technique) can also be used.
When using this code book compression technique, first, the compression processing device 20 includes a pseudo luminance signal Y ′ and pseudo color difference signals U ′ and V ′ obtained by the imaging unit 10 and a plurality of code books stored in advance. Compared with (pattern), the most similar pattern is found out, and the code number corresponding to the pattern is transmitted to the decompression processing device 30 on the receiving side.
The decompression processing device 30 reproduces the image signal compressed on the compression processing device 20 side by extracting a plurality of codebooks stored in advance from the pattern corresponding to the code number sent from the compression processing device 20. .
[0037]
(Second Embodiment)
In the present embodiment, the configuration of the imaging unit 10 illustrated in FIG. 1 is configured as illustrated in FIG. 6 (hereinafter, the imaging unit 10 here is referred to as “imaging unit 10 ′”).
[0038]
That is, the imaging unit 10 ′ includes three matrix circuits 204 in addition to the configuration shown in FIG. ₁ ~ 204 _Three Three analog memories 205 respectively corresponding to ₁ ~ 205 _Three It is set as the structure provided with.
Such an imaging unit 10 ′ operates as follows.
[0039]
Three analog memories 205 ₁ ~ 205 _Three Are included in the luminance / color difference pre-processing unit 13 of FIG.
Further, for the sake of simplicity of description, in the imaging unit 10 ′ of FIG. 6 described above, the same reference numerals are given to portions that operate in the same manner as the imaging unit 10 of FIG. 2, and detailed description thereof is omitted.
[0040]
First, in the same manner as the imaging unit 10 in FIG. ₁ , B ₂ ,...), The original signal Ye, Cy, Mg, G is obtained by scanning the sensor 201 and stored in the analog memory 203 of 2 × 2 pixels. Matrix circuit 204 ₁ ~ 204 _Three Respectively, from the signals Ye, Cy, Mg, G stored in the analog memory 203, the pseudo luminance signal Y ′, the pseudo color difference signal U ′, and the pseudo color difference signal V ′ are obtained by the above formulas (1) to (3). obtain.
[0041]
Matrix circuit 204 ₁ ~ 204 _Three The pseudo luminance signal Y ′, the pseudo color difference signal U ′, and the pseudo color difference signal V ′ obtained in the above are respectively stored in the corresponding analog memory 205. ₁ ~ 205 _Three Stored at the same address.
Analog memory 205 ₁ ~ 205 _Three Are configured in the same manner, and are optimally sized memories for the compression processing device 20 provided in the subsequent stage of the imaging unit 10 ′. Here, as an example, a 6 × 6 analog memory is used.
[0042]
Therefore, for example, as shown in FIG. ₁ In the first block B of the sensor 201 ₁ Pseudo luminance signal Y ′ (matrix 204) generated from original signals Ye, Cy, Mg, G corresponding to each pixel of ₁ Of the analog memory 205 ₁ Pixel position D at the upper left corner of ₁ Stored in Pixel position D at this time ₁ As shown in FIG. ₁ The position of the center of gravity (the position of the center of gravity with respect to pixel scanning) O ₁ It corresponds to.
The next block B ₂ The pseudo luminance signal Y ′ generated from the original signals Ye, Cy, Mg, G corresponding to each pixel of ₁ Next pixel position D ₂ Stored in This pixel position D ₂ As shown in FIG. ₂ The position of the center of gravity O ₂ It corresponds to.
Thereafter, in the same manner, the matrix 204 ₁ The pseudo luminance signal Y ′ obtained by ₁ Are stored at predetermined pixel positions.
[0043]
In addition, the analog memory 205 ₂ And 205 _Three The above-mentioned analog memory 205 ₁ Similarly, the pseudo color difference signal U ′ and the pseudo color difference signal V ′ are stored corresponding to 6 × 6 pixels, respectively.
[0044]
In this way, each analog memory 205 ₁ ~ 205 _Three The pseudo luminance signal Y ′, the pseudo color difference signal U ′, and the pseudo color difference signal V ′ corresponding to 6 × 6 pixels respectively stored in are output from the imaging unit 10 ′.
Therefore, in the compression processing device 20 provided in the subsequent stage of the imaging unit 10 ′, the pseudo luminance signal Y ′, the pseudo color difference signal U ′, and the pseudo color difference signal V ′ are in units of 6 × 6 pixels, that is, in this apparatus. The data is supplied in parallel (or serial) in a size unit optimum for processing.
[0045]
As described above, in the present embodiment, the pseudo luminance signal Y ′, the pseudo chrominance signal U ′, and the pseudo chrominance signal V ′ are transmitted from the imaging unit 10 ′ to the compression processing device 20. Since the output is performed in units of the optimum size for the processing in the above, the processing can be further speeded up.
[0046]
Specifically, for example, when the above-described codebook compression technique is used in the compression processing device 20 provided in the subsequent stage of the imaging unit 10 ′, the analog memory 205 ₁ ~ 205 _Three Is larger than the size of the code book (for example, 4 × 4 pixels) (here, 6 × 6 pixels).
As a result, the pseudo luminance signal Y ′, the pseudo color difference signal U ′, and the pseudo color difference signal V ′ corresponding to the pixels necessary for codebook search (here, 6 × 6 pixels) are sequentially output from the imaging unit 10 ′. The
The output of the imaging unit 10 ′ at this time, that is, the analog memory 205 ₁ ~ 205 _Three As shown in FIG. 8, among the 6 × 6 pixel signals, the center 4 × 4 pixel signal is output first, and then the 20 pixel signals around the center are output. So that Then, the compression processing device 20 is adjacent to a signal of 4 × 4 pixels at the center as shown in FIG. 9 with respect to the signals sequentially output in units of 6 × 6 pixels as shown in FIG. In this way, the code book search process in units of 6 × 6 pixels is sequentially advanced.
Therefore, the compression processing device 20 sequentially advances the code book search processing in units of 6 × 6 pixels without waiting for the output of signals of 6 × 6 pixels necessary for processing, as in the prior art. be able to.
[0047]
In the present embodiment, the scanning of the sensor 201 may be simply performed in units of 4 pixel blocks (that is, in FIG. ₁ Next to block B ₂ Block B without reading _Three It is preferable to perform the shift while shifting one pixel).
If the scanning is simply performed in units of 4 pixel blocks, as shown in FIG. 10, each pixel on the 6 × 6 analog memory is alternately arranged with respect to each pixel in the sensor 201. This is because the resolution drops accordingly (in this case, the resolution is reduced to ¼). On the other hand, if scanning is performed while shifting one pixel, each pixel on the 6 × 6 analog memory corresponds to each pixel in the sensor 201 as shown in FIG. , The resolution never drops.
[0048]
Another object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the host and terminal of each of the above-described embodiments to a system or apparatus, and the computer (or CPU) of the system or apparatus. Needless to say, this can also be achieved by reading and executing the program code stored in the storage medium.
In this case, the program code itself read from the storage medium implements the functions of the respective embodiments, and the storage medium storing the program code constitutes the present invention.
[0049]
A ROM, floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, nonvolatile memory card, or the like can be used as a storage medium for supplying the program code.
[0050]
Further, by executing the program code read by the computer, not only the functions of the embodiment are realized, but also the OS or the like running on the computer performs the actual processing based on the instruction of the program code. Needless to say, the present invention includes a case where part or all of the functions are performed and the functions of the respective embodiments are realized by the processing.
[0051]
Further, after the program code read from the storage medium is written to the memory provided in the extension function board inserted in the computer or the function extension unit connected to the computer, the function extension is performed based on the instruction of the program code It goes without saying that the case where the CPU or the like provided in the board or function expansion unit performs part or all of the actual processing and the functions of the respective embodiments are realized by the processing.
[0052]
【The invention's effect】
As described above, in the present invention, signal processing (matrix calculation or the like) for obtaining a pseudo luminance signal and a pseudo color difference signal from an original signal obtained by receiving subject light is performed on the same chip, not outside the image sensor. Configured to do.
As a result, the processing speed can be increased. For this reason, image processing such as compression processing and expansion processing can be efficiently performed on the output of the image sensor. In addition, high-quality image quality can be obtained by applying the increased processing speed to improve the accuracy of image processing.
[0053]
If the pseudo luminance signal and the pseudo color difference signal are configured to be output in units of predetermined pixel blocks, efficient processing can be performed at the output destination. For example, by giving the pseudo luminance signal and the pseudo color difference signal to the compression process in the pixel block size unit optimum for the compression process of the output destination, it is not necessary to accumulate signals for the block size necessary for the compression process. The processing can proceed sequentially without waiting for accumulation.
[0054]
Therefore, according to the present invention, highly accurate image processing can be performed efficiently.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of an image processing system to which the present invention is applied in a first embodiment.
FIG. 2 is a block diagram illustrating an internal configuration of an imaging apparatus of the image processing system.
FIG. 3 is a diagram for explaining a state in which original signals Ye, Cy, Mg, and G obtained by a sensor are stored in a 2 × 2 analog memory in the imaging apparatus.
FIG. 4 is a diagram for explaining a case where eight original signals Ye, Cy, Mg, G, Ye, Cy, G, and Mg are read from the sensor and stored in the 2 × 2 analog memory.
FIG. 5 is a diagram for explaining a state in which original signals R, G, G, and B obtained by the sensor are stored in a 2 × 2 analog memory using a color filter as a primary color filter.
FIG. 6 is a block diagram showing an internal configuration of an imaging unit of the image processing system in the second embodiment.
FIG. 7 is a diagram for explaining a relationship between a storage position (address) and a sensor when a signal is stored in a 6 × 6 analog memory in the imaging unit.
FIG. 8 is a diagram for explaining signal output from the imaging unit using a codebook compression technique in the subsequent compression processing apparatus of the imaging unit.
FIG. 9 is a diagram for explaining processing on an output signal of the imaging unit in the compression processing apparatus.
FIG. 10 is a diagram for clarifying the resolution in the case of shifting two pixels with respect to the case of reading a pixel block while shifting one pixel.
[Explanation of symbols]
10 Imaging unit
11 Image sensor
13 Brightness / color difference pre-processing section
20 Compression processor
30 Decompression processing device
40 color processor
50 Display / Recording Device
100 Image processing system
201 sensor
202 Read circuit
203 2 × 2 analog memory
204 ₁ ~ 204 _Three Matrix circuit

Claims (12)

An imaging device comprising imaging means for receiving subject light via a predetermined color filter by a plurality of pixels arranged two-dimensionally and outputting an original signal corresponding to each received light amount at the plurality of pixels,
An image pickup device further comprising signal processing means for generating and outputting a pseudo luminance signal and a pseudo color difference signal from the original signal outputted from the image pickup means. The signal processing means includes
First storage means for storing the original signal output from the imaging means in units of first pixel blocks;
2. The image pickup device according to claim 1, further comprising a calculation unit that performs a predetermined calculation process on the original signal stored in the first storage unit to generate the pseudo luminance signal and the pseudo color difference signal. 3. The imaging according to claim 2, wherein the signal processing means further includes second storage means for storing the pseudo luminance signal and the pseudo color difference signal generated by the arithmetic means in units of second pixel blocks. element. 2. The image pickup device according to claim 1, wherein the signal processing unit outputs the pseudo luminance signal and the pseudo color difference signal in units of second pixel blocks. 5. The image sensor according to claim 3, wherein the second pixel block size is a size corresponding to processing at an output destination of the signal processing means. An image processing apparatus that images a subject with a color image sensor and performs predetermined image processing on an output signal of the image sensor,
The image processing apparatus according to claim 1, wherein the color image sensor is an image sensor according to claim 1. An image processing system in which an imaging device including a color imaging device and an image processing device that performs predetermined image processing on an output signal of the imaging device are connected at least.
The image processing apparatus according to claim 1, wherein the color image sensor is an image sensor according to claim 1. An imaging unit having a plurality of two-dimensionally arranged pixels on which subject light is incident via a predetermined color filter and a signal processing unit that performs predetermined signal processing on the output of the imaging unit are provided on the same chip. A storage medium storing computer-readable processing steps for performing an operation of an image sensor, wherein the processing steps include:
In the imaging unit, an imaging step of outputting an original signal corresponding to each received light amount in the plurality of pixels;
The signal processing unit includes a signal processing step of generating and outputting a pseudo luminance signal and a pseudo color difference signal from the original signal output from the imaging unit in the first step in the signal processing unit. . The signal processing step includes
A first storage step of storing the original signal output in the first step in units of first pixel blocks;
9. The storage medium according to claim 8, further comprising a calculation step of performing a predetermined calculation process on the original signal stored in the first storage step to generate the pseudo luminance signal and the pseudo color difference signal. 10. The storage according to claim 9, wherein the signal processing step further includes a second storage step of storing the pseudo luminance signal and the pseudo color difference signal generated by the calculation step in units of second pixel blocks. Medium. 9. The storage medium according to claim 8, wherein the signal processing step includes a step of outputting the pseudo luminance signal and the pseudo color difference signal in units of second pixel blocks. The storage medium according to claim 10 or 11, wherein the signal processing step includes a step of setting the second pixel block size to a size corresponding to processing at an output destination of the imaging device.

Images