CN104869379B - White balance compensation method and electronic device - Google Patents

Abstract

The invention provides a white balance compensation method and an electronic device. The method comprises the following steps. A first specific color ratio and a second specific color ratio of the preset color at the preset color temperature are obtained. A first reference color ratio and a second reference color ratio of the reference color at a preset color temperature are obtained. A picture comprising a plurality of pixels is obtained, and an exposure index value corresponding to the picture is obtained. When the exposure index value corresponds to a preset color temperature, a plurality of specific pixels are taken out from the plurality of pixels. And calculating a plurality of white balance compensation values of the picture according to the specific pixels. The color temperature of the picture is obtained. And when the picture color temperature corresponds to the preset color temperature, updating the plurality of white balance compensation values according to the first reference color proportion and the second reference color proportion. And carrying out white balance operation on each pixel according to the updated white balance compensation values.

Description

White balance compensation method and electronic device

technical field

The present invention relates to an image processing method and an electronic device, and in particular to a white balance compensation method and an electronic device.

Background technique

At present, cameras on mobile devices are more and more widely used, and users have higher and higher requirements for image quality after taking pictures. The image quality of a camera depends on the size of the photosensitive element, the design of the lens and the aperture, but due to the size of the mobile device, the design and quality of optical elements such as the photosensitive element and the lens are limited. Therefore, when designing the back-end Image Signal Processor (ISP) chip on the mobile device, how to correct the exposure, white balance, etc. for the raw image obtained by the photosensitive element is the current development. A very important project.

The main purpose of camera white balance is to restore the color temperature of the shooting scene at that time, and then restore the color at that time. However, due to the convenience of the original algorithm design and the insufficient computing power of the ISP chip and other factors, the white balance correction method has changed to the R:G:B (ie, red:green:blue) of gray scale and white and other related colors. color) becomes 1:1:1 (ie, gray world algorithm).

Under normal light sources (such as sunlight), the above practice may be suitable for white balance correction of raw images. However, if the white R:G:B ratio is not 1:1:1 under a warmer color light source such as yellow light, it may be 1.2:1:0.8. In this case, if the R:G:B ratio of such a scene is corrected to 1:1:1, it will cause the white to become very pure white, but it will make other colors appear bluish.

In addition, in order to calculate the ratio of R:G:B, the ISP chip will analyze the ratio of R:G:B for each pixel (pixel) of an image, and then use its reciprocal as the RGB compensation value. For example, if the R:G:B ratio of an image is 0.5:1:0.2, the corresponding compensation value should be RGB=(2,1,5). Therefore, how to effectively obtain effective pixel information for white balance calculation is a very important key.

In the traditional white balance algorithm, most of them take the pixels of the entire image to calculate the white balance. When there are a large number of pure color pixels or pixels close to pure color in the original image, the traditional white balance algorithm may misjudge the color temperature of the scene, resulting in color distortion in the compensated image. For example, when there are a lot of yellow objects or red objects in the original image, the proportion of red (R) in the original image will be higher than that of blue (B). Therefore, the traditional white balance algorithm may misjudge that this is a scene with a warm color temperature, and then increase the compensation value corresponding to blue, resulting in a bluish picture after compensation.

Contents of the invention

In view of this, the present invention provides a white balance compensation method and an electronic device. The white balance compensation method can prevent the pure color pixels or pixels close to the pure color from affecting the electronic device's judgment of the scene color temperature, thereby producing a better white balance compensation result.

The present invention provides a white balance compensation method suitable for electronic devices. The method includes the following steps: obtaining a first specific color ratio and a second specific color ratio of a preset color at a preset color temperature; obtaining a reference color at a preset color temperature. The first reference color ratio and the second reference color ratio at the color temperature; acquire a picture including a plurality of pixels, and obtain an exposure index value corresponding to the picture, wherein each pixel has a first color ratio and a second color ratio; when the exposure index value When corresponding to the preset color temperature, extract a plurality of specific pixels from the plurality of pixels; calculate a plurality of white balance compensation values of the picture according to the plurality of specific pixels; obtain the picture color temperature of the picture; when the picture color temperature corresponds to the preset When the color temperature is high, update the plurality of white balance compensation values according to the first reference color ratio and the second reference color ratio; perform a white balance operation on each pixel according to the updated plurality of white balance compensation values to generate a compensated screen.

The invention provides an electronic device, which includes an image capturing unit, a storage unit and a processing unit. The storage unit stores a plurality of modules. The processing unit is coupled to the imaging unit and the storage unit, and accesses the multiple modules to perform the following steps: obtain the first specific color ratio and the second specific color ratio of the preset color at the preset color temperature; obtain the reference color at the preset color temperature. Set the first reference color ratio and the second reference color ratio under the color temperature; control the imaging unit to obtain a picture including a plurality of pixels, and obtain the exposure index value corresponding to the picture, wherein each pixel has the first color ratio and the second color ratio ; When the exposure index value corresponds to the preset color temperature, take out a plurality of specific pixels from the plurality of pixels; calculate a plurality of white balance compensation values of the picture according to the plurality of specific pixels; obtain the picture color temperature of the picture; when the picture When the color temperature corresponds to the preset color temperature, update the plurality of white balance compensation values according to the first reference color ratio and the second reference color ratio; perform a white balance operation on each pixel according to the updated plurality of white balance compensation values, to produce a compensated picture.

Based on the above, the white balance compensation method and electronic device proposed by the present invention can exclude pixels close to pure color when calculating the white balance compensation value of the captured picture, thereby preventing these pixels from negatively affecting the compensated picture.

In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail together with the accompanying drawings.

Description of drawings

FIG. 1 is a schematic diagram of an electronic device according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of a white balance compensation method according to an embodiment of the present invention.

Explanation of reference signs:

100: electronic device;

110: imaging unit;

120: storage unit;

130: processing unit;

S210-S280: steps.

detailed description

FIG. 1 is a schematic diagram of an electronic device according to an embodiment of the present invention. In this embodiment, the electronic device 100 includes an image capturing unit 110 , a storage unit 120 and a processing unit 130 . The electronic device 100 is, for example, a camera, a smart phone, a tablet computer, a personal digital assistant (PDA), or any other device capable of capturing images. The imaging unit 110 is, for example, any camera with a charge coupled device (CCD) lens, a complementary metal oxide semiconductor transistors (CMOS) lens, or an infrared lens, and can also obtain depth information An image acquisition device such as a depth camera or a stereo camera. The storage unit 120 is, for example, any type of fixed or removable random access memory (Random Access Memory, RAM), read-only memory (Read-Only Memory, ROM), flash memory (Flash memory), hard disk or other similar The device or the combination of these devices is not limited in its kind.

The processing unit 130 is coupled to the image capturing unit 110 and the storage unit 120 . The processing unit 130 is, for example, a general purpose processor, a special purpose processor, a conventional processor, a digital signal processor, a plurality of microprocessors (microprocessor), one or more microprocessors incorporating a digital signal processor core, a control microcontrollers, Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), any other kind of integrated circuits, state machines, RISC-based machines ( Advanced RISC Machine, ARM) processors and similar.

In this embodiment, the processing unit 130 can access multiple modules stored in the storage unit 120 to execute each step of the white balance compensation method proposed by the present invention.

Roughly speaking, when there are a large number of pure color pixels in the original image, in order to prevent these pure color pixels from causing the processing unit 130 to misjudge the color temperature of the scene, the white balance compensation method of the present invention can use appropriate means before calculating the white balance compensation value These solid-color pixels are excluded. In this way, when the processing unit 130 can accurately perform a white balance operation on each pixel in the original image according to the color temperature of the scene, the compensated picture can be prevented from appearing bluish or reddish. Various details of the white balance compensation method proposed by the present invention will be introduced below.

FIG. 2 is a schematic diagram of a white balance compensation method according to an embodiment of the present invention. The method proposed in this embodiment can be executed by the electronic device 100 shown in FIG. 1 , and the detailed steps of the method will be described below with each component shown in FIG. 1 .

First, in step S210 , the processing unit 130 may obtain a first specific color ratio and a second specific color ratio of a preset color at a preset color temperature. The preset color is, for example, red, green and/or blue (ie, the three primary colors of light), but embodiments of the present invention are not limited thereto.

In this embodiment, the preset color may include a first component, a second component and a third component. Those skilled in the art should understand that each color can be represented by a specific ratio of red, green and blue components (ie, R:G:B ratio). Therefore, the first component of the preset color is, for example, the red component (R) of the preset color, the second component of the preset color is, for example, the green component (G) of the preset color, and the third component of the preset color is, for example, the preset The blue component of the color is assumed, but embodiments of the present invention are not limited thereto.

The preset color temperature can be set by the designer according to the scene he considers. For example, if the scene considered by the designer is an outdoor environment, the designer can set the preset color temperature to 6500K, for example. If the scene considered by the designer is an indoor environment, the designer can set the preset color temperature to, for example, 4500K. If the scene considered by the designer is a low light source environment, the designer can set the preset color temperature to, for example, 3000K. Those skilled in the art should understand that the values of the various preset color temperatures mentioned above are just examples, and are not intended to limit the implementation of the present invention.

After setting the preset color temperature, the processing unit 130 can correspondingly obtain the first specific color ratio and the second specific color ratio of the preset color. In this embodiment, the first specific color ratio of the preset color is, for example, the ratio between the first component of the preset color and the second component of the preset color. In other words, the first specific color ratio of the preset color is, for example, the R/G value of the preset color. In addition, the second specific color ratio of the preset color is a ratio between the third component of the preset color and the second component of the preset color. In other words, the second specific color ratio of the preset color is, for example, the B/G value of the preset color.

For example, when the preset color and the preset color temperature are red and 6500K respectively, the processing unit 130 obtains the first specific color ratio (ie, R/G value) and the second specific color ratio (ie, , B/G value) are, for example, 1.85 and 0.01, respectively. In this way, when the processing unit 130 later detects that the picture captured by the imaging unit 110 corresponds to a color temperature of 6500K (that is, corresponds to the color temperature of the outdoor environment), the processing unit 130 can correspondingly find out the pure color pixels in this picture (or pixels that are close to a solid color). In detail, when the processing unit 130 detects a pixel with an R/G value greater than 1.85 and a B/G value lower than 0.01 in the picture captured by the imaging unit 110, the processing unit 130 can know that the pixel should be close to Red objects, and then this pixel can be excluded when calculating the white balance compensation value of the picture, so as to avoid the negative impact of this pixel on the compensated picture (such as making the compensated picture appear bluish, etc.).

Next, in step S220 , the processing unit 130 can obtain the first reference color ratio and the second reference color ratio of the reference color at the preset color temperature. In this embodiment, the reference color is, for example, white or other grayscale colors. As taught in the previous examples, the reference color may also include a first component (i.e., a red component (R)), a second component (i.e., a green component (G)), and a third component (i.e., a blue component (B )). And, after setting the preset color temperature, the first reference color ratio of the reference color is, for example, the ratio between the first component of the reference color and the second component of the reference color. In other words, the first reference color ratio of the reference color is, for example, the R/G value of the reference color at a preset color temperature. In addition, after setting the preset color temperature, the second reference color ratio of the reference color is, for example, the ratio between the third component of the reference color and the second component of the reference color. In other words, the second reference color ratio of the reference color is, for example, the B/G value of the reference color at a preset color temperature.

For example, when the reference color and the preset color temperature are white and 6500K respectively, the first reference color ratio (ie, R/G value) and the second reference color ratio (ie, B value) of the reference color obtained by the processing unit 130 /G value) are, for example, 0.8 and 1.4, respectively.

In addition, in other embodiments, the processing unit 130 may also obtain the first reference color ratio and the second reference color ratio respectively corresponding to the reference color under various preset color temperatures. For example, the processing unit 130 can obtain R/G values and B/G values corresponding to white at preset color temperatures of 6500K, 4500K and 3000K.

In step S230 , the processing unit 130 may control the image capturing unit 110 to acquire a frame (for example, an original image) including a plurality of pixels, and obtain an exposure index value (exposure index) corresponding to the frame.

When the exposure index value is known, the processing unit 130 can deduce which environment the scene in the frame corresponds to, and then find out the preset color temperature corresponding to the scene in the frame. For example, when the exposure index value corresponding to the frame corresponds to the outdoor environment, the processing unit 130 may know that the preset color temperature corresponding to the outdoor environment should be 6500K. For another example, when the exposure index value corresponding to the frame corresponds to the indoor environment, the processing unit 130 may know that the preset color temperature corresponding to the indoor environment should be 4500K. For another example, when the exposure index value corresponding to the frame corresponds to a low light source environment, the processing unit 130 may know that the preset color temperature corresponding to the low light source environment should be 3000K.

In addition, in this embodiment, each pixel has a first color ratio and a second color ratio. In detail, as taught in the previous embodiments, each pixel included in the screen also includes a first component (ie, a red component (R)), a second component (ie, a green component (G)) and a third component (ie, blue component (B)). The first color ratio is the ratio between the first component of each pixel and the second component of each pixel. In other words, the first color ratio of each pixel is, for example, the R/G value of each pixel. The second color ratio is the ratio between the third component of each pixel and the second component of each pixel. In other words, the second color ratio of each pixel is, for example, the B/G value of each pixel.

In step S240, when the exposure index value corresponds to the preset color temperature, the processing unit 130 may extract a plurality of specific pixels from the plurality of pixels. Next, in step S250, the processing unit 130 may calculate a plurality of white balance compensation values of the frame according to the plurality of specific pixels.

In this embodiment, the first color ratio of each specific pixel is smaller than the first specific color ratio, and the second color ratio of each specific pixel is larger than the second specific color ratio. For example, when the exposure index value corresponds to the preset color temperature of 6500K, the processing unit 130 may extract pixels with an R/G value less than 1.85 and a B/G value greater than 0.01 from the frame. Then, the processing unit 130 may continue to calculate the white balance compensation value of the frame according to the extracted pixels (ie, specific pixels). In one embodiment, the processing unit 130 may calculate the white balance compensation value of the frame based on the gray world algorithm, but the embodiments of the present invention are not limited thereto.

From another point of view, when the processing unit 130 calculates the white balance compensation value of the picture, it will not consider the pixels with R/G value greater than 1.85 and B/G value less than 0.01, because these pixels are likely to be close to red object. In this way, the white balance compensation value calculated by the processing unit 130 will not cause the compensated picture to appear bluish.

In one embodiment, when the preset color temperature is 6500K, the multiple white balance compensation values (that is, RGB compensation values) are, for example, (2.8, 1, 1.05), but the embodiments of the present invention are not limited to this. In other embodiments, the plurality of white balance compensation values may be considered to include a first compensation value and a second compensation value, which may respectively correspond to the R value and the B value in the RGB compensation values, but the implementation of the present invention The method is not limited to this.

In step S260, the processing unit 130 can obtain the picture color temperature of the picture. Next, in step S270, when the image color temperature corresponds to the preset color temperature, the processing unit 130 may update the plurality of white balance compensation values according to the first reference color ratio and the second reference color ratio.

In one embodiment, when the temperature difference between the picture color temperature and the preset color temperature is smaller than a preset threshold (for example, 750K), the processing unit 130 may determine that the picture color temperature corresponds to the preset color temperature. For example, when the picture color temperature is 6000K, the processing unit 130 may determine that the picture color temperature corresponds to 6500K. For another example, when the color temperature of the picture is 5000K, the processing unit may determine that the color temperature of the picture corresponds to 4500K, but embodiments of the present invention are not limited thereto.

When the picture color temperature corresponds to the preset color temperature of 6500K, the processing unit 130 updates the plurality of white balance compensation values, for example, by adding the R value (that is, the first compensation value) and the B value ( That is, the second compensation value) is multiplied by the first reference color ratio and the second reference color ratio. That is, if the RGB compensation value is (2.8,1,1.05), the updated RGB compensation value (that is, the white balance compensation value) is, for example, (2.24,1,1.47), that is, (2.8×0.8,1, 1.05×1.4).

Next, in step S280 , the processing unit 130 may perform a white balance operation on each pixel according to the updated white balance compensation values to generate a compensated image. Specifically, the processing unit 130 may multiply the updated first compensation value (eg, 2.24) by the first color ratio (ie, R/G value) of each pixel, and multiply the updated second compensation value (eg, is 1.47) multiplied by the second color scale (ie, B/G value) of each pixel.

As taught in the previous embodiments, since the processing unit 130 has excluded pixels close to red when calculating the white balance compensation value of the frame, the compensated frame can avoid bluishness.

It should be noted that although in the foregoing embodiments it is assumed that the preset color is red, thereby enabling the processing unit 130 to prevent red pixels from having adverse effects on the compensated picture, those skilled in the art should be able to use the foregoing implementation The corresponding practice when the default color is blue (or green and other colors) is deduced from the teaching in the example. In this way, the processing unit 130 can prevent the blue pixels in the frame from adversely affecting the compensated frame (for example, causing the compensated frame to appear reddish).

Specifically, the processing unit 130 can obtain the first specific color ratio and the second specific color ratio respectively corresponding to a plurality of preset colors at a plurality of preset color temperatures. For example, the processing unit 130 can obtain R/G values and B/G values respectively corresponding to red at preset color temperatures of 6500K, 4500K and 3000K. Moreover, the processing unit 130 can also obtain R/G values and B/G values respectively corresponding to green under preset color temperatures of 6500K, 4500K and 3000K. In addition, the processing unit 130 can obtain R/G values and B/G values respectively corresponding to blue at preset color temperatures of 6500K, 4500K and 3000K. After obtaining the above-mentioned R/G values and B/G values, the processing unit 130 can use them to find pixels close to pure colors in the picture captured by the imaging unit 110, and then exclude them when calculating the white balance compensation value of the picture. This pixel, in order to avoid the negative impact of this pixel on the compensated image.

To sum up, after obtaining the first specific color ratio and the second specific color ratio of the preset color at the preset color temperature, the white balance compensation method and the electronic device proposed by the present invention can calculate the white balance compensation of the obtained picture. Pixels that are close to pure color are excluded from the value, so as to prevent these pixels from negatively affecting the compensated picture. Specifically, after excluding pixels close to the pure color, the electronic device can more accurately determine the scene color temperature of the acquired picture, and then generate a more appropriate white balance compensation value. In this way, even if the original image includes a large number of pure color pixels or pixels close to pure color, the electronic device can still generate a compensated image closer to the real scene according to the correct scene color temperature, without making the compensated image appear reddish or It is a case of distortion such as bluishness.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than limiting them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the various embodiments of the present invention. scope.

Claims (8)

1. a kind of white balance compensation method, is suitable to an electronic installation, it is characterised in that methods described comprises the following steps：

Obtain one first particular color ratio and one second particular color ratio of the pre-set color under a preset color temperature；

Obtain one first reference color ratio and one second reference color ratio of the reference color under the preset color temperature；

Acquisition includes a picture of multiple pixels, and obtains the corresponding exposure index value of the picture, wherein respectively the pixel has One first color-ratio and one second color-ratio；

When the exposure index value corresponds to the preset color temperature, this according to the pre-set color under the preset color temperature is first specific Color-ratio and the second particular color ratio, take out multiple specific pixels from those pixels；

Multiple white balance compensation values of the picture are calculated according to those specific pixels；

Obtain a scene color temperature of the picture；

When the scene color temperature corresponds to the preset color temperature, according to the first reference color ratio and the second reference color ratio Example updates those white balance compensation values, and wherein those white balance compensation values include one first offset and one second offset, And include the step of updating those white balance compensation values according to the first reference color ratio and the second reference color ratio First offset is multiplied by into the first reference color ratio, with produce update after first offset, and by this second Offset is multiplied by the second reference color ratio, to produce second offset after updating；And

One white balance operation is carried out to the respectively pixel according to those white balance compensation values after updating, to produce the picture after compensating Face.

2. method according to claim 1, it is characterised in that the pre-set color include first composition, second composition and 3rd composition, also, the first particular color ratio be the first composition and the pre-set color of the pre-set color this second Ratio between composition, and the second particular color ratio be the 3rd composition and the pre-set color of the pre-set color this Ratio between binary,

Wherein, the reference color includes first composition, second composition and the 3rd composition, also, the first reference color ratio The first composition for the reference color and the ratio between the second composition of the reference color, and the second reference color ratio Example is the ratio between the 3rd composition and the second composition of the reference color of the reference color,

Wherein, respectively the pixel includes first composition, second composition and the 3rd composition, also, first color-ratio respectively should Ratio between the second composition of the first composition of pixel and the respectively pixel, and second color-ratio is each pixel Ratio between the second composition of 3rd composition and the respectively pixel.

3. method according to claim 2, it is characterised in that respectively first color-ratio of the specific pixel less than this One particular color ratio, and respectively second color-ratio of the specific pixel is more than the second particular color ratio.

4. method according to claim 1, it is characterised in that according to those white balance compensation values after updating to the respectively picture The step of element carries out the white balance operation includes：

First offset after renewal is multiplied by into first color-ratio of the respectively pixel；And

Second offset after renewal is multiplied by into second color-ratio of the respectively pixel.

5. a kind of electronic installation, it is characterised in that include：

To obtain one first particular color ratio and one second particular color ratio of the pre-set color under a preset color temperature The module of example；

To obtain one first reference color ratio and one second reference color ratio of the reference color under the preset color temperature The module of example；

Include a picture of multiple pixels to control taking unit acquisition, and obtain the corresponding exposure index value of the picture Module, wherein respectively the pixel has one first color-ratio and one second color-ratio；

When the exposure index value corresponds to the preset color temperature, this according to the pre-set color under the preset color temperature is first specific Color-ratio and the second particular color ratio, to the module that multiple specific pixels are taken out from those pixels；

To the module that multiple white balance compensation values of the picture are calculated according to those specific pixels；

To the module for obtaining a scene color temperature of the picture；

When the scene color temperature corresponds to the preset color temperature, to according to the first reference color ratio and this second refer to face Color ratio example updates the module of those white balance compensation values, and wherein those white balance compensation values include one first offset and one the Two offsets；

First offset is multiplied by into the first reference color ratio, to produce the mould of first offset after updating Block；

Second offset is multiplied by into the second reference color ratio, to produce the mould of second offset after updating Block；And

To according to update after those white balance compensation values one white balance operation is carried out to the respectively pixel, with produce compensation after The module of the picture.

6. electronic installation according to claim 5, it is characterised in that the pre-set color includes first composition, second composition And the 3rd composition, also, the first particular color ratio be the first composition and the pre-set color of the pre-set color should Ratio between second composition, and the second particular color ratio is the 3rd composition and the pre-set color of the pre-set color Ratio between the second composition,

Wherein, the reference color includes first composition, second composition and the 3rd composition, also, the first reference color ratio The first composition for the reference color and the ratio between the second composition of the reference color, and the second reference color ratio Example is the ratio between the 3rd composition and the second composition of the reference color of the reference color,

Wherein, respectively the pixel includes first composition, second composition and the 3rd composition, also, first color-ratio respectively should Ratio between the second composition of the first composition of pixel and the respectively pixel, and second color-ratio is each pixel Ratio between the second composition of 3rd composition and the respectively pixel.

7. electronic installation according to claim 6, it is characterised in that respectively first color-ratio of the specific pixel is less than The first particular color ratio, and respectively second color-ratio of the specific pixel is more than the second particular color ratio.

8. electronic installation according to claim 5, it is characterised in that the electronic installation includes：

To the module that first offset after renewal is multiplied by respectively first color-ratio of the pixel；And

To the module that second offset after renewal is multiplied by respectively second color-ratio of the pixel.