CN108012134B - Photographing method and apparatus, computer-readable storage medium, and computer device - Google Patents

Abstract

The application discloses a shooting method. The shooting method comprises the following steps: controlling a light supplement lamp to assist in exposure so as to obtain a first image; acquiring the color temperature of a light source of a first image; determining a first color temperature of a scene according to the color temperature of a light source of the first image and the color temperature of a fill-in lamp; acquiring a second image when the light supplement lamp is turned off; acquiring the color temperature of a light source of a second image as a second color temperature of the scene; determining the equivalent color temperature of the scene according to the first color temperature and the second color temperature; and performing white balance processing on the second image according to the equivalent color temperature of the scene. The application also discloses a shooting device, a computer readable storage medium and a computer device. The shooting method and device, the computer-readable storage medium and the computer device in the embodiment of the application determine the accurate equivalent color temperature of the scene according to the first image acquired when the light supplement lamp is turned on and the second image acquired when the light supplement lamp is turned off, so that the color tone of the second image subjected to white balance processing according to the equivalent color temperature of the scene is more accurate.

Description

Shooting method and apparatus, computer readable storage medium and computer device

technical field

The present application relates to the field of imaging technologies, and in particular, to a photographing method, a photographing apparatus, a computer-readable storage medium, and a computer device.

Background technique

The white balance technology of the related art detects the color temperature of the light source of the scene corresponding to the image and performs white balance processing on the image according to the color temperature of the light source. The tones of the white-balanced image are also not accurate.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a photographing method, a photographing apparatus, a computer-readable storage medium, and a computer device.

The photographing method of the embodiment of the present application is used for computer equipment, and the computer equipment includes a fill light, and the photographing method includes the following steps:

controlling the supplementary light for auxiliary exposure to obtain a first image;

processing the first image to obtain the color temperature of the light source of the first image;

Determine the first color temperature of the scene according to the color temperature of the light source of the first image and the color temperature of the fill light;

acquiring a second image when the fill light is turned off;

processing the second image to obtain the color temperature of the light source of the second image as the second color temperature of the scene;

determining the equivalent color temperature of the scene based on the first color temperature of the scene and the second color temperature of the scene; and

White balance processing is performed on the second image according to the equivalent color temperature of the scene.

The photographing apparatus according to the embodiment of the present application is used in computer equipment, where the computer equipment includes a fill light, and the photographing apparatus includes:

a control module, the control module is used to control the auxiliary exposure of the fill light to obtain the first image;

a first processing module, the first processing module is configured to process the first image to obtain the color temperature of the light source of the first image;

a first determination module, configured to determine a first color temperature of the scene according to the color temperature of the light source of the first image and the color temperature of the fill light;

an acquisition module, which is used to acquire a second image when the fill light is turned off;

a second processing module, the second processing module is configured to process the second image to obtain the color temperature of the light source of the second image as the second color temperature of the scene;

a second determination module configured to determine an equivalent color temperature of the scene according to the first color temperature of the scene and the second color temperature of the scene; and

A third processing module, the third processing module is configured to perform white balance processing on the second image according to the equivalent color temperature of the scene.

One or more non-volatile computer-readable storage media containing computer-executable instructions of embodiments of the present application, when executed by one or more processors, cause the processors to execute the Shooting method.

A computer device according to an embodiment of the present application includes a memory and a processor, where computer-readable instructions are stored in the memory, and when the instructions are executed by the processor, the processor causes the processor to execute the shooting method.

The photographing method and device, computer-readable storage medium, and computer equipment of the embodiments of the present application determine the first color temperature of the scene according to the first image collected when the fill light is turned on, and determine the scene's color temperature according to the second image collected when the fill light is turned off. the second color temperature, and determine the accurate equivalent color temperature of the scene according to the first color temperature The tones are also more accurate.

Additional aspects and advantages of the present application will be set forth, in part, from the following description, and in part will become apparent from the following description, or may be learned by practice of the present application.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1 is a schematic flowchart of a photographing method according to some embodiments of the present application.

FIG. 2 is a schematic plan view of a computer device according to some embodiments of the present application.

FIG. 3 is a schematic block diagram of a photographing apparatus according to some embodiments of the present application.

FIG. 4 is a schematic flowchart of a photographing method according to some embodiments of the present application.

FIG. 5 is a schematic block diagram of a photographing apparatus according to some embodiments of the present application.

FIG. 6 is a schematic diagram of a shooting scene of some embodiments of the present application.

FIG. 7 is a schematic flowchart of a photographing method according to some embodiments of the present application.

FIG. 8 is a schematic diagram of a shooting scene of some embodiments of the present application.

FIG. 9 is a schematic block diagram of a first processing module of some embodiments of the present application.

FIG. 10 is a schematic diagram of a color temperature curve of some embodiments of the present application.

FIG. 11 is a schematic flowchart of a photographing method according to some embodiments of the present application.

12 is a schematic plan view of a computer device according to some embodiments of the present application.

FIG. 13 is a schematic block diagram of a photographing apparatus according to some embodiments of the present application.

FIG. 14 is a schematic flowchart of a photographing method according to some embodiments of the present application.

FIG. 15 is a schematic flowchart of a photographing method according to some embodiments of the present application.

FIG. 16 is a schematic block diagram of a photographing apparatus according to some embodiments of the present application.

FIG. 17 is a schematic flowchart of a photographing method according to some embodiments of the present application.

FIG. 18 is a schematic block diagram of a first processing module of some embodiments of the present application.

FIG. 19 is a schematic flowchart of a photographing method according to some embodiments of the present application.

FIG. 20 is a block diagram of a second determination module of some embodiments of the present application.

FIG. 21 is a schematic block diagram of a computer device according to some embodiments of the present application.

FIG. 22 is a schematic block diagram of an image processing circuit according to some embodiments of the present application.

Description of main component symbols:

Computer equipment 1000, fill light 100, first fill light 120, second fill light 140, photographing device 200, control module 212, first processing module 214, first determination unit 2142, first processing unit 2144, first Second determination unit 2146, first determination module 216, acquisition module 218, second processing module 222, third determination unit 2222, second processing unit 2224, fourth determination unit 2226, second determination module 224, calculation unit 2242, judgment unit 2244, fifth determination unit 2246, entry unit 2248, third processing module 226, first division module 228, first determination module 232, second determination module 234, first splicing module 236, third determination module 238, first Four determination module 242, second division module 244, third determination module 246, fourth determination module 248, second splicing module 252, fifth determination module 254, system bus 510, processor 520, memory 530, internal memory 540, Display screen 550 , input device 560 , image processing circuit 800 , ISP processor 810 , control logic 820 , camera 830 , lens 832 , image sensor 834 , sensor 840 , image memory 850 , encoder/decoder 860 , display 870 .

Detailed ways

In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

It will be understood that the terms "first", "second", etc. used in this application may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, a first image could be referred to as a second image, and, similarly, a second image could be referred to as a first image, without departing from the scope of this application. Both the first image and the second image are images, but not the same image.

Referring to FIG. 1 and FIG. 2 , the photographing method of the embodiment of the present application can be used in a computer device 1000 . Computer device 1000 includes fill light 100 . The shooting method includes the following steps:

S212: controlling the supplementary light 100 for auxiliary exposure to obtain a first image;

S214: Process the first image to obtain the color temperature of the light source of the first image;

S216: Determine the first color temperature of the scene according to the color temperature of the light source of the first image and the color temperature of the fill light 100;

S218: Acquire a second image when the fill light 100 is turned off;

S222: Process the second image to obtain the color temperature of the light source of the second image as the second color temperature of the scene;

S224: Determine the equivalent color temperature of the scene according to the first color temperature of the scene and the second color temperature of the scene; and

S226: Perform white balance processing on the second image according to the equivalent color temperature of the scene.

Referring to FIG. 2 and FIG. 3 , the photographing apparatus 200 according to the embodiment of the present application may be used in the computer device 1000 . Computer device 1000 includes fill light 100 . The photographing apparatus 200 includes a control module 212 , a first processing module 214 , a first determination module 216 , an acquisition module 218 , a second processing module 222 , a second determination module 224 and a third processing module 226 . The control module 212 is used to control the supplementary light 100 for auxiliary exposure to acquire the first image. The first processing module 214 is configured to process the first image to obtain the color temperature of the light source of the first image. The first determination module 216 is configured to determine the first color temperature of the scene according to the color temperature of the light source of the first image and the color temperature of the fill light 100 . The acquiring module 218 is configured to acquire the second image when the fill light 100 is turned off. The second processing module 222 is configured to process the second image to obtain the color temperature of the light source of the second image as the second color temperature of the scene. The second determining module 224 is configured to determine the equivalent color temperature of the scene according to the first color temperature of the scene and the second color temperature of the scene. The third processing module 226 is configured to perform white balance processing on the second image according to the equivalent color temperature of the scene.

The photographing method of the embodiment of the present application may be implemented by the photographing apparatus 200 of the embodiment of the present application, wherein step S212 may be implemented by the control module 212 , step S214 may be implemented by the first processing module 214 , and step S216 may be implemented by the first determination module 216 , Step S218 may be implemented by the acquiring module 218 , Step S222 may be implemented by the second processing module 222 , Step S224 may be implemented by the second determining module 224 , and Step S226 may be implemented by the third processing module 226 .

Referring to FIG. 2 , the photographing apparatus 200 of the embodiment of the present application may be applied to the computer device 1000 of the embodiment of the present application, that is, the computer device 1000 of the embodiment of the present application may include the photographing apparatus 200 of the embodiment of the present application.

The photographing method, photographing device 200 and computer equipment 1000 of the embodiments of the present application determine the first color temperature of the scene according to the first image collected when the fill light 100 is turned on, and determine the first color temperature of the scene according to the second image collected when the fill light 100 is turned off There are two color temperatures, and the accurate equivalent color temperature of the scene is determined according to the first color temperature and the second color temperature, so that the white balance processing can be performed on the second image according to the equivalent color temperature of the scene, and then the white balance processing of the second image can be made. Hue is also more accurate.

In some embodiments, the color temperature of the scene (the first color temperature of the scene, the second color temperature of the scene, or the equivalent color temperature of the scene) may refer to the color temperature of the original scene, excluding the color temperature of the fill light 100 .

Specifically, due to certain errors in the white balance algorithm, for example, in a dark light environment, the existing white balance algorithm is difficult to detect the light source, and even if the light source is detected, the accuracy of the color temperature of the light source obtained by detection is relatively low. Therefore, the fill light 100 can be used to increase the brightness to improve the success rate of light source detection, but since the fill light 100 generally affects the color temperature of the scene while increasing the brightness, for example, when the color temperature of the fill light 100 is different from the color temperature of the scene Larger values may also result in less accurate color temperature of the detected scene. Therefore, the first image can be collected when the fill light 100 is turned on and the second image can be collected when the fill light 100 is turned off. The first color temperature of the scene can be obtained from the first image, and the second image of the scene can be obtained from the second image. Color temperature, according to the first color temperature and the second color temperature, a more accurate equivalent color temperature of the scene can be obtained.

In some embodiments, the computer device 1000 pre-stores the corresponding relationship of color temperature and white balance parameters, and according to the equivalent color temperature, the corresponding white balance parameter can be obtained by searching in the corresponding relationship of color temperature and white balance parameter, so that the corresponding white balance parameter can be obtained according to the white balance parameter. White balance the image.

Referring to FIG. 4, in some embodiments, the following steps are included before step S214:

S228: Divide the first image into multiple regions;

S232: Determine whether the area is a target area including the light source of the first image according to the histogram of each area;

S234: Determine whether there are multiple adjacent target areas;

S236: When there are multiple adjacent target areas, splicing the adjacent multiple target areas into a light source of the first image; and

S238: When there are no adjacent multiple target areas, determine the target area as the light source of the first image.

Referring to FIG. 5 , in some embodiments, the photographing apparatus 200 includes a first dividing module 228 , a first determining module 232 , a second determining module 234 , a first splicing module 236 and a third determining module 238 . The first division module 228 is used to divide the first image into a plurality of regions. The first determination module 232 is configured to determine whether the area is a target area including the light source of the first image according to the histogram of each area. The second judging module 234 is used to judge whether there are multiple adjacent target areas. The first splicing module 236 is used for splicing the adjacent multiple target areas into a light source of the first image when there are multiple adjacent target areas. The third determining module 238 is configured to determine the target area as the light source of the first image when there are no adjacent multiple target areas.

That is to say, step S228 can be realized by the first dividing module 228, step S232 can be realized by the first judging module 232, step S234 can be realized by the second judging module 234, step S236 can be realized by the first splicing module 236, and step S236 can be realized by the first splicing module 236. S238 may be implemented by the third determination module 238 .

In this way, the position of the light source in the first image can be determined.

Specifically, the first image may be divided into multiple regions, for example, the first image may be divided into 64*48 regions. According to the histogram of each area, it can be determined whether the proportion of pixels whose pixel value exceeds the preset pixel value P in each area exceeds the preset proportion. The preset pixel value P is, for example, 239, and the preset proportion is, for example, 5%. Determine whether the proportion of pixels with a pixel value exceeding 239 in each area exceeds 5%, and the corresponding area where the proportion of pixels with a pixel value exceeding the preset pixel value P exceeds the preset proportion is the target area including the light source of the first image. When there is a target area in the first image, it is determined whether there are multiple adjacent target areas. When there are multiple adjacent target areas, the adjacent multiple target areas belong to the same light source, so the adjacent target areas can be The multiple target areas are spliced into the light source of the first image; when there are no adjacent multiple target areas, the target area can be regarded as the light source of the first image. Therefore, the position of the light source in the first image can be determined by the target area.

Referring to FIG. 6, in one example, it can be determined that region A, region B, region C and region D are target regions including the light source of the first image according to the histogram of each region, for example, from the histogram of region A, It can be judged that the proportion of pixels whose pixel value exceeds the preset pixel value P in area A exceeds the preset ratio. Since area A, area B, area C and area D are adjacent multiple target areas, the area A, area B, area C and area D are spliced together to obtain a relatively complete light source.

Referring to FIG. 7 and FIG. 8, in some embodiments, step S214 includes the following steps:

S2142: Determine a highlight area and a medium brightness area according to the brightness distribution of the center of the light source of the first image along the radial direction outward;

S2144: Subtract the average value of the base color channel pixels of the highlighted area from the average value of the base color channel pixels of the mid-bright area to determine the color of the light source of the first image; and

S2146: Determine the color temperature of the light source of the first image according to the color of the light source of the first image.

Referring to FIG. 8 and FIG. 9 , in some embodiments, the first processing module 214 includes a first determination unit 2142 , a first processing unit 2144 and a second determination unit 2146 . The first determining unit 2142 is configured to determine the highlight area and the middle brightness area according to the brightness distribution of the center of the light source of the first image along the radially outward direction. The first processing unit 2144 is configured to subtract the average value of the pixels of the primary color channel in the highlighted area from the average value of the pixels of the primary color channel in the middle bright area to determine the color of the light source of the first image. The second determining unit 2146 is configured to determine the color temperature of the light source of the first image according to the color of the light source of the first image.

That is to say, step S2142 may be implemented by the first determination unit 2142 , step S2144 may be implemented by the first processing unit 2144 , and step S2146 may be implemented by the second determination unit 2146 .

In this way, the color and color temperature of the light source of the first image can be determined through the highlight region H and the medium brightness region M.

Referring to FIG. 8 again, after the position of the light source in the first image is determined, it can be understood that the central area O of the light source in the first image is an overexposed area, generally a large white spot, and does not contain information on the color of the light source. The color of the light source can be determined by the pixel average value of the primary color channel in the highlight region H and the medium brightness region M. The highlighted area H may refer to an area formed by pixels whose brightness values are in the first brightness range L1 from the center of the light source radially outward, and the first brightness range L1 is, for example, [200, 239). The medium-brightness area M may refer to an area formed by pixels whose brightness values are in the second brightness range L2 from the center of the light source radially outward, and the second brightness range L2 is, for example, [150, 200). It should be noted that the specific values of the first brightness range L1 and the second brightness range L2 can be determined according to the radially outward brightness distribution of the center O of the light source. The brightness range L1 and the second brightness range L2; for example, the brightness of the light source decays relatively slowly, and the first brightness range L1 and the second brightness range L2 can be reduced.

In some embodiments, primary color channel refers to a color channel, for example including at least one of R (red) channel, Gr (green-red) channel, Gb (green-blue) channel, B (blue) channel, in some cases In an embodiment, the pixel value of the G (green) channel can be obtained by the pixel value of the Gr channel and the pixel value of the Gb channel. The pixel average value may refer to an arithmetic average value of a plurality of pixel values, and the plurality of pixel values may be pixel values of all pixels in a highlighted area or pixel values of all pixels in a medium-brightness area. In an example, the pixel average values (R _avg , G _avg , B _avg ) of each primary color channel in the highlight area are (200, 210, 220), and the average pixel average values (R _avg , G _avg ) of each primary color channel in the mid-bright area are , B _avg ) is (160, 180, 190), then the channel (R, G, B) of the light source color is (200-160, 210-180, 220-190), ie (40, 30, 30).

In some embodiments, determining the color temperature of the light source according to the color of the light source may specifically be: determining the color temperature of the light source according to the color of the light source, the corresponding relationship between the color of the light source and the color temperature of the light source. The corresponding relationship between the color of the light source and the color temperature of the light source may be a mapping table and/or a color temperature curve.

Referring to FIG. 10 , in one embodiment, in a standard light box with a color temperature of 3000K, 4000K, 5000K, 6000K, etc., an image can be acquired, and the color of the light source corresponding to the above-mentioned different color temperatures can be obtained through calculation, so that a light source can be formed. and the color temperature curve of the color and the color temperature, and the color temperature curve can be saved in the computer device 1000 . The color temperature of the corresponding light source can be obtained by looking up the color of the light source in the color temperature curve.

Referring to FIGS. 11 and 12 , in some embodiments, the fill light 100 includes a first fill light 120 with a first preset color temperature and a second fill light 140 with a second preset color temperature, step S216 includes the following steps:

S242 : Determine the color temperature of the fill light 100 according to the first preset color temperature, the second preset color temperature, the working state of the first fill light 120 and the working state of the second fill light 140 .

Referring to FIGS. 12 and 13 , in some embodiments, the fill light 100 includes a first fill light 120 with a first preset color temperature and a second fill light 140 with a second preset color temperature. The photographing device 200 includes a fourth determination module 242 . The fourth determination module 242 is configured to determine the color temperature of the fill light 100 according to the first preset color temperature, the second preset color temperature, the working state of the first fill light 120 and the working state of the second fill light 140 .

That is to say, step S242 may be implemented by the fourth determination module 242 .

In this way, the color temperature of the fill light 100 can be determined accurately and quickly.

Specifically, in some embodiments, in order to enhance the brightness of the fill light 100 and adjust the color temperature of the fill light 100, the fill light 100 may include a first fill light with a first preset color temperature and a second fill light with a preset color temperature. Set the color temperature of the second fill light. The brightness of the first fill light 120 and the brightness of the second fill light 140 can be determined by the working state of the first fill light 120 (eg, working current, working voltage, etc.) and the working state of the second fill light 140 . The color temperature of the fill light 100 can be determined according to the first preset color temperature, the second preset color temperature, the brightness of the first fill light 120 and the brightness of the second fill light 140 (ie, the first fill light 120 and the second fill light 140). The comprehensive color temperature of the light 140), according to the following formula (CCT2*F1+CCT3*F2)/(F1+F2)=CCT1, wherein CCT2 can be the first preset color temperature, and F1 can be the brightness of the first fill light 120 , CCT3 may be the second preset color temperature, F2 may be the brightness of the second fill light 140 , and CCT1 may be the color temperature of the fill light 100 .

In some embodiments, the first preset color temperature and the second preset color temperature may be determined according to different first fill light 120 and second fill light 140, for example, the first preset color temperature is 3000K, and the second preset color temperature is 3000K. The preset color temperature is 5000K, or the first preset color temperature is 2000K, the second preset color temperature is 8000K, and so on.

In one embodiment, the first preset color temperature is 3000K, the second preset color temperature is 5000K, and the first fill light 120 and the second fill light 140 are controlled to work at the same time, and emit consistent brightness during operation, so as to obtain the fill light. The color temperature of the light lamp 100 is 4000K.

In some embodiments, the number of the fill light 100 is 1, and the color temperature of the fill light 100 can be regarded as the color temperature of the fill light 100 .

Referring to FIG. 14, in some embodiments, the fill light 100 has a first brightness, and the scene has a second brightness, and step S216 includes the following steps:

S2162: Determine the first color temperature of the scene according to the first brightness, the second brightness, and the color temperature of the light source of the first image and the color temperature of the fill light 100.

Referring to FIG. 3 , in some embodiments, the fill light 100 has a first brightness, the scene has a second brightness, and the first determining module 216 is configured to determine the color of the light source according to the first brightness, the second brightness, and the first image. The color temperature of the warm fill light 100 determines the color temperature of the scene.

That is to say, step S2162 may be implemented by the first determination module 216 .

In this way, the first color temperature of the scene can be determined accurately and quickly.

Specifically, the first color temperature of the scene can be determined according to the first brightness, the second brightness, the color temperature of the light source of the first image, and the color temperature of the fill light 100, according to the following formula (CCT2*F1+CCT3*F2)/(F1+ F2)=CCT1, wherein CCT2 may be the color temperature of the fill light 100, F1 may be the first brightness, CCT3 may be the first color temperature of the scene, F2 may be the second brightness, and CCT1 may be the color temperature of the light source of the first image, Then CCT3=[CCT1*(F1+F2)-CCT2*F1]/F2 can be obtained.

In some embodiments, the first brightness may be determined by the brightness of the fill light 100. For example, when the fill light 100 includes the first fill light 120 and the second fill light 140, the brightness of the fill light 100 (No. A brightness) is the sum of the brightness of the first fill light 120 and the brightness of the second fill light 140 . When the number of the fill light 100 is 1, the brightness of the fill light 100 itself can be regarded as the first brightness.

In some embodiments, the ambient image may be acquired when the fill light 100 does not work, and the second brightness may be acquired by processing the ambient image, for example, calculating the average brightness of all pixels of the ambient image as the second brightness.

In some embodiments, the computer device 1000 may include a photometric element, such as a selenium photocell, a cadmium sulfide photoresistor, a silicon photodiode, a gallium arsenide phosphide photodiode, and the like. Two brightness.

Referring to FIG. 15, in some embodiments, the following steps are included before step S222:

S244: Divide the second image into multiple regions;

S246: Determine whether the area is a target area including the light source of the second image according to the histogram of each area;

S248: Determine whether there are multiple adjacent target areas;

S252: When there are multiple adjacent target areas, splicing the adjacent multiple target areas into a light source for the second image; and

S254: When there are no adjacent multiple target areas, determine the target area as the light source of the second image.

Referring to FIG. 16 , in some embodiments, the photographing device 200 includes a second dividing module 244 , a third determining module 246 , a fourth determining module 248 , a second splicing module 252 and a fifth determining module 254 . The second division module 244 is used to divide the second image into a plurality of regions. The third judging module 246 is configured to judge whether the area is a target area including the light source of the second image according to the histogram of each area. The fourth judging module 248 is used to judge whether there are multiple adjacent target areas. The second splicing module 252 is used for splicing the adjacent multiple target areas into a light source of the second image when there are multiple adjacent target areas. The fifth determination module 254 is configured to determine the target area as the light source of the second image when there are no adjacent multiple target areas.

That is to say, step S244 can be realized by the second dividing module 244, step S246 can be realized by the third judging module 246, step S248 can be realized by the fourth judging module 248, step S252 can be realized by the second splicing module 252, and step S248 can be realized by the second splicing module 252. S254 may be implemented by the fifth determination module 254 .

In this way, the position of the light source in the second image can be determined.

In some embodiments, the method for determining the position of the light source in the second image is similar to the method for determining the position of the light source in the first image described above, and details are not described herein.

Referring to FIG. 17, in some embodiments, step S222 includes the following steps:

S2222: Determine the highlight area and the middle brightness area according to the brightness distribution of the center of the light source of the second image along the radially outward;

S2224: subtracting the average value of the base color channel pixels of the highlighted area from the average value of the base color channel pixels of the middle bright area to determine the color of the light source of the second image; and

S2226: Determine the color temperature of the light source of the second image according to the color of the light source of the second image.

Referring to FIG. 18 , in some embodiments, the second processing module 222 includes a third determination unit 2222 , a second processing unit 2224 and a fourth determination unit 2226 . The third determining unit 2222 is configured to determine the highlight area and the medium brightness area according to the brightness distribution of the center of the light source of the second image along the radially outward direction. The second processing unit 2224 is configured to subtract the average value of the pixels of the primary color channel in the highlighted area from the average value of the pixels of the primary color channel in the highlighted area to determine the color of the light source of the second image. The fourth determining unit 2226 is configured to determine the color temperature of the light source of the second image according to the color of the light source of the second image.

That is to say, step S2222 may be implemented by the third determination unit 2222 , step S2224 may be implemented by the second processing unit 2224 , and step S2226 may be implemented by the fourth determination unit 2226 .

In this way, the color and color temperature of the light source of the second image can be determined through the highlighted area and the middle-bright area.

In some embodiments, the method of determining the color and color temperature of the light source of the second image by using the highlighted area and the middle-bright area is similar to the above-mentioned method of determining the color and color temperature of the light source of the first image by using the highlighted area and the middle-bright area , which will not be repeated here.

Referring to FIG. 19, in some embodiments, step S224 includes the following steps:

S2242: Calculate the color temperature difference between the first color temperature of the scene and the second color temperature of the scene;

S2244: Determine whether the color temperature difference value is less than the preset difference value;

S2246: When the color temperature difference value is less than the preset difference value, determine the first color temperature, or the second color temperature, or the average value of the first color temperature and the second color temperature as the equivalent color temperature of the scene; and

When the color temperature difference value is greater than or equal to the preset difference value, go to step S212.

Referring to FIG. 20 , in some embodiments, the second determination module 224 includes a calculation unit 2242 , a determination unit 2244 , a fifth determination unit 2246 and an entry unit 2248 . The calculation unit 2242 is configured to calculate the color temperature difference value of the first color temperature of the scene and the second color temperature of the scene. The determination unit 2244 is used to determine whether the color temperature difference value is smaller than the preset difference value. The fifth determining unit 2246 is configured to determine the first color temperature, or the second color temperature, or the average value of the first color temperature and the second color temperature as the equivalent color temperature of the scene when the color temperature difference value is smaller than the preset difference value. The entry unit 2248 is configured to enter the step of controlling the supplementary light 100 for auxiliary exposure to acquire the first image when the color temperature difference value is greater than or equal to the preset difference value.

That is to say, step S2242 may be implemented by the computing unit 2242 , step S2244 may be implemented by the judging unit 2244 , and step S2246 may be implemented by the fifth determining unit 2246 .

In this way, the equivalent color temperature of the scene can be determined according to the first color temperature of the scene and the second color temperature of the scene.

Specifically, since there is a certain deviation between the first color temperature of the scene obtained by the first image and the second color temperature of the scene obtained by the second image, the color temperature of the first color temperature and the second color temperature of the scene can be calculated by calculating difference to determine the equivalent color temperature of the scene. Determine whether the color temperature difference value is smaller than a preset difference value, wherein the preset difference value can be preset in the computer device 1000 or determined by the user, and when the color temperature difference value is smaller than the preset difference value, the first color temperature of the scene is described. The color temperature is relatively close, that is, the color temperature obtained by the first image and the second image are relatively consistent, so the reliability of the first color temperature and the second color temperature is relatively high, and the first color temperature of the scene can be directly used as the equivalent of the scene. The color temperature, or the second color temperature of the scene is directly used as the equivalent color temperature of the scene, or the average value of the first color temperature and the second color temperature of the scene is directly used as the equivalent color temperature of the scene.

When the color temperature difference value is greater than or equal to the preset difference value, it means that the difference between the first color temperature and the second color temperature of the scene is relatively large, that is, the color temperatures obtained by the first image and the second image are relatively inconsistent, so the first color temperature The reliability of the temperature and the second color temperature is relatively low, so step S212 may be entered to re-execute the shooting method of the embodiment of the present application to re-acquire more accurate first color temperature and second color temperature of the scene.

In some embodiments, when the color temperature difference value is greater than or equal to the preset difference value, the equivalent color temperature of the scene can be determined according to a traditional white balance algorithm (such as a grayscale world method, a dynamic threshold algorithm, etc.), which is not done here. Specific restrictions.

The division of each module in the above-mentioned photographing apparatus 200 is only for illustration. In other embodiments, the photographing apparatus 200 may be divided into different modules as required to complete all or part of the functions of the above-mentioned photographing apparatus 200 .

The embodiment of the present application also provides a computer-readable storage medium. One or more non-volatile computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform the following steps:

S212: controlling the supplementary light 100 for auxiliary exposure to obtain a first image;

S214: Process the first image to obtain the color temperature of the light source of the first image;

S216: Determine the first color temperature of the scene according to the color temperature of the light source of the first image and the color temperature of the fill light 100;

S218: Acquire a second image when the fill light 100 is turned off;

S222: Process the second image to obtain the color temperature of the light source of the second image as the second color temperature of the scene;

S224: Determine the equivalent color temperature of the scene according to the first color temperature of the scene and the second color temperature of the scene; and

S226: Perform white balance processing on the second image according to the equivalent color temperature of the scene.

FIG. 21 is a schematic diagram of the internal structure of a computer device in one embodiment. As shown in FIG. 21 , the computer device 1000 includes a processor 520 , a memory 530 (eg, a non-volatile storage medium), an internal memory 540 , a display screen 550 and an input device 560 connected through a system bus 510 . The memory 530 of the computer device 1000 stores an operating system and computer-readable instructions. The computer-readable instructions can be executed by the processor 520 to implement the photographing method of the embodiment of the present application. The processor 520 is used to provide computing and control capabilities to support the operation of the entire computer device 1000 . Internal memory 530 of computer device 1000 provides an environment for the execution of computer readable instructions in memory 520 . The display screen 550 of the computer device 1000 may be a liquid crystal display screen or an electronic ink display screen, etc., and the input device 560 may be a touch layer covered on the display screen 550 , or a button, a trackball or a touch panel provided on the shell of the computer device 1000 . It can also be an external keyboard, trackpad or mouse, etc. The computer device 1000 may be a mobile phone, a tablet computer, a notebook computer, a personal digital assistant, or a wearable device (eg, a smart bracelet, a smart watch, a smart helmet, smart glasses), and the like. Those skilled in the art can understand that the structure shown in FIG. 21 is only a schematic diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device 1000 to which the solution of the present application is applied. The specific computer device 1000 may include more or fewer components than shown, or combine certain components, or have a different arrangement of components.

Referring to FIG. 22, the computer device 1000 in this embodiment of the present application includes an image processing circuit 800. The image processing circuit 800 may be implemented using hardware and/or software components, and may include various components that define an ISP (Image Signal Processing, image signal processing) pipeline. a processing unit. FIG. 22 is a schematic diagram of an image processing circuit 800 in one embodiment. As shown in FIG. 22 , for the convenience of description, only various aspects of the image processing technology related to the embodiments of the present application are shown.

As shown in FIG. 22 , image processing circuit 800 includes ISP processor 810 (ISP processor 810 may be processor 520 or part of processor 520 ) and control logic 820 . Image data captured by camera 830 is first processed by ISP processor 810, which analyzes the image data to capture image statistics that can be used to determine one or more control parameters of camera 830. Camera 830 may include one or more lenses 832 and image sensor 834 . Image sensor 834 , which may include an array of color filters (eg, Bayer filters), may obtain light intensity and wavelength information captured by each imaging pixel and provide a set of raw image data that may be processed by ISP processor 810 . The sensor 840 (eg, a gyroscope) may provide the acquired image processing parameters (eg, anti-shake parameters) to the ISP processor 810 based on the sensor 840 interface type. The sensor 840 interface may be an SMIA (Standard Mobile Imaging Architecture) interface, other serial or parallel camera interfaces, or a combination of the above interfaces.

Additionally, image sensor 834 may also send raw image data to sensor 840, which may provide raw image data to ISP processor 810 based on sensor 840 interface type, or sensor 840 may store raw image data in image memory 850.

ISP processor 810 processes raw image data pixel by pixel in various formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and the ISP processor 810 may perform one or more image processing operations on the raw image data, collecting statistical information about the image data. Among them, the image processing operations can be performed with the same or different bit depth precision.

ISP processor 810 may also receive image data from image memory 850 . For example, the sensor 840 interface sends the raw image data to the image memory 850, and the raw image data in the image memory 850 is provided to the ISP processor 810 for processing. The image memory 850 may be the memory 530, a part of the memory 530, a storage device, or an independent dedicated memory within the electronic device, and may include a DMA (Direct Memory Access) feature.

When receiving raw image data from the image sensor 834 interface or from the sensor 840 interface or from the image memory 850, the ISP processor 810 may perform one or more image processing operations, such as temporal filtering. The processed image data may be sent to image memory 850 for additional processing before being displayed. The ISP processor 810 receives the processed data from the image memory 850 and performs image data processing on the processed data in the original domain and in the RGB and YCbCr color spaces. The image data processed by the ISP processor 810 may be output to the display 870 (the display 870 may include the display screen 550 ) for viewing by the user and/or further processing by a graphics engine or a GPU (Graphics Processing Unit). In addition, the output of the ISP processor 810 may also be sent to the image memory 850 , and the display 870 may read image data from the image memory 850 . In one embodiment, image memory 850 may be configured to implement one or more frame buffers. Additionally, the output of ISP processor 810 may be sent to encoder/decoder 860 for encoding/decoding image data. The encoded image data may be saved and decompressed prior to display on the display 870 device. The encoder/decoder 860 may be implemented by a CPU or GPU or a co-processor.

Statistics determined by the ISP processor 810 may be sent to the control logic 820 unit. For example, the statistics may include image sensor 834 statistics such as auto exposure, auto white balance, auto focus, flicker detection, black level compensation, lens 832 shading correction, and the like. Control logic 820 may include a processing element and/or a microcontroller that executes one or more routines (eg, firmware) that may determine control parameters for camera 830 and an ISP processor based on received statistics 810 control parameters. For example, camera 830 control parameters may include sensor 840 control parameters (eg, gain, integration time for exposure control, stabilization parameters, etc.), camera flash control parameters, lens 832 control parameters (eg, focal length for focusing or zooming), or these parameters The combination. ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (eg, during RGB processing), and lens 832 shading correction parameters.

The following are the steps of implementing the photographing method using the image processing technology in Figure 22:

S212: controlling the supplementary light 100 for auxiliary exposure to obtain a first image;

S214: Process the first image to obtain the color temperature of the light source of the first image;

S216: Determine the first color temperature of the scene according to the color temperature of the light source of the first image and the color temperature of the fill light 100;

S218: Acquire a second image when the fill light 100 is turned off;

S222: Process the second image to obtain the color temperature of the light source of the second image as the second color temperature of the scene;

S224: Determine the equivalent color temperature of the scene according to the first color temperature of the scene and the second color temperature of the scene; and

S226: Perform white balance processing on the second image according to the equivalent color temperature of the scene.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium , when the program is executed, it may include the processes of the foregoing method embodiments. The storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or the like.

The above-mentioned embodiments only represent several embodiments of the present application, and the descriptions thereof are relatively specific and detailed, but should not be construed as a limitation on the scope of the patent of the present application. It should be pointed out that for those skilled in the art, without departing from the concept of the present application, several modifications and improvements can be made, which all belong to the protection scope of the present application. Therefore, the scope of protection of the patent of the present application shall be subject to the appended claims.

Claims (16)

1. a kind of image pickup method is used for computer equipment, which is characterized in that the computer equipment includes light compensating lamp, the bat Take the photograph method the following steps are included:

The light compensating lamp auxiliary exposure is controlled to obtain the first image；

The first image is handled to obtain the colour temperature of the light source of the first image；

The first colour temperature of scene is determined according to the colour temperature of the colour temperature of the light source of the first image and the light compensating lamp；

The second image is obtained when the light compensating lamp is closed；

The colour temperature of light source of second image to obtain second image is handled as the second colour temperature of the scene；

The equivalent colour temperature of the scene is determined according to the second colour temperature of the first colour temperature of the scene and the scene；With

White balance processing is carried out to second image according to the equivalent colour temperature of the scene；

The step of the equivalent colour temperature that the scene is determined according to the first colour temperature of the scene and the second colour temperature of the scene It is rapid the following steps are included:

Calculate the colour temperature difference of the first colour temperature of the scene and the second colour temperature of the scene；

Judge whether the colour temperature difference is less than preset difference value；

When the colour temperature difference is less than the preset difference value, first colour temperature or second colour temperature or described the are determined Equivalent colour temperature of the average value of color temperature and second colour temperature as the scene；With

When the colour temperature difference is greater than or equal to the preset difference value, into the light compensating lamp auxiliary exposure is controlled to obtain the The step of one image.

2. image pickup method according to claim 1, which is characterized in that the processing the first image is to obtain described Before the step of colour temperature of the light source of one image the following steps are included:

The first image is divided into multiple regions；

According to the histogram in each region judge the region whether be include the first image light source target area Domain；

Judge whether there is adjacent multiple target areas；

Adjacent multiple target areas are spliced into the first image when there are adjacent multiple target areas Light source；With

The target area is determined as to the light source of the first image when adjacent multiple target areas are not present.

3. image pickup method according to claim 1, which is characterized in that the processing the first image is to obtain described The step of colour temperature of the light source of one image the following steps are included:

The light for surrounding the first image is determined according to the Luminance Distribution of the center of the light source of the first image radially The highlight regions of the central area in source and middle bright area；

By the primary color channels pixel average of the highlight regions subtract the primary color channels pixel average of the middle bright area with Determine the color of the light source of the first image；With

The colour temperature of the light source of the first image is determined according to the color of the light source of the first image.

4. image pickup method according to claim 1, which is characterized in that the light compensating lamp includes having the first preset color temperature First light compensating lamp and the second light compensating lamp with the second preset color temperature, the colour temperature of the light source according to the first image and institute Before stating the step of the colour temperature of light compensating lamp determines the first colour temperature of scene the following steps are included:

According to first preset color temperature, second preset color temperature, the working condition of first light compensating lamp and described second The working condition of light compensating lamp determines the colour temperature of the light compensating lamp.

5. image pickup method according to claim 1, which is characterized in that the light compensating lamp has the first brightness, the scene With the second brightness, the colour temperature of the light source according to the first image and the colour temperature of the light compensating lamp determine the first of scene The step of colour temperature the following steps are included:

According to first brightness, second brightness, the first image light source colour temperature and the light compensating lamp colour temperature Determine the first colour temperature of the scene.

6. image pickup method according to claim 1, which is characterized in that the processing second image is to obtain described the Before the step of the second colour temperature of the colour temperature of the light source of two images as the scene the following steps are included:

Second image is divided into multiple regions；

According to the histogram in each region judge the region whether be include second image light source target area Domain；

Judge whether there is adjacent multiple target areas；

Adjacent multiple target areas are spliced into second image when there are adjacent multiple target areas Light source；With

The target area is determined as to the light source of second image when adjacent multiple target areas are not present.

7. image pickup method according to claim 1, which is characterized in that the processing second image is to obtain described the The step of the second colour temperature of the colour temperature of the light source of two images as the scene the following steps are included:

The light for surrounding second image is determined according to the Luminance Distribution of the center of the light source of second image radially The highlight regions of the central area in source and middle bright area；

By the primary color channels pixel average of the highlight regions subtract the primary color channels pixel average of the middle bright area with Determine the color of the light source of second image；With

The colour temperature of the light source of second image is determined according to the color of the light source of second image.

8. a kind of filming apparatus is used for computer equipment, which is characterized in that the computer equipment includes light compensating lamp, the bat Taking the photograph device includes:

Control module, the control module is for controlling the light compensating lamp auxiliary exposure to obtain the first image；

First processing module, the first processing module is for handling the first image to obtain the light source of the first image Colour temperature；

First determining module, first determining module are used for colour temperature and the light compensating lamp according to the light source of the first image Colour temperature determine the first colour temperature of scene；

Module is obtained, the acquisition module is used to obtain the second image when the light compensating lamp is closed；

Second processing module, the Second processing module is for handling second image to obtain the light source of second image Second colour temperature of the colour temperature as the scene；

Second determining module, second determining module are used for according to the first colour temperature of the scene and the second color of the scene Temperature determines the equivalent colour temperature of the scene；With

Third processing module, the third processing module is for carrying out second image according to the equivalent colour temperature of the scene White balance processing；

Second determining module includes:

Computing unit, the computing unit are used to calculate the colour temperature of the first colour temperature of the scene and the second colour temperature of the scene Difference；

Judging unit, the judging unit is for judging whether the colour temperature difference is less than preset difference value；

5th determination unit, the 5th determination unit are used to determine institute when the colour temperature difference is less than the preset difference value The average value of the first colour temperature or second colour temperature or first colour temperature and second colour temperature is stated as the scene Equivalent colour temperature；With

Into unit, the unit that enters is used for when the colour temperature difference is greater than or equal to the preset difference value, into control The step of light compensating lamp auxiliary exposure is to obtain the first image.

9. filming apparatus according to claim 8, which is characterized in that the filming apparatus includes:

First division module, first division module are used to the first image being divided into multiple regions；

First judgment module, the first judgment module are used to whether judge the region according to the histogram in each region Be include the first image light source target area；

Second judgment module, second judgment module is for judging whether there is adjacent multiple target areas；

First splicing module, first splicing module is for will be adjacent more when there are adjacent multiple target areas A target area is spliced into the light source of the first image；With

Third determining module, the third determining module are used for the mesh when adjacent multiple target areas are not present Mark region is determined as the light source of the first image.

10. filming apparatus according to claim 8, which is characterized in that the first processing module includes:

First determination unit, first determination unit are used for according to the center of the light source of the first image radially Luminance Distribution determines the highlight regions and middle bright area of the central area of the light source around the first image；

First processing units, the first processing units are used to the primary color channels pixel average of the highlight regions subtracting institute The primary color channels pixel average of middle bright area is stated to determine the color of the light source of the first image；With

Second determination unit, second determination unit are used to determine described first according to the color of the light source of the first image The colour temperature of the light source of image.

11. filming apparatus according to claim 8, which is characterized in that the light compensating lamp includes having the first preset color temperature The first light compensating lamp and the second light compensating lamp with the second preset color temperature, the filming apparatus include:

4th determining module, the 4th determining module are used for according to first preset color temperature, second preset color temperature, institute The working condition of the working condition and second light compensating lamp of stating the first light compensating lamp determines the colour temperature of the light compensating lamp.

12. filming apparatus according to claim 8, which is characterized in that the light compensating lamp has the first brightness, the scene With the second brightness, first determining module is used for according to first brightness, second brightness, the first image The colour temperature of light source and the colour temperature of the light compensating lamp determine the colour temperature of the scene.

13. filming apparatus according to claim 8, which is characterized in that the filming apparatus includes:

Second division module, second division module are used to second image being divided into multiple regions；

Third judgment module, the third judgment module are used to whether judge the region according to the histogram in each region Be include second image light source target area；

4th judgment module, the 4th judgment module is for judging whether there is adjacent multiple target areas；

Second splicing module, second splicing module is for will be adjacent more when there are adjacent multiple target areas A target area is spliced into the light source of second image；With

5th determining module, the 5th determining module are used for the mesh when adjacent multiple target areas are not present Mark region is determined as the light source of second image.

14. filming apparatus according to claim 8, which is characterized in that the Second processing module includes:

Third determination unit, the third determination unit are used for according to the center of the light source of second image radially Luminance Distribution determines the highlight regions and middle bright area of the central area of the light source around second image；

The second processing unit, described the second processing unit are used to the primary color channels pixel average of the highlight regions subtracting institute The primary color channels pixel average of middle bright area is stated with the color of the light source of determination second image；With

4th determination unit, the 4th determination unit are used to determine described second according to the color of the light source of second image The colour temperature of the light source of image.

15. a kind of non-volatile computer readable storage medium storing program for executing comprising computer executable instructions, when the computer can be held When row instruction is executed by one or more processors, so that bat described in any one of processor perform claim requirement 1 to 7 Take the photograph method.

16. a kind of computer equipment, including memory and processor, computer-readable instruction is stored in the memory, institute When stating instruction by processor execution, so that shooting side described in any one of processor perform claim requirement 1 to 7 Method.