HK40001462A - Imaging control method, apparatus, electronic device and computer-readable storage medium - Google Patents

Description

Imaging control method, imaging control device, electronic device, and computer-readable storage medium

Technical Field

The present application relates to the field of electronic device technologies, and in particular, to an imaging control method and apparatus, an electronic device, and a computer-readable storage medium.

Background

With the continuous development of terminal technology, more and more users use electronic devices to capture images. In a backlight scene, when a user uses a front camera of the electronic equipment for self-shooting, the situation that the face exposure is insufficient is easily caused because the user is positioned between a light source and the electronic equipment. If the brightness of the human face is increased by adjusting the exposure, the background area is overexposed, and the shooting scene cannot be clearly displayed.

In order to improve the shooting quality in high dynamic range scenes such as backlight, in general, in the shooting process, the imaging effect of images is improved by adopting a mode of synthesizing images with different exposure levels.

However, the imaging quality of the images captured in this way varies with different shooting scenes, and in some shooting scenes, although the dynamic range is large, the imaging effect is poor, so that such a single shooting mode cannot cope with multiple shooting scenes.

Disclosure of Invention

The present application is directed to solving, at least to some extent, one of the technical problems in the related art.

Therefore, the application provides an imaging control method, an imaging control device, an electronic device and a computer-readable storage medium, which are used for acquiring an image by adopting corresponding shooting modes according to environment brightness values of different shooting scenes so as to solve the technical problem that the resolution and the signal-to-noise ratio of the image are low in the prior art.

An embodiment of an aspect of the present application provides an imaging control method, which is applied to an imaging device, where the imaging device includes a pixel unit array composed of a plurality of photosensitive pixel units, each photosensitive pixel unit includes a plurality of original pixels, and the original pixels are long-exposure pixels, short-exposure pixels, or medium-exposure pixels, and the method includes:

when a shooting scene belongs to a dark light environment with the brightness smaller than the threshold brightness, determining whether the shooting scene belongs to a high dynamic range with the exposure ratio larger than a first exposure ratio threshold value according to the exposure ratio of the long exposure pixels and the short exposure pixels in the shooting scene;

if the shooting scene belongs to a high dynamic range, controlling the pixel unit array to adopt at least two exposure durations to execute the step of outputting the original pixel information of each exposure pixel for multiple times so as to generate a corresponding first image according to the output original pixel information at each time; wherein, each time the step of outputting the original pixel information of each exposure pixel is executed, the pixel unit array adopts the same exposure time length;

and performing synthesis processing according to the first image of each frame.

According to the imaging control method, when a shooting scene belongs to a dark light environment with the brightness smaller than the threshold brightness, whether the shooting scene belongs to a high dynamic range with the exposure ratio larger than a first exposure ratio threshold is determined according to the exposure ratio of long exposure pixels and short exposure pixels in the shooting scene, if the shooting scene belongs to the high dynamic range, the pixel unit array is controlled to adopt at least two exposure time lengths to execute a step of outputting original pixel information of each exposure pixel for multiple times, so that a corresponding first image is generated according to the output original pixel information of each time, and when the step of outputting the original pixel information of each exposure pixel is executed each time, the pixel unit array adopts the same exposure time length, and finally synthesis processing is carried out according to the first image of each frame. Therefore, when the dynamic range of the dark light environment is high, under different exposure durations, the high dynamic range image is obtained through the synthesis processing of the merged pixel information corresponding to the original pixel information of each photosensitive pixel unit, the dynamic range is ensured, the imaging effect and the imaging quality are improved, and the shooting experience of a user is improved.

In another aspect, an embodiment of the present application provides an imaging control apparatus, including:

the determining module is used for determining whether the shooting scene belongs to a high dynamic range of which the exposure ratio is greater than a first exposure ratio threshold value according to the exposure ratio of the long exposure pixels and the short exposure pixels in the shooting scene when the shooting scene belongs to a dim light environment with the brightness less than the threshold brightness;

the control module is used for controlling the pixel unit array to adopt at least two exposure durations to execute the step of outputting the original pixel information of each exposure pixel for multiple times if the shooting scene belongs to a high dynamic range so as to generate a corresponding first image according to the output original pixel information; wherein, each time the step of outputting the original pixel information of each exposure pixel is executed, the pixel unit array adopts the same exposure time length;

and the processing module is used for carrying out synthesis processing according to the first image of each frame.

The imaging control device of the embodiment of the application determines whether a shooting scene belongs to a high dynamic range with an exposure ratio larger than a first exposure ratio threshold value according to an exposure ratio of a long exposure pixel and a short exposure pixel in the shooting scene when the shooting scene belongs to a dark light environment with brightness smaller than the threshold brightness, and controls the pixel unit array to execute a step of outputting original pixel information of each exposure pixel for multiple times by adopting at least two exposure time lengths if the shooting scene belongs to the high dynamic range, so as to generate a corresponding first image according to the output original pixel information of each time, wherein when the step of outputting the original pixel information of each exposure pixel is executed each time, the pixel unit array adopts the same exposure time length, and finally, synthesis processing is performed according to the first image of each frame. Therefore, when the dynamic range of the dark light environment is high, under different exposure durations, the high dynamic range image is obtained through the synthesis processing of the merged pixel information corresponding to the original pixel information of each photosensitive pixel unit, the dynamic range is ensured, the imaging effect and the imaging quality are improved, and the shooting experience of a user is improved.

An embodiment of another aspect of the present application provides an electronic device, including: a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the imaging control method as described in the above embodiments when executing the program.

In yet another aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, wherein the program is executed by a processor to implement the imaging control method according to the above embodiments.

Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a schematic flowchart of an imaging control method according to an embodiment of the present disclosure;

fig. 2 is a schematic partial structural view of an image forming apparatus according to an embodiment of the present application;

fig. 3 is a schematic structural diagram of a pixel unit array of an imaging device according to an embodiment of the present disclosure;

fig. 4 is a schematic flowchart of another imaging control method provided in the embodiment of the present application;

fig. 5 is a schematic structural diagram of an imaging control apparatus according to an embodiment of the present application;

FIG. 6 is a block diagram of an electronic device according to some embodiments of the present application;

FIG. 7 is a block diagram of an image processing circuit according to some embodiments of the present disclosure.

Detailed Description

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.

In the related art, in order to improve the shooting quality in a high dynamic range scene such as a backlight, in the shooting process, a long exposure, a medium exposure and a short exposure are respectively performed by controlling a pixel array, and then images obtained under different exposure levels are synthesized and output to be imaged, so as to improve the imaging effect of the images. However, the imaging quality of the images obtained by such a method may change with different shooting scenes, and in some shooting scenes, an ideal shooting effect cannot be achieved.

In order to solve the above problems, the present application provides an imaging control method, where when a shooting scene belongs to a dark light environment with brightness less than a threshold brightness, it is determined whether the shooting scene belongs to a high dynamic range with an exposure ratio greater than a first exposure ratio threshold according to an exposure ratio of a long exposure pixel and a short exposure pixel in the shooting scene, and if the shooting scene belongs to the high dynamic range, a step of outputting original pixel information of each exposure pixel is executed for multiple times by controlling a pixel unit array to generate a corresponding first image according to the output original pixel information for each time, where each time the step of outputting the original pixel information of each exposure pixel is executed, the pixel unit array uses the same exposure time, and finally, synthesis processing is performed according to the first image of each frame.

An imaging control method and apparatus of an embodiment of the present application are described below with reference to the drawings.

Fig. 1 is a schematic flowchart of an imaging control method according to an embodiment of the present disclosure.

The imaging control method of the embodiment of the application is applied to imaging equipment, and the imaging equipment comprises a pixel unit array formed by a plurality of photosensitive pixel units, wherein each photosensitive pixel unit comprises a plurality of original pixels, and the original pixels are long exposure pixels, short exposure pixels or medium exposure pixels.

As an example, referring to fig. 2, the imaging apparatus includes a pixel cell array 31 and a filter cell array 32 disposed on the pixel cell array 31. The pixel unit array 31 includes a plurality of photosensitive pixel units 311, and each photosensitive pixel unit 311 includes a plurality of photosensitive pixels 3111. The filter unit array 32 includes a plurality of filter units 322 corresponding to the plurality of light-sensing pixel units 311, and each filter unit 322 covers the corresponding light-sensing pixel unit 311. Each of the photosensitive pixel cells 311 in the pixel cell array 31 includes a plurality of primitive pixels, wherein the primitive pixels are long-exposure pixels, short-exposure pixels, or medium-exposure pixels.

As shown in fig. 1, the imaging control method includes the steps of:

step 101, when the shooting scene belongs to a dark light environment with the brightness smaller than the threshold brightness, determining whether the shooting scene belongs to a high dynamic range with the exposure ratio larger than a first exposure ratio threshold according to the exposure ratio of the long exposure pixels and the short exposure pixels in the shooting scene.

In the embodiment of the application, an ISO or exposure time of a preview image of an imaging device in a current shooting scene is firstly acquired, wherein an ISO value is used for indicating the sensitivity of a camera. And if the obtained ISO or exposure time of the shooting scene is larger than the corresponding first parameter threshold, determining that the shooting scene belongs to a dim light environment. Wherein, the first parameter threshold value can be set as the ISO parameter value of 400, and the exposure time of 30 ms.

The ISO value of the preview image in the shooting scene can be acquired by reading the ISO value automatically adjusted by the camera of the imaging device.

In the embodiment of the application, the exposure time can be preset in a built-in program of the electronic device, or can be set by a user, so that the exposure time of the preview image in the shooting scene can be acquired through the imaging device.

After determining the dark light environment to which the shooting scene belongs, further determining that the ISO or exposure time of the preview image in the shooting scene is greater than the corresponding first parameter threshold and less than the corresponding second parameter threshold; wherein the second parameter threshold is greater than the first parameter threshold. Wherein, the second parameter threshold value can be set as the parameter value of ISO 1600, and the exposure time is 50 ms.

Further, after determining that the shooting scene belongs to the dark light environment, the brightness level may also be divided for the dark light environment, for example, when the ISO value of the obtained preview image in the shooting scene is greater than 400 and less than 1600, it is determined that the current shooting scene is the dark light environment with medium and low brightness. And when the ISO value of the obtained preview image in the shooting scene is larger than 1600, the current shooting scene is in a low-brightness dim light environment.

Specifically, when the shooting scene is determined to belong to a dark light environment with the brightness smaller than the threshold brightness according to the obtained ISO or exposure time of the shooting scene, under the shooting scene, the long exposure pixels and the short exposure pixels are obtained, the exposure ratio of the long exposure pixels and the short exposure pixels is further calculated, and if the obtained exposure ratio is larger than the first exposure ratio threshold, the current shooting scene can be determined to belong to the high dynamic range.

The threshold brightness is a preset brightness value for judging that a shooting scene belongs to a dim light environment with a certain brightness level, and may be preset in a built-in program of the imaging device or set by a user; the first exposure ratio threshold is a threshold that is set in advance to determine the dynamic range of the imaging scene from the exposure ratio of the long-exposure pixels to the short-exposure pixels. When the exposure ratio threshold of the shooting scene is larger than the first exposure ratio threshold, the current shooting scene is in a high dynamic range; and when the exposure ratio threshold of the shooting scene is smaller than the first exposure ratio threshold, the current shooting scene is in a narrow dynamic range.

Step 102, if the shooting scene belongs to a high dynamic range, controlling the pixel unit array to adopt at least two exposure durations to execute the step of outputting the original pixel information of each exposure pixel for multiple times so as to generate a corresponding first image according to the output original pixel information of each time; wherein, when the step of outputting the original pixel information of each exposure pixel is executed each time, the pixel unit array adopts the same exposure time length.

In this embodiment, when the shooting scene belongs to a high dynamic range in a dark light environment, the image obtained by a single shooting of the imaging device may have a large area of overexposure or a partial overexposure, and therefore, the pixel unit array 31 needs to be controlled to output the original pixel information of each exposed pixel for multiple times, and then imaging is performed according to the original pixel information output each time. The pixel unit array 31 uses the same exposure time length each time the step of outputting the original pixel information of each exposure pixel is executed.

Specifically, the imaging device controls the long exposure pixels, the short exposure pixels, and the middle exposure pixels of the pixel unit array 31 to perform exposure for multiple times, and after the exposure is finished, the light sensing pixel unit 311 obtains the original pixel information of the long exposure pixels, the original pixel information of the short exposure pixels, and the original pixel information of the middle exposure pixels. The imaging apparatus controls the pixel unit array 31 to acquire the original pixel information for at least two exposure periods each time.

As a possible implementation, the exposure times used in the process of the imaging device controlling the pixel unit array 31 to acquire the original pixel information a plurality of times are different.

As another possible implementation, the imaging device controls the exposure time in the process of acquiring the original pixel information by the pixel unit array 31 a plurality of times, and may adopt the same exposure time a plurality of times and an excessively long exposure time.

It should be noted that the two exposure periods of the pixel unit array 31 are controlled as an example, and there may be another exposure manner, which is not limited by the embodiment.

Further, each time the pixel unit array 31 outputs original pixel information, in the same photosensitive pixel unit 311, an average value of the obtained original pixel information of the long-exposure pixel, the obtained original pixel information of the short-exposure pixel, and the obtained original pixel information of the medium-exposure pixel is calculated, thereby obtaining merged pixel information. And, each photosensitive pixel cell 311 corresponds to one merged pixel information.

As an example, taking the red photosensitive pixel unit shown in fig. 3 as an example, R (1,1) is a long exposure pixel, R (1,2) and R (2,1) are medium exposure pixels, and R (2,2) is a short exposure pixel. The processor of the imaging apparatus first controls the long-exposure pixel R (1,1), the middle-exposure pixel R (1,2), the middle-exposure pixel R (2,1), and the short-exposure pixel R (2,2) to be synchronously exposed. After the exposure is finished, the red pixel unit outputs four pieces of original pixel information, namely, original pixel information output by the long-exposure pixel R (1,1), original pixel information output by the middle-exposure pixel R (1,2), original pixel information output by the middle-exposure pixel R (2,1), and original pixel information output by the short-exposure pixel R (2, 2). In this manner, the processor of the image forming apparatus controls the photosensitive pixels 3111 in each photosensitive pixel unit 311 to perform synchronous exposure in the manner described above, and acquires a plurality of pieces of original pixel information output by each photosensitive pixel unit 311.

Further, the processor of the imaging apparatus performs a combination calculation of the original pixel information in the same photosensitive pixel cell 311 to obtain a plurality of combined pixel information, and calculates the combined pixel information of each photosensitive pixel cell 311 using the following formula:in this manner, the processor of the imaging apparatus can calculate a plurality of pieces of combined pixel information of the plurality of photosensitive pixel units 311 in the entire pixel unit array 31.

And then, carrying out interpolation calculation according to the merged pixel information corresponding to each photosensitive pixel unit to generate a first image under the corresponding exposure duration. Similarly, the corresponding first image may be generated according to a plurality of combined pixel information of a plurality of photosensitive pixel units in the entire pixel unit array.

Step 103, synthesizing processing is performed according to the first image of each frame.

Specifically, a plurality of combined pixel information of a plurality of photosensitive pixel units 311 in the entire pixel unit array is generated to generate a corresponding first image, and the first image is synthesized, so as to obtain a high dynamic range image. Finally, the image after the synthesis processing is presented on the imaging device as a captured image or stored in a memory of the electronic device.

According to the imaging control method, when a shooting scene belongs to a dark light environment with the brightness smaller than the threshold brightness, whether the shooting scene belongs to a high dynamic range with the exposure ratio larger than a first exposure ratio threshold is determined according to the exposure ratio of long exposure pixels and short exposure pixels in the shooting scene, if the shooting scene belongs to the high dynamic range, the pixel unit array is controlled to adopt at least two exposure time lengths to execute a step of outputting original pixel information of each exposure pixel for multiple times, so that a corresponding first image is generated according to the output original pixel information of each time, and when the step of outputting the original pixel information of each exposure pixel is executed each time, the pixel unit array adopts the same exposure time length, and finally synthesis processing is carried out according to the first image of each frame. Therefore, when the dynamic range of the dark light environment is high, under different exposure durations, the high dynamic range image is obtained through the synthesis processing of the merged pixel information corresponding to the original pixel information of each photosensitive pixel unit, the dynamic range is ensured, the imaging effect and the imaging quality are improved, and the shooting experience of a user is improved.

As another possible implementation manner, when the ISO or exposure time of the captured scene preview image is greater than or equal to the corresponding second parameter threshold, or if the captured scene belongs to the narrow dynamic range with the exposure ratio less than or equal to the first exposure ratio threshold, and the current captured scene belongs to the low-brightness environment in the dark environment, the pixel unit array is controlled to execute the step of outputting the original pixel information of each exposed pixel for multiple times with the same exposure time length, so as to perform imaging according to the output original pixel information for each time. Referring to fig. 4, fig. 4 is a schematic flowchart of another imaging control method provided in the embodiment of the present application.

As shown in fig. 4, the imaging control method may include the steps of:

step 201, determining that the ISO or exposure time of the preview image is greater than or equal to the corresponding second parameter threshold, or determining that the shooting scene belongs to a narrow dynamic range with an exposure ratio less than or equal to the first exposure ratio threshold.

In the embodiment of the present application, the method for acquiring the ISO or exposure time of the preview image is described in step 101 in the foregoing embodiment, and details are not described herein.

Further, it is determined that the ISO or exposure time for acquiring the preview image of the imaging device in the current shooting scene is greater than or equal to the corresponding second parameter threshold, or it is determined that the shooting scene belongs to a narrow dynamic range with an exposure ratio less than or equal to the first exposure ratio threshold, and the current shooting scene is a low-brightness dim light environment.

Step 202, controlling the pixel unit array to execute the step of outputting the original pixel information of each exposure pixel for multiple times with the same exposure duration, so as to generate a corresponding second image according to the output original pixel information of each time.

In this embodiment, when a shooting scene belongs to a dark light environment with lower brightness, an image obtained by single shooting by an imaging device may have a large-area overexposure or a partial overexposure, and therefore, multiple times of execution of controlling the pixel unit array to output multiple original pixel information obtained by exposure with the same exposure time are required, and then multiple images are obtained after combining the pixel information.

Specifically, the imaging device controls the long exposure pixels, the short exposure pixels and the middle exposure pixels of the pixel unit array to be exposed for the same exposure time for multiple times, and after exposure is finished, the photosensitive pixel units obtain original pixel information of the long exposure pixels, original pixel information of the short exposure pixels and original pixel information of the middle exposure pixels.

Furthermore, when the pixel unit array outputs the original pixel information each time, an average value of the original pixel information of the same photosensitive pixel unit is calculated to obtain combined pixel information, and each photosensitive pixel unit corresponds to one combined pixel information. The method for specifically obtaining the combined pixel information is as described in step 102 of the above embodiment, and is not described herein again.

And then, performing interpolation calculation on the combined pixel information corresponding to each photosensitive pixel unit obtained by each execution to generate a corresponding frame of second image.

Step 203, performing synthesis noise reduction processing according to the second image of each frame.

Because the current shooting scene is a low-brightness dark light environment and the shot image has noise, the second image of each frame generated by multiple executions needs to be synthesized and de-noised, and then the image after the synthesis and de-noised processing is obtained. Finally, the image after the synthesis processing is presented on the imaging device as a captured image or stored in a memory of the electronic device.

According to the imaging control method, the step of outputting the original pixel information of each exposure pixel is executed for multiple times by controlling the pixel unit array to adopt the same exposure time length through determining that the ISO or the exposure time of the preview image is larger than or equal to the corresponding second parameter threshold value or determining that the shooting scene belongs to the narrow dynamic range of which the exposure ratio is smaller than or equal to the first exposure ratio threshold value, so that the corresponding second image is generated according to the output original pixel information of each time, and then the synthesis noise reduction processing is carried out according to the second image of each frame. Therefore, in a low-brightness environment, the imaging equipment executes the control pixel unit array for multiple times to output original pixel information by adopting the same exposure duration, generates corresponding frame images, and then synthesizes and denoises the images, so that noise can be better controlled in a low-light environment, the imaging effect and the definition are improved, and the user experience is further improved.

In order to implement the above embodiments, the present application also proposes an imaging control apparatus.

Fig. 5 is a schematic structural diagram of an imaging control apparatus according to an embodiment of the present application.

As shown in fig. 5, the image formation control apparatus 100 is applied to an image forming apparatus including a pixel unit array composed of a plurality of photosensitive pixel units, each photosensitive pixel unit including a plurality of primitive pixels, the primitive pixels being long-exposure pixels, short-exposure pixels, or intermediate-exposure pixels, the apparatus including: a determination module 110, a control module 120, and a processing module 130.

The determining module 110 is configured to determine whether the shooting scene belongs to a high dynamic range in which an exposure ratio is greater than a first exposure ratio threshold according to an exposure ratio of the long-exposure pixel and the short-exposure pixel in the shooting scene when the shooting scene belongs to a dim light environment with a brightness less than a threshold brightness.

The control module 120 is configured to control the pixel unit array to perform the step of outputting the original pixel information of each exposure pixel for multiple times with at least two exposure durations if the shooting scene belongs to the high dynamic range, so as to generate a corresponding first image according to the output original pixel information of each time; wherein, when the step of outputting the original pixel information of each exposure pixel is executed each time, the pixel unit array adopts the same exposure time length.

And a processing module 130, configured to perform synthesis processing according to the first image of each frame.

As another possible implementation manner, the control module 120 is specifically configured to: calculating an average value of original pixel information of the same photosensitive pixel unit when the pixel unit array outputs the original pixel information every time to obtain merged pixel information, wherein each photosensitive pixel unit corresponds to one merged pixel information;

and generating a first image under the corresponding exposure duration according to the combined pixel information corresponding to each photosensitive pixel unit.

As another possible implementation manner, the imaging control apparatus 100 further includes:

the first determining module is used for determining that the ISO or exposure time of the preview image in the shooting scene is greater than the corresponding first parameter threshold value and smaller than the corresponding second parameter threshold value; wherein the second parameter threshold is greater than the first parameter threshold.

As another possible implementation manner, the imaging control apparatus 100 further includes:

and the first control module is used for controlling the pixel unit array to adopt the same exposure duration to execute the step of outputting the original pixel information of each exposure pixel for multiple times so as to generate a corresponding second image according to the output original pixel information of each time when the ISO or the exposure time of the preview image is greater than or equal to the corresponding second parameter threshold value or the shooting scene belongs to the narrow dynamic range of which the exposure ratio is less than or equal to the first exposure ratio threshold value.

And the first processing module is used for carrying out synthesis noise reduction processing according to the second image of each frame.

As another possible implementation manner, the first control module is specifically configured to: calculating an average value of original pixel information of the same photosensitive pixel unit when the pixel unit array outputs the original pixel information every time to obtain combined pixel information, wherein each photosensitive pixel unit corresponds to one combined pixel information;

and generating a frame of second image according to the combined pixel information corresponding to each photosensitive pixel unit.

As another possible implementation manner, the imaging control apparatus 100 further includes:

and the acquisition module is used for acquiring the ISO or exposure time of the preview image in the shooting scene.

And the second determining module is used for determining that the shooting scene belongs to the dim light environment when the ISO or exposure time of the shooting scene is greater than the corresponding first parameter threshold.

As another possible implementation manner, the imaging control apparatus 100 further includes:

and the display module is used for displaying the synthesized image as a shot image.

And the storage module is used for storing the image after the synthesis processing as a shot image.

The imaging control device of the embodiment of the application determines whether a shooting scene belongs to a high dynamic range with an exposure ratio larger than a first exposure ratio threshold value according to an exposure ratio of a long exposure pixel and a short exposure pixel in the shooting scene when the shooting scene belongs to a dark light environment with brightness smaller than the threshold brightness, and controls the pixel unit array to execute a step of outputting original pixel information of each exposure pixel for multiple times by adopting at least two exposure time lengths if the shooting scene belongs to the high dynamic range, so as to generate a corresponding first image according to the output original pixel information of each time, wherein when the step of outputting the original pixel information of each exposure pixel is executed each time, the pixel unit array adopts the same exposure time length, and finally, synthesis processing is performed according to the first image of each frame. Therefore, when the dynamic range of the dark light environment is high, under different exposure durations, the high dynamic range image is obtained through the synthesis processing of the merged pixel information corresponding to the original pixel information of each photosensitive pixel unit, the dynamic range is ensured, the imaging effect and the imaging quality are improved, and the shooting experience of a user is improved.

It should be noted that the foregoing explanation of the embodiment of the imaging control method is also applicable to the imaging control apparatus of this embodiment, and is not repeated here.

In order to implement the above embodiments, the present application also provides an electronic device, including: the imaging control method includes a memory, a processor and a computer program stored in the memory and capable of running on the processor, and when the processor executes the program, the imaging control method is realized.

In order to implement the above-mentioned embodiments, the present application also proposes a computer-readable storage medium having a computer program stored thereon, characterized in that the program, when executed by a processor, implements the imaging control method as described in the above-mentioned embodiments.

Referring to fig. 6, the present application further provides an electronic device 200. The electronic device 200 comprises a memory 50 and a processor 60. The memory 50 has stored therein computer readable instructions. The computer readable instructions, when executed by the memory 50, cause the processor 60 to perform the imaging control method of any of the embodiments described above.

Fig. 6 is a schematic diagram of the internal structure of the electronic device 200 in one embodiment. The electronic device 200 includes a processor 60, a memory 50 (e.g., a non-volatile storage medium), an internal memory 82, a display screen 83, and an input device 84 connected by a system bus 81. The memory 50 of the electronic device 200 stores, among other things, an operating system and computer-readable instructions. The computer readable instructions are executable by the processor 60 to implement the imaging control method of the embodiments of the present application. The processor 60 is used to provide computing and control capabilities to support the operation of the overall electronic device 200. The internal memory 50 of the electronic device 200 provides an environment for the execution of computer readable instructions in the memory 52. The display 83 of the electronic device 200 may be a liquid crystal display or an electronic ink display, and the input device 84 may be a touch layer covered on the display 83, a button, a trackball or a touch pad arranged on a housing of the electronic device 200, or an external keyboard, a touch pad or a mouse. The electronic device 200 may be a mobile phone, a tablet computer, a notebook computer, a personal digital assistant, or a wearable device (e.g., a smart bracelet, a smart watch, a smart helmet, smart glasses), etc. Those skilled in the art will appreciate that the configuration shown in fig. 6 is merely a schematic diagram of a portion of the configuration associated with the present application, and does not constitute a limitation on the electronic device 200 to which the present application is applied, and that a particular electronic device 200 may include more or less components than those shown in the drawings, or combine certain components, or have a different arrangement of components.

Referring to fig. 7, the electronic device 200 according to the embodiment of the present disclosure includes an Image Processing circuit 90, and the Image Processing circuit 90 may be implemented by hardware and/or software components, including various Processing units defining an ISP (Image Signal Processing) pipeline. FIG. 7 is a schematic diagram of image processing circuitry 90 in one embodiment. As shown in fig. 7, for convenience of explanation, only aspects of the image processing technology related to the embodiments of the present application are shown.

As shown in fig. 7, the image processing circuit 90 includes an ISP processor 91 (the ISP processor 91 may be the processor 60) and a control logic 92. The image data captured by the camera 93 is first processed by the ISP processor 91, and the ISP processor 91 analyzes the image data to capture image statistics that may be used to determine one or more control parameters of the camera 93. The camera 93 may include one or more lenses 932 and an image sensor 934. Image sensor 934 may include an array of color filters (e.g., Bayer filters), and image sensor 934 may acquire light intensity and wavelength information captured by each imaging pixel and provide a set of raw image data that may be processed by ISP processor 91. The sensor 94 (e.g., a gyroscope) may provide parameters of the acquired image processing (e.g., anti-shake parameters) to the ISP processor 91 based on the type of interface of the sensor 94. The sensor 94 interface may be a SMIA (Standard Mobile Imaging Architecture) interface, other serial or parallel camera interface, or a combination thereof.

In addition, the image sensor 934 may also send raw image data to the sensor 94, the sensor 94 may provide the raw image data to the ISP processor 91 based on the type of interface of the sensor 94, or the sensor 94 may store the raw image data in the image memory 95.

The ISP processor 91 processes the raw image data pixel by pixel in a variety of formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and the ISP processor 91 may perform one or more image processing operations on the raw image data, gathering statistical information about the image data. Wherein the image processing operations may be performed with the same or different bit depth precision.

The ISP processor 91 may also receive image data from the image memory 95. For example, the sensor 94 interface sends raw image data to the image memory 95, and the raw image data in the image memory 95 is then provided to the ISP processor 91 for processing. The image Memory 95 may be the Memory 50, a portion of the Memory 50, a storage device, or a separate dedicated Memory within the electronic device, and may include a DMA (Direct Memory Access) feature.

Upon receiving raw image data from the image sensor 934 interface or from the sensor 94 interface or from the image memory 95, the ISP processor 91 may perform one or more image processing operations, such as temporal filtering. The processed image data may be sent to image memory 95 for additional processing before being displayed. The ISP processor 91 receives the processed data from the image memory 95 and performs image data processing on the processed data in the raw domain and in the RGB and YCbCr color spaces. The image data processed by ISP processor 91 may be output to display 97 (display 97 may include display screen 83) for viewing by a user and/or further processed by a Graphics Processing Unit (GPU). Further, the output of the ISP processor 91 may also be sent to an image memory 95, and the display 97 may read image data from the image memory 95. In one embodiment, image memory 95 may be configured to implement one or more frame buffers. Further, the output of the ISP processor 91 may be transmitted to an encoder/decoder 96 for encoding/decoding the image data. The encoded image data may be saved and decompressed before being displayed on the display 97 device. The encoder/decoder 96 may be implemented by a CPU or GPU or coprocessor.

The statistical data determined by the ISP processor 91 may be sent to the control logic 92 unit. For example, the statistical data may include image sensor 934 statistics such as auto-exposure, auto-white balance, auto-focus, flicker detection, black level compensation, lens 932 shading correction, and the like. The control logic 92 may include a processing element and/or microcontroller that executes one or more routines (e.g., firmware) that determine control parameters of the camera 93 and control parameters of the ISP processor 91 based on the received statistical data. For example, the control parameters of camera 93 may include sensor 94 control parameters (e.g., gain, integration time for exposure control, anti-shake parameters, etc.), camera flash control parameters, lens 932 control parameters (e.g., focal length for focusing or zooming), or a combination of these parameters. The ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (e.g., during RGB processing), and lens 932 shading correction parameters.

In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.

The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.

It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.

In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Claims (9)

1. An image formation control method applied to an image forming apparatus including a pixel unit array composed of a plurality of photosensitive pixel units, each photosensitive pixel unit including a plurality of primitive pixels, the primitive pixels being long-exposure pixels, short-exposure pixels, or intermediate-exposure pixels, the method comprising the steps of:

when a shooting scene belongs to a dark light environment with the brightness smaller than the threshold brightness, determining whether the shooting scene belongs to a high dynamic range with the exposure ratio larger than a first exposure ratio threshold value according to the exposure ratio of the long exposure pixels and the short exposure pixels in the shooting scene;

if the shooting scene belongs to a high dynamic range, controlling the pixel unit array to adopt at least two exposure durations to execute the step of outputting the original pixel information of each exposure pixel for multiple times so as to generate a corresponding first image according to the output original pixel information at each time; wherein, each time the step of outputting the original pixel information of each exposure pixel is executed, the pixel unit array adopts the same exposure time length;

performing synthesis processing according to the first image of each frame;

if the ISO or the exposure time of the preview image is larger than or equal to the corresponding second parameter threshold value, or if the shooting scene belongs to the narrow dynamic range of which the exposure ratio is smaller than or equal to the first exposure ratio threshold value, controlling the pixel unit array to adopt the same exposure time length to execute the step of outputting the original pixel information of each exposure pixel for multiple times so as to generate a corresponding second image according to the output original pixel information of each time;

and performing synthesis noise reduction processing according to the second image of each frame.

2. The imaging control method according to claim 1, wherein the controlling the pixel unit array to perform the step of outputting the original pixel information of each exposure pixel a plurality of times with at least two exposure durations to generate a corresponding first image according to the output original pixel information each time comprises:

calculating an average value of the original pixel information of the same photosensitive pixel unit when the pixel unit array outputs the original pixel information every time to obtain merged pixel information, wherein each photosensitive pixel unit corresponds to one merged pixel information;

and generating a first image under the corresponding exposure duration according to the combined pixel information corresponding to each photosensitive pixel unit.

3. The imaging control method according to claim 1, wherein determining whether the shooting scene belongs to a high dynamic range with an exposure ratio greater than a first exposure ratio threshold according to the exposure ratio of the long-exposure pixel to the short-exposure pixel under the shooting scene further comprises:

determining that the ISO or exposure time of the preview image in the shooting scene is greater than a corresponding first parameter threshold value and smaller than a corresponding second parameter threshold value;

wherein the second parameter threshold is greater than the first parameter threshold.

4. The imaging control method according to claim 1, wherein the controlling the pixel unit array to perform the step of outputting the original pixel information of each exposure pixel a plurality of times with the same exposure time length to generate a corresponding second image according to the output original pixel information each time comprises:

calculating an average value of the original pixel information of the same photosensitive pixel unit when the pixel unit array outputs the original pixel information every time to obtain combined pixel information, wherein each photosensitive pixel unit corresponds to one combined pixel information;

and generating a frame of second image according to the combined pixel information corresponding to each photosensitive pixel unit.

5. The imaging control method according to any one of claims 1 to 4, characterized in that the method further includes:

acquiring ISO or exposure time of a preview image in the shooting scene;

and if the ISO or the exposure time of the shooting scene is larger than the corresponding first parameter threshold, determining that the shooting scene belongs to the dim light environment.

6. The imaging control method according to any one of claims 1 to 4, further comprising, after the synthesizing process is performed based on the first image of each frame:

and displaying or storing the synthesized image as a shot image.

7. An image formation control apparatus applied to an image forming apparatus including a pixel unit array composed of a plurality of photosensitive pixel units, each photosensitive pixel unit including a plurality of primitive pixels, the primitive pixels being long-exposure pixels, short-exposure pixels, or intermediate-exposure pixels, the apparatus comprising:

the determining module is used for determining whether the shooting scene belongs to a high dynamic range of which the exposure ratio is greater than a first exposure ratio threshold value according to the exposure ratio of the long exposure pixels and the short exposure pixels in the shooting scene when the shooting scene belongs to a dim light environment with the brightness less than the threshold brightness;

the control module is used for controlling the pixel unit array to adopt at least two exposure durations to execute the step of outputting the original pixel information of each exposure pixel for multiple times if the shooting scene belongs to a high dynamic range so as to generate a corresponding first image according to the output original pixel information; wherein, each time the step of outputting the original pixel information of each exposure pixel is executed, the pixel unit array adopts the same exposure time length;

the processing module is used for carrying out synthesis processing according to the first image of each frame;

the image forming apparatus further includes:

the first control module is further configured to control the pixel unit array to perform the step of outputting the original pixel information of each exposure pixel for multiple times with the same exposure duration if the ISO or the exposure time of the preview image is greater than or equal to the corresponding second parameter threshold or if the shooting scene belongs to the narrow dynamic range of which the exposure ratio is less than or equal to the first exposure ratio threshold, so as to generate a corresponding second image according to the output original pixel information of each time;

and the first processing module is also used for carrying out synthesis noise reduction processing according to the second image of each frame.

8. An electronic device, comprising: memory, processor and computer program stored on the memory and executable on the processor, which when executed by the processor implements the imaging control method according to any of claims 1 to 6.

9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out an imaging control method according to any one of claims 1 to 6.