CN110266966A - Image generation method and device, electronic equipment and computer readable storage medium - Google Patents

Abstract

The application relates to an image generation method, an image generation device, an electronic device and a computer readable storage medium, wherein the image generation method comprises the following steps: when the shaking intensity of the shooting equipment exceeds the preset OIS shaking prevention range, a good shaking prevention effect cannot be achieved even if OIS shaking prevention is adopted, so that OIS shaking prevention is abandoned to obtain the shaking intensity of the shooting equipment, exposure time is configured for at least two cameras of the shooting equipment according to the shaking intensity of the shooting equipment, and the exposure time is shorter than the shaking duration of the shooting equipment, so that a clear image can be captured and shot in a shooting scene. And shooting by at least two cameras of the shooting equipment by adopting correspondingly configured exposure time to generate at least two original images, and splicing and synthesizing the at least two original images to obtain a target image. And the definition of the image is further improved by synthesizing a plurality of original images.

Description

Image generation method and apparatus, electronic device, computer-readable storage medium

technical field

The present application relates to the field of computer technology, and in particular, to an image generation method and apparatus, an electronic device, and a computer-readable storage medium.

Background technique

With the continuous development of camera technology, people's requirements for taking pictures with cameras of electronic devices are increasing day by day. Traditional electronic devices have developed from a single camera to a dual camera later, and the quality of photos has been significantly improved. However, people's requirements for taking pictures of electronic devices are also increasing. How to further improve the quality of taking pictures of electronic devices and meet the higher requirements of users for taking pictures is an urgent problem to be solved.

SUMMARY OF THE INVENTION

Embodiments of the present application provide an image generation method, apparatus, electronic device, and computer-readable storage medium, which can improve the photographing quality of the electronic device and meet higher photographing requirements.

An image generation method, comprising:

When the shaking intensity of the photographing device exceeds the preset range, obtain the shaking intensity of the photographing device;

Configure an exposure time for at least two cameras of the photographing device according to the shaking intensity of the photographing device, where the exposure time is less than the shaking duration of the photographing device;

At least two original images are generated by at least two cameras of the shooting device using the correspondingly configured exposure time to shoot;

The target image is obtained by splicing and synthesizing the at least two original images.

An image generation device, comprising:

a shaking intensity acquisition module of the photographing device, configured to acquire the shaking intensity of the photographing device when the shaking intensity of the photographing device exceeds a preset range;

an exposure time configuration module, configured to configure an exposure time for at least two cameras of the photographing device according to the shaking intensity of the photographing device, where the exposure time is less than the shaking duration of the photographing device;

an original image generation module, configured to generate at least two original images by shooting at least two cameras of the shooting device using correspondingly configured exposure times;

The splicing and synthesizing module is used for splicing and synthesizing the at least two original images to obtain a target image.

An electronic device includes a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the above method.

A computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the steps of the above method are implemented.

The above-mentioned image generation method, device, electronic device, and computer-readable storage medium, when the shaking intensity of the photographing device exceeds the preset range of OIS anti-shake, even if OIS anti-shake is used, a better anti-shake effect cannot be achieved, so it is discarded. OIS anti-shake is used to obtain the shaking intensity of the shooting device. According to the shaking intensity of the shooting device, configure the exposure time for at least two cameras of the shooting device. . Then, at least two cameras of the shooting device use the correspondingly configured exposure time to shoot to generate at least two original images, and the at least two original images are spliced and synthesized to obtain a target image. Combining multiple original images further improves the clarity of the image.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

Fig. 1 is the application environment diagram of the image generation method in one embodiment;

2 is a flowchart of an image generation method in one embodiment;

3 is a flowchart of a method for configuring exposure times for at least two cameras of a photographing device according to the shaking intensity of the photographing device in FIG. 2;

4 is a flowchart of an image generation method in another embodiment;

5 is a flowchart of an image generation method in a specific embodiment;

6 is a structural block diagram of an image generating apparatus in one embodiment;

7 is a structural block diagram of an image generating apparatus in another embodiment;

8 is a schematic diagram of the internal structure of an electronic device in one embodiment;

FIG. 9 is a schematic diagram of an image processing circuit in one embodiment.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

It will be understood that the terms "first", "second", etc. used in this application may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, a first camera may be referred to as a second camera, and similarly, a second camera may be referred to as a first camera, without departing from the scope of this application. Both the first camera and the second camera are cameras, but they are not the same camera.

FIG. 1 is a schematic diagram of an application environment of an image generation method in one embodiment. As shown in FIG. 1 , the application environment includes an electronic device 100 . The electronic device 100 includes at least one first camera 110 and at least two second cameras 120 , wherein the field of view of the first camera 110 is larger than the field of view of the second camera 120 . When the shaking intensity of the photographing device exceeds the preset range, the electronic device obtains the shaking intensity of the photographing device; configure the exposure time for at least two cameras of the photographing device according to the shaking intensity of the photographing device, and the exposure time is less than the shaking duration of the photographing device; At least two original images are generated by at least two cameras of the photographing device using correspondingly configured exposure times; and the target image is obtained by splicing and synthesizing the at least two original images. It can be understood that the above-mentioned electronic device 100 is a photographing device, and may not be limited to various mobile phones, computers, portable devices, cameras, and the like.

FIG. 2 is a flowchart of an image generation method in one embodiment. As shown in FIG. 2 , the image generation method includes steps 220 to 280 .

Step 220, when the shaking intensity of the photographing device exceeds the preset range, obtain the shaking intensity of the photographing device.

Specifically, the shaking intensity refers to the magnitude of the shaking amplitude of the photographing device within a preset time period when the photographing device is photographing. The magnitude of the shaking amplitude of the photographing device within a preset time period can be represented by an angular velocity or an acceleration. The acceleration sensor in the photographing device can be used to collect the acceleration of the lens, and the collected acceleration can reflect the shaking intensity of the photographing device. The greater the acceleration, the greater the shaking intensity of the photographing device. The angular velocity of the lens can also be collected by using a gyroscope in the photographing device, and the collected angular velocity can reflect the shaking intensity of the photographing device. The greater the angular velocity, the greater the shaking intensity of the photographing device. Under normal circumstances, the shooting equipment adopts OIS for shooting, but the compensation range of OIS anti-shake is limited. Generally, it can compensate the shaking of the angular velocity of the shooting equipment at 0-2°, and a better anti-shake effect can be obtained.

However, when the angular velocity of the photographing device exceeds 2°, the anti-shake effect obtained by using the OIS anti-shake is poor, and the captured image is relatively blurred. Therefore, when it is detected that the shaking intensity of the photographing device exceeds the preset range (the compensation range of OIS anti-shake), the shaking intensity of the photographing device is obtained, that is, the angular velocity of the lens of the photographing device is obtained through the gyroscope. Of course, there is also a situation where the photographing equipment does not move, but the photographed object moves relatively quickly, which is also applicable.

Step 240: Configure an exposure time for at least two cameras of the photographing device according to the shaking intensity of the photographing device, where the exposure time is less than the shaking duration of the photographing device.

When it is detected that the shaking intensity of the photographing device exceeds the preset range (the compensation range of OIS anti-shake), after obtaining the shaking intensity of the photographing device, configure the exposure time for at least two cameras of the photographing device according to the shaking intensity of the photographing device. In general, the shaking intensity of the photographing device includes the angular velocity of the lens of the photographing device obtained by the gyroscope. Of course, it can also be the movement information of the lens obtained without the gyroscope, such as the acceleration of the lens collected by the acceleration sensor. . When the shaking intensity of the photographing device includes the angular velocity of the lens of the photographing device obtained by the gyroscope, that is, the greater the angular velocity of the lens of the photographing device obtained by the gyroscope, the exposure time configured for at least two cameras of the photographing device is shorter. A short exposure time corresponds to a high-speed shutter. With a high-speed shutter, even if the shaking intensity of the shooting device exceeds the compensation range of OIS anti-shake, it can still capture a clear image. For example, when the angular velocity of the lens of the shooting device is 3°, the compensation range of OIS anti-shake is beyond the compensation range, so at least two cameras of the shooting device can be configured with a short exposure time (such as 1/ 100s, 1/500s, 1/1000s, etc.), of course, these short exposure times are set according to the angular velocity of the lens, which can be obtained after a lot of experiments and can take clear images.

The shaking duration refers to the duration of a single shaking of the photographing equipment. Generally, it is necessary to ensure that the single exposure time is less than the single shaking duration of the photographing equipment. For example, if the single shaking duration of the photographing equipment is 1/100s, Then, to ensure that the single exposure time is less than the single shaking duration of the shooting device, the single exposure time can be any value less than 1/100s, such as 1/500s, 1/1000s, etc.

Short exposure times are configured for at least two cameras of the photographing device according to the angular velocity of the lens of the photographing device, wherein the at least two cameras of the photographing device may be respectively configured with different short exposure times. However, these short exposure times require the single shaking duration of the shooting device, or a small range of fluctuations on the single shaking duration of the shooting device. That is, the same short exposure time may be configured for at least two cameras of the photographing device, or different exposure times may be configured. When the shooting device includes two cameras, two different exposure times can be configured respectively; when the shooting device includes three cameras, three different exposure times can be configured respectively, or two different exposure times can be configured respectively. Each camera is configured with the same exposure time, and the other camera is configured with different exposure times; when the shooting device contains more than four cameras, four different exposure times can be configured respectively, or any two of them can be configured with different exposure times. Or configure the same exposure time for three cameras and different exposure times for the other two or one camera.

Step 260, at least two original images are generated by at least two cameras of the photographing device using the correspondingly configured exposure time to photograph.

After the exposure times are configured for the at least two cameras of the photographing device, at least two cameras of the photographing device perform photography using the correspondingly configured exposure times to generate at least two original images. That is, one original image may be captured by each camera, or multiple original images may be captured by each camera.

Step 280, splicing and synthesizing at least two original images to obtain a target image.

The target image is obtained by splicing and synthesizing at least two original images captured by at least two cameras of the shooting device. The stitching synthesis process here is similar to the synthesis process of an HDR (High-Dynamic Range, high dynamic range image) image, and will not be repeated here. Compared to normal images, HDR images can provide more dynamic range and image detail.

In the image generation method in this embodiment, when the shaking intensity of the shooting device exceeds the preset range of OIS anti-shake, even if OIS anti-shake is adopted, it cannot achieve a good anti-shake effect. Therefore, the OIS anti-shake is discarded and the shooting device is obtained. According to the shaking intensity of the shooting device, configure the exposure time for at least two cameras of the shooting device. If the exposure time is less than the shaking time of the shooting device, a clear image of the shooting scene can be captured. Then, at least two cameras of the shooting device use the correspondingly configured exposure time to shoot to generate at least two original images, and the at least two original images are spliced and synthesized to obtain a target image. Combining multiple original images further improves the clarity of the image.

In one embodiment, as shown in FIG. 3 , in step 240, exposure times are configured for at least two cameras of the photographing equipment according to the shaking intensity of the photographing equipment, and the exposure time is less than the shaking duration of the photographing equipment, including:

Step 242, obtaining the angular velocity of the lens of the photographing device;

Step 244: Configure an exposure time for at least two cameras of the photographing device according to the angular velocity, where the exposure time is less than the shaking duration of the photographing device.

Specifically, when the shaking intensity of the photographing device includes the angular velocity of the lens of the photographing device obtained by the gyroscope, that is, the greater the angular velocity of the lens of the photographing device obtained by the gyroscope, the higher the angular velocity of the lens of the photographing device, the higher the angular velocity of the lens of the photographing device, the higher the angular velocity of the lens of the photographing device. the shorter the exposure time. A short exposure time corresponds to a high-speed shutter. With a high-speed shutter, even if the shaking intensity of the shooting device exceeds the compensation range of OIS anti-shake, it can still capture a clear image. For example, when the angular velocity of the lens of the shooting device is 3°, the compensation range of OIS anti-shake is beyond the compensation range, so at least two cameras of the shooting device can be configured with a short exposure time (such as 1/ 100s, 1/500s, 1/1000s, etc.), of course, these short exposure times are set according to the angular velocity of the lens, which can be obtained after a lot of experiments and can take clear images. Under normal circumstances, it is necessary to ensure that the single exposure time is less than the single shaking time of the shooting device.

In the embodiment of the present application, the shaking intensity of the photographing device is determined by the angular velocity of the lens detected by the gyroscope, and then the exposure time is configured for at least two cameras of the photographing device according to the angular velocity. The angular velocity of the lens detected by the gyroscope is generally more accurate, so the further determined exposure time will be more accurate, so that the sharpness of the original image generated by at least two cameras of the shooting device using the correspondingly configured exposure time to shoot higher.

In one embodiment, the photographing device includes a first camera and a second camera, and the aperture of the first camera is larger than the aperture of the second camera;

Step 240, configure exposure time for at least two cameras of the photographing device according to the angular velocity, where the exposure time is less than the shaking duration of the photographing device, including:

acquiring the first camera of the shooting device, and configuring a first exposure time for the first camera according to the angular velocity, where the first exposure time is less than the shaking duration of the shooting device;

The second camera of the photographing device is acquired, and a second exposure time is configured for the second camera according to the angular velocity, the second exposure time is less than the shaking duration of the photographing device, and the first exposure time is less than the second exposure time.

Specifically, the photographing device includes a first camera and a second camera, and the aperture of the first camera is larger than the aperture of the second camera. The number of the first cameras is at least one or more, and similarly, the number of the second cameras is also at least one or more. In the case of ensuring the amount of incoming light, when the aperture of the camera is large, the exposure time can be reduced a little, and when the aperture of the camera is small, the exposure time can be increased accordingly.

Therefore, the first camera of the photographing device is acquired, and the first exposure time is configured for the first camera according to the angular velocity, and the first exposure time is less than the shaking duration of the photographing device. The second camera of the photographing device is acquired, and a second exposure time is configured for the second camera according to the angular velocity, the second exposure time is less than the shaking duration of the photographing device, and the first exposure time is less than the second exposure time.

Of course, other parameters of the camera also need to be considered for comprehensive evaluation, such as sensitivity ISO. Sensitivity, also known as ISO value, is a measure of how sensitive a film is to light. For less sensitive film, a longer exposure time is required to achieve the same imaging as the more sensitive film, so it is often referred to as a slow film. Highly sensitive film is therefore called fast film. When other shooting parameters are the same, the high ISO camera module can slightly reduce the exposure time.

In the embodiment of the present application, different exposure times are correspondingly configured for different cameras according to different shooting parameters of the cameras, so that the maximum amount of incoming light can be obtained while ensuring that the exposure time is less than the shaking duration of the shooting device. The amount of incoming light can ensure the brightness of the image, thereby improving the clarity of the image.

In one embodiment, the preset range is the maximum adjustment range of the OIS anti-shake of the photographing device.

In the embodiment of the present application, specifically, the angular velocity of the lens is collected by the gyroscope in the photographing device, and the collected angular velocity can reflect the shaking intensity of the photographing device. The greater the angular velocity, the stronger the shaking of the photographing device. Under normal circumstances, the shooting equipment adopts OIS for shooting, but the compensation range of OIS anti-shake is limited. Generally, it can compensate the shaking of the angular velocity of the shooting equipment at 0-2°, and a better anti-shake effect can be obtained. Then the maximum adjustment range of the OIS image stabilization of the shooting device is 2°. Of course, this value can also be other reasonable values.

In one embodiment, at least two cameras of the photographing device use correspondingly configured exposure times to photograph to generate at least two original images, including:

At least four original images are generated by at least two shootings performed by at least two cameras of the shooting device using correspondingly configured exposure times.

Specifically, after the exposure times are configured for the at least two cameras of the photographing device, at least two cameras of the photographing device use the correspondingly configured exposure times to perform at least two shots to generate at least four original images. That is, at least two original images may be obtained by capturing at least two times by each camera. For example, the first camera performs two shots to obtain two original images, and the second camera performs three shots to obtain three original images. The first camera may use a correspondingly configured exposure time to shoot for the first time, and determine whether the clarity of the original image obtained by shooting meets a preset standard, and if so, shoot another original image at the exposure time. If it is judged that the sharpness of the original image obtained by the first shooting does not meet the preset standard, then slightly float around the exposure time, and re-shoot several times to obtain the original image until the sharpness obtained by shooting meets the preset standard. A standard original image or an image with a higher definition than the previously captured image is captured.

In this embodiment of the present application, at least two cameras of the photographing device perform at least two shots at a correspondingly configured exposure time to generate at least four original images, or make slight fluctuations on the left and right of the configured exposure time, and re-shoot multiple times. The original image is obtained until the original image whose sharpness meets the preset standard is obtained. The final obtained original image is an image whose definition meets a preset standard, thereby improving the clarity of an image obtained by subsequent image stitching and synthesis.

In one embodiment, the target image is obtained by splicing at least two original images, including:

Screen out the original images whose sharpness exceeds the preset threshold from at least two original images;

The target image is obtained by stitching and synthesizing the original images whose sharpness exceeds the preset threshold.

Specifically, after at least two original images are generated by the at least two cameras of the shooting device using the correspondingly configured exposure time to generate, an original image whose definition exceeds a preset threshold is screened out from the at least two original images, The target image is obtained by stitching and synthesizing the original images whose sharpness exceeds the preset threshold. For example, it is assumed that the photographing device has two cameras, and two original images are obtained by taking one photograph respectively through the two cameras. The original images whose sharpness exceeds the preset threshold are screened out from the two original images, and the target image is obtained by splicing and synthesizing the original images whose sharpness exceeds the preset threshold. If the sharpness of the two original images exceeds the preset threshold, the two original images are spliced and synthesized. If the sharpness of only one original image exceeds the preset threshold, the original image can be output directly As the target image, of course, a camera whose resolution does not meet the preset threshold can be used to reconfigure the exposure parameters for re-shooting, and then stitch and synthesize to obtain the target image.

For example, assuming that the photographing device has two cameras, four original images are obtained by shooting twice through the two cameras respectively. The original images whose sharpness exceeds the preset threshold are screened out from the four original images, and the original images whose sharpness exceeds the preset threshold are spliced and synthesized to obtain the target image. If the sharpness of the four original images exceeds the preset threshold, the four original images are spliced and synthesized. If the sharpness of only one original image exceeds the preset threshold, the original image can be output directly As the target image, of course, a camera whose resolution does not meet the preset threshold can be used to reconfigure the exposure parameters for re-shooting, and then stitch and synthesize to obtain the target image.

In the embodiment of the present application, all original images captured by the camera are screened to select original images whose definition exceeds a preset threshold, and then spliced and synthesized to obtain a target image. The original image of the synthesized target image can be screened, so as to prevent the original image with too low definition from affecting the definition of the final synthesized target image. And it is also possible to reconfigure the exposure parameters of the camera that does not meet the preset threshold for re-shooting, and then stitch and synthesize to obtain the target image. One is to avoid wasting camera resources, and the other is to increase the number of original images, which is conducive to improving the final synthesis. The clarity of the target image.

In one embodiment, an image generation method is also provided, the method further comprising: when the shaking intensity of the photographing device exceeds a preset range, performing OIS anti-shake compensation on the photographing device, and using the OIS anti-shake compensation parameter Adjust to the maximum adjustment range.

As shown in Figure 4, the steps of the image generation method include:

Step 420, when the shaking intensity of the photographing device exceeds the preset range, perform OIS anti-shake compensation on the photographing device, and adjust the OIS anti-shake compensation parameter to the maximum adjustment range.

Step 440: Obtain the shaking intensity of the photographing device, and configure exposure times for at least two cameras of the photographing device according to the shaking intensity of the photographing device, where the exposure time is less than the shaking duration of the photographing device.

Specifically, the angular velocity of the lens is collected by the gyroscope in the photographing device, and the collected angular velocity can reflect the shaking intensity of the photographing device. The greater the angular velocity, the stronger the shaking of the photographing device. Under normal circumstances, the shooting equipment adopts OIS for shooting, but the compensation range of OIS anti-shake is limited. Generally, it can compensate the shaking of the angular velocity of the shooting equipment at 0-2°, and a better anti-shake effect can be obtained. However, when the angular velocity of the photographing device exceeds 2°, the anti-shake effect obtained by using the OIS anti-shake is poor, and the captured image is relatively blurred. Therefore, when it is detected that the shaking intensity of the shooting device exceeds the preset range (the maximum compensation range of OIS anti-shake), firstly adjust the OIS anti-shake of the shooting device to the preset range, that is, the maximum compensation range of OIS anti-shake, and then obtain The shaking intensity of the photographing device, and the exposure time is configured for at least two cameras of the photographing device according to the shaking intensity of the photographing device. Of course, it is also possible to adjust the OIS image stabilization to the shooting device to be close to the maximum compensation range of OIS image stabilization. Wherein, the exposure time is less than the shaking time of the photographing device. And because the use of OIS anti-shake to compensate for part of the shaking of the shooting equipment, it is equivalent to reducing the shaking intensity of the shooting equipment, so the configured exposure time can be slightly longer, and a longer exposure time can ensure a certain amount of light. Thereby improving the clarity of the image.

In step 460, at least two cameras of the photographing device perform photographing at a correspondingly configured exposure time to generate at least two original images.

After the exposure times are configured for the at least two cameras of the photographing device, at least two cameras of the photographing device perform photography using the correspondingly configured exposure times to generate at least two original images. That is, one original image may be captured by each camera, or multiple original images may be captured by each camera.

Step 480, splicing and synthesizing at least two original images to obtain a target image.

The target image is obtained by splicing and synthesizing at least two original images captured by at least two cameras of the shooting device. The stitching synthesis process here is similar to the synthesis process of an HDR (High-Dynamic Range, high dynamic range image) image, and will not be repeated here. Compared to normal images, HDR images can provide more dynamic range and image detail.

In the image generation method in this embodiment, when the shaking intensity of the photographing device exceeds the preset range of OIS anti-shake, the photographing device is first adjusted to the maximum compensation range of OIS anti-shake by adopting OIS anti-shake, and then according to the The shaking intensity configures the exposure time for at least two cameras of the photographing device, and the exposure time is less than the shaking duration of the photographing device. Because the use of OIS anti-shake compensation for the shooting equipment compensates part of the shaking, it is equivalent to reducing the shaking intensity of the shooting equipment, so the configured exposure time can be slightly longer, and the longer exposure time can ensure a certain amount of light, so Improve the clarity of the image. Then, at least two cameras of the shooting device use the correspondingly configured exposure time to shoot to generate at least two original images, and the at least two original images are spliced and synthesized to obtain a target image. Combining multiple original images further improves the clarity of the image.

In a specific embodiment, the electronic device includes one first camera 310 and two second cameras as an example for description, as shown in FIG. 5 ,

Step 502, acquiring the angular velocity of the lens that is captured by the gyroscope in the photographing device;

Step 504, judge whether the angular velocity of the lens collected by the gyroscope exceeds the maximum compensation range of OIS anti-shake;

Step 506 , if no, use OIS for compensation, and then shoot.

Step 508, if yes, obtain the shaking intensity of the photographing device, and the greater the angular velocity, the greater the shaking intensity of the photographing device;

Step 510, according to the shaking intensity of the photographing equipment, configure three different exposure times for the three cameras of the photographing equipment respectively, and the exposure times are less than the single shaking duration of the photographing equipment;

Step 512, three original images are generated by the three cameras of the shooting device using the correspondingly configured exposure time to shoot;

Step 514, screening out the original images whose clarity exceeds the preset threshold from the three original images;

Step 516, splicing and synthesizing the original images whose definition exceeds the preset threshold to obtain the target image.

In the embodiment of the present application, the shaking intensity of the photographing device is determined by the angular velocity of the lens detected by the gyroscope, and then the exposure time is configured for at least two cameras of the photographing device according to the angular velocity. The three cameras of the shooting device use the correspondingly configured exposure time to shoot to generate three original images, filter all the original images captured by the cameras to select the original images whose clarity exceeds the preset threshold, and then perform stitching and synthesis to obtain the target image. . The original image of the synthesized target image can be screened, so as to prevent the original image with too low definition from affecting the definition of the final synthesized target image. Thus, the sharpness of the target image is improved.

It should be understood that although the steps in the flowcharts of FIG. 2 and FIG. 5 are displayed in sequence according to the arrows, these steps are not necessarily executed in the sequence indicated by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited to the order, and these steps may be performed in other orders. Moreover, at least a part of the steps in FIG. 2 and FIG. 5 may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but may be executed at different times. These sub-steps or The order of execution of the stages is also not necessarily sequential, but may be performed alternately or alternately with other steps or sub-steps of other steps or at least a portion of a stage.

In one embodiment, as shown in FIG. 6, an image generating apparatus 600 is provided, including:

The shaking intensity acquisition module 620 of the photographing device is configured to obtain the shaking intensity of the photographing device when the shaking intensity of the photographing device exceeds a preset range;

an exposure time configuration module 640, configured to configure exposure times for at least two cameras of the photographing equipment according to the shaking intensity of the photographing equipment, where the exposure time is less than the shaking duration of the photographing equipment;

an original image generation module 660, configured to generate at least two original images by using at least two cameras of the photographing device to take pictures with correspondingly configured exposure times;

The splicing and synthesizing module 680 is used for splicing and synthesizing at least two original images to obtain a target image.

In one embodiment, the exposure time configuration module 640 is further configured to acquire the angular velocity of the lens of the photographing device; configure the exposure time for at least two cameras of the photographing device according to the angular velocity, and the exposure time is less than the shaking duration of the photographing device.

In one embodiment, the shooting device includes a first camera and a second camera, and the aperture of the first camera is larger than the aperture of the second camera; the exposure time configuration module 640 is further configured to acquire the first camera of the shooting device, according to the angular velocity A camera is configured with a first exposure time, and the first exposure time is shorter than the shaking duration of the photographing device; the second camera of the photographing device is acquired, and a second exposure time is configured for the second camera according to the angular velocity, and the second exposure time is shorter than the shaking duration of the photographing device, And the first exposure time is shorter than the second exposure time.

In one embodiment, the preset range is the maximum adjustment range of the OIS anti-shake of the photographing device.

In one embodiment, the original image generating module 660 is further configured to generate at least four original images by at least two cameras of the shooting device using correspondingly configured exposure times to perform at least two shots.

In one embodiment, the splicing and synthesizing module 680 is configured to filter out the original images whose definition exceeds a preset threshold from at least two original images;

In one embodiment, as shown in FIG. 7 , an image generating apparatus 600 is provided, which further includes an OIS anti-shake module 610 for performing OIS on the photographing device when the shaking intensity of the photographing device exceeds a preset range. Anti-shake compensation, adjust the OIS anti-shake compensation parameters to the maximum adjustment range.

The division of each module in the above image generation apparatus is only for illustration. In other embodiments, the image generation apparatus may be divided into different modules as required to complete all or part of the functions of the above image generation apparatus.

FIG. 8 is a schematic diagram of the internal structure of an electronic device in one embodiment. As shown in FIG. 8, the electronic device includes a processor and a memory connected by a system bus. Among them, the processor is used to provide computing and control capabilities to support the operation of the entire electronic device. The memory may include non-volatile storage media and internal memory. The nonvolatile storage medium stores an operating system and a computer program. The computer program can be executed by the processor to implement an image generation method provided by the following embodiments. Internal memory provides a cached execution environment for operating system computer programs in non-volatile storage media. The electronic device may be a mobile phone, a tablet computer, a personal digital assistant or a wearable device, and the like.

The implementation of each module in the image generating apparatus provided in the embodiments of the present application may be in the form of a computer program. The computer program can be run on a terminal or server. The program modules constituted by the computer program can be stored in the memory of the terminal or the server. When the computer program is executed by the processor, the steps of the methods described in the embodiments of the present application are implemented.

The embodiments of the present application also provide an electronic device. The above electronic device includes an image processing circuit, and the image processing circuit may be implemented by hardware and/or software components, and may include various processing units that define an ISP (Image Signal Processing, image signal processing) pipeline. FIG. 9 is a schematic diagram of an image processing circuit in one embodiment. As shown in FIG. 9 , for the convenience of description, only various aspects of the image processing technology related to the embodiments of the present application are shown.

As shown in FIG. 9 , the image processing circuit includes a first ISP processor 930 , a second ISP processor 940 and a control logic 950 . The first camera 910 includes one or more first lenses 912 and a first image sensor 914 . The first image sensor 914 may include a color filter array (eg, a Bayer filter), the first image sensor 914 may acquire light intensity and wavelength information captured with each imaging pixel of the first image sensor 914, and provide information that can be accessed by the first ISP A set of image data processed by processor 930. The second camera 920 includes one or more second lenses 922 and a second image sensor 924 . The second image sensor 924 may include a color filter array (eg, a Bayer filter), the second image sensor 924 may acquire light intensity and wavelength information captured with each imaging pixel of the second image sensor 924, and provide information that can be accessed by the second ISP A set of image data processed by processor 940.

The first image captured by the first camera 910 is transmitted to the first ISP processor 930 for processing. After the first ISP processor 930 processes the first image, the statistical data of the first image (such as image brightness, image contrast value , image color, etc.) to the control logic 950, and the control logic 950 can determine the control parameters of the first camera 910 according to the statistical data, so that the first camera 910 can perform auto-focus, auto-exposure and other operations according to the control parameters. After being processed by the first ISP processor 930, the first image can be stored in the image memory 960, and the first ISP processor 930 can also read the image stored in the image memory 960 for processing. In addition, after being processed by the ISP processor 930, the first image can be directly sent to the display 970 for display, and the display 970 can also read the image in the image memory 960 for display.

Among them, the first ISP processor 930 processes the image data pixel by pixel in various formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and the first ISP processor 930 may perform one or more image processing operations on the image data, collecting statistical information about the image data. Among them, the image processing operations can be performed with the same or different bit depth precision.

The image memory 960 may be a part of a memory device, a storage device, or an independent dedicated memory in an electronic device, and may include a DMA (Direct Memory Access, direct memory access) feature.

Upon receiving the interface from the first image sensor 914, the first ISP processor 930 may perform one or more image processing operations, such as temporal filtering. The processed image data may be sent to image memory 960 for additional processing before being displayed. The first ISP processor 930 receives processing data from the image memory 960, and performs image data processing in RGB and YCbCr color spaces on the processing data. The image data processed by the first ISP processor 930 may be output to the display 970 for viewing by the user and/or further processed by a graphics engine or a GPU (Graphics Processing Unit, graphics processor). In addition, the output of the first ISP processor 930 may also be sent to the image memory 960 , and the display 970 may read image data from the image memory 960 . In one embodiment, image memory 960 may be configured to implement one or more frame buffers.

Statistics determined by the first ISP processor 930 may be sent to the control logic 950 . For example, the statistics may include first image sensor 914 statistics such as auto exposure, auto white balance, auto focus, flicker detection, black level compensation, first lens 912 shading correction, and the like. The control logic 950 may include a processor and/or a microcontroller executing one or more routines (eg, firmware) that may determine the control parameters and the first camera 910 based on the received statistical data. A control parameter of the ISP processor 930. For example, the control parameters of the first camera 910 may include gain, integration time for exposure control, anti-shake parameters, flash control parameters, first lens 912 control parameters (eg, focal length for focusing or zooming), or a combination of these parameters. ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (eg, during RGB processing), and first lens 912 shading correction parameters.

Similarly, the second image captured by the second camera 920 is transmitted to the second ISP processor 940 for processing. After the second ISP processor 940 processes the first image, the statistical data of the second image (such as the brightness of the image, the The contrast value, the color of the image, etc.) are sent to the control logic 950, and the control logic 950 can determine the control parameters of the second camera 920 according to the statistical data, so that the second camera 920 can perform auto-focus, auto-exposure and other operations according to the control parameters . After being processed by the second ISP processor 940, the second image can be stored in the image memory 960, and the second ISP processor 940 can also read the image stored in the image memory 960 for processing. In addition, after being processed by the ISP processor 940, the second image can be directly sent to the display 970 for display, and the display 970 can also read the image in the image memory 960 for display. The second camera 920 and the second ISP processor 940 can also implement the processing as described for the first camera 910 and the first ISP processor 930 .

The image processing circuit provided according to the embodiment of the present application can implement the above-mentioned image generation method. Wherein, the electronic device may have multiple cameras, the cameras include lenses and image sensors corresponding to the lenses, and the image sensors in the multiple cameras are arranged in a rectangular diagonal manner. The process of implementing the image generation method by the electronic device is the same as that in the above-mentioned embodiment, which will not be repeated here.

The embodiment of the present application also provides a computer-readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions, when executed by one or more processors, cause the processors to perform the steps of the image generation method.

A computer program product containing instructions, when run on a computer, causes the computer to perform an image generation method.

Any reference to a memory, storage, database, or other medium as used in embodiments of the present application may include non-volatile and/or volatile memory. Suitable nonvolatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in various forms such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), Memory Bus (Rambus) Direct RAM (RDRAM), Direct Memory Bus Dynamic RAM (DRDRAM), and Memory Bus Dynamic RAM (RDRAM).

The above examples only represent several embodiments of the present application, and the descriptions thereof are relatively specific and detailed, but should not be construed as a limitation on the scope of the patent of the present application. It should be pointed out that for those skilled in the art, without departing from the concept of the present application, several modifications and improvements can be made, which all belong to the protection scope of the present application. Therefore, the scope of protection of the patent of the present application shall be subject to the appended claims.

Claims (10)

1. an image generation method, is characterized in that, comprises: When the shaking intensity of the photographing device exceeds the preset range, obtain the shaking intensity of the photographing device; Configure an exposure time for at least two cameras of the photographing device according to the shaking intensity of the photographing device, where the exposure time is less than the shaking duration of the photographing device; At least two original images are generated by at least two cameras of the shooting device using the correspondingly configured exposure time to shoot; The target image is obtained by splicing and synthesizing the at least two original images. 2 . The method according to claim 1 , wherein the exposure time is configured for at least two cameras of the photographing device according to the shaking intensity of the photographing device, and the exposure time is less than the shaking of the photographing device. 3 . duration, including: obtaining the angular velocity of the lens of the photographing device; Exposure time is configured for at least two cameras of the photographing device according to the angular velocity, where the exposure time is less than the shaking duration of the photographing device. 3. The method according to claim 2, wherein the photographing device comprises a first camera and a second camera, and the aperture of the first camera is larger than the aperture of the second camera; The configuring exposure time for at least two cameras of the photographing device according to the angular velocity, where the exposure time is less than the shaking duration of the photographing device, includes: acquiring a first camera of the photographing device, and configuring a first exposure time for the first camera according to the angular velocity, where the first exposure time is less than the shaking duration of the photographing device; Obtain the second camera of the shooting device, and configure a second exposure time for the second camera according to the angular velocity, the second exposure time is less than the shaking duration of the shooting device, and the first exposure time is less than the the second exposure time. 4 . The method according to claim 1 , wherein the preset range is the maximum adjustment range of the optical image stabilization OIS of the photographing device. 5 . 5. The method according to claim 1, wherein the generating at least two original images by shooting at least two cameras of the shooting device using a correspondingly configured exposure time, comprising: At least four original images are generated by at least two shootings performed by at least two cameras of the shooting device using correspondingly configured exposure times. 6. The method according to claim 1, wherein the obtaining a target image by splicing and synthesizing the at least two original images comprises: Screening out an original image whose definition exceeds a preset threshold from the at least two original images; The target image is obtained by splicing and synthesizing the original images whose definition exceeds the preset threshold. 7. The method according to claim 4, wherein the method further comprises: When the shaking intensity of the photographing device exceeds the preset range, OIS anti-shake compensation is performed on the photographing device, and the OIS anti-shake compensation parameter is adjusted to the maximum adjustment range. 8. An image generation device, characterized in that, comprising: a shaking intensity acquisition module of the photographing device, configured to acquire the shaking intensity of the photographing device when the shaking intensity of the photographing device exceeds a preset range; an exposure time configuration module, configured to configure an exposure time for at least two cameras of the photographing device according to the shaking intensity of the photographing device, where the exposure time is less than the shaking duration of the photographing device; an original image generation module, configured to generate at least two original images by shooting at least two cameras of the shooting device using correspondingly configured exposure times; The splicing and synthesizing module is used for splicing and synthesizing the at least two original images to obtain a target image. 9. An electronic device comprising a memory and a processor, wherein a computer program is stored in the memory, characterized in that, when the computer program is executed by the processor, the processor is made to execute the process as claimed in claims 1 to 7 The steps of any one of the image generation methods. 10. A computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.