CN110191274A - Imaging method, imaging device, storage medium and electronic equipment - Google Patents

Abstract

The application discloses imaging method is applied to electronic equipment, and this electronic equipment includes colored camera module, black and white camera module and a plurality of long burnt camera module, and there is the overlapping in the shooting region of each long burnt camera module and the shooting region of target camera module, and this target camera module is this colored camera module or this black and white camera module, and this imaging method includes: receiving an image shooting request of an object to be shot; shooting the object to be shot through the target shooting module according to the image shooting request, or shooting the object to be shot through the color shooting module and the black-and-white shooting module to obtain a base image; shooting the object to be shot through the plurality of long-focus camera modules to obtain a plurality of target images; image synthesis processing is performed on the base image and the plurality of target images, and the image obtained by synthesis is used to respond to the image capturing request. The image quality of the image can be improved.

Description

Imaging method, apparatus, storage medium and electronic device

technical field

The present application belongs to the field of image technology, and in particular, relates to an imaging method, an apparatus, a storage medium and an electronic device.

Background technique

At present, users usually use electronic devices with camera modules to capture images, and through these electronic devices, they can record what happens around them, what they see, and the like, anytime, anywhere. However, due to the hardware defects of the camera module itself, the image captured by the camera module is often clear in the middle area, while the edge area is relatively blurred, resulting in poor imaging quality of the entire image.

SUMMARY OF THE INVENTION

Embodiments of the present application provide an imaging method, an apparatus, a storage medium, and an electronic device, which can improve the imaging quality of an image.

The embodiment of the present application provides an imaging method, which is applied to an electronic device. The electronic device includes a color camera module, a black-and-white camera module, and a plurality of telephoto camera modules. The shooting area of each telephoto camera module is related to the target camera. The shooting areas of the modules overlap, and the target camera module is the color camera module or the black-and-white camera module, and the imaging method includes:

Receive an image capture request of the subject to be photographed;

According to the image shooting request, the object to be shot is shot by the target camera module, or the object to be shot is shot by the color camera module and the black and white camera module to obtain a base image ;

The object to be photographed is photographed by the plurality of telephoto camera modules to obtain a plurality of target images;

Perform image synthesis processing on the base image and the plurality of target images, and use the synthesized images to respond to the image capture request.

The embodiment of the present application provides an imaging device, which is applied to electronic equipment. The electronic equipment includes a color camera module, a black-and-white camera module, and a plurality of telephoto camera modules. The shooting area of each telephoto camera module is related to the target camera. The shooting areas of the modules overlap, and the target camera module is the color camera module or the black-and-white camera module, and the imaging device includes:

a receiving module, configured to receive an image shooting request of the object to be shot;

a first photographing module, configured to photograph the object to be photographed through the target camera module according to the image photographing request, or to photograph the object to be photographed through the color camera module and the black and white camera module The object is photographed to obtain a base image;

a second shooting module, configured to shoot the object to be shot through the multiple telephoto camera modules to obtain multiple target images;

A response module, configured to perform image synthesis processing on the base image and the multiple target images, and use the synthesized images to respond to the image capture request.

Embodiments of the present application provide a storage medium on which a computer program is stored, and when the computer program is executed on a computer, causes the computer to execute the procedures in the imaging method provided by the embodiments of the present application.

Embodiments of the present application further provide an electronic device, including a memory and a processor, where the processor is configured to execute the procedures in the imaging method provided by the embodiments of the present application by invoking a computer program stored in the memory.

In the imaging method, device, storage medium, and electronic device provided by the embodiments of the present application, the electronic device can use the target camera module to shoot the object to be photographed, or use the color camera module and the black-and-white camera module to shoot the object to be photographed to obtain a substrate image. In addition, the electronic device can capture the object to be photographed through a plurality of telephoto camera modules to obtain a plurality of target images. Afterwards, the electronic device may perform image synthesis processing on the base image and the multiple target images, and use the synthesized images to respond to the image capture request. That is, in this embodiment, since the final synthesized image is synthesized by a base image and a plurality of target images, and the base image is formed by the target camera module or the color camera module and the black-and-white camera module (one of which is the target camera module) module), a plurality of target images are captured by a plurality of telephoto camera modules, and the shooting area of each telephoto camera module overlaps with the shooting area of the target camera module, so the resulting composite Both the center area and the edge area of the image are sharper, thereby improving the overall imaging quality of the image.

Description of drawings

The technical solutions of the present application and the beneficial effects thereof will be apparent through the detailed description of the specific embodiments of the present application in conjunction with the accompanying drawings.

FIG. 1 is a schematic flowchart of an imaging method provided by an embodiment of the present application.

FIG. 2 is a first schematic diagram of a color camera module, a black-and-white camera module, and a plurality of telephoto camera modules provided by an embodiment of the present application.

FIG. 3 is a schematic diagram of a shooting area of a target camera module and a plurality of telephoto camera modules provided by an embodiment of the present application.

4 is a second schematic diagram of a color camera module, a black-and-white camera module, and a plurality of telephoto camera modules provided by an embodiment of the present application.

5 is a third schematic diagram of a color camera module, a black-and-white camera module, and a plurality of telephoto camera modules provided by an embodiment of the present application.

FIG. 6 is a schematic diagram of a scene in which an electronic device according to an embodiment of the present application receives an image capture request.

FIG. 7 is a schematic diagram of a relative positional relationship between a base image and multiple target images provided by an embodiment of the present application.

FIG. 8 is a schematic diagram of a composite image provided by an embodiment of the present application.

FIG. 9 is another schematic flowchart of the imaging method provided by the embodiment of the present application.

FIG. 10 is a schematic structural diagram of an image sensor shared by a target camera module and a telephoto camera module according to an embodiment of the present application.

FIG. 11 is a schematic structural diagram of an imaging device provided by an embodiment of the present application.

FIG. 12 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

FIG. 13 is another schematic structural diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

Please refer to the drawings, wherein the same component symbols represent the same components, and the principles of the present application are exemplified by being implemented in a suitable computing environment. The following description is based on illustrated specific embodiments of the present application and should not be construed as limiting other specific embodiments of the present application not detailed herein.

It can be understood that, the executive body of the embodiment of the present application may be an electronic device such as a smart phone or a tablet computer.

Please refer to FIG. 1. FIG. 1 is a schematic flowchart of an imaging method provided by an embodiment of the present application. The imaging method can be applied to electronic equipment. The electronic equipment can include a color camera module, a black-and-white camera module, and a plurality of telephoto camera modules. The shooting area of each telephoto camera module and the shooting area of the target camera module exist. Overlapping, the target camera module can be a color camera module or a black and white camera module.

Take an electronic device with 4 telephoto camera modules as an example. In the embodiment of the present application, the electronic device includes a color camera module, a black-and-white camera module, and four telephoto camera modules. Wherein, the shooting area of each telephoto camera module overlaps with the shooting area of the target camera module. The target camera module can be a color camera module or a black and white camera module.

Please refer to Figure 2 and Figure 3, the target camera module can be a standard type of camera module, or a camera module with a field of view angle of about 45 degrees, and the field of view of the telephoto camera module can be within 40 degrees. The electronic device includes four telephoto camera modules, which are respectively a telephoto camera module A, a telephoto camera module B, a telephoto camera module C, and a telephoto camera module D. The axis of each telephoto camera module is inclined and intersected towards the axis of the target camera module, so that the shooting area a of the telephoto camera module A corresponds to the upper left corner of the shooting area of the target camera module, and the shooting area of the telephoto camera module B is The area b corresponds to the upper right corner of the shooting area of the target camera module, the shooting area c of the telephoto camera module C corresponds to the lower left corner of the shooting area of the target camera module, and the shooting area d of the telephoto camera module D corresponds to the target camera module. The lower right corner of the group's shooting area. Thus, the shooting area of the telephoto camera module overlaps with the edge portion of the shooting area of the target camera module, and the overlapping shooting area between any two telephoto camera modules (that is, the shooting area of the two telephoto camera modules) The overlapping area between ) overlaps with the middle part of the shooting area of the target camera module.

Please refer to FIG. 4 , when the target camera module is the color camera module 10 , the shooting area of each telephoto camera module overlaps with the shooting area of the color camera module 10 . For example, the shooting area of the color camera module 10 may include the shooting area of the telephoto camera module, the shooting area of the telephoto camera module overlaps with the edge portion of the shooting area of the color camera module 10, and any two telephoto cameras The overlapping shooting area between the modules overlaps with the middle part of the shooting area of the color camera module 10 .

Please refer to FIG. 5 , when the target camera module is the black and white camera module 20 , the shooting area of each telephoto camera module and the shooting area of the black and white camera module 20 overlap. For example, the shooting area of the black and white camera module 20 may include the shooting area of the telephoto camera module, the shooting area of the telephoto camera module overlaps with the edge of the shooting area of the black and white camera module 20, and any two telephoto cameras The overlapping shooting area between the modules overlaps with the middle part of the shooting area of the black and white camera module 20 .

The flow of the imaging method may include:

101. Receive an image shooting request of the object to be shot.

At present, users usually use electronic devices with camera modules to capture images, and through these electronic devices, they can record what happens around them, what they see, and the like, anytime, anywhere. However, due to the hardware defects of the camera module itself, the image captured by the camera module is often clear in the middle area, while the edge area is relatively blurred, resulting in poor imaging quality of the entire image.

In this embodiment of the present application, for example, the electronic device may first receive an image capture request of the object to be captured.

For example, the image capture request may be directly input by the user to instruct the electronic device to capture the subject to be captured. The object to be shot, that is, the object that the camera module is aimed at when the electronic device receives the input image shooting request, includes but is not limited to people, objects, and scenes.

For example, after the user operates the electronic device to start a shooting application (such as the system application "camera" of the electronic device), and moves the electronic device to make the camera module of the electronic device aim at the object to be shot, he can click the "camera" interface The "photograph" button (which can be a virtual button) provided on the above is used to input an image capture request to the electronic device, as shown in FIG. 6 .

For another example, after a user operates an electronic device to start a shooting application, and moves the electronic device so that the camera module of the electronic device is aimed at the object to be photographed, the user can issue a voice command to the electronic device to “take a picture”, thereby sending the electronic device to the electronic device. Enter an image capture request. In addition, the electronic device may also send an image capturing request to the electronic device in the form of an instruction such as a gesture, which is not limited in this embodiment.

102. According to the image shooting request, use the target camera module to shoot the object to be shot, or use the color camera module and the black-and-white camera module to shoot the object to be shot, to obtain a base image.

For example, after receiving an image capture request of the object to be captured, the electronic device can capture the object to be captured through the target camera module, or capture the object to be captured through the color camera module and the black-and-white camera module, thereby Get the base image.

That is, after receiving the image capturing request of the object to be captured, the electronic device can capture the object to be captured through only one camera module, the target camera module, so as to obtain the base image. Or, after receiving the image capturing request of the object to be photographed, the electronic device can use the two camera modules (one of which is the target camera module), the color camera module and the black-and-white camera module, to perform the image capture of the object to be shot. photographed to obtain a base image.

103. Shoot the object to be photographed through multiple telephoto camera modules to obtain multiple target images.

For example, after receiving an image capturing request of the object to be photographed, the electronic device may capture the object to be photographed through multiple telephoto camera modules, thereby obtaining multiple images, that is, multiple target images.

It should be noted that when multiple telephoto camera modules are used to shoot the object to be photographed, the telephoto camera module and the target camera module (or color camera module and black and white camera module) use the same parameters (such as contrast ratio). , brightness, exposure time, etc.) to shoot. Therefore, the shooting area of the telephoto camera module is a part of the shooting area of the target camera module (or the color camera module and the black-and-white camera module), and the image effects obtained by the two are the same.

For example, the electronic device includes four telephoto camera modules, namely telephoto camera module A, telephoto camera module B, telephoto camera module C, and telephoto camera module D, and these four telephoto camera modules The shooting area of the module corresponds to the upper left corner, the upper right corner, the lower left corner and the lower right corner of the shooting area of the target camera module. Four images will be captured through these four telephoto camera modules, as shown in Figure 7. The image content of the image P1 captured by the telephoto camera module A corresponds to the image content in the upper left corner of the base image, the image content of the image P2 captured by the telephoto camera module B corresponds to the image content in the upper right corner of the base image, and the telephoto camera module C captures the image content in the upper right corner of the base image. The image content of the image P3 corresponds to the image content of the lower left corner of the base image, and the image content of the image P4 captured by the telephoto camera module D corresponds to the image content of the lower right corner of the base image. In this way, the image contents captured by different telephoto camera modules cover different positions of the edge region in the base image.

It should be noted that the order of execution of 102 and 103 is not specifically limited in this embodiment of the present application. It may be that 103 is executed after the execution of 102 is completed, 102 may be executed after the execution of 103 is completed, or 102 and 103 may be executed simultaneously. ,and many more.

104. Perform image synthesis processing on the base image and the multiple target images, and use the synthesized images to respond to the image capturing request.

For example, after capturing the base image and multiple target images, the electronic device may perform image synthesis processing on the base image and the multiple target images to obtain corresponding synthesized images, and use the synthesized images to respond to the image capturing request. For example, the synthesized image is determined as the imaging image corresponding to the image capturing request.

For example, after photographing the base image and the multiple target images, the electronic device may align the multiple target images obtained by photographing with the base image. Based on the aligned base image and the target image, for the overlapping portion of the base image and the target image, the electronic device can calculate the average pixel value of each overlapping pixel point. For example, in addition to the base image captured by the target camera module, the electronic device also captures four target images through the four telephoto camera modules. Please refer to FIG. 8, the overlapping area where each target image and the base image overlap at the same time is located in the middle area of the base image, so, for the overlapping area shown in FIG. The pixel values in the target image) are 108, 109, 110, 112, and 111, respectively, and the electronic device can calculate and obtain the average pixel value of the pixel points at this position as 110.

Afterwards, the electronic device can obtain a composite image according to the average pixel value obtained from the corresponding pixel points in each position in the base image. For example, the electronic device may adjust the pixel value of each pixel of the base image to the calculated average pixel value, thereby obtaining a composite image. For example, for the pixel point at position W, the electronic device can adjust its pixel value from 108 to 110. The composite image is obtained by adjusting the pixel values of the pixels in the base image.

For another example, the electronic device can also regenerate a new image, that is, a composite image, according to the average pixel value of each position obtained by calculation.

In the embodiment of the present application, after the electronic device performs image synthesis processing on a plurality of target images and base images obtained by shooting, the composite image is set as the imaging image of the image capturing request. So far, the electronic device has completed a complete shooting operation corresponding to the received image shooting request.

Please continue to refer to FIG. 8, which shows the change in sharpness from the base image to the synthesized image, where the X axis represents the position change from the image edge area to the center area, and then from the center area to the edge area, Y The axis represents the sharpness of the image. It can be seen from the figure that in the base image, the central area has the highest definition, and as the central area spreads to the edge area, the sharpness gradually decreases, and the change is more severe. In the composite image, the central area has the highest definition, and compared with the base image, the definition of the edge area of the composite image is improved as a whole. As the center area spreads to the edge area, although the definition gradually decreases, the change Smoother, that is, the center area and edge area of the composite image are sharper, so that the overall image quality of the composite image is improved.

Please refer to FIG. 9 , which is another schematic flowchart of the imaging method provided by an embodiment of the present application. The imaging method can be applied to electronic equipment. The electronic equipment can include a color camera module, a black-and-white camera module, and a plurality of telephoto camera modules. The shooting area of each telephoto camera module and the shooting area of the target camera module exist. Overlapping, the target camera module can be a color camera module or a black and white camera module. The flow of the imaging method may include:

201. The electronic device receives an image capturing request of the object to be captured.

For example, the user opens the camera application and points the camera at the object to be photographed in the shooting scene, and then the user clicks the camera button provided on the preview interface of the camera application. At this time, the electronic device can receive the image of the object to be photographed. ask.

202. The electronic device acquires an ambient light intensity value.

203. The electronic device detects whether the ambient light intensity value is less than a preset first threshold.

For example, 202 and 203 could include:

After receiving the image capturing request, the electronic device may acquire the current ambient light intensity value, and detect whether the current ambient light intensity value is smaller than the preset first threshold value. Wherein, when the ambient light intensity value is less than the preset first threshold, it may be considered that the current environment is a dark light environment, such as a night scene. When the ambient light intensity value is greater than or equal to the preset first threshold, it may be considered that the current environment is a bright light environment.

If it is detected that the current ambient light intensity value is less than the preset first threshold, go to 204 .

If it is detected that the current ambient light intensity value is greater than or equal to the preset first threshold, go to 205 .

204. If it is detected that the ambient light intensity value is less than the preset first threshold, the electronic device uses the color camera module and the black-and-white camera module to shoot the object to be photographed to obtain a base image.

For example, after acquiring the current ambient light intensity value, the electronic device detects that the ambient light intensity value is smaller than the preset first threshold, and may consider the current environment to be a dark light environment, such as a night scene. In this case, the electronic device can shoot the object to be photographed through its color camera module and black and white camera module to obtain a base image.

For example, in one embodiment, the electronic device captures the object to be photographed through a color camera module and a black-and-white camera module to obtain a base image, which may include:

The electronic device shoots the subject to be photographed through the color camera module to obtain a first image, and uses the black and white camera module to shoot the subject to be photographed to obtain a second image;

The electronic device synthesizes the first image and the second image to obtain a base image.

For example, the electronic device can shoot the subject to be photographed once through its color camera module to obtain a first image (such as a color image), and at the same time, the electronic device can shoot the subject to be photographed once through its black-and-white camera module to obtain the second image. (such as black and white images). After obtaining the first image and the second image, the electronic device may perform a synthesis process on the first image and the second image, thereby obtaining a base image.

It should be noted that, when the base image is obtained by using the color camera module and the black-and-white camera module, the color camera module can capture the entire color picture, and the black-and-white camera module can record the rest of the picture information. When imaging, the first image and the second image are superimposed. Because the black and white camera module has a higher amount of light, it can capture more information, so the synthesized photos are more effective than ordinary cameras in terms of details and picture color. Be good. Since the second image captured by the black and white camera module can better retain the details of the image, and the transition of similar colors will be more obvious and natural, the base image obtained by using the color camera module and the black and white camera module has an overall sense of hierarchy. The image is better, and the image is clearer, especially the night shot has a good imaging effect. That is, the imaging effect of the base image obtained by the electronic device synthesizing the first image and the second image is better.

205. If it is detected that the ambient light intensity value is greater than or equal to the preset first threshold, the electronic device acquires a value of a preset parameter, where the value of the preset parameter is used to represent the current computing capability of the electronic device.

206. If it is detected that the value of the preset parameter is smaller than the preset second threshold, the electronic device uses the target camera module to photograph the object to be photographed to obtain a base image.

For example, 205 and 206 could include:

After acquiring the current ambient light intensity value, the electronic device detects that the ambient light intensity value is greater than or equal to the preset first threshold value, and may consider the current environment to be a bright environment. In this case, the electronic device may further acquire the value of the preset parameter, where the value of the preset parameter may be used to represent the current computing capability of the electronic device. For example, when the value of the preset parameter is less than the preset second threshold, it can be considered that the current computing capability of the electronic device is relatively weak, and when the value of the preset parameter is greater than or equal to the preset second threshold, it can be considered that the current computing capability of the electronic device is relatively low. powerful. For example, the preset parameter may be the current remaining running memory capacity and the like.

After acquiring the value of the preset parameter, the electronic device can detect whether the value of the preset parameter is smaller than the preset second threshold.

If the value of the preset parameter is smaller than the preset second threshold, it may be considered that the current computing capability of the electronic device is weak. In this case, in order to reduce the computing burden of the device, the electronic device may capture the object to be photographed through the target camera module, thereby obtaining the base image. That is, at this time, the electronic device only uses one camera module, the target camera module, to shoot the object to be photographed to obtain the base image. The base image is not captured by the two camera modules of the color camera module and the black-and-white camera module.

207. The electronic device captures the object to be photographed through a plurality of telephoto camera modules to obtain a plurality of target images.

For example, after receiving an image capturing request of the object to be photographed, the electronic device may capture the object to be photographed through multiple telephoto camera modules, thereby obtaining multiple images, that is, multiple target images.

208. The electronic device performs image synthesis processing on the base image and the multiple target images, and uses the synthesized images to respond to the image capture request.

For example, after capturing the base image and multiple target images, the electronic device may perform image synthesis processing on the base image and the multiple target images to obtain corresponding synthesized images, and use the synthesized images to respond to the image capturing request. For example, the synthesized image is determined as the imaging image corresponding to the image capturing request.

In an embodiment, after the above process 205, if the electronic device detects that the value of the preset parameter is greater than or equal to the preset second threshold, it can be considered that the current computing capability of the electronic device is relatively strong. In this case, the electronic device can also use the color camera module and the black-and-white camera module to shoot the object to be photographed, so as to obtain the base image.

In another embodiment, when it is detected that the current ambient light intensity value is greater than or equal to the preset first threshold, it may be considered that the current environment of the electronic device is a bright environment. In this case, the electronic device may also The object to be photographed is photographed directly through the target camera module to obtain a base image.

In one embodiment, when the electronic device only captures the object to be photographed through the target camera module (such as a color camera module) to obtain the base image, the electronic device can also perform the following process:

The electronic device continuously shoots the object to be photographed multiple times through the target camera module to obtain a plurality of third images;

The electronic device performs image synthesis processing on the plurality of third images to obtain a base image.

For example, the electronic device may shoot the object to be photographed twice, three times, or four times through the target camera module, so as to obtain multiple third images. Afterwards, the electronic device may perform image synthesis processing such as multi-frame noise reduction on the plurality of third images, so as to obtain a base image.

For example, when the electronic device only selects the target camera module to capture the object to be photographed to obtain the base image, and the computing power of the electronic device is relatively strong, the electronic device can use the target camera module to record the object to be photographed two or three or four times in a row. shooting, thereby obtaining a plurality of third images. Afterwards, the electronic device may perform image synthesis processing such as multi-frame noise reduction on the plurality of third images, so as to obtain a base image.

It can be understood that since the shooting time interval is very short, it can be considered that the above-mentioned multiple third images are images obtained by shooting in the same scene, and the contents of these images are the same.

Wherein, when the electronic device performs image synthesis processing on the plurality of third images, it first aligns the plurality of third images, and then calculates the average pixel value of each pixel overlapped by the aligned plurality of third images, and finally obtains according to the calculation Each average pixel value of , obtains a composite image of a plurality of third images, and the composite image is set as the base image.

Compared with directly setting the image captured by the target camera module as the base image, in the embodiment of the present application, a higher-definition base image can be obtained, so that the finally obtained imaging image also has a higher definition.

In one embodiment, the electronic device may further include an electrochromic component for covering the color camera module and/or the black and white camera module and/or the telephoto camera module. Before receiving the image capturing request of the object to be captured, the electronic device may also perform the following process:

The electronic device controls the electrochromic component to appear transparent.

Then, after using the synthesized image to respond to the image capture request, the electronic device can also perform the following process: the electronic device controls the electrochromic component to switch from a transparent state to a colored state, so as to hide the color camera module and/or the black-and-white camera module and/or telephoto camera module.

For example, in the embodiment of the present application, in order to improve the integrity of the electronic device, the color camera module and/or the black-and-white camera module and/or the multiple telephoto camera modules can also be covered with electrochromic components, so that the Use electrochromic components to hide the camera module when necessary.

The working principle of the electrochromic component is briefly introduced below.

Electrochromism is a phenomenon in which the color/transparency of a material undergoes a stable and reversible change under the action of an applied electric field. Materials with electrochromic properties may be referred to as electrochromic materials. The electrochromic components in the embodiments of the present application are made of electrochromic materials.

Wherein, the electrochromic component may include two layers of conductive layers arranged in layers, and a color-changing layer, an electrolyte layer, and an ion storage layer located between the two conductive layers. For example, when no voltage is applied on the two transparent conductive layers of the electrochromic component (or in other words, the voltage is 0V), the electrochromic component can be in a transparent state, and when a voltage is applied between the two transparent conductive layers of the electrochromic component When the voltage changes from 0V to 3V, the electrochromic component can turn black, when the voltage applied between its two transparent conductive layers changes from 3V to 0V, the electrochromic component changes from black to transparent, etc. .

In this way, each camera module can be hidden by utilizing the color-adjustable feature of the electrochromic component.

In the embodiment of the present application, the electronic device can switch the electrochromic component covering the color camera module and/or the black and white camera module and/or the telephoto camera module to the transparent state while starting the shooting application. , so that the color camera module and/or the black and white camera module and/or the telephoto camera module can shoot the object to be photographed.

After acquiring the base image and multiple target images, and finally synthesizing the imaging image and exiting the shooting application, the electronic device can switch the electrochromic component to a colored state, thereby hiding the color camera module and/or the black and white camera module group and/or telephoto camera modules.

In one embodiment, a color camera module, a black-and-white camera module, and a plurality of telephoto camera modules can be arranged at the back cover of the electronic device. Then, in a colored state, the color of the electrochromic component can be the same as that of the electronic device. The back cover of the device is the same color. It can be understood that, by setting the color of the electrochromic component in the colored state to be the same as the color of the back cover of the electronic device, a better visual concealment effect can be achieved.

For example, the electronic equipment is provided with electrochromic components covering the color camera module, the black and white camera module and the telephoto camera module at the same time, and the electronic equipment is provided with a color camera module, a black and white camera module and a telephoto camera module. If the color of one side of the back cover is black, when the electronic device does not start the shooting application, the electrochromic component is kept in a black coloring state, so that the color camera module, the black and white camera module and the telephoto camera module are hidden. When starting a shooting application, the electrochromic component is switched to a transparent state synchronously, so that the electronic device can shoot through the color camera module, the black-and-white camera module, and the telephoto camera module. After the imaging image is finally synthesized and the shooting application is exited, the electronic device switches the electrochromic component to a black coloring state, so that the color camera module, the black-and-white camera module, and the telephoto camera module are hidden again.

In some embodiments, according to the image capturing request, the object to be captured is captured by the target camera module, or the to-be-captured object is captured by the color camera module and the black-and-white camera module. Before the subject is photographed and the base image is obtained, it can also include:

The electronic device detects whether it is currently in a shaking state;

If it is not currently in a shaking state, the electronic device uses the target camera module to shoot the object to be captured according to the image capture request, or uses the color camera module and the black-and-white camera module to shoot the object. The object to be photographed is photographed to obtain a base image.

According to the relevant descriptions in the above embodiments, the embodiment of the present application uses images captured by different camera modules to finally synthesize an imaged image. If the electronic device is in a shaking state during the capturing process, it will cause images captured by different camera modules. There are obvious differences in the image content, which affects the synthesis effect of the imaged images.

Therefore, in this embodiment of the present application, when the electronic device receives an input image capturing request, it first determines whether it is currently in a shaking state. Among them, the electronic device can judge the shaking state in a variety of ways. For example, the electronic device can judge whether the current speed in each direction is greater than the preset speed. If so, it is judged that it is currently in a shaking state. Not in a shaking state (or a stable state); for another example, the electronic device can determine whether the current displacement in each direction is greater than the preset displacement, if so, it is determined that the current is in a shaking state, if not, it is determined that the current is not shaking. state. In addition, the judgment of the jitter state may also be performed in a manner not listed in the embodiment of the present application, which is not specifically limited in the embodiment of the present application.

When it is determined that it is not currently in a shaking state, the electronic device can, according to the image shooting request, use the target camera module to shoot the object to be shot, or use the color camera module and the black-and-white camera module to shoot the object to be shot. The group photographs the object to be photographed, thereby obtaining a base image.

In some embodiments, if it is not currently in a shaking state, the electronic device uses the target camera module to capture the object to be captured according to the image capture request, or captures the object to be captured through the color camera module and the image capture module. The black-and-white camera module captures the object to be photographed to obtain a base image, and may also include:

If it is not currently in a shaking state, the electronic device detects whether the object to be photographed is in a stationary state;

If the object to be photographed is in a static state, the electronic device uses the target camera module to photograph the to-be-photographed object according to the image capture request, or uses the color camera module and the black-and-white camera module to pair The object to be photographed is photographed to obtain a base image.

According to the above related descriptions, those of ordinary skill in the art can understand that, under the condition that the electronic device is not in a shaking state, if the object to be photographed is not in a static state (for example, the object to be photographed includes a moving object), the electronic device will pass the camera mode There may also be large differences in the image content of the images captured by the group.

Therefore, in the embodiment of the present application, when the electronic device determines that it is not currently in a shaking state, it does not immediately use the camera module to shoot the object to be photographed, but further detects whether the object to be photographed is in a static state. The object to be shot is in a static state, and then according to the image shooting request, the object to be shot is shot by the target camera module, or the object to be shot is shot by the color camera module and the black and white camera module. Shooting is performed to obtain a base image. For details, reference may be made to the relevant descriptions in the above embodiments, which will not be repeated here.

Among them, how to judge whether the object to be photographed is in a static state can be judged by those skilled in the art by selecting an appropriate method according to actual needs, and this embodiment of the present application does not specifically limit this, for example, an optical flow method, residual error method etc. to judge whether the object to be photographed is in a stationary state.

In some embodiments, the target camera module and the telephoto camera module may share an image sensor.

For example, please refer to Figure 10, the target camera and the telephoto camera share the same image sensor, and the target camera module (lens part) and the telephoto camera module (lens part) can project external light to different image sensors in time-sharing part, to achieve shooting of external objects.

Compared with the prior art in which each camera module uses an image sensor independently, the image sensor shared by multiple camera modules in the embodiment of the present application can reduce space occupation.

Please refer to FIG. 11 , which is a schematic structural diagram of an imaging device provided by an embodiment of the present application. The electronic device includes a color camera module, a black and white camera module and a plurality of telephoto camera modules, and the shooting area of each telephoto camera module overlaps with the shooting area of the target camera module, and the target camera module is the Color camera module or the black and white camera module. The imaging device 300 may include: a receiving module 301 , a first photographing module 302 , a second photographing module 303 , and a response module 304 .

The receiving module 301 is configured to receive an image shooting request of the object to be shot.

The first shooting module 302 is configured to, according to the image shooting request, use the target camera module to shoot the object to be shot, or use the color camera module and the black and white camera module to shoot the object to be shot. The subject is photographed to obtain a base image.

The second photographing module 303 is configured to photograph the object to be photographed through the multiple telephoto camera modules to obtain multiple target images.

The response module 304 is configured to perform image synthesis processing on the base image and the multiple target images, and use the synthesized images to respond to the image capture request.

In one embodiment, after receiving the image capturing request of the object to be captured, the first capturing module 302 may be configured to: acquire an ambient light intensity value, and detect whether the ambient light intensity value is less than a preset first threshold value ; If it is detected that the ambient light intensity value is less than the preset first threshold value, the object to be photographed is photographed by the color camera module and the black and white camera module to obtain a base image.

In one embodiment, the first photographing module 302 may be used to:

The object to be photographed is photographed by the color camera module to obtain a first image, and the object to be photographed is photographed by the black and white camera module to obtain a second image;

The first image and the second image are synthesized to obtain a base image.

In one embodiment, the first photographing module 302 may be used to:

The object to be photographed is continuously photographed multiple times by the target camera module to obtain a plurality of third images;

Perform image synthesis processing on the plurality of third images to obtain a base image.

In an embodiment, after receiving the image capturing request of the object to be captured, the first capturing module 302 may be further configured to: acquire the value of a preset parameter, where the value of the preset parameter is used to represent the electronic The current computing capability of the device; if it is detected that the value of the preset parameter is less than the preset second threshold, the object to be photographed is photographed by the target camera module to obtain a base image.

In one embodiment, the electronic device further includes an electrochromic component covering the color camera module and/or the black-and-white camera module and/or the telephoto camera module; Before capturing an image capturing request of an object, the receiving module 301 can also be used to:

controlling the electrochromic component to present a transparent state;

After responding to the image capturing request using the synthesized image, the response module 304 may further be configured to: control the electrochromic component to switch from a transparent state to a colored state, so as to hide the color camera module and/or The black and white camera module and/or the telephoto camera module.

In one embodiment, the color camera module, the black-and-white camera module, and a plurality of telephoto camera modules are arranged at the back cover of the electronic device, and in the colored state, the electrochromic component is the same color as the back cover of the electronic device.

Embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed on a computer, causes the computer to execute the procedures in the imaging method provided by this embodiment.

An embodiment of the present application further provides an electronic device, including a memory and a processor, where the processor is configured to execute the process in the imaging method provided by the present embodiment by calling a computer program stored in the memory.

For example, the above-mentioned electronic device may be a mobile terminal such as a tablet computer or a smart phone. Please refer to FIG. 12 , which is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

The electronic device 400 may include a camera assembly 401, a memory 402, a processor 403 and other components. Those skilled in the art can understand that the structure of the electronic device shown in FIG. 12 does not constitute a limitation on the electronic device, and may include more or less components than the one shown, or combine some components, or arrange different components.

The camera assembly 401 may include a color camera module, a black and white camera module and a plurality of telephoto camera modules, and the shooting area of each telephoto camera module overlaps with the shooting area of the target camera module, and the target camera module is: The color camera module or the black and white camera module.

Memory 402 may be used to store applications and data. The application program stored in the memory 402 contains executable code. Applications can be composed of various functional modules. The processor 403 executes various functional applications and data processing by executing the application programs stored in the memory 402 .

The processor 403 is the control center of the electronic device, uses various interfaces and lines to connect various parts of the entire electronic device, and executes the electronic device by running or executing the application program stored in the memory 402 and calling the data stored in the memory 402. The various functions and processing data of the device are used to monitor the electronic equipment as a whole.

In this embodiment, the processor 403 in the electronic device loads the executable code corresponding to the process of one or more application programs into the memory 402 according to the following instructions, and the processor 403 executes the execution and stores it in the memory 402 in the application, thus executing:

Receive an image capture request of the subject to be photographed;

According to the image shooting request, the object to be shot is shot by the target camera module, or the object to be shot is shot by the color camera module and the black and white camera module to obtain a base image ;

The object to be photographed is photographed by the plurality of telephoto camera modules to obtain a plurality of target images;

Perform image synthesis processing on the base image and the plurality of target images, and use the synthesized images to respond to the image capture request.

Referring to FIG. 13 , the electronic device 500 may include a camera assembly 401 , a memory 402 , a processor 403 , an input unit 404 , an output unit 405 , a speaker 406 , a microphone 407 and other components.

The camera assembly 401 may include a color camera module, a black and white camera module and a plurality of telephoto camera modules, and the shooting area of each telephoto camera module overlaps with the shooting area of the target camera module, and the target camera module is: The color camera module or the black and white camera module.

Memory 402 may be used to store applications and data. The application program stored in the memory 402 contains executable code. Applications can be composed of various functional modules. The processor 403 executes various functional applications and data processing by executing the application programs stored in the memory 402 .

The processor 403 is the control center of the electronic device, uses various interfaces and lines to connect various parts of the entire electronic device, and executes the electronic device by running or executing the application program stored in the memory 402 and calling the data stored in the memory 402. The various functions and processing data of the device are used to monitor the electronic equipment as a whole.

The input unit 404 may be used to receive input numbers, character information or user characteristic information (such as fingerprints), and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

The output unit 405 may be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device, which may be composed of graphics, text, icons, videos, and any combination thereof. The output unit may include a display panel.

In this embodiment, the processor 403 in the electronic device loads the executable code corresponding to the process of one or more application programs into the memory 402 according to the following instructions, and the processor 403 executes the execution and stores it in the memory 402 in the application, thus executing:

Receive an image capture request of the subject to be photographed;

According to the image shooting request, the object to be shot is shot by the target camera module, or the object to be shot is shot by the color camera module and the black and white camera module to obtain a base image ;

The object to be photographed is photographed by the plurality of telephoto camera modules to obtain a plurality of target images;

Perform image synthesis processing on the base image and the plurality of target images, and use the synthesized images to respond to the image capture request.

In one embodiment, after receiving the image capture request of the object to be captured, the processor 403 may execute: obtain an ambient light intensity value, and detect whether the ambient light intensity value is less than a preset first threshold; if detecting When the ambient light intensity value is less than the preset first threshold, the object to be photographed is photographed by the color camera module and the black-and-white camera module to obtain a base image.

In one embodiment, when the processor 403 performs the shooting of the object to be photographed by the color camera module and the black-and-white camera module to obtain a base image, the processor 403 can perform: The object to be photographed is photographed to obtain a first image, and the black and white camera module is used to photograph the object to be photographed to obtain a second image; the first image and the second image are synthesized, Get the base image.

In one embodiment, when the processor 403 performs the shooting of the object to be shot through the target camera module to obtain a base image, the processor 403 may execute: the object to be shot is continuously captured by the target camera module Shooting multiple times to obtain a plurality of third images; performing image synthesis processing on the plurality of third images to obtain a base image.

In an implementation manner, after receiving the image capture request of the object to be captured, the processor 403 may execute: acquiring a value of a preset parameter, where the value of the preset parameter is used to represent the current calculation of the electronic device If it is detected that the value of the preset parameter is smaller than the preset second threshold, the target camera module is used to photograph the object to be photographed to obtain a base image.

In one embodiment, the electronic device further includes an electrochromic component covering the color camera module and/or the black-and-white camera module and/or the telephoto camera module; Before capturing the image capturing request of the object, the processor 403 may execute: controlling the electrochromic component to present a transparent state.

Then, after using the synthesized image to respond to the image capturing request, the processor 403 may execute: control the electrochromic component to switch from a transparent state to a colored state, so as to hide the color camera module and/or The black and white camera module and/or the telephoto camera module.

In one embodiment, the color camera module, the black-and-white camera module, and a plurality of telephoto camera modules are arranged at the back cover of the electronic device, and in the colored state, the electrochromic component is the same color as the back cover of the electronic device.

In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to the detailed description of the imaging method above, and details are not repeated here.

The imaging device provided in the embodiment of the present application and the imaging method in the above embodiment belong to the same concept, and any method provided in the imaging method embodiment can be executed on the imaging device, and the specific implementation process is detailed in detail. Embodiments of the imaging method are not repeated here.

It should be noted that, for the imaging methods described in the embodiments of the present application, those of ordinary skill in the art can understand that all or part of the process of implementing the imaging methods described in the embodiments of the present application can be completed by controlling the relevant hardware through a computer program. , the computer program can be stored in a computer-readable storage medium, such as a memory, and executed by at least one processor, and the execution process can include the flow of the embodiment of the imaging method. The storage medium may be a magnetic disk, an optical disk, a read only memory (ROM, Read Only Memory), a random access memory (RAM, Random Access Memory), and the like.

For the imaging device according to the embodiment of the present application, each functional module may be integrated into one processing chip, or each module may exist physically alone, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium, such as a read-only memory, a magnetic disk or an optical disk, etc. .

The imaging method, device, storage medium, and electronic device provided by the embodiments of the present application have been described in detail above. The principles and implementations of the present application are described with specific examples. The descriptions of the above embodiments are only used for In order to help understand the method of the present application and its core idea; at the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation and application scope. In summary, the content of this specification It should not be construed as a limitation of this application.

Claims (10)

1. an imaging method, is applied to electronic equipment, it is characterized in that, described electronic equipment comprises color camera module, black and white camera module and a plurality of telephoto camera modules, the shooting area and target of each telephoto camera module The shooting areas of the camera module overlap, the target camera module is the color camera module or the black and white camera module, and the imaging method includes: Receive an image capture request of the subject to be photographed; According to the image shooting request, the object to be shot is shot by the target camera module, or the object to be shot is shot by the color camera module and the black and white camera module to obtain a base image ; The object to be photographed is photographed by the plurality of telephoto camera modules to obtain a plurality of target images; Perform image synthesis processing on the base image and the plurality of target images, and use the synthesized images to respond to the image capture request. 2 . The imaging method according to claim 1 , wherein after receiving the image capturing request of the object to be captured, the method further comprises: acquiring an ambient light intensity value, and detecting whether the ambient light intensity value is smaller than a preset value. 3 . first threshold; If it is detected that the ambient light intensity value is less than the preset first threshold, the object to be photographed is photographed by the color camera module and the black-and-white camera module to obtain a base image. 3. The imaging method according to claim 2, wherein the object to be photographed is photographed by the color camera module and the black and white camera module to obtain a base image, comprising: The object to be photographed is photographed by the color camera module to obtain a first image, and the object to be photographed is photographed by the black and white camera module to obtain a second image; The first image and the second image are synthesized to obtain a base image. 4. The imaging method according to claim 1, wherein the object to be photographed is photographed by the target camera module to obtain a base image, comprising: The object to be photographed is continuously photographed multiple times by the target camera module to obtain a plurality of third images; Perform image synthesis processing on the plurality of third images to obtain a base image. 5 . The imaging method according to claim 1 , wherein after receiving the image capturing request of the object to be captured, the method further comprises: obtaining a value of a preset parameter, wherein the value of the preset parameter is used to indicate the the current computing power of the electronic device; If it is detected that the value of the preset parameter is smaller than the preset second threshold, the object to be photographed is photographed by the target camera module to obtain a base image. 6. The imaging method according to any one of claims 1-5, wherein the electronic device further comprises covering the color camera module and/or the black and white camera module and/or the long camera module. The electrochromic component of the focus camera module; before receiving the image shooting request of the object to be shot, it also includes: controlling the electrochromic component to present a transparent state; After responding to the image capturing request using the synthesized image, the method further includes: controlling the electrochromic component to switch from a transparent state to a colored state, so as to hide the color camera module and/or the black and white camera module group and/or the telephoto camera module. 7. The imaging method according to claim 6, wherein the color camera module, the black and white camera module and a plurality of telephoto camera modules are arranged at the back cover of the electronic device, and the coloring In the state, the color of the electrochromic component is the same as the color of the back cover of the electronic device. 8. An imaging device, applied to electronic equipment, wherein the electronic equipment comprises a color camera module, a black and white camera module and a plurality of telephoto camera modules, the shooting area of each telephoto camera module and the target. The shooting areas of the camera module overlap, the target camera module is the color camera module or the black and white camera module, and the imaging device includes: a receiving module, configured to receive an image shooting request of the object to be shot; a first photographing module, configured to photograph the object to be photographed through the target camera module according to the image photographing request, or to photograph the object to be photographed through the color camera module and the black and white camera module The object is photographed to obtain a base image; a second shooting module, configured to shoot the object to be shot through the multiple telephoto camera modules to obtain multiple target images; A response module, configured to perform image synthesis processing on the base image and the multiple target images, and use the synthesized images to respond to the image capture request. 9. A storage medium on which a computer program is stored, characterized in that, when the computer program is executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 7. 10. An electronic device, comprising a memory and a processor, wherein the processor is configured to execute the method according to any one of claims 1 to 7 by invoking a computer program stored in the memory.