CN112087571A - Image acquisition method and device, electronic equipment and computer readable storage medium - Google Patents

Abstract

The application relates to an image acquisition method, an image acquisition device, an electronic device and a computer-readable storage medium. The method is applied to the electronic equipment, the electronic equipment comprises a wide-angle camera and at least two tele cameras, and an overlapped view field area exists between each tele camera and the wide-angle camera; the method comprises the following steps: controlling a wide-angle camera to acquire a wide-angle image; controlling each long-focus camera to collect a frame of long-focus images respectively by using a preset focus to obtain at least two frames of long-focus images, wherein the preset focus is located at infinity; and carrying out fusion processing on the wide-angle image and the long-focus images in at least two frames to obtain a target image. The image acquisition method can ensure that the fused target image keeps consistent definition, and can improve the quality of the target image.

Description

Image acquisition method and apparatus, electronic device, computer-readable storage medium

technical field

The present application relates to the field of imaging technologies, and in particular, to an image acquisition method and apparatus, electronic equipment, and computer-readable storage medium.

Background technique

With the development of imaging technology, people have higher and higher requirements for the image acquisition technology of electronic equipment. In order to improve the imaging effect of electronic equipment, more and more equipment manufacturers are equipped with multiple cameras for electronic equipment. The electronic device may collect images through multiple cameras, so as to stitch and synthesize the images collected by the multiple cameras.

SUMMARY OF THE INVENTION

Embodiments of the present application provide an image acquisition method, apparatus, electronic device, and computer-readable storage medium, which can improve image quality.

An image acquisition method, applied to an electronic device, the electronic device comprising a wide-angle camera and at least two telephoto cameras, and each of the telephoto cameras and the wide-angle camera has an overlapping field of view area; the method includes:

controlling the wide-angle camera to collect wide-angle images;

Controlling each of the telephoto cameras to collect one frame of telephoto images with a preset focus, to obtain at least two frames of telephoto images, wherein the preset focus is located at infinity;

Perform fusion processing on the wide-angle image and at least two frames of the telephoto image to obtain a target image. An image acquisition device, comprising:

a first acquisition module, used to control the wide-angle camera to collect wide-angle images;

The second acquisition module is configured to control each of the at least two telephoto cameras to collect one frame of telephoto images with a preset focus, to obtain at least two frames of telephoto images, wherein the preset The focus is at infinity, and there is an overlapping field of view between each of the telephoto cameras and the wide-angle camera;

A processing module, configured to perform fusion processing on the wide-angle image and at least two frames of the telephoto image to obtain a target image.

An electronic device comprising a wide-angle camera, at least two telephoto cameras, a memory and a processor; wherein, there is an overlapping field of view area between each of the telephoto cameras and the wide-angle camera; a computer program is stored in the memory , when the computer program is executed by the processor, causing the processor to perform the following steps:

controlling the wide-angle camera to collect wide-angle images;

Controlling each of the telephoto cameras to collect one frame of telephoto images with a preset focus, to obtain at least two frames of telephoto images, wherein the preset focus is located at infinity;

Perform fusion processing on the wide-angle image and at least two frames of the telephoto image to obtain a target image.

A computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

controlling the wide-angle camera to collect wide-angle images;

Controlling each of the telephoto cameras to collect one frame of telephoto images with a preset focus, to obtain at least two frames of telephoto images, wherein the preset focus is located at infinity;

Perform fusion processing on the wide-angle image and at least two frames of the telephoto image to obtain a target image.

The above-mentioned image acquisition method, device, electronic device and computer-readable storage medium, since the wide-angle image used for fusion to obtain the target image is the image captured by the wide-angle camera, and the telephoto image is the preset focus is captured by the telephoto camera at infinity image, then at least two frames of telephoto images can maintain consistent sharpness of the object to be photographed, which can avoid the problem of inconsistent image sharpness, poor image effect and poor quality due to different focus positions between different cameras. , which can improve the quality of the target image.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

Fig. 1 is the application environment diagram of the image acquisition method in one embodiment;

2 is a schematic diagram of an image processing circuit in one embodiment;

3 is a flowchart of an image acquisition method in one embodiment;

4 is a schematic diagram of a wide-angle image and 4 frames of telephoto images in one embodiment;

5 is a flowchart of an image acquisition method in another embodiment;

6 is a schematic diagram of 2 frames of wide-angle images and 4 frames of telephoto images in one embodiment;

7 is a structural block diagram of an image acquisition device in one embodiment;

FIG. 8 is a structural block diagram of an electronic device in one embodiment.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

It will be understood that the terms "first", "second", etc. used in this application may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, a first processor could be referred to as a second processor, and similarly, a second processor could be referred to as a first processor, without departing from the scope of this application. Both the first processor and the second processor are processors, but they are not the same processor.

FIG. 1 is a schematic diagram of an application environment of an image acquisition method in one embodiment. As shown in FIG. 1 , the application environment includes an electronic device 100 . The electronic device 100 includes a wide-angle camera 210 and at least two telephoto cameras 220. Specifically, the telephoto camera 220 is a fixed-focus camera with a focus at infinity. Wherein, during image acquisition, the wide-angle camera 210 and at least two telephoto cameras 220 are arranged on the same side of the electronic device 100 in a certain structure, so that there is an overlapping view between each telephoto camera 220 and the wide-angle camera 210 . field area. The electronic device 100 can control the wide-angle camera 210 to collect wide-angle images, and control each telephoto camera 220 to collect one frame of telephoto images with a preset focus, obtain at least two frames of telephoto images, and combine the wide-angle image and at least two frames of telephoto images. The image is fused to obtain the target image. The electronic device 100 may not be limited to various mobile phones, tablet computers, or personal digital assistants or wearable devices, and the like.

The above electronic device 100 includes an image processing circuit, and the image processing circuit may be implemented by hardware and/or software components, and may include various processing units that define an ISP (Image Signal Processing, image signal processing) pipeline. FIG. 2 is a schematic diagram of an image processing circuit in one embodiment. As shown in FIG. 2 , for the convenience of description, only various aspects of the image processing technology related to the embodiments of the present application are shown.

As shown in FIG. 2 , the image processing circuit includes a first ISP processor 230 , a second ISP processor 240 and a control logic 250 . The wide-angle camera 210 includes one or more first lenses 212 and a first image sensor 214 . The first image sensor 214 may include a color filter array (eg, a Bayer filter), the first image sensor 214 may obtain light intensity and wavelength information captured with each imaging pixel of the first image sensor 214, and provide information that can be accessed by the first ISP A set of image data processed by processor 230. The telephoto camera 220 includes one or more second lenses 222 and a second image sensor 224 . The second image sensor 224 may include a color filter array (eg, a Bayer filter), the second image sensor 224 may acquire light intensity and wavelength information captured with each imaging pixel of the second image sensor 224, and provide information that can be accessed by the second ISP A set of image data processed by processor 240 .

The wide-angle image collected by the wide-angle camera 210 is transmitted to the first ISP processor 230 for processing. After the first ISP processor 230 processes the wide-angle image, the statistical data of the wide-angle image (such as the brightness of the image, the contrast value of the image, the color of the image, etc.) etc.) are sent to the control logic 250, and the control logic 250 can determine the control parameters of the wide-angle camera 210 according to the statistical data, so that the wide-angle camera 210 can perform auto-focus, auto-exposure and other operations according to the control parameters. After being processed by the first ISP processor 230, the wide-angle image can be stored in the image memory 260, and the first ISP processor 230 can also read the image stored in the image memory 260 for processing. In addition, the wide-angle image can be directly sent to the display 270 for display after being processed by the ISP processor 230, and the display 270 can also read the image in the image memory 260 for display.

Among them, the first ISP processor 230 processes the image data pixel by pixel in various formats. For example, each image pixel may have a bit depth of 2, 10, 12, or 14 bits, and the first ISP processor 230 may perform one or more image processing operations on the image data, collecting statistical information about the image data. Among them, the image processing operations can be performed with the same or different bit depth precision.

The image memory 260 may be a part of a memory device, a storage device, or an independent dedicated memory in an electronic device, and may include a DMA (Direct Memory Access, direct memory access) feature.

Upon receiving the interface from the first image sensor 214, the first ISP processor 230 may perform one or more image processing operations, such as temporal filtering. The processed image data may be sent to image memory 260 for additional processing before being displayed. The first ISP processor 230 receives processing data from the image memory 260 and performs image data processing in the RGB and YCbCr color spaces on the processed data. The image data processed by the first ISP processor 230 may be output to the display 270 for viewing by the user and/or further processed by a graphics engine or a GPU (Graphics Processing Unit, graphics processor). In addition, the output of the first ISP processor 230 may also be sent to the image memory 260 , and the display 270 may read image data from the image memory 260 . In one embodiment, image memory 260 may be configured to implement one or more frame buffers.

Statistics determined by the first ISP processor 230 may be sent to the control logic 250 . For example, the statistics may include first image sensor 214 statistics such as auto exposure, auto white balance, auto focus, flicker detection, black level compensation, first lens 212 shading correction, and the like. Control logic 250 may include a processor and/or microcontroller executing one or more routines (eg, firmware) that may determine control parameters of wide-angle camera 210 and a first Control parameters of the ISP processor 230. For example, the control parameters of the wide-angle camera 210 may include gain, integration time for exposure control, anti-shake parameters, flash control parameters, first lens 212 control parameters (eg, focal length for focusing or zooming), or a combination of these parameters. ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (eg, during RGB processing), and first lens 212 shading correction parameters.

Similarly, the telephoto image collected by the telephoto camera 220 is transmitted to the second ISP processor 240 for processing. After the second ISP processor 240 processes the telephoto image, the statistical data of the telephoto image (such as the brightness of the image, the The contrast value, the color of the image, etc.) are sent to the control logic 250, and the control logic 250 can determine the control parameters of the telephoto camera 220 according to the statistical data, so that the telephoto camera 220 can perform auto-focus, auto-exposure and other operations according to the control parameters. . After being processed by the second ISP processor 240, the telephoto image can be stored in the image memory 260, and the second ISP processor 240 can also read the image stored in the image memory 260 for processing. In addition, after being processed by the ISP processor 240, the telephoto image can be directly sent to the display 270 for display, and the display 270 can also read the image in the image memory 260 for display. The telephoto camera 220 and the second ISP processor 240 can also implement the processing procedures as described for the wide-angle camera 210 and the first ISP processor 230 .

In this embodiment, the field of view of the wide-angle camera 210 is greater than the field of view of the telephoto camera 220 , and the telephoto camera 230 is a preset fixed-focus camera with a focus at infinity. For example, the field of view of the wide-angle camera 210 may be 80 degrees, 85 degrees, 90 degrees, 100 degrees, etc.; the field of view of the telephoto camera 220 may be 20 degrees, 25 degrees, 30 degrees, 40 degrees, etc. Do limit. The electronic device 100 may include at least one wide-angle camera 210 and at least two telephoto cameras 220 . For example, the number of wide-angle cameras 210 may be 1, 2, etc., and the number of telephoto cameras 220 may be 2, 3, 4, etc.

Optionally, after the electronic device 100 controls the wide-angle camera 210 to collect a wide-angle image, and controls each telephoto camera 220 to collect one frame of a telephoto image with a preset focus, the first ISP processor 230 may convert the wide-angle image and at least two frames of the telephoto image. To perform fusion processing on the telephoto image, the second ISP processor 240 can also perform fusion processing on the wide-angle image and at least two frames of telephoto images; in some embodiments, the wide-angle image and at least two frames can also be fused by the processor of the electronic device The frame telephoto image is subjected to fusion processing, etc., which is not limited here.

The image acquisition method provided in the embodiment of the present application is described by taking the electronic device running in FIG. 1 as an example. The electronic device includes a wide-angle camera and at least two telephoto cameras, and each telephoto camera overlaps with the wide-angle camera. field of view area. Specifically, the image acquisition method includes steps 302 to 306 . in,

Step 302, controlling the wide-angle camera to collect a wide-angle image.

The electronic device controls the wide-angle camera to capture the wide-angle image. Specifically, the electronic device may control the wide-angle camera to collect the wide-angle image when receiving the image collection instruction.

Step 304 , controlling each telephoto camera to collect one frame of telephoto images with a preset focus, to obtain at least two frames of telephoto images, wherein the preset focus is located at infinity.

Specifically, a telephoto camera is a fixed-focus camera with a focus at infinity. Before the electronic device leaves the factory, the focal length of the telephoto camera can be pre-set to infinity, that is, the focus is at infinity. Therefore, the telephoto camera included in the electronic device has only a fixed focal length of infinity lens, and the telephoto camera has no zoom function. The electronic device controls each telephoto camera to collect one frame of telephoto image with a preset focus at infinity, and the imaging clarity of at least two telephoto images obtained remains the same, that is, the image resolution of at least two telephoto images is consistent. The sharpness of the photographed object at the same distance from the camera is consistent.

Each telephoto camera has an overlapping field of view with the wide-angle camera. The field of view refers to the field of view that the camera can capture. For example, the size of a scene is 4*6m, and the size of the target object in the scene is 2*3m; if the wide-angle camera can capture the wide-angle image of the scene, and one of the telephoto cameras can only capture the length of the target object If the target object is in the scene, the wide-angle camera and the telephoto camera have an overlapping field of view. Specifically, since the field of view of the wide-angle camera is larger than that of the telephoto camera, the wide-angle camera may include the field of view of the telephoto camera.

Optionally, the electronic device can control the wide-angle camera to collect a wide-angle image when receiving the camera startup instruction, and display the wide-angle image as a preview image on the display screen of the electronic device; when the electronic device receives the image acquisition instruction, the electronic device While controlling the wide-angle cameras to collect wide-angle images, each telephoto camera is controlled to collect one frame of telephoto images with a preset focus at infinity, so as to obtain at least two frames of telephoto images.

Step 306: Perform fusion processing on the wide-angle image and at least two frames of telephoto images to obtain a target image.

Fusion processing refers to the operation of generating a final image from multiple images according to certain rules. Specifically, the electronic device can perform fusion processing on the wide-angle image and at least two frames of telephoto images by using one or more fusion methods based on linear weighting, nonlinear weighted fusion, principal component analysis fusion, pyramid change, wavelet change, etc., Get the target image. Optionally, after the electronic device obtains the target image through fusion processing, the target image may be displayed on the display screen of the electronic device.

In the embodiment provided in this application, by controlling the wide-angle camera to collect wide-angle images, and controlling each telephoto camera to collect one frame of telephoto images with a preset focus at infinity, at least two frames of telephoto images are obtained. Fusion processing with the wide-angle image to obtain the target image. Since the wide-angle image used for fusion to obtain the target image is an image captured by a wide-angle camera, and the telephoto image is an image captured by a telephoto camera with a preset focus of infinity, the object to be captured in at least two frames of telephoto images can be Maintaining consistent sharpness can avoid the problem of inconsistent image sharpness, poor image effect and quality due to different focus positions between different cameras, and can improve the quality of the target image.

In one embodiment, there is no overlapping field of view area between the at least two telephoto cameras.

Each telephoto camera can be used to shoot a different field of view area, so that the field of view area of each frame of the telephoto camera can respectively correspond to a part of the field of view area of the wide-angle camera. For example, when the electronic device includes two telephoto cameras, the field of view areas of the two telephoto cameras may respectively correspond to the upper and lower field of view areas of the wide-angle camera, or may correspond to the left and right fields of the wide-angle camera, respectively. A field of view area; when the field of view of the wide-angle camera includes buildings, trees, and roads, a telephoto camera can be used to capture a telephoto image that includes the building area, and a telephoto camera can be used to capture the tree area. A telephoto image, another telephoto camera can be used to take a telephoto image that includes the road.

During assembly and configuration of the electronic device, the field of view area of each telephoto camera can be adjusted so that there is no overlapping field of view area between each telephoto camera. The at least two telephoto cameras do not have overlapping field of view areas, and the image details contained in the at least two telephoto frames obtained by the electronic device are richer. Taking the telephoto camera as an example of 16M pixels, if the electronic device includes 4 telephoto cameras, and there is no overlapping area between the 4 telephoto images collected by the 4 telephoto cameras, the electronic device will process the 4 telephoto images. The image obtained after fusion is 64M pixels; if there is an overlapping parallax area between the telephoto cameras, there is an overlapping area between at least two telephoto images collected, and the image pixels obtained by fusion are less than 64M pixels. There is no overlapping field of view area between at least two telephoto cameras included in the electronic device, which can improve the pixels of the fused image.

In one embodiment, the electronic device includes four telephoto cameras, and the fields of view of the four telephoto cameras extend from one of the corner positions of the field of view of the wide-angle camera to a middle position of the field of view of the wide-angle camera.

As shown in FIG. 4 , taking the electronic device including one wide-angle camera and four telephoto cameras as an example, the electronic device can collect a frame of wide-angle image 402 through the wide-angle camera, and the electronic device can locate at infinity through four preset focal points. The telephoto camera at the location performs image acquisition to obtain corresponding 4 frames of telephoto images 404 , 406 , 408 and 410 with the same imaging definition. Specifically, the field of view areas of the four frames of telephoto images 404, 406, 408 and 410 respectively extend from one of the corner positions of the field of view area of the wide-angle image 402 to the middle position of the field of view area of the wide-angle image, as shown in Fig. 4 The field of view areas of the frame telephoto images 404 , 406 , 408 , and 410 are located in the upper left area, the upper right area, the lower left area, and the lower right area of the field of view area of the wide angle image 402 , respectively. The overlapping area 412 is the overlapping field of view area between the four telephoto cameras. Optionally, in some embodiments, the overlapping field of view area may also not exist between the four telephoto cameras. The parallax area of the wide-angle camera is similar to the total field of view area of the four telephoto cameras, and the electronic device can take the wide-angle image 402 as a reference, and fuse the wide-angle image 402 and the four telephoto images 404, 406, 408, and 410 to obtain a shot. The picture is large, and the image definition is consistent and the target image of good quality.

In one embodiment, the electronic device includes at least two wide-angle cameras, and the provided image acquisition method may include:

Step 502 , controlling each wide-angle camera to collect one frame of wide-angle images respectively, to obtain at least two frames of wide-angle images.

At least two wide-angle cameras included in the electronic device have the same field of view. For example, the field of view of the wide-angle camera is 75 degrees, 80 degrees, 85 degrees, 90 degrees, 95 degrees, etc., which are not limited herein. Optionally, in some embodiments, the field of view of the at least two wide-angle cameras may also be different.

There is an overlapping field of view area between at least two wide-angle cameras. Specifically, the field of view area between the wide-angle cameras can be set according to actual needs, which is not limited here. For example, when two wide-angle cameras are included, overlapping and non-overlapping fields of view can be included between the two wide-angle cameras, which can increase the captured image; when three wide-angle cameras are included, the three The wide-angle cameras can be arranged in sequence. Two adjacent wide-angle cameras can have overlapping field of view areas, and two non-adjacent wide-angle cameras can have no overlapping field of view areas; three wide-angle cameras can also have every two wide-angle cameras. There are overlapping fields of view between cameras, which are not limited here.

The electronic device can control each of the at least two wide-angle cameras to collect one frame of wide-angle image respectively, and the at least two frames of wide-angle images obtained have the same photographed object and different photographed objects.

Step 504: Control each telephoto camera to collect one frame of telephoto images with a preset focus, respectively, to obtain at least two frames of telephoto images, wherein the preset focus is located at infinity.

Step 506 , fuse at least two frames of wide-angle images according to overlapping regions in the at least two frames of wide-angle images to obtain a reference image.

The electronic device may fuse the at least two frames of wide-angle images according to the overlapping area between the at least two frames of wide-angle images. Compared with each frame of wide-angle image, the fused reference image has a larger field of view and contains more photographed objects.

Step 508: Perform fusion processing on the reference image and at least two frames of telephoto images to obtain a target image.

Specifically, there is an overlapping area between each frame of the telephoto image and the reference image, and the electronic device may perform fusion processing on the reference image and at least two frames of the telephoto image according to the overlapping area between the telephoto image and the reference image. Based on the principle of camera imaging, in the images collected by the camera, the clarity and imaging effect of the central area are often higher than those of the edge area. In the process of fusing the reference image and at least two frames of telephoto images, the electronic device can obtain the reference image separately. The image content of the central area and the image content of at least two frames of telephoto images to synthesize the target image.

Optionally, in some embodiments, if there is an overlapping area between at least two frames of telephoto images, the electronic device may also stitch the at least two frames of telephoto images first, and then stitch the image obtained after the stitching process with the reference image. Fusion processing to get the target image. Specifically, the electronic device may sequentially perform stitching processing on multiple frames of telephoto images in a predetermined direction according to the reference image.

The electronic device collects one frame of wide-angle image by controlling each wide-angle camera, fuses the obtained at least two frames of wide-angle images to obtain a reference image, and controls each camera to collect one frame of telephoto image at a preset focus, and obtains at least one frame of telephoto image. Two frames of telephoto images and at least two frames of wide-angle images are fused to obtain a target image, which can improve the field of view area of the target image while ensuring the clarity of the target image.

FIG. 6 is a schematic diagram of 2 wide-angle images and 4 telephoto images collected by an electronic device in one embodiment. As shown in Figure 6, the electronic device is provided with 2 wide-angle cameras and 4 telephoto cameras with the focus at infinity. The electronic device can control the two wide-angle cameras to collect a frame of wide-angle images, and obtain wide-angle images collected by the two wide-angle cameras respectively. 602 and a wide-angle image 604. The electronic device may fuse the wide-angle image 602 and the wide-angle image 604 to obtain the reference image 606 . The reference image 606 includes fields of view of the wide-angle image 602 and the wide-angle image 604 . The electronic device captures images with a preset focus through four telephoto cameras, and obtains four corresponding telephoto images 608 , 610 , 612 and 614 with the same imaging definition. The four telephoto images 608 , 610 , 612 and 614 There may be no overlapping field of view areas between. The electronic device can fuse the four frames of telephoto images 608 , 610 , 612 and 614 based on the reference image 606 to obtain a target image with a larger field of view and better image clarity.

In one embodiment, the provided image acquisition method further includes: acquiring calibration parameters between at least two wide-angle cameras before obtaining a reference image by fusing at least two frames of wide-angle images according to overlapping regions in the at least two frames of wide-angle images; Correction processing is performed on at least two frames of wide-angle images according to the calibration parameters.

The calibration parameters are obtained by calibrating at least two wide-angle cameras before the electronic device leaves the factory. The calibration process refers to the operation of solving the parameters in the geometric model imaged by the camera, and the image captured by the camera can restore the object in the space through the geometric model imaged by the camera. Taking the electronic device including two wide-angle cameras, such as wide-angle camera A and wide-angle camera B, as an example, the calibration parameters between the two wide-angle cameras obtained by the electronic device are the dual-target calibration parameters between the wide-angle camera A and the wide-angle camera B. Among them, the bi-target setting parameters can include a rotation matrix and a translation matrix. The electronic device performs correction processing on the at least two frames of wide-angle images according to the calibration parameters, so that the positions of the same feature points in the processed at least two frames of wide-angle images correspond to the positions of each frame of wide-angle images.

Optionally, in some embodiments, the calibration parameter may also include a single-target determination parameter corresponding to each wide-angle camera, and the electronic device may process the wide-angle image collected by the wide-angle camera according to the single-target determination parameter corresponding to each wide-angle camera. Afterwards, correction processing is performed on the wide-angle image according to the dual-target setting parameters.

By acquiring calibration parameters between at least two wide-angle cameras, and performing correction processing on at least two frames of wide-angle images according to the calibration parameters, the processed at least two frames of wide-angle images contain the same features in each frame of wide-angle images. , so that when synthesizing at least two frames of wide-angle images, the position of the same feature point in different wide-angle images can be accurately found, and the accuracy of the synthesizing process can be improved.

In one embodiment, in the provided image acquisition method, before controlling each telephoto camera to collect one frame of telephoto images with a preset focus, and obtaining at least two frames of telephoto images, the method further includes: when acquiring a wide-angle camera to acquire a wide-angle image When the focusing distance is greater than or equal to the preset distance, the step of controlling each telephoto camera to collect one frame of telephoto images with the preset focus, and obtain at least two frames of telephoto images is performed.

Focus distance refers to the distance between the focused object and the camera. The electronic device obtains the focusing distance when the wide-angle camera captures the wide-angle image. Specifically, the electronic device can collect the preview image through the wide-angle camera and display it on the display screen of the electronic device to receive the focus area selected by the user, and then obtain the focus distance of the focus object corresponding to the focus area; When taking an image, the focusing object is determined by means of automatic focusing such as contrast focusing, laser focusing, or phase focusing, so as to obtain the focusing distance of the focusing object.

The preset distance may be set according to actual application requirements, which is not limited here. Specifically, the preset distance is used to determine whether the electronic device is in a close-range shooting state or a long-range shooting state. For example, the preset distance may be 3 meters, 5 meters, 7 meters, 10 meters, etc., which is not limited herein. When the focusing distance is greater than or equal to the preset distance, the electronic device can determine that the electronic device is in a long-range shooting state, so that the electronic device can control each telephoto camera to capture a preset focus while capturing a wide-angle image through the wide-angle camera. frame telephoto images to obtain at least two frames of telephoto images, and perform fusion processing on the wide-angle image and at least two frames of telephoto images to obtain target images.

Optionally, in one embodiment, when the focusing distance is less than the preset distance and the electronic device includes a wide-angle camera, the wide-angle image is used as the target image; when the focusing distance is less than the preset distance, and the electronic device includes at least two wide-angle cameras. When the camera is used, at least two frames of wide-angle images are fused to obtain the target image.

The electronic device may determine that the electronic device is in a close-up shooting state when the focusing distance is less than the preset distance, and at this time, the electronic device may collect a wide-angle image through a wide-angle camera to obtain a target image. Specifically, if the electronic device includes only one wide-angle camera, the electronic device can use the wide-angle image captured by the wide-angle camera as the target image; if the electronic device includes at least two wide-angle cameras, the electronic device can capture multiple frames from multiple wide-angle cameras The wide-angle image is fused to obtain the target image.

By obtaining the focusing distance when the wide-angle camera collects the wide-angle image, the generation method of the target image is determined according to the size relationship between the focusing distance and the preset distance. When the focusing distance is greater than or equal to the preset distance, the wide-angle camera and at least two long The target image is obtained by fusing the images collected by the focal camera. When the focusing distance is less than the preset distance, the target image is obtained according to the wide-angle image collected by the wide-angle camera, which can meet different shooting conditions and ensure that the electronic equipment can obtain the image in different shooting conditions. The quality and effect of the target image can improve the accuracy of image acquisition.

It should be understood that although the steps in the flowcharts of FIGS. 3 and 5 are sequentially displayed according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited to the order, and these steps may be performed in other orders. Moreover, at least a part of the steps in FIGS. 3 and 5 may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but may be executed at different times. These sub-steps or stages are not necessarily completed at the same time. The order of execution of the steps is not necessarily sequential, but may be performed alternately or alternately with other steps or at least a part of sub-steps or stages of other steps.

FIG. 7 is a structural block diagram of an image acquisition apparatus according to an embodiment. As shown in FIG. 7 , the image acquisition device includes a first acquisition module 702, a second acquisition module 704 and a processing module 706, wherein:

The first acquisition module 702 is configured to control the wide-angle camera to collect wide-angle images.

The second acquisition module 704 is configured to control each telephoto camera to acquire one frame of telephoto images with a preset focus, respectively, to obtain at least two frames of telephoto images, wherein the preset focus is at infinity, and each telephoto camera There is an overlapping field of view between the camera and the wide-angle camera.

The processing module 706 is configured to perform fusion processing on the wide-angle image and at least two frames of telephoto images to obtain a target image.

In the image acquisition device provided by the embodiment of the present application, the wide-angle image used to obtain the target image is an image captured by a wide-angle camera, and the telephoto image is an image captured by a telephoto camera with a focus at infinity, then at least two frames of telephoto images The objects to be photographed can maintain the same sharpness, which can avoid the problem of inconsistent image sharpness, poor image effect and poor quality of the fused image due to different focusing positions between different cameras, and can improve the quality of the target image.

In one embodiment, the first acquisition module 702 can also be used to control each wide-angle camera to collect one frame of wide-angle images respectively, to obtain at least two frames of wide-angle images; the processing module 706 can also be used to obtain at least two frames of wide-angle images according to overlapping The region fuses at least two frames of wide-angle images to obtain a reference image, and fuses the reference image and at least two frames of telephoto images to obtain a target image.

In one embodiment, the processing module 706 may also be configured to acquire calibration parameters between at least two wide-angle cameras; and perform correction processing on at least two frames of wide-angle images according to the calibration parameters.

In one embodiment, the second acquisition module 704 can also be used to acquire the focus distance when the wide-angle camera collects the wide-angle image; when the focus distance is greater than or equal to the preset distance, then control each telephoto camera to use the preset focus respectively One frame of telephoto images is collected to obtain at least two frames of telephoto images.

In one embodiment, the processing module 706 may also be configured to use the wide-angle image as the target image when the focus distance is less than the preset distance and the number of wide-angle cameras is one; when the focus distance is less than the preset distance, and the wide-angle camera When the number is two or more, at least two frames of wide-angle images are fused to obtain the target image.

In one embodiment, the second acquisition module 704 may also be configured to control the four telephoto cameras to acquire one frame of telephoto images respectively, to obtain four frames of telephoto images, wherein the field of view areas of the four telephoto images are obtained from the wide-angle One of the corner positions of the field of view area of the image extends to the middle position of the field of view area of the wide-angle image.

In one embodiment, the second acquisition module 704 may be further configured to control each telephoto camera of the at least two telephoto cameras to acquire one frame of telephoto images to obtain at least two frames of telephoto images, wherein the at least two telephoto frames are There are no overlapping fields of view between images.

The division of each module in the above image acquisition device is only used for illustration. In other embodiments, the image acquisition device may be divided into different modules as required to complete all or part of the functions of the above image acquisition device.

FIG. 8 is a schematic diagram of the internal structure of an electronic device in one embodiment. As shown in FIG. 8, the electronic device includes a processor and a memory connected by a system bus. Among them, the processor is used to provide computing and control capabilities to support the operation of the entire electronic device. The memory may include non-volatile storage media and internal memory. The nonvolatile storage medium stores an operating system and a computer program. The computer program can be executed by the processor to implement an image acquisition method provided by the following embodiments. Internal memory provides a cached execution environment for operating system computer programs in non-volatile storage media. The electronic device may be a mobile phone, a tablet computer, a personal digital assistant or a wearable device, and the like.

The implementation of each module in the image acquisition apparatus provided in the embodiments of the present application may be in the form of a computer program. The computer program can be run on a terminal or a server. The program modules constituted by the computer program can be stored in the memory of the terminal or server. When the computer program is executed by the processor, the steps of the methods described in the embodiments of the present application are implemented.

Embodiments of the present application also provide a computer-readable storage medium. One or more non-volatile computer-readable storage media containing computer-executable instructions, when executed by one or more processors, cause the processors to perform the steps of the image acquisition method.

A computer program product containing instructions, when executed on a computer, causes the computer to perform an image acquisition method.

Any reference to a memory, storage, database, or other medium as used in embodiments of the present application may include non-volatile and/or volatile memory. Suitable nonvolatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in various forms such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), Memory Bus (Rambus) Direct RAM (RDRAM), Direct Memory Bus Dynamic RAM (DRDRAM), and Memory Bus Dynamic RAM (RDRAM).

The above-mentioned embodiments only represent several embodiments of the present application, and the descriptions thereof are relatively specific and detailed, but should not be construed as a limitation on the scope of the patent of the present application. It should be noted that, for those skilled in the art, without departing from the concept of the present application, several modifications and improvements can be made, which all belong to the protection scope of the present application. Therefore, the scope of protection of the patent of the present application shall be subject to the appended claims.

Claims (10)

1. The image acquisition method is characterized by being applied to electronic equipment, wherein the electronic equipment comprises a wide-angle camera and at least two tele cameras, and an overlapped view field area exists between each tele camera and the wide-angle camera; the method comprises the following steps:

controlling the wide-angle camera to acquire a wide-angle image;

controlling each long-focus camera to collect a frame of long-focus images with a preset focus to obtain at least two frames of long-focus images, wherein the preset focus is located at infinity;

and carrying out fusion processing on the wide-angle image and the at least two frames of the tele images to obtain a target image.

2. The method of claim 1, wherein the electronic device comprises at least two of the wide-angle cameras, wherein there is an overlapping disparity region between the at least two wide-angle cameras;

control the wide-angle image that the wide-angle camera gathered corresponds includes:

controlling each wide-angle camera to respectively collect a frame of wide-angle image to obtain at least two frames of wide-angle images;

the fusing the wide-angle image and the at least two frames of the tele images to obtain a target image comprises:

fusing at least two frames of the wide-angle images according to the overlapped areas in the at least two frames of the wide-angle images to obtain a reference image;

and carrying out fusion processing on the reference image and at least two frames of the tele images to obtain the target image.

3. The method of claim 2, wherein before fusing the at least two frames of the wide-angle images according to the overlapping area of the at least two frames of the wide-angle images to obtain the reference image, further comprising:

obtaining calibration parameters between at least two wide-angle cameras;

and correcting at least two frames of the wide-angle images according to the calibration parameters.

4. The method according to claim 1, wherein before controlling each of the tele cameras to collect a frame of tele image with a preset focus to obtain at least two frames of tele images, the method further comprises:

acquiring the focusing distance of the wide-angle camera when the wide-angle camera collects the wide-angle image;

and when the focusing distance is greater than or equal to a preset distance, executing the step of controlling each long-focus camera to respectively collect a frame of long-focus image by using a preset focus to obtain at least two frames of long-focus images.

5. The method of claim 4, further comprising:

when the focusing distance is smaller than the preset distance and the electronic equipment comprises one wide-angle camera, taking the wide-angle image as the target image;

and when the focusing distance is smaller than the preset distance and the electronic equipment comprises at least two wide-angle cameras, performing fusion processing on the at least two frames of wide-angle images to obtain the target image.

6. The method of claim 1, wherein the electronic device comprises 4 tele cameras, and wherein the field of view of the 4 tele cameras extends from one of the corner positions of the field of view of the wide camera to a middle position of the field of view of the wide camera.

7. The method of any of claims 1 to 6, wherein there is no overlapping field of view area between at least two of the tele cameras.

8. An image acquisition apparatus, comprising:

the first acquisition module is used for controlling the wide-angle camera to acquire a wide-angle image;

the second acquisition module is used for controlling each long-focus camera in the at least two long-focus cameras to acquire a frame of long-focus images with a preset focus respectively to obtain at least two frames of long-focus images, wherein the preset focus is located at infinity, and an overlapped view field area exists between each long-focus camera and the wide-angle camera;

and the processing module is used for carrying out fusion processing on the wide-angle image and the at least two frames of the tele images to obtain a target image.

9. An electronic device comprises a wide-angle camera, at least two tele cameras, a memory and a processor; an overlapped field of view area exists between each tele camera and each wide camera; the memory has stored therein a computer program which, when executed by the processor, causes the processor to carry out the steps of the image acquisition method according to any one of claims 1 to 7.

10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.

Images