RU2807091C1 - Image merger method and electronic device - Google Patents

Abstract

FIELD: image capture and processing.

SUBSTANCE: result is achieved by obtaining a plurality of images with different features, and the process of obtaining a plurality of images with different features comprises the steps in which, in response to the first operation, the first image is obtained through the first camera, the second image through the second camera, and the third image through the third camera. The electronic image processing device may process the first image to obtain the fourth image, where the resolution of the first image of the region in the fourth image is the same as the resolution of the second image. The electronic imaging device may then perform image fusion on the second image and the fourth image to obtain the fifth image. Further, the electronic imaging device may process the third image to obtain the sixth image, where the resolution of the second image of the region in the sixth image is the same as the resolution of the first image. The electronic device may then perform image fusion on the fifth image and the sixth image to obtain the seventh image.

EFFECT: improvement of quality of images obtained by an electronic image processing device.

21 cl, 17 dwg

Description

This application claims priority to Chinese Patent Application No. 202110506754.4, filed by the Chinese National Intellectual Property Administration on May 10, 2021, entitled "IMAGE FUSION METHOD AND ELECTRONIC DEVICE", which is incorporated herein by reference in its entirety.

Field of technology to which the invention relates

Embodiments of the present application relate to electronic device technologies and, in particular, to an image fusion method and an electronic device.

State of the art

As electronic technology develops, electronic devices (such as a mobile phone, tablet computer or smart watch) acquire an increasing number of features. For example, most electronic devices may be equipped with a camera so that such electronic devices have an image acquisition function.

Using a mobile phone as an example, a mobile phone may be equipped with a variety of cameras, such as a main camera, a telephoto camera, and a wide-angle camera. Based on the features of the mentioned cameras, the mobile phone can use different cameras to acquire images in the same shooting scenario to obtain images with different features. For example, based on the feature that the telephoto camera has a long focal length, the mobile phone may use the telephoto camera to locally obtain sharp telephotographic images. In another example, based on the feature that the main camera has a large amount of transmitted light and high resolution, the mobile phone can use the main camera to obtain completely relatively clear images. In another example, based on the feature that a wide-angle camera has a short focal length and a large viewing angle, a mobile phone can use the wide-angle camera to capture images with large viewing angles.

However, in traditional technology, an electronic device must respond to many user operations before receiving many images with different features. The process of shooting an electronic device is relatively cumbersome, which negatively affects the user's ease of use when shooting.

Disclosure of the invention

The present application provides an image fusion method and an electronic device to simplify the process of obtaining multiple images with different features and improve the user's ease of use when shooting.

According to the first approach, the present application provides a method for merging images. The method may be applied to an electronic device, where the electronic device includes a first camera, a second camera, and a third camera, wherein the field of view of the first camera is larger than the field of view of the second camera, and the field of view of the third camera is larger than the field of view of the first camera.

According to the method, the electronic device detects the first operation. The electronic device may, in response to the first operation, obtain a first image through a first camera, a second image through a second camera, and a third image through a third camera. The viewfinder window in which the first camera receives the first image is the first viewfinder window, the viewfinder window in which the second camera receives the second image is the second viewfinder window, the viewfinder window in which the third camera receives the third image is the third viewfinder window, the third the viewfinder window is larger than the first viewfinder window, and the first viewfinder window is larger than the second viewfinder window. The electronic device may process the first image to produce a fourth image. The fourth image contains a first image of the region, the resolution (resolution) of the first image of the region in the fourth image is the same as the resolution of the second image, the viewfinder window of the first image of the region relative to the first camera is a fourth viewfinder window, the first viewfinder window contains a fourth viewfinder window and a fourth The viewfinder window coincides with the second viewfinder window. The electronic device may then perform image fusion on the second image and the fourth image to produce a fifth image.

It should be understood that since the resolution of the first image of the region in the fourth image is the same as the resolution of the second image and the viewfinder window of the first image of the region is the same as the second viewfinder window, the electronic device can perform merging of the images in the second image and the fourth image. In addition, the second image has the feature that the local image (ie, the image of the distant object) is clear, and the fourth image has the feature that the entire image is relatively clear. The electronic device performs image fusion on the second image and the fourth image, and may combine features of the second image and the fourth image to obtain a fifth image in which the full image has relatively high definition and the local image has relatively high definition. Thus, the fifth image combines features of the second image and the first image. In this way, the quality of images obtained by the electronic device can be improved.

The electronic device may process the third image to produce a sixth image. The sixth image contains a second image of the region, the resolution of the second image of the region in the sixth image is the same as the resolution of the first image, the viewfinder window of the second region image relative to the third camera is a fifth viewfinder window, the third viewfinder window contains a fifth viewfinder window, and the fifth viewfinder window is the same as the first window of the viewfinder. The electronic device may then perform image fusion on the fifth image and the sixth image to obtain a seventh image.

It should be understood that since the resolution of the second image of the region in the sixth image is the same as the resolution of the fifth image, and the viewfinder window of the second region image is the same as the viewfinder window of the fifth image, the electronic device can perform a fusion of the images in the fifth image and the sixth image. In addition, the fifth image has a feature in which the entire image is relatively clear and the local image (ie, the image of a distant object) is clear, and the sixth image has a relatively large viewfinder window. The electronic device performs image fusion on the fifth image and the sixth image, and may combine features of the fifth image and the sixth image to obtain a seventh image whose viewfinder window is relatively large, the full image has relatively high definition, and the local image has relatively high definition. Thus, the seventh image combines the features of the first image, the second image and the third image. In this way, the quality of images obtained by the electronic device can be improved.

In addition, it follows from the above that by performing only one operation, the user can obtain an image with features of multiple images through the electronic device, so that the shooting process is simplified and the user's usability is improved.

According to the first approach, in an exemplary design method, processing the first image by the electronic device to obtain a fourth image comprises performing super-resolution reconstruction on the first image by the electronic device to obtain the fourth image.

It should be understood that the electronic device performs super-resolution reconstruction on the first image, which may increase the resolution of the first image, that is, the resolution of the fourth image becomes greater than the resolution of the first image. Thus, it can be ensured that the resolution of the first image of the region in the acquired fourth image is the same as the resolution of the second image. Additionally, it can be ensured that the electronic device performs fusion on the fourth image and the second image to obtain an image with different image features.

According to the first approach, in another possible design method, processing the third image by the electronic device to obtain a sixth image comprises performing super-resolution reconstruction on the third image by the electronic device to obtain the sixth image.

It should be understood that the electronic device performs super-resolution reconstruction on the third image, which can increase the resolution of the third image, that is, the resolution of the sixth image is greater than the resolution of the third image. Thus, it can be ensured that the resolution of the second image of the region in the acquired sixth image is the same as the resolution of the first image. Additionally, it can be ensured that the electronic device performs fusion on the sixth image and the fifth image to obtain an image with different image features.

According to the first approach, in another possible design method, after the electronic device performs image fusion on the fifth image and the sixth image to obtain a seventh image, the method further comprises receiving a second operation by the electronic device, where the second operation is used to initiate the electronic device to display the seventh image. The electronic device may display the first interface in response to the second operation, where the first interface is configured to display a dynamic screen in which the seventh image is centered on the third image of the area and is automatically scaled. The seventh image contains a third region image, the viewfinder window of the third region image relative to the third camera is a sixth viewfinder window, the third viewfinder window contains a sixth viewfinder window, and the sixth viewfinder window coincides with the second viewfinder window.

For example, the seventh image may be centered on the third image of the region, and the seventh image may be automatically scaled according to scale factors in descending order. The maximum scale factor of the seventh image is the scale factor of the second image, and the minimum scale factor of the seventh image is the scale factor of the third image.

It should be understood that the electronic device displays the seventh image dynamically so that the user can see a dynamic image that increases the percentage of the viewing area of the image.

According to the first approach, in another possible design method, the first playback interface further comprises a first speed option and a first zoom option, where the first speed option is configured to adjust the playback speed of the dynamic screen, and the first zoom option is configured to adjust the maximum zoom factor of the seventh image in the first interface. The method further comprises the steps of adjusting, by the electronic device, the playback speed of the dynamic screen in response to an adjustment operation performed by the user at the first speed option; and electronically adjusting the maximum zoom factor of the seventh image in response to an adjustment operation performed by the user at the first zoom option.

For example, the first speed option could instruct the electronic device to automatically enlarge the seventh image to 100 pixels/s or field of view (FOV) to 20% FOV/s. When the zoom factor of the second image is 4X, the maximum zoom factor of the seventh image can be 4X.

It should be understood that the first speed option and the first zoom option may allow the user to adjust the playback speed and the maximum zoom factor of the image and therefore the user's usability is improved.

According to the first approach, in another possible design method, the first interface further includes a manual playback button, where the manual playback button is configured to trigger the electronic device to display the second interface on the screen. The second interface includes a seventh image and a specified scaling option, and the specified scaling option is configured to set a scaling factor of the seventh image.

That is, the electronic device can be switched from the seventh image dynamic reproduction mode to the seventh image manual reproduction mode. Thus, the user can flexibly select a mode for displaying the seventh image on the screen, and therefore the user's usability is improved.

According to the first approach, in another possible design method, after the electronic device performs image fusion on the fifth image and the sixth image to obtain a seventh image, the method further comprises receiving, by the electronic device, a second operation, where the second operation is used to initiate the electronic device, to display the seventh image on the screen. The electronic device may, in response to the second operation, display a second interface, where the second interface includes a seventh image and a preset zoom option, and the preset zoom option is configured to set a zoom factor of the seventh image. The method further comprises the steps of obtaining a zoom factor set by the user in the preset zoom option by the electronic device, and displaying the seventh image according to the zoom factor set by the user.

It should be understood that after the electronic device receives the operation performed according to the predetermined scaling option, the electronic device may display an image scaled by the predetermined factor. That is, the seventh image may display an area with features of other images (such as the first image, the second image, or the third image). In this way, the user can view features of different images in one image and therefore the user experience is improved.

According to the first approach, in another possible design method, the second interface further includes an autoplay button and the autoplay button is configured to trigger the electronic device to display the first interface. The first interface is configured to display a dynamic screen in which the seventh image is centered on the third region image and is automatically scaled, the seventh image comprising a third region image, the viewfinder window of the third region image relative to the third camera being a sixth viewfinder window, the third viewfinder window comprising a sixth viewfinder window and the sixth viewfinder window coincides with the second viewfinder window.

That is, the electronic device can be switched from a seventh image manual reproduction mode to a seventh image dynamic reproduction mode. Thus, the user can flexibly select a mode for displaying the seventh image, and the user's usability is improved.

According to the first approach, in another possible design method, the first interface includes a format conversion button, where the format conversion button is configured to trigger the electronic device to convert the file format of the seventh image. The method further comprises receiving, by the electronic device, a third operation performed by a format conversion button to generate a first file, where the first file is a video file in which the seventh image is centered on the third area image and is automatically scaled; or the first file is a Graphics Interchange Format GIF image file in which the seventh image is centered on the third area image and automatically scaled.

It should be understood that the first file can automatically scale the seventh image in any electronic device. In this way, after receiving the first file, other electronic devices can display the automatically scaled seventh image on the screen, and therefore the usability of the user is improved.

According to the first approach, in another possible design method, the first camera is the main camera, the second camera is a telephoto camera and the third camera is a wide-angle camera.

When the first camera is the main camera, the first image is the main image. When the second camera is a telephoto camera, the second image is a telephoto image. When the third camera is a wide-angle camera, the third image is a wide-angle image. Thus, the seventh image obtained by the electronic device has many features, such as a relatively large viewfinder window, a relatively high definition of the overall image, and a relatively high definition of the local image. Thus, the seventh image combines the features of the main image, the telephoto image and the wide-angle image. In this way, the quality of images obtained by the electronic device can be improved. In addition, by performing only one operation, the user through the electronic device can obtain an image with features of multiple images, so that the shooting process is simplified and the user's usability is improved.

According to the second approach, the present application provides a method for merging images. The method can be applied to an electronic device. The electronic device includes a first camera, a second camera, a third camera and a fourth camera, wherein the field of view of the first camera is larger than the field of view of the second camera, the field of view of the third camera is larger than the field of view of the first camera, and the field of view of the fourth camera is the same as field of view of the first camera.

According to the method, the electronic device detects the first operation. The electronic device, in response to the first operation, may obtain a first image through a first camera, a second image through a second camera, a third image through a third camera, and an eighth image through a fourth camera. The viewfinder window in which the first camera receives the first image is the first viewfinder window, the viewfinder window in which the second camera receives the second image is the second viewfinder window, the viewfinder window in which the third camera receives the third image is the third viewfinder window, the third the viewfinder window is larger than the first viewfinder window, the first viewfinder window is larger than the second viewfinder window, and the viewfinder window in which the fourth camera receives the eighth image is the same as the first viewfinder window. The electronic device may merge the images in the first image and the eighth image to obtain a ninth image.

It should be understood that image fusion can improve image quality. The electronic device performs image fusion in the first image and the eighth image, and the image quality of the resulting ninth image is higher than the image quality of the first image (or eighth image). In this way, the quality of images obtained by the electronic device can be improved.

The electronic device may process the ninth image to produce a fourth image. The fourth image contains a first image of the region, the resolution of the first image of the region in the fourth image is the same as the resolution of the second image, the viewfinder window of the first image of the region relative to the first camera is a fourth viewfinder window, the first viewfinder window contains a fourth viewfinder window, and the fourth viewfinder window is the same as second viewfinder window. Then, the electronic device may merge the images in the second image and the fourth image to obtain a fifth image.

It should be understood that since the ninth image is an image fusion image, the image quality is relatively high. Therefore, the image quality for the fourth image is relatively high. In addition, since the resolution of the first image of the region in the fourth image is the same as the resolution of the second image, and the viewfinder window of the first image of the region is the same as the second viewfinder window, the electronic device can perform merging of the images in the second image and the fourth image. In addition, the second image has a feature that a local image (ie, an image of a distant object) is clear, and the fourth image has a feature that the entire image is relatively clear. The electronic device performs image fusion on the second image and the fourth image, and may combine features of the second image and the fourth image to obtain a fifth image in which the full image has relatively high definition and the local image has relatively high definition. That is, the fifth image combines features of the second image and the first image. In this way, the quality of images captured by the electronic device can be improved.

The electronic device may process the third image to produce a sixth image. The sixth image contains a second image of the region, the resolution of the second region image in the sixth image is the same as the resolution of the first image, the viewfinder window of the second region image relative to the third camera is a fifth viewfinder window, the third viewfinder window contains a fifth viewfinder window, and the fifth viewfinder window is the same with the first viewfinder window. The electronic device may merge the images in the fifth image and the sixth image to obtain a seventh image.

It should be understood that since the resolution of the second image of the region in the sixth image is the same as the resolution of the fifth image, and the viewfinder window of the second region image is the same as the viewfinder window of the fifth image, the electronic device can perform a fusion of the images in the fifth image and the sixth image. In addition, the fifth image has the feature that the entire image is relatively clear and the local image (ie, the image of a distant object) is clear, and the sixth image has a relatively large viewfinder window. The electronic device performs image fusion on the fifth image and the sixth image, and may combine features of the fifth image and the sixth image to obtain a seventh image for which the viewfinder window is relatively large, the full image has relatively high definition and the local image has relatively high definition. That is, the seventh image combines the features of the first image, the second image, and the third image. In this way, the quality of images obtained by the electronic device can be improved.

In addition, as can be understood from the above, by performing only one operation, the user through the electronic device can obtain an image with features of multiple images, so that the shooting process is simplified and the user's usability is improved.

According to the second approach, in an exemplary design method, processing the ninth image by the electronic device to obtain a fourth image comprises performing super-resolution reconstruction on the ninth image by the electronic device to obtain the fourth image.

It should be understood that the electronic device performs super-resolution reconstruction on the ninth image, which may increase the resolution of the ninth image, that is, the resolution of the fourth image is greater than the resolution of the ninth image. In this way, it can be ensured that the resolution of the first image of the region in the acquired fourth image is the same as the resolution of the second image. Additionally, it can be ensured that the electronic device performs fusion on the fourth image and the second image to obtain an image with different image features.

According to the second approach, in another possible design method, processing the third image by the electronic device to obtain the sixth image comprises performing super-resolution reconstruction on the third image by the electronic device to obtain the sixth image.

It should be understood that the electronic device performs super-resolution reconstruction on the third image, which may increase the resolution of the third image, that is, the resolution of the sixth image is greater than the resolution of the third image. Thus, it can be ensured that the resolution of the second image of the region in the acquired sixth image is the same as the resolution of the first image. Additionally, it can be ensured that the electronic device performs fusion on the sixth image and the fifth image to obtain an image with different image features.

According to the second approach, in another possible design method, after the electronic device performs image fusion on the fifth image and the sixth image to obtain a seventh image, the method further comprises receiving a second operation by the electronic device, wherein the second operation is used to cause the electronic device to display the seventh image. image. The electronic device, in response to the second operation, may display a first interface, where the first interface is configured to display a dynamic screen in which the seventh image is centered on the third image of the area and is automatically scaled. The seventh image contains a third image of the region, wherein the viewfinder window of the third image of the region relative to the third camera is a sixth viewfinder window, the third viewfinder window contains a sixth viewfinder window, and the sixth viewfinder window coincides with the second viewfinder window.

For example, the seventh image may be centered on the third image of the region, and the seventh image may be automatically scaled according to scale factors in descending order. The maximum scale factor of the seventh image is the scale factor of the second image, and the minimum scale factor of the seventh image is equal to the scale factor of the third image.

It should be understood that the electronic device displays the seventh image on the screen in a dynamic mode, so that the user can see the dynamic image, which increases the viewing percentage of the image.

According to the second approach, in another possible design method, the first playback interface further includes a first speed option and a first zoom option, where the first speed option is configured to adjust the playback speed of the dynamic screen, and the first zoom option is configured to adjust the maximum zoom of the seventh image in the first interface . The method further comprises the steps of, in response to an adjustment operation by the electronic device, adjusting the dynamic screen playback speed performed at the first speed option; and in response to an adjustment operation performed by the user at the first zoom option, electronically adjusting the maximum zoom factor of the seventh image.

For example, the first speed option could instruct the electronic device to automatically scale the seventh image at 100 pixels/sec or 20% FOV/sec. When the zoom factor of the second image is 4X, the maximum gain of the seventh image can be 4X.

It should be understood that the first speed option and the first zoom option may allow the user to adjust the zoom speed and the maximum zoom factor so that the user's usability is improved.

According to the second approach, in another possible design method, the first interface further includes a manual playback button, where the manual playback button is configured to trigger the electronic device to display the second interface. The second interface includes a seventh image and a preset scaling option, wherein the preset scaling option is configured to set a scaling factor of the seventh image.

That is, the electronic device can be switched from the seventh image dynamic reproduction mode to the seventh image manual reproduction mode. Thus, the user can flexibly select the screen display mode of the seventh image, so that the user's usability is improved.

According to the second approach, in another possible design method, after the electronic device performs image fusion on the fifth image and the sixth image to obtain a seventh image, the method further comprises receiving, by the electronic device, a second operation, where the second operation is used to initiate the electronic device, to display the seventh image. The electronic device, in response to the second operation, may display a second interface, wherein the second interface includes a seventh image and a preset scaling option, and the preset scaling option is configured to set the scaling of the seventh image. The method further comprises receiving, by an electronic device, a zoom factor set by the user in the preset zoom option, and displaying a seventh image in accordance with the zoom factor set by the user.

It should be understood that after the electronic device receives the operation performed for a given scaling option, the electronic device may display an image scaled by a given factor. That is, the seventh image may display an area with features of different images (such as the first image, the second image, or the third image). In this way, the user can view features of different images in one image, so that the user's usability is improved.

According to the second approach, in another possible design method, the second interface further includes an autoplay button and the autoplay button is configured to trigger the electronic device to display the first interface. The first interface is configured to display a dynamic screen in which the seventh image is centered on the third area image and is automatically scaled, the seventh image contains the third area image, the viewfinder window of the third area image relative to the third camera is a sixth viewfinder window, the third viewfinder window includes a sixth viewfinder window , and the sixth viewfinder window coincides with the second viewfinder window.

That is, the electronic device can switch from a manual reproduction mode of the seventh image to a dynamic reproduction mode of the seventh image. Thus, the user can flexibly select the screen display mode of the seventh image, so that the user's usability is improved.

According to the second approach, in another possible design method, the first interface includes a format conversion button, where the format conversion button is configured to initiate an electronic device to convert the file format of the seventh image. The method further comprises receiving, by the electronic device, a third operation performed on a format conversion button to generate a first file, where the first file is a video file in which the seventh image is centered on the third area image and is automatically scaled; or the first file is a Graphics Interchange Format (GIF) image file in which the seventh image is centered on the third area image and automatically scaled.

It should be understood that the first file can automatically scale the seventh image in any electronic device. In this way, after receiving the first file, other electronic devices can display the automatically scaled seventh image on the screen, so that the user's usability is improved.

According to the second approach, in another possible design method, the first camera is the main camera, the second camera is a telephoto camera and the third camera is a wide-angle camera.

When the first camera is the main camera, the first image is the main image. When the second camera is a telephoto camera, the second image is a telephoto image. When the third camera is a wide-angle camera, the third image is a wide-angle image. That is, the seventh image acquired by the electronic device has many features, such as a relatively large viewfinder window, a relatively high definition of the overall image, and a relatively high definition of the local image. That is, the seventh image combines features of the main image, the telephoto image and the wide-angle image. In this way, the quality of images obtained by the electronic device can be improved. In addition, by performing only one operation, the user can obtain an image with features of multiple images through an electronic device, so that the shooting process is simplified and the user's usability is improved.

According to the third approach, the present application presents an electronic device. An electronic device contains memory, a display screen, and a processor. The memory and display screen are connected to the processor; the memory is configured to store a computer control program and the computer control program contains computer instructions; and the processor is configured to detect a first operation when computer instructions are executed by the processor. The processor is further configured to receive a first image through the first camera, a second image through the second camera, and a third image through the third camera in response to the first operation, wherein the viewfinder window in which the first camera receives the first image is the first viewfinder window, the viewfinder window, in in which the second camera receives a second image is a second viewfinder window, the viewfinder window in which the third camera receives a third image is a third viewfinder window, the third viewfinder window being larger than the first viewfinder window, and the first viewfinder window being larger than the second viewfinder window. The processor is further configured to process the first image to obtain a fourth image. The fourth image contains a first region image, the resolution of the first region image in the fourth image is the same as the resolution of the second image, the viewfinder window of the first region image relative to the first camera is the fourth viewfinder window, the first viewfinder window contains the fourth viewfinder window, and the fourth viewfinder window is the same as second viewfinder window. The processor is further configured to merge the images in the second image and the fourth image to obtain a fifth image. The processor is further configured to process the third image to obtain a sixth image. The sixth image contains a second region image, the resolution of the second region image in the sixth image is the same as the resolution of the first image, the viewfinder window of the second region image relative to the third camera is the fifth viewfinder window, the third viewfinder window contains the fifth viewfinder window, and the fifth viewfinder window is the same as the first viewfinder window. The processor is further configured to merge the images in the fifth image and the sixth image to obtain a seventh image.

According to a third approach, for a possible design method where the processor executes computer instructions, the processor is further configured to perform super-resolution reconstruction on the first image to obtain a fourth image.

According to a third approach, in another possible design method, where computer instructions are executed by a processor, the processor is further configured to perform super-resolution reconstruction on the third image to obtain a sixth image.

According to a third approach, in another possible design method, when computer instructions are executed by the processor, the processor is further configured to receive a second operation, where the second operation is used to initiate a display screen to display a seventh image on the screen. On the display screen, in response to the second operation, a first interface is displayed, where the first interface is configured to display a dynamic screen in which the seventh image is centered on the third image of the area and is automatically scaled. The seventh image contains a third region image, the viewfinder window of the third region image relative to the third camera is a sixth viewfinder window, the third viewfinder window contains a sixth viewfinder window, and the sixth viewfinder window coincides with the second viewfinder window.

According to a third approach, in another possible design method, the first playback interface further includes a first speed option and a first zoom option, where the first speed option is configured to adjust the playback speed of the dynamic screen, and the first zoom option is configured to adjust the maximum zoom factor of the seventh image in the first interface. When the processor executes computer instructions, the processor is further configured to adjust the playback speed of the dynamic screen in response to an adjustment operation performed by the user at the first speed option. The processor is further configured to adjust the maximum zoom factor of the seventh image in response to an adjustment operation performed by the user on the first zoom option.

According to a third approach, in another possible design method, the first interface further includes a manual playback button, where the manual playback button is configured to initiate a display screen to display the second interface on the screen. The second interface includes a seventh image and a specified scaling option, and the specified scaling option is configured to set a scaling factor of the seventh image.

According to a third approach, in another possible design method, when the processor executes computer instructions, the processor is further configured to receive a second operation, where the second operation is used to initiate a display screen to display a seventh image on the screen. The display screen is further configured to display a second interface in response to the second operation, where the second interface includes a seventh image and a predetermined zoom option, and the predetermined zoom option is configured to set a zoom factor of the seventh image. The display screen is further configured to receive a zoom factor set by the user in the predetermined zoom option, and display a seventh image on the screen in accordance with the zoom factor set by the user.

According to a third approach, in another possible design method, the second interface further includes an autoplay button, and the autoplay button is configured to initiate a display screen to display the first interface on the screen. The first interface is configured to display a dynamic screen in which the seventh image is centered on the third region image and is automatically scaled, the seventh image comprising a third region image, the viewfinder window of the third region image relative to the third camera being a sixth viewfinder window, the third viewfinder window comprising a sixth viewfinder window and the sixth viewfinder window coincides with the second viewfinder window.

According to the third approach, in another possible design method, the first interface includes a format conversion button, where the format conversion button is configured to trigger the processor to convert the file format of the seventh image. When the processor executes computer instructions, the processor is further configured to receive a third operation performed on the format conversion button to generate a first file, where the first file is a video file in which the seventh image is centered on the third area image and is automatically scaled; or the first file is a Graphics Interchange GIF image file in which the seventh image is centered on the third area image and automatically scaled.

According to the third approach, in another possible design method, the first camera is a main camera, the second camera is a telephoto camera, and the third camera is a wide-angle camera.

According to the fourth approach, the present application presents an electronic device. An electronic device contains memory, a display screen, and a processor. The memory and the display screen are coupled to the processor, the memory is configured to store a computer control program, and the computer control program contains computer instructions; and the processor is configured to detect a first operation when computer instructions are executed by the processor. The processor is further configured to receive a first image through the first camera, a second image through the second camera, a third image through the third camera, and an eighth image through the fourth camera in response to the first operation, wherein the viewfinder window in which the first camera receives the first image is the first window viewfinder, the viewfinder window in which the second camera receives a second image is a second viewfinder window, the viewfinder window in which the third camera receives a third image is a third viewfinder window, the third viewfinder window is larger than the first viewfinder window, the first viewfinder window is larger, than the second viewfinder window, and the viewfinder window in which the fourth camera receives the eighth image is the same as the first viewfinder window. The processor is further configured to merge images for the first image and the eighth image to obtain a ninth image. The processor is further configured to process the ninth image to obtain a fourth image. The fourth image contains a first region image, the resolution of the first region image in the fourth image is the same as the resolution of the second image, the viewfinder window of the first region image relative to the first camera is the fourth viewfinder window, the first viewfinder window contains the fourth viewfinder window, and the fourth viewfinder window is the same as the second viewfinder window. The processor is further configured to merge images for the second image and the fourth image to obtain a fifth image. The processor is further configured to process the third image to obtain a sixth image. The sixth image contains a second region image, the resolution of the second region image in the sixth image is the same as the resolution of the first image, the viewfinder window of the second region image relative to the third camera is the fifth viewfinder window, the third viewfinder window contains the fifth viewfinder window, and the fifth viewfinder window is the same as the first window of the viewfinder. The processor is further configured to merge images for the fifth image and the sixth image to obtain a seventh image.

According to a fourth approach, in a possible design method where the processor executes computer instructions, the processor is further configured to super-resolve a ninth image to obtain a fourth image.

According to a fourth approach, in another possible design method, when the processor executes computer instructions, the processor is further configured to super-resolve a third image to obtain a sixth image.

According to a fourth approach, in another possible design method, when computer instructions are executed by the processor, the processor is further configured to receive a second operation, where the second operation is used to initiate a display screen to display a seventh image on the screen. The display screen displays a first interface on the screen in response to the second operation, where the first interface is configured to display a dynamic screen in which the seventh image is centered on the third image of the area and is automatically scaled. The seventh image contains a third region image, the viewfinder window of the third region image relative to the third camera is a sixth viewfinder window, the third viewfinder window contains a sixth viewfinder window, and the sixth viewfinder window coincides with the second viewfinder window.

According to the fourth approach, in another possible design method, the first playback interface further comprises a first speed option and a first zoom option, where the first speed option is configured to adjust the playback speed of the dynamic screen, and the first zoom option is configured to adjust the maximum zoom factor of the seventh image in the first interface. When computer instructions are executed by the processor, the processor is further configured to adjust the playback speed of the dynamic screen in response to an adjustment operation performed by the user at the first speed option. The processor is further configured to adjust the maximum zoom factor of the seventh image in response to an adjustment operation performed by the user on the first zoom option.

According to the fourth approach, in another possible design method, the first interface further includes a manual playback button, where the manual playback button is configured to initiate a display screen to display the second interface on the screen. The second interface includes a seventh image and a preset scaling option, and the preset scaling option is configured to set a scaling factor of the seventh image.

According to a fourth approach, in another possible design method, when the processor executes computer instructions, the processor is further configured to receive a second operation, where the second operation is used to initiate a display screen to display a seventh image on the screen. The display screen is further configured to display a second interface in response to the second operation, where the second interface includes a seventh image and a predetermined zoom option, and the predetermined zoom option is configured to set a zoom factor of the seventh image. The display screen is further configured to receive a zoom factor set by the user in the predetermined zoom option, and display a seventh image on the screen in accordance with the zoom factor set by the user.

According to the fourth approach, in another possible design method, the second interface further includes an autoplay button, and the autoplay button is configured to initiate a display screen to display the first interface on the screen. The first interface is configured to display a dynamic screen in which the seventh image is centered on the third region image and is automatically scaled, the seventh image comprising a third region image, the viewfinder window of the third region image relative to the third camera being a sixth viewfinder window, the third viewfinder window comprising a sixth viewfinder window and the sixth viewfinder window coincides with the second viewfinder window.

According to the fourth approach, in another possible design method, the first interface includes a format conversion button, where the format conversion button is configured to trigger the processor to convert the file format of the seventh image. When the processor executes computer instructions, the processor is further configured to receive a third operation performed on the format conversion button to generate a first file, where the first file is a video file in which the seventh image is centered on the third area image and automatically scaled; or the first file is a Graphics Interchange Format (GIF) image file in which the seventh image is centered on the third area image and automatically scaled.

According to the fourth approach, in another possible design method, the first camera is a main camera, the second camera is a telephoto camera, and the third camera is a wide-angle camera.

According to the fifth approach, the present application provides an electronic device. An electronic device contains: memory and processor. The memory communicates with the processor; the memory is configured to store a computer control program and the computer control program contains computer instructions; and when the instructions are executed by the processor, the computer instructions cause the electronic device to perform the method described for the first approach in any possible way of designing it.

According to the sixth approach, the present application presents an electronic device. An electronic device contains: memory and processor. The memory communicates with the processor; the memory is configured to store a computer control program and the computer control program contains computer instructions; and when the instructions are executed by the processor, the computer instructions cause the electronic device to perform the method described for the second approach in any possible way of designing it.

According to the seventh approach, the present application provides a system of chips. A system of chips is used in an electronic device. The chip system includes one or more interface circuits and one or more processors. The interface circuit and the processor are connected to each other by a line. The interface circuit is configured to receive signals from the memory of the electronic device and send signals to the processor. Signals contain computer commands stored in memory. When the processor executes computer instructions, the electronic device performs the method described in the first approach or in the second approach and in any possible way of designing it.

According to the eighth approach, the present application provides a computer-readable medium containing computer instructions, where the computer instructions, when operated on an electronic device, cause the electronic device to perform a method described in the first approach or in the second approach and in any possible design method thereof.

According to the ninth approach, the present application provides a computer program product, wherein the computer program product, when operated on a computer, causes the computer to perform a method described in the first approach or in the second approach and in any possible design method thereof.

It should be understood that in order to obtain the favorable results that can be achieved by the electronic device described in the third approach and in any possible design method, the electronic device described in the fourth approach and in any possible design method thereof, the electronic device described in the fifth approach , the electronic device described in the sixth approach, the chip system described in the seventh approach, the computer readable medium described in the eighth approach, and the computer program product described in the ninth approach presented above, reference may be made to the favorable results for the first approach or the second approach and any possible way of designing them and the details are not re-described here.

Brief description of drawings

Fig. 1 is an example of an image preview interface according to an embodiment of the present application;

Fig. 2A is a hardware structure of an electronic device according to an embodiment of the present application;

Fig. 2B is an example of a viewfinder window according to an embodiment of the present application;

Fig. 3 is a flowchart of an image fusion method according to an embodiment of the present application;

Fig. 4 is an example of an image corresponding to an embodiment of the present application;

Fig. 5 is an example of another image corresponding to an embodiment of the present application;

Fig. 6 is an example of another image corresponding to an embodiment of the present application;

Fig. 7 is a flowchart of an image fusion method according to an embodiment of the present application;

Fig. 8 is an example of yet another image corresponding to an embodiment of the present application;

Fig. 9(a),Fig. 9(b) and FIG. 9(c) is an example of another image preview interface corresponding to an embodiment of the present application;

Fig. 10 is an example of a scaling factor setting interface according to an embodiment of the present application;

Fig. 11 is an example of an image display interface according to an embodiment of the present application;

Fig. 12 is an example of another image display interface corresponding to an embodiment of the present application;

Fig. 13 is an example of another image display interface corresponding to an embodiment of the present application; And

Fig. 14 shows the structural composition of a chip system corresponding to an embodiment of the present application.

Carrying out the invention

The technical solutions contained in the embodiments of the present application are clearly and fully described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are merely some, and not all, embodiments of the present application. All other embodiments obtained by one skilled in the art, based on the embodiments of this application and without creative effort, will fall within the scope of protection of this application.

The symbol "/" in this application generally indicates an "or" relationship between related entities. For example, A/B can be understood as either A or B.

The terms “first” and “second” are used merely for descriptive purposes and should not be construed as an indication or to imply the relative importance or to imply the number of technical features indicated. Therefore, a feature defined by "first" or "second" may explicitly or implicitly contain one or more features. In the descriptions of this embodiment, unless otherwise stated, “many” means two or more.

In addition, the terms “comprises” and “has” as used in the description of this application and any variant thereof are intended to cover a non-exclusive inclusion. For example, a process, method, system, product or device that contains a sequence of steps or modules is not limited to the listed steps or modules; and instead, further optionally comprising a step or module that is not listed or that further comprises another step or module that is inherent to the process, method, product or device.

Additionally, in embodiments of the present application, terms such as “exemplary” or “for example” are used to provide an example, illustration, or description. In this application, any embodiment or design described using “exemplary” or “for example” is not to be explained as being preferable or superior to another embodiment or design. The use of terms such as "exemplary" or "for example" is intended to be nothing less than a representation of a concept in a particular way.

To facilitate understanding of the technical solution of the present application, before describing in detail the image fusion method in the embodiments of the present application, the technical terms mentioned in the embodiments of the present application will first be introduced.

1. Reconstruction with super resolution

Super-resolution reconstruction refers to the generation of a high-quality, high-resolution image using a low-quality, low-resolution image or groups of low-quality, low-resolution images. The super-resolution reconstruction may comprise a reconstruction-based method or a learning-based method.

2. Image Signal Processing (ISP) module

After the camera receives the raw image (that is, the RAW image), the electronic device can transmit the raw image to the ISP module. The RAW format is a format that is not processed or compressed. The ISP module can then analyze the raw image, and check the density gap between adjacent pixels in the image. Then, the ISP module can properly process the raw image using the specified adjustment algorithm in the ISP module, so as to improve the quality of images captured by the camera.

After the technical terms mentioned in the embodiments of the present application have been described, conventional technologies are described below.

As electronic technology develops, an electronic device (such as a mobile phone, tablet computer or smart watch) acquires more and more functions. Using a mobile phone as an example, a mobile phone may be equipped with multiple cameras, such as a main camera, a telephoto camera, and a wide-angle camera. A mobile phone may use different cameras to capture images in the same shooting scenario, so as to obtain images with different features.

In traditional technology, when the user receives different images (such as the main image, telephoto image and wide-angle image) in the same scenario through an electronic device, the user must switch the shooting mode of the electronic device to obtain different images in the same scenario. The main image is an image captured by the electronic device through the main camera, the telephotographic image is an image captured by the electronic device through the telephoto camera, and the wide-angle image is the image captured by the electronic device through the wide-angle camera.

For example, as shown at (a) in FIG. 1, when the shooting mode of the electronic device is a normal shooting mode, the electronic device can obtain the main image 101 through the main camera. Then, in response to a switching operation performed by the user, the electronic device may switch the shooting mode to the telephoto shooting mode shown at (b) in FIG. 1. Next, the electronic device can obtain the telephoto image 102 through the telephoto camera. Thereafter, in response to a switching operation performed by the user, the electronic device can switch the shooting mode to the wide-angle shooting mode shown at (c) in FIG. 1. The electronic device can then obtain the wide-angle image 103 through the wide-angle camera.

However, in the prior solution, the electronic device must respond to a plurality of operations performed by the user before it receives a plurality of images with different features. The shooting process of an electronic device is relatively cumbersome, which affects the user's shooting experience.

Therefore, embodiments of the present application provide a method for merging images. According to the above method, the electronic device can obtain a main image, a telephoto image and a wide-angle image, respectively, through the main camera, a telephoto camera and a wide-angle camera simultaneously in response to a shooting operation performed by the user. The electronic device can then perform super-resolution reconstruction on the main image and the wide-angle image, and perform image fusion on the telephoto image, the reconstructed super-resolution main image, and the reconstructed super-resolution wide-angle image to obtain the final image.

It should be noted that, the image obtained by the electronic device through the camera in embodiments of the present application may be the image obtained after the ISP module processes the raw image obtained by the camera. That is, the image obtained by the electronic device through the main camera is the image obtained after the ISP module processes the raw image obtained by the main camera. The image captured by an electronic device through a telephoto camera is the image obtained after the ISP module processes the raw image captured by the telephoto camera. The image captured by the electronic device through the wide-angle camera is the image obtained after the ISP module processes the raw image captured by the wide-angle camera. Additionally, in embodiments of the present application, the image obtained by the electronic device through the camera may be a raw image, that is, an image in RAW format, which is not limited in the embodiments of the present application. A RAW image is an image that records the original information of the camera sensor, and also records some metadata (ISO setting, shooting shutter speed, aperture value, white balance, etc.) generated when the image is received by the camera, and the image is not processed by the module IPS. ISO is short for International Organization for Standardization.

It should be understood that the fact that the electronic device receives the main image, telephoto image and wide-angle image respectively through the main camera, telephoto camera, and wide-angle camera simultaneously means that the moment (such as the first moment) when the main camera receives the main image is the moment ( such as the second moment) when the telephoto camera receives a telephoto image, and the moment (such as the third moment) when the wide-angle camera receives a wide-angle image are the same. Alternatively, the time difference between the first moment and the second moment, the time difference between the first moment and the third moment, and the time difference between the second moment and the third moment are very small values (for example, the time difference in all cases is less than 1 mm, 0.5 mm, 2 mm, etc.).

It should be understood that the final image is obtained based on the fusion of the main image, the telephoto image and the wide-angle image. Therefore, the final fused image has the characteristics of a main image, a telephotographic image, and a wide-angle image. For example, the final image has the feature in the main image that the overall image is relatively sharp, and also has the feature of local sharpness in the telephoto image, and further has the feature of having a relatively large viewing angle in the wide-angle photograph. Additionally, the electronic device must only respond to one shooting operation performed by the user before producing the final photograph. In this way, the process of obtaining multiple images with different features can be simplified and the user's ease of use can be improved.

For example, the electronic device in embodiments of the present application may be such as a tablet computer, a mobile phone, a desktop computer, a laptop, a PDA, a laptop, an ultra-mobile personal computer (UMPC), a netbook, a cell phone, a personal digital assistant (personal digital assistant (PDA), augmented reality (AR)/virtual reality (VR) device or device installed in a vehicle. The specific form of the electronic device is not particularly limited in embodiments of the present application.

The image fusion method presented in the present application may be performed by an image fusion device, and the image fusion device may be an electronic device shown in FIG. 2A. In addition, the actuator may also be a Central Processing Unit (CPU) of an electronic device or a control module in an electronic image fusion device. In the embodiments of the present application, the image fusion method provided in the embodiments of the present application is described by an example in which the image fusion method is performed by an electronic device.

As shown in FIG. 2A, in the present application, the electronic device presented in the present application is described using an example in which the electronic device is the mobile phone 200 shown in FIG. 2A. The mobile phone 200 shown in FIG. 2A is simply an example of an electronic device, and the mobile phone 200 may contain more or fewer components than shown in the drawing, or two or more components may be combined, or a different arrangement of components may be used. The various components shown in FIG. 2A may be implemented in hardware comprising one or more signal processing circuits and/or application specific integrated circuits, software, or a combination of hardware and software.

As shown in FIG. 2A, the mobile phone 200 may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) 230, a charge management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, mobile communication module 250, radio module 260 and audio module 270, speaker 270A, telephone receiver 270B, microphone 270C, headset connector 270D, sensor module 280, key 290, motor 291, indicator 292, camera 293, display screen 294, subscriber card interface 295 identification data module (subscriber identity module, SIM), etc.

The sensor module 280 may include sensors such as a pressure sensor, a gyroscopic sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, an optical proximity sensor, a fingerprint sensor, a temperature sensor and a touch sensor, an ambient light sensor, a bone conduction sensor, and etc.

Processor 210 may include one or more processing units. For example, processor 210 may include memory, a video codec, a baseband processor, a neural-network processing unit (NPU), and/or the like. The various processors may be independent units or may be integrated into one or more processors.

The controller may be a control center and a control center of the mobile phone 200. The controller may generate an operation control signal in accordance with the command operation code and the timing signal to complete sample control and command execution.

Memory may be further configured in processor 210 to store instructions and data. In some embodiments, the memory in processor 210 is a cache.

In some embodiments, processor 210 may include one or more interfaces. The interface may include interfaces such as an inter-integrated circuit (I2C) interface, a subscriber identity module (SIM) interface, a universal serial bus (USB) interface, and/or the like.

It should be understood that the circuit diagrams of the interface connections between the modules in this embodiment are merely illustrative descriptions and do not constitute a structural limitation on the mobile phone 200. In some other embodiments, the mobile phone 200 may also adopt an interface connection method different from the method described in the foregoing embodiment, or adopt a combination of multiple interface connection methods.

The charge control module 240 is configured to receive charging voltage from the charger. The charger may be a wireless charger or may be a wired charger. When charging the battery 242, the charge control module 240 may further supply power to the electronic device through the power control module 241.

The power management module 241 is configured to connect to the battery 242, the charge management module 242, and the processor 210. The power management module 241 receives input power from the battery 242 and/or from the power management module 240 to supply power to the processor 210, the internal memory 221, external memory, display screen 294, camera 293, radio module 260, etc. In some embodiments, power management module 241 and charge management module 240 may also be located in the same component.

The wireless communication function of the mobile phone 200 may be implemented using an antenna 1, an antenna 2, a mobile communication module 250, a radio module 260, a modem processor, a baseband processor, etc. In some embodiments, the antenna 1 and the mobile communication module 250 of the mobile phone 200 and the antenna 2 and the radio communication module 260 of the electronic device 200 communicate, so that the mobile phone 200 can communicate with the network and other device using wireless communication technology.

Antenna 1 and antenna 2 are configured to transmit and receive an electromagnetic wave signal. Each mobile phone antenna 200 may be configured to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. The mobile communication module 250 may provide wireless communication solutions such as 2G/3G/4G/5G applicable to the mobile phone 200. The mobile communication module 250 may include at least one filter, a switch, a power amplifier, a low noise amplifier, LNA), etc. The mobile communication module 250 may further amplify the signal modulated by the modem processor and convert the signal into an electromagnetic wave for radiation through the antenna 1. In some embodiments, at least some functional modules of the mobile communication module 250 may be located in processor 210.

The radio communication module 260 may provide a wireless radio communication solution applicable to the mobile phone 200, such as a wireless local area network (WLAN) (eg, a Wi-Fi network), frequency modulation (FM), and infrared (FM). infrared, IR) technology. For example, in embodiments of the present application, the mobile phone 200 may access a Wi-Fi network through a wireless communication module 260. The wireless communication module 260 may be one or more components into which at least one communication processor module is integrated.

The mobile phone 200 implements a display function using a GPU, a display screen 294, an application processor, etc. The GPU is an image processing microprocessor and is coupled to the display screen 294 and an application processor.

The display screen 294 is configured to display an image, video, etc. on the screen. The display screen 294 includes a display panel. For example, in embodiments of the present application, the display screen 294 may be configured to display a gallery interface, a shooting interface, or the like on the screen.

The mobile phone 200 may implement a shooting function using an ISP, a camera 293, a video codec, a GPU, a display screen 294, an application processor, etc. The ISP is configured to process data transmitted by the camera 293 on a reverse channel. The camera 293 is configured to obtain a static image or video. In some embodiments, the mobile phone 200 may include one or N cameras 293 and N is a positive integer greater than 1.

In this embodiment of the present application, the N cameras 293 may include: a main camera, a telephoto camera, and a wide-angle camera. Alternatively, the N cameras 293 may further comprise at least one camera such as an infrared camera, a three-dimensional (3D) camera, or a black and white camera. The features (i.e., advantages and disadvantages) and applicable scenarios of each of the listed cameras are briefly introduced below.

(1) Main camera: The main camera has the features of a large amount of light input, high resolution and a moderate field of view. The main camera is usually used as the default camera for an electronic device (such as a mobile phone). Thus, an electronic device (such as a mobile phone) can launch the main camera by default in response to an operation performed by the user to launch the Camera application, and display the image captured by the main camera on a preview interface.

(2) Telephoto camera: The telephoto camera has a relatively long focal length and is suitable for photographing a subject (that is, a distant object) that is far from the mobile phone. However, a telephoto camera has a relatively small amount of light coming in. If an image is captured using a telephoto camera in a low-light scenario, the image quality may be affected due to insufficient light being received. In addition, a telephoto camera has a relatively small field of view and is not suitable for shooting relatively large scenes, that is, it is not suitable for shooting a relatively large subject (such as a building or landscape).

(3) Wide-angle camera: A wide-angle camera has a relatively large field of view and is suitable for shooting a relatively large subject (such as a landscape). However, the focal length of a wide-angle camera is relatively short. When a wide-angle camera receives an object at a relatively close distance, the object in the resulting wide-angle image tends to become distorted (for example, the object in the image becomes wider and flatter than the original object).

(4) Black and white camera: Since a black and white camera does not have any filter, compared to a color camera, a black and white camera has a relatively large amount of incoming light. In addition, the focusing speed of a black and white camera is faster than the focusing speed of a color camera. However, images captured by a black and white camera can only represent different grayscale levels and cannot represent the true colors of the object. It should be noted that the main camera and telephoto camera are both color cameras.

It should be noted that the field of view in embodiments of the present application comprises a horizontal field of view and a vertical field of view.

The external memory interface 220 may be configured to connect to an external storage card, such as a micro SD card, to enhance the storage capabilities of the mobile phone 200. The external storage card communicates with the processor 210 using the external memory interface 220 to implement the storage function data. For example, a file such as music or video is stored on an external storage card.

The internal memory 221 may be configured to store a computer control program. The control program contains commands. The processor 210 executes instructions stored in the internal memory 221 to execute various functional applications and data processing of the mobile phone 200. For example, in this embodiment of the present application, the processor 210 may execute instructions stored in the internal memory 221, and the internal memory 221 may include an area program storage and data storage area.

The program storage area may store an operating system, an application required for at least one function (for example, an audio playback function or an image playback function), etc. The data storage area may store data (for example, audio data and an address book), etc. created when using the mobile phone 200. In addition, the internal memory 221 may include high-speed random access memory or may include non-volatile memory such as at least a magnetic disk memory, flash memory, or universal flash memory. flash storage, UFS).

The mobile phone 200 may implement an audio function using an audio module 270, a speaker 270A, a telephone receiver 270B, a microphone 270C, a headset jack 270D, an application processor, and the like, for example, to play or record music.

The button 290 includes a power button, a volume button, etc. The button 290 may be a mechanical button or a touch typing keyboard. The motor 291 can generate a vibration prompt. Motor 291 may be configured to provide vibration signaling of an incoming call and may further be configured to provide sensory vibration feedback. The indicator 292 may be a warning light, may be configured to indicate the state of charge and the need for battery replacement, and may further be configured to indicate the arrival of a message, missed call, notification, etc. SIM card interface 295 is configured to connect to the SIM -card. A SIM card may be inserted into or removed from SIM card interface 295 to connect to or disconnect from the mobile phone 200. The mobile phone 200 may support one or N SIM card interfaces, where N is a positive integer. more than 1. SIM card interface 295 can support nano SIM card, micro SIM card, SIM card, etc.

Although in FIG. 2A is not shown, the mobile phone 200 may further include a flash memory, a mini-projection device, a near field communication (NFC) device, etc. Details will not be described here.

It should be understood that the structure shown in this embodiment is not particularly limiting to the mobile phone 200. In some other embodiments, the mobile phone 200 may contain more or fewer components than shown in the drawing, or some components may be combined, or some the components may be separated, or the components may be arranged in other ways. The components shown in the drawing may be implemented in hardware, software, or a combination of software and hardware.

All methods in the following embodiments can be implemented in an electronic device having the hardware structure described above. In the following embodiments, an electronic device containing said hardware structure is used as an example to describe the method of this embodiment of the present application.

In this embodiment of the present application, the electronic device may receive a first image through a first camera, a second image through a second camera, and a third image through a third camera in response to a shooting operation performed by a user. The third camera's field of view is larger than the first camera's field of view, and the first camera's field of view is larger than the second camera's field of view.

It should be noted that the fact that the field of view of the third camera is larger than the field of view of the first camera means that the horizontal field of view of the third camera is larger than the horizontal field of view of the first camera, and/or the vertical field of view of the third camera is larger than the vertical field of view first camera. The first camera's field of view is larger than the second camera's field of view means that the first camera's horizontal field of view is larger than the second camera's horizontal field of view, and/or the first camera's vertical field of view is larger than the second camera's vertical field of view. For example, the third camera is a wide-angle camera, the first camera is a main camera and the second camera is a telephoto camera.

The viewfinder window in which the first camera receives the first image is the first viewfinder window, the viewfinder window in which the second camera receives the second image is the second viewfinder window, and the viewfinder window in which the third camera receives the third image is the third viewfinder window. The third viewfinder window is larger than the first viewfinder window, and the first viewfinder window is larger than the second viewfinder window. The electronic device may then process the first image and the third image and perform image fusion on the second image, process the first image, and process the third image to obtain the final image. Thus, the final image may have features of a first image, a second image, and a third image.

It should be noted that in this embodiment of the present application, the viewfinder window of the image captured by the camera refers to the range of the area that the camera can photograph. For example, as shown in FIG. 2B, the main camera can obtain an image corresponding to the area 203 in the area 202. That is, areas other than the area 203 in the area 202 are not within the viewfinder window of the image captured by the main camera. Moreover, in this embodiment of the present application, the image viewfinder window corresponds to the viewfinder window of the image captured by the camera. For example, the first image viewfinder window may indicate a viewfinder window (ie, a first viewfinder window) in which the first camera receives a first image. In another example, the second image viewfinder window may indicate a viewfinder window (ie, a second viewfinder window) in which the second camera receives the second image.

In the following embodiments, using an example in which the first camera is a main camera, the second camera is a telephoto camera, and the third camera is a wide-angle camera, embodiments of the present application are described. When the first camera is the main camera, the first image is the main image. When the second camera is a telephoto camera, the second image is a telephoto image. When the third camera is a wide-angle camera, the third image is a wide-angle image.

As shown in FIG. 3, the image fusion method presented in this embodiment of the present application may comprise steps S301 to S306.

S301. The electronic device detects the first operation.

The first operation is a user-performed operation, such as a click operation. Alternatively, the first operation is a shooting button click operation performed by the user. Alternatively, the first operation is used to initiate the electronic device to start the shooting function. That is, the electronic device receives the operation performed by the user and can take a photo.

S302. The electronic device receives a first image through a first camera, a second image through a second camera, and a third image through a third camera in response to the first operation.

The third viewfinder window is larger than the first viewfinder window, and the first viewfinder window is larger than the second viewfinder window. Alternatively, the first camera is the main camera, the second camera is a telephoto camera and the third camera is a wide-angle camera.

In this embodiment of the present application, the scaling factor of the second image is larger than the scaling factor of the first image, and the scaling factor of the first image is larger than the scaling factor of the third image. That is, among the first image, the second image, and the third image, the scaling factor of the second image is the highest, the scaling factor of the first image is average, and the scaling factor of the third image is the lowest.

It should be noted that the higher the image zoom factor, the smaller the image viewfinder window. For example, as shown in FIG. 1, assume that the zoom factor of the main image 101 is 1X, the zoom factor of the telephoto image 102 is 4X, and the zoom factor of the wide-angle image 103 is 0.5X. As shown in FIG. 1, the viewfinder window of the main image 101 shown at (a) in FIG. 1 is larger than the viewfinder window of the telephotographic image 102 shown at (b) in FIG. 1. A viewfinder window of the main image 101 shown at (a) in FIG. 1 is smaller than the viewfinder window of the wide-angle image 103 shown at (c) in FIG. 1.

The first image contains a fourth region image, where the viewfinder window of the fourth region image is the same as the second viewfinder window. The third image contains a fifth region image, where the viewfinder window of the fifth region image is the same as the shooting region of the first image. For example, as shown in FIG. 4, a fourth image of the area 401 included in the main image 101 shown at (a) in FIG. 4 is the same as the viewfinder window of the telephotographic image 102 shown at (b) in FIG. 4. A fifth image of the area 402 included in the wide-angle image 103 shown at (c) in FIG. 4 is the same as the main image viewfinder window 101.

In some embodiments, the electronic device may receive a first image through the main camera, a second image through the telephoto camera, and a third image through the wide-angle camera simultaneously in response to the first operation.

It should be noted that when an electronic device simultaneously receives a first image through the main camera, a second image through the telephoto camera, and a third image through the wide-angle camera, means that the moment (may be referred to as the first moment) at which the main camera receives the first image, the moment (may be referred to as the second moment) at which the telephoto camera receives the second image and the moment (such as the third moment) at which the wide-angle camera receives the third image are the same, or the time difference between the first moment and the second moment, the time difference between the first moment and the third moment, and the time differences between the second moment and the third moment are all relatively small (for example, all time differences are less than 1 mm). When there is a time difference between the first moment, the second moment and the third moment, the order in which the main camera acquires the first image, the telephoto camera acquires the second image, and the wide-angle camera acquires the third image is not limited in this embodiment of the present application.

S303. The electronic device performs super-resolution reconstruction on the first image to produce a fourth image.

The fourth image contains a first image of the region, the viewfinder window of the first image of the region relative to the first camera is a fourth viewfinder window, the first viewfinder window contains a fourth viewfinder window, and the fourth viewfinder window coincides with the second viewfinder window. That is, the first camera, using the fourth viewfinder window, can obtain an image that matches the viewfinder window of the first image of the area. For example, the first viewfinder window is the viewfinder window of the image 501 shown at (a) in FIG. 5, and the fourth viewfinder window is the viewfinder window of the first area image 502 shown at (a) in FIG. 5. In subsequent embodiments, for descriptions of the viewfinder window of the region image, reference may be made to the description of the viewfinder window of the first region image.

The resolution of the first image of the region is the same as the resolution of the second image. For example, as shown at (a) in FIG. 5, image 501 contains a first region image 502. The resolution of the first area image 502 is the same as the resolution of the second image 102 shown at (b) in FIG. 5. For example, the resolution of the first image of an area is 20 million pixels and the resolution of the second image is 20 million pixels.

It should be noted that in this embodiment of the present application, the resolutions of two images (for example, image A and image B) being the same means that the number of pixels in the horizontal direction in image A is the same as the number of pixels in the horizontal direction in image B. and the number of pixels in the vertical direction in image A is the same as the number of pixels in the vertical direction in image B. For example, the resolution of the first region image is 5000×4000 and the resolution of the second image is 5000×4000.

It should be noted that specifically for a method in which an electronic device performs super-resolution reconstruction on a first image, reference may be made to a method of performing super-resolution reconstruction on an image with conventional technology, and the details in this embodiment of the present application will not be described again. For example, the electronic device may adjust the resolution of the first image using a bilinear interpolation algorithm to obtain a fourth image.

In some embodiments, to ensure that the resolution of the first image of the region is the same as the resolution of the second image, the electronic device may perform super-resolution reconstruction on the first image using the relationship between the zoom factor of the first image and the zoom factor of the second image to obtain a fourth image .

In an exemplary implementation, the electronic device may perform super-resolution reconstruction with a first coefficient on the first image to obtain a fourth image. The first factor is the ratio between the zoom factor of the first image and the zoom factor of the second image. The resolution of the fourth image is greater than the resolution of the first image.

Optionally, the electronic device may calculate a resolution of the fourth image corresponding to a scale factor of the first image, a scale factor of the second image, and a resolution of the second image. For example, an electronic device can obtain the resolution of the fourth image using Formula 1:

M = (p ÷ q) ² ×b, (formula 1)

where M is the resolution of the fourth image, p is the scaling factor of the second image, q is the scaling factor of the first image, b is the resolution of the second image, and (p ÷ q) is the first factor.

For example, referring to FIG. 1 and fig. 5, assuming that the zoom factor of the telephoto image 102 is 4X, the zoom factor of the main image 101 is 1X, and the resolution of the telephoto image 102 is 20 million pixels, the electronic device can determine the resolution of the image 501 using Formula 1 as:

M = (4 ÷ 1) ² ×2000 = 32000

That is, the resolution of image 501 is 320 million pixels.

S304. The electronic device performs image fusion on the second image and the fourth image to produce a fifth image.

The fifth image contains the seventh region image. The viewfinder window of the seventh region image is the same as the second viewfinder window (or the viewfinder window of the fourth region image).

In this embodiment of the present application, the electronic device may perform fusion on the second image and the fourth image using an image fusion algorithm to obtain the fifth image. The image fusion algorithm is not limited in this embodiment of the present application. For example, an image fusion algorithm may be an algorithm for merging high-frequency and low-frequency information. In another example, the image fusion algorithm may be a multi-scale fusion algorithm. In another example, the electronic device may perform fusion on a second image and a fourth image through a given model to produce a fifth image. The specified model may be a Visual Geometry Group Network (VGG) model, an absorption model, a ResNET model, etc. This is not limited to this embodiment of the present application.

It should be understood that since the resolution of the first image of the region in the fourth image is the same as the resolution of the second image, and the viewfinder window of the first image of the region is the same as the second viewfinder window, the electronic device can perform merging of the images in the second image and the fourth image.

It will be understood that the second image has the characteristic that the local image (ie, the image of the distant object) is clear, and the fourth image has the characteristic that the overall image is relatively clear. The electronic device performs image fusion on the second image and the fourth image, and may combine features of the second image and the fourth image to obtain a fifth image in which the full image has relatively high definition and the local image has relatively high definition. That is, the fifth image combines features of the main image and the telephotographic image. In this way, the quality of images obtained by the electronic device can be improved.

S305. The electronic device performs super-resolution reconstruction on the third image to produce the sixth image.

The sixth image contains a second image of the region, the viewfinder window of the second region image relative to the third camera is the fifth viewfinder window, the third viewfinder window contains the fifth viewfinder window, and the viewfinder window of the second region image (that is, the fifth viewfinder window) coincides with the viewfinder window of the first image (or fifth Images). For example, as shown at (a) in FIG. 6, the fifth viewfinder window is a viewfinder window of the second image of the area 602.

In this embodiment of the present application, the resolution of the second image of the region is the same as the resolution of the fifth image. For example, as shown at (a) in FIG. 6, the sixth image 601 contains a second image of an area 602. The resolution of the second area image 602 is the same as the resolution of the fifth image 501 shown at (b) in FIG. 6. For example, the resolution of the second image of the area is 320 million pixels and the resolution of the fifth image is 320 million pixels.

It should be noted that for descriptions of the process in which the electronic device performs super-resolution reconstruction on the third image to obtain the sixth image, reference may be made to descriptions in which the electronic device performs super-resolution reconstruction on the first image to obtain the fourth image in step S303 image, and the details are not re-described here. For example, the electronic device may adjust the resolution of the third image using a bilinear interpolation algorithm to obtain a sixth image.

In some embodiments, to ensure that the resolution of the second image of the region is the same as the resolution of the fifth image, the electronic device may perform super-resolution reconstruction on the third image using scaling between the scale factor of the first image and the scale factor of the third image to obtain the sixth image .

In an exemplary implementation, the electronic device may perform super-resolution reconstruction at a second factor on the third image to obtain a sixth image. The second factor is the factor between the zoom factor of the first image and the zoom factor of the third image. The resolution of the sixth image is greater than the resolution of the third image.

In a possible design, the electronic device may calculate the resolution of the sixth image according to the ratio of the scaling factor of the first image, the scaling factor of the third image, and the resolution of the fifth image. For example, an electronic device can obtain the resolution of the sixth image according to Formula 2:

N = (k + j) ² × c (formula 2)

where N is the resolution of the sixth image, k is the scaling factor of the first image, j is the scaling factor of the third image, c is the resolution of the fifth image, and (k + j) is the second factor.

For example, referring to FIG. 1 and fig. 6, assuming that the zoom factor of the main image 101 is 1X, the zoom factor of the telephoto image 103 is 0.5X, and the resolution of the fifth image is 320 million pixels, the electronic device can determine the resolution of the sixth image 601 using Formula 2 as follows:

M = (1 + 0.5) ² × 32000 = 128000 So the resolution of the sixth image 601 is 1.28 billion pixels.

It should be noted that, the order in which the electronic device acquires the fifth image and the sixth image is not limited in this embodiment of the present application. For example, the electronic device may first execute step S305 and then execute step S304. In another example, the electronic device may simultaneously execute steps S304 and S305.

S306. The electronic device performs image fusion on the fifth image and the sixth image to obtain a seventh image.

The seventh image contains an eighth region image, where the viewfinder window of the eighth region image is the same as the first viewfinder window (or the viewfinder window of the fifth region image in the third image).

It should be noted that for descriptions of the process in which the electronic device performs image fusion in the fifth image and the sixth image to obtain the seventh image, reference may be made to descriptions of how the electronic device performs image fusion in the second image and the fourth image to obtain the fifth image in step S304, and the details are not described again here.

It should be noted that since the resolution of the second image of the region in the sixth image is the same as the resolution of the fifth image, and the viewfinder window of the second region image is the same as the viewfinder window of the fifth image, the electronic device can perform merging of the images in the fifth image and the sixth image.

It will be understood that the fifth image has the characteristics that the full image is relatively clear and that the local image (ie, the image of a distant object) is clear and the sixth image has a relatively large viewfinder window. The electronic device performs image fusion on the fifth image and the sixth image, and may combine features of the fifth image and the sixth image to obtain a seventh image in which the viewfinder window is relatively large, the full image is relatively high-definition, and the local image is relatively high-definition. That is, the seventh image combines features of the main image, the telephoto image and the wide-angle image. In this way, the quality of images obtained by the electronic device can be improved.

Based on the foregoing technical solution, the electronic device accepts the shooting operation performed by the user and can separately acquire the first image, the second image and the third image, respectively, through the main camera, the telephoto camera and the wide-angle camera. In addition, the electronic device may perform image processing on the first image, the second image, and the third image to obtain a seventh image, where the seventh image has features of images captured by different cameras. That is, by performing only one operation, the user can obtain an image with features of multiple images using the electronic device, so that the shooting process is simplified and the user's usability is improved.

It should be noted that during image acquisition, the electronic device may be affected by several factors, resulting in poor image quality. For example, when a user takes a photo and if their hands are shaking, the photo taken by the electronic device may be blurry. In another example, when lighting is poor, the noise in the image captured by the electronic device can be significant.

In some other embodiments, to improve the quality of images acquired by the electronic device, the electronic device may acquire images using a secondary camera (ie, a fourth camera). The auxiliary camera is not limited in this embodiment of the present application. For example, the secondary camera may be an infrared camera. In another example, the secondary camera may be a black and white camera.

An example is taken in the case where the sub camera is an infrared camera, that is, the electronic device acquires images using an infrared camera. An infrared camera can detect not only visible light, but also infrared light. For example, infrared light may be infrared light with a wavelength of 890 to 990 nanometers (nm). Thus, an infrared camera can sense infrared light with a wavelength between 890 nm and 990 nm. Of course, the infrared light (that is, the wavelengths of infrared light) that different infrared cameras can detect may vary. A visible light camera can also be a common wavelength camera. The common wavelength band is the wavelength band that contains the wavelengths of visible light.

In a dark scenario (such as in the evening, late at night or in a dark room), the intensity of visible light is relatively low. The main camera cannot sense light or the sensed light is weak and therefore a clear image cannot be obtained. However, an infrared light camera can detect infrared light emitted by a person or animal at a temperature within the viewfinder window and therefore an image of the person or animal can be obtained.

Considering the above features of the infrared camera, when using the main camera to take images in a dark scenario, in order to prevent the image quality from being affected by weak visible light, the electronic device, through the advantage that the infrared camera can detect infrared light, uses the infrared camera in as a secondary camera to assist the main camera, thereby improving the quality of images captured by the main camera.

As shown in FIG. 7, the image merging method may comprise steps S701 to S707.

S701. The electronic device detects the first operation.

It should be noted that for the descriptions of step S701, reference may be made to the descriptions of step S301 in the previous embodiment, and the details will not be described again here.

S702. The electronic device, in response to the first operation, receives a first image through a first camera, a second image through a second camera, a third image through a third camera, and an eighth image through a fourth camera.

The viewfinder window of the eighth image is the same as the first viewfinder window.

It should be noted that in this embodiment of the present application, the viewfinder window of the eighth image being the same as the first viewfinder window means that: the similarity between the eighth image viewfinder window and the first viewfinder window is 100%, or the similarity between the eighth image viewfinder window and the first viewfinder window is larger than the specified similarity threshold (for example, 99%, 95%, or 90%).

For example, as shown at (a) in FIG. 8, area 801 is the first viewfinder window, area 802 is the eighth image viewfinder window, and area 801 is the same as area 802. In another example, as shown at (b) in FIG. 8, area 803 is the first viewfinder window, area 804 is the eighth image viewfinder window, and area 803 is not completely the same as area 804.

In this embodiment of the present application, the electronic device can simultaneously acquire an eighth image through the sub-camera, a first image through the main camera, a second image through the telephoto camera, and a third image through the wide-angle camera.

It should be noted that for descriptions of the same point, reference may be made to descriptions of how the electronic device in step S302 simultaneously acquires a first image through the main camera, a second image through the telephoto camera, and a third image through the wide-angle camera, and the details will not be described again here.

S703. The electronic device performs image fusion on the first image and the eighth image to obtain a ninth image.

The viewfinder window of the ninth image is the same as the first viewfinder window. The ninth image contains a sixth region image, where the viewfinder window of the sixth region image is the same as the second viewfinder window.

It should be noted that the resolutions of the first image and the eighth image are not limited in this embodiment of the present application. For example, the resolution of the first image may be greater than the resolution of the eighth image. In another example, the resolution of the first image may be equal to the resolution of the eighth image. In another example, the resolution of the first image may be less than the resolution of the eighth image.

In some embodiments, if the resolution of the first image is greater than (or equal to) the resolution of the eighth image, the electronic device may directly merge the images in the first image and the eighth image to obtain a ninth image.

It should be noted that in the process in which the electronic device performs image fusion in the first image and the eighth image, the electronic device may upscale the eighth image to the same resolution as the first image.

In some other embodiments, if the resolution of the first image is less than the resolution of the eighth image, the electronic device may upscale the first image and the resolution of the upscaled first image is the same as the resolution of the eighth image. The electronic device may then perform image fusion on the enlarged first image and the eighth image to obtain a ninth image.

It should be noted that for descriptions of the process in which the electronic device performs image fusion in the first image and the eighth image to obtain the ninth image, reference may be made to descriptions of how the electronic device performs image fusion in the second image and the fourth image so as to step S304 to obtain the fifth image, and the details will not be described again here.

It should be understood that merging images can improve image quality. The electronic device performs image fusion in the first image and the eighth image, and the image quality of the resulting ninth image will be higher than the image quality of the first image (or eighth image). Thus, in a dark scenario or in a scenario in which the object is moving, the quality of the images obtained by the electronic device can be further improved.

S704. The electronic device performs super-resolution reconstruction on the ninth image to produce the fourth image.

It should be noted that for descriptions of the process in which the electronic device performs super-resolution reconstruction on the ninth image to obtain the fourth image, reference may be made to descriptions of the process in step S303 in which the electronic device performs super-resolution reconstruction on the first image to obtain fourth image, and the details are not described again here.

It should be understood that the image quality of the ninth image obtained by the electronic device through fusion is higher than the image quality of the first image (or the eighth image). The electronic device performs super-resolution reconstruction on the ninth image, and the image quality of the resulting fourth image is also higher than the image quality of the first image (or eighth image). In this way, the quality of images obtained by the electronic device can be improved.

S705. The electronic device performs image fusion on the fourth image and the second image to produce a fifth image.

It should be noted that for the description of step S705, reference may be made to the description of step S304 in the previous embodiment, and the details will not be described again here.

S706. The electronic device performs super-resolution reconstruction on the third image to produce the sixth image.

It should be noted that for the description of step S706, reference may be made to the description of S305 in the previous embodiment, and the details will not be described again here.

S707. The electronic device performs image fusion on the sixth image and the fifth image to obtain a seventh image.

It should be noted that the description of step S707 reference may be made to the description of step S306 in the previous embodiment, and the details will not be described again here.

Based on the foregoing technical solution, the electronic device accepts the shooting operation performed by the user and can obtain the first image, the second image, the third image and the eighth image, respectively, through the main camera, the telephoto camera, the wide-angle camera and the sub camera. In addition, the electronic device may perform image processing on the first image, the second image, the third image, and the eighth image to obtain a seventh image, wherein the seventh image has features of images acquired by different cameras. Thus, by performing only one operation, a user can obtain an image with features of multiple images using an electronic device, so that the shooting process is simplified and the user's usability is improved.

It should be noted that in order to help the user obtain an image (ie, a seventh image) with features of a main image, a telephotographic image, and a wide-angle image through the electronic device, the electronic device may set a predetermined shooting mode. When the shooting mode of the electronic device is a predetermined shooting mode, the electronic device can obtain the seventh image through cameras such as the main camera, the telephoto camera and the wide-angle camera.

In some embodiments, before the electronic device accepts a shooting operation performed by the user, the electronic device may launch a shooting application and display an image preview interface. Then, the electronic device may receive a shooting mode switching operation performed by the user, where the shooting mode switching operation is used to trigger the electronic device to change the shooting mode. In response to the shooting mode switching operation, the electronic device may switch the shooting mode to a predetermined shooting mode. For example, as shown in FIG. 9(a), after the electronic device has launched the shooting application, the electronic device may display the image preview interface 901. The image preview interface 901 includes a viewfinder frame 902, a shutter button 903, a receive option 904, an album button 905, an image preview option 906, a flash memory option 907, a Video option, a Photo option. , a "More" option, etc. Then, the electronic device may display the function option block 908 shown in FIG. 9(b) at the top level of the image preview interface 901 in response to a selection operation (eg, operation A) performed by the user on the "More" option. The function option block 908 contains a "Professional" mode identifier, a "Time lapse" mode identifier, a "Panorama" mode identifier, a "Spotlight" mode identifier, etc. Spotlight mode " is the seventh image acquisition mode. That is, when the shooting mode of the electronic device is the Spotlight mode, the electronic device can obtain the seventh image by acquiring an image through a plurality of cameras. Then, in response to an operation (eg, operation B) performed by the user on the Spotlight mode identifier, the electronic device may switch the shooting mode of the electronic device to the Spotlight mode (as shown in FIG. 9(c)).

Thus, when the shooting mode of the electronic device is a predetermined shooting mode, the electronic device can receive a shooting operation performed by the user and obtain the seventh image. For example, the electronic device may receive operation C (that is, the electronic device executes step S301) performed by the receive button 904 shown in FIG. 9(c), and obtains the seventh image (that is, the electronic device executes steps S302 to S306).

It should be noted that when the shooting mode of the electronic device is a predetermined shooting mode, the electronic device may trigger at least one camera to obtain a preview image.

In some embodiments, when the shooting mode of the electronic device is a predetermined shooting mode, the electronic device may trigger the main camera, the telephoto camera, and the wide-angle camera to obtain a preview image. Alternatively, the electronic device can also trigger the main camera, secondary camera, telephoto camera and wide-angle camera to produce a preview image. The preview image is the seventh image. That is, the preview image is an image obtained after the electronic device processes images acquired by a plurality of cameras (ie, S303 to S306).

It should be understood that the electronic device triggers the main camera, telephoto camera and wide-angle camera to obtain a preview image, and may display the processed image (ie, the seventh image) on the preview interface screen. In this way, the user can intuitively understand the effect of the image taken in a given shooting mode, and the user's shooting experience is improved.

In some other embodiments, when the shooting mode of the electronic device is a predetermined shooting mode, the electronic device may trigger any camera (eg, a main camera, a telephoto camera, or a wide-angle camera) to obtain a preview image. The preview image is an image captured by a camera fired by an electronic device. For example, the electronic device may trigger the main camera to obtain a preview image (preview image 906 shown in FIG. 9(a)). In another example, an electronic device may trigger a wide-angle camera to obtain a preview image (preview image 906 shown in FIG. 9(c)). Typically, an electronic device can trigger a wide-angle camera to capture a preview image. In this way, the user can know the largest area that the electronic device is photographing.

It should be understood that when an electronic device triggers any camera to obtain a preview image, the electronic device does not need to process the resulting image, so that the power consumption of the electronic device is reduced.

In some embodiments, the electronic device may improve image quality in a user-defined area. Specifically, the electronic device may receive a scaling setting operation performed by the user, where the scaling setting operation is used to cause the electronic device to set the scaling factors of the first image, the second image, and the third image. In response to a zoom factor setting operation performed by the user, the electronic device may set a first predetermined factor, a second predetermined factor, and a third predetermined factor, where the first predetermined factor is a scale factor of the first image, the second predetermined factor is a scale factor of the second image, and the third predetermined factor is scaling factor of the third image. For example, as shown at (a) in FIG. 10, the electronic device may display the zoom setting window 1002 shown at (b) in FIG. 10 in response to an operation D performed by the user on the Ratio setting 1001. Alternatively, the electronic device may display a zoom ratio setting window 1002 in response to an operation performed on the Spotlight mode identifier shown in FIG. 9(b). The zoom setting window 1002 includes a zoom factor input field for the main image, a zoom input field for the telephoto image, and a zoom input field for the wide-angle image. The user can enter the image scaling factor in the scaling input field. For example, the zoom factor (i.e., the first specified zoom factor) of the main image is 1X, the zoom factor (i.e., the second specified zoom factor) of the telephoto image is 4X, and the zoom factor (i.e., the third specified zoom factor) of the wide-angle image is 0. 5X. Alternatively, the zoom factor setting window 1002 may further include a "Save" button, a "Reset" button, and a "Cancel" button. The "Save" button is configured to trigger the electronic device to save the image zoom factor entered by the user, and the "Reset" button is configured to trigger the electronic device to set the image zoom factor to the default zoom factor. The default zoom factor is not limited in this embodiment of the present application (for example, the default zoom factor of the main image may be 1X, the default zoom factor of the telephoto image may be 3.5X, and the default zoom factor of the wide-angle image may be 0 ,6X). The "Cancel" button is configured to cause the electronic device not to display the scaling setting window 1002 on the screen.

It should be understood that through the operation of setting the zoom factor, the electronic device can adjust the display areas of the first image, the second image and the third image. Thus, the electronic device can set display areas with various features in the seventh image in accordance with the user's intention, so that the user's usability is improved.

It should be noted that after the electronic device receives the seventh image (that is, the electronic device executes step S306 or the electronic device executes step S707), the electronic device may receive a second operation, where the second operation is used to cause the electronic device to display seventh image. The electronic device may display the seventh image in a predetermined mode in response to the second operation. The specified mode contains dynamic mode and static mode. Dynamic mode is used to instruct the electronic device to automatically scale the seventh image with the third image of the area as the center. The seventh image contains a third region image, the viewfinder window of the third region image relative to the third camera is a sixth viewfinder window, the third viewfinder window contains a sixth viewfinder window, and the sixth viewfinder window coincides with the second viewfinder window. The static mode is used to instruct the electronic device to scale the seventh image after the scaling operation entered by the user is received.

In some embodiments, the electronic device may display a seventh image on the screen in accordance with a dynamic mode. Specifically, the electronic device receives the second operation. The electronic device may display a dynamic image interface (ie, a first interface) on a screen in response to a second operation performed by a user, wherein the dynamic image interface is configured to display a dynamic screen in which the seventh image is centered on the third area image and automatically scaled. Specifically, the seventh image may be centered on the third area image, and the seventh image may be automatically scaled according to scale factors in descending order. The maximum scale factor of the seventh image is the scale factor of the second image, and the minimum scale factor of the seventh image is the scale factor of the third image.

For example, as shown in FIG. 11, the electronic device may display a dynamic image interface 1101 on the screen in response to a second operation performed by the user. The dynamic image interface 1101 includes a dynamic image 1102. For the dynamic image 1102, the seventh image may be centered on the third region image 1105 and automatically scaled according to a scale factor in descending order. For example, the user can view a dynamic image interface in the user interface. The image corresponding to position (c) in FIG. 4 shown on the user interface may be scaled to the image at (a) in FIG. 4 presented on the user interface and then scaled to the image corresponding to position (b) in FIG. 4 presented on the user interface. Alternatively, the dynamic image scaling process may be repeated repeatedly. For example, after presenting the image corresponding to position (b) in FIG. 4, the user navigates to the image corresponding to position (c) in FIG. 4 presented on the user interface to repeatedly reproduce such dynamic changing process, or, instead of repeating, continues to save the image obtained after scaling the dynamic image to the image corresponding to position (b) in FIG. 4, and displays the last frame of the image. Dynamic display of the dynamic image may be performed in response to the user's finger pressing any location on the dynamic image. When the user's fingers leave the screen, the long press ends and the dynamic display of the dynamic image ends. Dynamic display can also be performed in response to a long finger press by the user anywhere on the dynamic image for 2 seconds. When the user's fingers leave the screen, the long press ends and the dynamic display of the dynamic image continues and does not stop. Alternatively, there may be a playback icon and the user clicks the icon to display a dynamic image. The dynamic image display method and the specific operation in response to which the dynamic display is performed are not limited in this embodiment of the present application. Alternatively, the dynamic screen interface may further comprise a first speed option, where the first speed option is configured to adjust the speed of playback on the dynamic screen. The electronic device may adjust the playback speed of the dynamic screen in response to an adjustment operation performed by the user at the first speed option. For example, as shown in FIG. 11, the dynamic image interface 1101 further includes a first speed option 1103. For example, the first speed option 1103 may instruct the electronic device to automatically scale the seventh image to 100 pixels/sec or 20% FOV/sec.

Alternatively, the dynamic image interface may further comprise a first scaling option, where the first scaling option is configured to adjust the maximum scaling factor of the seventh image on the first interface. The maximum zoom factor of the seventh image is less than or equal to the second specified zoom factor (ie, the zoom factor of the second image). The electronic device may adjust the maximum zoom factor of the seventh image in response to an adjustment operation performed by the user at the first zoom option. For example, as shown in FIG. 11, the dynamic image interface 1101 further includes a first zoom option 1104. For example, when the zoom factor of the second image is 4X, the maximum zoom factor of the seventh image may be 4X and may also be 3X.

It should be understood that the electronic device displays the seventh image in a dynamic mode so that the user can view the dynamic image, which increases the viewing percentage of the image. In addition, the first speed option and the first zoom option may allow the user to adjust the zoom speed and the maximum zoom factor of the image so that the user's usability is improved.

In some embodiments, the electronic device may display a seventh image on the screen corresponding to a static mode. Specifically, the electronic device may display a static image interface (ie, a second interface) on a screen in response to a second operation performed by the user, where the static image interface includes a seventh image that cannot be automatically scaled. Alternatively, the image display interface may further comprise a predetermined scaling option, where the predetermined scaling option is configured to set a scaling factor of the seventh image. The electronic device may receive a zoom factor set by the user in a given zoom option and display on the screen a seventh image corresponding to the zoom factor set by the user. For example, as shown in FIG. 12, an image display interface 1201 displayed on a screen by an electronic device may include a seventh image 1202 and a predetermined zoom option 1203. For example, a given scaling option 1203 may comprise a first predefined zoom factor (eg, 1X), a second predefined zoom factor (eg, 4X), and a third predefined zoom factor (eg, 0.5X). That is, the electronic device may set the scaling factor of the seventh image to 4X, 1X, or 0.5X in response to an operation performed by the user on the specified scaling option 1203.

It should be understood that after the electronic device receives an operation performed on a given scaling option, the electronic device displays an image on the screen that is scaled by the given factor. That is, the seventh image may display an area on the screen with features of different images (such as the first image, the second image, or the third image). In this way, the user can view features of different images in one image, so that the user's usability is improved.

In some embodiments, the electronic device may switch the display mode of the seventh image. In a possible design, when the interface displayed by the electronic device is a first interface, that is, the electronic device displays a dynamic screen in which the seventh image is centered on the third area image and automatically scaled, the first interface further includes a manual playback button, where the manual playback button is configured with the possibility of the electronic display device initiating a second interface. The electronic device can accept the operation performed by the manual play button and switch the interface displayed on the screen from the first interface to the second interface. For example, as shown at (a) in FIG. 13, a dynamic image interface 1301 displayed on a screen by an electronic device may include a manual playback button 1302. For example, manual play button 1302 may be "Dynamic mode". The interface displayed on the screen by the electronic device may be switched from the dynamic image interface 1301 to the static image interface 1303 shown at (b) in FIG. 13, in response to an operation performed by the user with the manual play button 1302.

In another possible design, when the interface displayed on the screen by the electronic device is a second interface, the second interface may further comprise an autoplay button, where the autoplay button is configured to cause the electronic device to display the first interface. For example, as shown at (b) in FIG. 13, the still image interface 1303 includes an auto playback button 1304. For example, the auto play button 1304 may be "Static mode". The electronic device may receive the operation performed on the auto play button and switch the interface displayed on the screen from the second interface to the first interface.

It should be understood that after receiving the operation performed by the user, the electronic device may switch the display mode of the seventh image. Thus, the user can flexibly select a mode for displaying the seventh image on the screen, so that the user's usability is improved.

It should be noted that there are many types of images stored in an electronic device. The electronic device can display common types of images in a common display manner. For example, the electronic device may display a telephoto image, a main image, etc. on the screen. The electronic device may also display a seventh image in a predetermined mode.

In some embodiments, to assist the electronic device in determining an image display mode, when storing the seventh image, the electronic device may add a first identifier to the seventh image information, where the first identifier is used to instruct the electronic device to display the seventh image in a specified mode. The electronic device may determine, in accordance with the image information of the image in response to the second operation, whether to display the image in a predetermined mode. For example, upon receiving a second operation by a user, the electronic device may detect whether the first identifier contains image information for the image. If the image information contains the first identifier, the electronic device can display the image in a predetermined mode. If the image information does not contain the first identifier, the electronic device can display the image on the screen in a conventional display manner.

It should be understood that the electronic device adds the first identifier to the seventh image so that the electronic device can display the seventh image in a predetermined manner. Thus, the user's viewing percentage of the image is increased and the user's usability is improved.

It should be noted that after the electronic device receives the seventh image, the electronic device may share the seventh image with other electronic devices. Other electronic devices may display the seventh image in other display methods in accordance with the electronic device's ability to identify the first identifier.

In some embodiments, an electronic device (eg, a first device) that receives the seventh image may display the seventh image in a predetermined manner and the first device is able to identify the first identifier. Specifically, the electronic device may share the seventh image with the first device. Upon receiving the seventh image, the first device can detect and identify the first identifier of the seventh image. The first device may then display the seventh image on the screen in a predetermined mode. For example, the first device may dynamically display the seventh image in response to the second operation.

In some other embodiments, the electronic device (eg, a second device) that receives the seventh image may display the seventh image in a conventional display manner and the second device does not have the ability to identify the first identifier. Specifically, the electronic device may share the seventh image with the second device. After receiving the seventh image, the second device is unable to identify the first identifier of the seventh image. The second device may then display the seventh image on the screen in a conventional display manner. For example, the second device, in response to the second operation, may display the seventh image on the screen of the second device.

It should be noted that if other electronic devices do not have the ability to identify the first identifier, the electronic device cannot display the seventh image on the screen, which is automatically scaled, and therefore the user's usability is adversely affected.

In some other embodiments, to allow an electronic device that cannot identify the first identifier to view a seventh image that is automatically scaled, the electronic device may convert the file format of the seventh image. Specifically, when the interface displayed on the screen by the electronic device is a first interface, that is, the electronic device displays a dynamic screen in which the seventh image is centered on the third area image and automatically scaled, the first interface may further comprise a format conversion button, wherein the format conversion button configured to initiate an electronic device to convert the file format of the seventh image. The electronic device may receive a third operation performed on the format conversion button to generate the first file. The third operation is used to cause the electronic device to convert the file format of the seventh image, the first file being a file in which the seventh image is centered on the third image area and automatically scaled. For example, an electronic device may generate a video file, or an electronic device may generate a dynamic image file. The electronic device can then share the first file with other electronic devices. For example, when the first file is a Graphics Interchange Format (GIF) image file, the electronic device may share the GIF image with other electronic devices.

It should be noted that the automatic scaling speed of the seventh image in the first file and the maximum zoom factor to which the seventh image can be scaled can be set using the first speed option and the first zoom option. This is not limited in this embodiment of the present application.

It should be understood that the first file can automatically scale the seventh image in any electronic device. In this way, after receiving the first file, other electronic devices can display the automatically scaled seventh image on the screen, so that the user's usability is improved.

The solutions presented in the embodiments of the present application are described above mainly from the point of view of an electronic device. It should be understood that in order to implement the features presented above, the electronic device includes corresponding hardware structures and/or software modules to perform the functions. One skilled in the art can readily understand that, in combination with the image fusion method and examples described in the embodiments disclosed herein, the present application can be implemented in hardware or a combination of hardware and software. Regardless of whether a function is performed in hardware or software of an electronic device, control of the hardware depends on the specific application and design constraints of the technology. One skilled in the art may employ various methods to implement the described features for each particular application, but implementation should not be considered to be beyond the scope of the present application.

In embodiments of the present application, division into functional modules or division into functional blocks can be performed on an image fusion device based on the method described above, for example, each functional module or functional block can be divided according to each feature, or two or more features can be integrated into one processing module. An integrated module may be implemented in the form of hardware or may be implemented in the form of a software function module or function block. The division into modules or blocks in the embodiments of the present application is exemplary and is simply a division along logical grounds and may be a different division during actual implementation.

Other embodiments of the present application provide an electronic device (such as the mobile phone 200 shown in FIG. 2A). The electronic device may include memory and one or more processors. The memory communicates with the processor. The electronic device may further comprise a camera. Alternatively, the electronic device may be connected to an external camera. The memory is configured to store a computer control program, and the computer control program contains computer instructions. When the processor executes computer instructions, the electronic device may perform various features or steps performed by the mobile phone according to the above method embodiments. With respect to the structure of the electronic device, reference may be made to the structure of the mobile phone 200 shown in FIG. 2A.

This embodiment of the present application is further provided by a chip system. As shown in FIG. 14, the chip system includes at least one processor 1401 and at least one interface circuit 1402. Processor 1401 and interface circuit 1402 may be coupled to each other using a line. For example, interface circuitry 1402 may be configured to receive signals from other devices (such as the memory of an electronic device). In another example, interface circuitry 1402 may be configured to send signals to other devices (eg, processor 1401). For example, the interface circuit 1402 may read instructions stored in memory and send the instructions to the processor 1401. When the instructions are executed by the processor 1401, the electronic device (mobile phone 200 shown in FIG. 2A) may perform the steps according to the embodiments described above. Of course, the chip system may further comprise other discrete devices, which are not particularly limited in the embodiments of the present application.

Embodiments of the present application further provide a computer-readable storage medium, wherein the computer-readable storage media contains computer instructions. Computer instructions, when acted on an electronic device (mobile phone 200 shown in FIG. 2A), cause the electronic device to implement the features or steps implemented by the mobile phone in prior embodiments of the method.

This embodiment of the present application further provides a computer program product that, when run on a computer, causes the computer to implement the features or steps implemented by the mobile phone in the previous method embodiments.

The preceding descriptions of the implementations will allow one skilled in the art to clearly understand that for the purpose of convenience and brevity of the description, the division of the preceding functional modules is made by way of example for illustration. In actual application, the preceding features can be assigned to various modules and implemented according to requirements, that is, the internal structure of the device is divided into various functional modules to implement all or part of the features described above.

In several embodiments presented herein, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the described embodiment of the device is merely an example. For example, division into modules or blocks is simply division by logical functions and may be a different division in actual implementation. For example, multiple modules or components may be combined or integrated in other devices, or some features may be ignored or not executed. In addition, the mutual connections or direct connections or communication connections displayed or discussed may be implemented using certain interfaces. Indirect connections or cohesive connections between devices or modules can be implemented in electrical, mechanical or other forms.

Blocks described as separate parts may or may not be physically separate, and parts depicted as blocks may be one or more physical blocks, may be located in one location, or may be distributed in different locations. Some or all of the modules may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional blocks in embodiments of the present application may be integrated into a single processor, or each of the blocks may exist physically separately, or two or more blocks may be integrated into a single block. The integrated block may be implemented in hardware form or may be implemented in the form of a software function block.

When an integrated block is implemented in the form of a software function block and sold or used as an independent product, the integrated block may be stored on a readable storage medium. Based on this understanding, the technical solutions contained in the embodiments of this application, substantially or partially advancing the prior art, or all or some of the technical solutions may be implemented in the form of a software product. The software product is stored in a storage medium and contains a number of instructions for communicating to a device (which may be a single-chip microcomputer, a chip, or the like) or a processor to perform all or some of the steps of the methods described in the embodiments of the present application. The above-mentioned storage medium includes any medium that can store a control program, such as a USB flash memory card, a removable hard disk, a read only memory (ROM), a random access memory (RAM) , magnetic disk, or optical disk.

The foregoing content merely describes specific implementations of the present application, but is not intended to limit the scope of the present application. Any change or substitution within the technical scope disclosed in this application must fall within the scope of protection of this application. Therefore, the scope of protection of the present application should be subject to the scope of protection of the claims.

Claims (62)

1. An image fusion method implemented in an electronic device, wherein the electronic device comprises a first camera, a second camera and a third camera, wherein the field of view of the first camera is larger than the field of view of the second camera, and the field of view of the third camera is larger than the field of view of the first camera, containing stages in which: detect, using an electronic device, the first operation; is obtained, by an electronic device, in response to the first operation, a first image through the first camera, a second image through the second camera, and a third image through the third camera, wherein the viewfinder window in which the first camera receives the first image is the first viewfinder window, the viewfinder window , in which the second camera receives a second image is a second viewfinder window, the viewfinder window in which a third camera receives a third image is a third viewfinder window, and the third viewfinder window is larger than the first viewfinder window, and the first viewfinder window is larger than the second window viewfinder; processing, using an electronic device, the first image to obtain a fourth image, wherein the fourth image contains a first image of the region, and the resolution of the first image of the region in the fourth image is the same as the resolution of the second image, the viewfinder window of the first image of the region relative to the first camera is the fourth window a viewfinder, the first viewfinder window includes a fourth viewfinder window, and the fourth viewfinder window coincides with the second viewfinder window; performing, using an electronic device, merging the images in the second image and the fourth image to obtain a fifth image; processing, by an electronic device, the third image to obtain a sixth image, the sixth image comprising a second image of the region, the resolution of the second region image in the sixth image is the same as the resolution of the first image, the viewfinder window of the second region image relative to the third camera is a fifth viewfinder window , the third viewfinder window contains a fifth viewfinder window, and the fifth viewfinder window coincides with the first viewfinder window; And performing, using an electronic device, merging the images in the fifth image and the sixth image to obtain a seventh image. 2. The method according to claim 1, wherein the step of processing, using an electronic device, the first image to obtain a fourth image comprises a substep of performing, using an electronic device, super-resolution reconstruction on the first image to obtain a fourth image. 3. The method according to claim 1 or 2, wherein the step of processing, using an electronic device, the third image to obtain a sixth image, comprises the substep of performing, using an electronic device, super-resolution reconstruction on the third image to obtain a sixth image. 4. Method according to any one of paragraphs. 1-3, further comprising, after the step of electronically merging the images in the fifth image and the sixth image to obtain a seventh image, the steps of: receiving, by an electronic device, a second operation, the second operation being used to cause the electronic device to display a seventh image; And displaying, by an electronic device, a first interface in response to a second operation, wherein the first interface is configured to display a dynamic screen, and the seventh image is centered on the third area image and is automatically scaled, wherein the seventh image includes the third area image, a viewfinder window of the third area image relative to the third camera is a sixth viewfinder window, the third viewfinder window contains a sixth viewfinder window, and the sixth viewfinder window coincides with the second viewfinder window. 5. The method of claim 4, wherein the first interface further comprises a first speed option and a first zoom option, wherein the first speed option is configured to adjust the playback speed of the dynamic screen, and the first zoom option is configured to adjust the maximum zoom factor of the seventh image on the first interface; wherein the method further comprises the steps of: adjusting, by an electronic device, the playback speed of the dynamic screen in response to an adjustment operation performed by the user at the first speed option; And adjusting, by an electronic device, a maximum zoom factor of the seventh image in response to an adjustment operation performed by the user at the first zoom option. 6. The method of claim 4 or 5, wherein the first interface further comprises a manual play button, wherein the manual play button is configured to initiate an electronic device to display the second interface on the screen, wherein the second interface includes a seventh image and a specified scaling option, and the specified scaling option is configured to set a scaling factor of the seventh image. 7. Method according to any one of paragraphs. 1-3, further comprising, after the step of electronically merging the images in the fifth image and the sixth image to obtain a seventh image, the steps of: receiving, by an electronic device, a second operation, where the second operation is used to cause the electronic device to display a seventh image on a screen; And displaying, by an electronic device, a second interface in response to the second operation, the second interface comprising a seventh image and a predetermined zoom option, wherein the predetermined zoom option is configured to set a zoom factor of the seventh image; wherein the method further comprises a step in which receiving, by an electronic device, a zoom factor set by the user in the specified zoom factor option, and displaying a seventh image in accordance with the zoom factor set by the user. 8. The method of claim 7, wherein the second interface further comprises an autoplay button, wherein the autoplay button is configured to trigger the electronic device to display the first interface on the screen, wherein the first interface is configured to display a dynamic screen in which the seventh image is centered on the third region image and is automatically scaled, the seventh image comprising a third region image, the viewfinder window of the third region image relative to the third camera being a sixth viewfinder window, the third viewfinder window comprising a sixth viewfinder window and the sixth viewfinder window coincides with the second viewfinder window. 9. Method according to any one of paragraphs. 4-6, wherein the first interface includes a format conversion button, wherein the format conversion button is configured to initiate an electronic device to convert the seventh image file format; wherein the method further comprises a step in which receiving, by an electronic device, a third operation performed on the format conversion button to generate a first file, the first file being a video file, wherein the seventh image is centered on the third area image and is automatically scaled; or the first file is a Graphics Interchange Format (GIF) image file, wherein the seventh image is centered on the third area image and automatically scaled. 10. Method according to any one of paragraphs. 1-9, in which the first camera is a main camera, the second camera is a telephoto camera, and the third camera is a wide-angle camera. 11. An image fusion method implemented in an electronic device, wherein the electronic device comprises a first camera, a second camera, a third camera and a fourth camera, wherein the field of view of the first camera is larger than the field of view of the second camera, the field of view of the third camera is larger than the field of view of the first camera, and the field of view of the fourth camera is the same as the field of view of the first camera, comprising the steps of: detect, using an electronic device, the first operation; is obtained, by an electronic device, in response to the first operation, a first image through the first camera, a second image through the second camera, a third image through the third camera, and an eighth image through the fourth camera, wherein the viewfinder window in which the first camera receives the first image is the first viewfinder window, the viewfinder window in which the second camera receives the second image is the second viewfinder window, the viewfinder window in which the third camera receives the third image is the third viewfinder window, and the third viewfinder window is larger than the first viewfinder window, the first viewfinder window larger than the second viewfinder window, and the viewfinder window in which the fourth camera receives the eighth image is the same as the first viewfinder window; performing, using an electronic device, merging the images in the first image and the eighth image to obtain a ninth image; processing, using an electronic device, the ninth image to obtain a fourth image, the fourth image containing a first image of the region, the resolution of the first image of the region in the fourth image is the same as the resolution of the second image, the viewfinder window of the first image of the region relative to the first camera is the fourth viewfinder window , the first viewfinder window contains a fourth viewfinder window, and the fourth viewfinder window coincides with the second viewfinder window; performing, using an electronic device, merging the images in the second image and the fourth image to obtain a fifth image; processing, by an electronic device, the third image to obtain a sixth image, the sixth image comprising a second image of the region, the resolution of the second region image in the sixth image is the same as the resolution of the first image, the viewfinder window of the second region image relative to the third camera is a fifth viewfinder window , the third viewfinder window contains a fifth viewfinder window, and the fifth viewfinder window coincides with the first viewfinder window; And performing, using an electronic device, merging the images in the fifth image and the sixth image to obtain a seventh image. 12. The method of claim 11, wherein the step of processing, using an electronic device, the ninth image to obtain a fourth image comprises the substep of performing, using an electronic device, super-resolution reconstruction on the ninth image to obtain a fourth image. 13. The method according to claim 11 or 12, wherein the step of processing, using an electronic device, the third image to obtain a sixth image comprises the substep of performing, using an electronic device, super-resolution reconstruction on the third image to obtain a sixth image. 14. Method according to any one of paragraphs. 11-13, further comprising, after the step of electronically merging the images in the fifth image and the sixth image to obtain a seventh image, the steps of: receiving, by an electronic device, a second operation, the second operation being used to cause the electronic device to display a seventh image; And displaying, by an electronic device, in response to the second operation, a first interface, wherein the first interface is configured to display a dynamic screen, wherein the seventh image is centered on the third area image and is automatically scaled, the seventh image contains the third area image, a viewfinder window of the third area image relative to the third camera is a sixth viewfinder window, the third viewfinder window contains a sixth viewfinder window, and the sixth viewfinder window coincides with the second viewfinder window. 15. The method of claim 14, wherein the first interface further comprises a first speed option and a first zoom option, wherein the first speed option is configured to adjust the playback speed of the dynamic screen, and the first zoom option is configured to adjust the maximum zoom factor of the seventh image in the first interface; wherein the method further comprises the steps of: adjusting, by an electronic device, the playback speed of the dynamic screen in response to an adjustment operation performed by the user at the first speed option; And adjusting, by an electronic device, a maximum zoom factor of the seventh image in response to an adjustment operation performed by the user at the first zoom option. 16. The method of claim 14 or 15, wherein the first interface further comprises a manual playback button, wherein the manual playback button is configured to initiate an electronic device to display on the screen of the second interface, wherein the second interface includes a seventh image and a predetermined scaling option, and the predetermined scaling option is configured to set a scaling factor of the seventh image. 17. Method according to any one of paragraphs. 11-13, further comprising, after the step of electronically merging the images in the fifth image and the sixth image to obtain a seventh image, the steps of: receiving, by an electronic device, a second operation, the second operation being used to cause the electronic device to display a seventh image; And displaying, by an electronic device, on a screen, in response to a second operation, a second interface, the second interface comprising a seventh image and a predetermined zoom option, wherein the predetermined zoom option is configured to set a zoom factor of the seventh image; wherein the method further comprises the step of: receiving, by an electronic device, a zoom factor set by the user in the predetermined zoom option, and displaying on the screen a seventh image corresponding to the zoom factor set by the user. 18. The method of claim 17, wherein the second interface further comprises an autoplay button, wherein the autoplay button is configured to trigger the electronic device to display the first interface on a screen, wherein the first interface is configured to display a dynamic screen in which the seventh image is centered on the third area image and is automatically scaled, the seventh image contains the third area image, the viewfinder window of the third area image relative to the third camera is a sixth viewfinder window, the third viewfinder window includes a sixth viewfinder window and the sixth viewfinder window coincides with the second viewfinder window. 19. An electronic image processing device comprising a memory, a display screen and one or more processors, wherein the memory and the display screen are coupled to the processor, the memory is configured to store a computer control program, the computer control program contains computer instructions that cause, when executed, one or more processors, performing by an electronic device the method according to any one of claims. 1-10. 20. An electronic image processing device comprising a memory, a display screen and one or more processors, wherein the memory and the display screen are coupled to the processor, the memory is configured to store a computer control program, the computer control program contains computer instructions that cause, when executed, one or more processors, performing by an electronic device the method according to any one of claims. 11-18. 21. A machine-readable storage medium storing computer commands that cause, when executed by an electronic device, the electronic device to execute the method according to any one of claims. 1-18.