CN114422687B - Preview image switching method and device, electronic equipment and storage medium - Google Patents

Abstract

The present disclosure relates to a preview image switching method and device, electronic equipment, and storage media. Wherein, the method is applied to electronic equipment, including: collecting a first image through a first camera and displaying an initial preview image generated based on the first image; determining that the object distance between the first camera and the subject is less than a preset distance In the case of , switch the currently used camera from the first camera to the second camera; wherein, the focal length of the first camera is greater than the focal length of the second camera, and the size of the image sensor of the first camera is smaller than the size of the image sensor of the second camera. ; Collect the second image through the second camera, and determine the target area consistent with the image content presented in the initial preview image from the second image; determine the image content belonging to the target area in the second image as the current preview image, and switch the displayed initial preview image to the current preview image.

Description

Preview image switching method and device, electronic equipment and storage medium

Technical field

The present disclosure relates to the field of image processing, and in particular, to a preview image switching method and device, electronic equipment and storage media.

Background technique

With the continuous development of imaging technology, more and more users have joined the ranks of photography, and even created a nationwide photography craze.

Today's electronic devices, such as mobile phones, tablets, etc., are mostly equipped with multiple cameras in order to capture images with good visual effects in different shooting scenarios.

In related technologies, when a subject is close to an electronic device, a camera with a larger focal length needs to be switched to a camera with a smaller focal length to obtain a clear image. However, during this switching process, due to the sharp reduction in focal length and the increase in the size of the image sensor used with the camera, it is likely to cause the problem that only the middle area of the image obtained is clear, while the edge areas are blurred.

Contents of the invention

The present disclosure provides a preview image switching method and device, electronic equipment, and storage medium, which can avoid the problem of edge blur in the final preview image during the process of switching from a camera with a larger focal length to a camera with a smaller focal length.

According to a first aspect of the present disclosure, a preview image switching method is provided, applied to electronic devices, including:

Collect the first image through the first camera, and display the initial preview image generated based on the first image;

When it is determined that the object distance between the first camera and the subject is less than the preset distance, the currently used camera is switched from the first camera to the second camera; wherein the focal length of the first camera is greater than the focal length of the second camera, And the size of the image sensor of the first camera is smaller than the size of the image sensor of the second camera;

Collect a second image through a second camera, and determine a target area from the second image that is consistent with the image content presented in the initial preview image;

The image content belonging to the target area in the second image is determined as the current preview image, and the displayed initial preview image is switched to the current preview image.

According to a second aspect of the present disclosure, a preview image switching device is provided, applied to electronic equipment, including:

A generating unit that collects the first image through the first camera and displays an initial preview image generated based on the first image;

The first switching unit switches the currently used camera from the first camera to the second camera when it is determined that the object distance between the first camera and the subject is less than the preset distance; wherein the focal length of the first camera is greater than the second camera. The focal length of the two cameras, and the size of the image sensor of the first camera is smaller than the size of the image sensor of the second camera;

A determining unit that collects a second image through a second camera and determines a target area from the second image that is consistent with the image content presented in the initial preview image;

The second switching unit determines the image content belonging to the target area in the second image as the current preview image, and switches the displayed initial preview image to the current preview image.

According to a third aspect of the present disclosure, an electronic device is provided, including:

processor;

Memory used to store instructions executable by the processor;

Wherein, the processor implements the method described in the first aspect by running the executable instructions.

According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, computer instructions are stored thereon, and when the instructions are executed by a processor, the steps of the method described in the first aspect are implemented.

In the technical solution of the present disclosure, when a camera with a larger focal length is used to collect images, an initial preview image is displayed based on the image collected by the camera. When it is determined that the object distance between the camera and the subject is less than the preset distance, the currently used camera is switched to a camera with a smaller focal length. After switching the camera, the present disclosure does not directly use the collected image as a preview image. Instead, from the image collected after switching the camera, the target area consistent with the image content presented in the initial preview image is determined, and the target area is determined. The image content in the target area is determined to be the current preview image.

It should be understood that when switching from a camera with a larger focal length to a camera with a smaller focal length, the field of view becomes larger, and the image content in the captured image will increase, and because the relative position between the subject and the electronic device is not Changes occur and the added image content is usually displayed around the captured image. Therefore, the present disclosure only determines the determined target area as the current preview image, which is equivalent to cropping the surrounding picture (or the edge area of the image). It can be seen that compared with related technologies, the present disclosure will not display the edge area of the image collected after switching the camera, thereby avoiding the problem of blurred edges of the displayed preview image after switching from a camera with a larger focal length to a camera with a smaller focal length. .

In addition, in the above process, the target area in the second image is determined based on the initial preview image before camera switching. It can be seen that the display screen of the current preview image is consistent with the initial preview image, which avoids the jump of the preview screen during the camera switching process.

Description of the drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.

Figure 1 is a flow chart of a preview image switching method according to an exemplary embodiment of the present disclosure;

Figure 2 is a flow chart of another preview image switching method according to an exemplary embodiment of the present disclosure;

Figure 3 is a schematic diagram showing the distribution of detection areas on an image sensor according to an exemplary embodiment of the present disclosure;

Figure 4 is a schematic diagram of the relative position between a second image and a target area according to an exemplary embodiment of the present disclosure;

Figure 5 is a block diagram of a preview image switching device according to an exemplary embodiment of the present disclosure;

Figure 6 is a block diagram of another preview image switching device according to an exemplary embodiment of the present disclosure;

FIG. 7 is a schematic structural diagram of an electronic device in an exemplary embodiment of the present disclosure.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with aspects of the disclosure as detailed in the appended claims.

The terminology used in this disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "the" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

It should be understood that although the terms first, second, third, etc. may be used in this disclosure to describe various information, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of the present disclosure, the first information may also be called second information, and similarly, the second information may also be called first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "when" or "in response to determining."

Today's electronic devices, such as mobile phones, tablets, etc., are mostly equipped with multiple cameras in order to capture images with good visual effects in different shooting scenarios. For example, in a smartphone, it can include: main camera, wide-angle camera, ultra-wide-angle camera, macro camera, etc.

In related technologies, when a subject is close to an electronic device, a camera with a larger focal length needs to be switched to a camera with a smaller focal length to obtain a clear image. Wherein, when the switched camera (for example, a camera with a very small focal length such as a macro camera or an ultra-wide-angle camera) is used to shoot a close-up view, the switched shooting mode is also called a close-up mode.

However, during this switching process, due to the smaller focal length, it is likely to cause the problem that only the middle area of the image obtained is clear, while the edge areas are blurred. It should be emphasized that in practical applications, the larger the focal length of the camera, the smaller the size of the image sensor used. In other words, in the process of switching from a camera with a larger focal length to a camera with a smaller focal length, the size of the image sensor used to capture images becomes larger. Therefore, the above-mentioned problem of blurred edge areas is also known as the problem of blurred image edges caused by the increase in image sensors.

In order to solve the above problem, the present disclosure proposes a preview image switching method to solve the above technical problem of blurring the edges of the preview image after camera switching.

FIG. 1 is a flow chart of a preview image switching method according to an exemplary embodiment of the present disclosure. The method is applied to electronic equipment, as shown in Figure 1. The method may include the following steps:

Step 102: Collect the first image through the first camera and display the initial preview image generated based on the first image.

The electronic device in this disclosure may be any type of electronic device. For example, the electronic device may be a mobile terminal such as a smartphone or a tablet computer, or a fixed terminal such as a smart TV or a PC (Personal Computer). It should be understood that any electronic device that only needs to be equipped with multiple cameras and whose focal lengths are inconsistent can be used as the electronic device in the present disclosure. Which type of electronic device it is specifically applied to can be determined by those skilled in the art according to the actual situation. The requirements are determined, and this disclosure does not limit this.

In related technologies, an application with a shooting function is installed in an electronic device to control multiple cameras assembled, thereby achieving the purpose of shooting. This type of application is often called a camera application. In practical applications, after the user opens the camera application in the electronic device, the camera will automatically display the image collected by the camera. This screen is called a preview image, allowing the user to adjust the shooting parameters based on the preview image.

Similarly in the present disclosure, when the camera application in the electronic device is started, images can be collected through the currently used first camera, and then an initial preview image is generated based on the collected first image for the user to preview the collection. to the image. It should be understood that the first camera in the present disclosure can be any type of camera, for example, the first camera can be any of the main camera, wide-angle camera, ultra-wide-angle camera, etc. of the electronic device.

Step 104: When it is determined that the object distance between the first camera and the subject is less than the preset distance, switch the currently used camera from the first camera to the second camera; wherein the focal length of the first camera is greater than that of the second camera. focal length, and the size of the image sensor of the first camera is smaller than the size of the image sensor of the second camera.

In the present disclosure, a preset distance may be preset for determining whether the currently used first camera is unable to clearly capture the subject. In actual operation, the distance between the subject and the first camera, that is, the object distance, can be detected first, and then the object distance is compared with the preset distance to determine the distance between the first camera and the subject. When the distance is less than the preset distance, the currently used camera is switched to a second camera with a smaller focal length.

In the present disclosure, either traditional two-way ranging technology or one-way ranging technology can be used, or ToF (Time of flight, time of flight) ranging method can be used to measure the distance between the subject and the first camera. distance. It should be noted that any method that can measure the distance between the subject and the first camera can be used in the present disclosure, and the disclosure is not limited thereto.

As mentioned above, since the focal length of the first camera is greater than the focal length of the second camera, the image sensor used with the first camera is usually smaller in size than the image sensor used with the second camera. This is also one of the reasons why image blur occurs at the edge of the preview image in related technologies.

Step 106: Collect a second image through the second camera, and determine a target area consistent with the image content presented in the initial preview image from the second image.

In related technologies, images collected after switching cameras are directly used as preview images. It is not difficult to understand that the above-mentioned camera switching causes the focal length of the camera used to collect images and the size of the image sensor to change, which in turn leads to blurring of the edges of the collected images. If the collected images are directly used as previews image, which will inevitably lead to blurred edges in the preview image. At the same time, due to changes in the focal length of the camera and the size of the sensor, the field of view of the obtained image will inevitably change, causing an obvious image jump phenomenon when switching from the original preview image to the current preview image. From the user's perspective, the edges of the preview image are not only blurred, but the content contained in the preview image also instantly increases.

In the present disclosure, the image collected after switching the camera is no longer directly used as a preview image as in the related art, but a certain preprocessing is performed on the collected image. Specifically, the image content presented in the initial preview image displayed before switching the camera can be determined first, and after collecting the second image through the second camera, the image presented in the initial preview image can be determined from the collected second image. Target areas with consistent content. On this basis, the image content belonging to the target area in the second image can be determined as the current preview image.

It should be understood that since the present disclosure determines the current preview image from the second image based on the image content of the initial preview image after obtaining the second image, and the image contents of the two are consistent, obviously there will be no problem in the related art. Preview image jump phenomenon. In addition, the above-mentioned camera switching operation is performed when the electronic device determines that the distance between the subject and the first camera is less than the preset distance. In other words, the electronic device automatically performs the switching operation. Obviously, the relative position of the second camera and the first camera does not change at the moment of switching. It can be seen that when the camera switching causes the field of view to become larger, the image content presented in the collected second image contains the image content of the first image, and the image content of the first image is located in the center of the second image. . In other words, the determined target area is located in the center of the second image, which is equivalent to the extra image content of the second image relative to the first image being located around the second image (or in the edge area). It can be seen that determining the target area as the current preview image is equivalent to cropping the edge area in the second image and using the remaining portion as the current preview image, that is, cropping the blurred area in the related technology and displaying it.

In the present disclosure, the target area may be determined from the second image in various ways.

In one embodiment, multiple reference objects may be determined from the image content presented in the initial preview image, and based on the determined multiple reference objects, the image content presented in the initial preview image may be determined from the second image. Consistent target area. For example, after multiple reference objects are determined, the relative positional relationship between the multiple reference objects may be further determined to determine the target area from the second image based on the determined multiple reference objects and the relative positional relationship.

In another embodiment, the center point and field of view angle of the initial preview image may be determined first, and then the target point corresponding to the center point is determined in the second image, so as to start from the first preview image based on the determined target point and field of view angle. Determine the target area in the two images. It should be understood that the field of view determines how much content is included in the image. It can be seen that on the basis of determining the center point of the first image, only the corresponding target point is determined in the second image, and the image content consistent with the image presented in the initial preview image can be determined from the second image based on the field of view. area, that is, the target area.

In practical applications, the edge blurring phenomenon means that the image content in the center of the image remains clear. This situation only occurs when the subject is a planar object perpendicular to the optical axis of the camera. Just imagine, if the subject is not a plane object perpendicular to the optical axis of the camera, assuming that the center of the image is the focus point, and the image content near the center is not on the same plane as the center point, it is obvious that blur will appear in the non-edge area, and In the edge area, there may be an area on the same plane as the center point, but it is clear. It can be seen that in the present disclosure, it is also necessary to determine whether the object is a plane object perpendicular to the optical axis of the first camera. Only when the object is determined to be a plane object perpendicular to the optical axis of the first camera, the operation of switching the currently used camera from the first camera to the second camera is performed; otherwise, the switching operation is not performed.

Under ideal conditions, when the distance between the subject and each detection area on the image sensor is equal, the subject can be considered to be a plane object perpendicular to the optical axis of the camera (for convenience of expression, in the following text, "perpendicular to the camera" will be used) Plane object with optical axis" is referred to as "planar object"). However, in actual situations, errors are inevitable and it is difficult to achieve complete equality. For this reason, the present disclosure presets an object distance difference to determine whether the subject is a planar object. It should be understood that since the actual area of the image sensor is small, the area difference between the image sensor and the subject is usually large. If the actual distance between the image sensor and the subject is directly detected, only the area between the subject and the image sensor can be determined. Whether equal-sized areas are planes, it cannot be truly determined that the image contents contained in the collected images are all in the same plane. To this end, in this disclosure, a phase focusing method is adopted to determine the equivalent object distance between the image content collected in each detection area of the image sensor and the corresponding object, and by comparing the equivalent object distance, it is determined whether the subject is photographed. is a flat object.

In actual operation, at least two detection areas can be determined first in the image sensor corresponding to the first camera, and phase focusing is performed based on the determined at least two detection areas respectively to obtain focus data of each detection area; On this basis, the equivalent object distance corresponding to each detection area can be calculated based on the obtained focus data, and the object distance difference between any two of at least two equivalent object distances can be further determined; if any of the above two If the object distance difference between the two objects is less than the preset object distance difference, it can be determined that the object being photographed is a plane object; otherwise, it is determined that the object being photographed is not a plane object.

It should be noted that the above equivalent object distance does not refer to the distance between the camera and the subject in the traditional sense, but refers to the equivalent object distance between the image content collected in a certain detection area on the image sensor and its object. In other words, the equivalent object distance is a calculated virtual distance specifically used to determine whether the subject is a planar object, rather than an actual distance. It can be understood as: after the image sensor is simulated and enlarged to an area as large as the subject, the measured distance between each detection area and the corresponding position in the subject is measured.

In order to further improve the accuracy of determining whether the subject is a flat object. The determined at least two detection areas may include: a first area located at the center of the image sensor of the first camera, and at least a pair of detection areas symmetrically arranged with the first area as a reference. For example, in a square image sensor, in addition to the first area located at the center of the square, it may also include four equally large detection areas located at the four corners. Of course, this example is only illustrative, and the setting of the detection area can be determined by those skilled in the art according to actual needs, and the present disclosure does not limit this.

Step 108: Determine the image content belonging to the target area in the second image as the current preview image, and switch the displayed initial preview image to the current preview image.

In the present disclosure, after the target area is determined from the second image, the image content belonging to the target area in the second image can be determined as the current preview image, and the displayed initial preview image can be switched to the current preview image.

During the switching process, since the image content of the current preview image is consistent with that of the initial preview image, there will be no jump in the preview image screen in the related technology. At the same time, since the present disclosure switches the first camera with a larger focal length to a second camera with a smaller focal length when it is determined that the object distance between the subject and the camera is less than the preset distance, it can obviously improve the clarity of the picture. It can be seen that the present disclosure improves the clarity of the preview image while avoiding jumps in the preview image.

In related technology, when the distance between the subject and the camera is lower than a certain threshold, the camera application is switched to macro mode. During this switching process, the camera application needs to be restarted, and the electronic device needs to be equipped with a corresponding macro camera in advance so that the currently used camera can be switched to the macro camera when the camera mode is switched to macro mode. The process is complicated, and the preview image also jumps due to changes in camera focus.

In one case of the present disclosure, the first camera may be a wide-angle camera, and the second camera may be an ultra-wide-angle camera. In this case, when the object distance between the subject and the first camera is less than the preset distance, the wide-angle camera can be switched to the ultra-wide-angle camera. This process includes the above-mentioned operation of determining the target object and switching between preview images. It should be understood that due to the cropping of the image, the advantage of the traditional ultra-wide-angle camera's large field of view is eliminated, and at the same time, the advantage of the ultra-wide-angle camera's smaller focal length is used to achieve close-range shooting. In short, the technical solution of the present disclosure can use an ultra-wide-angle camera to achieve macro photography, avoiding the limitations of the related technology of needing to switch camera modes to perform macro photography, and the limitation of having to install a macro camera.

Of course, if it is determined that the subject is not a planar object perpendicular to the optical axis of the first camera, macro photography cannot be achieved through the above-mentioned ultra-wide-angle camera. In this case, the present disclosure may also switch the shooting mode of the electronic device to the macro mode to collect images through the macro camera as in the related art. Specifically, you can restart the camera application to switch to macro mode, and switch the currently used camera to the macro camera.

It can be seen from the above technical solution that when the object distance between the camera and the subject is determined to be less than the preset distance, the present disclosure switches the currently used camera from a camera with a larger focal length to a camera with a smaller focal length. And after switching the camera, the present disclosure does not directly use the collected image as the preview image. Instead, from the image collected after switching the camera, the target area consistent with the image content presented in the initial preview image is determined, and The image content in the target area is determined to be the current preview image.

It should be understood that when switching from a camera with a larger focal length to a camera with a smaller focal length, the field of view becomes larger, the image content in the captured image increases, and the relative position between the subject and the electronic device does not change. Variation, increased image content is usually displayed around the captured image. Therefore, the present disclosure only determines the determined target area as the current preview image, which is equivalent to cropping the surrounding picture (or edge area). It can be seen that compared with related technologies, the present disclosure does not display the edge area of the image collected after switching the camera, thereby avoiding the problem of blurring the edges of the preview image when switching from a camera with a larger focal length to a camera with a smaller focal length. .

In addition, in the above process, the target area in the second image is determined based on the initial preview image before camera switching. It can be seen that the display screen of the current preview image is consistent with the initial preview image, which avoids the jump of the preview screen during the camera switching process.

It should be stated that in this disclosure, the operations of detecting whether the object distance is smaller than the preset distance and switching cameras are automatically performed by electronic devices. From the user's perspective, only the preview screen in the electronic device becomes clear. There is no problem of picture jump and edge blur in this process, which improves the user's shooting experience.

Below, the technical solution of the present disclosure will be introduced by taking a smartphone equipped with multiple cameras as an example.

Figure 2 shows another preview image switching method according to an exemplary embodiment of the present disclosure. The method is applied to a smartphone equipped with multiple cameras. As shown in Figure 2, the method may include the following steps:

Step 201: Collect a first image through a wide-angle camera.

Smartphones can include multiple cameras such as main camera, wide-angle camera, ultra-wide-angle camera, etc. This embodiment takes switching from a wide-angle camera to an ultra-wide-angle camera as an example.

Smartphones can use wide-angle cameras in multiple scenarios. For example, when the user needs to take pictures of indoor furnishings, in order to include more items in the captured images, the wide-angle camera can be used to take pictures.

Step 202: Display an initial preview image based on the collected first image.

Following the above example, when the user is using the wide-angle camera to take pictures of indoor furnishings, he may suddenly want to take a picture of a certain furnishing and then get closer to the furnishing. At this time, images can still be collected through the wide-angle camera and the image sensor used with it, and the collected image can be used as the first image in this step. Further, an initial preview image can be displayed on the screen of the smartphone based on the first image.

Step 203: Determine whether the distance between the subject and the wide-angle camera is less than the preset distance; if so, jump to step 204; otherwise, jump to step 211.

In this embodiment, a preset distance can be set based on the focal length of the wide-angle camera and the ultra-wide-angle camera. The preset distance is smaller than the object distance calculated based on the focal length of the wide-angle camera and the imaging formula. The specific value of the preset distance can be determined by this method. Field technicians determine based on actual needs.

Following the above example, when the user approaches the above furnishings, the ToF distance measurement method can be used to detect the object distance between the object being measured and the wide-angle camera. When the detected object distance is smaller than the preset distance, the object distance can be further detected. Whether the photographed object is a flat object.

It should be noted that the plane object in this embodiment is not an absolute plane. It should be understood that for any object, when it is close to a certain extent, the distance difference between each part of the object and the camera is small, and the object can also be determined as a planar object.

Step 204: Determine whether the object is a planar object; if so, jump to step 205; otherwise, jump to step 211.

In this embodiment, five detection areas can be determined first on the image sensor corresponding to the wide-angle camera, and the equivalent object distances between these five detection areas and the corresponding physical objects can be determined respectively. And based on the distance difference between any two of the five determined equivalent object distances and the preset distance difference, it is judged whether the subject is a planar object.

For example, the detection area on the image sensor can be as shown in Figure 3. Assuming that the shape of the image sensor is a square with a side length of 1, then a square detection area with a side length of 0.3 can be taken at the center of the image sensor, and a square detection area with a side length of 0.2 can be taken at the four corners of the image sensor. And it can be marked as detection area A and detection areas B1 to B4 as shown in Figure 3 . On this basis, it is assumed that the measured equivalent object distance corresponding to the detection area A is X1, and the measured equivalent object distance corresponding to the detection areas B1 to B4 is X2 to X5. In this step, the object distance difference between any two of them can be calculated separately, that is, calculate X1-X2, X1-X3, X1-X4, X1-X5, X2-X3, X2-X4, X2-X5, X3-X4, X3-X5, and Make sure the subject is a flat object.

Step 205: Switch the wide-angle camera to the ultra-wide-angle camera.

Step 206: Collect the second image through the wide-angle camera.

Step 207: Determine multiple reference objects from the initial preview image.

Step 208: Determine a target area from the second image that is consistent with the image content presented in the initial preview image based on multiple reference objects.

After switching from the wide-angle camera to the ultra-wide-angle camera, the focal length of the camera becomes smaller and the image sensor it is paired with becomes larger. Correspondingly, the field of view of the second image collected also becomes larger and the image content also increases. If the second image is directly used as the preview image, the edge area is likely to be blurred and the preview image will jump.

To this end, this embodiment prioritizes determining multiple reference objects from the initial preview image, and uses these multiple reference objects as standards to determine the target area from the second image that is consistent with the image content presented in the initial preview image, and The image content contained in the target area serves as the current preview image.

In this process, the relationship between the second image and the target area can be as shown in FIG. 4 , and the image content contained in the target area is consistent with the image content presented in the initial preview image.

It can be clearly known from Figure 4 that the edge area (shaded area) in the second image will not be displayed as the current preview image, which can obviously avoid the blurring of the image edge area in the related art.

Step 209: Determine the image content contained in the determined target area as the current preview image.

Step 210: Switch the initial preview image to the current preview image.

Step 211: No camera switching operation is performed.

In this embodiment, if the distance between the camera and the subject is not less than the preset distance, or the subject is not a plane object, the camera switching operation is not performed. Of course, when the distance between the camera and the subject is less than the preset distance, but the subject is not a flat object, you can switch the smartphone to macro mode to complete macro photography of non-planar objects through the macro camera. .

It can be seen from the above technical solutions that the first camera in the present disclosure may be a wide-angle camera, and the second camera may be an ultra-wide-angle camera. When it is detected that the distance between the wide-angle camera and the subject is less than the preset distance, the wide-angle camera can be switched to the ultra-wide-angle camera. It is not difficult to understand that the present disclosure takes advantage of the smaller focal length of the ultra-wide-angle camera to achieve close-up shooting, which is equivalent to realizing macro photography through the ultra-wide-angle camera. At the same time, the target area is determined from the second image based on the initial preview image as the current preview image, which not only avoids the blurring of the edge area but also prevents the preview image from jumping.

FIG. 5 is a block diagram of a preview image switching device according to an exemplary embodiment of the present disclosure. Referring to FIG. 5 , the device includes a generating unit 501 , a first switching unit 502 , a determining unit 503 and a second switching unit 504 .

The generation unit 501 is configured to collect a first image through a first camera and display an initial preview image generated based on the first image;

The first switching unit 502 is configured to switch the currently used camera from the first camera to the second camera when it is determined that the object distance between the first camera and the subject is less than the preset distance; wherein, the first camera The focal length is greater than the focal length of the second camera, and the size of the image sensor of the first camera is smaller than the size of the image sensor of the second camera;

The determination unit 503 is configured to collect a second image through a second camera, and determine a target area from the second image that is consistent with the image content presented by the initial preview image;

The second switching unit 504 is configured to determine the image content belonging to the target area in the second image as the current preview image, and switch the displayed initial preview image to the current preview image.

Optionally, the determination unit 503 is further assembled as:

Determine multiple reference objects in the image content presented in the initial preview image;

According to the plurality of reference objects, a target area consistent with the image content presented in the initial preview image is determined from the second image.

Optionally, the determination unit 503 is further assembled as:

Determine the center point and field of view angle of the initial preview image;

A target point corresponding to the center point is determined in the second image, and a target area consistent with the image content presented in the initial preview image is determined from the second image based on the target point and the field of view angle.

As shown in Figure 6, Figure 6 is a block diagram of another preview image switching device according to an exemplary embodiment of the present disclosure. Based on the aforementioned embodiment shown in Figure 5, this embodiment also includes: a judgment unit 505, Execution unit 506 and third switching unit 507.

optional,

The judging unit 505 is equipped to judge whether the photographed object is a planar object perpendicular to the optical axis of the first camera;

The execution unit 506 is configured to perform an operation of switching the currently used camera from the first camera to the second camera when the subject is determined to be a planar object perpendicular to the optical axis of the first camera.

Optionally, the judgment unit 505 is further configured as:

Determine at least two detection areas in the image sensor of the first camera, and perform phase focusing based on the at least two detection areas respectively to obtain focus data of each detection area;

Based on the obtained focus data, calculate the equivalent object distance corresponding to each detection area, and determine the object distance difference between any two of at least two equivalent object distances;

When it is determined that the object distance difference between any two objects is less than the preset object distance difference, it is determined that the photographed object is a plane object perpendicular to the optical axis of the first camera; otherwise, the photographed object Not a planar object perpendicular to the optical axis of the first camera.

Optionally, the at least two detection areas include:

A first area located at the center of the image sensor of the first camera, and at least a pair of detection areas symmetrically arranged with the first area as a reference.

optional,

The third switching unit 507 is configured to switch the shooting mode of the electronic device to the macro mode to use the macro camera when it is determined that the subject is not a planar object perpendicular to the optical axis of the first camera. Perform image acquisition.

As for the device embodiment, since it basically corresponds to the method embodiment, please refer to the partial description of the method embodiment for relevant details. The device embodiments described above are only illustrative. The units described as separate components may or may not be physically separated. The components shown as units may or may not be physical units, that is, they may be located in One location, or it can be distributed across multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the disclosed solution. Persons of ordinary skill in the art can understand and implement the method without any creative effort.

Correspondingly, the present disclosure also provides a preview image switching device, including: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to implement the method described in any one of the above embodiments. Preview image switching method, for example, the method may include: collecting a first image through a first camera and displaying an initial preview image generated based on the first image; determining that the object distance between the first camera and the subject is less than a preset distance In the case of , switch the currently used camera from the first camera to the second camera; wherein, the focal length of the first camera is greater than the focal length of the second camera, and the size of the image sensor of the first camera is smaller than the size of the image sensor of the second camera. ; Collect the second image through the second camera, and determine the target area consistent with the image content presented in the initial preview image from the second image; determine the image content belonging to the target area in the second image as the current preview image, and switch the displayed initial preview image to the current preview image.

Correspondingly, the present disclosure also provides an electronic device. The electronic device includes a memory and one or more programs, wherein the one or more programs are stored in the memory and configured to be processed by one or more processors. Executing the one or more programs includes instructions for implementing the preview image switching method as described in any of the above embodiments. For example, the method may include: collecting a first image through a first camera and displaying a preview image based on the first image. The initial preview image generated;

When it is determined that the object distance between the first camera and the subject is less than the preset distance, the currently used camera is switched from the first camera to the second camera; wherein the focal length of the first camera is greater than the focal length of the second camera, And the size of the image sensor of the first camera is smaller than the size of the image sensor of the second camera; the second image is collected through the second camera, and a target area consistent with the image content presented in the initial preview image is determined from the second image ; Determine the image content belonging to the target area in the second image as the current preview image, and switch the displayed initial preview image to the current preview image.

FIG. 7 is a block diagram of a device 700 for implementing preview image switching according to an exemplary embodiment. For example, the device 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like.

Referring to Figure 7, the device 700 may include one or more of the following components: a processing component 702, a memory 704, a power supply component 706, a multimedia component 708, an audio component 710, an input/output (I/O) interface 712, a sensor component 714, and communications component 716.

Processing component 702 generally controls the overall operations of device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to complete all or part of the steps of the above method. Additionally, processing component 702 may include one or more modules that facilitate interaction between processing component 702 and other components. For example, processing component 702 may include a multimedia module to facilitate interaction between multimedia component 708 and processing component 702.

Memory 704 is configured to store various types of data to support operations at device 700 . Examples of such data include instructions for any application or method operating on device 700, contact data, phonebook data, messages, pictures, videos, etc. Memory 704 may be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EEPROM), Programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

Power supply component 706 provides power to the various components of device 700 . Power supply component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to device 700 .

Multimedia component 708 includes a screen that provides an output interface between the device 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide action. In some embodiments, multimedia component 708 includes a front-facing camera and/or a rear-facing camera. When the device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front-facing camera and rear-facing camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

Audio component 710 is configured to output and/or input audio signals. For example, audio component 710 includes a microphone (MIC) configured to receive external audio signals when device 700 is in operating modes, such as call mode, recording mode, and speech recognition mode. The received audio signal may be further stored in memory 704 or sent via communication component 716 . In some embodiments, audio component 710 also includes a speaker for outputting audio signals.

The I/O interface 712 provides an interface between the processing component 702 and a peripheral interface module, which may be a keyboard, a click wheel, a button, etc. These buttons may include, but are not limited to: Home button, Volume buttons, Start button, and Lock button.

Sensor component 714 includes one or more sensors that provide various aspects of status assessment for device 700 . For example, sensor component 714 can detect the open/closed state of device 700, the relative positioning of components, such as the display and keypad of device 700, and sensor component 714 can also detect a change in position of device 700 or a component of device 700. , the presence or absence of user contact with device 700 , device 700 orientation or acceleration/deceleration and temperature changes of device 700 . Sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

Communication component 716 is configured to facilitate wired or wireless communication between apparatus 700 and other devices. The device 700 can access a wireless network based on communication standards, such as WiFi, 2G or 3G, 4G LTE, 7G NR (New Radio) or a combination thereof. In one exemplary embodiment, communication component 716 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communications component 716 also includes a near field communications (NFC) module to facilitate short-range communications. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, apparatus 700 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable Gate array (FPGA), controller, microcontroller, microprocessor or other electronic components are implemented for executing the above method.

In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions, such as a memory 704 including instructions, which are executable by the processor 720 of the device 700 to complete the above method is also provided. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

Other embodiments of the disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the disclosure herein. The present disclosure is intended to cover any variations, uses, or adaptations of the disclosure that follow the general principles of the disclosure and include common common sense or customary technical means in the technical field that are not disclosed in the disclosure. . It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise structures described above and illustrated in the accompanying drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the disclosure is limited only by the appended claims.

The above are only preferred embodiments of the present disclosure and are not intended to limit the present disclosure. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present disclosure shall be included in this disclosure. within the scope of protection.

Claims (8)

1. A preview image switching method, characterized in that it is applied to electronic devices, including: Collect the first image through the first camera, and display the initial preview image generated based on the first image; When it is determined that the object distance between the first camera and the subject is less than the preset distance, the currently used camera is switched from the first camera to the second camera; wherein the focal length of the first camera is greater than the focal length of the second camera, And the size of the image sensor of the first camera is smaller than the size of the image sensor of the second camera; Collect a second image through a second camera, and determine a target area from the second image that is consistent with the image content presented in the initial preview image; Determine the image content belonging to the target area in the second image as the current preview image, and switch the displayed initial preview image to the current preview image; Wherein, determining a target area from the second image that is consistent with the image content presented in the initial preview image includes: determining a plurality of reference objects in the image content presented in the initial preview image; A reference object is used to determine a target area consistent with the image content presented in the initial preview image from the second image; or, Determining a target area consistent with the image content presented in the initial preview image from the second image includes: determining the center point and field of view angle of the initial preview image; determining in the second image the target area that is consistent with the image content presented in the initial preview image. A target point corresponding to the center point, and based on the target point and the field of view angle, a target area consistent with the image content presented in the initial preview image is determined from the second image. 2. The method of claim 1, further comprising: Determine whether the photographed object is a plane object perpendicular to the optical axis of the first camera; When it is determined that the photographed object is a planar object perpendicular to the optical axis of the first camera, an operation of switching the currently used camera from the first camera to the second camera is performed. 3. The method of claim 2, wherein determining whether the photographed object is a plane object perpendicular to the optical axis of the first camera includes: Determine at least two detection areas in the image sensor of the first camera, and perform phase focusing based on the at least two detection areas respectively to obtain focus data for each detection area; Based on the obtained focus data, calculate the equivalent object distance corresponding to each detection area, and determine the object distance difference between any two of at least two equivalent object distances; When it is determined that the object distance difference between any two objects is less than the preset object distance difference, it is determined that the photographed object is a plane object perpendicular to the optical axis of the first camera; otherwise, the photographed object Not a planar object perpendicular to the optical axis of the first camera. 4. The method according to claim 3, characterized in that the at least two detection areas include: A first area located at the center of the image sensor of the first camera, and at least a pair of detection areas symmetrically arranged with the first area as a reference. 5. The method of claim 3, further comprising: If it is determined that the object being photographed is not a plane object perpendicular to the optical axis of the first camera, the shooting mode of the electronic device is switched to a macro mode to collect images through the macro camera. 6. A preview image switching device, characterized in that it is applied to electronic equipment and includes: A generating unit that collects the first image through the first camera and displays an initial preview image generated based on the first image; The first switching unit switches the currently used camera from the first camera to the second camera when it is determined that the object distance between the first camera and the subject is less than the preset distance; wherein the focal length of the first camera is greater than the second camera. The focal length of the two cameras, and the size of the image sensor of the first camera is smaller than the size of the image sensor of the second camera; A determining unit that collects a second image through a second camera and determines a target area from the second image that is consistent with the image content presented in the initial preview image; A second switching unit determines the image content belonging to the target area in the second image as the current preview image, and switches the displayed initial preview image to the current preview image; Wherein, determining a target area from the second image that is consistent with the image content presented in the initial preview image includes: determining a plurality of reference objects in the image content presented in the initial preview image; A reference object is used to determine a target area consistent with the image content presented in the initial preview image from the second image; or, Determining a target area consistent with the image content presented in the initial preview image from the second image includes: determining the center point and field of view angle of the initial preview image; determining in the second image the target area that is consistent with the image content presented in the initial preview image. A target point corresponding to the center point, and based on the target point and the field of view angle, a target area consistent with the image content presented in the initial preview image is determined from the second image. 7. An electronic device, characterized in that it includes: processor; Memory used to store instructions executable by the processor; Wherein, the processor implements the method according to any one of claims 1-5 by running the executable instructions. 8. A computer-readable storage medium having computer instructions stored thereon, characterized in that when the instructions are executed by a processor, the steps of the method according to any one of claims 1-5 are implemented.