CN108881733B - Panoramic shooting method and mobile terminal - Google Patents

Abstract

The present invention provides a panorama shooting method and a mobile terminal. The mobile terminal includes a foldable first display screen, the first display screen includes a first display area and a second display area, and a first camera is arranged on the back of the first display area. module, the back of the second display area is provided with a second camera module; the method includes: when the first angle between the first display area and the second display area satisfies a preset condition, The camera module obtains the first and second images respectively; receives the first input that the user controls the first display area to move to the second display area; in response to the first input, in the process of reducing the first included angle, the The camera module acquires the first image sequence; performs image stitching according to the first image, the second image and the first image sequence to generate a first panoramic image. The invention can increase the shooting angle and image clarity, and improve the panoramic shooting effect.

Description

A panorama shooting method and mobile terminal

technical field

The present invention relates to the field of communication technologies, and in particular, to a panorama shooting method and a mobile terminal.

Background technique

With the continuous development of electronic technology, people have higher and higher requirements for panoramic shooting of mobile terminals. Most of the existing mobile terminals are used to manually rotate the imaging device for panoramic shooting, so it is difficult to ensure that the imaging device is in the During the rotation process, it is always kept at the same level, and due to the influence of the environment, the imaging device is also prone to jitter during the rotation and movement.

Therefore, the existing panoramic shooting process has the following defects:

Since the movement is a dynamic process, the exposure time of the camera module during panorama shooting is not enough, the resolution of the panorama image is not enough, the pixels are not high, and it is easy to be broken; during the panorama shooting process, the rotation speed of the mobile terminal and the vertical shake in the horizontal direction during rotation The amplitude is not easy to control, and it is easy to affect the shooting effect.

At present, most of the mobile terminal industry is a single-sided screen. When using the rear camera for panoramic shooting, the user needs to hold the mobile terminal, take the waist and foothold of the person as the axis, and move the camera module to perform panoramic shooting. This posture is due to The arm is long, it is easy to shake when moving and rotating, and the shooting angle range is relatively small.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a panorama shooting method and a mobile terminal, so as to solve the problems in the prior art that the panorama shooting is prone to poor image definition, shaking during shooting affects shooting, and the shooting angle range is limited.

In order to solve the above problems, the embodiments of the present invention are implemented as follows:

In a first aspect, an embodiment of the present invention provides a panorama shooting method, which is applied to a mobile terminal. The mobile terminal includes a foldable first display screen. The first display screen includes a first display area and a second display area. The first display area The back of the display area is provided with a first camera module, and the back of the second display area is provided with a second camera module; the method includes:

When the first included angle between the first display area and the second display area satisfies the preset condition, obtaining the first image through the first camera module and obtaining the second image through the second camera module;

receiving a first input from a user controlling the first display area to move to the second display area;

In response to the first input, in the process of reducing the first included angle, acquiring the first image sequence through the first camera module;

Image stitching is performed according to the first image, the second image and the first image sequence to generate a first panoramic image.

In a second aspect, an embodiment of the present invention provides a mobile terminal, the mobile terminal includes a foldable first display screen, the first display screen includes a first display area and a second display area, and the back of the first display area is provided with a first display screen. A camera module, the back of the second display area is provided with a second camera module; the mobile terminal further includes:

The first acquisition module is used to acquire the first image through the first camera module and acquire the second image through the second camera module when the first angle between the first display area and the second display area satisfies the preset condition. image;

a first receiving module, configured to receive a first input from a user to control the movement of the first display area to the second display area;

a second acquisition module, configured to acquire the first image sequence through the first camera module during the process of reducing the first included angle in response to the first input;

The first generating module is configured to perform image stitching according to the first image, the second image and the first image sequence to generate a first panoramic image.

In a third aspect, an embodiment of the present invention further provides a mobile terminal, including a processor, a memory, and a computer program stored in the memory and running on the processor, the computer program being executed by the processor to realize the above-mentioned panorama shooting method. step.

In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the above-mentioned panoramic shooting method are implemented.

The technical solution of the present invention is that when the folding angle of the detachable display screen satisfies the preset conditions, the first camera module and the second camera module are used for shooting, and then the rotation of the display area in which the first camera module is arranged on the back is used. The first camera module performs continuous shooting, and synthesizes the images captured by the two camera modules to generate a panoramic image, which enables users to obtain panoramic images through convenient and reliable operations, and is less prone to shaking during the shooting process, increasing the number of images. The shooting angle and image clarity greatly improve the effect of panoramic shooting and ensure the fun and experience of shooting images for users.

Description of drawings

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

FIG. 1a shows a schematic diagram 1 of a first display screen according to an embodiment of the present invention;

Fig. 1b shows a second schematic diagram of the first display screen according to the embodiment of the present invention;

Fig. 1c shows a schematic diagram of a first camera module disposed on the back of the first display area according to an embodiment of the present invention;

Fig. 1d shows a schematic diagram of setting a second camera module on the rear shell of the mobile terminal on the back of the second display area according to the embodiment of the present invention;

2 shows a schematic diagram of a panoramic shooting method according to an embodiment of the present invention;

3 shows a schematic diagram of a second display screen and a first camera module according to an embodiment of the present invention;

FIG. 4 shows a schematic diagram of a mobile terminal according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a hardware structure of a mobile terminal according to an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

An embodiment of the present invention provides a panorama shooting method, which is applied to a mobile terminal. As shown in FIG. 1a to FIG. 1d, the mobile terminal includes a foldable first display screen 1, and the first display screen 1 includes a first display area 11 and a first display screen Two display areas 12, the back of the first display area 11 is provided with a first camera module 111, and the back of the second display area 12 is provided with a second camera module 121; as shown in FIG. 2, the method includes:

Step 201: When the first included angle between the first display area and the second display area satisfies a preset condition, acquire the first image through the first camera module and acquire the second image through the second camera module.

The embodiment of the present invention is applied to a mobile terminal including a foldable display screen. For details, please refer to FIG. 1a to FIG. 1d. The sum of the areas of the first display area 11 and the second display area 12 is equal to the total area of the folding screen. The first camera module 111 is located at the back of the first display area 11 and is opposite to the first display area 11 , and the second camera module 121 is located at the back of the second display area 12 and is opposite to the second display area 12 .

The folding angle of the folding screen is between zero degrees and 180 degrees. When the folding angle of the folding screen is zero, the first display area 11 and the second display area 12 are attached. When the folding angle of the folding screen is 180 degrees, the first display area 11 A display area 11 and a second display area 12 form a plane.

When the mobile terminal is in a folded state, the mobile terminal needs to detect the first angle between the first display area and the second display area. When it is determined that the first angle meets the preset condition, the mobile terminal can control the back of the first display area. The first camera module and the second camera module on the back of the second display area perform the shooting process. Since the mobile terminal is in a static state in the current state, the first camera module and the second camera module can obtain relatively clear images. image.

The purpose of shooting when it is determined that the first included angle meets the preset conditions is to ensure that the first camera module and the second camera module can use their corresponding horizontal shooting angles for framing, and the images captured according to the framing can be stitched together. . After static photography is performed by the first camera module and the second camera module to obtain the first image and the second image, step 202 needs to be continued.

Step 202: Receive a first input from the user for controlling the movement of the first display area to the second display area.

After the first camera module and the second camera module are used for static photography, and the first image and the second image are obtained respectively, the first input from the user to control the movement of the first display area to the second display area can be received. The first included angle between a display area and the second display area decreases.

Step 203: In response to the first input, in the process of reducing the first included angle, acquire the first image sequence through the first camera module.

When receiving a first input from the user controlling the first display area to move to the second display area, keeping the first camera module on and turning off the second camera module in response to the first input. During the process of decreasing the first included angle, the first camera module may perform continuous shooting, and the first image sequence may be acquired according to the dynamic shooting process of the first camera module.

It should be noted that, when the first camera module and the second camera module perform static shooting, both the first camera module and the second camera module have blind spots, and the second camera module is kept open in the first camera module. After the group is closed and the dynamic shooting is performed by the first camera module in the process of reducing the first included angle, the viewing range can be expanded and the effect of panoramic shooting can be improved.

For example, if the horizontal shooting angles corresponding to the first camera module and the second camera module are both 50 degrees, then in the state that the first included angle satisfies the preset condition, the first camera module and the second camera module After framing with their corresponding horizontal shooting angles, there is still a shooting blind spot greater than or equal to 260 degrees. At this time, by rotating the first display area, controlling the first display area to rotate in the direction of the second display area, reducing the angle of the first included angle, and using the first camera module to perform dynamic shooting during the rotation process, the viewfinder can be enlarged scope.

Among them, the minimum angle value of the first included angle can be reduced to zero degrees. When the angle of the first included angle changes to zero, the first display area is in contact with the second display area. At this time, although the viewing range is enlarged, it still cannot Realize 360-degree viewing. For example, in the case where the horizontal shooting angles corresponding to the first camera module and the second camera module are both 50 degrees, the blind area of the first camera module is 65 degrees (90 degrees-50 degrees/2), and the corresponding The blind area of the second camera is 65 degrees (90 degrees-50 degrees/2), that is, the static shooting of the first camera module and the second camera module is completed, and the first camera module changes to zero at the first angle. After dynamic shooting during the process, the corresponding blind spot for framing is 130 degrees, that is, the combination of the two camera modules can achieve 230-degree framing during this process, which expands the framing range compared to the static shooting process.

Step 204: Perform image stitching according to the first image, the second image and the first image sequence to generate a first panoramic image.

Obtaining the first image statically shot by the first camera module, the second image statically shot by the second camera module, and the first image sequence obtained by the first camera module performing dynamic shooting during the first angle reduction process Afterwards, stitching may be performed according to the first image, the second image and the first image sequence, and a first panoramic image may be generated according to the stitching result.

In the solution provided by the embodiment of the present invention, the first camera module and the second camera module can be used for shooting in front, and then the first camera module can be used for continuous shooting according to the rotation of the display area where the first camera module is arranged on the back. The images captured by the two camera modules are synthesized and processed to generate a panoramic image, which enables users to obtain panoramic images through convenient and reliable operations, and is less prone to shaking during the shooting process, increasing the shooting angle and image clarity, greatly improving The effect of panoramic shooting.

In the embodiment of the present invention, when the first angle between the first display area and the second display area satisfies the preset condition, the first image is acquired by the first camera module and the second image is acquired by the second camera module The step of image includes: detecting the angle value of the first included angle; when the angle value of the first included angle is within the preset angle range, acquiring the first image through the first camera module and passing the second camera module Acquiring a second image; wherein, the minimum angle in the preset angle range is the angle at which the first camera module and the second camera module perform non-overlapping framing at respective horizontal shooting angles of view and obtain a stitched image.

Before static photography is performed by the first camera module and the second camera module, the angle value of the first angle between the first display area and the second display area needs to be detected by the gyroscope. After the angle value, it is necessary to judge whether the angle value of the first included angle is within the preset angle range, and if the angle value of the first included angle is within the preset angle range, it is determined that the first included angle satisfies the preset condition. At the same time, static shooting can be performed through the first camera module and the second camera module.

The minimum angle in the preset angle range here is the angle that can ensure that the two camera modules can use their respective horizontal shooting angles for non-overlapping framing, and the obtained images can be stitched together, and the preset angle range is such that the two camera modules can be The range of angles within which images can be stitched by shooting at their respective horizontal shooting angles. For example, the minimum angle value in the preset angle range is 133 degrees. When the first angle is 133 degrees, the two camera modules can be used for non-overlapping framing at their respective horizontal shooting angles, and the obtained images can be stitched together. The preset angle range here may be set to be 133 degrees to 138 degrees, and when the first included angle is equal to 133 degrees or 138 degrees or located between the two, it can be determined that the first included angle satisfies the preset condition. Of course, for the case where the angle value of the first included angle is greater than 133 degrees and less than or equal to 138 degrees, the viewing ranges of the two camera modules overlap, and the overlapping area needs to be cropped during splicing. It should be noted that, the preset angle range can be set according to the actual situation, and the above is only an enumerated implementation situation.

By detecting the angle value of the first included angle, it can be determined that the first camera module and the second camera module are used for shooting on the premise that the requirements are met, so as to ensure the availability and validity of the captured image.

Wherein, when the angle value of the first included angle is not within the preset angle range, the method further includes outputting prompt information for prompting the user to adjust the angle value of the first included angle. That is, if the angle value of the first included angle does not meet the preset conditions, the mobile terminal may output prompt information through the first display area or the second display area, and the prompt information may include information on how to adjust the angle value of the first included angle, which is convenient for The user can quickly and accurately adjust the angle according to the prompt information.

In the embodiment of the present invention, after obtaining the first image through the first camera module and obtaining the second image through the second camera module, the method further includes: displaying the first image obtained by the first camera module through the first display area. and displaying the second image obtained by the second camera module through the second display area.

After using the two camera modules for static shooting, since the first camera module is disposed on the back of the first display area, the first image captured by the first camera module can be displayed through the first display area in response to the shooting process. Since the second camera module is arranged on the back of the second display area, the second image captured by the second camera module can be displayed through the second display area in response to the shooting process. visual experience.

After obtaining the first image sequence through the first camera module, the method further includes: displaying the first image sequence obtained by the first camera module through the first display area. In the process that the first display area moves to the second display area and the angle value of the first angle decreases, after the first image sequence is acquired by dynamic shooting by the first camera module, the first camera can be monitored by the first display area. The first image sequence captured by the module is displayed, which is convenient for users to watch in real time.

In the embodiment of the present invention, before obtaining the first image through the first camera module and obtaining the second image through the second camera module, the method further includes: receiving a panoramic shooting mode activation instruction input by the user in the first display screen; The startup instruction enables the first camera module and the second camera module.

Before it is determined that the first angle satisfies the preset conditions, the first image is obtained through the first camera module and the second image is obtained through the second camera module, it is necessary to receive the panoramic shooting mode activation instruction input by the user in the first display screen , based on the activation instruction, the mobile terminal enters the panoramic shooting mode, and activates the first camera module and the second camera module respectively. After the first camera module and the second camera module are activated, it can be detected whether the first included angle satisfies the preset condition. Of course, when it is determined that the first included angle satisfies the preset condition, the mobile terminal outputs the output to activate the first camera module. The prompt information of the group and the second camera module, the user directly starts the first camera module and the second camera module according to the prompt information, and executes the shooting process.

In this embodiment of the present invention, after acquiring the first image sequence through the first camera module, the method further includes: receiving a second input from the user for controlling the mobile terminal to move along a preset direction, where the preset direction is movement along the first display area The direction in which the trajectory continues to move; in response to the second input, in the process of moving the mobile terminal to the preset position, a second image sequence is obtained through the first camera module, wherein when the mobile terminal moves to the preset position, the first camera module The group and the second camera module complete 360-degree viewing; image stitching is performed according to the first image, the second image, the first image sequence, and the second image sequence to generate a second panoramic image.

In the embodiment of the present invention, when the first camera module and the second camera module perform static shooting, both the first camera module and the second camera module have blind spots, and the second camera is kept on when the first camera module is turned on. After the module is closed, and the first camera module performs dynamic shooting in the process of reducing the first included angle, the viewing range can be expanded. After the group of statically captured second images and the first image sequence dynamically captured by the first camera module, 360-degree framing is still not achieved. At this time, a second input from the user to control the mobile terminal to move in a preset direction can be received. The preset direction here is the direction in which the entire mobile terminal continues to move along the previous movement trajectory of the first display area. The movement trajectory of the first display area is It is the trajectory of the first display area moving to the second display area. After receiving the second input, in response to the second input, during the process of moving the mobile terminal to the preset position, the first camera module is kept on and the second camera module is off, and the first camera module is The second sequence of images is acquired during the movement of the mobile terminal. The preset position here is a position where the first camera module and the second camera module can complete a 360-degree view from the start of shooting. After acquiring the second sequence of images, it can be displayed through the first display area.

After acquiring the first image, the second image, the first image sequence, and the second image sequence, image stitching may be performed according to the first image, the second image, the first image sequence, and the second image sequence to generate a second panoramic image, The second panoramic image here is a corresponding 360-degree viewfinder image.

After using the first camera module and the second camera module to complete static shooting, and using the first camera module to obtain the first image sequence, you can continue to rotate the mobile terminal to the preset position, obtain the second image sequence, and complete the 360-degree Framing to increase the shooting range of the camera module.

In this embodiment of the present invention, as shown in FIGS. 1 a , 1 b , 1 d and 3 , a preset area on the back of the first display area 11 forms the second display screen 2 , and the back of the second display area 12 is the back of the mobile terminal. Shell 3; the first included angle is greater than or equal to zero degrees and less than or equal to 180 degrees; when the angle value of the first included angle is zero, the second display screen 2, the first display area 11, the second display area 12 and the mobile terminal The rear shells 3 are arranged in sequence; when the angle value of the first included angle is 180 degrees, the first display screen 1 is located on the first end face, and the second display screen 2 and the rear shell 3 are located on the second end face opposite to the first end face.

The size of the second display screen 2 is smaller than the size of the first display screen 1. When the mobile terminal is in an extended state, that is, when the first included angle is 180 degrees, the second display screen 2 and the rear case 3 are located on the same end surface, and the first display screen The screen 1 is located on the opposite end face, wherein the size of the first display screen 1 may be greater than or equal to the sum of the sizes of the second display screen 2 and the rear case 3 .

And the second display screen 2 corresponds to the first display area 11 , and the rear case 3 corresponds to the second display area 12 . When the first display area 11 and the second display area 12 are in contact, the first angle between the two is zero degrees. At this time, the second display screen 2 , the first display area 11 , the second display area 12 and the rear case 3 Arranged in sequence, the mobile terminal is in a fully folded state, and the first camera module 111 and the second camera module 121 are away from each other. The first camera module 111 is disposed on the end face of the second display screen 2 and is a front camera module, and the second camera module 121 is disposed on the rear shell 3 and is a rear camera module.

In the embodiment of the present invention, when the folding angle of the detachable display screen satisfies a preset condition, the first camera module and the second camera module can be used to perform static shooting, and then the display area of the first camera module can be set according to the back. The rotation utilizes the first camera module for continuous shooting, and the images captured by the two camera modules are synthesized and processed to generate the first panoramic image, which enables the user to obtain the panoramic image through convenient and reliable operations, and does not easily occur during the shooting process. Shake, increase the shooting angle and image clarity, greatly improve the effect of panoramic shooting, and ensure the user's fun and experience of shooting images.

Further, after the two cameras are used to complete static shooting and the first camera module is used to obtain the first image sequence, the mobile terminal can be rotated to a preset position to complete 360-degree viewing and increase the shooting range.

An embodiment of the present invention provides a mobile terminal. As shown in FIG. 1a to FIG. 1d, the mobile terminal includes a foldable first display screen 1, and the first display screen 1 includes a first display area 11 and a second display area 12. The back of a display area 11 is provided with a first camera module 111, and the back of the second display area 12 is provided with a second camera module 121; as shown in FIG. 4, the mobile terminal further includes:

The first acquisition module 10 is configured to acquire the first image through the first camera module and acquire the first image through the second camera module when the first angle between the first display area and the second display area satisfies the preset condition. two images;

a first receiving module 20, configured to receive a first input from a user to control the movement of the first display area to the second display area;

The second acquisition module 30 is configured to, in response to the first input, acquire the first image sequence through the first camera module during the process of decreasing the first included angle;

The first generating module 40 is configured to perform image stitching according to the first image, the second image and the first image sequence to generate a first panoramic image.

Wherein, the first acquisition module includes:

A detection sub-module for detecting the angle value of the first included angle;

an acquisition sub-module for acquiring the first image through the first camera module and acquiring the second image through the second camera module when the angle value of the first included angle is within the preset angle range;

Wherein, the minimum angle in the preset angle range is the angle at which the first camera module and the second camera module perform non-overlapping framing at respective horizontal shooting angles of view and obtain a stitched image.

Wherein, when the angle value of the first included angle is not within the preset angle range, the mobile terminal further includes:

The output module is configured to output prompt information for prompting the user to adjust the angle value of the first included angle.

Wherein, the mobile terminal also includes:

The first display module is configured to display the first image obtained by the first camera module through the first display area after the first obtaining module obtains the first image through the first camera module and obtains the second image through the second camera module. and displaying the second image obtained by the second camera module through the second display area.

Wherein, the mobile terminal also includes:

The second display module is configured to display the first image sequence obtained by the first camera module through the first display area after the second obtaining module obtains the first image sequence through the first camera module.

Wherein, the mobile terminal also includes:

The second receiving module is configured to receive, after the second obtaining module obtains the first image sequence through the first camera module, a second input that the user controls the mobile terminal to move along a preset direction, where the preset direction is along the first display area. The direction in which the movement trajectory continues to move;

The third acquisition module is configured to, in response to the second input, acquire a second image sequence through the first camera module during the process of moving the mobile terminal to the preset position, wherein when the mobile terminal moves to the preset position, the first camera The module and the second camera module complete 360-degree framing;

The second generating module is configured to perform image stitching according to the first image, the second image, the first image sequence and the second image sequence to generate a second panoramic image.

Wherein, the preset area on the back of the first display area forms a second display screen, and the back of the second display area is the back cover of the mobile terminal;

The first included angle is greater than or equal to zero degrees and less than or equal to 180 degrees;

When the angle value of the first included angle is zero, the second display screen, the first display area, the second display area and the rear case of the mobile terminal are arranged in sequence;

When the angle value of the first included angle is 180 degrees, the first display screen is located on the first end surface, and the second display screen and the rear case are located on the second end surface opposite to the first end surface.

In the mobile terminal provided by the embodiment of the present invention, when the folding angle of the detachable display screen satisfies a preset condition, the first camera module and the second camera module can be used to perform static shooting, and then the first camera module can be set according to the back. The rotation of the display area of 2000 uses the first camera module to perform continuous shooting, and the images obtained by the two camera modules are combined to generate a first panoramic image, which enables the user to obtain a panoramic image through convenient and reliable operations, and when shooting It is not easy to shake during the process, the shooting angle and image clarity are increased, the effect of panoramic shooting is greatly improved, and the user's enjoyment and experience of shooting images is guaranteed.

Further, after the two cameras are used to complete static shooting and the first camera module is used to obtain the first image sequence, the mobile terminal can be rotated to a preset position to complete 360-degree viewing and increase the shooting range.

5 is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present invention. The mobile terminal 500 includes but is not limited to: a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, and a display unit 506 , a user input unit 507 , an interface unit 508 , a memory 509 , a processor 510 , and a power supply 511 and other components.

The mobile terminal 500 further includes a foldable first display screen, the first display screen includes a first display area and a second display area, the back of the first display area is provided with a first camera module, and the back of the second display area is provided with a first camera module. The second camera module.

Those skilled in the art can understand that the structure of the mobile terminal shown in FIG. 5 does not constitute a limitation on the mobile terminal, and the mobile terminal may include more or less components than the one shown, or combine some components, or different components layout. In this embodiment of the present invention, the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

The processor 510 is configured to: when the first angle between the first display area and the second display area satisfies a preset condition, obtain the first image through the first camera module and obtain the first image through the second camera module Two images; the user input unit 507 is configured to receive a first input from the user to control the movement of the first display area to the second display area; the processor 510 is configured to: in response to the first input, in the process of decreasing the first included angle, The first image sequence is acquired through the first camera module; the image stitching is performed according to the first image, the second image and the first image sequence to generate a first panoramic image.

Wherein, when the first included angle between the first display area and the second display area satisfies the preset condition, when the first image is acquired by the first camera module and the second image is acquired by the second camera module, the processor 510 It is also used for performing the following steps: detecting the angle value of the first included angle; when the angle value of the first included angle is within the preset angle range, acquiring the first image through the first camera module and passing the second camera module group to acquire the second image; wherein, the minimum angle in the preset angle range is the angle that enables the first camera module and the second camera module to perform non-overlapping framing at respective horizontal shooting angles of view, and obtain a stitched image.

Wherein, when the angle value of the first included angle is not within the preset angle range, the processor 510 is further configured to perform the following step: outputting prompt information for prompting the user to adjust the angle value of the first included angle.

After the processor 510 obtains the first image through the first camera module and obtains the second image through the second camera module, the display unit 506 is further configured to perform the following steps: displaying the first camera module through the first display area to obtain the image and the second image obtained by the second camera module is displayed in the second display area.

Wherein, after the processor 510 obtains the first image sequence through the first camera module, the display unit 506 is further configured to perform the following step: displaying the first image sequence obtained by the first camera module through the first display area.

Wherein, after the processor 510 obtains the first image sequence through the first camera module, the user input unit 507 is further configured to: receive a second input for the user to control the mobile terminal to move along a preset direction, and the preset direction is along the first display The direction in which the movement trajectory of the area continues to move; the processor 510 is further configured to perform the following steps: in response to the second input, in the process of moving the mobile terminal to the preset position, acquire a second image sequence through the first camera module, wherein when the mobile terminal moves to the preset position When the mobile terminal moves to the preset position, the first camera module and the second camera module complete 360-degree viewing; image stitching is performed according to the first image, the second image, the first image sequence, and the second image sequence to generate a second image. Panoramic image.

Wherein, the preset area on the back of the first display area forms a second display screen, and the back of the second display area is the back shell of the mobile terminal; the first included angle is greater than or equal to zero degrees and less than or equal to 180 degrees;

When the angle value of the first included angle is zero, the second display screen, the first display area, the second display area and the back shell of the mobile terminal are arranged in sequence; when the angle value of the first included angle is 180 degrees, the first The display screen is located on the first end surface, and the second display screen and the rear case are located on the second end surface opposite to the first end surface.

In this way, when the folding angle of the detachable display screen satisfies the preset conditions, the first camera module and the second camera module can be used to perform static shooting, and then the first camera module can be used to rotate according to the rotation of the display area of the first camera module on the back. One camera module performs continuous shooting, and the images captured by the two camera modules are synthesized and processed to generate a first panoramic image, which enables users to obtain panoramic images through convenient and reliable operations, and is less prone to shaking during the shooting process, increasing the It improves the shooting angle and image clarity, greatly improves the effect of panoramic shooting, and ensures the fun and experience of shooting images for users.

Further, after the two cameras are used to complete static shooting and the first camera module is used to obtain the first image sequence, the mobile terminal can be rotated to a preset position to complete 360-degree viewing and increase the shooting range.

It should be understood that, in this embodiment of the present invention, the radio frequency unit 501 can be used for receiving and sending signals during sending and receiving of information or during a call. Specifically, after receiving the downlink data from the base station, it is processed by the processor 510; The uplink data is sent to the base station. Generally, the radio frequency unit 501 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 501 can also communicate with the network and other devices through a wireless communication system.

The mobile terminal provides the user with wireless broadband Internet access through the network module 502, such as helping the user to send and receive emails, browse web pages, access streaming media, and the like.

The audio output unit 503 may convert audio data received by the radio frequency unit 501 or the network module 502 or stored in the memory 509 into audio signals and output as sound. Also, the audio output unit 503 may also provide audio output related to a specific function performed by the mobile terminal 500 (eg, call signal reception sound, message reception sound, etc.). The audio output unit 503 includes a speaker, a buzzer, a receiver, and the like.

The input unit 504 is used to receive audio or video signals. The input unit 504 may include a graphics processor (Graphics Processing Unit, GPU) 5041 and a microphone 5042, and the graphics processor 5041 is used for still pictures or video images obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode data is processed. The processed image frames may be displayed on the display unit 506 . The image frames processed by the graphics processor 5041 may be stored in the memory 509 (or other storage medium) or transmitted via the radio frequency unit 501 or the network module 502 . The microphone 5042 can receive sound and can process such sound into audio data. The processed audio data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 501 for output in the case of a telephone call mode.

The mobile terminal 500 also includes at least one sensor 505, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 5061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 5061 and the proximity sensor when the mobile terminal 500 is moved to the ear. / or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of mobile terminals (such as horizontal and vertical screen switching, related games , magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; the sensor 505 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, Infrared sensors, etc., are not repeated here.

The display unit 506 is used to display information input by the user or information provided to the user. The display unit 506 may include a display panel 5061, and the display panel 5061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 507 may be used to receive input numerical or character information, and generate key signal input related to user settings and function control of the mobile terminal. Specifically, the user input unit 507 includes a touch panel 5071 and other input devices 5072 . The touch panel 5071, also referred to as a touch screen, can collect the user's touch operations on or near it (such as the user's finger, stylus, etc., any suitable object or accessory on or near the touch panel 5071). operate). The touch panel 5071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To the processor 510, the command sent by the processor 510 is received and executed. In addition, the touch panel 5071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 5071 , the user input unit 507 may also include other input devices 5072 . Specifically, other input devices 5072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.

Further, the touch panel 5071 can be covered on the display panel 5061. When the touch panel 5071 detects a touch operation on or near it, it transmits it to the processor 510 to determine the type of the touch event, and then the processor 510 determines the type of the touch event according to the touch The type of event provides a corresponding visual output on display panel 5061. Although in FIG. 5, the touch panel 5071 and the display panel 5061 are used as two independent components to realize the input and output functions of the mobile terminal, in some embodiments, the touch panel 5071 and the display panel 5061 may be integrated The input and output functions of the mobile terminal are implemented, which is not specifically limited here.

The interface unit 508 is an interface for connecting an external device to the mobile terminal 500 . For example, external devices may include wired or wireless headset ports, external power (or battery charger) ports, wired or wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 508 may be used to receive input (eg, data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 500 or may be used between the mobile terminal 500 and the external Transfer data between devices.

The memory 509 may be used to store software programs as well as various data. The memory 509 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required for at least one function, and the like; Data created by the use of the mobile phone (such as audio data, phone book, etc.), etc. Additionally, memory 509 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 510 is the control center of the mobile terminal, uses various interfaces and lines to connect various parts of the entire mobile terminal, runs or executes the software programs and/or modules stored in the memory 509, and calls the data stored in the memory 509. , perform various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole. The processor 510 may include one or more processing units; preferably, the processor 510 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem The processor mainly handles wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 510.

The mobile terminal 500 may also include a power supply 511 (such as a battery) for supplying power to various components. Preferably, the power supply 511 may be logically connected to the processor 510 through a power management system, so as to manage charging, discharging, and power consumption management through the power management system. and other functions.

In addition, the mobile terminal 500 includes some functional modules not shown, which will not be repeated here.

Preferably, an embodiment of the present invention further provides a mobile terminal, including a processor 510, a memory 509, and a computer program stored in the memory 509 and running on the processor 510, when the computer program is executed by the processor 510 The various processes of the above-mentioned embodiments of the panoramic shooting method are implemented, and the same technical effect can be achieved. To avoid repetition, details are not repeated here.

Embodiments of the present invention further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, each process of the above-mentioned embodiments of the panoramic shooting method can be achieved, and the same technology can be achieved. The effect, in order to avoid repetition, is not repeated here. The computer-readable storage medium is, for example, a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), a magnetic disk, or an optical disk.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

From the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk, CD), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of the present invention.

The embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of the present invention, without departing from the spirit of the present invention and the scope protected by the claims, many forms can be made, which all belong to the protection of the present invention.

Claims (12)

1. A panorama shooting method, applied to a mobile terminal, wherein the mobile terminal comprises a foldable first display screen, the first display screen comprises a first display area and a second display area, the first display screen is A first camera module is arranged on the back of a display area, and a second camera module is arranged on the back of the second display area; the method includes: When the first angle between the first display area and the second display area satisfies a preset condition, the first image is acquired by the first camera module and the first image is acquired by the second camera module two images; receiving a first input from a user controlling the first display area to move to the second display area; In response to the first input, in the process of reducing the first included angle, acquiring a first image sequence through the first camera module; Perform image stitching according to the first image, the second image and the first image sequence to generate a first panoramic image; After obtaining the first image sequence through the first camera module, the method further includes: receiving a second input from a user controlling the mobile terminal to move along a preset direction, where the preset direction is a direction that continues to move along the movement track of the first display area; In response to the second input, during the process of moving the mobile terminal to a preset position, a second image sequence is acquired through the first camera module, wherein when the mobile terminal moves to the preset position, the The first camera module and the second camera module complete 360-degree viewing; Image stitching is performed according to the first image, the second image, the first image sequence, and the second image sequence to generate a second panoramic image. 2 . The panorama shooting method according to claim 1 , wherein, when the first angle between the first display area and the second display area satisfies a preset condition, the method of using the The steps of obtaining a first image by a camera module and obtaining a second image through the second camera module include: detecting the angle value of the first included angle; When the angle value of the first included angle is within a preset angle range, acquiring the first image through the first camera module and acquiring the second image through the second camera module; Wherein, the minimum angle in the preset angle range is an angle that enables the first camera module and the second camera module to perform non-overlapping framing at respective horizontal shooting angles of view and obtain a stitched image. 3. The panoramic shooting method according to claim 2, wherein when the angle value of the first included angle is not within the preset angle range, the method further comprises: Prompt information for prompting the user to adjust the angle value of the first included angle is output. 4. The panorama shooting method according to claim 1, wherein after the first image is obtained by the first camera module and the second image is obtained by the second camera module, the method further include: displaying the first image obtained by the first camera module through the first display area, and The second image obtained by the second camera module is displayed through the second display area. 5. The panorama shooting method according to claim 1, wherein after the first image sequence is obtained by the first camera module, the method further comprises: The first image sequence obtained by the first camera module is displayed through the first display area. 6 . The panorama shooting method according to claim 1 , wherein a preset area on the back of the first display area forms a second display screen, and the back of the second display area is a back cover of the mobile terminal. 7 . ; The first included angle is greater than or equal to zero degrees and less than or equal to 180 degrees; When the angle value of the first included angle is zero, the second display screen, the first display area, the second display area and the rear case of the mobile terminal are arranged in sequence; When the angle value of the first included angle is 180 degrees, the first display screen is located on the first end surface, and the second display screen and the rear case are located on the second end surface opposite to the first end surface. 7. A mobile terminal, characterized in that the mobile terminal comprises a foldable first display screen, the first display screen comprises a first display area and a second display area, and the back of the first display area is provided with There is a first camera module, and the back of the second display area is provided with a second camera module; the mobile terminal further includes: a first acquisition module, configured to acquire a first image through the first camera module and pass the The second camera module obtains the second image; a first receiving module, configured to receive a first input from a user to control the movement of the first display area to the second display area; a second acquisition module, configured to acquire a first image sequence through the first camera module during the process of reducing the first included angle in response to the first input; a first generating module, configured to perform image stitching according to the first image, the second image and the first image sequence to generate a first panoramic image; The mobile terminal also includes: The second receiving module is configured to, after the second obtaining module obtains the first image sequence through the first camera module, receive a second input from the user controlling the mobile terminal to move in a preset direction, the The preset direction is the direction of continuing to move along the movement track of the first display area; A third acquisition module, configured to acquire a second image sequence through the first camera module during the process of moving the mobile terminal to a preset position in response to the second input, wherein when the mobile terminal moves to a preset position At the preset position, the first camera module and the second camera module complete 360-degree viewing; The second generating module is configured to perform image stitching according to the first image, the second image, the first image sequence and the second image sequence to generate a second panoramic image. 8. The mobile terminal according to claim 7, wherein the first acquisition module comprises: a detection submodule for detecting the angle value of the first included angle; The acquisition sub-module is used for acquiring the first image through the first camera module and acquiring the second image through the second camera module when the angle value of the first included angle is within the preset angle range. image; Wherein, the minimum angle in the preset angle range is an angle that enables the first camera module and the second camera module to perform non-overlapping framing at respective horizontal shooting angles of view and obtain a stitched image. 9. The mobile terminal according to claim 8, wherein when the angle value of the first included angle is not within the preset angle range, the mobile terminal further comprises: The output module is configured to output prompt information for prompting the user to adjust the angle value of the first included angle. 10. The mobile terminal according to claim 7, wherein the mobile terminal further comprises: The first display module is configured to display all images through the first display area after the first obtaining module obtains the first image through the first camera module and obtains the second image through the second camera module. The first image acquired by the first camera module, and the second image acquired by the second camera module is displayed through the second display area. 11. The mobile terminal according to claim 7, wherein the mobile terminal further comprises: a second display module, configured to display the first image sequence obtained by the first camera module through the first display area after the second obtaining module obtains the first image sequence through the first camera module . 12 . The mobile terminal according to claim 7 , wherein a preset area on the back of the first display area forms a second display screen, and the back of the second display area is a back cover of the mobile terminal; 12 . The first included angle is greater than or equal to zero degrees and less than or equal to 180 degrees; When the angle value of the first included angle is zero, the second display screen, the first display area, the second display area and the rear case of the mobile terminal are arranged in sequence; When the angle value of the first included angle is 180 degrees, the first display screen is located on the first end surface, and the second display screen and the rear case are located on the second end surface opposite to the first end surface.

Images