CN115334243A - Shooting method and device thereof - Google Patents

Abstract

The application discloses a shooting method and a shooting device, and belongs to the technical field of camera shooting. The method comprises the following steps: under the condition that a shooting preview interface is displayed, receiving a first input of a user to a target moving object in the shooting preview interface; responding to the first input, and determining the motion parameters of the target moving object in the motion process according to at least two frames of images acquired by the target moving object in the motion process; and shooting the target moving object based on the motion parameters of the target moving object to obtain a target image.

Description

Shooting method and device thereof

technical field

The present application belongs to the technical field of photographing, and in particular relates to a photographing method and a device thereof.

Background technique

At present, users can take images with a panning effect (that is, the background is blurred and the subject is clear) through electronic devices, and the user can move the electronic device so that the imaging effect of the moving object on the image sensor is relatively static, thereby Users can get images with panning effects.

However, the user needs to keep the electronic device as stable as possible, and then move the electronic device to take pictures. If the user shakes the electronic device during the movement, the imaging effect of the image taken by the electronic device will be poor. Panning effect images are poorly imaged.

Contents of the invention

The purpose of the embodiments of the present application is to provide a photographing method and device thereof, which can solve the problem of poor imaging effect of panning effect images captured by electronic equipment.

In a first aspect, an embodiment of the present application provides a shooting method, the shooting method includes: when the shooting preview interface is displayed, receiving a user's first input on the target moving object in the shooting preview interface; responding to the first input , according to at least two frames of images collected during the movement of the target moving object, determine the motion parameters of the target moving object during the movement; based on the motion parameters of the target moving object, photograph the target moving object to obtain the target image.

In a second aspect, an embodiment of the present application provides a photographing device, and the photographing device includes: a receiving module, a determining module, and a photographing module. The receiving module is configured to receive the user's first input on the target moving object in the shooting preview interface when the shooting preview interface is displayed. The determining module is configured to, in response to the first input, determine motion parameters of the target moving object during the movement according to at least two frames of images collected during the movement of the target moving object. The photographing module is configured to photograph the target moving object based on the motion parameters of the target moving object to obtain a target image.

In the third aspect, the embodiment of the present application provides an electronic device, the electronic device includes a processor and a memory, the memory stores programs or instructions that can run on the processor, and the programs or instructions are processed by the The steps of the method described in the first aspect are realized when the controller is executed.

In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or an instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented .

In the fifth aspect, the embodiment of the present application provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions, so as to implement the first aspect the method described.

In a sixth aspect, an embodiment of the present application provides a computer program product, the program product is stored in a storage medium, and the program product is executed by at least one processor to implement the method described in the first aspect.

In the embodiment of the present application, when the shooting preview interface is displayed, the user can input the target moving object in the shooting preview interface, so that the electronic device can collect at least two frames of images of the target moving object during the movement, Therefore, the electronic device can determine the motion parameters of the target moving object during the motion process according to the at least two frames of images, and then the electronic device can capture the target moving object according to the motion parameters of the target moving object during the motion process to obtain the target image. In this solution, since the electronic device can identify the motion parameters of the target moving object in the shooting preview interface, when the electronic device is shooting the target moving object, the electronic device can determine the target moving object in the shooting preview interface. The motion parameters in the motion process, the target moving object is photographed, so that the projection of the target moving object on the image sensor can be relatively static, so as to achieve the shooting effect of panning, avoiding the shaking caused by the user when moving the electronic device. The imaging effect of the image captured by the device is relatively poor. In this way, while the efficiency of capturing the panning image by the electronic device is improved, the imaging effect of the panning image captured by the electronic device is also improved.

Description of drawings

FIG. 1 is a flow chart of a shooting method provided by an embodiment of the present application;

FIG. 2 is a schematic structural diagram of a photographing device provided in an embodiment of the present application;

Fig. 3 is one of the schematic diagrams of the hardware structure of an electronic device provided by the embodiment of the present application;

FIG. 4 is a second schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present application.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

The terms "first", "second" and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific sequence or sequence. It should be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application can be practiced in sequences other than those illustrated or described herein, and that references to "first," "second," etc. distinguish Objects are generally of one type, and the number of objects is not limited. For example, there may be one or more first objects. In addition, "and/or" in the specification and claims means at least one of the connected objects, and the character "/" generally means that the related objects are an "or" relationship.

The photographing method provided by the embodiment of the present application will be described in detail below through specific embodiments and application scenarios with reference to the accompanying drawings.

The photographing method provided in the embodiment of the present application may be applied to photographing an image with a panning effect.

At present, when a user takes an image with a panning effect (that is, the background is blurred and the object is clear) through an electronic device, the user can usually move the electronic device so that the imaging effect of the moving object on the image sensor is relatively static , so that the user can obtain an image with a panning effect. Specifically, since panning requires a long exposure time to achieve the effect of blurring the background, the electronic device can set the shutter speed to a slow shutter when shooting, and then the user follows the movement The subject moves the electronic device to capture images with a panning effect. The current panning shooting method requires the user to keep the mobile phone as stable as possible, and then move the electronic device to shoot (for example, use waist or hand movements to stabilize and follow the moving subject. shooting), however, if the user shakes the electronic device during the process, the imaging effect of the image captured by the electronic device will be poor.

In the embodiment of the present application, when the shooting preview interface is displayed, the user can input the target moving object in the shooting preview interface, so that the electronic device can collect at least two frames of images of the target moving object during the movement, so that The electronic device can determine the motion parameters of the target moving object during the motion process according to the at least two frames of images, and then the electronic device can capture the target moving object according to the motion parameters of the target moving object during the motion process to obtain the target image. In this solution, since the electronic device can identify the motion parameters of the target moving object in the shooting preview interface, when the electronic device is shooting the target moving object, the electronic device can determine the target moving object in the shooting preview interface. The motion parameters in the motion process, the target moving object is photographed, so that the projection of the target moving object on the image sensor can be relatively static, so as to achieve the shooting effect of panning, avoiding the shaking caused by the user when moving the electronic device. The imaging effect of the image captured by the device is relatively poor. In this way, while the efficiency of capturing the panning image by the electronic device is improved, the imaging effect of the panning image captured by the electronic device is also improved.

The shooting method provided in the embodiment of the present application may be executed by a shooting device, and the shooting device may be an electronic device or a functional module in the electronic device. The technical solutions provided by the embodiments of the present application will be described below by taking an electronic device as an example.

An embodiment of the present application provides a photographing method, and FIG. 1 shows a flow chart of the photographing method provided in the embodiment of the present application. As shown in FIG. 1 , the photographing method provided in the embodiment of the present application may include the following steps 201 to 203 .

Step 201. When a shooting preview interface is displayed, the electronic device receives a user's first input on a target moving object in the shooting preview interface.

In the embodiment of the present application, the user can make a first input on the target moving object on the shooting preview interface, so that the electronic device can determine the target moving object, so that the electronic device can obtain the movement track of the target moving object, and then the electronic device can obtain the target moving object according to the target The motion trajectory of the moving object determines the motion parameters of the target moving object.

Optionally, in the embodiment of the present application, the above-mentioned target moving object may be a movable object, for example, the above-mentioned target moving object may be a person or an animal.

Optionally, in this embodiment of the present application, the foregoing motion parameters may be a motion speed of the target moving object and a motion direction of the target moving object.

Optionally, in the embodiment of the present application, the above-mentioned first input may be the user's click input, long press input, slide input, preset trajectory input, etc. on the target moving object. Specifically, it may be determined according to actual usage requirements, and is not limited in this embodiment of the present application.

Optionally, in this embodiment of the present application, before the electronic device receives the user's first input on the target moving object in the shooting preview interface, the electronic device may display prompt information on the shooting preview interface to prompt the user to select a target moving object in the shooting preview interface. target moving object to obtain the motion parameters of the target moving object.

Optionally, in this embodiment of the application, the user can input the panning shooting control in the shooting preview interface, so that the electronic device starts the panning shooting mode, and prompts the user to select the target moving object in the shooting preview interface to obtain The motion parameters of the target motion object.

Step 202: In response to the first input, the electronic device determines motion parameters of the target moving object during the movement according to at least two frames of images collected during the movement of the target moving object.

In the embodiment of the present application, in response to the first input, the electronic device displays a frame of interest (Region of Interest, ROI) containing the target moving object on the shooting preview interface, and tracks the target moving object through the interest frame to collect the target moving object. At least two frames of images of the target moving object during the movement, so as to determine the motion parameters of the target moving object during the movement according to the at least two frames of images.

Specifically, in response to the first input, the above-mentioned electronic device displays the frame of interest containing the target moving object in the shooting preview interface as the user clicks on the target moving object in the shooting preview interface, the electronic device may use artificial intelligence (AI) The recognition algorithm matches the most suitable target moving object according to the click position of the user in the shooting preview interface, and tracks the target moving object.

Optionally, in this embodiment of the present application, the electronic device may obtain the position offset and the feature pixel offset between the at least two frames of images according to the at least two frames of images, so that according to the position offset and the feature pixel offset The displacement is used to determine the motion parameters of the target moving object during the motion process.

Optionally, in this embodiment of the present application, the above-mentioned motion parameters include a motion direction and a motion speed; the above-mentioned step 202 may specifically be implemented through the following steps 202a to 202c.

Step 202a, the electronic device responds to the first input, and determines the position offset and feature pixel offset of the target moving object according to at least two frames of images.

In the embodiment of the present application, the electronic device may determine the position offset and feature pixel offset of the target moving object according to the frame of interest displayed on the shooting preview interface.

Optionally, in the embodiment of the present application, the foregoing step 202a may be specifically implemented through the following steps 301 and 302.

Step 301, the electronic device acquires at least two pieces of location information, and determines a location offset according to the at least two pieces of location information.

In the embodiment of the present application, each of the above at least two pieces of location information is the location information of the target moving object in one frame of image.

In the embodiment of the present application, the electronic device may obtain the center position information of the target moving object in a frame of image to obtain at least two position information, and determine the position offset of the target moving object through the at least two position information.

Specifically, the above position information may be coordinate information of the target moving object in the image sensor.

Optionally, in the embodiment of the present application, the electronic device may obtain the center position information of the frame of interest containing the target moving object to obtain at least two position information, and determine the position offset of the target moving object through the at least two position information quantity.

Exemplarily, taking two frames of images as an example, after the electronic device obtains the center position information of the frame of interest containing the target moving object in each of the two frames of images, the electronic device can determine the target moving object through the following formula 1 The position offset of , the specific formula is:

boxSpeed=Box2_center–Box1_center (1)

Among them, Box1_center is the center position information of the frame of interest in the first frame image, Box2_center is the center position information of the frame of interest in the second frame image, and boxSpeed is the position offset of the target moving object.

Step 302: The electronic device performs image recognition on at least two frames of images to obtain feature pixels of the at least two frames of images, and performs feature comparison on the feature pixels of the at least two frames of images to obtain feature pixel offsets.

In the embodiment of the present application, the electronic device can perform image feature recognition on at least two frames of images through an AI recognition algorithm to obtain key feature points in at least two frames of images, and then compare the key feature points in at least two frames of images , get the feature pixel offset.

Optionally, in this embodiment of the present application, the electronic device may use an AI recognition algorithm to identify the images contained in the frame of interest in at least two frames of images, so as to obtain the key of the image contained in the frame of interest in at least two frames of images. feature points, and then compare the key feature points of the images contained in the frame of interest in at least two frames of images to obtain the feature pixel offset.

Exemplarily, taking two frames of images as an example, after the electronic device identifies the key feature points of the image contained in the frame of interest in the two frames of images, the electronic device can determine the feature pixel offset by the following formula 2, the specific formula for:

featureSpeed=feature2–feature1 (2)

Among them, feature1 is the key feature point of the image contained in the frame of interest in the first frame of image, feature2 is the key feature point of the image contained in the frame of interest in the second frame of image, and featureSpeed is the key feature point of the image contained in the frame of interest in the two frames of image The feature pixel offset between the key feature points of the image.

In the embodiment of the present application, the electronic device can calculate the imaging position of the target moving object on the image sensor, so as to obtain the speed of the target moving object during the movement process, and then the electronic device can match the speed of the target moving object through the calculated speed. Speed of motion to achieve panning effect.

Step 202b, the electronic device determines the pixel offset of the target moving object in the first direction and the pixel offset in the second direction according to the position offset and the characteristic pixel offset.

In the embodiment of the present application, the first direction is perpendicular to the second direction.

In the embodiment of the present application, after the electronic device obtains the position offsets and feature pixel offsets of at least two frames of images, the electronic device can determine the distance between at least two frames of images according to the position offsets and feature pixel offsets. pixel offset.

Exemplarily, taking two frames of images as an example, after the electronic device determines the position offset and feature pixel offset between the two frames of images, the electronic device can use the following formula 3 to obtain the total number of pixels between the two frames of images Offset, the specific formula is:

totalSpeed=boxSpeed+featureSpeed (3)

Among them, boxSpeed is the position offset between the two frames of images, featureSpeed is the feature pixel offset between the two frames of images, and totalSpeed is the total pixel offset between the two frames of images.

In the embodiment of the present application, after the electronic device obtains the pixel offset between at least two frames of images, the electronic device can, according to the target image in the next frame image (that is, the next frame image of the original frame image in at least two frames of images) The pixel offset of the moving object determines the pixel offset of the target moving object in the original frame image in the vertical direction and the horizontal direction.

Exemplarily, taking two frames of images as an example, assume that the pixel coordinates of the target moving object in the first frame of images are (0, 0), and the pixel coordinates of the target moving object in the second frame of images are (1, 3 ), then the pixel offset of the target moving object in the first frame image in the horizontal direction is 1, and the pixel offset in the vertical direction is 3.

Step 202c, according to the pixel offset in the first direction and the pixel offset in the second direction, determine the moving direction and moving speed of the target moving object during the moving process.

In the embodiment of the present application, the electronic device can determine the movement angle of the target moving object during the movement according to the pixel offset in the first direction and the pixel offset in the second direction of the target moving object, thereby determining the target The moving direction of the moving object during the movement.

In the embodiment of the present application, the electronic device can determine the moving distance of the target moving object during the movement according to the pixel offset in the first direction and the pixel offset in the second direction of the target moving object, thereby determining the target The movement speed of the moving object during the movement.

In the embodiment of the present application, the electronic device can determine the motion parameters of the camera according to the moving speed and moving direction of the target moving object, and then control the camera to match the moving speed and moving direction of the target moving object, so as to realize the panning effect.

Optionally, in the embodiment of the present application, the above step 202c may specifically go through the following steps 401 and 402.

Step 401, the electronic device determines the target included angle value according to the pixel offset in the first direction and the pixel offset in the second direction, and determines the moving direction of the target moving object during the movement according to the target included angle value .

In the embodiment of the present application, the above-mentioned target included angle value is an included angle value between the horizontal direction and the moving direction of the target moving object during the moving process, and the above-mentioned horizontal direction is the first direction or the second direction.

In the embodiment of the present application, after the electronic device obtains the pixel offset in the horizontal direction and the pixel offset in the vertical direction of the target moving object in the first frame of images in at least two frames of images, the electronic device may perform the following Formula 4 is used to determine the direction of motion of the target moving object during the motion process. The specific formula is:

θ = arctan(totalSpeedY/totalSpeedX) (4)

Among them, totalSpeedY is the pixel offset of the target moving object in the vertical direction, totalSpeedX is the pixel offset of the target moving object in the horizontal direction, and θ is the angle value of the moving direction.

It should be noted that the above horizontal direction is determined by a gyroscope in the electronic device or other components capable of detecting the horizontal direction.

Specifically, the above-mentioned gyroscope may be a sensing gyroscope, such as a piezoelectric gyroscope, a micromechanical gyroscope, a fiber optic gyroscope, or a laser gyroscope.

Optionally, in the embodiment of the present application, if the first direction is the left direction, the second direction is the direction perpendicular to the left direction; if the first direction is the right direction, the second direction is the direction perpendicular to the right direction.

Specifically, in the case where the above-mentioned first direction is the left horizontal direction, the second direction may be the upper vertical direction and the lower vertical direction; in the case where the above-mentioned first direction is the right horizontal direction, the second direction may be the upper vertical direction and down vertically.

The following uses four quadrants to illustrate that the electronic device determines the included angle value of the moving direction of the target moving object according to the pixel offset in the first direction and the pixel offset in the second direction.

Exemplarily, the electronic device may determine the included angle value of the moving direction of the target moving object in the first quadrant and the fourth quadrant through the above formula four;

The electronic device can determine the angle value of the moving direction of the target moving object in the second quadrant through the following formula 5, the specific formula is:

θ=arctan(totalSpeedY/totalSpeedX)+180° (5)

Among them, totalSpeedY is the pixel offset of the target moving object in the upper vertical direction, totalSpeedX is the pixel offset of the target moving object in the left direction, and θ is the angle value of the moving direction of the target moving object in the second quadrant.

The electronic device can determine the included angle value of the moving direction of the target moving object in the third quadrant through the following formula 6, the specific formula is:

θ=arctan(totalSpeedY/totalSpeedX)–180° (6)

Among them, totalSpeedY is the pixel offset of the target moving object in the vertical direction, totalSpeedX is the pixel offset of the target moving object in the left direction, and θ is the angle value of the moving direction of the target moving object in the third quadrant.

Step 402, the electronic device determines the target pixel offset according to the pixel offset in the first direction and the pixel offset in the second direction, and determines the target moving object at The speed of motion during motion.

In the embodiment of the present application, the aforementioned target exposure time is the image exposure time of the target moving object during its movement.

In the embodiment of the present application, the electronic device may determine the moving distance of the target moving object during the movement (hereinafter referred to as the first distance) according to the pixel offset in the first direction and the pixel offset in the second direction. , and then according to the first distance and the target exposure time, the moving speed of the target moving object during the movement is determined.

Specifically, the electronic device can determine the moving distance of the target moving object during the movement according to the following formula 7, the specific formula is:

totalSpeed＝sqrt(totalSpeedX ² +totalSpeedY ² ) (7)

Wherein, totalSpeedY is the pixel offset of the target moving object in the vertical direction, totalSpeedX is the pixel offset of the target moving object in the horizontal direction, and totalSpeed is the moving distance of the target moving object in at least two frames of images.

Specifically, after the electronic device obtains the moving distance of the target moving object during the movement, the electronic device can determine the moving speed of the target moving object through the following formula 8, the specific formula is:

V＝totalSpeed/t (8)

Wherein, totalSpeed is the moving distance of the target moving object in at least two frames of images, t is the target exposure time, and V is the moving speed of the target moving object.

In the embodiment of the present application, the electronic device can determine the moving speed and moving direction of the target moving object during the movement through the pixel offset in the first direction and the pixel offset in the second direction, and then control the camera to match The moving speed and moving direction of the target moving object, so as to realize the panning effect.

Step 203: The electronic device photographs the target moving object based on the motion parameters of the target moving object to obtain a target image.

In the embodiment of the present application, when the electronic device obtains the motion parameters of the target moving object and detects that the target moving object is in motion, the electronic device may automatically photograph the target moving object to obtain a target image.

Optionally, in this embodiment of the present application, the electronic device may receive a shooting input from the user, so that the electronic device may shoot a target moving object to obtain a target image.

Optionally, in the embodiment of the present application, the above-mentioned shooting input may be the user's click input, sliding input, or preset track input on the shooting control in the shooting preview interface; or the user's combined input of physical buttons (such as the power button and volume key); or the user's voice input to the electronic device. Specifically, it may be determined according to actual usage conditions, and is not limited in this embodiment of the application.

In the embodiment of the present application, the electronic device can obtain the target image by controlling the camera to match the moving speed and moving direction of the target moving object according to the moving parameters of the target moving object.

An embodiment of the present application provides a shooting method. When the shooting preview interface is displayed, the user can input the target moving object in the shooting preview interface, so that the electronic device can collect at least two images of the target moving object during the movement process. frame images, so that the electronic device can determine the motion parameters of the target moving object during the motion process according to the at least two frames of images, and then the electronic device can shoot the target moving object according to the motion parameters of the target moving object during the motion process, and obtain target image. In this solution, since the electronic device can identify the motion parameters of the target moving object in the shooting preview interface, when the electronic device is shooting the target moving object, the electronic device can determine the target moving object in the shooting preview interface. The motion parameters in the motion process, the target moving object is photographed, so that the projection of the target moving object on the image sensor can be relatively static, so as to achieve the shooting effect of panning, avoiding the vibration caused by the user when moving the electronic device. The imaging effect of the image captured by the device is relatively poor. In this way, while the efficiency of capturing the panning image by the electronic device is improved, the imaging effect of the panning image captured by the electronic device is also improved.

Optionally, in the embodiment of the present application, the foregoing step 204 may be specifically implemented through the following step 204a.

Step 204a, based on the motion parameters of the target moving object, the electronic device controls the movement of the camera of the electronic device, and takes pictures of the target moving object during the movement of the camera to obtain a target image.

In the embodiment of the present application, after the electronic device responds to the shooting input, the electronic device can set the initial position of the camera, the initial speed of the camera, and the acceleration of each period during the exposure period according to the moving direction of the target moving object and the moving speed of the target moving object , so that the camera can shoot the target moving object according to the acceleration to obtain the target image.

Specifically, the aforementioned camera may be a micro-cloud platform camera.

In the embodiment of the present application, after the electronic device obtains the motion parameters of the target moving object, the electronic device may control the movement of the camera so that the projected position of the target moving object captured by the electronic device on the image sensor is relatively static, thereby obtaining the target image.

Optionally, in this embodiment of the present application, the above-mentioned motion parameters include motion speed and motion direction; "the electronic device controls the camera movement of the electronic device based on the motion parameters of the target moving object" in the above-mentioned step 204a can be specifically performed through the following steps 501 to step 504 are realized.

Step 501, the electronic device determines the motion acceleration of the target moving object according to the moving speed of the target moving object during the movement.

In the embodiment of the present application, the electronic device can determine the first acceleration of the target moving object between every two frames of images according to the motion speed between every two frames of images in at least two frames of images, through the following formula 9, so as to obtain The motion acceleration of the target moving object in at least two frames of images, the specific formula is:

S1＝V1t+1/2*at ² (9)

Among them, S1 is the moving distance of the target moving object between every two frames of images, t is the target exposure time, and a is the first acceleration of the target moving object between every two frames of images.

In the embodiment of the present application, after the electronic device obtains the motion acceleration between every two frames of images, the electronic device can use the following formula 10 to obtain the motion acceleration of the target moving object in at least two frames of images, the specific formula is:

a=(S2–S1)/t ² (10)

Wherein, a is the motion acceleration in at least two frames of images, S1 and S2 are the moving distances of the target moving object between every two frames of images, and t is the target exposure realization.

Step 502, the electronic device determines an average moving speed of the target moving object according to the moving speed and moving acceleration of the target moving object during the movement.

In the embodiment of the present application, the electronic device may determine the average moving speed of the target moving object in every two frames of images according to the moving speed, moving acceleration and target exposure time of the target moving object in the moving process of every two frames of images.

Specifically, after the electronic device obtains the moving acceleration and moving speed of the target moving object in every two frames of images, the electronic device can determine the average moving speed of the target moving object in every two frames of images through the following formula 11, the specific calculation formula is :

V'=(V1+V1+a*Δt)/2 (11)

Among them, V1 is the moving speed of the target moving object in every two frames of images, Δt is the target exposure time, a is the moving acceleration of the target moving object in every two frames of images, V' is the average moving speed of the target moving objects in every two frames of images .

Step 503, the electronic device determines the rotation angle value of the camera within the target exposure time according to the average moving speed, the target exposure time and the inherent parameters of the camera.

Optionally, in this embodiment of the present application, the inherent parameters of the camera include an equivalent focal length of the camera and specification parameters of the image sensor.

Specifically, after the electronic device obtains the average motion speed, the target exposure time, and the inherent parameters of the camera, the following formula 12 can be used to determine the rotation angle value of the camera within the target exposure time, and the specific formula is:

θ_indeed=arctan((Δt*α*V')/(2*1000*EFL)) (12)

Among them, Δt is the target exposure time, α is the specification parameter of the image sensor, EFL is the equivalent focal length of the camera, V' is the average moving speed of the target moving object in every two frames of images, θ_indeed is the rotation of the camera within the target exposure time angle value.

Step 504, the electronic device controls the rotation of the camera according to the rotation angle value and the moving direction of the target moving object.

In the embodiment of the present application, the electronic device can calculate the actual angle of rotation of the camera within each target exposure time, so as to achieve uniform acceleration and track the target moving object to obtain the target image.

In the embodiment of the present application, within the target exposure time, the electronic device can adjust the angle of the camera according to the moving direction of the target moving object, and adjust the angle of the camera according to the average moving speed of the target moving object, so that the imaging of the target shooting object on the image sensor The position is fixed. In this way, the target moving object and the camera are relatively still, and the background moves to capture images with a panning effect.

It should be noted that, the shooting method provided in the embodiment of the present application may be executed by a shooting device, or an electronic device, or may also be a functional module or entity in the electronic device. In the embodiment of the present application, taking the photographing device executing the photographing method as an example, the photographing device provided in the embodiment of the present application is described.

Fig. 2 shows a possible structural schematic diagram of the photographing device involved in the embodiment of the present application. As shown in FIG. 2 , the photographing device 70 may include: a receiving module 71 , a determining module 72 and a photographing module 73 .

Wherein, the receiving module 71 is configured to receive the user's first input on the target moving object in the shooting preview interface when the shooting preview interface is displayed. The determining module 72 is configured to, in response to the first input received by the receiving module, determine motion parameters of the target moving object during the movement according to at least two frames of images collected during the movement of the target moving object. The photographing module 73 is configured to photograph the target moving object based on the motion parameters of the target moving object to obtain a target image.

In a possible implementation manner, the above motion parameters include motion direction and motion speed; the above determination module 72 is specifically configured to determine the position offset and feature pixel offset of the target moving object according to at least two frames of images; and According to the position offset and the feature pixel offset, determine the pixel offset of the target moving object in the first direction and the pixel offset in the second direction, the first direction is perpendicular to the second direction; and according to the first direction The pixel offset in one direction and the pixel offset in the second direction determine the moving direction and moving speed of the target moving object during the moving process.

In a possible implementation manner, the determination module 72 is specifically configured to obtain at least two position information, and determine the position offset according to the at least two position information, each position information is the target moving object in a frame of image The position information in; and performing image recognition on at least two frames of images to obtain feature pixels of at least two frames of images, and performing feature comparison on the feature pixels of at least two frames of images to obtain feature pixel offsets.

In a possible implementation, the determination module 72 is specifically configured to determine the target angle value according to the pixel offset in the first direction and the pixel offset in the second direction, and to determine the target angle value according to the target angle value , determine the moving direction of the target moving object during the moving process, the target angle value is the angle value between the horizontal direction and the moving direction of the target moving object during the moving process, and the horizontal direction is the first direction or the second direction; and Determine the target pixel offset according to the pixel offset in the first direction and the pixel offset in the second direction, and determine the movement of the target moving object during the movement according to the target pixel offset and the target exposure time Speed, the target exposure time is the image exposure time of the target moving object during its motion.

In a possible implementation manner, the above-mentioned motion parameters include motion speed and motion direction; the above-mentioned shooting module 73 is specifically configured to determine the motion acceleration of the target motion object according to the motion speed of the target motion object during motion; and The moving speed and moving acceleration of the moving object during the movement process determine the average moving speed of the target moving object; and determine the rotation angle value of the camera within the target exposure time according to the average moving speed, the target exposure time and the inherent parameters of the camera; The rotation angle value and the movement direction of the target moving object control the rotation of the camera.

An embodiment of the present application provides a shooting device. Since the shooting device can identify the motion parameters of the target moving object in the shooting preview interface during the movement process, when the electronic device is shooting the target moving object, the shooting device can be based on the shooting preview The interface determines the motion parameters of the target moving object during the movement, and shoots the target moving object so that the projection of the target moving object on the image sensor can be relatively static, so as to achieve the shooting effect of panning, which avoids the user from moving the electronic device The jitter generated during the operation results in poor imaging effect of the image captured by the electronic device. In this way, the imaging effect of the panning image captured by the capturing device is improved while improving the efficiency of the panning image captured by the capturing device.

The photographing device in the embodiment of the present application may be a device, and may also be a component, an integrated circuit, or a chip in an electronic device. The device may be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a vehicle electronic device, a mobile Internet device (MobileInternet Device, MID), an augmented reality (augmented reality, AR)/virtual reality (virtual reality, VR ) devices, robots, wearable devices, ultra-mobile personal computers (ultra-mobile personal computer, UMPC), netbooks or personal digital assistants (personal digital assistant, PDA), etc., can also serve as servers, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (television, TV), teller machine or self-service machine, etc., which are not specifically limited in this embodiment of the present application.

The photographing device in the embodiment of the present application may be a device with an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in this embodiment of the present application.

The photographing device provided by the embodiment of the present application can realize various processes realized by the method embodiment in FIG. 1 , and details are not repeated here to avoid repetition.

Optionally, as shown in FIG. 3 , the embodiment of the present application also provides an electronic device 90, including a processor 91 and a memory 92, and the memory 92 stores programs or instructions that can run on the processor 91, the When the programs or instructions are executed by the processor 91, the various steps of the above-mentioned photographing method embodiments can be realized, and the same technical effect can be achieved. To avoid repetition, details are not repeated here.

It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

FIG. 4 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 100 includes but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110, etc. part.

Those skilled in the art can understand that the electronic device 100 can also include a power supply (such as a battery) for supplying power to various components, and the power supply can be logically connected to the processor 110 through the power management system, so that the management of charging, discharging, and function can be realized through the power management system. Consumption management and other functions. The structure of the electronic device shown in FIG. 4 does not constitute a limitation to the electronic device, and the electronic device may include more or fewer components than shown in the figure, or combine some components, or arrange different components, which will not be repeated here. .

Wherein, the user input unit 107 is configured to receive the user's first input on the target moving object in the shooting preview interface when the shooting preview interface is displayed. The processor 110 is configured to, in response to the first input, determine motion parameters of the target moving object during the movement according to at least two frames of images collected during the movement of the target moving object. The processor 110 is further configured to photograph the target moving object based on the motion parameters of the target moving object to obtain a target image.

An embodiment of the present application provides an electronic device. Since the electronic device can identify the motion parameters of the target moving object in the shooting preview interface, when the electronic device is shooting the target moving object, the electronic device can use the shooting preview The interface determines the motion parameters of the target moving object during the movement, and shoots the target moving object so that the projection of the target moving object on the image sensor can be relatively static, so as to achieve the shooting effect of panning, which avoids the user from moving the electronic device The jitter generated when the electronic device is used leads to poor imaging effect of the image captured by the electronic device. In this way, while the efficiency of capturing the panning image by the electronic device is improved, the imaging effect of the panning image captured by the electronic device is also improved.

Optionally, in the embodiment of the present application, the above-mentioned motion parameters include motion direction and motion speed; the above-mentioned processor 110 is specifically configured to determine the position offset and feature pixel offset of the target moving object according to at least two frames of images; And according to the position offset and the characteristic pixel offset, determine the pixel offset of the target moving object in the first direction and the pixel offset in the second direction, the first direction is perpendicular to the second direction; and according to The pixel offset in the first direction and the pixel offset in the second direction determine the moving direction and moving speed of the target moving object during the moving process.

Optionally, in the embodiment of the present application, the above-mentioned processor 110 is specifically configured to obtain at least two position information, and determine the position offset according to the at least two position information, and each position information is the target moving object in one frame Position information in the image: image recognition is performed on at least two frames of images to obtain feature pixels of the at least two frames of images, and feature comparison is performed on the feature pixels of the at least two frames of images to obtain feature pixel offsets.

Optionally, in the embodiment of the present application, the above-mentioned processor 110 is specifically configured to determine the target angle value according to the pixel offset in the first direction and the pixel offset in the second direction, and value, to determine the direction of movement of the target moving object during the movement process, the target angle value is the angle value between the horizontal direction and the movement direction of the target moving object during the movement process, and the horizontal direction is the first direction or the second direction; and according to The pixel offset in the first direction and the pixel offset in the second direction determine the target pixel offset, and determine the moving speed of the target moving object during the movement according to the target pixel offset and the target exposure time , the target exposure time is the image exposure time of the target moving object during motion.

Optionally, in this embodiment of the present application, the above-mentioned motion parameters include motion speed and motion direction; the above-mentioned processor 110 is specifically configured to determine the motion acceleration of the target motion object according to the motion speed of the target motion object during motion; The moving speed and moving acceleration of the moving object during the movement process determine the average moving speed of the target moving object; according to the average moving speed, the target exposure time and the inherent parameters of the camera, determine the rotation angle value of the camera within the target exposure time; according to the rotation The angle value and the movement direction of the target moving object control the rotation of the camera.

The electronic device provided by the embodiment of the present application can realize each process realized by the above method embodiment, and can achieve the same technical effect, and to avoid repetition, details are not repeated here.

For the beneficial effects of the various implementations in this embodiment, refer to the beneficial effects of the corresponding implementations in the foregoing method embodiments. To avoid repetition, details are not repeated here.

It should be understood that, in the embodiment of the present application, the input unit 104 may include a graphics processing unit (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processing unit 1041 is compatible with the image capturing device (such as Camera) to process the image data of still pictures or videos. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 107 includes at least one of a touch panel 1071 and other input devices 1072 . The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts, a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.

The memory 109 can be used to store software programs as well as various data. The memory 109 can mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area can store an operating system, an application program or instructions required by at least one function (such as a sound playing function, image playback function, etc.), etc. Furthermore, memory 109 may include volatile memory or nonvolatile memory, or, memory 109 may include both volatile and nonvolatile memory. Wherein, the non-volatile memory may be a read-only memory (Read-Only Memory, ROM), a programmable read-only memory (Programmable ROM, PROM), an erasable programmable read-only memory (Erasable PROM, EPROM), an electronically programmable Erase Programmable Read-Only Memory (Electrically EPROM, EEPROM) or Flash. Volatile memory can be random access memory (Random Access Memory, RAM), static random access memory (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), synchronous dynamic random access memory (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDRSDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous connection dynamic random access memory (Synch link DRAM , SLDRAM) and Direct Memory Bus Random Access Memory (Direct Rambus RAM, DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to the operating system, user interface, and application programs, etc., Modem processors mainly process wireless communication signals, such as baseband processors. It can be understood that the foregoing modem processor may not be integrated into the processor 110 .

The embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, each process of the above-mentioned method embodiment is realized, and the same technology can be achieved. Effect, in order to avoid repetition, will not repeat them here.

Wherein, the processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk, and the like.

The embodiment of the present application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above method embodiments , and can achieve the same technical effect, in order to avoid repetition, it will not be repeated here.

It should be understood that the chips mentioned in the embodiments of the present application may also be called system-on-chip, system-on-chip, system-on-a-chip, or system-on-a-chip.

An embodiment of the present application provides a computer program product, the program product is stored in a storage medium, and the program product is executed by at least one processor to implement the various processes in the above-mentioned shooting method embodiment, and can achieve the same technical effect, To avoid repetition, details are not repeated here.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved. Functions are performed, for example, the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on such an understanding, the technical solution of the present application can be embodied in the form of computer software products, which are stored in a storage medium (such as ROM/RAM, magnetic disk, etc.) , optical disc), including several instructions to enable a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in various embodiments of the present application.

The embodiments of the present application have been described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementations. The above-mentioned specific implementations are only illustrative and not restrictive. Those of ordinary skill in the art will Under the inspiration of this application, without departing from the purpose of this application and the scope of protection of the claims, many forms can also be made, all of which belong to the protection of this application.

Claims (10)

1. A shooting method, characterized in that the method comprises: When the shooting preview interface is displayed, receiving a user's first input on the target moving object in the shooting preview interface; In response to the first input, determine motion parameters of the target moving object during the movement according to at least two frames of images collected during the movement of the target moving object; Based on the motion parameters of the target moving object, the target moving object is photographed to obtain a target image. 2. The method according to claim 1, wherein the motion parameters include motion direction and motion speed; said target motion object is determined according to at least two frames of images during the motion process of the target motion object Movement parameters during exercise, including: Determine the position offset and feature pixel offset of the target moving object according to the at least two frames of images; According to the position offset and the characteristic pixel offset, determine the pixel offset of the target moving object in the first direction and the pixel offset in the second direction, the first direction is different from the pixel offset in the second direction. said second direction is perpendicular; According to the pixel offset in the first direction and the pixel offset in the second direction, the moving direction and moving speed of the target moving object during the moving process are determined. 3. The method according to claim 2, wherein the determining the position offset and feature pixel offset of the target moving object according to the at least two frames of images comprises: Acquire at least two position information, and determine the position offset according to the at least two position information, each position information is the position information of the target moving object in a frame of image; Image recognition is performed on the at least two frames of images to obtain feature pixels of the at least two frames of images, and feature comparison is performed on the feature pixels of the at least two frames of images to obtain the feature pixel offset. 4. The method according to claim 2, wherein, according to the pixel offset in the first direction and the pixel offset in the second direction, it is determined that the target moving object is moving The direction and speed of movement during the process, including: Determine a target included angle value according to the pixel offset in the first direction and the pixel offset in the second direction, and determine that the target moving object is in motion according to the target included angle value direction of movement, the target included angle value is the included angle value between the horizontal direction and the moving direction of the target moving object during the movement, and the horizontal direction is the first direction or the second direction; determining a target pixel offset according to the pixel offset in the first direction and the pixel offset in the second direction, and determining the target moving object according to the target pixel offset and the target exposure time The moving speed during the moving process, the target exposure time is the image exposure time of the target moving object during the moving process. 5. The method according to any one of claims 1 to 4, characterized in that, the motion parameters include motion speed and motion direction; the motion parameters based on the target moving object, for the target moving object Shoot to get the target image, including: determining the motion acceleration of the target moving object according to the moving speed of the target moving object during the movement; determining the average moving speed of the target moving object according to the moving speed and moving acceleration of the target moving object during the movement; Determine the rotation angle value of the camera within the target exposure time according to the average motion speed, target exposure time and inherent parameters of the camera; The rotation of the camera is controlled according to the rotation angle value and the moving direction of the target moving object. 6. A photographing device, characterized in that the device comprises: a receiving module, a determining module and a photographing module; The receiving module is configured to receive the user's first input on the target moving object in the shooting preview interface when the shooting preview interface is displayed; The determining module is configured to, in response to the first input received by the receiving module, determine the movement of the target moving object during the movement according to at least two frames of images collected during the movement of the target moving object parameter; The photographing module photographs the target moving object based on the motion parameters of the target moving object to obtain a target image. 7. The device according to claim 6, wherein the motion parameters include motion direction and motion speed; the determination module is specifically configured to determine the position of the target moving object according to the at least two frames of images offset and feature pixel offset; and according to the position offset and the feature pixel offset, determine the pixel offset of the target moving object in the first direction and the pixel in the second direction offset, the first direction is perpendicular to the second direction; and according to the pixel offset in the first direction and the pixel offset in the second direction, it is determined that the target moving object is Movement direction and movement speed during movement. 8. The device according to claim 7, wherein the determining module is specifically configured to acquire at least two pieces of location information, and determine the location offset according to the at least two pieces of location information, each The position information is the position information of the target moving object in one frame of images; and performing image recognition on the at least two frames of images to obtain the feature pixels of the at least two frames of images, and performing image recognition on the at least two frames of images A feature comparison is performed on the feature pixels to obtain the feature pixel offset. 9. The device according to claim 7, wherein the determination module is specifically configured to determine the target according to the pixel offset in the first direction and the pixel offset in the second direction The included angle value, and according to the target included angle value, determine the moving direction of the target moving object during the movement process, the target included angle value is the difference between the horizontal direction and the moving direction of the target moving object during the moving process Angle value, the horizontal direction is the first direction or the second direction; and according to the pixel offset in the first direction and the pixel offset in the second direction, determine the target pixel offset, and determine the moving speed of the target moving object during the movement according to the target pixel offset and the target exposure time, where the target exposure time is the image exposure time of the target moving object during the movement. 10. The device according to any one of claims 6 to 9, wherein the motion parameters include motion speed and motion direction; the photographing module is specifically configured to The moving speed of the target moving object is determined to determine the moving acceleration of the target moving object; and according to the moving speed and moving acceleration of the target moving object during the movement process, the average moving speed of the target moving object is determined; and according to the average moving speed , the target exposure time and the intrinsic parameters of the camera, determining the rotation angle value of the camera within the target exposure time; and controlling the rotation of the camera according to the rotation angle value and the movement direction of the target moving object.

Images