CN108924438A - shooting control method and related product - Google Patents

Abstract

The embodiment of the application discloses a shooting control method and a related product, which are applied to electronic equipment comprising an ultrasonic sensor.

Description

Shooting control method and related products

technical field

The present application relates to the technical field of shooting, and in particular to a shooting control method and related products.

Background technique

With the popularization and application of electronic devices (such as: mobile phones, tablet computers, etc.), electronic devices can support more and more applications, and their functions are becoming more and more powerful. Indispensable electronic supplies.

Nowadays, more and more users use electronic devices to shoot videos or images, as well as live video broadcasts. Generally speaking, users will post-process the captured pictures or videos after shooting, such as adding special effects, etc. However, in the live broadcast scene, usually the audience will watch the video in real time, and it is difficult to add special effects to the live video. Therefore, the problem of how to add special effects to the video or image being shot during the shooting process needs to be solved urgently.

Contents of the invention

Embodiments of the present application provide a shooting control method and related products, which can add special effects to a picture being shot according to user's body movements.

In the first aspect, an embodiment of the present application provides a shooting control method applied to an electronic device, where the electronic device includes an ultrasonic sensor, and the method includes:

When the electronic device is in the shooting mode, acquire the target body movement of the user through the ultrasonic sensor;

determining the target special effect according to the target body movement;

Adding the target special effect to the current screen of the display screen of the electronic device.

In a second aspect, an embodiment of the present application provides a shooting control device, which is applied to an electronic device, the electronic device includes an ultrasonic sensor, and the shooting control device includes:

An acquisition unit, configured to acquire the target body movement of the user through the ultrasonic sensor when the electronic device is in the shooting mode;

A determining unit, configured to determine target special effects according to the target body movement;

A control unit, configured to add the target special effect to the current screen of the display screen of the electronic device.

In a third aspect, an embodiment of the present application provides an electronic device, including: an ultrasonic sensor, a processor, and a memory; and one or more programs, the one or more programs are stored in the memory and configured To be executed by the processor, the program includes instructions for some or all of the steps as described in the first aspect.

In a fourth aspect, the embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program, wherein the computer program enables the computer to execute the computer according to the first aspect of the embodiment of the present application. instructions for some or all of the steps described in .

In a fifth aspect, an embodiment of the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable the computer to execute the Part or all of the steps described in the first aspect of the application example. The computer program product may be a software installation package.

Implementing the embodiment of the present application has the following beneficial effects:

It can be seen that the shooting control method and related products described in the embodiments of the present application are applied to electronic devices including ultrasonic sensors. The target special effect is determined, and the target special effect is added to the current picture of the display screen of the electronic device, so that the special effect can be added to the picture being shot according to the user's body movements.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present application. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1A is a schematic structural diagram of an exemplary electronic device provided in an embodiment of the present application;

FIG. 1B is a schematic flowchart of a shooting control method provided in an embodiment of the present application;

Fig. 1C is a schematic diagram of a demonstration of determining the contour of the user's body through multiple reflection points provided by the embodiment of the present application;

FIG. 1D is a schematic diagram of a demonstration of adding special effects through the user's target body movements provided by the embodiment of the present application;

FIG. 2 is a schematic flowchart of another shooting control method provided in the embodiment of the present application;

FIG. 3 is a schematic flowchart of another shooting control method provided by an embodiment of the present application;

Fig. 4 is another schematic structural diagram of an electronic device provided by an embodiment of the present application;

FIG. 5 is a schematic structural diagram of a shooting control device provided in an embodiment of the present application;

FIG. 6 is a schematic structural diagram of another electronic device provided by an embodiment of the present application.

Detailed ways

In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiment of the application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiment of the application. Obviously, the described embodiment is only It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

The terms "first", "second" and the like in the specification and claims of the present application and the above drawings are used to distinguish different objects, rather than to describe a specific order. Furthermore, the terms "include" and "have", as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optionally further includes For other steps or units inherent in these processes, methods, products or devices.

Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The occurrences of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is understood explicitly and implicitly by those skilled in the art that the embodiments described herein can be combined with other embodiments.

The electronic devices involved in the embodiments of the present application may include various handheld devices with wireless communication functions, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to wireless modems, as well as various forms of user equipment (user equipment, UE), mobile station (mobile station, MS), terminal device (terminal device) and so on. For convenience of description, the devices mentioned above are collectively referred to as electronic devices.

The following describes the embodiments of the present application in detail.

Please refer to FIG. 1A. FIG. 1A is a schematic structural diagram of an electronic device 100 provided in an embodiment of the present application. The above-mentioned electronic device 100 includes: a housing 110, a circuit board 120 disposed in the housing 110, an ultrasonic sensor 130 and The display screen 140 arranged on the housing 110, the circuit board 120 is provided with a processor 121, the ultrasonic sensor 130 is connected to the processor 121, the processor 121 is connected to the display screen 140, Wherein, the ultrasonic sensor 130 may include an ultrasonic transmitter and an ultrasonic receiver, the ultrasonic transmitter may include one or more speakers, earpieces or other electro-acoustic conversion units, and the ultrasonic receiver may include one or more microphones or other acoustic-electric conversion units , the above-mentioned ultrasonic transmitter and ultrasonic receiver may be located on the front, back, frame, etc. of the electronic device, which is not limited in this embodiment of the present application.

The following describes the embodiments of the present application in detail.

Please refer to FIG. 1B. FIG. 1B is a schematic flowchart of a shooting control method provided in an embodiment of the present application. The shooting control method described in this embodiment is applied to the electronic device shown in FIG. 1A, and the electronic device includes ultrasonic sensor, the shooting control method includes:

101. When the electronic device is in a shooting mode, acquire body movements of a target through an ultrasonic sensor.

In the embodiment of the present application, the electronic device can pre-set the special effect shooting mode and the traditional shooting mode, wherein the special effect is the content with a specific visual effect added in the shooting screen, and the traditional shooting mode refers to the shooting mode that does not include the operation of adding special effects The special effect shooting mode refers to the shooting mode in which special effects are added during the shooting process. The user can set the shooting mode in the special effect shooting mode, so that in the process of shooting images or videos by the electronic device, the user's target body movements are automatically obtained through the ultrasonic sensor. .

Wherein, the above-mentioned target body movements include actions formed by the user through the movement of various body parts, and the target body movements may include at least one of the following, for example: an action made by a body part of the user, for example, an action of the user's left or right finger gesticulating a heart, Actions made by multiple body parts of the user, for example, the action of the user raising his hands above his head to form a heart, or the action of raising his legs with both feet of the user, the action of posing various body parts of the user in specific postures, etc.

Optionally, in the above step 101, acquiring the target body movement through the ultrasonic sensor may include the following steps:

11. Transmitting an ultrasonic signal through an ultrasonic transmitter of the ultrasonic sensor, and receiving an echo signal of the ultrasonic signal through an ultrasonic receiver of the ultrasonic sensor;

12. According to the ultrasonic signal and the echo signal, identify the sub-actions of each limb in the plurality of body parts, and obtain a plurality of sub-actions of the body;

13. Composing the target body motion according to at least one body sub-motion in the plurality of body sub-motions.

In the embodiment of the present application, the ultrasonic transmitter of the ultrasonic sensor can transmit the ultrasonic signal according to the preset frequency. When the transmitted ultrasonic signal encounters an obstacle, it will be reflected by the obstacle, and the reflected echo can be received by the ultrasonic receiver of the ultrasonic sensor. Wave signal, where the obstacle can be a person, animal, object, etc. within the range of the distance between the electronic device and the electronic device is less than the preset distance threshold. The user is analyzed as an obstacle. The ultrasonic signal is reflected by various positions of the user's body, and an echo signal will be generated. According to the time length t between transmitting the ultrasonic signal and receiving the echo signal, and the propagation speed c of the ultrasonic signal, the user's body can be determined. The distance between each reflection point and the electronic device in the multiple reflection points of the multiple positions of the ultrasonic wave is obtained, and multiple distances are obtained, and each reflection point corresponds to a distance, wherein the calculation formula of the distance d is: d=t* c/2, the three-dimensional coordinate system in the three-dimensional space can be established in advance, and the coordinates of each reflection point in the three-dimensional coordinate system of the multiple reflection points on the user's body can be determined according to multiple distances and the propagation direction of the ultrasonic waves, and then the multiple reflection points Points are connected to obtain the user's body contour, as shown in Figure 1C, Figure 1C is a schematic diagram of a demonstration of determining the user's body contour through multiple reflection points provided by the embodiment of the application, according to the body contour, the user's body shape can be determined The body sub-actions of each body part, one body part corresponds to one body part action, where the body part can include at least one of the following: the user's head, face, neck, left hand, right hand, stomach, buttocks, left foot, right foot, Left leg, right leg and so on.

Among them, in step 13, the target body movement may be composed of sub-movements of multiple limbs. For example, the target body movement is an action in which the legs are separated and the hands are stretched to both sides. The target body movement is composed of the left hand, right hand, left leg, The target body action may also be composed of sub-actions of one limb, for example, the movement of the right hand (or left hand) swinging up and down. Therefore, it can be performed according to at least one of the sub-actions of multiple limbs. Combined to get the target body movement.

Optionally, in the above step 101, acquiring the target body movement through the ultrasonic sensor may include the following steps:

14. Acquiring sound field change information of the ultrasonic sound field generated by the ultrasonic sensor within a preset time period;

15. Determine the trajectory of the limb movement according to the sound field change information, and generate a trajectory image;

16. Matching the trajectory image with a plurality of image templates in the preset image template library to obtain a plurality of matching values, and each image template in the plurality of image templates corresponds to a body movement;

17. Determine the target body movement corresponding to the image template with the largest matching value among the plurality of image templates.

In the embodiment of the present application, for the sound field change information of the ultrasonic sound field within a preset time period, first, a plurality of sound wave distribution information at multiple time points within the preset time period can be obtained, and then, according to the preset sound wave distribution information and A plurality of sound wave distribution information determines a plurality of difference sound wave distribution information, wherein the preset sound wave distribution information is the sound wave distribution information when there is no obstacle in the sound field, and finally, the sound field change information is determined according to the plurality of difference sound wave distribution information, specifically , can sequentially determine multiple change sub-information between two difference sound wave distribution information corresponding to two adjacent two time points, change sub-information between any two adjacent first moments and second moments, It can reflect the change of the limb state of the user from the first moment to the second moment. The change of the limb state can include at least one of the following: the moving distance of the limb, the swing amplitude of the limb, the rotation angle of the limb, etc., thus, according to multiple changes The sub-information determines the changes of the user's limb state at multiple time points, and then determines the user's limb movement trajectory according to the multiple change sub-information, and generates a trajectory image. In addition, multiple image templates corresponding to multiple different gestures can be preset , each image template corresponds to a gesture, and an image template library is established, and then the generated trajectory image is matched with multiple image templates in the preset image template library to obtain the matching value of the trajectory image and each image template, Therefore, the gesture corresponding to the image template with the largest matching value among the multiple image templates is used as the target body movement.

For example, the user can draw a heart-shaped trajectory in three-dimensional space with the left hand and the right hand, and can determine the position of the user's hands at each time period in multiple time points through the above-mentioned sound field change information, and determine the The body movement trajectories of the user's left and right hands, and then determine the target body movements of the left and right hands according to the body movement trajectories.

102. Determine a target special effect according to the target body movement.

In the embodiment of the present application, after obtaining the above-mentioned target body movements, the mapping relationship corresponding to the target body movements can be determined according to the preset mapping relationship between the body movements and the special effects, wherein, when the electronic device captures an image, the target special effects can include At least one of the following: color adjustment of part of the image, adding new images, text, etc. to the image, for example, when the target body movement is the action of the user's left or right finger gesticulating a heart, the corresponding target special effect can be set to "flicker" When the electronic device shoots a video, the target special effect can include at least one of the following: adding animation, static image, music, etc. For example, the user's hand is waving in the air, and the target special effect can be set to add fluorescence that follows the hand.

Optionally, in the above step 102, determining the target special effect according to the target body movement may include the following steps:

21. Determine composition information of at least one body part corresponding to the target body movement;

22. Determine the target mapping relationship corresponding to the composition information in the preset mapping relationship set, where each set of mapping relationships in the mapping relationship set is the mapping relationship between body movements and special effects;

23. Determine a target special effect corresponding to the target body movement according to the target mapping relationship.

In this embodiment of the application, the above composition information refers to the composition information of at least one body part that constitutes the target body movement, and the target body movement can be composed of one or more body parts such as hands, head, stomach, buttocks, legs, feet Therefore, the mapping relationship between body movements and special effects can be pre-set under multiple different composition information, so that after determining the composition information of the target body movement, the corresponding combination information can be determined. Target mapping relationship, for example, when the composition information of target body movements is hands and feet, the target mapping relationship between body movements and special effects corresponding to the composition information of hands and feet can be preset, and the target mapping relationship is multiple body movements The mapping relationship with multiple special effects. The multiple body movements in the target mapping relationship are all body movements composed of hand and foot body movements. Finally, according to the target mapping relationship, determine the target special effect corresponding to the target body movement .

Optionally, in the above step 21, the target body movement corresponds to a target body part, and the determining the composition information of at least one body part corresponding to the target body movement may include the following steps:

A1. Determine the target limb type to which the target limb part corresponding to the target limb movement belongs;

A2. Judging whether the target limb type is a specified type, and there is a symmetrical limb part symmetrical to the target limb part in the specified type;

A3. If yes, obtain the first position of the target body part in the shooting frame, and the second position of the symmetrical body part in the shooting frame;

A4. Determine the relative positional relationship between the target limb part and the symmetrical limb part according to the first position and the second position, and determine the composition information of the target limb part according to the relative positional relationship.

In the embodiment of this application, the above specified type refers to the type of body parts with symmetry. For symmetrical body parts such as left hand, right hand, left leg, right leg, left foot, and right foot, different body parts can be set to make The same action corresponds to different special effects. For example, it can be set that the action of gesticulating a heart made by the left hand corresponds to the first special effect, and the action of gesticulating a heart made by the right hand corresponds to the second special effect. The first special effect is different from the second special effect. In this way, the The types of special effects corresponding to limited body parts are more abundant.

In view of the above situation, in the process of determining the composition information of at least one body part corresponding to the target body action, if it is determined that the target body action corresponds to a target body part, and the target body part belongs to a specified type of body part, it is necessary to combine the body part with Symmetrical body parts are distinguished, for example, to distinguish which body part of the left hand and right hand made the target body movement, since the user's various body parts have a certain relative positional relationship, it can be based on the target body part and the symmetrical body part. The relative positional relationship distinguishes the target body part from the symmetrical body part. The relative positional relationship can include any of the following: up-down relationship, left-right relationship, and front-to-back relationship. The left hand in the picture is the user's right hand, and the right hand in the shooting screen is the user's left hand. Then, determine whether the body part corresponding to the target body movement is the left hand or the right hand. The left hand in the shooting screen is the user's left hand, and the right hand in the shooting screen is the user's right hand.

103. Add the target special effect to the current screen of the display screen of the electronic device.

In the embodiment of the present application, the target special effect can be added to the current picture of the display screen to make the captured image or video more interesting. Specifically, the special effect can be added to a preset area in the shooting picture, and the preset area can be It is a system setting, and it can also be set by the user.

Optionally, when multiple users are included in the shooting picture, the body movements of the multiple users may be recognized, and then the target special effect is determined according to the body movements of the multiple users.

For example, in the scene where the user performs a live video broadcast, the electronic device can be controlled by body movements to add special effects to the live broadcast screen, as shown in Figure 1D, which is a method for adding special effects through the user's target body movements provided by this application. From the schematic diagram of the demonstration, it can be seen that when the user makes the target body movement to separate the legs and stretch the hands to the sides, special effects of fluorescence and flame can be added.

Optionally, at least one screen area of at least one body part corresponding to the target body movement in the display screen may be determined, and then the content of the target special effect is scaled according to the ratio of the total area of at least one screen area to the total area of the screen, so that Make the target special effects appear with body movements.

Optionally, in this embodiment of the application, after the image or video is obtained by shooting the current picture with the above-mentioned target special effect, the target image can be stored in the captured image or video, so that the user can view the image or video During the process, the target special effects can be seen at the same time.

Optionally, since the added target special effect is an additional effect in the captured image or video, the electronic device may receive the user's preset operation control instruction, and then revoke the target special effect according to the preset operation control instruction, thereby restoring The original display effect of images or videos enables users to edit the captured images or videos flexibly.

Optionally, two or more corresponding special effects can be set for the target body movement, and any special effect in the two or more special effects can be preset as the default special effect. In the above step 102, the default special effect can be determined according to the target body movement as the default special effect. Target special effects, after the shooting is completed, can receive the user's setting instructions to replace the added target special effects, so as to realize the diversity of special effects and meet the individual needs of users.

It can be seen that the shooting control method described in the embodiment of the present application is applied to an electronic device including an ultrasonic sensor. When the electronic device is in the shooting mode, the target body movement of the user is obtained through the ultrasonic sensor, and the target special effect is determined according to the target body movement. Adding target special effects to the current picture of the display screen of the electronic device, so that special effects can be added to the picture being shot according to the user's body movements.

Please refer to FIG. 2. FIG. 2 is a schematic flowchart of another shooting control method provided by the embodiment of the present application. The shooting control method described in this embodiment is applied to the electronic device shown in FIG. 1A, and the electronic device includes an ultrasonic sensor. The method may include the steps of:

201. When the electronic device is in a shooting mode, use the ultrasonic sensor to acquire a body movement of a target.

202. Determine a target special effect according to the target body movement.

Wherein, for the specific implementation process of the above-mentioned steps 201-202, reference may be made to the corresponding description in the method shown in FIG. 1B , which will not be repeated here.

203. Acquire the movement speed of the user.

In the embodiment of this application, during the process of shooting video, the user’s movement speed may appear relatively fast. For example, during the process of dancing, the movement speed of the limbs of the user will be relatively fast, and the jump of the captured video screen is relatively fast. Fast, if special effects are added in this case, the duration of the special effects in the corresponding screen is relatively short, and it is difficult to present a good visual effect. Therefore, the user's movement speed can be obtained, where the user's movement speed refers to the user's body The movement speed of the part, to obtain the movement speed of the user, can be obtained by obtaining at least one movement distance or movement range from the first moment to the second moment of at least one body part corresponding to the user's target body movement, and then according to at least one movement distance or The maximum movement distance or the maximum movement range in the movement range determines the user's movement speed.

204. If the movement speed is less than a preset threshold, add the target special effect to the current screen of the display screen of the electronic device.

Wherein, the above-mentioned preset threshold can be set by the user, or, by default, if the motion speed is greater than or equal to the preset threshold, this process is terminated, and if the motion speed is less than the preset threshold, special effects are added to the current screen of the display screen. In this way, by limiting the movement speed of the electronic device, it can be more intelligently determined whether to add special effects to the captured video to improve the visual effect of the captured video.

It can be seen that the shooting control method described in the embodiment of the present application is applied to an electronic device including an ultrasonic sensor. When the electronic device is in the shooting mode, the target body movement of the user is obtained through the ultrasonic sensor, and the target special effect is determined according to the target body movement. , acquiring the motion speed of the user, and if the motion speed is less than a preset threshold, adding the target special effect to the current picture of the display screen of the electronic device, so that the special effect can be flexibly added to the picture being shot according to the user's body movements.

Consistent with the above, please refer to FIG. 3 , which is a schematic flowchart of another shooting control method provided in the embodiment of the present application. The shooting control method described in this embodiment is applied to the electronic device shown in FIG. 1A , electronic The device includes an ultrasonic sensor for generating a sound field, and the method may include the following steps:

301. When the electronic device is in a shooting mode, transmit an ultrasonic signal through an ultrasonic transmitter of the ultrasonic sensor, and receive an echo signal of the ultrasonic signal through an ultrasonic receiver of the ultrasonic sensor.

302. Identify, according to the ultrasonic signal and the echo signal, the sub-motions of each limb in the multiple body parts, to obtain multiple sub-motions of the limbs.

303. Compose the target body motion according to at least one body sub-motion in the plurality of body sub-motions.

304. Determine a target special effect according to the target body movement.

305. Acquire the movement speed of the user.

306. If the movement speed is less than a preset threshold, add the target special effect to the current screen of the display screen of the electronic device.

Wherein, the specific implementation process of the above-mentioned steps 301-304 can refer to FIG. 1B , and the specific implementation process of steps 305-306 can refer to the corresponding description in the method shown in FIG. 2 , which will not be repeated here.

The shooting control method described in the embodiment of the present application is applied to an electronic device including an ultrasonic sensor. When the electronic device is in the shooting mode, the ultrasonic signal is transmitted by the ultrasonic transmitter of the ultrasonic sensor, and received by the ultrasonic receiver of the ultrasonic sensor. The echo signal of the ultrasonic signal, according to the ultrasonic signal and the echo signal, recognizes the limb sub-actions of each of the multiple limb parts of the user, obtains multiple limb sub-actions, and according to at least one of the multiple limb sub-actions Actions form the target body movement, determine the target special effect according to the target body movement, and obtain the user's movement speed. If the movement speed is less than the preset threshold, add the target special effect to the current screen of the display screen of the electronic device, so that the user's movement speed can be obtained. Body movements flexibly add special effects to the scene being shot.

The following is a device for implementing the above shooting control method, specifically as follows:

Consistent with the above, please refer to Figure 4, Figure 4 is an electronic device provided by an embodiment of the present application, including: an ultrasonic sensor, a processor and a memory; and one or more programs, the one or more programs are stored In the memory, and configured to be executed by the processor, the program includes instructions for:

When the electronic device is in the shooting mode, acquiring target body movements through the ultrasonic sensor;

determining the target special effect according to the target body movement;

Adding the target special effect to the current screen of the display screen of the electronic device.

In a possible example, in terms of acquiring the target body movement of the user through the ultrasonic sensor, the program includes instructions for performing the following steps:

transmitting an ultrasonic signal through an ultrasonic transmitter of the ultrasonic sensor, and receiving an echo signal of the ultrasonic signal through an ultrasonic receiver of the ultrasonic sensor;

identifying the sub-actions of each of the user's multiple limbs according to the ultrasonic signal and the echo signal, and obtaining multiple sub-actions of the limbs;

Composing the target body motion according to at least one body motion in the plurality of body motions.

In a possible example, in terms of acquiring the target body movement of the user through the ultrasonic sensor, the program includes instructions for performing the following steps:

Obtaining sound field change information of the ultrasonic sound field generated by the ultrasonic sensor within a preset time period;

Determining limb movement trajectories according to the sound field change information, and generating a trajectory image;

Matching the trajectory image with a plurality of image templates in the preset image template library to obtain a plurality of matching values, and each image template in the plurality of image templates corresponds to a body movement;

Determine the target body movement corresponding to the image template with the largest matching value among the plurality of image templates.

In a possible example, in terms of determining the target special effect according to the target body movement, the program includes instructions for performing the following steps:

determining composition information of at least one body part corresponding to the target body movement;

Determine the target mapping relationship corresponding to the composition information in the preset mapping relationship set, where each set of mapping relationships in the mapping relationship set is the mapping relationship between body movements and special effects;

A target special effect corresponding to the target body movement is determined according to the target mapping relationship.

In a possible example, the target body action corresponds to a target body part, and in terms of determining composition information of at least one body part corresponding to the target body action, the program includes instructions for performing the following steps:

determining the target limb type to which the target limb part corresponding to the target limb movement belongs;

judging whether the target limb type is a specified type, and there is a symmetrical limb part symmetrical to the target limb part in the specified type;

If yes, obtain a first position of the target body part in the shooting frame, and a second position of the symmetrical body part in the shooting frame;

The relative positional relationship between the target limb part and the symmetrical limb part is determined according to the first position and the second position, and the composition information of the target limb part is determined according to the relative positional relationship.

In one possible example, the program further includes instructions for performing the following steps:

Obtain the movement speed of the user;

If the movement speed is less than the preset threshold, the step of adding the target special effect to the current screen of the display screen of the electronic device is executed.

Please refer to FIG. 5 . FIG. 5 is a schematic structural diagram of a shooting control device provided in this embodiment. The shooting control device is applied to electronic equipment, and the electronic device includes an ultrasonic sensor, and the shooting control device includes an acquisition unit 501, a determination unit 502, and a control unit 503, wherein,

The acquiring unit 501 is configured to acquire target body movements through the ultrasonic sensor when the electronic device is in a shooting mode;

The determining unit 502 is configured to determine target special effects according to the target body movements;

The control unit 503 is configured to add the target special effect to the current screen of the display screen of the electronic device.

Optionally, in terms of acquiring the target body movement of the user through the ultrasonic sensor, the acquiring unit 501 is specifically configured to:

transmitting an ultrasonic signal through an ultrasonic transmitter of the ultrasonic sensor, and receiving an echo signal of the ultrasonic signal through an ultrasonic receiver of the ultrasonic sensor;

identifying the sub-actions of each of the user's multiple limbs according to the ultrasonic signal and the echo signal, and obtaining multiple sub-actions of the limbs;

Composing the target body motion according to at least one body motion in the plurality of body motions.

Optionally, the determining unit 502 is specifically configured to:

transmitting an ultrasonic signal through an ultrasonic transmitter of the ultrasonic sensor, and receiving an echo signal of the ultrasonic signal through an ultrasonic receiver of the ultrasonic sensor;

identifying the sub-actions of each of the user's multiple limbs according to the ultrasonic signal and the echo signal, and obtaining multiple sub-actions of the limbs;

Composing the target body motion according to at least one body motion in the plurality of body motions.

Optionally, the determining unit 502 is specifically configured to:

Obtaining sound field change information of the ultrasonic sound field generated by the ultrasonic sensor within a preset time period;

Determining limb movement trajectories according to the sound field change information, and generating a trajectory image;

Matching the trajectory image with a plurality of image templates in the preset image template library to obtain a plurality of matching values, and each image template in the plurality of image templates corresponds to a body movement;

Determine the target body movement corresponding to the image template with the largest matching value among the plurality of image templates.

Optionally, the target body action corresponds to a target body part, and in terms of determining composition information of at least one body part corresponding to the target body action, the determining unit 502 is specifically configured to:

determining the target limb type to which the target limb part corresponding to the target limb movement belongs;

judging whether the target limb type is a specified type, and there is a symmetrical limb part symmetrical to the target limb part in the specified type;

If yes, obtain a first position of the target body part in the shooting frame, and a second position of the symmetrical body part in the shooting frame;

The relative positional relationship between the target limb part and the symmetrical limb part is determined according to the first position and the second position, and the composition information of the target limb part is determined according to the relative positional relationship.

Optionally, the acquiring unit 501 is also configured to acquire the user's movement speed;

If the movement speed is less than the preset threshold, the control unit 503 executes the step of adding the target special effect to the current screen of the display screen of the electronic device.

It can be seen that the shooting control device described in the embodiments of the present application is applied to electronic equipment including an ultrasonic sensor. When the electronic equipment is in the shooting mode, the ultrasonic transmitter of the ultrasonic sensor transmits an ultrasonic signal, and the ultrasonic sensor transmits an ultrasonic signal. The ultrasonic receiver receives the echo signal of the ultrasonic signal, and recognizes the limb sub-actions of each of the user's multiple limb parts according to the ultrasonic signal and the echo signal, and obtains multiple limb sub-actions, and according to the multiple body sub-actions At least one body sub-action constitutes a target body action, and the target special effect is determined according to the target body action, and the user's movement speed is obtained. If the movement speed is less than a preset threshold, the target special effect is added to the current screen of the display screen of the electronic device, thereby, It can flexibly add special effects to the picture being shot according to the user's body movements.

It can be understood that the functions of the program modules of the shooting control device in this embodiment can be implemented according to the method in the above method embodiment, and the specific implementation process can refer to the relevant description of the above method embodiment, and will not be repeated here.

The embodiment of the present application also provides another electronic device, as shown in Figure 6, for the convenience of description, only the parts related to the embodiment of the present application are shown, and the specific technical details are not disclosed, please refer to the method of the embodiment of the present application part. The electronic device can be any terminal device including mobile phone, tablet computer, PDA (personal digital assistant, personal digital assistant), POS (point of sales, sales terminal), vehicle-mounted computer, etc. Taking the electronic device as a mobile phone as an example:

The electronic device 6000 shown in Figure 6 includes: at least one processor 6011, a memory 6012, a communication interface (including a SIM interface 6014, an audio input interface 6015, a serial interface 6016 and other communication interfaces 6017), a signal processing module 6013 (including receiver 6018, transmitter 6019, LOs6020 and signal processor 6021), input and output modules (including display screen 6022, speaker 6023, microphone 6024, sensor 6025, etc.). Those skilled in the art can understand that the structure of the electronic device shown in FIG. 6 does not constitute a limitation on the electronic device, and may include more or less components than shown in the figure, or combine some components, or arrange different components.

The components of the electronic device are specifically introduced below in conjunction with FIG. 6 :

The processor 6011 is the control center of the mobile phone. It uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and/or modules stored in the memory 6012, and calling data stored in the memory, the electronic system is executed. Various functions and processing data of the equipment, so as to monitor the electronic equipment as a whole. Optionally, the processor can integrate an application processor (for example, CPU, or GPU) and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc., and the modem processor mainly processes Handle wireless communications. It can be understood that the foregoing modem processor may not be integrated into the processor.

Wherein, the processor 6011 is configured to perform the following steps:

When the electronic device is in the shooting mode, acquiring target body movements through the ultrasonic sensor;

determining the target special effect according to the target body movement;

Adding the target special effect to the current screen of the display screen of the electronic device.

The memory 6012 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function, etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory can include high-speed random access memory, and can also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage devices. In this embodiment of the application, the memory can be used to store emotion The corresponding relationship with the mapping relationship, and the mapping relationship between the signal strength and the distance in each set of mapping relationships.

The communication interface is used to communicate with external devices, including a SIM interface 6014 , an audio input interface 6015 , a serial interface 6016 and other communication interfaces 6017 .

The input and output module 6010 may include a display screen 6022, a speaker 6023, a microphone 6024, a sensor 6025, etc., wherein the display screen 6022 is used to detect the movement parameters of the user's finger moving a preset distance on the display screen, and obtain the result of pressing the user's finger. According to the pressing parameters of the display screen, the sensor 6025 may include a light sensor, a motion sensor, an ultrasonic sensor, an electroencephalogram sensor, a camera, and other sensors. Specifically, the light sensor can include an environment sensor and a proximity sensor, wherein the environment sensor can adjust the brightness of the touch display screen according to the brightness of the ambient light, and the proximity sensor can turn off the touch display screen and/or when the mobile phone is moved to the ear. or backlight. The motion sensor can be, for example, an accelerometer sensor. The accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary. It can be used to identify the posture of electronic devices (such as horizontal and vertical screens) Switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tap), etc.

The signal processing module 6013 is used to process the signal received by the electronic device from the external device and send the signal to the external device. The external device may be a base station, for example, where the receiver 6018 is used to receive the signal sent by the external device and transmit the signal to the signal The processor 6021, the transmitter 6019 is used to transmit the signal output by the signal processor 6021.

In the aforementioned embodiments shown in FIG. 1B , FIG. 2 or FIG. 3 , the method flow of each step can be implemented based on the structure of the electronic device.

In the aforementioned embodiments shown in FIG. 4 and FIG. 5 , the functions of each unit can be realized based on the structure of the mobile phone.

An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables the computer to execute any part of the shooting control method described in the above method embodiments or all steps.

The embodiment of the present application also provides a computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable the computer to execute the method described in the above method embodiments Some or all of the steps of any one capture control method.

It should be noted that for the foregoing method embodiments, for the sake of simple description, they are expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited by the described action sequence. Depending on the application, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions and modules involved are not necessarily required by this application.

In the foregoing embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or can be Integrate into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented not only in the form of hardware, but also in the form of software program modules.

The integrated units may be stored in a computer-readable memory if implemented in the form of a software program module and sold or used as an independent product. Based on this understanding, the technical solution of the present application is essentially or part of the contribution to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory. Several instructions are included to make a computer device (which may be a personal computer, server or network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned memory includes: various media capable of storing program codes such as USB flash drive, read-only memory (ROM), random access memory (RAM), removable hard disk, magnetic disk or optical disk.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable memory, and the memory can include: a flash disk , ROM, RAM, disk or CD, etc.

The embodiments of the present application have been introduced in detail above, and specific examples have been used in this paper to illustrate the principles and implementation methods of the present application. The descriptions of the above embodiments are only used to help understand the methods and core ideas of the present application; meanwhile, for Those skilled in the art will have changes in specific implementation methods and application scopes based on the ideas of the present application. In summary, the contents of this specification should not be construed as limiting the present application.

Claims (10)

1. a kind of filming control method, which is characterized in that be applied to electronic equipment, the electronic equipment includes supersonic sensing Device, the method includes：

When the electronic equipment is in screening-mode, target limb action is obtained by the ultrasonic sensor；

Target special efficacy is determined according to the target limb action；

The target special efficacy is added in the current picture of the display screen of the electronic equipment.

2. the method according to claim 1, wherein the mesh for obtaining user by the ultrasonic sensor Limb action is marked, including：

Emit ultrasonic signal by the ultrasonic transmitter of the ultrasonic sensor, and, pass through the supersonic sensing The ultrasonic receiver of device receives the echo-signal of the ultrasonic signal；

Each body part in multiple body parts of the user is identified according to the ultrasonic signal and the echo-signal Limbs transfer make, obtain multiple limbs transfers and make；

Make to form the target limb action according at least one limbs transfer in the multiple limbs transfer work.

3. the method according to claim 1, wherein the mesh for obtaining user by the ultrasonic sensor Limb action is marked, including：

Obtain the sound field change information of the ultrasonic sound field of the ultrasonic sensor generation within a preset period of time；

Limb motion track is determined according to the sound field change information, and generates trace image；

The trace image is matched with the multiple images template in pre-set image template library, obtains multiple matching values, institute State the corresponding limb action of each image template in multiple images template；

Determine the corresponding target limb action of the maximum image template of matching value in described multiple images template.

4. method according to any one of claims 1 to 3, which is characterized in that described true according to the target limb action Set the goal special efficacy, including：

Determine the composition information of at least one corresponding body part of the target limb action；

Determine that preset mapping relations concentrate target mapping relations corresponding with the composition information, the mapping relations are concentrated every Mapping relations of one group of mapping relations between limb action and special efficacy；

Target special efficacy corresponding with the target limb action is determined according to the target mapping relations.

5. according to the method described in claim 4, it is characterized in that, the target limb action corresponds to a target limbs portion Position, the composition information of at least one corresponding body part of the determination target limb action, including：

Determine target limbs type belonging to the corresponding target body part of the target limb action；

Judge whether the target limbs type is specified type, exists and the target body part pair in the specified type The symmetrical body part claimed；

If so, obtaining first position and the symmetrical body part of the target body part in the shooting picture The second position in the shooting picture；

It is determined between the target body part and the symmetrical body part according to the first position and the second position Relative positional relationship, and relationship determines the composition information of the target body part depending on that relative position.

6. method according to claim 1-5, which is characterized in that the method also includes：

Obtain the movement velocity of the user；

If the movement velocity is less than preset threshold, execution is described to be added in the current picture of the display screen of the electronic equipment The step of target special efficacy.

7. a kind of imaging control device, which is characterized in that be applied to electronic equipment, the electronic equipment includes supersonic sensing Device, the imaging control device include：

Acquiring unit, for obtaining target limb by the ultrasonic sensor when the electronic equipment is in screening-mode Body movement；

Determination unit, for determining target special efficacy according to the target limb action；

Control unit, for adding the target special efficacy in the current picture of the display screen of the electronic equipment.

8. imaging control device according to claim 7, which is characterized in that obtained described by the ultrasonic sensor In terms of the target limb action for taking family, the acquiring unit is specifically used for：

Emit ultrasonic signal by the ultrasonic transmitter of the ultrasonic sensor, and, pass through the supersonic sensing The ultrasonic receiver of device receives the echo-signal of the ultrasonic signal；

Each body part in multiple body parts of the user is identified according to the ultrasonic signal and the echo-signal Limbs transfer make, obtain multiple limbs transfers and make；

Make to form the target limb action according at least one limbs transfer in the multiple limbs transfer work.

9. a kind of electronic equipment, which is characterized in that including：Ultrasonic sensor, processor and memory；And it is one or more Program, one or more of programs are stored in the memory, and are configured to be executed by the processor, described Program includes the instruction for any one of such as claim 1-6 method.

10. a kind of computer readable storage medium, which is characterized in that it is used to store computer program, wherein the computer Program makes computer execute as the method according to claim 1 to 6.