CN110266947B - Photographing method and related device - Google Patents
Photographing method and related device Download PDFInfo
- Publication number
- CN110266947B CN110266947B CN201910563123.9A CN201910563123A CN110266947B CN 110266947 B CN110266947 B CN 110266947B CN 201910563123 A CN201910563123 A CN 201910563123A CN 110266947 B CN110266947 B CN 110266947B
- Authority
- CN
- China
- Prior art keywords
- face image
- preset
- tracking information
- determining
- feature information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/193—Preprocessing; Feature extraction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Ophthalmology & Optometry (AREA)
- User Interface Of Digital Computer (AREA)
- Studio Devices (AREA)
Abstract
本申请实施例公开了一种拍照方法及相关装置，应用于电子设备，包括：在所述电子设备的显示屏上显示拍照的预览画面，所述预览画面中包括至少一张人脸图像；判断所述至少一张人脸图像中是否存在拥有眼动控制权限的目标人脸图像；若是，则检测所述目标人脸图像对应的第一眼动跟踪信息；根据所述第一眼动跟踪信息控制所述电子设备执行拍照操作。实施本申请实施例有利于提升拍照的便捷性，提升拍照过程中用户的操作体验，提升电子设备的智能性。
The embodiment of the present application discloses a photographing method and a related device, which are applied to electronic equipment, including: displaying a preview image of photographing on a display screen of the electronic equipment, the preview image including at least one face image; judging Whether there is a target face image with eye movement control authority in the at least one face image; if so, detect the first eye movement tracking information corresponding to the target face image; according to the first eye movement tracking information The electronic device is controlled to perform a photographing operation. Implementing the embodiments of the present application is beneficial to improve the convenience of taking pictures, improve the user's operating experience in the process of taking pictures, and improve the intelligence of the electronic device.
Description
Technical Field
The present application relates to the field of electronic devices, and in particular, to a photographing method and related apparatus.
Background
With the progress of the image technology, photographing through a mobile terminal is becoming more and more popular, when a user uses the mobile terminal to photograph, the user needs to manually click a preset position of a screen or press a preset key of a mobile phone to complete photographing operation, so that the user must hold the mobile phone in the photographing process, the distance between the user and the mobile terminal is limited, or the user can set timing photographing in a self-photographing scene at present, but the timing photographing is not flexible, so that the conditions that the time in the photographing process is up, but a photographing object is not ready or the time of the photographing object is too long are caused, and the user experience is poor.
Disclosure of Invention
The embodiment of the application provides a photographing method and a related device, which are beneficial to improving the convenience of photographing, improving the control experience of a user in the photographing process and improving the intelligence of electronic equipment.
In a first aspect, an embodiment of the present application provides a photographing method applied to an electronic device, where the method includes:
displaying a photographed preview picture on a display screen of the electronic equipment, wherein the preview picture comprises at least one face image;
judging whether a target face image with eye movement control authority exists in the at least one face image;
if yes, detecting first eye tracking information corresponding to the target face image;
and controlling the electronic equipment to execute photographing operation according to the first eye tracking information.
In a second aspect, an embodiment of the present application provides a photographing apparatus applied to an electronic device, the photographing apparatus including a processing unit, wherein,
the processing unit is used for displaying a photographed preview picture on a display screen of the electronic equipment, and the preview picture comprises at least one face image; the system comprises at least one face image, a target face image and a control unit, wherein the face image is used for judging whether a target face image with an eye movement control authority exists in the at least one face image; if so, detecting first eye tracking information corresponding to the target face image; and the electronic equipment is controlled to execute the photographing operation according to the first eye tracking information.
In a third aspect, an embodiment of the present application provides an electronic device, including a controller, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the controller, and the program includes instructions for executing steps in any method of the first aspect of the embodiment of the present application.
In a fourth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program makes a computer perform part or all of the steps described in any one of the methods of the first aspect of the present application.
In a fifth aspect, the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform some or all of the steps as described in any one of the methods of the first aspect of the embodiments of the present application. The computer program product may be a software installation package.
It can be seen that, in the embodiment of the application, the electronic device firstly displays a photographed preview picture on a display screen of the electronic device, wherein the preview picture includes at least one face image; secondly, judging whether a target face image with eye movement control authority exists in the at least one face image; if yes, detecting first eye tracking information corresponding to the target face image; and finally, controlling the electronic equipment to execute photographing operation according to the first eye tracking information. Therefore, in the embodiment of the application, the electronic equipment can execute the photographing operation according to the eye movement tracking information corresponding to the target face image with the control authority in the photographing interface, so that a plurality of persons do not need to manually press the preset key or the preset area to photograph, and do not need to photograph regularly, the convenience of the photographing process of the plurality of persons is improved, the photographing flexibility is improved, and the user experience in the photographing process and the intelligence of the electronic equipment are improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;
fig. 2A is a schematic flowchart of a photographing method according to an embodiment of the present application;
FIG. 2B is a schematic diagram of a possible method for determining a first facial image from a plurality of facial images according to an embodiment of the present disclosure;
fig. 3 is a schematic flowchart of another photographing method provided in the embodiment of the present application;
fig. 4 is a schematic flowchart of another photographing method provided in the embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
fig. 6 is a block diagram illustrating functional units of a photographing apparatus according to an embodiment of the present disclosure.
Detailed Description
In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
Electronic devices may include various handheld devices, vehicle-mounted devices, wearable devices (e.g., smartwatches, smartbands, pedometers, etc.), computing devices or other processing devices connected to wireless modems, as well as various forms of User Equipment (UE), Mobile Stations (MS), terminal Equipment (terminal device), and so forth, having wireless communication capabilities. For convenience of description, the above-mentioned devices are collectively referred to as electronic devices.
The following describes embodiments of the present application in detail.
Referring to fig. 1, fig. 1 is a schematic structural diagram of an electronic device 100 according to an embodiment of the present disclosure, as shown in the figure, a front surface of the electronic device 100 includes an eyeball tracking apparatus 101, and a back surface of the electronic device 100 includes a rear camera module 102 and an infrared device 103; the rear camera module 102 includes at least one camera, and each camera in the at least one camera may be a zoom camera or a fixed-focus camera; the eye tracking apparatus 101 may include an infrared device (e.g., an infrared lamp) and an image capture device (e.g., a camera); when the user takes a picture, the electronic device starts the eyeball tracking device 101; the image acquisition equipment can acquire a picture to be photographed, the electronic equipment can acquire face information of the picture to be photographed and eye movement information corresponding to the face information according to a preset algorithm, a face recognition function is realized according to the face information, eye movement tracking information is generated according to the eye movement information, and photographing operation is executed according to authorized face information and the eye movement tracking information corresponding to the face information. The rear camera module 103 can realize a photographing function, during the photographing process of a user, the electronic equipment obtains a photographing preview picture in real time through the rear camera module 103, and the electronic equipment realizes a face recognition function aiming at the photographing preview picture according to a preset algorithm; meanwhile, the rear camera module 103 can be matched with the infrared equipment 103 to realize an eyeball tracking function, so that the user can realize the function of controlling photographing by eyes in the process of photographing by using the rear camera.
The eyeball tracking device comprises infrared equipment (such as an infrared lamp) and image acquisition equipment (such as a camera), so that characteristic information related to the change can be acquired, such as extraction of the change characteristics through image capture or scanning, the state and the demand of a user can be predicted through real-time tracking of the change of the eyes, response is carried out, and the purpose of controlling the equipment through the eyes is achieved.
Referring to fig. 2A, fig. 2A is a schematic flowchart of a photographing method applied to an electronic device including an eyeball tracking device according to an embodiment of the present application. As shown in the figure, the photographing method comprises the following steps:
The preview picture is a picture obtained by a camera of the electronic equipment in real time in the current photographing process.
The electronic equipment can identify the face image in the preview picture according to a preset algorithm to obtain at least one face image.
The electronic equipment obtains face feature information corresponding to at least one face image according to a preset face recognition algorithm, compares the face feature information corresponding to the at least one face image with preset face feature information, and if it is determined that first face feature information matched with the preset face feature information exists in the face feature information corresponding to the at least one face image, the face image corresponding to the first face feature information is a target face image with eye movement control authority.
The electronic equipment firstly determines eye images of a target face image, secondly generates eyeball state information according to a preset image processing algorithm, determines the gaze position of a current user according to the eyeball state information, determines the gaze position corresponding to each frame of image in a plurality of frames of images within a preset time period, and generates the first eye tracking information according to the gaze position corresponding to each frame of image within the preset time period, wherein the gaze position is a position on a display screen of the electronic equipment, or when the user starts a rear camera, the gaze position can be a position on a back body of the electronic equipment.
And step 204, the electronic equipment controls the electronic equipment to execute a photographing operation according to the first eye tracking information.
The mode of the electronic device executing the photographing operation according to the first eye tracking information may be: the first eye tracking information is detected to include a preset track, wherein the preset track can be set by a user, such as a square, a triangle, a figure eight, and the like. Or, the electronic device may execute the photographing operation when detecting that the time that the first eye tracking information stays in the preset position or the preset area is greater than or equal to a preset time length, for example, the preset position is a photographing icon, the preset time length is 1 second, and the electronic device detects that the time that the first eye tracking information stays in the photographing icon is equal to 1 second.
It can be seen that, in the embodiment of the application, the electronic device firstly displays a photographed preview picture on a display screen of the electronic device, wherein the preview picture includes at least one face image; secondly, judging whether a target face image with eye movement control authority exists in the at least one face image; if yes, detecting first eye tracking information corresponding to the target face image; and finally, controlling the electronic equipment to execute photographing operation according to the first eye tracking information. Therefore, in the embodiment of the application, the electronic equipment can execute the photographing operation according to the eye movement tracking information corresponding to the target face image with the control authority in the photographing interface, so that a plurality of persons do not need to manually press the preset key or the preset area to photograph, and do not need to photograph regularly, the convenience of the photographing process of the plurality of persons is improved, the photographing flexibility is improved, and the user experience in the photographing process and the intelligence of the electronic equipment are improved.
In one possible example, the determining whether the target face image having the eye movement control authority exists in the at least one face image includes: acquiring feature information corresponding to each face image in the at least one face image according to a preset feature recognition algorithm; executing a preset matching step aiming at the characteristic information corresponding to each human face image, if the characteristic information corresponding to each human face image has first characteristic information which is successfully matched; determining that the target face image exists in the at least one face image, and the face image corresponding to the first feature information is the target face image.
The feature information may be information (which may include information of size, color, etc.) of eyes, eyebrows, nose, mouth, ears, etc. in each face image.
Therefore, in this example, the electronic device may determine feature information of each face image, and perform matching operation according to the feature information to detect whether a target face image exists in a plurality of face images, so that the intelligence of the electronic device is improved.
In one possible example, the performing a preset matching step on the feature information corresponding to each face image includes: generating an arrangement sequence of the feature information according to a preset arrangement strategy; determining the feature information of a first sequence in the arrangement sequence as currently processed feature information and setting a detection state of the currently processed feature information as an undetected state, wherein the detection state comprises a detected state and an undetected state; detecting the detection state of the currently processed characteristic information, and if the detection state is an undetected state, inquiring a preset database by taking the currently processed characteristic information as an inquiry identifier; if data matched with the currently processed feature information is detected, determining that the currently processed feature information is the first feature information, and updating the detection state to be the detected state; and if the data matched with the currently processed characteristic information is not detected, updating the currently processed characteristic information into the characteristic information of the next order.
The preset arrangement strategy may be determined according to the position of the facial image on the display screen, for example, the arrangement order of the feature information corresponding to the facial image is determined according to the left-to-right or top-to-bottom order of the facial image.
If data matched with the currently processed feature information is detected, the currently processed feature information is determined to be the first feature information, and after the detection state is updated to be the detected state, the electronic device can jump out of the matching step.
And the electronic equipment updates the currently processed feature information to be the feature information of the last sequence, and if no data matched with the feature information of the last sequence is detected, the electronic equipment determines that the target face image with the eye movement control authority does not exist in the at least one face image.
Therefore, in this example, the electronic device may sequentially detect whether the feature information corresponding to the face image matches with the feature information in the preset database, and then determine that there is no target face image with eye movement control authority in at least one face image, so that the intelligence of the electronic device is improved.
Optionally, if N pieces of preset face image corresponding to N pieces of preset feature information exist in the preset database, the electronic device performs a preset matching step on the feature information of the at least one face image, and when it is detected that first feature information matched with the feature information in the preset database exists in the feature information of the at least one face image, continues to perform a matching operation until N pieces of feature information matched with the N pieces of preset feature information are determined from the feature information of the at least one face image or until all feature information of the at least one face image is detected. If the N preset face images exist in the at least one current face image, inquiring the corresponding priorities of the N preset face images; if at least two face images exist under the same priority, determining the priorities of the at least two face images according to the position relation of the at least two face images, further determining the final priorities of the N preset face images (the priorities of any two face images are different), detecting first eye tracking information corresponding to the face image with the first priority in the final priorities, and performing photographing operation according to the first eye tracking information; if the first eye tracking information is detected not to be within a preset range (for example, the preset range can be a body of the electronic device) for a long time (for example, the preset time exceeds a preset time, which can be set by a user, for example, 10 seconds), the electronic device determines second eye tracking information corresponding to a face image with a second priority, and performs a photographing operation according to the second eye tracking information; similarly, if the second eye tracking information is detected not to be in the preset range for a long time, determining third eye tracking information corresponding to the face image with the third priority, executing the photographing operation according to the third eye tracking information, and so on until the photographing operation is completed. The step of determining the priorities of the at least two face images according to the position relationship of the at least two face images comprises the following steps: determining a preset position point of the preview picture and a central position point of each face image in the at least two face images; calculating the distance between the preset position point and the central position point of each human face image to obtain a distance value corresponding to each human face image in the at least two human face images; and determining the priority of the at least two face images according to the distance value corresponding to each face image in the at least two face images.
In one possible example, the controlling the electronic device to perform a photographing operation according to the first eye tracking information includes: detecting that the electronic equipment meets a first preset condition, and executing photographing operation; the first preset condition is as follows: the first eye tracking information comprises a preset track, or the staying time of the first eye tracking information at a preset position is larger than a preset threshold value, and the preset position is a position area or a position point in the preview picture.
The preset track can be a square, a cross, a figure eight or the like.
Therefore, in the example, the electronic device can perform the photographing operation according to the eye movement tracking information without manual operation, so that the photographing convenience is improved, and the intelligence of the electronic device is improved.
In one possible example, after the detecting that the electronic device satisfies the first preset condition and before the performing the photographing operation, the method further includes: acquiring eye tracking information corresponding to the face images except the target face image in the at least one face image to obtain a first number of eye tracking information; determining a first number of fixation position points corresponding to the first number of eye movement tracking information; and detecting that the first number of position points are all in a preset range.
The preset range may be a range in which a center point of the electronic device is a circle center and the preset length is a radius.
Therefore, in the example, when the electronic equipment detects that the camera is watched by multiple persons or the watching positions are all in a certain range, the photographing operation is executed, the satisfaction degree of the user on the photos is improved, the user experience is further improved, and the intelligence of the electronic equipment is also improved.
In one possible example, after determining whether the target facial image having the eye movement control authority exists in the at least one facial image, the method further includes: if not, determining a first face image in the at least one face image according to a preset strategy; acquiring second eye movement tracking information of the first face image; and executing photographing operation according to the second eye movement tracking information.
Therefore, in the example, the electronic device can automatically determine the first face image under the condition that the face images without the control authority in the plurality of face images are determined, and then the photographing operation is executed according to the eye movement tracking information of the first face image, so that the requirement of the photographing scene is met, and the intelligence of the electronic device is improved.
In one possible example, the determining a first facial image of the at least one facial image according to a preset policy includes: determining a preset position point of the preview picture and a central position point of each face image in the at least one face image; calculating the distance between a preset position point of the preview picture and the center position point of each face image to obtain a second number of distance values; determining a minimum distance value of the second number of distance values; and determining the face image corresponding to the minimum distance value as the first face image.
For example, referring to fig. 2B, fig. 2B is a schematic diagram illustrating a possible method for determining a first facial image from a plurality of facial images according to an embodiment of the present disclosure; as shown, the preview screen of the electronic device 100 includes three face images. A1 is a preset position point in the preview screen of the electronic device 100 (which may be a center point of the display screen of the electronic device 100), the electronic device 100 may determine a center position point of each face image, calculate distances d1, d2, and d3 from the center position points of the three images, compare the values of d1, d2, and d3, determine that d2 is the minimum value, and determine that the middle face image corresponding to d2 in the three face images is the first face image.
Therefore, in the example, the electronic device can determine the face image closest to the preset position point in the display screen, and perform the photographing operation according to the eye movement tracking information of the face image, so that the control method for photographing for multiple persons is provided, the requirement of a photographing scene is met, the user experience is improved, and the intelligence of the electronic device is improved.
Referring to fig. 3, fig. 3 is a schematic flowchart of a photographing method according to an embodiment of the present application, and the photographing method is applied to an electronic device including an eye tracking apparatus. As shown in the figure, the photographing method comprises the following steps:
And 309, controlling the electronic equipment to execute a photographing operation by the electronic equipment according to the first eye tracking information.
It can be seen that, in the embodiment of the application, the electronic device firstly displays a photographed preview picture on a display screen of the electronic device, wherein the preview picture includes at least one face image; secondly, judging whether a target face image with eye movement control authority exists in the at least one face image; if yes, detecting first eye tracking information corresponding to the target face image; and finally, controlling the electronic equipment to execute photographing operation according to the first eye tracking information. Therefore, in the embodiment of the application, the electronic equipment can execute the photographing operation according to the eye movement tracking information corresponding to the target face image with the control authority in the photographing interface, the convenience of the photographing process of multiple persons is improved, the preset key or the preset area is not required to be manually pressed to photograph, the photographing is not required to be performed regularly, the photographing flexibility is improved, and the user experience of the photographing process and the intelligence of the electronic equipment are improved.
In addition, the electronic equipment can determine the feature information of each face image and execute matching operation according to the feature information so as to detect whether a target face image exists in a plurality of face images, and the intelligence of the electronic equipment is improved.
In addition, the electronic equipment can detect whether the characteristic information corresponding to the face images is matched with the characteristic information in the preset database in sequence, and then the target face images with eye movement control authority do not exist in at least one face image, so that the intelligence of the electronic equipment is improved.
Referring to fig. 4, fig. 4 is a schematic flowchart of a photographing method according to an embodiment of the present disclosure, and the photographing method is applied to an electronic device including an eye tracking device. As shown in the figure, the photographing method comprises the following steps:
In step 404, the electronic device calculates a distance between a preset position point of the preview screen and a center position point of each face image to obtain a second number of distance values.
In step 405, the electronic device determines a minimum distance value of the second number of distance values.
In step 406, the electronic device determines that the face image corresponding to the minimum distance value is a first face image.
And step 408, the electronic device executes a photographing operation according to the second eye tracking information.
It can be seen that, in the embodiment of the application, the electronic device firstly displays a photographed preview picture on a display screen of the electronic device, wherein the preview picture includes at least one face image; secondly, judging whether a target face image with eye movement control authority exists in the at least one face image; if yes, detecting first eye tracking information corresponding to the target face image; and finally, controlling the electronic equipment to execute photographing operation according to the first eye tracking information. Therefore, in the embodiment of the application, the electronic equipment can execute the photographing operation according to the eye movement tracking information corresponding to the target face image with the control authority in the photographing interface, the convenience of the photographing process of multiple persons is improved, the preset key or the preset area is not required to be manually pressed to photograph, the photographing is not required to be performed regularly, the photographing flexibility is improved, and the user experience of the photographing process and the intelligence of the electronic equipment are improved.
In addition, under the condition that electronic equipment determines the face image that does not have the control authority, can automatic determination first face image, and then carry out the operation of shooing according to the eye movement tracking information of first face image, satisfied the demand of the scene of shooing, promoted electronic equipment's intellectuality.
In addition, the electronic equipment can determine the face image closest to the preset position point in the display screen, and the photographing operation is executed according to the eye movement tracking information of the face image, so that the control method for photographing for multiple persons is provided, the user experience is improved, and the intelligence of the electronic equipment is improved.
Consistent with the embodiments shown in fig. 2A, fig. 3, and fig. 4, please refer to fig. 5, and fig. 5 is a schematic structural diagram of an electronic device 500 according to an embodiment of the present application, as shown in the figure, the electronic device 500 includes an application processor 510, a memory 520, a communication interface 530, and one or more programs 521, where the one or more programs 521 are stored in the memory 520 and configured to be executed by the application processor 510, and the one or more programs 521 include instructions for performing the following steps; displaying the photographed preview image on a display interface of the electronic equipment;
displaying a photographed preview picture on a display screen of the electronic equipment, wherein the preview picture comprises at least one face image;
judging whether a target face image with eye movement control authority exists in the at least one face image;
if yes, detecting first eye tracking information corresponding to the target face image;
and controlling the electronic equipment to execute photographing operation according to the first eye tracking information.
It can be seen that, in the embodiment of the application, the electronic device firstly displays a photographed preview picture on a display screen of the electronic device, wherein the preview picture includes at least one face image; secondly, judging whether a target face image with eye movement control authority exists in the at least one face image; if yes, detecting first eye tracking information corresponding to the target face image; and finally, controlling the electronic equipment to execute photographing operation according to the first eye tracking information. Therefore, in the embodiment of the application, the electronic equipment can execute the photographing operation according to the eye movement tracking information corresponding to the target face image with the control authority in the photographing interface, the convenience of the photographing process of multiple persons is improved, the preset key or the preset area is not required to be manually pressed to photograph, the photographing is not required to be performed regularly, the photographing flexibility is improved, and the user experience of the photographing process and the intelligence of the electronic equipment are improved.
In one possible example, in the aspect of determining whether the target face image having the eye movement control authority exists in the at least one face image, the instructions in the program are specifically configured to perform the following operations: acquiring feature information corresponding to each face image in the at least one face image according to a preset feature recognition algorithm; executing a preset matching step aiming at the characteristic information corresponding to each human face image, if the characteristic information corresponding to each human face image has first characteristic information which is successfully matched; determining that the target face image exists in the at least one face image, and the face image corresponding to the first feature information is the target face image.
In one possible example, in terms of performing a preset matching step on the feature information corresponding to each facial image, the instructions in the program are specifically configured to perform the following operations: generating an arrangement sequence of the feature information according to a preset arrangement strategy; determining the feature information of a first sequence in the arrangement sequence as currently processed feature information and setting a detection state of the currently processed feature information as an undetected state, wherein the detection state comprises a detected state and an undetected state; detecting the detection state of the currently processed characteristic information, and if the detection state is an undetected state, inquiring a preset database by taking the currently processed characteristic information as an inquiry identifier; if data matched with the currently processed feature information is detected, determining that the currently processed feature information is the first feature information, and updating the detection state to be the detected state; and if the data matched with the currently processed characteristic information is not detected, updating the currently processed characteristic information into the characteristic information of the next order.
In one possible example, in terms of the controlling the electronic device to perform the photographing operation according to the first eye tracking information, the instructions in the program are specifically configured to perform the following operations: detecting that the electronic equipment meets a first preset condition, and executing photographing operation; the first preset condition is as follows: the first eye tracking information comprises a preset track, or the staying time of the first eye tracking information at a preset position is larger than a preset threshold value, and the preset position is a position area or a position point in the preview picture.
In one possible example, after the detecting that the electronic device satisfies the first preset condition and before the performing the photographing operation, the instructions in the program are further configured to: acquiring eye tracking information corresponding to the face images except the target face image in the at least one face image to obtain a first number of eye tracking information; determining a first number of fixation position points corresponding to the first number of eye movement tracking information; and detecting that the first number of position points are all in a preset range.
In one possible example, after the determining whether the target face image having the eye movement control authority exists in the at least one face image, the instructions in the program are further configured to: if not, determining a first face image in the at least one face image according to a preset strategy; acquiring second eye movement tracking information of the first face image; and executing photographing operation according to the second eye movement tracking information.
In one possible example, in the aspect of determining the first facial image of the at least one facial image according to the preset policy, the instructions in the program are specifically configured to: determining a preset position point of the preview picture and a central position point of each face image in the at least one face image; calculating the distance between a preset position point of the preview picture and the center position point of each face image to obtain a second number of distance values; determining a minimum distance value of the second number of distance values; and determining the face image corresponding to the minimum distance value as the first face image.
The above description has introduced the solution of the embodiment of the present application mainly from the perspective of the method-side implementation process. It is understood that the electronic device comprises corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above-mentioned functions. Those of skill in the art would readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiment of the present application, the electronic device may be divided into the functional units according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one control unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.
Fig. 6 is a block diagram of functional units of a photographing apparatus 600 according to an embodiment of the present application. This photographing apparatus 600 is applied to an electronic device, and the photographing apparatus 600 includes a processing unit 601, wherein:
the processing unit 601 is configured to display a photographed preview image on a display screen of the electronic device, where the preview image includes at least one face image; the system comprises at least one face image, a target face image and a control unit, wherein the face image is used for judging whether a target face image with an eye movement control authority exists in the at least one face image; if so, detecting first eye tracking information corresponding to the target face image; and the electronic equipment is controlled to execute the photographing operation according to the first eye tracking information.
The photographing apparatus 600 may further include a communication unit 602 and a storage unit 603, where the storage unit 603 is used for storing program codes and data of the electronic device. The processing unit 601 may be a processor, the communication unit 602 may be a touch display screen, an eye tracking device or a transceiver, and the storage unit 603 may be a memory.
It can be seen that, in the embodiment of the application, the electronic device firstly displays a photographed preview picture on a display screen of the electronic device, wherein the preview picture includes at least one face image; secondly, judging whether a target face image with eye movement control authority exists in the at least one face image; if yes, detecting first eye tracking information corresponding to the target face image; and finally, controlling the electronic equipment to execute photographing operation according to the first eye tracking information. Therefore, in the embodiment of the application, the electronic equipment can execute the photographing operation according to the eye movement tracking information corresponding to the target face image with the control authority in the photographing interface, the convenience of the photographing process of multiple persons is improved, the preset key or the preset area is not required to be manually pressed to photograph, the photographing is not required to be performed regularly, the photographing flexibility is improved, and the user experience of the photographing process and the intelligence of the electronic equipment are improved.
In one possible example, in the aspect of determining whether there is a target face image with an eye movement control authority in the at least one face image, the processing unit 601 is specifically configured to: acquiring feature information corresponding to each face image in the at least one face image according to a preset feature recognition algorithm; executing a preset matching step aiming at the characteristic information corresponding to each human face image, if the characteristic information corresponding to each human face image has first characteristic information which is successfully matched; determining that the target face image exists in the at least one face image, and the face image corresponding to the first feature information is the target face image.
In a possible example, in terms of performing a preset matching step on the feature information corresponding to each face image, the processing unit 601 is specifically configured to: generating an arrangement sequence of the feature information according to a preset arrangement strategy; determining the feature information of a first sequence in the arrangement sequence as currently processed feature information and setting a detection state of the currently processed feature information as an undetected state, wherein the detection state comprises a detected state and an undetected state; detecting the detection state of the currently processed characteristic information, and if the detection state is an undetected state, inquiring a preset database by taking the currently processed characteristic information as an inquiry identifier; if data matched with the currently processed feature information is detected, determining that the currently processed feature information is the first feature information, and updating the detection state to be the detected state; and if the data matched with the currently processed characteristic information is not detected, updating the currently processed characteristic information into the characteristic information of the next order.
In a possible example, in terms of controlling the electronic device to perform the photographing operation according to the first eye tracking information, the processing unit 601 is specifically configured to: detecting that the electronic equipment meets a first preset condition, and executing photographing operation; the first preset condition is as follows: the first eye tracking information comprises a preset track, or the staying time of the first eye tracking information at a preset position is larger than a preset threshold value, and the preset position is a position area or a position point in the preview picture.
In a possible example, after the detecting that the electronic device satisfies the first preset condition, in a preceding aspect of the performing the photographing operation, the processing unit 601 is further configured to: acquiring eye tracking information corresponding to the face images except the target face image in the at least one face image to obtain a first number of eye tracking information; determining a first number of fixation position points corresponding to the first number of eye movement tracking information; and detecting that the first number of position points are all in a preset range.
In a possible example, after the determining whether the target face image having the eye movement control authority exists in the at least one face image, the processing unit 601 is further configured to: if not, determining a first face image in the at least one face image according to a preset strategy; acquiring second eye movement tracking information of the first face image; and executing photographing operation according to the second eye movement tracking information.
In one possible example, in terms of determining a first facial image of the at least one facial image according to a preset policy, the processing unit 601 is specifically configured to: determining a preset position point of the preview picture and a central position point of each face image in the at least one face image; calculating the distance between a preset position point of the preview picture and the center position point of each face image to obtain a second number of distance values; determining a minimum distance value of the second number of distance values; and determining the face image corresponding to the minimum distance value as the first face image.
Embodiments of the present application also provide a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any one of the methods described in the above method embodiments, and the computer includes a mobile terminal.
Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods as described in the above method embodiments. The computer program product may be a software installation package, the computer comprising a mobile terminal.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the above-described division of the units is only one type of division of logical functions, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, each functional unit in the embodiments of the present application may be integrated into one control unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit may be stored in a computer readable memory if it is implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the above-mentioned method of the embodiments of the present application. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (8)
1. A photographing method is applied to an electronic device, and the method comprises the following steps:
displaying a photographed preview picture on a display screen of the electronic equipment, wherein the preview picture comprises at least one face image;
judging whether a target face image with eye movement control authority exists in the at least one face image;
if yes, detecting first eye tracking information corresponding to the target face image;
after the electronic equipment is determined to meet a first preset condition according to the first eye tracking information, acquiring eye tracking information corresponding to face images except the target face image in the at least one face image to obtain a first number of eye tracking information; determining a first number of fixation position points corresponding to the first number of eye movement tracking information; when the first number of position points are detected to be within a preset range, controlling the electronic equipment to execute photographing operation;
if not, determining a first face image in the at least one face image according to a preset strategy;
acquiring second eye movement tracking information of the first face image;
and executing photographing operation according to the second eye movement tracking information.
2. The method according to claim 1, wherein the determining whether the target face image having the eye movement control authority exists in the at least one face image comprises:
acquiring feature information corresponding to each face image in the at least one face image according to a preset feature recognition algorithm;
executing a preset matching step aiming at the characteristic information corresponding to each face image;
and if first feature information which is successfully matched exists in the feature information corresponding to each face image, determining that the target face image exists in the at least one face image, and determining that the face image corresponding to the first feature information is the target face image.
3. The method according to claim 2, wherein the step of performing preset matching on the feature information corresponding to each face image comprises:
generating an arrangement sequence of the feature information according to a preset arrangement strategy;
determining the feature information of a first sequence in the arrangement sequence as currently processed feature information and setting a detection state of the currently processed feature information as an undetected state, wherein the detection state comprises a detected state and an undetected state;
detecting the detection state of the currently processed characteristic information, and if the detection state is an undetected state, inquiring a preset database by taking the currently processed characteristic information as an inquiry identifier;
if data matched with the currently processed feature information is detected, determining that the currently processed feature information is the first feature information, and updating the detection state to be the detected state;
and if the data matched with the currently processed characteristic information is not detected, updating the currently processed characteristic information into the characteristic information of the next order.
4. A method according to any one of claims 1 to 3, characterized in that said first preset condition is: the first eye tracking information comprises a preset track, or the staying time of the first eye tracking information at a preset position is larger than a preset threshold value, and the preset position is a position area or a position point in the preview picture.
5. The method according to claim 1, wherein the determining a first facial image of the at least one facial image according to a preset strategy comprises:
determining a preset position point of the preview picture and a central position point of each face image in the at least one face image;
calculating the distance between a preset position point of the preview picture and the center position point of each face image to obtain a second number of distance values;
determining a minimum distance value of the second number of distance values;
and determining the face image corresponding to the minimum distance value as the first face image.
6. A photographing apparatus, applied to an electronic device, includes a processing unit, wherein,
the processing unit is used for displaying a photographed preview picture on a display screen of the electronic equipment, and the preview picture comprises at least one face image; the system comprises at least one face image, a target face image and a control unit, wherein the face image is used for judging whether a target face image with an eye movement control authority exists in the at least one face image; if so, detecting first eye tracking information corresponding to the target face image; the electronic equipment is used for acquiring eye tracking information corresponding to face images except the target face image in the at least one face image after determining that the electronic equipment meets a first preset condition according to the first eye tracking information, so as to obtain a first number of eye tracking information; determining a first number of fixation position points corresponding to the first number of eye movement tracking information; when the first number of position points are detected to be within a preset range, controlling the electronic equipment to execute photographing operation; and if not, determining a first face image in the at least one face image according to a preset strategy; acquiring second eye movement tracking information of the first face image; and executing photographing operation according to the second eye movement tracking information.
7. An electronic device comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 1-5.
8. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910563123.9A CN110266947B (en) | 2019-06-26 | 2019-06-26 | Photographing method and related device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910563123.9A CN110266947B (en) | 2019-06-26 | 2019-06-26 | Photographing method and related device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110266947A CN110266947A (en) | 2019-09-20 |
| CN110266947B true CN110266947B (en) | 2021-05-04 |
Family
ID=67921993
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910563123.9A Expired - Fee Related CN110266947B (en) | 2019-06-26 | 2019-06-26 | Photographing method and related device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110266947B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111596760A (en) * | 2020-04-30 | 2020-08-28 | 维沃移动通信有限公司 | Operation control method and device, electronic equipment and readable storage medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103795926A (en) * | 2014-02-11 | 2014-05-14 | 惠州Tcl移动通信有限公司 | Method, system and photographing device for controlling photographing focusing by means of eyeball tracking technology |
| US20170126966A1 (en) * | 2015-10-29 | 2017-05-04 | Mediatek Inc. | Photography method using gaze detection |
| CN107172347B (en) * | 2017-05-12 | 2020-04-14 | 维沃移动通信有限公司 | A kind of photographing method and terminal |
| CN107992816B (en) * | 2017-11-28 | 2020-09-04 | 广东小天才科技有限公司 | A photo search method, device, electronic device and computer-readable storage medium |
| CN109146913B (en) * | 2018-08-02 | 2021-05-18 | 浪潮金融信息技术有限公司 | Face tracking method and device |
-
2019
- 2019-06-26 CN CN201910563123.9A patent/CN110266947B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN110266947A (en) | 2019-09-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10565763B2 (en) | Method and camera device for processing image | |
| CN107767333B (en) | Method and equipment for beautifying and photographing and computer storage medium | |
| CN108200337B (en) | Method, device, terminal and storage medium for photographing processing | |
| CN108024065B (en) | Terminal shooting method, terminal and computer readable storage medium | |
| US20170223261A1 (en) | Image pickup device and method of tracking subject thereof | |
| CN105554389B (en) | Shooting method and device | |
| CN110177210B (en) | Photographing method and related device | |
| CN110072061B (en) | Interactive shooting method, mobile terminal and storage medium | |
| JP2016531362A (en) | Skin color adjustment method, skin color adjustment device, program, and recording medium | |
| CN107622246B (en) | Face recognition method and related products | |
| CN108304708A (en) | Mobile terminal, face unlocking method and related product | |
| CN110248091B (en) | Focal length adjusting method and related product | |
| JP6942825B2 (en) | Methods and devices for enhancing facial images, electronic devices | |
| CN108549853B (en) | Image processing method, mobile terminal and computer readable storage medium | |
| CN105007413A (en) | Shooting control method and user terminal | |
| CN113076007A (en) | Display screen visual angle adjusting method and device and storage medium | |
| CN112333385B (en) | Electronic anti-shake control method and device | |
| CN112188091A (en) | Face information identification method and device, electronic equipment and storage medium | |
| CN110266947B (en) | Photographing method and related device | |
| CN112785490B (en) | Image processing methods, devices and electronic equipment | |
| CN116320711A (en) | Image shooting method and device | |
| CN111610886A (en) | Method and device for adjusting brightness of touch screen and computer readable storage medium | |
| CN105025209B (en) | A kind of image preview method and apparatus | |
| CN112333511A (en) | Control method, device and equipment of smart television and computer readable storage medium | |
| CN107992816A (en) | Photographing search method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20210504 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |