CN108696641A

CN108696641A - Call reminding method, device, storage medium and mobile terminal

Info

Publication number: CN108696641A
Application number: CN201810463540.1A
Authority: CN
Inventors: 龙俊卫
Original assignee: Oppo Chongqing Intelligent Technology Co Ltd
Current assignee: Oppo Chongqing Intelligent Technology Co Ltd
Priority date: 2018-05-15
Filing date: 2018-05-15
Publication date: 2018-10-23
Anticipated expiration: 2038-05-15
Also published as: CN108696641B

Abstract

The embodiment of the present application discloses call reminding method, device, storage medium and mobile terminal.This method includes:When detecting that default call event is triggered or will be triggered, ambient image is acquired by the camera of mobile terminal;Wherein, the default call event includes exhalation event and/or incoming call event;Identification is carried out to the facial image occurred in ambient image;When identification result meets preset condition, partner is prompted accordingly according to the identification result.The embodiment of the present application is by using above-mentioned technical proposal, recognition of face can be carried out to the user for local terminal of conversing, and prompts face recognition result to call opposite end, and call opposite end is allowed to know the identity situation of local terminal caller, facilitate communication, the perfect voice call function of mobile terminal.

Description

Call prompting method, device, storage medium and mobile terminal

Technical Field

The embodiment of the application relates to the technical field of mobile communication, in particular to a call prompting method, a call prompting device, a storage medium and a mobile terminal.

Background

At present, with the rapid popularization of mobile terminals, mobile terminals such as mobile phones and tablet computers have become one of the necessary communication tools for people. Communication modes between mobile terminal users are becoming more and more abundant, such as traditional telephone and short message services provided by mobile communication operators, and voice chat and video chat functions in various social software.

For a voice-based call method such as telephone or voice chat, the other party of the call is invisible to the current user, which brings certain obstacles to the call, and needs to be improved.

Disclosure of Invention

The embodiment of the application provides a call prompting method, a call prompting device, a storage medium and a mobile terminal, which can optimize a voice call scheme.

In a first aspect, an embodiment of the present application provides a call prompting method, including:

when a preset call event is detected to be triggered or is about to be triggered, acquiring an environment image through a camera of the mobile terminal; the preset call event comprises a calling event and/or a calling event;

carrying out identity recognition on a face image appearing in the environment image;

and when the identity recognition result meets the preset condition, carrying out corresponding prompt on the other party of the call according to the identity recognition result.

In a second aspect, an embodiment of the present application provides a call prompting device, including:

the mobile terminal comprises an image acquisition module, a communication module and a communication module, wherein the image acquisition module is used for acquiring an environment image through a camera of the mobile terminal when a preset communication event is detected to be triggered or is about to be triggered; the preset call event comprises a calling event and/or a calling event;

the identity recognition module is used for carrying out identity recognition on the face image appearing in the environment image;

and the prompting module is used for correspondingly prompting the other party of the call according to the identity recognition result when the identity recognition result meets the preset condition.

In a third aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a call prompting method according to an embodiment of the present application.

In a fourth aspect, an embodiment of the present application provides a mobile terminal, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor executes the computer program to implement the call prompting method according to the embodiment of the present application.

According to the call prompting scheme provided by the embodiment of the application, when a preset call event is detected to be triggered or to be triggered, an environment image is collected through a camera of the mobile terminal, identity recognition is carried out on a face image appearing in the environment image, and when an identity recognition result meets a preset condition, corresponding prompt is carried out on a call opposite side according to the identity recognition result. Through adopting above-mentioned technical scheme, can carry out face identification to the user of conversation home terminal to the conversation opposite terminal suggestion face identification result, let the conversation opposite terminal know the identity condition of home terminal talker, the convenient communication has perfected mobile terminal's voice call function.

Drawings

Fig. 1 is a schematic flow chart of a call prompting method according to an embodiment of the present application;

fig. 2 is a schematic flow chart of another call prompting method according to an embodiment of the present application;

fig. 3 is a schematic flow chart of another call prompting method according to an embodiment of the present application;

fig. 4 is a schematic flowchart of another call prompting method according to an embodiment of the present application;

fig. 5 is a schematic view of a call interface provided in an embodiment of the present application;

FIG. 6 is a schematic illustration of another exemplary embodiment of a call interface;

fig. 7 is a block diagram of a call prompt apparatus according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application;

fig. 9 is a schematic structural diagram of another mobile terminal according to an embodiment of the present application.

Detailed Description

The technical scheme of the application is further explained by the specific implementation mode in combination with the attached drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures.

Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the steps as a sequential process, many of the steps can be performed in parallel, concurrently or simultaneously. In addition, the order of the steps may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.

Fig. 1 is a flowchart illustrating a call alert method according to an embodiment of the present application, where the call alert method may be executed by a call alert device, where the call alert device may be implemented by software and/or hardware, and may be generally integrated in a mobile terminal. As shown in fig. 1, the method includes:

step 101, when detecting that a preset call event is triggered or is about to be triggered, acquiring an environment image through a camera of a mobile terminal.

For example, the mobile terminal in the embodiment of the present application may include mobile devices such as a mobile phone, a tablet computer, a notebook computer, and a personal digital assistant.

In the embodiment of the present application, the preset call event may include an outgoing call event and/or an incoming call event. Illustratively, an outgoing call event and/or an incoming call event corresponding to a phone may be included, as well as an outgoing call event and/or an incoming call event corresponding to a social account.

Many mobile terminals are provided with a card slot for a Subscriber Identity Module (SIM) card, and a Subscriber can insert a SIM card requested by a communication carrier, where each SIM card corresponds to a phone number (e.g., 151XXXXXXXX), and after inserting the SIM card into the mobile terminal of the Subscriber, the Subscriber can enjoy services such as phone calls, short messages, and mobile data networks provided by the communication carrier. Calling events corresponding to the phone can include that the current user calls other users by using the mobile terminal at a phone number corresponding to the current SIM card; the incoming call event corresponding to the phone may include other users calling a phone number corresponding to the SIM card of the current user.

With the rapid development of the internet, people can communicate in a network mode besides the traditional telephone. For example, a voice call may be made with other users using a social account registered in a social platform or social application (e.g., WeChat or QQ, etc.). Calling events corresponding to the social account numbers can include that a current user initiates a voice chat request to other users through the mobile terminal by using the currently used social account numbers; an incoming call event corresponding to a social account may include other users initiating a voice chat request to the current user's social account.

In the embodiment of the application, the condition that the preset call event is triggered is not limited, and the mode for predicting whether the preset call event is to be triggered is not limited.

For example, detecting that an outgoing call event is triggered or is about to be triggered includes: and detecting that the mobile terminal enters a preset interface or detecting a call dialing operation. The preset interface comprises a telephone book interface, a dialing interface, a call record interface or a contact interface in a social application, and when the mobile terminal enters the interfaces under the operation of a user, the situation that the user may actively contact a certain contact can be predicted. The call placement operation may include a number on a dial pad being triggered, an outgoing call button in a dial pad or in a social application being triggered, a contact entry in a phonebook interface being triggered, or an entry in a call log interface being triggered. For a telephone, a user may select a number dialing mode to dial the telephone, where the telephone number usually includes multiple digits, and when the user triggers (e.g., clicks or presses) at least one digit on the dial pad, it is predicted that the user will dial the telephone; after the telephone number is input, the user can trigger a calling button in the dialing keyboard, and a calling event corresponding to the telephone is considered to be triggered at the moment; after a user finds a contact who wants to perform voice call in the social application, a calling button can be triggered, and a calling event corresponding to the social account can be considered to be triggered at the moment; in some mobile terminals, a user may trigger a contact entry in a phone book or a number entry in a call record in a certain manner (e.g., clicking, long-pressing, sliding, etc.), so that the mobile terminal may send a call request to the corresponding contact, and at this time, it may be considered that an outgoing call event corresponding to the phone call is triggered.

For example, detecting that an incoming call event is triggered or is about to be triggered includes: receiving a phone call request or receiving a social account call request (an incoming call event may be considered to be triggered), or predicting that another user is about to call the user (an incoming call event may be considered to be triggered) through a memo, a short message record, a chat record, or the like.

At present, a camera is often arranged in a mobile terminal, and the mobile terminal can be used for photographing, video recording, video chatting and the like. The camera in the embodiment of the present application may include a front camera, a rear camera, a rotary camera, or the like. And controlling at least one camera arranged in the mobile terminal to acquire images in a view finding range as environment images. The operation of acquiring the environment image may be performed in real time or at a preset acquisition frequency, which is not limited in the embodiment of the present application. For example, when it is determined that the acquired environment image contains a human face, the acquisition may be stopped to save power consumption; and when the call connection is detected to be successful, stopping the acquisition to ensure that the acquired environment image is the latest environment image, namely the acquired face is the final real caller.

And 102, identifying the face image appearing in the environment image.

In the embodiment of the application, no limitation is made on how to determine whether the environment image contains the face image and specifically how to identify the face image. For example, the environment image may be subjected to image recognition based on facial features of a person (such as facial contours and facial feature distribution rules), and whether a human face image is included therein is determined. When the face image is determined to be included, the characteristics of the iris, the nasal wing, the mouth angle and the like of the eyes in the face image can be continuously analyzed to obtain an identity recognition result.

Optionally, if the face image cannot be detected from the environment image all the time, the subsequent steps may not be performed, and the process may be performed according to a normal call flow. The reason why the face cannot be detected may be that the mobile terminal is placed on a desktop, and the front camera of the mobile terminal cannot shoot an environment image containing a face image under the condition that the call mode is hands-free.

And 103, when the identity recognition result meets a preset condition, carrying out corresponding prompt on the opposite party of the call according to the identity recognition result.

For example, the mobile terminal may pre-store face information of the owner, may also pre-store face information of a person (such as a husband, wife, or child) who is closer to the owner, and may also pre-store face information of other contacts in the mobile terminal. The preset condition may include that the face image does not match any preset person, the preset person may be defaulted by the system as the owner or the holder of the account currently used by the mobile terminal, or may be set by the user according to personal conditions, for example, may be set as the user or the wife.

Illustratively, when the face image is not matched with any preset person, the calling party can be correspondingly prompted according to the identity recognition result, so that the calling party can know the identity condition of the local-end caller. For example, if the preset person only includes the owner, the calling party can be prompted when the current face image is not matched with the owner, and the current caller is not the owner, so that the communication between the two parties is facilitated.

The specific prompting mode and prompting content are not limited in the embodiment of the application, and can be set according to actual requirements.

According to the call prompting scheme provided by the embodiment of the application, when a preset call event is detected to be triggered or to be triggered, the camera of the mobile terminal is used for collecting the environment image, when the environment image is determined to contain the face image, the face image is subjected to identity recognition, and when the identity recognition result meets a preset condition, the call opposite side is correspondingly prompted according to the identity recognition result. Through adopting above-mentioned technical scheme, can carry out face identification to the user of conversation home terminal to the conversation opposite terminal suggestion face identification result, let the conversation opposite terminal know the identity condition of home terminal talker, the convenient communication has perfected mobile terminal's voice call function.

In some embodiments, the identifying the face image appearing in the environment image includes: and identifying whether the face image appearing in the environment image is matched with the holder of the account currently used by the mobile terminal. Correspondingly, when the identity recognition result meets the preset condition, the corresponding prompt is carried out on the other party of the call according to the identity recognition result, and the prompt comprises the following steps: and when the identity recognition result comprises that the face image is not matched with the holder, carrying out corresponding prompt on the opposite party of the call, wherein the prompt is used for reminding the opposite party of the call that the current caller is not the holder. The advantage that sets up like this lies in, can let the conversation other side in time know whether the person of calling of this end is the owner that the number corresponds, avoids some awkward circumstances to take place. In a daily life scenario, it is inevitable to encounter such a situation: the user himself or herself has an urgent situation to deal with and cannot get away, and therefore people around the user need to help to make or receive calls, or friends and relatives use the mobile terminal temporarily to make calls, the user is often considered as the owner of the user. At the beginning of a call, it is usually called first, and then speaking other call contents, such as calling father, mother, old woman, old man or relatives, etc., it is easy to generate some situations such as confusion of relatives and generations, exposure of ambiguous statement privacy between emotions, etc. In addition, when the default calling party is the owner, some important things which are relatively private can be directly spoken, so that other people can hear the important things, and privacy disclosure can be caused. The technical scheme provided by the application can well avoid the above situation, and can optimize the conversation process while perfecting the functions of the mobile terminal, thereby ensuring the smooth communication and the safety of privacy. In the embodiment of the application, regarding a holder of a current account used by a mobile terminal, when a preset call event corresponds to a call, the current account used by the mobile terminal is a number corresponding to an SIM card, and the holder can be regarded as a mobile terminal owner; when the preset call event corresponds to the social account, the currently used account of the mobile terminal is the currently logged-in social account, and the holder of the currently used account can be regarded as a registrant of the social account, and if the user a registers the account in the WeChat and the nickname is 'floret', the holder of the currently used account is the user a, and even if the user a logs in the WeChat by using the mobile terminal of another person, when the user uses the 'floret' to perform voice chat with another person, the holder of the currently used account is the user a.

In some embodiments, the prompting the other party of the call according to the identification result includes: and correspondingly prompting the opposite party of the call according to the identity recognition result before the call connection is successful or in a preset time period after the call connection is successful. Before the call connection is successful, the corresponding prompt is carried out on the call opposite side according to the identity recognition result, so that the call opposite side can receive the prompt as early as possible and make corresponding psychological preparation. In a preset time period after the call connection is successful, the corresponding prompt of the call opposite side according to the identity recognition result has the advantage that the prompt of the call opposite side can be prevented from being missed due to busy other things or other reasons, wherein the preset time period can include a preset time period, such as 5 seconds, when the call connection is successfully started.

In some embodiments, the prompting the call counterpart according to the identification result before the call connection is successful includes: and before the call connection is successful, correspondingly prompting in a mode of sending a message to the call opposite side, wherein the content of the message corresponds to the identification result. The advantage of setting up like this is, can let the conversation partner know the content of suggestion more directly perceivedly. The message may be in the form of a short message, a multimedia message, an application notification, or an application push message, and the embodiment of the present application is not limited. The display position or display mode of the message content is not limited, and may be, for example, displayed in the form of a pop-up window or a floating window on the top of the screen of the mobile terminal. The specific message content may be pre-written, for example, "not personally used, please note to distinguish," and the specific content is not limited, and may be set by default in the system or personalized by the user.

In some embodiments, the prompting the call counterpart according to the identification result before the call connection is successful includes: and in the waiting connection period before the call connection is successful, correspondingly prompting in a mode of sending waiting voice to the call opposite side, wherein the content of the waiting voice corresponds to the identification result. The advantage of this setting is that the user can listen to the waiting voice in the process of picking up the mobile terminal to wait for the successful call connection, and the situation that the user keeps putting the mobile terminal at the ear or busy with other things and does not see the prompt message in time is prevented. The playing mode of the waiting voice can be the same as the playing mode of the waiting ring (such as a polyphonic ringtone or a drip sound played at intervals), and the voice content can be pre-recorded, for example, "please note that the opposite party is not the person", the specific content is not limited, and can be set by default of the system or personalized by the user.

In some embodiments, the prompting the other party of the call according to the identification result within a preset time period after the call connection is successful includes: and in a preset time interval after the call connection is successful, carrying out corresponding prompt in a mode of sending voice to the call opposite side, wherein the content of the voice corresponds to the identity recognition result. The method has the advantages that after the call connection is successful, both parties of the call can pay attention to the voice received by the mobile terminal, and the voice for prompting is played at the moment, so that the opposite party of the call can be ensured to successfully receive the prompt. In addition, in order to avoid the interference of the voice prompt caused by the voice of the user at the local end of the call, the voice of the current caller of the mobile terminal can be shielded in the process of sending the voice to the opposite party of the call. The voice content of the voice may also be pre-recorded, for example, "please note that the other party is not the person himself", and the specific content is not limited, and may be set by default in the system or set individually by the user. For the mobile terminal, a prompt tone can also be played to the user to prompt that the other party cannot hear the words of the user currently.

In some embodiments, the prompting corresponding to sending a message to a call partner, where the content of the message corresponds to the identification result includes: judging whether a contact matched with the face image is stored in the mobile terminal; and if the contact person exists, correspondingly prompting in a mode of sending a message to a call counterpart, wherein the content of the message comprises the face image and/or the name of the contact person. The method has the advantages that the face information or the face image corresponding to each contact person can be stored in the mobile terminal in advance and used for being matched with the face image detected currently, if the contact person successfully matched exists, the specific identity of the current caller can be clearly informed to the opposite party of the call, and the opposite party of the call can have more clear psychological preparation. The contact person may be a contact person in a phone book of the mobile terminal, or a contact person in a contact list of the social account.

In some embodiments, in the process of acquiring the environment image through the camera of the mobile terminal, the method further includes: and if the front of the mobile terminal is detected to be shielded by the object, stopping the acquisition of the environment image. The method has the advantages that when the environment image containing the human face cannot be collected, collection is stopped in time, and power consumption is saved. For example, whether the front surface of the mobile terminal is blocked by an object may be detected by a distance sensor or a proximity sensor integrated with the front surface of the mobile terminal. For example, a distance value of the distance sensor is read, and when the distance value is smaller than a preset distance threshold, it is considered that the front surface of the mobile terminal is shielded by an object. When the front of the mobile terminal is shielded by an object, the camera cannot generally acquire an environment image containing a human face, which may be because the user has placed the mobile terminal to the ear to prepare for a call.

In some embodiments, the method further comprises: when detecting that an incoming call event is triggered, judging whether a message is received within a preset time range, if so, judging whether a sender of the received message is consistent with a caller of the incoming call event, and if so,: acquiring message content, and displaying the message content in a call interface; or controlling the message to be continuously displayed at a preset position in the screen until the mobile terminal is detected to be picked up by a user or until the screen of the mobile terminal is detected to be watched. This has the advantage of ensuring that the user can view the prompts sent by the party to the call. The preset time range may include a preset time period before and/or after the time when the incoming call event is triggered, and the preset time period may be, for example, 1 minute.

In the embodiment of the application, when the mobile terminal used by the other party and the current mobile terminal both have the call prompt function, the mobile terminal of the other party can also perform operations such as face detection and the like, and when the identity recognition result meets the preset condition, the mobile terminal can also perform corresponding prompt on the home terminal according to the identity recognition result, at this time, the mobile terminal of the home terminal can receive the message, if the sender of the message is consistent with the caller of the incoming call event, the message can be considered to correspond to the prompt of the identity recognition result, and at this time, the following any one or two ways can be adopted to ensure that the user can view the message content.

First, message content is obtained and displayed in a call interface. The method has the advantages that before the user answers the call, the identity of the calling party is usually checked in the call interface, the message content is directly displayed in the call interface, and the user can more intuitively and timely check the message content. Optionally, when the content of the message includes the facial image and/or name of the contact, the corresponding original facial image and/or name in the call interface may also be replaced with the facial image and/or name of the contact.

And secondly, controlling the message to be continuously displayed at a preset position in the screen until the mobile terminal is detected to be picked up by a user or until the screen of the mobile terminal is detected to be watched. The preset position may be the top of the screen or the center of the screen, and the embodiment of the present application is not limited. Whether the mobile terminal is picked up by a user or whether a screen of the mobile terminal is watched by the user can be detected through components such as a motion sensor or a camera integrated in the mobile terminal, and whether the user can view the content on the screen is further judged. Further, to ensure that the user can view the entire message content, the display of the message may be stopped for a predetermined length of time after detecting that the mobile terminal is picked up by the user or until detecting that the screen of the mobile terminal is gazed. That is, the message is controlled to be continuously displayed at a preset position in the screen until a first predetermined time after the mobile terminal is detected to be taken up by a user or until a second predetermined time after the screen of the mobile terminal is detected to be watched.

Fig. 2 is a schematic flow chart of another call prompting method provided in the embodiment of the present application, in which a mobile terminal takes a mobile phone as an example, and takes a preset call event as an example of a call-out event corresponding to a telephone, the method includes the following steps:

step 201, detecting that the mobile phone enters a preset interface.

Illustratively, the preset interface may include a mobile phone address book interface, a dial pad function module interface or a call record interface.

In the embodiment of the application, firstly, a short message sentence file can be created and edited for sending a short message in advance to inform the opposite party after the calling party confirms that the calling party is not the owner, so that the opposite party can effectively know and verify the identity of the calling party. The method for editing the short message sentence file can be as follows:

1. and entering a short message interface of the mobile terminal according to the clicking operation of the user.

2. Receiving and recording a pre-planned short message prompt statement input by a user. For example, input "use the mobile phone by oneself, please pay attention to the discrimination! (the specific short message prompting statement content can be decided by the user).

3. And saving the edited and confirmed short message prompting statement as a draft for later use.

In the embodiment of the present application, an Android operating system may be taken as an example for explanation. The method can acquire a TelephonyManager object (tManager ═ TelephonyManager;. getSystemservice (context. Telephony _ SERVICE)), and create a phone state listener (phone state listener:. newphone state listener ()) to monitor and judge the state of the mobile phone terminal when the mobile phone terminal makes and receives calls.

Step 202, judging whether a telephone dialing operation is detected, if so, executing step 203; otherwise, step 202 is repeated.

The phone dialing operation may include, among other things, a number on a dial pad being triggered, an outgoing call button in the dial pad being triggered, a contact entry in a phonebook interface being triggered, or an entry in a call log interface being triggered.

After detecting that the mobile phone enters a preset interface under the operation of a user, when it is monitored that the user starts to click a dialing button in a dialing keyboard function module interface (the click on a contact and a CALL record is finally processed on the dialing button of the underlying system, which can be understood that the click on the contact and the CALL record is a shortcut key of the dialing button), the system CALLs a dialbutton pressedless (int simId) function to send an Intent (which can be understood as an object in an android operating system, when going from a current activity, i.e. an interface layout space or an active window, to another activity, the Intent can be realized through the Intent, for example, the Intent is jumped from a dialing number interface to a calling interface in the dialing phone), so as to realize the jump (Intent _ CALL _ PRIVILEGED)) to the calling interface in the dialing phone. When the fact that a call is dialed through the dialing button is monitored, the system jumps to the Outgoing Call broadcasting.

And step 203, acquiring an environment image in real time through a front camera of the mobile phone.

Illustratively, when it is confirmed that a user calls a phone call through the dial button, a FRONT CAMERA of the mobile phone terminal (or a rotatable CAMERA with a current position located on the FRONT of the mobile terminal) is activated to perform continuous shooting (CAMERA info, CAMERA _ facial _ FRONT \/represents the orientation of the CAMERA, and two values are defined as CAMERA _ facial _ FRONT and CAMERA _ facial _ BACK, respectively), and the shot picture is input to the face recognition system module for recognition confirmation.

In addition, during the continuous shooting process, when a distance sensor carried by the mobile phone detects that an object approaches a shield (system. out. println ("its [0 ]:' + its [0 ]); if (its [0] ═ 0.0)), the user can prove that the user is close to and listening when picking up the mobile phone, and the shooting of the front camera of the mobile phone terminal can be sold out (mCamera ═ null) in consideration of the power consumption of the mobile phone; return false).

Step 204, judging whether an environment image containing a face image exists, if so, executing step 205; otherwise, step 207 is performed.

Step 205, identifying the face image, judging whether the face image is matched with the mobile phone owner, and if so, executing step 207; otherwise, step 206 is performed.

Face Recognition (face Recognition) is a biometric technology for performing identity Recognition based on Facial feature information of a person. The method comprises the steps of collecting images or video streams containing human faces by using a camera or a pick-up head, calculating and analyzing the positions, the shapes and the angles of five sense organs of the faces by using a core algorithm, and further comparing the positions, the shapes and the angles with an existing template in a database of the user, wherein the related technologies are generally called portrait identification and facial identification.

For example, the face may be detected first for preprocessing of face recognition. One or more standard face templates can be designed firstly, namely, on the basis of the facial features of a person (because the face has certain structural distribution features, such as the size, position, distance and other attributes of facial image facial features such as iris, nasal wing, mouth corner and the like), whether the face exists in a shot photo (namely, an input environmental image or video stream) is judged firstly, if the face exists, the position and the size of the face and the position information of each main facial organ are further given, an Adaboost learning algorithm is adopted on the basis of the features, then the matching degree between a sample collected by test and the standard template is calculated, and whether the face exists is judged through a threshold value, and the standard template at the moment is the face information or the face image of a mobile phone owner in the embodiment of the application. The Adaboost algorithm is a method for classification, which combines some weak classification methods together to form a new strong classification method, picks some rectangular features (weak classifiers) which can represent the human face most, constructs the weak classifiers into a strong classifier according to a weighted voting mode, and then connects a plurality of strong classifiers obtained by training in series to form a cascade-structured cascade classifier, thereby effectively improving the detection speed of the classifier.

And preprocessing the face image based on the face detection result, processing the image and finally serving the process of feature extraction. The original image acquired by the system is limited by various conditions and random interference, so that the original image cannot be directly used, and the original image needs to be subjected to image preprocessing such as gray scale correction, noise filtering and the like in the early stage of image processing. For the face image, the preprocessing process mainly includes light compensation, gray level transformation, histogram equalization, normalization, geometric correction, filtering, sharpening, and the like of the face image.

And extracting the features of the face image aiming at certain features of the face. Feature data of face classification is obtained according to shape description of face organs and distance characteristics between the face organs, and feature components of the face classification generally comprise Euclidean distance, curvature, angle and the like between feature points. The human face is composed of parts such as eyes, nose, mouth and chin, and geometric description of the parts and the structural relationship between the parts can be used as important features for recognizing the human face, and the features are called as geometric features.

And matching and identifying the face image. And searching and matching the extracted feature data of the face image with a feature template stored in a database, and outputting a result obtained by matching when the similarity exceeds a threshold value by setting the threshold value. The face features to be recognized are compared with the obtained face feature template, the face information is judged according to the similarity degree, whether the shot and input images are matched with the faces input by the system is determined, and whether the face images contained in the currently acquired environment images are matched with the owner faces prestored in the mobile phone is judged.

Optionally, step 204 may not be performed, but step 205 may be performed directly, where a face image of the environment image is first subjected to face recognition, whether a face image matching the mobile phone owner exists is determined, if yes, step 207 is performed, otherwise, the following steps are performed: and judging whether any image related to the face avatar exists in the environment image, if so, executing the step 207, otherwise, executing the step 206. The reason for this is that the environment image does not need to be confirmed whether to contain the face, the environment image is directly input into the corresponding model for face recognition, after the matching with the owner face fails, whether images except for the face avatar exist in the shot image with the matching failure can be further confirmed (namely, no image related to the face avatar appears), and the fact that the face avatar cannot be shot by the front camera is mainly considered in the case that the mobile phone is placed on a table top and hands-free conversation is performed.

Step 206, the calling party is prompted correspondingly to remind the answering party that the current caller is not the owner, and step 207 is executed.

When the face recognition detects that the face is not matched with the face input by the system, the current user who uses the mobile phone to make a call is proved not to be the owner, and the broadcast state of the call made by the mobile phone terminal is further monitored. First, through android _ xml registration broadcast (use-permission android: name: "android. permission. processing _ outputting _ CALLS" /), when it is monitored that the calling state changes, the calling broadcast (internal. external _ PHONE _ NUMBER) is received, the real-time validity of calling is proved, but not cancelled, and meanwhile, preparation is made for sending the edited short message sentence in the next step.

The method comprises the steps of obtaining a dialed telephone number service (public class outgoing Call service extendedsservice), setting button monitoring (btnOutgoing Call _ setonClickLister (this)), and obtaining a mobile phone number (log. info { } phoneNumber) of the dialed telephone, wherein if the mobile phone number is 159XXXXX, the mobile phone number is used for sending a pre-edited short message sentence.

And calling a function module and an interface of the system for sending the short message in the background, and sending the content of the short message edited in advance. Specifically, the method comprises the steps of firstly creating Uri, setting behaviors and filling in the acquired mobile phone number (Uri 2 ═ Uri. part ("smsto:" +159 XXXXX)), creating a short message intention (internal entremessage ═ new internal (internal.ACTION _ VIEW, Uri 2;), opening a system short message interface (intFinaIlmessage) by background operation, filling in the previously edited short message contents (internal.putExtra ("sms _ body", etc. getText (). toString () ", wherein" sms _ body "refers to a body field in a system data table sms, and storing the stored short message contents), and then sending the short message (short message).

Step 207, enter the normal call dialing subsequent flow.

For example, when the other party selects to answer, the voice of the user is collected and sent to the other party, and the call is carried out.

According to the call prompting method provided by the embodiment of the application, when a user makes a call, the mobile phone judges whether the user is the owner of the mobile phone or not in a face verification mode, if not, the called user is prompted in a mode of sending a pre-edited short message, so that the opposite side can know the identity condition of the user at the home end of the mobile phone in advance, psychological preparation is made, recognition and risk control are performed as far as possible, corresponding countermeasures are taken, the passive safety factor is improved, and the problem that the risk is revealed by the safety and privacy of the mobile phone terminal before the call is solved.

Fig. 3 is a flowchart illustrating a further call prompting method provided in an embodiment of the present application, where a preset call event is an incoming call event corresponding to a social account, as shown in fig. 3, the method includes the following steps:

step 301, detecting that the mobile terminal receives a voice call request based on a social application.

And step 302, controlling a camera of the mobile terminal to acquire an environment image in real time.

Step 303, judging whether an environment image containing a face image exists, if so, executing step 304; otherwise, step 306 is performed.

Step 304, identifying the face image, judging whether the face image is matched with a currently logged account holder in the social application, and if so, executing step 306; otherwise, step 305 is performed.

Step 305, sending a chat message to the initiator of the voice call request to remind the other party that the current receiver is not the user, and executing step 306.

It will be appreciated that the user will typically have a reaction time of a few seconds when he hears or sees the chat request, and the mobile terminal can use this time to complete the identity verification and send the chat message.

And step 306, entering a normal subsequent voice chat process.

For example, when it is detected that the user selects to answer, the voice of the user is acquired and sent to the other party to carry out voice call.

According to the call prompting method provided by the embodiment of the application, when a voice call request of the social application is received, the mobile terminal judges whether a user to be answered is the owner of the social account number currently or not in a face verification mode, if not, prompts the user initiating the voice call in a chat message sending mode to help the opposite side to know the identity condition of a receiver in advance, makes psychological preparation, takes corresponding measures, and further solves the problem that the safety and privacy of the mobile terminal are exposed during voice chat.

Fig. 4 is a schematic flowchart of another call prompting method provided in an embodiment of the present application, and as shown in fig. 4, the method includes:

step 401, when it is detected that a phone dialing event is triggered, acquiring an environment image through a camera of the mobile terminal.

Step 402, identifying whether a face image appearing in the environment image is matched with a holder of a current account used by the mobile terminal, if so, executing step 406; otherwise, step 403 is performed.

Step 403, judging whether a contact matched with the face image is stored in the mobile terminal, if so, executing step 404; otherwise, step 405 is performed.

Step 404, a corresponding prompt is carried out in a mode of sending a message to a call counterpart, wherein the content of the message comprises a face image and/or a name of the contact person, and step 406 is executed.

Step 405, a corresponding prompt is performed in a manner of sending a message to the call counterpart.

The prompt is used for reminding the opposite party of the call, and the current dialing person is not the owner.

Step 406, enter the normal call dialing follow-up flow.

Step 407, detecting that the incoming call event is triggered.

Illustratively, after the call is over, an incoming call event is detected to be triggered.

Step 408, judging whether a message is received within a preset time range, if so, executing step 409; otherwise, step 411 is executed.

Illustratively, the time of the message (long time msg. gettimestamp millis ()) is acquired and compared with the time of the incoming call.

Step 409, judging whether the sender of the received message is consistent with the caller of the incoming call event, if so, executing step 410; otherwise, step 411 is executed.

Illustratively, a number of a message sender (String sender: msg. getoriginingaddress ()) is obtained, and whether the message sender and the caller number are consistent or not is confirmed.

And step 410, obtaining the message content, and displaying the message content in a call interface.

Illustratively, the content of the message (String content) is read for msg, and the obtained short message content is displayed on the connected call interface by calling a pop-up dialog box, a floating window, or a caller id display control of the system, so as to inform the other party.

Fig. 5 is a schematic view of a call interface provided in an embodiment of the application, as shown in fig. 5, when another person uses a mobile phone of a current user dad to make a call to the current user, the mobile phone of the other party recognizes that the calling party is not dad of the current user, and sends a short message to the mobile phone of the user, and when the mobile phone of the user judges that the sending party of the short message is consistent with the calling party of the incoming call event, the mobile phone of the user obtains a message content "please note, the caller is not the owner", and displays the message content in the call interface to remind the user.

Fig. 6 is a schematic view of another call interface provided in this embodiment of the application, as shown in fig. 6, still taking an example that another person uses the mobile phone of the current user dad to make a call to the current user, assuming that the other person stores face information and a contact name (assumed as "xiaowei") in the mobile phone of the user dad, and dad recognizes that the current call is a xiaowei, then "xiaowei" and a corresponding face image can be sent to the mobile phone of the current user as message contents, and the original dad's head portrait and "dad" are respectively replaced with the faowei's head portrait and "xiaowei". Further, a message content can be added with "please note that xiaowei is using dad's cell phone" for further prompting the current user.

Step 411, enter the normal call answering subsequent flow.

It will be appreciated that the order of making and receiving calls may be interchanged.

According to the call prompting method provided by the embodiment of the application, when a call is made, face recognition is carried out, if the current caller is not the owner of the caller, the call opposite side is prompted, and meanwhile, if the identity of the current caller has a record in the mobile terminal, the recognized identity is informed to the opposite side. When the incoming call is answered, if a prompt message is received, the message content is obtained and displayed in a call interface to remind the caller that the caller is not the caller, so that the user can know the identity of the opposite party before answering. Thus, the mobile terminal has both functions of notifying the other person and accepting the notification.

Fig. 7 is a block diagram of a call prompting apparatus provided in an embodiment of the present application, where the apparatus may be implemented by software and/or hardware, and is generally integrated in a mobile terminal, and may perform call prompting by executing a call prompting method. As shown in fig. 7, the apparatus includes:

the image acquisition module 701 is used for acquiring an environment image through a camera of the mobile terminal when a preset call event is detected to be triggered or is about to be triggered; the preset call event comprises a calling event and/or a calling event;

an identity recognition module 702, configured to perform identity recognition on a face image appearing in the environment image;

and the prompting module 703 is configured to perform corresponding prompting on the other party of the call according to the identity recognition result when the identity recognition result meets a preset condition.

The conversation prompting device provided in the embodiment of the application acquires an environment image through a camera of the mobile terminal when detecting that a preset conversation event is triggered or is about to be triggered, identifies the face image appearing in the environment image, and carries out corresponding prompting on a conversation opposite side according to the identification result when the identification result meets a preset condition. Through adopting above-mentioned technical scheme, can carry out face identification to the user of conversation home terminal to the conversation opposite terminal suggestion face identification result, let the conversation opposite terminal know the identity condition of home terminal talker, the convenient communication has perfected mobile terminal's voice call function.

Optionally, the identifying the face image appearing in the environment image includes:

identifying whether a face image appearing in the environment image is matched with a holder of a current account used by the mobile terminal;

correspondingly, when the identity recognition result meets the preset condition, the corresponding prompt is carried out on the other party of the call according to the identity recognition result, and the prompt comprises the following steps:

and when the identity recognition result comprises that the face image is not matched with the holder, carrying out corresponding prompt on the opposite party of the call, wherein the prompt is used for reminding the opposite party of the call that the current caller is not the holder.

Optionally, the performing a corresponding prompt on the other party of the call according to the identification result includes:

and correspondingly prompting the opposite party of the call according to the identity recognition result before the call connection is successful or in a preset time period after the call connection is successful.

Optionally, before the call connection is successful, the correspondingly prompting the call counterpart according to the identification result includes:

before the call connection is successful, corresponding prompt is carried out in a mode of sending a message to the call opposite side, and the content of the message corresponds to the identity recognition result; or, in the waiting connection period before the call connection is successful, corresponding prompt is carried out in a mode of sending waiting voice to the call counterpart, and the content of the waiting voice corresponds to the identity recognition result;

in a preset time period after the call connection is successful, correspondingly prompting the call opposite side according to the identity recognition result, comprising the following steps:

in a preset time interval after the call connection is successful, carrying out corresponding prompt in a mode of sending voice to the call opposite side, wherein the content of the voice corresponds to the identity recognition result; and shielding the sound of the current caller of the mobile terminal in the process of sending the voice to the call counterpart.

Optionally, the prompting corresponding to the manner of sending a message to the other party of the call, where the content of the message corresponds to the identification result, includes:

judging whether a contact matched with the face image is stored in the mobile terminal;

and if the contact person exists, correspondingly prompting in a mode of sending a message to a call counterpart, wherein the content of the message comprises the face image and/or the name of the contact person.

Optionally, detecting that the outgoing call event is triggered or is about to be triggered comprises:

detecting that the mobile terminal enters a preset interface, wherein the preset interface comprises a telephone book interface, a dialing interface, a call record interface or a contact interface in a social application; or,

a call placement operation is detected, wherein the call placement operation includes a number on a dial pad being triggered, an outgoing call button in the dial pad or in a social application being triggered, a contact entry in a phonebook interface being triggered, or an entry in a call log interface being triggered.

Optionally, the image acquisition module is further configured to: in the process of collecting the environment image through a camera of the mobile terminal, if the fact that the front face of the mobile terminal is shielded by an object is detected, collection of the environment image is stopped.

Optionally, the apparatus further comprises:

the message receiving and judging module is used for judging whether a message is received within a preset time range when the fact that the incoming call event is triggered is detected;

the message sender judging module is used for judging whether the sender of the received message is consistent with the caller of the incoming call event or not when the message is received within the preset time range;

a message display processing module, configured to, when a sender of the received message is consistent with an outgoing party of the incoming call event:

acquiring message content, and displaying the message content in a call interface; or controlling the message to be continuously displayed at a preset position in the screen until a first preset time after the mobile terminal is detected to be taken up by a user or until a second preset time after the screen of the mobile terminal is detected to be watched.

Embodiments of the present application also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a call alerting method, the method including:

Storage medium-any of various types of memory devices or storage devices. The term "storage medium" is intended to include: mounting media such as CD-ROM, floppy disk, or tape devices; computer system memory or random access memory such as DRAM, DDRRAM, SRAM, EDORAM, Lanbas (Rambus) RAM, etc.; non-volatile memory such as flash memory, magnetic media (e.g., hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system connected to the first computer system through a network (such as the internet). The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media that may reside in different locations, such as in different computer systems that are connected by a network. The storage medium may store program instructions (e.g., embodied as a computer program) that are executable by one or more processors.

Of course, the storage medium provided in the embodiments of the present application and containing computer-executable instructions is not limited to the above-described call prompting operation, and may also perform related operations in the call prompting method provided in any embodiments of the present application.

The embodiment of the application provides a mobile terminal, and the call prompting device provided by the embodiment of the application can be integrated in the mobile terminal. Fig. 8 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application. The mobile terminal 800 may include: the system comprises a memory 801, a processor 802 and a computer program stored on the memory and executable by the processor, wherein the processor 802 implements the call prompting method according to the embodiment of the application when executing the computer program.

The mobile terminal provided by the embodiment of the application can carry out face recognition on a user of a call home terminal, and prompts a face recognition result to a call opposite terminal, so that the call opposite terminal can know the identity condition of a caller at the home terminal, the communication is convenient, and the voice call function of the mobile terminal is perfected.

Fig. 9 is a schematic structural diagram of another mobile terminal according to an embodiment of the present application, where the mobile terminal may include: a casing (not shown), a memory 901, a Central Processing Unit (CPU) 902 (also called a processor, hereinafter referred to as CPU), a circuit board (not shown), and a power circuit (not shown). The circuit board is arranged in a space enclosed by the shell; the CPU902 and the memory 901 are disposed on the circuit board; the power supply circuit is used for supplying power to each circuit or device of the mobile terminal; the memory 901 is used for storing executable program codes; the CPU902 executes a computer program corresponding to the executable program code by reading the executable program code stored in the memory 901, so as to implement the following steps:

The mobile terminal further includes: peripheral interface 903, RF (Radio Frequency) circuitry 905, audio circuitry 906, speakers 911, power management chip 908, input/output (I/O) subsystems 909, other input/control devices 910, touch screen 912, other input/control devices 910, and external port 904, which communicate through one or more communication buses or signal lines 907.

It should be understood that the illustrated mobile terminal 900 is merely one example of a mobile terminal and that the mobile terminal 900 may have more or fewer components than shown, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The following describes the mobile terminal for call prompting provided in this embodiment in detail, where the mobile terminal is a mobile phone as an example.

Memory 901, the memory 901 being accessible by the CPU902, the peripheral interface 903, etc., the memory 901 may comprise high speed random access memory, and may also comprise non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other volatile solid state storage devices.

A peripheral interface 903, the peripheral interface 903 may connect input and output peripherals of the device to the CPU902 and the memory 901.

An I/O subsystem 909, which I/O subsystem 909 may connect input and output peripherals on the device, such as a touch screen 912 and other input/control devices 910, to the peripheral interface 903. The I/O subsystem 909 may include a display controller 9091 and one or more input controllers 9092 for controlling other input/control devices 910. Where one or more input controllers 9092 receive electrical signals from or send electrical signals to other input/control devices 910, the other input/control devices 910 may include physical buttons (push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels. It is worth noting that the input controller 9092 may be connected with any one of the following: a keyboard, an infrared port, a USB interface, and a pointing device such as a mouse.

A touch screen 912, which is an input interface and an output interface between the user's mobile terminal and the user, displays visual output to the user, which may include graphics, text, icons, video, and the like.

The display controller 9091 in the I/O subsystem 909 receives electrical signals from the touch screen 912 or transmits electrical signals to the touch screen 912. The touch screen 912 detects a contact on the touch screen, and the display controller 9091 converts the detected contact into an interaction with a user interface object displayed on the touch screen 912, that is, to implement a human-computer interaction, where the user interface object displayed on the touch screen 912 may be an icon for running a game, an icon networked to a corresponding network, or the like. It is worth mentioning that the device may also comprise a light mouse, which is a touch sensitive surface that does not show visual output, or an extension of the touch sensitive surface formed by the touch screen.

The RF circuit 905 is mainly used to establish communication between the mobile phone and the wireless network (i.e., network side), and implement data reception and transmission between the mobile phone and the wireless network. Such as sending and receiving short messages, e-mails, etc. In particular, RF circuitry 905 receives and transmits RF signals, also referred to as electromagnetic signals, through which RF circuitry 905 converts electrical signals to or from electromagnetic signals and communicates with a communication network and other devices. The RF circuitry 905 may include known circuitry for performing these functions including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC (CODEC) chipset, a Subscriber Identity Module (SIM), and so forth.

The audio circuit 906 is mainly used to receive audio data from the peripheral interface 903, convert the audio data into an electric signal, and transmit the electric signal to the speaker 911.

The speaker 911 is used to convert the voice signal received by the mobile phone from the wireless network through the RF circuit 905 into sound and play the sound to the user.

And the power management chip 908 is used for supplying power and managing power to the hardware connected with the CPU902, the I/O subsystem and the peripheral interfaces.

The call prompting device, the storage medium and the mobile terminal provided in the above embodiments can execute the call prompting method provided in any embodiment of the present application, and have corresponding functional modules and beneficial effects for executing the method. For details of the call prompting method provided in any of the embodiments of the present application, reference may be made to the technical details not described in detail in the above embodiments.

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present application and the technical principles employed. It will be understood by those skilled in the art that the present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims

1. A call prompting method is characterized by comprising the following steps:

2. The method according to claim 1, wherein the identifying the face image appearing in the environment image comprises:

3. The method according to claim 1, wherein the prompting the other party of the call according to the identification result comprises:

4. The method of claim 3,

before the call connection is successful, the corresponding prompt is carried out on the other party of the call according to the identity recognition result, and the prompt comprises the following steps:

5. The method of claim 4, wherein the prompting the call party to send a message corresponding to the identification result comprises:

6. The method of claim 1, wherein detecting that an outgoing call event is triggered or is about to be triggered comprises:

7. The method according to claim 1, wherein in the process of acquiring the environment image through the camera of the mobile terminal, the method further comprises:

and if the front of the mobile terminal is detected to be shielded by the object, stopping the acquisition of the environment image.

8. The method of claim 1, further comprising:

when detecting that an incoming call event is triggered, judging whether a message is received within a preset time range;

if the message is determined to be received, judging whether a sender of the received message is consistent with a caller of the incoming call event or not;

if the two are consistent, then:

9. A call alert device, comprising:

10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a call alerting method as claimed in any one of claims 1 to 8.

11. A mobile terminal comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing a call alerting method as claimed in any one of claims 1-8 when executing the computer program.