CN106778179A - A kind of identity identifying method based on the identification of ultrasonic wave lip reading - Google Patents

Abstract

An identity authentication method based on ultrasonic lip recognition, comprising the following steps: (1) a signal transmitting source sends an ultrasonic signal, and a signal receiving source receives a reflected signal from the mouth; (2) lip language feature extraction is performed on the collected reflected signal , the extracted lip features include a spectrum feature corresponding to a lip event and the user's dynamic lip contour features; (3) identifying and authenticating the user according to the lip features extracted in step (2). The beneficial effects of the present invention are: on the basis of no need for additional hardware customization, the characteristic parameters of identity authentication are obtained by using the ability of ultrasonic sensing, the deployment cost is low, and the application scene of ultrasonic technology in mobile terminals is expanded; the use of users to express the same lip language The difference in behavior habits at the time of the event, combined with biological characteristics, solves the security loopholes in existing technologies such as facial recognition and fingerprint recognition, and can achieve efficient identity authentication.

Description

An identity authentication method based on ultrasonic lip recognition

technical field

The invention relates to the technical field of identity authentication, in particular to an identity authentication method based on ultrasonic lip recognition.

Background technique

In today's information society, accurate identity authentication technology is a necessary prerequisite for system security. Traditional identity authentication technologies are often based on characteristic content (text password, ID card ID) or customized identification and authentication items (ID card, student ID card). However, the former is easy to be copied and stolen by certain technical means, while the latter is often lost and damaged. Therefore, it is necessary to introduce biological feature information and the learning of user behavior habits into the identity authentication system. On the other hand, existing biological feature information, such as facial recognition, fingerprint recognition, and voiceprint recognition, can be recorded by other malicious users by taking pictures, copying fingerprints, recording, etc., which brings security risks to the system.

Contents of the invention

The technical problem to be solved by the present invention is to provide an identity authentication method based on ultrasonic lip recognition, which can solve the security loopholes in the existing facial recognition technology and achieve efficient authentication.

In order to solve the above-mentioned technical problems, the present invention provides an identity authentication method based on ultrasonic lip recognition, comprising the following steps:

(1) The signal transmitting source sends the ultrasonic signal, and the signal receiving source receives the reflected signal from the mouth;

(2) Lip feature extraction is performed on the collected reflection signal, and the extracted lip feature includes a spectrum feature corresponding to a lip event and a user's dynamic lip contour feature;

(3) Identify and authenticate the user according to the lip language features extracted in step (2).

Preferably, in step (2), the extracting method of user's dynamic lip contour feature comprises the steps:

(1) The mobile terminal generates an ultrasonic signal so that the ultrasonic signal covers the user's face;

(2) For a lip event, denoise and filter the ultrasonic signal reflected from the user's face to obtain a mouth reflection signal that only includes the user's mouth movement; a lip event refers to a sentence defined by the user as a password ;

(3) Use the changes of signal frequency and phase caused by the user's mouth movement as the identification fingerprint information.

Preferably, in step (2), the extraction method for a specific lip event expressed by the user comprises the following steps:

(1) Segmenting the reflection signal that only includes the mouth movement, obtaining the segmented signal, and extracting the spectral characteristic parameters of the segmented signal, matching the corresponding voice event;

(2) The speech events corresponding to the segmented signals are jointly learned and mapped to the corresponding lip events.

Preferably, in step (3), the user's identification and authentication include the following steps:

(1) User password information record; Utilize the mobile terminal to record the ultrasonic reflection signal under the influence of a user's lip language event as the identification password;

(2) Spectrum feature matching; when performing user identity authentication, the user repeats the same lip language, and performs identity verification through feature extraction and feature matching of the reflected signal and the recorded signal; extract the spectral features of the signal reflected by the current user's mouth movement, Judging whether it matches the spectrum feature of the lip event in the mobile terminal key, if the spectrum feature does not match, it is an illegal user;

(3) Lip contour feature matching: The lip contours of different users are different. When the spectral features of lip language events match, the user's biological identity authentication needs to be further carried out; by imaging the reflected signal of the mouth, the current The user's dynamic lip profile features are matched with the lip profile features of all users corresponding to the lip event in the user database. If the matching is successful, the authentication is passed, otherwise it is an illegal user.

Preferably, the mobile terminal includes an information collection module and an unlocking control module; wherein the information collection module includes a signal transmitting submodule and a signal receiving submodule; the signal transmitting submodule is a speaker of the mobile terminal, which sends ultrasonic signals; the signal receiving submodule is a mobile terminal The microphone receives the reflected signal from the user's face; the unlocking control module includes an identification sub-module, a matching sub-module and an authentication sub-module; the identification sub-module performs real-time lip language feature extraction and mobile terminal access to the reflected signal obtained by the signal receiving module Key generation; the matching submodule is used to match the lip language feature of the current access user with the information in the user database, and judge whether it matches the preset lip language key of the mobile terminal; the authentication submodule will Exceeding the threshold value is used for identity authentication. If the threshold value is exceeded, the identity authentication of the mobile terminal is passed;

The beneficial effects of the present invention are: on the basis of no need for additional hardware customization, the characteristic parameters of identity authentication are obtained by using the ability of ultrasonic sensing, the deployment cost is low, and the application scene of ultrasonic technology in mobile terminals is expanded; the use of users to express the same lip language The difference in behavior habits at the time of the event, combined with biological characteristics, solves the security loopholes in existing technologies such as facial recognition and fingerprint recognition, and can achieve efficient identity authentication.

Description of drawings

FIG. 1 is an example of an application scenario of the present invention.

Fig. 2 is a schematic diagram of functional modules of the mobile terminal of the present invention.

Fig. 3 is a schematic flow chart of the lip language feature recognition method of the present invention.

Fig. 4 is a schematic flowchart of the identity authentication method of the present invention.

detailed description

As shown in FIG. 1 , it is an example of an application scenario of the present invention. First, after the mobile terminal obtains the access information sent by each user to the mobile terminal, it transfers the key information synchronously transmitted by each user to the user database. The database identifies and matches the key information of all current users, and the user with the highest matching degree If the identity verification is passed, the user is the legal user of the mobile terminal. Other users are illegal users, and the mobile terminal keeps it in a locked state.

As shown in FIG. 2 , it is an overall structural diagram of the mobile terminal of the present invention. The invention provides an identity authentication technology and method for lip recognition based on ultrasonic waves. According to the function, it is divided into two modules: information collection and unlocking control. The information collection module includes a signal transmitting sub-module and a signal receiving sub-module. The signal transmitting sub-module is the speaker of the mobile terminal, which sends ultrasonic signals; the signal receiving sub-module is the microphone of the mobile terminal, which receives the reflected signal from the user's face. The unlocking control module includes an identification submodule, a matching submodule and an authentication submodule. The identification sub-module performs real-time lip language feature extraction and mobile terminal access key generation on the reflection signal acquired by the signal receiving module. The matching sub-module is used to match the lip language feature of the currently visiting user with the information in the user database, and judge whether it matches the preset lip language key of the mobile terminal. The authentication sub-module will perform identity authentication according to whether the degree of matching exceeds a threshold value. If it exceeds the threshold value, the identity authentication of the mobile terminal is passed. If not, the mobile terminal remains in a locked state and is determined to be an illegal user intrusion.

As shown in Figure 3, a method of lip language feature recognition based on the identity authentication technology and method for lip language recognition based on ultrasonic waves, including the following steps:

(1) Denoise and filter the ultrasonic signal reflected from the user's face to obtain a mouth reflection signal that only includes the user's mouth movement.

(2) Using the principle of ultrasonic imaging, according to the different reflection and scattering capabilities of different parts of the mouth to ultrasonic signals, the user's dynamic lip contour feature is constructed as the user's biological feature.

(3) Segment the reflected signal that only contains the mouth movement to obtain the segmented signal, and extract the spectral feature parameters of the segmented signal to match the corresponding speech event.

(4) The speech events corresponding to the segmented signals are jointly learned and mapped to the corresponding lip language content.

As shown in Figure 4, an identity authentication process method for a mobile terminal described in an identity authentication technology and method for lip language recognition based on ultrasonic waves, including the following steps:

(1) The establishment of the user database: the user selects any lip event as the key for mobile terminal identity authentication, and utilizes the lip feature extraction method shown in Figure 3 to train the dynamic lips of the user when telling the lip event Contour features, and corresponding spectral features. Use this to obtain the training set as the key for user authentication.

(2) User identification and authentication: For the identification of accessing mobile terminal users, after obtaining the current user's lip language feature sample set, analyze the matching degree between the current user's sample set and the training set in the lip language information database. The analysis of its matching degree can be subdivided into the following two parts:

(a) Spectrum feature matching: extract the spectrum feature of the signal reflected by the current user’s mouth movement, and judge whether it matches the spectrum feature of the lip event in the mobile terminal key. If the spectrum feature does not match, it is an illegal user, otherwise enter Next step.

(b) Lip contour feature matching: The lip contours of different users are different. When the spectral features of lip language events match, further biological identity authentication of users is required. By imaging the reflected signal of the mouth, the dynamic lip contour features of the current user are obtained, and matched with the lip contour features of all users corresponding to the lip language event in the user database. If the matching is successful, the authentication is passed, otherwise it is an illegal user.

The invention utilizes the user's mouth-shape detection as the user's fingerprint identification, and since no sound is needed, it will not be recorded by an audio recording device, and has good security. Lip event refers to words or sentences, which are pre-set by users. Other users cannot obtain lip event by taking pictures or recording. It can be widely used in mobile phone unlocking, payment application payment password authentication and other fields.

Although the present invention has been illustrated and described in terms of preferred embodiments, those skilled in the art should understand that various changes and modifications can be made to the present invention without departing from the scope defined by the claims of the present invention.

Claims (5)

1. it is a kind of based on ultrasonic wave lip reading identification identity identifying method, it is characterised in that comprise the following steps：

(1) signal emitting-source sends ultrasonic signal, and signal receives source and receives the reflected signal from mouth；

(2) lid speech characteristic extraction is carried out to the reflected signal for gathering, the lid speech characteristic of extraction includes that one section of lip reading event is corresponding Spectrum signature and the dynamic lip outline feature of user；

(3) user is identified and certification according to the lid speech characteristic extracted in step (2).

It is 2. as claimed in claim 1 to be based on the identity identifying method that ultrasonic wave lip reading is recognized, it is characterised in that in step (2), The extracting method of the dynamic lip outline feature of user comprises the following steps：

(1) mobile terminal produces ultrasonic signal so that ultrasonic signal covers the face of user；

(2) for one section of lip reading event, the ultrasonic signal to being reflected from user's face carries out denoising filtering, is only included Mouth reflected signal when user's mouth is moved；One section of lip reading event refers to a word as password of user oneself definition；

(3) change of signal frequency and phase is caused to be turned to recognize finger print information using the motion of user's mouth.

It is 3. as claimed in claim 1 to be based on the identity identifying method that ultrasonic wave lip reading is recognized, it is characterised in that in step (2), Extracting method for one section expressed by user specific lip reading event comprises the following steps：

(1) reflected signal for only including mouth motion is segmented, obtains block signal, and extract the frequency of the block signal Spectrum signature parameter, matches corresponding speech events；

(2) the corresponding speech events of block signal are carried out into combination learning, is mapped to corresponding lip reading event.

It is 4. as claimed in claim 1 to be based on the identity identifying method that ultrasonic wave lip reading is recognized, it is characterised in that in step (3), The identification and authentication of user comprises the following steps：

(1) user password information record；Believed using the ultrasonic reflections under the influence of one section of user's lip reading event of mobile terminal records Number as recognition code；

(2) spectrum signature matching；When authenticating user identification is carried out, user repeats same one section of lip reading, by reflected signal with The feature extraction of tracer signal, characteristic matching carry out authentication；Extract the frequency spectrum of the signal of active user's mouth motor reflex Feature, judges whether to match with the lip reading event spectrum signature in mobile terminal key, and such as spectrum signature is mismatched, then for non- Method user；

(3) lip outline characteristic matching：The lip outline of different user all has differences, when the spectrum signature of lip reading event , it is necessary to further carry out the biology authentication of user during matching；It is imaged by the reflected signal to mouth, builds current using The dynamic lip outline feature at family, the lip outline feature phase of all users corresponding with the customer data base lip reading event Match somebody with somebody, if the match is successful, certification passes through, otherwise be then disabled user.

5. it is as claimed in claim 1 to be based on the identity identifying method that ultrasonic wave lip reading is recognized, it is characterised in that mobile terminal bag Include information acquisition module and conciliate lock control module；Wherein information acquisition module includes that signal launches submodule and signal receives submodule Block；Signal transmitting submodule is the loudspeaker of mobile terminal, sends ultrasonic signal；Signal receiving submodule is mobile terminal Microphone, receives the reflected signal from user's face；Unblock control module includes identification submodule, matched sub-block and recognizes Card submodule；Wherein identification submodule the reflected signal that signal receiving module is obtained is carried out real-time lid speech characteristic extraction and The generation of mobile terminal accessing key；Matched sub-block is used for the letter by the lid speech characteristic of current accessed user and customer data base Breath is matched, and judges whether it matches with the default lip reading key of mobile terminal；Authentication sub module will be according to matching degree Whether authentication is carried out more than threshold value, if exceeding threshold value, the authentication of mobile terminal passes through, if it is not, then institute State mobile terminal and keep lock-out state, be judged to that disabled user swarms into.