[go: up one dir, main page]

CN110363120B - Intelligent terminal touch authentication method and system based on vibration signal - Google Patents

Intelligent terminal touch authentication method and system based on vibration signal Download PDF

Info

Publication number
CN110363120B
CN110363120B CN201910583135.8A CN201910583135A CN110363120B CN 110363120 B CN110363120 B CN 110363120B CN 201910583135 A CN201910583135 A CN 201910583135A CN 110363120 B CN110363120 B CN 110363120B
Authority
CN
China
Prior art keywords
touch
signal
vibration
vibration signal
feature
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201910583135.8A
Other languages
Chinese (zh)
Other versions
CN110363120A (en
Inventor
俞嘉地
徐翔宇
李明禄
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Jiao Tong University
Original Assignee
Shanghai Jiao Tong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Jiao Tong University filed Critical Shanghai Jiao Tong University
Priority to CN201910583135.8A priority Critical patent/CN110363120B/en
Publication of CN110363120A publication Critical patent/CN110363120A/en
Application granted granted Critical
Publication of CN110363120B publication Critical patent/CN110363120B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2218/00Aspects of pattern recognition specially adapted for signal processing
    • G06F2218/08Feature extraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2218/00Aspects of pattern recognition specially adapted for signal processing
    • G06F2218/12Classification; Matching

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Evolutionary Computation (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Biophysics (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)
  • Collating Specific Patterns (AREA)

Abstract

When the intelligent terminal detects finger touch, a specific vibration signal is actively generated, the vibration signal is collected through an IMU sensor, and biological characteristics, behavior characteristics and independent touch behavior characteristics are respectively extracted from the received vibration signal; then, a neural network based on a twin network (simple network) architecture is adopted to classify the biological characteristics, and behavior-independent intelligent terminal touch authentication is realized. The invention utilizes the intelligent terminal to actively send out the vibration signal and capture the biological characteristics of the touch finger so as to identify different users, and the method can not depend on the behavior characteristics of the touch.

Description

基于振动信号的智能终端触碰认证方法及系统Smart terminal touch authentication method and system based on vibration signal

技术领域technical field

本发明涉及的是一种用户认证领域的技术,具体是一种基于振动信号的与行为无关的智能终端触碰认证方法及系统。The invention relates to a technology in the field of user authentication, in particular to a behavior-independent smart terminal touch authentication method and system based on vibration signals.

背景技术Background technique

近年来,随着智能移动终端的不断发展,存储在智能移动终端设备,尤其是智能终端中的隐私和敏感数据不断增加,导致了隐私和数据泄露的巨大隐患。因此,安全且有效的智能终端用户认证系统,已经成为当前的研究热点。In recent years, with the continuous development of smart mobile terminals, the private and sensitive data stored in smart mobile terminal devices, especially smart terminals, have been increasing, resulting in huge hidden dangers of privacy and data leakage. Therefore, a safe and effective intelligent end-user authentication system has become a current research hotspot.

现有的工作主要分为三类,第一类工作是基于密码的智能终端用户认证系统,主要包括数字密码,手势密码和图形密码等。这一类用户认证系统的共性问题是容易受到窥视,存在较大的安全隐患;第二类工作是基于用户的某些外在的生物特征,主要包括指纹、人脸识别、虹膜识别、声纹识别等。这类工作的共性问题是往往需要额外设备和对环境敏感(湿度、光照、噪声等),并且容易受到重放攻击(replay attack);第三类工作是利用手指触碰屏幕的行为特征进行用户认证,主要包括触碰位置、触碰力度、触碰时间等。这类工作的共性问题是容易受到模仿攻击(mimic attack),并且用户体验较差。The existing work is mainly divided into three categories. The first category of work is a password-based intelligent terminal user authentication system, which mainly includes digital passwords, gesture passwords and graphic passwords. The common problem of this type of user authentication system is that it is easy to be peeped, and there are great security risks; the second type of work is based on some external biometric features of users, mainly including fingerprints, face recognition, iris recognition, voiceprint identification etc. The common problems of this type of work are that it often requires additional equipment and is sensitive to the environment (humidity, light, noise, etc.), and is vulnerable to replay attacks; the third type of work is to use the behavioral characteristics of fingers to touch the screen. Authentication mainly includes touch position, touch strength, touch time, etc. The common problem of this kind of work is that it is vulnerable to mimic attack and has poor user experience.

发明内容SUMMARY OF THE INVENTION

本发明针对现有技术存在的上述不足,提出一种基于振动信号的智能终端触碰认证方法及系统,利用智能终端主动发出振动信号,捕捉触碰手指的生物特征,以识别不同的用户,能够不依赖于触碰的行为特征(如接触位置、力度、持续时间等)。Aiming at the above-mentioned deficiencies in the prior art, the present invention proposes a method and system for smart terminal touch authentication based on vibration signals, which utilizes the smart terminal to actively send out vibration signals to capture the biometric features of the touching fingers to identify different users, thereby enabling the identification of different users. Behavioural characteristics that do not depend on touch (e.g. touch location, strength, duration, etc.).

本发明是通过以下技术方案实现的:The present invention is achieved through the following technical solutions:

本发明涉及一种基于振动信号的智能终端触碰认证方法,当智能终端检测到手指触摸时,通过主动产生特定振动信号并通过IMU传感器收集振动信号,并从中分别提取出生物特征、行为特征以及独立的触碰行为特征;然后采用基于孪生网络(siamese network)架构的神经网络对生物特征进行分类,实现行为无关的智能终端触碰认证。The invention relates to a touch authentication method for an intelligent terminal based on a vibration signal. When the intelligent terminal detects a finger touch, it actively generates a specific vibration signal and collects the vibration signal through an IMU sensor, and extracts biological features, behavioral features and Independent touch behavior features; then use a neural network based on a siamese network architecture to classify biometric features to achieve behavior-independent touch authentication for smart terminals.

所述的特定振动信号通过调节开关信号产生,其每个循环周期包括振动冲激信号、马达激活信号和余振消除部分。The specific vibration signal is generated by adjusting the switch signal, and each cycle includes a vibration impulse signal, a motor activation signal and a residual vibration elimination part.

所述的收集振动信号,优选先将收到的振动信号分割为暂态振动阶段、稳定振动阶段和衰退阶段。When collecting the vibration signal, preferably, the received vibration signal is firstly divided into a transient vibration stage, a stable vibration stage and a decay stage.

所述的提取,包括基于小波变化的特征提取、基于倒谱变换的特征提取、触碰位置特征提取、触碰力度特征提取,具体为:从暂态振动阶段提取得到小波变换后得到的时频谱、从稳定振动阶段提取倒谱、从移动终端的麦克风提取音频信号的峰值及其对应时间作为触碰位置特征、提取振动信号在共振频率附近的能量值

Figure GDA0002155778100000021
作为触碰力度特征,其中:fr为振动信号的共振频率,Δf定义了能量计算带宽,f(t)是原始信号,在中对应暂态振动阶段的振动信号。The extraction includes feature extraction based on wavelet change, feature extraction based on cepstral transformation, touch location feature extraction, and touch strength feature extraction, specifically: extracting the time spectrum obtained after wavelet transformation from the transient vibration stage. , Extract the cepstrum from the stable vibration stage, extract the peak value of the audio signal and its corresponding time from the microphone of the mobile terminal as the touch position feature, and extract the energy value of the vibration signal near the resonance frequency
Figure GDA0002155778100000021
As the touch strength feature, where: f r is the resonance frequency of the vibration signal, Δf defines the energy calculation bandwidth, and f(t) is the original signal, which corresponds to the vibration signal in the transient vibration stage.

所述的触碰行为特征具体是指:用户在使用智能终端时,手指与智能终端的接触,包括与智能设备的正面、侧面以及后面的接触时的行为特征,包括触碰位置和触碰力度特征。The touch behavior characteristics specifically refer to: when the user uses the intelligent terminal, the contact between the user's finger and the intelligent terminal includes the behavior characteristics of the contact with the front, side and back of the intelligent device, including the touch position and the touch strength. feature.

所述的基于孪生网络架构的神经网络,包括两个平行的子网络,每个子网络具有相同的结构和权值并分别根据输入的振动信号中提取的特征值X1,X2经过子网络后得到对应的特征表示CW(X1),CW(X2),进而得到两个特征表示的距离:DW(X1,X2)=||Cw(X1)-Cw(X2)||。The neural network based on the twin network architecture includes two parallel sub-networks, each sub-network has the same structure and weights, and respectively according to the eigenvalues X 1 , X 2 extracted from the input vibration signal after passing through the sub-networks. Obtain the corresponding feature representations C W (X 1 ), C W (X 2 ), and then obtain the distance between the two feature representations: D W (X 1 , X 2 )=||C w (X 1 )-C w ( X 2 )||.

所述的子网络为时延神经网络(TDNN)的结构,包含两个卷积层和一个全连接层。每个卷积层内为一个基本卷积模块作为核心,一个批标准化(BN)层处理梯度问题和一个ReLU层作为激活函数。The sub-network is a time-delayed neural network (TDNN) structure, including two convolutional layers and a fully connected layer. Within each convolutional layer is a basic convolutional module as the core, a batch normalization (BN) layer to handle the gradient problem and a ReLU layer as the activation function.

所述的神经网络的训练样本具有同样的标签,即来自同一个用户且触碰行为特征不相似,即触碰行为特征相似度低于阈值。The training samples of the neural network have the same label, that is, come from the same user and the touch behavior characteristics are not similar, that is, the similarity of the touch behavior characteristics is lower than the threshold.

所述的触碰行为特征相似度由皮尔逊相关系数衡量:The touch behavior feature similarity is measured by the Pearson correlation coefficient:

Figure GDA0002155778100000022
Figure GDA0002155778100000023
大于预设阈值h,则认为两个样本具有相似的触碰行为特征,否则认为二者的触碰行为特征不相似。
Figure GDA0002155778100000022
when
Figure GDA0002155778100000023
If it is greater than the preset threshold h, it is considered that the two samples have similar touch behavior characteristics; otherwise, the two samples are considered to have dissimilar touch behavior characteristics.

所述的分类是指:根据神经网络得到的两个输入对应的特征表示的距离,判断两个输入是否属于统一用户,进而实现触碰行为是否来自于已注册用户的判断。The classification refers to: judging whether the two inputs belong to a unified user according to the distance represented by the features corresponding to the two inputs obtained by the neural network, so as to realize the judgment of whether the touch behavior comes from a registered user.

技术效果technical effect

与现有技术相比,本发明通过构建基于智能移动终端的与行为无关的触碰认证系统,在不依赖于任何外部设备,实现准确的用户认证。在系统构建过程中,本发明结合智能移动终端的富传感器性和易开发性,利用智能移动终端上的振动马达和IMU传感器,综合了振动信号处理的有关技术和孪生神经网络的相关知识,最终实现了一个鲁棒性好且精度高的触碰认证系统,能够有效抵御重放攻击(replay attack)和模仿攻击(mimic attack),且对用户的触碰方式没有任何要求,极大提高了用户体验度。Compared with the prior art, the present invention realizes accurate user authentication without relying on any external device by constructing a behavior-independent touch authentication system based on an intelligent mobile terminal. In the system construction process, the present invention combines the sensor-richness and easy development of the intelligent mobile terminal, utilizes the vibration motor and the IMU sensor on the intelligent mobile terminal, and integrates the relevant technology of vibration signal processing and the relevant knowledge of the twin neural network, and finally A touch authentication system with good robustness and high precision is realized, which can effectively resist replay attack and mimic attack, and has no requirements on the user's touch method, which greatly improves the user's ability to touch. experience.

附图说明Description of drawings

图1为人手和手机的不同触碰方式示意图;Figure 1 is a schematic diagram of different touching methods of human hands and mobile phones;

图2为本发明的系统结构图;Fig. 2 is the system structure diagram of the present invention;

图3为振动信号设计示意图;Fig. 3 is a schematic diagram of vibration signal design;

图4为振动信号分割示意图;4 is a schematic diagram of vibration signal segmentation;

图5为振动信号小波变换三维示意图;Fig. 5 is a three-dimensional schematic diagram of wavelet transform of vibration signal;

图6为振动信号倒谱变换三维示意图;Fig. 6 is a three-dimensional schematic diagram of cepstral transformation of vibration signal;

图7为触碰位置特征提取示意图;7 is a schematic diagram of touch position feature extraction;

图8为触碰力度特征提取示意图;8 is a schematic diagram of touch force feature extraction;

图9为孪生网络训练数据挑选策略示意图;Fig. 9 is a schematic diagram of the selection strategy of twin network training data;

图10为本发明的孪生网络模型结构图;Fig. 10 is the twin network model structure diagram of the present invention;

图11为用户认证准确率的混淆矩阵图;Figure 11 is a confusion matrix diagram of user authentication accuracy;

图12为不同环境下模仿攻击的成功率图;Figure 12 shows the success rate of imitation attacks in different environments;

图13为不同环境下重放攻击的成功率图。Figure 13 shows the success rate of replay attacks in different environments.

具体实施方式Detailed ways

如图1所示,为人手触碰智能终端有着不同的方式,故希望通过捕捉与智能终端接触的手指的生物特征,能够在各种不同的触碰方式下,对触碰的用户进行认证识别,即实现行为无关的触碰用户认证。为了实现这一点,使用智能终端上的振动马达主动和IMU传感器,通过分析手指触碰对主动传播的振动信号的影响,从而捕获与智能终端接触的手指的生物特征。As shown in Figure 1, there are different ways for human hands to touch the smart terminal. Therefore, it is hoped that by capturing the biometric features of the finger that is in contact with the smart terminal, it is possible to authenticate and identify the touched user under various touch methods. , which implements behavior-independent touch user authentication. To achieve this, the biometrics of the fingers in contact with the smart terminal are captured by analyzing the effect of finger touch on the actively propagated vibration signal using the vibration motor active and IMU sensors on the smart terminal.

本实施例包括分为注册和登录两个阶段:This embodiment includes two stages of registration and login:

A注册阶段:当用户触摸智能手机时,首先通过利用智能终端上自带的震动马达主动产生特定的振动信号,并同时通过IMU传感器收集振动信号。在收集信号然后,它进一步经过校准和分割的处理,得到包含用户信息的信号片段。基于这些信号片段,分别提取信号特征(混合生物特征和行为特征)和独立的触碰行为特征。然后基于提取的信号特征和行为特征,通过基于孪生网络(siamese network)的神经网络架构和对应的训练样本选择策略来削弱触碰行为特征对提取出的信号特征的影响,并进一步训练与行为无关的触碰用户认证分类器模型。A registration stage: When the user touches the smartphone, it first actively generates a specific vibration signal by using the vibration motor built into the smart terminal, and at the same time collects the vibration signal through the IMU sensor. After the signal is collected, it is further processed for calibration and segmentation to obtain signal segments containing user information. Based on these signal fragments, signal features (hybrid biometric and behavioral features) and independent touch behavioral features are extracted, respectively. Then, based on the extracted signal features and behavioral features, the influence of the touch behavioral features on the extracted signal features is weakened through the neural network architecture based on the siamese network and the corresponding training sample selection strategy, and further training has nothing to do with the behavior. The touch user authentication classifier model.

B登录阶段:首先捕获手指触碰的动作并主动发送和接收特定的振动信号,然后按照注册阶段的方式提取振动信号的信号特征,利用提取的信号特征和注册阶段获得的分类器模型,即可对于触碰者进行身份认证。该登录阶段对于手指触碰的方式没有要求。B login stage: first capture the finger touch action and actively send and receive specific vibration signals, then extract the signal features of the vibration signal in the way of the registration stage, and use the extracted signal features and the classifier model obtained in the registration stage to get Authenticate the touch. This login phase has no requirements for finger touch.

如图2所示,本实施例涉及一种实现上述方法的系统,包括:振动信号处理模块、信号特征提取模块、行为无关分类器以及认证模块,其中:振动信号处理模块与信号特征提取模块相连并传输经过预处理的振动信号信息,信号特征提取模块与行为无关分类器相连并传输从经过预处理的振动信号中提取的信号特征及行为特征信息,行为无关分类器与认证模块相连并传输经过训练的分类器模型信息,认证模块接收认证阶段提取的信号特征相连并传输至经过训练的分类器模型得到登陆者的认证结果。As shown in FIG. 2 , this embodiment relates to a system for implementing the above method, including: a vibration signal processing module, a signal feature extraction module, a behavior-independent classifier, and an authentication module, wherein: the vibration signal processing module is connected to the signal feature extraction module And transmit the preprocessed vibration signal information, the signal feature extraction module is connected with the behavior independent classifier and transmits the signal features and behavior feature information extracted from the preprocessed vibration signal, the behavior independent classifier is connected with the authentication module and transmitted through The information of the trained classifier model, the authentication module receives the signal features extracted in the authentication phase, connects and transmits it to the trained classifier model to obtain the authentication result of the registrant.

如图3所示,所述的特定振动信号通过调节开关信号产生,具体为:首先产生一个极短的振动冲激信号(<0.1ms),并停顿约10ms用来做信号对齐和后续的触碰定位,然后激活振动马达90ms使之经由暂态振动阶段达到稳定振动阶段,然后停止10ms来消除余振,通过激活和停止持续5次形成500ms的振动信号,由于持续时间短,这样的振动信号几乎无损用户体验。As shown in Figure 3, the specific vibration signal is generated by adjusting the switch signal, specifically: firstly generate a very short vibration impulse signal (<0.1ms), and pause for about 10ms for signal alignment and subsequent touch Touch the position, then activate the vibration motor for 90ms to make it reach the stable vibration stage through the transient vibration stage, and then stop for 10ms to eliminate the residual vibration, and form a 500ms vibration signal by activating and stopping 5 times. Due to the short duration, such a vibration signal Almost no loss of user experience.

所述的收集振动信号,即利用IMU传感器进行接收,优选在发送端和接收端进行时间上的对齐。由于振动信号在智能终端里的传输速度一般大于2000m/s,仅需要不到0.05ms即可传遍一个普通大小的智能终端。而IMU传感器的采样频率往往不到1000Hz,对应1ms的时间解析度,远大于振动信号的传输时间,因此将IMU传感器接收到振动信号的采样点所对应的时间认为是振动信号的发送时间,从而完成信号对齐。The collection of vibration signals, that is, using the IMU sensor to receive, preferably performs time alignment at the sending end and the receiving end. Since the transmission speed of the vibration signal in the smart terminal is generally greater than 2000m/s, it only takes less than 0.05ms to spread through a normal-sized smart terminal. The sampling frequency of the IMU sensor is often less than 1000Hz, corresponding to a time resolution of 1ms, which is much greater than the transmission time of the vibration signal. Therefore, the time corresponding to the sampling point of the vibration signal received by the IMU sensor is considered as the transmission time of the vibration signal, so Complete signal alignment.

所述的收集振动信号,为了利用振动信号不同阶段所包含的信息,将接收到的振动信号进行如图4所示的分割,具体包括:For the collection of vibration signals, in order to utilize the information contained in different stages of the vibration signals, the received vibration signals are divided as shown in Figure 4, including:

1)基于发送信号的信息和信号对齐,将信号分为90ms的振动阶段(图4中A+B阶段)和10ms的衰退阶段(图4中C阶段)。1) Based on the information and signal alignment of the transmitted signal, the signal is divided into a 90ms vibration phase (A+B phase in Figure 4) and a 10ms decay phase (C phase in Figure 4).

2)利用振动信号频率变化的方差作为阈值,进一步区分振动信号的暂态振动阶段(图4中A阶段)和稳定振动阶段(图4中B阶段)。即当振动信号频率变化的方差大于阈值h时,认为处于暂态振动阶段,当振动信号频率变化的方差小于阈值h时,认为处于稳定振动阶段。2) Using the variance of the frequency change of the vibration signal as the threshold, further distinguish the transient vibration stage (stage A in Figure 4) and the stable vibration stage (stage B in Figure 4) of the vibration signal. That is, when the variance of the frequency change of the vibration signal is greater than the threshold h, it is considered to be in the transient vibration stage, and when the variance of the vibration signal frequency change is less than the threshold h, it is considered to be in the stable vibration stage.

所述的提取,包括基于小波变化的特征提取、基于倒谱变换的特征提取、触碰位置特征、触碰力度特征提取,具体步骤包括:The extraction includes feature extraction based on wavelet change, feature extraction based on cepstral transformation, touch location feature, and touch strength feature extraction, and the specific steps include:

1)从接收信号的暂态振动阶段提取特征,由于在暂态振动阶段,振动信号的频率不断变化,需要对原始振动信号进行变换,使之同时获得良好的时域和频域解析度。因此,利用连续小波变换(CWT)对暂态振动阶段的振动信号进行变换:1) Extract features from the transient vibration phase of the received signal. Since the frequency of the vibration signal is constantly changing during the transient vibration phase, the original vibration signal needs to be transformed to obtain good time and frequency domain resolutions at the same time. Therefore, the continuous wavelet transform (CWT) is used to transform the vibration signal in the transient vibration stage:

Figure GDA0002155778100000041
其中:CWTf(a,τ)是获得的时频谱;f(t)是原始信号,在中对应暂态振动阶段的振动信号;ψa,τ(t)是小波基函数,选择Morlet函数作为小波基函数以达到更好的时域和频域解析度,将小波变换后得到的时频谱作为暂态振动阶段的信号特征。
Figure GDA0002155778100000041
Among them: CWT f (a,τ) is the obtained time spectrum; f(t) is the original signal, corresponding to the vibration signal in the transient vibration stage; ψ a,τ (t) is the wavelet basis function, and the Morlet function is selected as The wavelet basis function is used to achieve better resolution in the time and frequency domains, and the time spectrum obtained after wavelet transformation is used as the signal characteristic of the transient vibration stage.

如图5所示,为一段暂态振动信号进行小波变化后的三维时频谱图,可以看出其时域和频域解析度都很高,显示了振动频率随时间变化的细节,也隐含了触碰手指对振动信号影响的细节。As shown in Figure 5, it is a three-dimensional time-spectrogram of a transient vibration signal after wavelet change. It can be seen that its resolution in the time domain and frequency domain is very high, showing the details of the change of vibration frequency with time, and also implicitly Details of the impact of touching your finger on the vibration signal.

2)基于倒谱变换的特征提取:同时从接收信号的稳定振动阶段提取特征,在稳定振动阶段,振动信号稳定在共振频率上,掩盖了其他相对较弱的频率成分,即边频带(side-band frequencies),而触碰手指对稳定振动阶段的影响往往反映在边频带上。因此,为了展示边频带的频率成分,利用倒谱变换获取稳定振动阶段信号中包含边频带在内的各种频率成分:Cy(q)=F-1(log Sy(f(t))),其中:Cy(q)为获得的倒谱;Sy(f(t))为信号的功率谱密度(PSD);F-1对应逆傅里叶变换(IFFT),将得到的倒谱作为稳定振动阶段的信号特征。2) Feature extraction based on cepstral transformation: At the same time, features are extracted from the stable vibration stage of the received signal. In the stable vibration stage, the vibration signal is stabilized at the resonant frequency, masking other relatively weak frequency components, that is, the side-band (side-band). band frequencies), while the effect of touching a finger on the stable vibration phase is often reflected in the sidebands. Therefore, in order to show the frequency components of the sidebands, the cepstral transformation is used to obtain various frequency components including the sidebands in the stable vibration phase signal: C y (q)=F -1 (log S y (f(t)) ), where: C y (q) is the obtained cepstrum; S y (f(t)) is the power spectral density (PSD) of the signal; F -1 corresponds to the inverse Fourier transform (IFFT), and the obtained inverse Spectrum as a signal characteristic of the stable vibration phase.

如图6所示,为对应于两个不同用户触碰的振动信号的倒谱,可以看出两个用户在倒谱上展现出完全不同的特征。As shown in FIG. 6 , for the cepstrum corresponding to the vibration signals touched by two different users, it can be seen that the two users exhibit completely different characteristics on the cepstrum.

3)触碰位置特征:为了获取用户的触碰位置信息,使用信号的到达时间(ToA)进行测量。由于振动信号的传输速度太快(>200m/s)而IMU的采样频率太低(<1000Hz),使用智能终端上的麦克风来捕捉与振动信号同时产生的声波信号来提取触碰位置特征,具体如图7所示,振动信号主要经由三条路径到达麦克风,第一条是通过手机内部振动传输,第二条是通过空气中的声波直线传输,第三条是通过触碰手指的反射传播。由于不同路径传播速度的距离不同,发送振动信号的冲激阶段(<0.1ms)在麦克风接收信号上会形成多个不同的峰值(如图7所示)。最先出现的峰值(峰值A)对应手机内部振动传输的路径,第二个峰值(峰值B)对应通过空气中的声波直线传输的路径,第三个峰值(峰值C)对应通过触碰手指的反射传播的路径。因此,通过这些峰值对应的时间,即可计算对应路径的长度,反应触碰位置的特征。因此,提取麦克风接收信号中的峰值和对应时间,作为触碰位置特征。3) Touch position feature: In order to obtain the user's touch position information, the time of arrival (ToA) of the signal is used for measurement. Since the transmission speed of the vibration signal is too fast (>200m/s) and the sampling frequency of the IMU is too low (<1000Hz), the microphone on the smart terminal is used to capture the sound wave signal generated at the same time as the vibration signal to extract the touch position feature. As shown in Figure 7, the vibration signal mainly reaches the microphone through three paths, the first is transmitted through the internal vibration of the mobile phone, the second is transmitted in a straight line through the sound wave in the air, and the third is transmitted through the reflection of the touching finger. Due to the different distances of propagation speed of different paths, the impulse phase (<0.1ms) of the transmitted vibration signal will form multiple different peaks on the received signal of the microphone (as shown in Figure 7). The first peak (peak A) corresponds to the path of vibration transmission inside the mobile phone, the second peak (peak B) corresponds to the straight transmission path of sound waves in the air, and the third peak (peak C) corresponds to the vibration transmitted by touching the finger. The path the reflection propagates. Therefore, through the time corresponding to these peaks, the length of the corresponding path can be calculated, reflecting the characteristics of the touch position. Therefore, the peak value and corresponding time in the received signal of the microphone are extracted as the touch position feature.

4)触碰力度特征提取:为了获取用户的触碰力度信息,利用振动信号的能量变化进行测量。为了避免干扰,计算振动信号在共振频率附近的能量值

Figure GDA0002155778100000051
其中:fr为振动信号的共振频率,Δf定义了能量计算带宽,在中设为5Hz。4) Touch strength feature extraction: In order to obtain the user's touch strength information, the energy change of the vibration signal is used to measure. To avoid interference, calculate the energy value of the vibration signal around the resonance frequency
Figure GDA0002155778100000051
Where: f r is the resonance frequency of the vibration signal, Δf defines the energy calculation bandwidth, and is set to 5Hz in .

如图8所示,为不同触碰力度下能量值E的变化情况,可以看出触碰力度越大,能量值E约小,呈现明显的对应关系。因此,提取振动信号在共振频率附近的能量值E,作为触碰力度特征。As shown in FIG. 8, it is the change of the energy value E under different touch strengths. It can be seen that the greater the touch strength, the smaller the energy value E, showing an obvious corresponding relationship. Therefore, the energy value E of the vibration signal near the resonance frequency is extracted as the touch strength feature.

所述的行为无关分类器,即基于孪生网络(siamese network)架构的神经网络,具体为训练过程中需要成对的训练样本的孪生网络,对于每一个训练样本(包含信号特征,用户标签和触碰行为特征),使用用户标签和触碰行为特征作为参考进行训练样本挑选,具体如图9中表格所示,对于有着同样的标签(来自同一个用户)的一组训练样本,当且仅当他们的触碰行为特征不相似时,将他们选作训练样本。类似地,对于有着不同标签(来自两个不同用户)的一组训练样本,且仅当他们的触碰行为特征相似时,将他们选作训练样本。两个样本x1,x2的触碰行为特征相似度由皮尔逊相关系数衡量:

Figure GDA0002155778100000061
Figure GDA0002155778100000062
大于预先设定的阈值h,则认为两个样本具有相似的触碰行为特征,否则认为二者的触碰行为特征不相似。从而迫使分类器不依赖于触碰行为特征完成分类,从而使得孪生网络能够从信号特征(混合生物特征和触碰行为特征)中进一步提取与触碰行为无关的生物特征。The behavior-independent classifier is a neural network based on a siamese network architecture, specifically a siamese network that requires paired training samples in the training process. touch behavior feature), using the user label and touch behavior feature as a reference to select training samples, as shown in the table in Figure 9, for a set of training samples with the same label (from the same user), if and only if When their touch behavior characteristics are not similar, they are selected as training samples. Similarly, for a set of training samples with different labels (from two different users), and only if their touch behavior characteristics are similar, they are selected as training samples. The similarity of the touch behavior characteristics of the two samples x 1 , x 2 is measured by the Pearson correlation coefficient:
Figure GDA0002155778100000061
when
Figure GDA0002155778100000062
If it is greater than the preset threshold h, it is considered that the two samples have similar touch behavior characteristics; otherwise, the two samples are considered to have dissimilar touch behavior characteristics. Therefore, the classifier is forced to complete the classification without relying on the touch behavior features, so that the Siamese network can further extract the biological features unrelated to the touch behavior from the signal features (mixed biological features and touch behavior features).

所述的孪生网络如图10所示,包括两个平行的子网络,每个子网络具有相同的结构和权值并分别根据输入的振动信号中提取的特征值X1,X2经过子网络后得到对应的特征表示CW(X1),CW(X2),进而得到两个特征表示的距离:DW(X1,X2)=||Cw(X1)-Cw(X2)||。The described Siamese network is shown in Figure 10, including two parallel sub-networks, each sub-network has the same structure and weights, and respectively according to the eigenvalues X 1 , X 2 extracted from the input vibration signal after passing through the sub-networks. Obtain the corresponding feature representations C W (X 1 ), C W (X 2 ), and then obtain the distance between the two feature representations: D W (X 1 , X 2 )=||C w (X 1 )-C w ( X 2 )||.

本实施例涉及一种应用场景:选取SAMSUNG Galaxy S6,SAMSUNG Galaxy S7,Google Pixel,HTC U Ultra和Huawei Mate8作为描述的触碰认证系统的原型机给15位不同的志愿者进行使用,以评估的实际效果。实验过程在三种不同环境下进行,即实验室环境(lab),商场环境(mall)和酒吧环境(bar),且对不同类型的触碰进行研究,包括掌外触碰(Off-Hand)和掌中触碰(In-Hand)。This embodiment involves an application scenario: SAMSUNG Galaxy S6, SAMSUNG Galaxy S7, Google Pixel, HTC U Ultra and Huawei Mate8 are selected as prototypes of the described touch authentication system for 15 different volunteers to use to evaluate the actual effect. The experimental process was carried out in three different environments, namely laboratory environment (lab), shopping mall environment (mall) and bar environment (bar), and different types of touch were studied, including off-hand touch (Off-Hand) and In-Hand.

本实施例具体包括以下步骤:This embodiment specifically includes the following steps:

步骤一、全部15位志愿者中10位注册进入系统成为合法用户,另外5位作为攻击者尝试通过随机触碰的方式进入系统。Step 1. 10 of the 15 volunteers registered to enter the system to become legitimate users, and the other 5 as attackers tried to enter the system by random touch.

步骤二、5位攻击者尝试使用模仿(mimic)攻击进入系统。Step 2. Five attackers try to use a mimic attack to enter the system.

步骤三、5位攻击者尝试使用重放(replay)攻击进入系统。Step 3. Five attackers try to use a replay attack to enter the system.

最主要的评估指标有三个:There are three main evaluation indicators:

用户认证的准确率(Accuracy),即对于不同用户认证成功的概率。Accuracy of user authentication, that is, the probability of successful authentication for different users.

描述用户体验的错误拒绝率(False Reject Rate),即将注册用户错误认证为非注册用户并致使无法进入系统的概率。Describes the False Reject Rate of the user experience, that is, the probability that a registered user is incorrectly authenticated as a non-registered user and cannot enter the system.

描述攻击成功率的错误接受率(False Accept Rate),即攻击者在未注册的情况下成功计入系统的概率。False Accept Rate, which describes the attack success rate, i.e. the probability that an attacker is successfully counted into the system without registering.

评估结果如下表所示,针对15名参与实验的志愿者,显示了认证不同用户的准确率。从图中可以看出,对于注册用户之间的识别,能够达到92.3%,对于潜在非注册用户的识别则能够达到98.7%,表明所提出的触碰认证系统能够安全有效地完成用户认证工作。The evaluation results are shown in the table below. For 15 volunteers participating in the experiment, the accuracy of authenticating different users is shown. It can be seen from the figure that the identification between registered users can reach 92.3%, and the identification of potential non-registered users can reach 98.7%, indicating that the proposed touch authentication system can complete user authentication safely and effectively.

Figure GDA0002155778100000071
Figure GDA0002155778100000071

如图11所示,针对三种不同的环境,对比显示了和现有两种常见的商用智能手机认证系统(支付宝的人脸认证系统和微信的语音锁认证系统)的错误拒绝率。可以看出,支付宝的人脸认证系统在光照条件差时(酒吧环境)难以正确认证注册用户,而微信的语音锁认证系统在环境噪声较大时(商场环境和酒吧环境)有着较高的错误拒绝率。而提出的触碰认证系统在各种环境下均保持较低的错误拒绝率,大大提高了用户体验度。As shown in Figure 11, for three different environments, the false rejection rate is compared with the existing two common commercial smartphone authentication systems (Alipay's face authentication system and WeChat's voice lock authentication system). It can be seen that Alipay's face authentication system is difficult to correctly authenticate registered users when the lighting conditions are poor (bar environment), while WeChat's voice lock authentication system has higher errors when the ambient noise is high (shopping mall environment and bar environment). rejection rate. The proposed touch authentication system maintains a low false rejection rate in various environments, which greatly improves the user experience.

如图12所示,针对不同环境和不同的触碰方式,显示了系统对模仿攻击的错误接受率。可以看出,在各种环境和触碰方式下,提出的系统均能够有效抵御模仿攻击,错误接受率保持在2%以下。图13显示了不同环境和不同的触碰方式下,系统对重放攻击的错误接受率。虽然错误接受率整体略高于模仿攻击,但仍保持在可接受的范围内,即5%以下。结果表明提出的系统能够有效抵御重放攻击。As shown in Figure 12, for different environments and different touch methods, the false acceptance rate of the system against imitation attacks is shown. It can be seen that under various environments and touch methods, the proposed system can effectively resist imitation attacks, and the false acceptance rate remains below 2%. Figure 13 shows the false acceptance rate of the system against replay attacks under different environments and different touch methods. While the false acceptance rate is slightly higher than imitation attacks overall, it remains within an acceptable range, i.e. under 5%. The results show that the proposed system can effectively resist replay attacks.

上述具体实施可由本领域技术人员在不背离原理和宗旨的前提下以不同的方式对其进行局部调整,的保护范围以权利要求书为准且不由上述具体实施所限,在其范围内的各个实现方案均受之约束。The above-mentioned specific implementation can be partially adjusted in different ways by those skilled in the art without departing from the principle and purpose. The protection scope is subject to the claims and is not limited by the above-mentioned specific implementation. Implementation plans are subject to constraints.

Claims (8)

1.一种基于振动信号的智能终端触碰认证方法,其特征在于,当智能终端检测到手指触摸时,通过主动产生特定振动信号并通过IMU传感器收集振动信号,并从中分别提取出生物特征、行为特征以及独立的触碰行为特征;然后采用基于孪生网络架构的神经网络对生物特征进行分类,实现行为无关的智能终端触碰认证;1. a kind of intelligent terminal touch authentication method based on vibration signal, it is characterized in that, when intelligent terminal detects finger touch, by actively generating specific vibration signal and collecting vibration signal by IMU sensor, and extract biological feature, Behavior characteristics and independent touch behavior characteristics; then use the neural network based on the twin network architecture to classify biological characteristics to realize behavior-independent smart terminal touch authentication; 所述的特定振动信号通过调节开关信号产生,其每个循环周期包括振动冲激信号、马达激活信号和余振消除部分;The specific vibration signal is generated by adjusting the switch signal, and each cycle includes a vibration impulse signal, a motor activation signal and a residual vibration elimination part; 所述的触碰行为特征具体是指:用户在使用智能终端时,手指与智能终端的接触,包括与智能设备的正面、侧面以及后面的接触时的行为特征,包括触碰位置和触碰力度特征;The touch behavior characteristics specifically refer to: when the user uses the intelligent terminal, the contact between the user's finger and the intelligent terminal includes the behavior characteristics of the contact with the front, side and back of the intelligent device, including the touch position and the touch strength. feature; 所述的基于孪生网络架构的神经网络,具体为训练过程中需要成对的训练样本的孪生网络,对于每一个训练样本,使用用户标签和触碰行为特征作为参考进行训练样本挑选,对于有着同样的标签的一组训练样本,当且仅当它们的触碰行为特征不相似时,将它们选作训练样本;对于有着不同标签的一组训练样本,且仅当它们的触碰行为特征相似时,将它们选作训练样本;The neural network based on the Siamese network architecture is specifically a Siamese network that requires paired training samples in the training process. A set of training samples with different labels, if and only if their touch behavior characteristics are not similar, they are selected as training samples; for a set of training samples with different labels, and only if their touch behavior characteristics are similar , select them as training samples; 两个样本x,y的触碰行为特征相似度由皮尔逊相关系数衡量:
Figure FDA0002478227430000011
其中:
Figure FDA0002478227430000012
Figure FDA0002478227430000013
分别为向量为x和y中元素的平均值,每个向量包含n个元素,当rx,y大于预先设定的阈值h,则认为两个样本具有相似的触碰行为特征,否则认为二者的触碰行为特征不相似,从而迫使分类器不依赖于触碰行为特征完成分类,从而使得孪生网络能够从信号特征中进一步提取与触碰行为无关的生物特征。
The similarity of the touch behavior characteristics of the two samples x, y is measured by the Pearson correlation coefficient:
Figure FDA0002478227430000011
in:
Figure FDA0002478227430000012
and
Figure FDA0002478227430000013
The vectors are the average value of the elements in x and y respectively, and each vector contains n elements. When r x and y are greater than the preset threshold h, the two samples are considered to have similar touch behavior characteristics, otherwise, the two samples are considered to have similar touch behavior characteristics. The touch behavior characteristics of the users are not similar, so that the classifier is not dependent on the touch behavior characteristics to complete the classification, so that the Siamese network can further extract the biological features unrelated to the touch behavior from the signal features.
2.根据权利要求1所述的基于振动信号的智能终端触碰认证方法,其特征是,所述的收集振动信号,先将收到的振动信号分割为暂态振动阶段、稳定振动阶段和衰退阶段。2. The intelligent terminal touch authentication method based on vibration signal according to claim 1, is characterized in that, described collection vibration signal, first divides the vibration signal received into transient vibration stage, stable vibration stage and decay stage. 3.根据权利要求1所述的基于振动信号的智能终端触碰认证方法,其特征是,所述的提取,包括基于小波变化的特征提取、基于倒谱变换的特征提取、触碰位置特征提取、触碰力度特征提取,具体为:从暂态振动阶段提取得到小波变换后得到的时频谱、从稳定振动阶段提取倒谱、从移动终端的麦克风提取音频信号的峰值及其对应时间作为触碰位置特征、提取振动信号在共振频率附近的能量值
Figure FDA0002478227430000014
作为触碰力度特征,其中:fr为振动信号的共振频率,Δf定义了能量计算带宽,f(t)是原始信号,即暂态振动阶段的振动信号。
3. The intelligent terminal touch authentication method based on vibration signal according to claim 1, is characterized in that, described extraction comprises feature extraction based on wavelet change, feature extraction based on cepstral transformation, touch position feature extraction , Touch strength feature extraction, specifically: extracting the time spectrum obtained after wavelet transformation from the transient vibration stage, extracting the cepstrum from the stable vibration stage, extracting the peak value of the audio signal and its corresponding time from the microphone of the mobile terminal as the touch Position feature, extract the energy value of vibration signal near resonance frequency
Figure FDA0002478227430000014
As the touch strength feature, where: f r is the resonance frequency of the vibration signal, Δf defines the energy calculation bandwidth, and f(t) is the original signal, that is, the vibration signal in the transient vibration stage.
4.根据权利要求1或3所述的基于振动信号的智能终端触碰认证方法,其特征是,所述的提取,具体包括:4. The vibration signal-based smart terminal touch authentication method according to claim 1 or 3, wherein the extraction specifically comprises: 1)从接收信号的暂态振动阶段提取特征,由于在暂态振动阶段,振动信号的频率不断变化,需要对原始振动信号进行变换,使之同时获得良好的时域和频域解析度,因此,利用连续小波变换对暂态振动阶段的振动信号进行变换:1) Extract features from the transient vibration phase of the received signal. Since the frequency of the vibration signal is constantly changing in the transient vibration phase, the original vibration signal needs to be transformed to obtain good time domain and frequency domain resolution at the same time. Therefore, , using continuous wavelet transform to transform the vibration signal in the transient vibration stage:
Figure FDA0002478227430000021
其中:CWTf(a,τ)是获得的时频谱;f(t)是原始信号,即暂态振动阶段的振动信号;ψa,τ(t)是小波基函数,其中a和τ分别表示时域和频域的解析度,
Figure FDA0002478227430000022
表示小波基函数时延为t的形式,选择Morlet函数作为小波基函数以达到更好的时域和频域解析度,将小波变换后得到的时频谱作为暂态振动阶段的信号特征;
Figure FDA0002478227430000021
where: CWT f (a,τ) is the obtained time spectrum; f(t) is the original signal, that is, the vibration signal in the transient vibration phase; ψ a,τ (t) is the wavelet basis function, where a and τ represent the resolution in the time and frequency domains,
Figure FDA0002478227430000022
Represents the form of wavelet basis function time delay as t, selects Morlet function as wavelet basis function to achieve better resolution in time domain and frequency domain, and takes the time spectrum obtained after wavelet transform as the signal characteristic of transient vibration stage;
2)基于倒谱变换的特征提取:利用倒谱变换获取稳定振动阶段信号中包含边频带在内的各种频率成分:Cy(q)=F-1(logSy(f(t))),其中:Cy(q)为获得的倒谱;Sy(f(t))为信号的功率谱密度;F-1对应逆傅里叶变换(IFFT),将得到的倒谱作为稳定振动阶段的信号特征;2) Feature extraction based on cepstral transformation: Use cepstral transformation to obtain various frequency components including sidebands in the signal in the stable vibration stage: C y (q)=F -1 (logS y (f(t))) , where: C y (q) is the obtained cepstrum; S y (f(t)) is the power spectral density of the signal; F -1 corresponds to the inverse Fourier transform (IFFT), and the obtained cepstrum is regarded as the stable vibration Signal characteristics of the stage; 3)触碰位置特征:振动信号经由三条路径到达麦克风,发送振动信号的冲激阶段在麦克风接收信号上最先出现的峰值对应手机内部振动传输的路径,第二个峰值对应通过空气中的声波直线传输的路径,第三个峰值对应通过触碰手指的反射传播的路径,提取麦克风接收信号中的峰值和对应时间,作为触碰位置特征;3) Touch position feature: the vibration signal reaches the microphone through three paths, the first peak that appears on the microphone received signal in the impulse phase of sending the vibration signal corresponds to the path of the internal vibration transmission of the mobile phone, and the second peak corresponds to the sound wave passing through the air. The path of straight transmission, the third peak corresponds to the path propagating through the reflection of the touch finger, and the peak value and corresponding time in the received signal of the microphone are extracted as the touch position feature; 4)触碰力度特征提取:计算振动信号在共振频率附近的能量值
Figure FDA0002478227430000023
其中:fr为振动信号的共振频率,Δf定义了能量计算带宽。
4) Touch strength feature extraction: Calculate the energy value of the vibration signal near the resonance frequency
Figure FDA0002478227430000023
where: f r is the resonance frequency of the vibration signal, and Δf defines the energy calculation bandwidth.
5.根据权利要求1所述的基于振动信号的智能终端触碰认证方法,其特征是,所述的基于孪生网络架构的神经网络,包括两个平行的子网络,每个子网络具有相同的结构和权值并分别根据输入的振动信号中提取的特征值X1,X2经过子网络后得到对应的特征表示CW(X1),CW(X2),进而得到两个特征表示的距离:DW(X1,X2)=||Cw(X1)-Cw(X2)||。5. The smart terminal touch authentication method based on vibration signal according to claim 1, wherein the described neural network based on twin network architecture comprises two parallel sub-networks, and each sub-network has the same structure and weights, respectively, according to the feature values X 1 , X 2 extracted from the input vibration signal, after passing through the sub-network, the corresponding feature representations C W (X 1 ), C W (X 2 ) are obtained, and then the two feature representations are obtained. Distance: D W (X 1 , X 2 )=||C w (X 1 )-C w (X 2 )||. 6.根据权利要求5所述的基于振动信号的智能终端触碰认证方法,其特征是,所述的子网络为时延神经网络的结构,包含两个卷积层和一个全连接层,每个卷积层内为一个基本卷积模块作为核心,一个BN层用于处理梯度问题和一个ReLU层作为激活函数;6. The vibration signal-based touch authentication method for an intelligent terminal according to claim 5, wherein the sub-network is a time-delay neural network structure, comprising two convolutional layers and a fully connected layer, and each Within each convolutional layer, a basic convolutional module is used as the core, a BN layer is used to deal with the gradient problem and a ReLU layer is used as an activation function; 所述的神经网络的训练样本具有同样的标签,即来自同一个用户且触碰行为特征不相似,即触碰行为特征相似度低于阈值。The training samples of the neural network have the same label, that is, come from the same user and the touch behavior characteristics are not similar, that is, the similarity of the touch behavior characteristics is lower than the threshold. 7.根据权利要求6所述的基于振动信号的智能终端触碰认证方法,其特征是,所述的分类是指:根据神经网络得到的两个输入对应的特征表示的距离,判断两个输入是否属于统一用户,进而实现触碰行为是否来自于已注册用户的判断。7. The smart terminal touch authentication method based on vibration signal according to claim 6, wherein the classification refers to: according to the distance of the corresponding feature representation of the two inputs obtained by the neural network, judging the two inputs Whether it belongs to a unified user, so as to realize the judgment of whether the touch behavior comes from the registered user. 8.一种实现权利要求1~7中任一所述方法的系统,其特征在于,包括:振动信号处理模块、信号特征提取模块、行为无关分类器以及认证模块,其中:振动信号处理模块与信号特征提取模块相连并传输经过预处理的振动信号信息,信号特征提取模块与行为无关分类器相连并传输从经过预处理的振动信号中提取的信号特征及行为特征信息,行为无关分类器与认证模块相连并传输经过训练的分类器模型信息,认证模块接收认证阶段提取的信号特征相连并传输至经过训练的分类器模型得到登陆者的认证结果。8. A system for implementing the method according to any one of claims 1 to 7, characterized in that, comprising: a vibration signal processing module, a signal feature extraction module, a behavior-independent classifier, and an authentication module, wherein: the vibration signal processing module is associated with The signal feature extraction module is connected to and transmits the preprocessed vibration signal information. The signal feature extraction module is connected to the behavior-independent classifier and transmits the signal features and behavioral feature information extracted from the preprocessed vibration signal. The behavior-independent classifier and authentication The modules are connected and transmit the information of the trained classifier model, the authentication module receives the signal features extracted in the authentication stage, connects and transmits it to the trained classifier model to obtain the authentication result of the lander.
CN201910583135.8A 2019-07-01 2019-07-01 Intelligent terminal touch authentication method and system based on vibration signal Expired - Fee Related CN110363120B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910583135.8A CN110363120B (en) 2019-07-01 2019-07-01 Intelligent terminal touch authentication method and system based on vibration signal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910583135.8A CN110363120B (en) 2019-07-01 2019-07-01 Intelligent terminal touch authentication method and system based on vibration signal

Publications (2)

Publication Number Publication Date
CN110363120A CN110363120A (en) 2019-10-22
CN110363120B true CN110363120B (en) 2020-07-10

Family

ID=68217593

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910583135.8A Expired - Fee Related CN110363120B (en) 2019-07-01 2019-07-01 Intelligent terminal touch authentication method and system based on vibration signal

Country Status (1)

Country Link
CN (1) CN110363120B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112989888B (en) * 2019-12-17 2024-06-07 华为技术有限公司 Fingerprint anti-counterfeiting method and electronic equipment
US11291910B2 (en) 2020-02-14 2022-04-05 Mediatek Inc. Apparatuses and methods for providing a virtual input key
CN112214635B (en) * 2020-10-23 2022-09-13 昆明理工大学 Fast audio retrieval method based on cepstrum analysis
CN112949403B (en) * 2021-02-01 2022-08-23 浙江大学 Reliable user authentication method and system based on biological characteristics of mandible
CN113324648B (en) * 2021-07-09 2021-11-12 中国铁道科学研究院集团有限公司铁道科学技术研究发展中心 Portable high-speed railway wheel rail vibration space-time synchronization test method and system
CN115481380A (en) * 2022-08-17 2022-12-16 北京理工大学 A Continuous Identity Authentication Method Based on Sliding Vibration Signal
CN116127365B (en) * 2023-04-14 2023-07-25 山东大学 A vibration-based authentication method applied to smart head-mounted devices

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101281852B1 (en) * 2012-06-28 2013-07-03 고려대학교 산학협력단 Biometric authentication device and method using brain signal
CN104765455A (en) * 2015-04-07 2015-07-08 中国海洋大学 Man-machine interactive system based on striking vibration
CN105808996A (en) * 2016-05-12 2016-07-27 北京小米移动软件有限公司 Method and device for unlocking screen of terminal
CN106874833A (en) * 2016-12-26 2017-06-20 中国船舶重工集团公司第七0研究所 A kind of mode identification method of vibration event

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1525710A4 (en) * 2002-07-29 2008-02-13 Idesia Ltd METHOD AND DEVICE FOR DETECTING AN ELECTRO-BIOMETRIC IDENTITY
US9329715B2 (en) * 2014-09-11 2016-05-03 Qeexo, Co. Method and apparatus for differentiating touch screen users based on touch event analysis
CN108681709B (en) * 2018-05-16 2020-01-17 深圳大学 Intelligent input method and system based on bone conduction vibration and machine learning

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101281852B1 (en) * 2012-06-28 2013-07-03 고려대학교 산학협력단 Biometric authentication device and method using brain signal
CN104765455A (en) * 2015-04-07 2015-07-08 中国海洋大学 Man-machine interactive system based on striking vibration
CN105808996A (en) * 2016-05-12 2016-07-27 北京小米移动软件有限公司 Method and device for unlocking screen of terminal
CN106874833A (en) * 2016-12-26 2017-06-20 中国船舶重工集团公司第七0研究所 A kind of mode identification method of vibration event

Also Published As

Publication number Publication date
CN110363120A (en) 2019-10-22

Similar Documents

Publication Publication Date Title
CN110363120B (en) Intelligent terminal touch authentication method and system based on vibration signal
Dong et al. Secure mmWave-radar-based speaker verification for IoT smart home
Lu et al. Lippass: Lip reading-based user authentication on smartphones leveraging acoustic signals
Chen et al. You can hear but you cannot steal: Defending against voice impersonation attacks on smartphones
Wang et al. Ghosttalk: Interactive attack on smartphone voice system through power line
Liu et al. An MFCC‐based text‐independent speaker identification system for access control
Chen et al. Listen to your fingers: User authentication based on geometry biometrics of touch gesture
CN103595538B (en) Identity verification method based on mobile phone acceleration sensor
CN113221673A (en) Speaker authentication method and system based on multi-scale feature aggregation
WO2010061344A2 (en) Device, system, and method of liveness detection utilizing voice biometrics
Kong et al. MultiAuth: Enable multi-user authentication with single commodity WiFi device
Marras et al. Adversarial Optimization for Dictionary Attacks on Speaker Verification.
JP4668237B2 (en) Personal authentication system
Liu et al. SoundID: Securing mobile two-factor authentication via acoustic signals
CN113241081A (en) Far-field speaker authentication method and system based on gradient inversion layer
CN106980836A (en) Auth method and device
Ren et al. Robust mobile two-factor authentication leveraging acoustic fingerprinting
CN116127365B (en) A vibration-based authentication method applied to smart head-mounted devices
Zarandy et al. Hey Alexa what did I just type? Decoding smartphone sounds with a voice assistant
WO2025031170A1 (en) Voiceprint recognition system evaluation method and apparatus, storage medium, and electronic device
WO2021103913A1 (en) Voice anti-counterfeiting method and apparatus, terminal device, and storage medium
Dua et al. MelCochleaGram-DeepCNN: sequentially fused spectrogram and the DeepCNN classifiers-based audio spoof detection system
Yu et al. WiFi signal-based user authentication
CN116881885A (en) User lip reading authentication method and device based on back scattering signal
CN115481380A (en) A Continuous Identity Authentication Method Based on Sliding Vibration Signal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200710

CF01 Termination of patent right due to non-payment of annual fee