CN117711032A - Fingerprint identification methods and electronic equipment - Google Patents

Abstract

This application provides a fingerprint identification method and an electronic device. The method includes: the electronic device performs multi-template matching on the fingerprint image corresponding to the user's fingerprint, wherein the similarity between the multi-templates satisfies the preset conditions, thereby effectively improving the Accuracy of fingerprint recognition.

Description

Fingerprint identification methods and electronic equipment

Technical field

The present application relates to the field of terminal equipment, and in particular, to a fingerprint identification method and electronic equipment.

Background technique

Currently, the unlocking methods of terminal devices include but are not limited to: fingerprint unlocking, password unlocking, face unlocking, etc. In the scenario of unlocking the terminal device through fingerprint, the user needs to register the fingerprint in advance so that the phone can be unlocked when the fingerprint of the finger used for unlocking matches the registered fingerprint. The current unlocking method usually matches the user's fingerprint with a pre-entered fingerprint template. However, because the quality of the user's fingerprint obtained by the electronic device may be low, fingerprint recognition will fail.

Contents of the invention

This application provides a fingerprint identification method and electronic device. In this method, the electronic device can match the user's fingerprint with multiple fingerprint templates, thereby improving the accuracy of fingerprint recognition.

In a first aspect, this application provides a fingerprint identification method. The method includes: the electronic device displays a fingerprint sensing area on the display screen in response to the received first user operation. The electronic device acquires the fingerprint image when the finger detected by the fingerprint sensor covers the fingerprint sensing area. The electronic device performs similarity matching between the fingerprint image and the first fingerprint template and at least one adjacent template of the first fingerprint template; wherein the distance between the first fingerprint template and each of the at least one adjacent template of the first fingerprint template is The similarity is greater than the first threshold. The electronic device obtains a first similarity value between the fingerprint image and the first fingerprint template, and at least a second similarity value between the fingerprint image and at least one neighboring template of the first fingerprint template. If the first similarity value and at least one second similarity value satisfy the similarity condition, the electronic device determines that the fingerprint image corresponding to the finger is successfully matched, and unlocks the electronic device. In this way, the electronic device matches the user's fingerprint with multiple stored fingerprint templates, which can effectively improve the success rate of fingerprint recognition.

In a possible implementation, before displaying the fingerprint sensing area on the display screen in response to the received user operation, the method further includes: the electronic device displays a new fingerprint interface in response to the received first user operation. The electronic device acquires multiple fingerprint templates when the finger detected by the fingerprint sensor covers the fingerprint sensing area, and the multiple fingerprint templates include the first fingerprint template. The electronic device performs similarity matching between the first fingerprint template and other fingerprint templates, and determines that the template whose similarity to the first fingerprint template is greater than a first threshold is a neighboring template of the first fingerprint template. The electronic device stores a correspondence between the first fingerprint template and at least one adjacent template of the first fingerprint template. The electronic device performs similarity matching between the second fingerprint template and other fingerprint templates, and determines that the template whose similarity to the second fingerprint template is greater than the first threshold is a neighboring template of the second fingerprint template. The electronic device stores a correspondence relationship between the second fingerprint template and at least one adjacent template of the second fingerprint template. In this way, the electronic device can find adjacent templates corresponding to each template based on the similarity between multiple templates, and save the corresponding relationship. Correspondingly, during the fingerprint identification process, the electronic device identifies fingerprints based on multiple templates with high similarity to improve the success rate of fingerprint matching.

In a possible implementation, similarity matching between the fingerprint image and the first fingerprint template and at least one adjacent template of the first fingerprint template includes: the electronic device based on the first fingerprint template and at least one adjacent template of the first fingerprint template The corresponding relationship between the templates is to obtain the pre-stored first fingerprint template and at least one adjacent template of the first fingerprint template. In this way, the electronic device pre-stores the corresponding relationship between the fingerprint template and the adjacent template, so that during the fingerprint recognition process, the corresponding adjacent template can be quickly found based on the corresponding relationship.

In a possible implementation, before performing similarity matching between the fingerprint image and the first fingerprint template and at least one adjacent template of the first fingerprint template, the method further includes: the electronic device matching the fingerprint image with the second fingerprint template and the second fingerprint template. Similarity matching is performed on at least one adjacent template of the fingerprint template. The electronic device obtains a third similarity value between the fingerprint image and the second fingerprint template, and at least a fourth similarity value between the fingerprint image and at least one neighboring template of the second fingerprint template. If the third similarity value and at least one fourth similarity value of the electronic device do not meet the similarity condition, similarity matching between the fingerprint image and the first fingerprint template and at least one adjacent template of the first fingerprint template continues. In this way, the electronic device can match the templates in the template library and their corresponding adjacent templates one by one to determine whether the user's fingerprint is successfully matched.

In a possible implementation, the similarity condition includes at least one of the following: the sum of the similarity values is greater than the third threshold; or each similarity value is greater than the corresponding preset threshold. In this way, even if the similarity between the user's fingerprint image and each template does not reach a certain threshold, it can still be judged whether the user's fingerprint is successfully matched by fusing the similarities, thereby improving the success rate of fingerprint recognition. and accuracy.

In a second aspect, the present application provides an electronic device, including: one or more processors, a memory; and one or more computer programs, wherein one or more computer programs are stored on the memory, and when the computer program is processed by one or more When the processor is executed, the electronic device performs the following steps: in response to the received first user operation, display the fingerprint sensing area on the display screen; obtain the fingerprint image when the finger detected by the fingerprint sensor covers the fingerprint sensing area; The fingerprint image performs similarity matching with the first fingerprint template and at least one adjacent template of the first fingerprint template; wherein the similarity between the first fingerprint template and each of the at least one adjacent template of the first fingerprint template is greater than a first threshold; obtain a first similarity value between the fingerprint image and the first fingerprint template, and at least a second similarity value between the fingerprint image and at least one adjacent template of the first fingerprint template; if the first similarity value is consistent with at least one The second similarity value meets the similarity condition, it is determined that the fingerprint image corresponding to the finger is successfully matched, and the electronic device is unlocked.

In a possible implementation, when the computer program is executed by one or more processors, the electronic device is caused to perform the following steps: in response to the received first user operation, display a new fingerprint interface; obtain the fingerprint detected by the fingerprint sensor Multiple fingerprint templates when the finger covers the fingerprint sensing area, including the first fingerprint template; perform similarity matching between the first fingerprint template and other fingerprint templates, and determine the similarity with the first fingerprint template Templates greater than the first threshold are adjacent templates of the first fingerprint template; save the correspondence between the first fingerprint template and at least one adjacent template of the first fingerprint template; perform similarity matching between the second fingerprint template and other fingerprint templates, And determine that the template whose similarity to the second fingerprint template is greater than the first threshold is a neighboring template of the second fingerprint template; and save the correspondence between the second fingerprint template and at least one neighboring template of the second fingerprint template.

In a possible implementation, when the computer program is executed by one or more processors, the electronic device is caused to perform the following steps: based on the correspondence between the first fingerprint template and at least one adjacent template of the first fingerprint template, Obtain a pre-stored first fingerprint template and at least one adjacent template of the first fingerprint template.

In a possible implementation, when the computer program is executed by one or more processors, the electronic device is caused to perform the following steps: performing a similarity comparison between the fingerprint image and the second fingerprint template and at least one adjacent template of the second fingerprint template. Match; obtain a third similarity value between the fingerprint image and the second fingerprint template, and at least a fourth similarity value between the fingerprint image and at least one adjacent template of the second fingerprint template; the third similarity value is similar to at least a fourth similarity value If the degree value does not meet the similarity condition, similarity matching between the fingerprint image and the first fingerprint template and at least one adjacent template of the first fingerprint template continues.

In a possible implementation, the similarity condition includes at least one of the following: the sum of the similarity values is greater than the third threshold; or each similarity value is greater than the corresponding preset threshold.

The second aspect and any implementation manner of the second aspect respectively correspond to the first aspect and any implementation manner of the first aspect. The technical effects corresponding to the second aspect and any implementation manner of the second aspect may be referred to the technical effects corresponding to the above-mentioned first aspect and any implementation manner of the first aspect, which will not be described again here.

In a third aspect, the present application provides a computer-readable medium for storing a computer program, the computer program comprising instructions for performing a method in the first aspect or any possible implementation of the first aspect.

In a fourth aspect, the present application provides a computer program, the computer program comprising instructions for performing a method in the first aspect or any possible implementation of the first aspect.

In a fifth aspect, this application provides a chip, which includes a processing circuit and transceiver pins. Wherein, the transceiver pin and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the method in the first aspect or any possible implementation of the first aspect to control the receiving pin to receive the signal, so as to Control the sending pin to send signals.

Description of the drawings

Figure 1 is a schematic diagram of the hardware structure of an exemplary electronic device;

Figure 2 is a schematic diagram showing the location of a fingerprint sensor;

Figure 3 is a software structure block diagram of an exemplary electronic device;

Figure 4 is a system architecture diagram of an exemplary electronic device;

Figure 5a is a schematic diagram of an exemplary user interface;

Figure 5b is a schematic diagram of an exemplary user interface;

Figure 6 is a schematic diagram of an exemplary user interface;

Figure 7 is a schematic diagram of an exemplary fingerprint identification process;

Figure 8 is a schematic diagram of an exemplary fingerprint template;

Figure 9 is a schematic diagram of an unlocking scene exemplarily shown;

Figure 10 is a schematic diagram illustrating a fingerprint verification method;

Figure 11 is an exemplary schematic diagram of adjacent template matching;

Figure 12 is an exemplary fingerprint matching schematic diagram;

Figure 13 is a schematic structural diagram of an exemplary device.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this application.

The term "and/or" in this article is just an association relationship that describes related objects, indicating that three relationships can exist. For example, A and/or B can mean: A exists alone, A and B exist simultaneously, and they exist alone. B these three situations.

The terms “first” and “second” in the description and claims of the embodiments of this application are used to distinguish different objects, rather than to describe a specific order of objects. For example, the first target object, the second target object, etc. are used to distinguish different target objects, rather than to describe a specific order of the target objects.

In the embodiments of this application, words such as "exemplary" or "for example" are used to represent examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "such as" in the embodiments of the present application is not to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the words "exemplary" or "such as" is intended to present the concept in a concrete manner.

In the description of the embodiments of this application, unless otherwise specified, the meaning of “plurality” refers to two or more. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

Optionally, in the embodiment of this application, the electronic device may be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR)/virtual reality (VR) device, a laptop, a super Mobile personal computers (ultra-mobile personal computers, UMPCs), netbooks, personal digital assistants (personal digital assistants, PDAs) and other devices with fingerprint recognition functions are not limited in this application.

FIG. 1 shows a schematic structural diagram of an electronic device 100 . It should be understood that the electronic device 100 shown in FIG. 1 is only an example of an electronic device, and the electronic device 100 may have more or fewer components than shown in the figure, and two or more components may be combined. , or can have different component configurations. The various components shown in Figure 1 may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.

The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2. Mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, And subscriber identification module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), an image signal processor ( image signal processor (ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU), etc. . Among them, different processing units can be independent devices or integrated in one or more processors.

The controller may be the nerve center and command center of the electronic device 100 . The controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 110 . If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuitsound, I2S) interface, a pulse code modulation (PCM) interface, and a universal asynchronous receiver (universal asynchronous receiver) /transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and/or Universal serial bus (USB) interface, etc.

The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (derail clock line, SCL). In some embodiments, processor 110 may include multiple sets of I2C buses. The processor 110 can separately couple the touch sensor 180K, charger, flash, camera 193, etc. through different I2C bus interfaces. For example, the processor 110 can be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to implement the touch function of the electronic device 100 .

The I2S interface can be used for audio communication. In some embodiments, processor 110 may include multiple sets of I2S buses. The processor 110 can be coupled with the audio module 170 through the I2S bus to implement communication between the processor 110 and the audio module 170 . In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface to implement the function of answering calls through a Bluetooth headset.

The PCM interface can also be used for audio communications to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface to implement the function of answering calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 110 and the wireless communication module 160 . For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.

The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 . MIPI interfaces include camera serial interface (CSI), display serial interface (displayserial interface, DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to implement the shooting function of the electronic device 100 . The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the electronic device 100 .

The GPIO interface can be configured through software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, display screen 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, etc.

The USB interface 130 is an interface that complies with USB standard specifications, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through them. This interface can also be used to connect other electronic devices, such as AR devices, etc.

It can be understood that the interface connection relationships between the modules illustrated in the embodiments of the present application are only schematic illustrations and do not constitute a structural limitation of the electronic device 100 . In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

The charging management module 140 is used to receive charging input from the charger. Among them, the charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from the wired charger through the USB interface 130 . In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through the wireless charging coil of the electronic device 100 . While the charging management module 140 charges the battery 142, it can also provide power to the electronic device through the power management module 141.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, wireless communication module 160, etc. The power management module 141 can also be used to monitor battery capacity, battery cycle times, battery health status (leakage, impedance) and other parameters. In some other embodiments, the power management module 141 may also be provided in the processor 110 . In other embodiments, the power management module 141 and the charging management module 140 may also be provided in the same device.

The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be reused as a diversity antenna for a wireless LAN. In other embodiments, antennas may be used in conjunction with tuning switches.

The mobile communication module 150 can provide solutions for wireless communication including 2G/3G/4G/5G applied on the electronic device 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, perform filtering, amplification and other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be disposed in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.

A modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs sound signals through audio devices (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be independent of the processor 110 and may be provided in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (bluetooth, BT), and global navigation satellite system. (global navigation satellite system, GNSS), frequency modulation (FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.

In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (codedivision multiple access, CDMA), broadband code Wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM , and/or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou satellite navigation system (beidounavigation satellite system, BDS), quasi-zenith satellite system (quasi- zenith satellitesystem (QZSS) and/or satellite based augmentation systems (SBAS)

The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is an image processing microprocessor and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 194 is used to display images, videos, etc. Display 194 includes a display panel. The display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode). (AMOLED), flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diodes (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

The electronic device 100 can implement the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, the light is transmitted to the camera sensor through the lens, the optical signal is converted into an electrical signal, and the camera sensor passes the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be provided in the camera 193.

Camera 193 is used to capture still images or video. The object passes through the lens to produce an optical image that is projected onto the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to convert it into a digital image signal. ISP outputs digital image signals to DSP for processing. DSP converts digital image signals into standard RGB, YUV and other format image signals. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can continuously learn by itself. Intelligent cognitive applications of the electronic device 100 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, etc.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 . The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. Such as saving music, videos, etc. files in external memory card.

Internal memory 121 may be used to store computer executable program code, which includes instructions. The processor 110 executes instructions stored in the internal memory 121 to execute various functional applications and data processing of the electronic device 100 . The internal memory 121 may include a program storage area and a data storage area. Among them, the stored program area can store an operating system, at least one application program required for a function (such as a sound playback function, an image playback function, etc.). The storage data area may store data created during use of the electronic device 100 (such as audio data, phone book, etc.). In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), etc.

The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playback, recording, etc.

The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .

The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, pressure sensor 180A may be disposed on display screen 194 . There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor may include at least two parallel plates of conductive material. When a force is applied to pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation is performed on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 may also calculate the touched position based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch location but with different touch operation intensities may correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold is applied to the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.

The gyro sensor 180B may be used to determine the motion posture of the electronic device 100 . In some embodiments, the angular velocity of electronic device 100 about three axes (ie, x, y, and z axes) may be determined by gyro sensor 180B. The gyro sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyro sensor 180B detects the angle at which the electronic device 100 shakes, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shake of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

Air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

Magnetic sensor 180D includes a Hall sensor. The electronic device 100 may utilize the magnetic sensor 180D to detect opening and closing of the flip holster. In some embodiments, when the electronic device 100 is a flip machine, the electronic device 100 may detect the opening and closing of the flip according to the magnetic sensor 180D. Then, based on the detected opening and closing status of the leather case or the opening and closing status of the flip cover, features such as automatic unlocking of the flip cover are set.

The acceleration sensor 180E can detect the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of electronic devices and be used in horizontal and vertical screen switching, pedometer and other applications.

Distance sensor 180F for measuring distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 may utilize the distance sensor 180F to measure distance to achieve fast focusing.

Proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outwardly through the light emitting diode. Electronic device 100 uses photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100 . When insufficient reflected light is detected, the electronic device 100 may determine that there is no object near the electronic device 100 . The electronic device 100 can use the proximity light sensor 180G to detect when the user holds the electronic device 100 close to the ear for talking, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in holster mode, and pocket mode automatically unlocks and locks the screen.

The ambient light sensor 180L is used to sense ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in the pocket to prevent accidental touching.

Fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access to application locks, fingerprint photography, fingerprint answering of incoming calls, etc. For example, in the embodiment of the present application, the fingerprint sensor 180H can output the collected fingerprints to the processor 110, and the processor 110 can perform fingerprint recognition, entry and other operations to implement fingerprint entry, fingerprint unlocking and other functions. FIG. 2 is a schematic diagram illustrating the location of a fingerprint sensor. Please refer to FIG. 2 . Taking the electronic device 100 as a mobile phone as an example, the fingerprint sensor can be disposed under the display screen of the mobile phone, referred to as an under-screen fingerprint sensor, and can be used for under-screen fingerprint unlocking. Optionally, the fingerprint sensor can usually be positioned correspondingly according to the width and length of the mobile phone, so that when the user holds the mobile phone with one hand, the user's thumb can touch the fingerprint sensing area corresponding to the fingerprint sensor. Of course, the above setting method is only a schematic example. In other embodiments, a mobile phone can be equipped with multiple fingerprint sensors, and the position of the fingerprint sensor can be set according to actual needs, which is not limited in this application. For example, fingerprint sensors can be distributed in multiple locations under the display screen, allowing users to press and input fingerprints anywhere on the screen. For example, the fingerprint sensor in the embodiment of the present application is an under-screen (ie, under the display screen) sensor, that is, the fingerprint sensor is arranged in the display screen (or under the display screen). In other embodiments, the fingerprint sensor can also be arranged outside the display screen, for example, it can be arranged under the HOME button, or it can be arranged on the side frame, or it can also be arranged on the back of the mobile phone, which is not limited in this application.

Temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 utilizes the temperature detected by the temperature sensor 180J to execute the temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of a processor located near the temperature sensor 180J in order to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to prevent the low temperature from causing the electronic device 100 to shut down abnormally. In some other embodiments, when the temperature is lower than another threshold, the electronic device 100 performs boosting on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

Touch sensor 180K, also called "touch panel". The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation on or near the touch sensor 180K. The touch sensor can pass the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation may be provided through display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 at a location different from that of the display screen 194 .

Bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human body's vocal part. The bone conduction sensor 180M can also contact the human body's pulse and receive blood pressure beating signals. In some embodiments, the bone conduction sensor 180M can also be provided in an earphone and combined into a bone conduction earphone. The audio module 170 can analyze the voice signal based on the vibration signal of the vocal vibrating bone obtained by the bone conduction sensor 180M to implement the voice function. The application processor can analyze the heart rate information based on the blood pressure beating signal acquired by the bone conduction sensor 180M to implement the heart rate detection function.

The buttons 190 include a power button, a volume button, etc. Key 190 may be a mechanical key. It can also be a touch button. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100 .

The motor 191 can generate vibration prompts. The motor 191 can be used for vibration prompts for incoming calls and can also be used for touch vibration feedback. For example, touch operations for different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. The motor 191 can also respond to different vibration feedback effects for touch operations in different areas of the display screen 194 . Different application scenarios (such as time reminders, receiving information, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

The indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, or may be used to indicate messages, missed calls, notifications, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195 . The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. SIM card interface 195 can support Nano SIM card, Micro SIM card, SIM card, etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100 .

The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiment of this application takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100 .

FIG. 3 is a software structure block diagram of the electronic device 100 according to the embodiment of the present application.

The layered architecture of the electronic device 100 divides the software into several layers, and each layer has clear roles and division of labor. The layers communicate through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: application layer, application framework layer, Android runtime (Android runtime) and system libraries, and kernel layer.

The application layer can include a series of application packages.

As shown in Figure 3, the application package can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, fingerprint and other applications. For example, a fingerprint application program can implement the fingerprint entry method in the embodiment of this application.

The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

As shown in Figure 3, the application framework layer can include window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

A window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, capture the screen, etc.

Content providers are used to store and retrieve data and make this data accessible to applications. Said data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

The view system includes visual controls, such as controls that display text, controls that display pictures, etc. A view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.

The phone manager is used to provide communication functions of the electronic device 100 . For example, call status management (including connected, hung up, etc.).

The resource manager provides various resources to applications, such as localized strings, icons, pictures, layout files, video files, etc.

The notification manager allows applications to display notification information in the status bar, which can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be notifications that appear in the status bar at the top of the system in the form of charts or scroll bar text, such as notifications for applications running in the background, or notifications that appear on the screen in the form of conversation windows. For example, text information is prompted in the status bar, a beep sounds, the electronic device vibrates, the indicator light flashes, etc.

Android Runtime includes core libraries and virtual machines. The Android runtime is responsible for the scheduling and management of the Android system.

The core library contains two parts: one is the functional functions that need to be called by the Java language, and the other is the core library of Android.

The application layer and application framework layer run in virtual machines. The virtual machine executes the java files of the application layer and application framework layer into binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection and other functions.

System libraries can include multiple functional modules. For example: surface manager (surface manager), media libraries (Media Libraries), 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.

The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, composition, and layer processing.

2D Graphics Engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

It can be understood that the components included in the system framework layer, system library and runtime layer shown in Figure 3 do not constitute specific limitations on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figures, or some components may be combined, some components may be separated, or some components may be arranged differently.

In this embodiment of the present application, the system architecture of the electronic device as shown in Figure 4 includes a trusted execution environment (trusted execution environment, TEE) and a rich execution environment (rich execution environment, REE). Isolate highly security-sensitive applications from the general software environment, provide a specialized trusted execution environment TEE, and protect the confidentiality, integrity and access rights of application resources and data; it also protects traditional operating systems such as Android that are easily attacked Provides a general rich execution environment REE. Applications executed on the REE side are called client applications (CA), such as banking applications and other third-party payment applications. Applications executed on the TEE side are called trusted applications (TA), such as signature execution. , encryption and decryption calculation and other key service applications. Since TA runs in the trusted execution environment TEE, the deployment/upgrade operation of TA needs to strictly follow the security verification specifications of the TEE issuer (usually the terminal manufacturer), such as using digital signatures and other measures to ensure that all aspects of the TEE are truly trustworthy. . The trusted execution environment TEE includes the trusted execution environment internal application programming interface (TEE Internal API) and trusted operating system components. The main function of the TEE Internal API is to provide trusted operating system components upwards. functions, communicate with the client application CA, realize TA-TA communication, provide secure storage, cryptography functions, time functions, etc.; the trusted operating system components mainly include trusted core framework, trusted functions, trusted kernel and trustworthy core. Trust execution environment TEE communication agent, in which the trusted core framework provides TA with operating system-like functions; the trusted function provides support capabilities for application developers; the trusted core is used to interact with trusted devices in the platform hardware; The Trusted Execution Environment Communication Agent provides a secure communication channel for TA and CA. For example, the Trusted Execution Environment Communication Agent passes messages to the Rich Execution Environment Communication Agent through the platform hardware to realize the interaction between TA and CA. Rich execution environment REE includes trusted execution environment client application programming interface (TEE ClientAPI), trusted execution environment functional application programming interface (TEE Functional API) and Multimedia operating system. Multimedia operating system components mainly include public device drivers and rich execution environment communication agents. Among them, rich execution environment communication agents are used to communicate with TEEs. CA and TA provide a secure communication channel. Public device drivers are used to drive Common devices in platform hardware. CA uses TEE Client API and TEE Functional API to access the security services provided by TA.

In the embodiment of this application, steps such as fingerprint entry, saving, and identification (or matching) can be performed in a TEE environment to ensure the security and privacy of fingerprint information.

The fingerprint identification method in the embodiment of this application is mainly divided into two parts, the first part is fingerprint entry, and the second part is fingerprint unlocking.

The fingerprint entry method in the embodiment of the present application will be described in detail below with specific examples. Figure 5a is a schematic diagram of an exemplary user interface. Please refer to (1) of Figure 5a. As an example, a main interface 501 (which may also be called a desktop) is displayed on the display screen of the mobile phone. The main interface 501 includes one or more controls. Controls include but are not limited to: power control, network control, application icon control, etc. The user can click the settings icon control 502 to launch the settings application. Exemplarily, the mobile phone displays the setting interface in response to the received user operation. Please refer to (2) of Figure 5a. In an exemplary embodiment, the setting interface 503 includes one or more setting options. Setting options include but are not limited to: sound and vibration options, notification options, biometric and password options 504, application options, battery options, etc. The user can click on the biometric and password option 504 to launch the biometric and password application. Please refer to (3) of Figure 5a. Exemplarily, the mobile phone displays the biometric and password interface 505 in response to the received user operation. One or more options are included in the biometrics and password interface 505. Options include but are not limited to: fingerprint option 506, face recognition option, lock screen password option, etc. The user can click the fingerprint option 506 to launch the fingerprint application. Please refer to (4) of Figure 5a. As an example, the mobile phone displays a screen lock password input interface 507 in response to the received user operation. In other words, after the user enters the correct lock screen password, the phone will display the fingerprint setting interface to ensure the security of the phone.

Please continue to refer to (4) of Figure 5a. For example, the lock screen password input interface 507 includes but is not limited to: a password line 508 and a keyboard 509. For example, the user can click the number corresponding to the lock screen password on the keyboard 509 to enter the lock screen password. When the user clicks on the lock screen password number, the corresponding password digit in the password line 508 may flash, fill, or other methods to prompt the user for the currently entered password digit. For example, if the lock screen password is 123456, when the user clicks on the number 1, the first password digit in the password line 508 can be filled with black (it can also be other colors, which is not limited by this application). The user continues to enter other numbers. When the user enters the last digit "6", the phone responds to the received 6-digit password and matches it with the pre-stored lock screen password. If the match is successful, the phone displays the fingerprint setting interface. If matching fails, the user can be prompted to re-enter the lock screen password. It should be noted that in the embodiment of this application, a 6-digit screen lock password is used as an example for explanation. In other embodiments, it can also be other digits, which is not limited in this application.

Please refer to Figure 5b. Exemplarily, in response to the received user operation, the mobile phone displays the fingerprint setting interface 510 (which can also be called the fingerprint application interface) after the received 6-digit password successfully matches the pre-stored lock screen password. . Exemplarily, the fingerprint setting interface 501 includes but is not limited to: fingerprint application options, fingerprint list 514, new fingerprint options 515, fingerprint recognition options 516, etc. Exemplarily, the fingerprint application options optionally include, but are not limited to: unlocking the device option 511, accessing the safe option 512, and accessing the application lock option 513. For example, the user can set the fingerprint application scenario by setting the above options. For example, if the user clicks the unlock device option 511 to open the unlock device option. In response to the received user operation, the mobile phone determines that the entered fingerprint will be used to unlock the device. That is to say, the user can unlock the mobile phone in the screen-off or screen-lock mode through fingerprint unlocking.

Please continue to refer to FIG. 5b. Exemplarily, the fingerprint list 514 is used to display the information of the entered fingerprints. The fingerprint list 514 in Figure 5b is empty, which means that no fingerprints have been entered yet. The specific input method of fingerprints will be explained in the following embodiments. For example, the fingerprint list may also include list information, such as "(0/5)" in the figure, where the number "5" may represent the upper limit of the fingerprints that can be entered, that is, up to 5 fingerprints can be entered. The number "0" indicates that the number of fingerprints currently entered is 0. It should be noted that the upper limit of the fingerprints that can be entered is only a schematic example. In other embodiments, it can be set according to actual needs, and is not limited in this application. For example, the user clicks the new fingerprint option 415. The mobile phone responds to the received user operation and executes the fingerprint entry process.

Please refer to (1) of Figure 6. As an example, the mobile phone displays a new fingerprint interface 601. The new fingerprint interface 601 includes but is not limited to: input demonstration screen 602, prompt information 603, and start input option 604.

For example, the input demonstration screen 602 may optionally prompt the user on how to input fingerprints in the form of animation or pictures. For example, the content displayed in the animation can be that the user holds the mobile phone and puts his thumb on the fingerprint sensing area corresponding to the fingerprint sensor and presses it.

For example, the prompt information 603 is used to prompt the user to place his finger on the fingerprint sensing area on the screen and press it with a little force.

For example, the user can click the start entry option 604. In an example, please refer to (2) of FIG. 6 . In response to the received user operation, the mobile phone displays prompt information 605 and fingerprint sensing area 606 in the new fingerprint interface 601 . For example, the prompt information 605 is used to prompt the user of the action that currently needs to be performed, such as "place your finger." Moreover, the prompt information is also used to prompt the user to "press your finger on the sensing area in the screen, move away after feeling the vibration, and repeat this step." For example, the fingerprint sensing area 606 may correspond to the fingerprint sensor shown in FIG. 2 . Optionally, the size of the fingerprint sensing area may be less than or equal to the size of the fingerprint sensor, which is not limited in this application. Optionally, the shape of the fingerprint sensing area is the same as or different from the shape of the fingerprint sensor. Of course, the fingerprint sensing area can also be slightly larger than the size of the fingerprint sensor, and the area larger than the fingerprint sensor is an invalid recording area, that is, even if the user places his finger in this area, the mobile phone may not be able to recognize the fingerprint in this area. Illustratively, the shape, size and position of the fingerprint sensing area are only illustrative examples. In other embodiments, it can be set according to actual needs. For example, the fingerprint sensing area may be rectangular or elliptical, which is not limited in this application. For example, the fingerprint sensing area 606 may include a fingerprint texture image, which may be used to indicate that the area is a fingerprint sensing area.

In another example, please refer to (3) of Figure 6. In response to the received user click to start the input option 504, the mobile phone displays prompt information 605 and fingerprint sensing area 606 in the new fingerprint interface 601, and may also include a fingerprint display. Area 607. For example, the fingerprint display area 607 can be used to display fingerprint patterns that are subsequently entered. Optionally, in the embodiment of the present application, the shape of the fingerprint display area 607 is an ellipse as an example for description. In other embodiments, the shape, frame, size and position of the fingerprint display area 607 can be set according to actual needs. Optionally, the background color of the fingerprint display area 607 may be the same as the background color of the new fingerprint interface 501, or may be different. This application is not limited.

For example, the background color of the new fingerprint interface 601 may be a background color with lower saturation, for example, dark blue. It may also be a background color with higher saturation, such as white, which is not limited in this application.

For example, the fingerprint to be entered by the user is the right thumb fingerprint. Of course, for recording the fingerprints of the user's other fingers, reference can also be made to the recording method of the right thumb fingerprint, which will not be described one by one in this application. Please refer to (4) of FIG. 6 , for example, the user covers the fingerprint of the right thumb on the fingerprint sensing area 606 . It should be noted that the position of the right thumb in the fingerprint sensing area 606 shown in (4) of FIG. 6 is only a schematic example. This application only takes the current position of the right thumb in the fingerprint sensing area 606 as an example for explanation. .

Still referring to (4) of FIG. 6 , for example, the user's right thumb presses the fingerprint sensing area 606 and remains still. It should be noted that the pressing method can increase the accuracy of fingerprint recognition. If the user does not press the fingerprint sensing area 606, for example, the user just covers the fingerprint sensing area 606 with his right thumb without pressing hard, it may cause the phone to malfunction. The user's fingerprint cannot be accurately identified. It should be further noted that keeping still while pressing can also be understood as pressing with a static gesture, which can further improve the accuracy of fingerprint recognition.

For example, the fingerprint sensor of the mobile phone can recognize the fingerprint in the fingerprint sensing area 606. The fingerprint sensor outputs the recognized fingerprint to the fingerprint application. The fingerprint application may display the corresponding fingerprint pattern 608 in the fingerprint display area 607 to indicate that the fingerprint in the area corresponding to the fingerprint pattern 608 has been entered.

FIG. 7 is a schematic diagram of an exemplary fingerprint identification process. Please refer to FIG. 7 . In an exemplary embodiment, when a user enters a fingerprint, the electronic device obtains a fingerprint template and stores the fingerprint template in a template library. As mentioned above, the template library is located in the TEE environment to ensure the security and privacy of fingerprint templates.

Figure 8 is a schematic diagram of an exemplary fingerprint template. Please refer to Figure 8. During the fingerprint entry process, when the electronic device saves the fingerprint template, it actually takes a photo of each entered area (such as the dotted box in Figure 8 ), and stores the corresponding fingerprint image, which is a fingerprint template. For example, the fingerprint template is used to store fingerprint texture information.

For example, when a user enters a fingerprint, the electronic device adopts a multi-region collection method. That is, the electronic device can prompt the user for the fingerprint area that currently needs to be collected, and the user can press the fingerprint in this area firmly into the fingerprint sensing area. The electronic device can obtain the fingerprint information of the area and generate a corresponding image. It can also be understood as taking a snapshot of the area to save the corresponding fingerprint image. When the user repeatedly presses the fingerprint, the electronic device can obtain fingerprint information corresponding to multiple areas (also called fingerprint lines) and obtain the corresponding image (ie, fingerprint template).

Among them, there may be repeated parts between fingerprint templates. Moreover, when saving some fingerprint templates, the corresponding transformation relationships can be saved. For example, as shown in Figure 8, during the input process of fingerprint template 2 (hereinafter referred to as template 2), the electronic device takes a photo of the fingerprint area to obtain template 2. The electronic device obtains the transformation relationship of template 2 (for example, the rotation angle of the x and y axes, the coordinate system can be set according to actual needs, and is not limited in this application). This transformation relationship can be understood as when template 2 is stored in the template library. , are stored according to normal specifications. The electronic device can rotate the template 2 through the recorded transformation relationship, thereby obtaining the actual image of the template 2 during the fingerprint entry process.

FIG. 9 is a schematic diagram of an unlocking scene as an example. Please refer to (1) of Figure 9. For example, the mobile phone is in the screen-off mode. The user can click on the screen-off interface 901. Please refer to (2) of FIG. 9 . In response to the received user operation, the mobile phone displays the fingerprint sensing area 902 in the screen-off interface 901 . Referring to (3) of FIG. 9 , for example, the user presses the fingerprint sensing area 902 with the index finger of the right hand. For example, the fingerprint sensor outputs the recognized fingerprint to the fingerprint application, and the fingerprint application compares the fingerprint input by the fingerprint sensor with one or more stored fingerprints. In one example, it is assumed that the fingerprint of the user's right index finger has been recorded in the mobile phone. Accordingly, the fingerprint application determines that the fingerprint comparison is successful. The fingerprint app instructs the phone to unlock. Please refer to (4) of Figure 9 , for example, the mobile phone displays the desktop 903. In another example, it is assumed that the fingerprint of the user's right index finger is not recorded in the mobile phone. Accordingly, the fingerprint application determines that the fingerprint comparison fails and the mobile phone is not unlocked.

For example, as shown in Figure 7, the user enters a fingerprint during the fingerprint unlocking process. The electronic device obtains the fingerprint image corresponding to the user's fingerprint, and extracts multiple stored fingerprint templates from the template library. The electronic device can match the fingerprint image with templates in the template library to verify the user's fingerprint. In one example, if the verification is successful, the phone is unlocked. If the verification is unsuccessful, the phone will not be unlocked and a message indicating that fingerprint recognition failed will be displayed.

Figure 10 is an exemplary fingerprint verification method. As shown in Figure 10, the electronic device matches the fingerprint image with the templates in the template library one by one. If any template successfully matches the fingerprint image, for example, the similarity is greater than a threshold (for example, 80%, which can be set according to actual needs and is not limited in this application), then the matching can be determined to be successful (that is, the verification is successful). If the template and the fingerprint image all fail to match (that is, the similarity between all templates and the fingerprint image is lower than the threshold), it can be determined that the matching fails.

However, this matching method makes the quality of the fingerprint image obtained by the electronic device poor in low temperatures and when the user's fingers are relatively dry. Therefore, it may cause the user's fingerprint to fail to match multiple times, affecting the user experience.

Embodiments of the present application provide a fingerprint identification method that can identify fingerprints based on multiple templates to improve the accuracy of fingerprint identification.

In this embodiment of the present application, the electronic device can obtain multiple fingerprint templates during the process of entering fingerprints (for the process, please refer to Figure 6). For fingerprint templates, please refer to the description in Figure 8, which will not be described again here. The electronic device can match multiple acquired templates to determine a corresponding adjacent template for each fingerprint template.

Figure 11 is a schematic diagram illustrating adjacent template matching. Referring to Figure 11, the electronic device obtains multiple templates, such as template 1, template 2...template n. The electronic device can match each template one by one according to the storage order (or other order, which is not limited in this application) to obtain adjacent templates corresponding to each template. Taking template 1 as an example, the electronic device matches template 1 and template 2, and detects that the similarity between the image of template 1 and the image of template 2 exceeds the threshold (for example, 60%, which can be set according to actual needs and is not limited in this application). It can be determined that template 2 is a neighboring template of template 1. The electronic device may maintain a neighboring template list to record the neighboring templates corresponding to each template. The electronic device can correspondingly record the identification information of template 1 and template 2 (which may be the name of the template, etc., which is not limited in this application) into the adjacent template list. It should be noted that template 2 is an adjacent template to template 1, and correspondingly, template 1 is also an adjacent template to template 2. It should be further noted that the method of performing image matching on each image (including fingerprint image and template) in the embodiment of the present application to obtain the similarity between the images may refer to the existing technology, which is not limited by this application.

Optionally, as mentioned above, each fingerprint template corresponds to transformation relationship information. When performing adjacent template matching on a template, the electronic device can rotate the template according to the transformation relationship information and then detect the similarity between the templates, thereby improving the accuracy of adjacent template recognition.

In the embodiment of the present application, the similarity between templates and the image similarity between the fingerprint image and the template described below can be understood as one of the fingerprint textures saved in each image (including the fingerprint image and the template). similarity between.

Still referring to Figure 11, the electronic device matches template 1 and template 3, and detects that the similarity between the images of template 1 and template 3 is lower than the threshold, and then determines that template 1 and template 3 are not adjacent templates.

The electronic device matches template 1 and template 4, and detects that the similarity between the images of template 1 and template 4 is higher than the threshold, and then determines that template 1 and template 4 are adjacent templates. The electronic device traverses each template one by one in the above manner to obtain the corresponding adjacent template. Optionally, there may be templates that do not correspond to adjacent templates, that is, the similarities between the template and other templates are lower than the threshold, which is not limited in this application.

Table 1 is an exemplary list of adjacent templates:

Table 1

template Proximity template Template 1 Template 2 Template 4 … …

Optionally, the transformation relationship corresponding to each adjacent template can also be recorded in the list.

Exemplarily, during the fingerprint unlocking process (for the user interface, refer to FIG. 9 , which will not be described again here), the electronic device acquires the user's fingerprint image. Figure 12 is an exemplary fingerprint matching schematic diagram. Referring to Figure 12, the electronic device performs multi-template matching on the user's fingerprint image and templates in the template library. Specifically, the electronic device traverses the templates one by one according to the storage order (or other order), and obtains adjacent templates corresponding to the templates. The electronic device can match the fingerprint image with the template and the corresponding adjacent template to obtain the corresponding similarity. The electronic device can fuse multiple similarities to determine whether the match is successful based on the fused similarities.

For example, still referring to Figure 12, taking template 1 as an example, based on Table 1, the electronic device can determine that the adjacent templates corresponding to template 1 are template 2 and template 4. The electronic device matches the fingerprint image with template 1 and obtains a similarity of 1. Optionally, the electronic device can score the similarity of the template based on the corresponding similarity. For example, the similarity score between the fingerprint image and template 1 is Score_1. Among them, the higher the similarity, the higher the score.

Then, the electronic device matches the fingerprint image with template 2, and obtains a similarity of similarity 2. Optionally, the electronic device can score the similarity of the template based on the corresponding similarity. For example, the similarity score between the fingerprint image and template 2 is Score_2.

The electronic device matches the fingerprint image with template 4 and obtains a similarity of 3. And determine the similarity score between the fingerprint image and template 4 as Score_3.

The electronic device fuses the fingerprint image with similarities between the template and its neighboring templates. In one possible implementation, the similarity fusion method may be to add multiple similarities (ie, similarity scores). In another possible implementation, the similarity fusion method may be to detect whether each similarity is greater than a similarity threshold. Among them, the similarity threshold is smaller than the similarity threshold in the scene in Figure 10. In other words, through the method in the embodiment of this application, the similarity can be reduced. For example, in the scenario in Figure 10, the similarity between the fingerprint image and any template needs to be greater than 60% to determine a successful match. In the embodiment of the present application, if the similarity between the fingerprint image and template 1 is greater than the first threshold (for example, 60%), the similarity between the fingerprint image and template 2 is greater than the second threshold (for example, 20%), and the fingerprint image is If the similarity between the templates 4 is greater than the second threshold (it may also be different from the second threshold, which is not limited in this application), it can be determined that the matching is successful. In another possible implementation manner, the electronic device can also use a decision tree classification method to fuse the similarities to determine whether the matching is successful, which is not limited in this application.

As an example, the fingerprint image acquired by the electronic device can only identify 20 accurate points (the distance is only schematic, and this application does not limit it). In the scenario shown in Figure 10, assuming that the similarity between the 20 points in the fingerprint image and templates 1 to template n is less than 80%, the electronic device will determine that the matching fails. In the embodiment of the present application, the electronic device matches the fingerprint image with template 1 and its adjacent templates (template 2 and template 4) respectively. Among them, there may be some points located in template 1, with a corresponding similarity of 20% (the value can also be understood as a similarity score), some points located in template 2, with a corresponding similarity of 30%, and some points located in template 4. Medium, the similarity is 30%. The electronic device fuses the similarity scores (ie, 20% + 30% + 30%), and determines that the fused similarity score is 80%, determines that the similarity threshold is reached, and determines that the matching is successful.

It can be understood that, in order to implement the above functions, the electronic device includes corresponding hardware and/or software modules that perform each function. In conjunction with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving the hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions in conjunction with the embodiments for each specific application, but such implementations should not be considered to be beyond the scope of this application.

In one example, FIG. 13 shows a schematic block diagram of a device 1300 according to an embodiment of the present application. The device 1300 may include: a processor 1301 and a transceiver/transceiver pin 1302, and optionally, a memory 1303.

The various components of device 1300 are coupled together by bus 1304, which includes, in addition to a data bus, a power bus, a control bus, and a status signal bus. However, for the sake of clarity, various buses are referred to as bus 1304 in the figure.

Optionally, the memory 1303 may be used for instructions in the foregoing method embodiments. The processor 1301 can be used to execute instructions in the memory 1303, and control the receiving pin to receive signals, and control the transmitting pin to send signals.

The device 1300 may be the electronic device or a chip of the electronic device in the above method embodiment.

All relevant content of each step involved in the above method embodiments can be quoted from the functional description of the corresponding functional module, and will not be described again here.

This embodiment also provides a computer storage medium that stores computer instructions. When the computer instructions are run on an electronic device, the electronic device executes the above related method steps to implement the method in the above embodiment.

This embodiment also provides a computer program product. When the computer program product is run on a computer, it causes the computer to perform the above related steps to implement the method in the above embodiment.

In addition, embodiments of the present application also provide a device. This device may be a chip, a component or a module. The device may include a connected processor and a memory. The memory is used to store computer execution instructions. When the device is running, The processor can execute computer execution instructions stored in the memory, so that the chip executes the methods in each of the above method embodiments.

Among them, the electronic equipment, computer storage media, computer program products or chips provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the corresponding methods provided above. The beneficial effects of the method will not be repeated here.

As mentioned above, the above embodiments are only used to illustrate the technical solution of the present application, but not to limit it. Although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still make the foregoing technical solutions. The technical solutions described in each embodiment may be modified, or some of the technical features may be equivalently replaced; however, these modifications or substitutions do not cause the essence of the corresponding technical solutions to depart from the scope of the technical solutions in each embodiment of the present application.

Claims (12)

1. A fingerprint identification method, characterized in that it is applied to electronic equipment, and the electronic equipment is in a locked state, and the method includes: In response to the received first user operation, display the fingerprint sensing area on the display screen; Obtain the fingerprint image when the finger detected by the fingerprint sensor covers the fingerprint sensing area; Perform similarity matching between the fingerprint image and the first fingerprint template and at least one adjacent template of the first fingerprint template; wherein each of the first fingerprint template and the at least one adjacent template of the first fingerprint template The similarity between adjacent templates is greater than the first threshold; Obtaining a first similarity value between the fingerprint image and the first fingerprint template, and at least a second similarity value between the fingerprint image and at least one adjacent template of the first fingerprint template; If the first similarity value and the at least one second similarity value meet the similarity condition, it is determined that the fingerprint image corresponding to the finger is successfully matched, and the electronic device is unlocked. 2. The method according to claim 1, characterized in that, in response to the received user operation, before displaying the fingerprint sensing area on the display screen, the method further includes: In response to the received first user operation, display a new fingerprint interface; Acquire multiple fingerprint templates when the finger detected by the fingerprint sensor covers the fingerprint sensing area, and the multiple fingerprint templates include the first fingerprint template; Perform similarity matching between the first fingerprint template and other fingerprint templates, and determine that the template whose similarity to the first fingerprint template is greater than the first threshold is a neighboring template of the first fingerprint template; Saving the correspondence between the first fingerprint template and the at least one adjacent template of the first fingerprint template; Perform similarity matching between the second fingerprint template and other fingerprint templates, and determine that the template whose similarity to the second fingerprint template is greater than the first threshold is a neighboring template of the second fingerprint template; A correspondence relationship between the second fingerprint template and at least one adjacent template of the second fingerprint template is saved. 3. The method of claim 2, wherein similarity matching between the fingerprint image and the first fingerprint template and at least one adjacent template of the first fingerprint template includes: Based on the corresponding relationship between the first fingerprint template and at least one adjacent template of the first fingerprint template, the pre-stored first fingerprint template and at least one adjacent template of the first fingerprint template are obtained. 4. The method according to claim 2, characterized in that before performing similarity matching between the fingerprint image and the first fingerprint template and at least one adjacent template of the first fingerprint template, the method further includes : Perform similarity matching between the fingerprint image and the second fingerprint template and at least one adjacent template of the second fingerprint template; Obtaining a third similarity value between the fingerprint image and the second fingerprint template, and at least a fourth similarity value between the fingerprint image and at least one adjacent template of the second fingerprint template; If the third similarity value and the at least one fourth similarity value do not satisfy the similarity condition, continue to make the fingerprint image similar to the first fingerprint template and at least one adjacent template of the first fingerprint template. degree match. 5. The method according to any one of claims 1 to 4, characterized in that the similarity condition includes at least one of the following: The sum of each similarity value is greater than the third threshold; or, Each similarity value is greater than the corresponding preset threshold. 6. An electronic device, characterized in that it includes: One or more processors and memories; and one or more computer programs, wherein the one or more computer programs are stored on the memory and when executed by the one or more processors, cause the electronic device to perform the following steps: In response to the received first user operation, display the fingerprint sensing area on the display screen; Obtain the fingerprint image when the finger detected by the fingerprint sensor covers the fingerprint sensing area; Perform similarity matching between the fingerprint image and the first fingerprint template and at least one adjacent template of the first fingerprint template; wherein each of the first fingerprint template and the at least one adjacent template of the first fingerprint template The similarity between adjacent templates is greater than the first threshold; Obtaining a first similarity value between the fingerprint image and the first fingerprint template, and at least a second similarity value between the fingerprint image and at least one adjacent template of the first fingerprint template; If the first similarity value and the at least one second similarity value meet the similarity condition, it is determined that the fingerprint image corresponding to the finger is successfully matched, and the electronic device is unlocked. 7. The electronic device according to claim 6, characterized in that, when the computer program is executed by the one or more processors, the electronic device is caused to perform the following steps: In response to the received first user operation, display a new fingerprint interface; Acquire multiple fingerprint templates when the finger detected by the fingerprint sensor covers the fingerprint sensing area, and the multiple fingerprint templates include the first fingerprint template; Perform similarity matching between the first fingerprint template and other fingerprint templates, and determine that the template whose similarity to the first fingerprint template is greater than the first threshold is a neighboring template of the first fingerprint template; Saving the correspondence between the first fingerprint template and the at least one adjacent template of the first fingerprint template; Perform similarity matching between the second fingerprint template and other fingerprint templates, and determine that the template whose similarity to the second fingerprint template is greater than the first threshold is a neighboring template of the second fingerprint template; A correspondence relationship between the second fingerprint template and at least one adjacent template of the second fingerprint template is saved. 8. The electronic device according to claim 7, characterized in that, when the computer program is executed by the one or more processors, the electronic device is caused to perform the following steps: Based on the corresponding relationship between the first fingerprint template and at least one adjacent template of the first fingerprint template, the pre-stored first fingerprint template and at least one adjacent template of the first fingerprint template are obtained. 9. The electronic device according to claim 7, characterized in that, when the computer program is executed by the one or more processors, the electronic device is caused to perform the following steps: Perform similarity matching between the fingerprint image and the second fingerprint template and at least one adjacent template of the second fingerprint template; Obtaining a third similarity value between the fingerprint image and the second fingerprint template, and at least a fourth similarity value between the fingerprint image and at least one adjacent template of the second fingerprint template; If the third similarity value and the at least one fourth similarity value do not satisfy the similarity condition, continue to make the fingerprint image similar to the first fingerprint template and at least one adjacent template of the first fingerprint template. degree match. 10. The electronic device according to any one of claims 6 to 9, characterized in that the similarity condition includes at least one of the following: The sum of each similarity value is greater than the third threshold; or, Each similarity value is greater than the corresponding preset threshold. 11. A computer storage medium, characterized by comprising computer instructions, which when the computer instructions are run on an electronic device, cause the electronic device to perform the method according to any one of claims 1-5. 12. A chip, characterized in that it includes one or more interface circuits and one or more processors; the interface circuit is used to receive signals from the memory of the electronic device and send the signals to the processor, The signal includes computer instructions stored in a memory; when the processor executes the computer instructions, the electronic device is caused to perform the method of any one of claims 1-5.