CN107295192B - Unlocking control method and related product - Google Patents

Abstract

An unlocking control method and a related product comprise the following steps: acquiring human eye information and human face information, wherein the human eye information comprises iris information; executing a first operation and a second operation in parallel, wherein the first operation is to match the iris information with a preset iris template, and the second operation is to match the face information with a preset face template; and when any one of the first operation and the second operation is successfully matched, executing unlocking operation. The embodiment of the invention is beneficial to improving the stability and the high efficiency of the unlocking operation of the mobile terminal.

Description

Unlock control method and related products

technical field

The present invention relates to the technical field of mobile terminals, in particular to an unlocking control method and related products.

Background technique

With the popularization and application of smart phones, smart phones can support more and more applications, and their functions are becoming more and more powerful. A growing body of research shows that how software operates and how users use their smartphones is a key factor in determining system energy consumption and efficiency.

At present, most smart phones use biometric information unlocking schemes, such as fingerprint unlocking, face unlocking, iris unlocking, etc. Among them, iris unlocking has a higher security level, but consumes more power and unlocks slower; The speed is fast, but it may not be recognized in situations such as wet fingers; the face recognition unlocking speed is faster, but the security level is low, and it is inconvenient to use in weak light.

SUMMARY OF THE INVENTION

The embodiments of the present invention provide an unlocking control method and related products, so as to improve the stability and efficiency of the unlocking operation of the mobile terminal.

In a first aspect, an embodiment of the present invention provides a mobile terminal, including a face information collection device, an iris information collection device, a processor, and a memory, wherein the above-mentioned human eye information collection device and the above-mentioned iris information collection device are connected to the above-mentioned processor, The processor is connected to the above-mentioned memory, wherein,

The above-mentioned iris information collection device is used to obtain human eye information, and the above-mentioned human eye information includes iris information;

The above-mentioned face information collection device is used to obtain face information;

The above-mentioned processor is used to perform a first operation and a second operation in parallel, the above-mentioned first operation is to match the above-mentioned iris information with a preset iris template, and the above-mentioned second operation is to perform the above-mentioned face information and preset face template. match;

The above-mentioned processor is further configured to perform an unlocking operation when it is detected that any one of the above-mentioned first operation and the above-mentioned second operation matches successfully.

In a second aspect, an embodiment of the present invention provides an unlocking control method, where the above method includes:

Obtain human eye information and face information, the above-mentioned human eye information includes iris information;

Performing the first operation and the second operation in parallel, the above-mentioned first operation is to match the above-mentioned iris information with the preset iris template, and the above-mentioned second operation is to match the above-mentioned human face information with the preset human face template;

When it is detected that any one of the above-mentioned first operation and the above-mentioned second operation is successfully matched, the unlocking operation is performed.

In a third aspect, an embodiment of the present invention provides a mobile terminal, where the mobile terminal has a function of implementing the behavior of the mobile terminal in the foregoing method design. The above functions can be implemented by hardware, or by executing corresponding software by hardware. The above-mentioned hardware or software includes one or more modules corresponding to the above-mentioned functions.

In a fourth aspect, an embodiment of the present invention provides a mobile terminal, including: a processor, a memory, and one or more programs; the one or more programs are stored in the memory and configured to be executed by the processor For execution, the above program includes instructions for executing the steps described in any of the methods in the second aspect of the embodiments of the present invention.

In a fifth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, the computer program specifically includes instructions, and the above-mentioned instructions are used to execute the For some or all of the steps described in any method in the second aspect of the embodiments of the present invention, the above-mentioned computer includes a mobile terminal.

In a sixth aspect, an embodiment of the present invention provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute the implementation of the present invention. Examples include some or all of the steps described in any method of the second aspect. The computer program product may be a software installation package, and the above-mentioned computer includes a mobile terminal.

It can be seen that, in this embodiment of the present invention, the mobile terminal first obtains human eye information and face information, the above-mentioned human eye information includes iris information, and secondly, performs a first operation and a second operation in parallel, and the above-mentioned first operation is to use the above-mentioned iris information. The information is matched with the preset iris template, and the above-mentioned second operation is to match the above-mentioned face information with the preset face template. Finally, when it is detected that any operation in the above-mentioned first operation and the above-mentioned second operation is successfully matched , to perform the unlock operation. It can be seen that the mobile terminal performs two biometric matching methods at the same time. When one of the matching methods is successful, the unlocking is realized. Compared with a single biometric identification, it is beneficial to improve the stability of the unlocking operation of the mobile terminal. Moreover, the parallel operation of iris matching and Face matching is beneficial to improve the efficiency of the unlocking operation of the mobile terminal.

Description of drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained according to these drawings without creative efforts.

1A is a schematic structural diagram of a mobile terminal provided by an embodiment of the present invention;

1B is a schematic flowchart of an unlocking control method disclosed in an embodiment of the present invention;

FIG. 1C is an example diagram of collection of human eye information of a mobile terminal disclosed in an embodiment of the present invention;

1D is an example diagram of collecting face information of another mobile terminal disclosed in an embodiment of the present invention;

2 is a schematic flowchart of another unlocking control method disclosed in an embodiment of the present invention;

3 is a schematic flowchart of another unlocking control method disclosed in an embodiment of the present invention;

4 is a schematic structural diagram of a mobile terminal disclosed in an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of another mobile terminal disclosed in an embodiment of the present invention.

Detailed ways

In order to make those skilled in the art better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only These are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

The terms "first", "second" and the like in the description and claims of the present invention and the above drawings are used to distinguish different objects, rather than to describe a specific order. Furthermore, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optionally also includes For other steps or units inherent to these processes, methods, products or devices.

Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor a separate or alternative embodiment that is mutually exclusive of other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

The mobile terminals involved in the embodiments of the present invention may include various handheld devices with wireless communication functions, vehicle-mounted devices, wearable devices, computing devices, or other processing devices connected to wireless modems, as well as various forms of user equipment (User Equipment). Equipment, UE), mobile station (Mobile Station, MS), terminal device (terminal device) and so on. For the convenience of description, the devices mentioned above are collectively referred to as mobile terminals. The embodiments of the present invention will be described in detail below.

Please refer to FIG. 1A . FIG. 1A is a schematic structural diagram of a mobile terminal 100 according to an embodiment of the present invention. The mobile terminal 100 includes: a casing, a touch display screen, a main board, a battery and a sub-board, and an infrared light source is arranged on the main board. 21. The iris camera 22, the front camera 23, the processor 110, the memory 120, the SIM card slot, etc., the sub-board is provided with a vibrator, an integrated sound cavity, and a VOOC flash charging interface. The above-mentioned infrared light source 21 and iris camera 22 constitute the mobile The iris information collection device of the terminal 100, the above-mentioned front camera 23 constitutes the face information collection device of the mobile terminal 100, wherein,

The above-mentioned iris information collection device is used to obtain human eye information, and the above-mentioned human eye information includes iris information;

Wherein, when the iris information collection device collects human eye information, the infrared light source 21 is used to emit infrared light to illuminate the user's iris to form reflected light, the iris camera 22 is used to collect reflected light to form a human eye image, and the processor 110 acquires the human eye image Then, the human eye image quality assessment, iris region localization in the human eye image (including coarse localization and fine localization), iris preprocessing, iris feature point extraction, iris template generation and other processing processes are performed for the human eye image. The iris template is for the above-mentioned iris information.

The above-mentioned face information collection device is used to obtain face information;

The above-mentioned processor 110 is used to perform a first operation and a second operation in parallel, the above-mentioned first operation is to match the above-mentioned iris information with a preset iris template, and the above-mentioned second operation is to match the above-mentioned face information with a preset face template. to match;

The above-mentioned processor 110 is further configured to perform an unlocking operation when it is detected that any one of the above-mentioned first operation and the above-mentioned second operation is successfully matched.

It can be seen that, in this embodiment of the present invention, the mobile terminal first obtains human eye information and face information, the above-mentioned human eye information includes iris information, and secondly, performs a first operation and a second operation in parallel, and the above-mentioned first operation is to use the above-mentioned iris information. The information is matched with the preset iris template, and the above-mentioned second operation is to match the above-mentioned face information with the preset face template. Finally, when it is detected that any operation in the above-mentioned first operation and the above-mentioned second operation is successfully matched , to perform the unlock operation. It can be seen that the mobile terminal performs two biometric matching methods at the same time. When one of the matching methods is successful, the unlocking is realized. Compared with a single biometric identification, it is beneficial to improve the stability of the unlocking operation of the mobile terminal. Moreover, the parallel operation of iris matching and Face matching is beneficial to improve the efficiency of the unlocking operation of the mobile terminal.

In a possible example, when it is detected that any one of the above-mentioned first operation and the above-mentioned second operation is successfully matched, after performing the unlocking operation, the above-mentioned processor is further configured to: when the above-mentioned successful matching operation is the above-mentioned first operation When the operation is performed, the above-mentioned second operation is interrupted; or, when the above-mentioned successful matching operation is the above-mentioned second operation, the above-mentioned first operation is interrupted.

In a possible example, before the above-mentioned processor acquires the human eye information and the face information, it is further used for: when it is detected that the fingerprint information entered by the user fails to match the preset fingerprint template, and the number of failures is greater than the first preset threshold , and output guiding information, where the above-mentioned guiding information is used to guide the user to input the above-mentioned human eye information and the above-mentioned human face information.

In a possible example, when it is detected that any one of the above-mentioned first operation and the above-mentioned second operation is successfully matched, after performing the unlocking operation, the above-mentioned processor is further configured to: determine, according to the above-mentioned human eye information, whether in at least one eyeball an eye-white area of a preset area; and for determining whether the eye-white area is smaller than a second preset threshold; and for displaying an application interface of the first preset application when it is determined that the eye-white area is smaller than the second preset threshold; and an application interface for displaying a second preset application when it is determined that the area of the white of the eye is greater than or equal to the second preset threshold.

In a possible example, in the aspect of matching the above-mentioned face information with a preset face template, the above-mentioned processor is specifically configured to: perform a third operation and a fourth operation in parallel, and the above-mentioned third operation is based on the preset human face. The face unlock strategy matches the above-mentioned face information with the above-mentioned preset face template, and the above-mentioned fourth operation is to determine the twisting direction of the above-mentioned human face according to the above-mentioned human face information; and for when it is judged that the above-mentioned twisting direction is the first direction. , start the first preset application in the background, and after the above-mentioned unlocking operation is performed, display the application interface of the first preset application; and when it is determined that the twisting direction is the second direction, start the second preset application in the background , and after the above-mentioned unlocking operation is performed, the application interface of the above-mentioned second preset application is displayed.

Please refer to FIG. 1B. FIG. 1B is a schematic flowchart of an unlocking control method provided by an embodiment of the present invention. As shown in the figure, the unlocking control method includes:

S101, the mobile terminal acquires human eye information and human face information, and the above-mentioned human eye information includes iris information;

Wherein, the mobile terminal can acquire human eye information and human face information at the same time, and the above-mentioned human eye information includes iris information and eye white information.

S102, the above-mentioned mobile terminal performs a first operation and a second operation in parallel, the above-mentioned first operation is to match the above-mentioned iris information with a preset iris template, and the above-mentioned second operation is to match the above-mentioned face information with a preset face template ;

The above-mentioned face information may be face data information or face image information, the above-mentioned preset face template may be a face data template or a face image template, and the face data template refers to the facial feature points of the user's face. A set of correspondences between positions and feature values of feature points (feature values may be capacitance, inductance, voltage, current, relative value, etc.), and a face image template refers to a user's face image.

Wherein, the matching process of the above-mentioned parallel biological information may be the same or different, which is not limited here.

S103, when the mobile terminal detects that any one of the first operation and the second operation matches successfully, the mobile terminal performs an unlocking operation;

Wherein, when the mobile terminal detects that any one of the first operation and the second operation is successfully matched, the matching degree between the iris information in the first operation and the preset iris template may be higher than that of the face information in the second operation. The matching degree with the preset face template first reaches the preset matching degree threshold, or the matching degree between the face information in the second operation and the preset face template is higher than the matching degree between the iris information in the first operation and the preset iris template. The matching degree first reaches the preset matching degree threshold.

The above unlocking operation may be removing the lock screen interface, or switching the mobile terminal from a current state to a state where an application interface of a certain application is displayed, which is not limited herein.

It can be seen that, in this embodiment of the present invention, the mobile terminal first obtains human eye information and face information, the above-mentioned human eye information includes iris information, and secondly, performs a first operation and a second operation in parallel, and the above-mentioned first operation is to use the above-mentioned iris information. The information is matched with the preset iris template, and the above-mentioned second operation is to match the above-mentioned face information with the preset face template. Finally, when it is detected that any operation in the above-mentioned first operation and the above-mentioned second operation is successfully matched , to perform the unlock operation. It can be seen that the mobile terminal performs two biometric matching methods at the same time. When one of the matching methods is successful, the unlocking is realized. Compared with a single biometric identification, it is beneficial to improve the stability of the unlocking operation of the mobile terminal. Moreover, the parallel operation of iris matching and Face matching is beneficial to improve the efficiency of the unlocking operation of the mobile terminal.

In a possible example, when it is detected that any one of the above-mentioned first operation and the above-mentioned second operation is successfully matched, after the unlocking operation is performed, the above-mentioned method further includes:

When the above-mentioned successful matching operation is the above-mentioned first operation, the above-mentioned second operation is interrupted; or,

When the above-mentioned successful matching operation is the above-mentioned second operation, the above-mentioned first operation is interrupted.

It can be seen that in this example, when the mobile terminal detects that any one of the first operation and the second operation is successfully matched, the other operation is interrupted, so as to ensure the stability of the unlocking control of the mobile terminal without adding redundant operations, It is beneficial to release the running space of the mobile terminal system in time and reduce the power consumption of the mobile terminal.

In a possible example, before obtaining the human eye information and the face information, the above method further includes:

When it is detected that the fingerprint information entered by the user fails to match the preset fingerprint template, and the number of failures is greater than the first preset threshold, guidance information is output, and the guidance information is used to guide the user to enter the above-mentioned human eye information and the above-mentioned face information.

The fingerprint information may be fingerprint data information or fingerprint image information, the preset fingerprint template may be a fingerprint data template or a fingerprint image template, and the fingerprint data template refers to the position of the feature points on the fingerprint surface of the user's finger and the characteristics of the feature points. A set of correspondences between values (feature values can be capacitance, inductance, voltage, current, relative value, etc.), and the fingerprint image template refers to an image of the fingerprint surface of a user's finger.

Wherein, the above-mentioned guidance information may be the image obtained by the current camera output by the display screen, or may be text guidance, or may be vibration guidance, etc., which is not limited herein.

It can be seen that in this example, when the mobile terminal detects that the fingerprint information fails to match the preset fingerprint template for many times, it actively guides the user to input face information or human eye information, and then performs face or iris matching, which is conducive to improving the unlocking of the mobile terminal. speed and improve the intelligence of mobile terminals.

In a possible example, when it is detected that any one of the above-mentioned first operation and the above-mentioned second operation is successfully matched, after the unlocking operation is performed, the above-mentioned method further includes:

Determine the white area of at least one preset region in the eyeball according to the above-mentioned human eye information;

judging whether the above-mentioned area of the white of the eye is less than a second preset threshold;

When it is determined that the white area of the eye is smaller than the second preset threshold, the application interface of the first preset application is displayed;

When it is determined that the white area of the eye is greater than or equal to the second preset threshold, an application interface of the second preset application is displayed.

The at least one eyeball may be the left eye or the right eye, and the preset area may be the white area on the left side of the pupil or the white area on the right side of the pupil.

For example, when the above-mentioned preset area is the white area on the left side of the pupil, as shown in FIG. 1C , when the above-mentioned white area is smaller than the above-mentioned second preset threshold, it means that the user is doing the action of looking to the left with the human eye. Look at the first preset application corresponding to this action, and display the application interface of the first preset application; on the other hand, when the above-mentioned eye white area is greater than or equal to the above-mentioned second preset threshold, it means that the user is looking to the right with the human eye. Action, according to the second preset application corresponding to the action of looking right, the application interface of the second preset application is displayed.

The preset application corresponding to the size of the white area of the eye may be set actively by the user, or may be set by counting the area of the white eye of the user multiple times and the historical record of the user unlocking the application, which is not limited herein.

It can be seen that in this example, after the unlocking operation, the mobile terminal independently determines the displayed application interface according to the user's eye white area, which further improves the intelligence of the mobile terminal, and the eye white area is obtained when the mobile terminal directly unlocks and matches the user. It is determined by human eye information, and there is no need to obtain human eye information twice, which is conducive to improving the efficiency of entering applications.

In a possible example, the above-mentioned matching of the above-mentioned face information with a preset face template includes:

The third operation and the fourth operation are performed in parallel, and the third operation is to match the above-mentioned face information with the above-mentioned preset face template according to the preset face unlocking strategy, and the above-mentioned fourth operation is to determine the above-mentioned person according to the above-mentioned face information. the twist direction of the face;

When it is determined that the twisting direction is the first direction, the first preset application is started in the background, and after the unlocking operation is performed, the application interface of the first preset application is displayed;

When it is determined that the twisting direction is the second direction, the second preset application is started in the background, and after the unlocking operation is performed, the application interface of the second preset application is displayed.

The above face unlocking strategy is to match the position of the feature points of the face and the feature value of the specific point with the preset face template, and the matching degree is greater than the preset matching degree threshold.

Wherein, the specific implementation manner of determining the twisting direction of the above-mentioned face may be the area size of the left and right ears in the acquired face information, when the area of the left ear is larger than that of the right ear, the twisting direction is the right side, and when the area of the left ear is smaller than the right ear When the ear is turned, the twist direction is the left side.

For example, as shown in FIG. 1D , the face information includes the complete right ear image and does not include the left ear image, indicating that the twist direction is the left side.

Wherein, the above-mentioned first direction may be the left side or the right side, and the second direction may be the right side or the left side.

The corresponding relationship between the twisting direction and the preset application may be set by the user, or may be set by counting the historical records of the user's multiple twists and the user's unlocking and entering the application. Since the twisting direction may be related to the position of the application on the display screen, For example, application 1 is on the left side of the display screen. When the user wants to enter application 1, he will turn to the left to view application 1. Therefore, the history setting of the application can be set by counting the number of times the user turns and unlocks the application. Here Not limited.

It can be seen that in this example, when the mobile terminal performs iris matching or face matching, the direction of face rotation is determined in parallel, which is used to determine the interface display after the unlocking operation, which is beneficial to improve the intelligence of the mobile terminal, and the three operations are parallelized. It is executed, and the first preset application or the second preset application is started in the background before the successful unlocking, which is beneficial to further improve the unlocking efficiency of the mobile terminal.

Consistent with the embodiment shown in FIG. 1B above, please refer to FIG. 2 . FIG. 2 is a schematic flowchart of another unlocking control method provided by an embodiment of the present invention. As shown in the figure, the unlocking control method includes:

S201, when the mobile terminal detects that the fingerprint information entered by the user fails to match with a preset fingerprint template, and the number of failures is greater than a first preset threshold, the mobile terminal outputs guidance information, where the above-mentioned guidance information is used to guide the user to enter human eye information and face information ;

Wherein, the above-mentioned guidance information may be the image obtained by the current camera output by the display screen, or may be text guidance, or may be vibration guidance, etc., which is not limited herein.

S202, the above-mentioned mobile terminal obtains the above-mentioned human eye information and the above-mentioned human face information, and the above-mentioned human eye information includes iris information;

S203, the above-mentioned mobile terminal performs a first operation and a second operation in parallel, the above-mentioned first operation is to match the above-mentioned iris information with a preset iris template, and the above-mentioned second operation is to match the above-mentioned face information with a preset face template. ;

S204, when the above-mentioned mobile terminal detects that the first operation in the above-mentioned first operation and the above-mentioned second operation is successfully matched, performs an unlocking operation, and interrupts the above-mentioned second operation;

S205, the above-mentioned mobile terminal determines the eye white area of the preset area in at least one eyeball according to the above-mentioned human eye information;

S206, the mobile terminal determines whether the area of the white of the eye is smaller than a second preset threshold;

S207, when the mobile terminal determines that the area of the white of the eye is smaller than the second preset threshold, displays an application interface of the first preset application.

Wherein, for the above S202, S203, and S204, reference may be made to the corresponding steps in the embodiment described in FIG. 1B.

It can be seen that, in this embodiment of the present invention, the mobile terminal first obtains human eye information and face information, the above-mentioned human eye information includes iris information, and secondly, performs a first operation and a second operation in parallel, and the above-mentioned first operation is to use the above-mentioned iris information. The information is matched with the preset iris template, and the above-mentioned second operation is to match the above-mentioned face information with the preset face template. Finally, when it is detected that any operation in the above-mentioned first operation and the above-mentioned second operation is successfully matched , to perform the unlock operation. It can be seen that the mobile terminal performs two biometric matching methods at the same time. When one of the matching methods is successful, the unlocking is realized. Compared with a single biometric identification, it is beneficial to improve the stability of the unlocking operation of the mobile terminal. Moreover, the parallel operation of iris matching and Face matching is beneficial to improve the efficiency of the unlocking operation of the mobile terminal.

In addition, when the mobile terminal detects that the fingerprint information fails to match the preset fingerprint template for many times, it actively guides the user to input face information or human eye information, and after the unlocking operation, the mobile terminal autonomously determines the displayed image according to the user's eye white area. The application interface further improves the intelligence and unlocking efficiency of the mobile terminal, and the white area of the eye is determined by the mobile terminal directly through the human eye information obtained when the user performs unlocking and matching. efficiency.

Consistent with the embodiment shown in FIG. 1B above, please refer to FIG. 3 . FIG. 3 is a schematic flowchart of another unlocking control method provided by an embodiment of the present invention. As shown in the figure, the unlocking control method includes:

S301, the mobile terminal acquires human eye information and human face information, and the above-mentioned human eye information includes iris information;

S302, the above-mentioned mobile terminal performs the first operation and the second operation in parallel, the above-mentioned first operation is to match the above-mentioned iris information with a preset iris template, the above-mentioned second operation is to perform the third operation and the fourth operation in parallel, the above-mentioned third operation The operation is to match the above-mentioned face information with the above-mentioned preset face template according to the preset face unlocking strategy, and the above-mentioned fourth operation is to determine the twisting direction of the above-mentioned face according to the above-mentioned face information;

S303, when the mobile terminal determines that the twist direction is the first direction, the mobile terminal starts a first preset application in the background;

S304, when the above-mentioned mobile terminal detects that any operation in the above-mentioned first operation and the above-mentioned second operation is successfully matched, perform an unlocking operation;

S305, the mobile terminal displays an application interface of the first preset application.

Wherein, for the above S301 and S304, reference may be made to the corresponding steps in the embodiment described in FIG. 1B .

It can be seen that, in this embodiment of the present invention, the mobile terminal first obtains human eye information and face information, the above-mentioned human eye information includes iris information, and secondly, performs a first operation and a second operation in parallel, and the above-mentioned first operation is to use the above-mentioned iris information. The information is matched with the preset iris template, and the above-mentioned second operation is to match the above-mentioned face information with the preset face template. Finally, when it is detected that any operation in the above-mentioned first operation and the above-mentioned second operation is successfully matched , to perform the unlock operation. It can be seen that the mobile terminal performs two biometric matching methods at the same time. When one of the matching methods is successful, the unlocking is realized. Compared with a single biometric identification, it is beneficial to improve the stability of the unlocking operation of the mobile terminal. Moreover, the parallel operation of iris matching and Face matching is beneficial to improve the efficiency of the unlocking operation of the mobile terminal.

In addition, when the mobile terminal performs iris matching or face matching, the direction of face rotation is determined in parallel, which is used to determine the interface display after the unlocking operation, which is beneficial to improve the intelligence of the mobile terminal. Moreover, the three operations are performed in parallel, and in Starting the first preset application or the second preset application in the background before the successful unlocking is beneficial to further improve the unlocking efficiency of the mobile terminal.

The foregoing describes the solutions of the embodiments of the present invention mainly from the perspective of the method-side execution process. It can be understood that, in order to implement the above-mentioned functions, the mobile terminal includes corresponding hardware structures and/or software modules for executing each function. Those skilled in the art should easily realize that the present invention can be implemented in hardware or a combination of hardware and computer software in conjunction with the units and algorithm steps of each example described in the embodiments disclosed herein. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of the present invention.

In this embodiment of the present invention, the mobile terminal may be divided into functional units according to the foregoing method examples. For example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units. It should be noted that, the division of units in the embodiment of the present invention is schematic, and is only a logical function division, and there may be other division manners in actual implementation.

In the case of using an integrated unit, FIG. 4 shows a schematic structural diagram of a mobile terminal provided in this embodiment. The mobile terminal 400 includes: a processing unit 402 and a communication unit 403 . The processing unit 402 is used to control and manage the actions of the mobile terminal. For example, the processing unit 402 is used to support the mobile terminal to perform steps S101 to S103 in FIG. 1B , steps S201 to S207 in FIG. 2 , and steps S301 to S301 in FIG. 3 . S305 and/or other processes for the techniques described herein. The communication unit 403 is used to support the communication between the mobile terminal and other devices (such as a display screen, etc.), or support the communication between the processing unit 402 and peripheral devices of the mobile terminal (such as an iris camera, a front camera, etc.). The mobile terminal may further include a storage unit 401 for storing program codes and data of the mobile terminal.

The processing unit 402 may be a processor or a controller, for example, a central processing unit (Central Processing Unit, CPU), a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application-specific integrated circuit (Application-Specific Integrated Circuit) Circuit, ASIC), Field Programmable Gate Array (Field Programmable Gate Array, FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It may implement or execute the various exemplary logical blocks, modules and circuits described in connection with this disclosure. The above-mentioned processor may also be a combination that realizes computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like. The communication unit 403 may be a transceiver, a transceiver circuit, an internal communication interface (a communication port between a processor and a peripheral device), etc., and may include one or more interfaces. The storage unit 401 may be a memory.

The above-mentioned processing unit 402 is used for acquiring human eye information and human face information through the above-mentioned communication unit, and the above-mentioned human eye information includes iris information; and is used to perform a first operation and a second operation in parallel, and the above-mentioned first operation is to convert the above-mentioned iris The information is matched with the preset iris template, and the above-mentioned second operation is to match the above-mentioned face information with the preset face template; , perform the unlock operation.

In a possible example, when the above-mentioned processing unit 402 detects that any one of the above-mentioned first operation and the above-mentioned second operation is successfully matched, after performing the unlocking operation, the above-mentioned processing unit 402 is further configured to: when the above-mentioned successful matching operation is the above-mentioned first operation When an operation is performed, the above-mentioned second operation is interrupted; or, when the above-mentioned successful matching operation is the above-mentioned second operation, the above-mentioned first operation is interrupted.

In a possible example, before the above-mentioned processing unit 402 obtains the human eye information and the face information through the above-mentioned communication unit, it is further configured to: when it is detected that the fingerprint information entered by the user fails to match the preset fingerprint template, and the number of failures is greater than the number of the first When there is a preset threshold, the above-mentioned communication unit outputs guiding information, and the above-mentioned guiding information is used to guide the user to input the above-mentioned human eye information and the above-mentioned human face information.

In a possible example, when the above-mentioned processing unit 402 detects that any one of the above-mentioned first operation and the above-mentioned second operation is successfully matched, after performing the unlocking operation, the above-mentioned processing unit 402 is further configured to: determine at least one eyeball according to the above-mentioned human eye information and the white area of the eye in the preset area; and for judging whether the white area of the eye is smaller than the second preset threshold; and for displaying the application interface of the first preset application when the area of the white of the eye is less than the second preset threshold; and The application interface for displaying the second preset application when the white area of the eye is greater than or equal to the second preset threshold.

In a possible example, in the aspect of matching the above-mentioned face information with a preset face template, the above-mentioned processing unit 402 is specifically configured to: perform the third operation and the fourth operation in parallel, and the above-mentioned third operation is based on the preset The face unlocking strategy matches the above-mentioned face information with the above-mentioned preset face template, and the above-mentioned fourth operation is to determine the twisting direction of the above-mentioned human face according to the above-mentioned human face information; and is used for determining that the above-mentioned twisting direction is the first direction. when the first preset application is activated in the background, and after the unlocking operation is performed, the application interface of the first preset application is displayed; and when it is determined that the twisting direction is the second direction, the second preset application is activated in the background application, and after the above-mentioned unlocking operation is performed, the application interface of the above-mentioned second preset application is displayed.

It can be understood that the functions of each program module of the mobile terminal 400 in this embodiment can be specifically implemented according to the methods in the foregoing method embodiments, and the specific implementation process can refer to the relevant descriptions of the foregoing method embodiments, which will not be repeated here.

Consistent with the embodiment shown in FIG. 1B above, please refer to FIG. 5 . FIG. 5 is a mobile terminal provided by an embodiment of the present invention, including: a processor, a memory, a communication interface, and one or more programs; One or more programs are stored in the above-mentioned memory and configured to be executed by the above-mentioned one or more processors, the above-mentioned programs include instructions for performing the following steps;

Obtain human eye information and face information, the above-mentioned human eye information includes iris information;

Performing the first operation and the second operation in parallel, the above-mentioned first operation is to match the above-mentioned iris information with the preset iris template, and the above-mentioned second operation is to match the above-mentioned human face information with the preset human face template;

When it is detected that any one of the above-mentioned first operation and the above-mentioned second operation is successfully matched, the unlocking operation is performed.

It can be seen that, in this embodiment of the present invention, the mobile terminal first obtains human eye information and face information, the above-mentioned human eye information includes iris information, and secondly, performs a first operation and a second operation in parallel, and the above-mentioned first operation is to use the above-mentioned iris information. The information is matched with the preset iris template, and the above-mentioned second operation is to match the above-mentioned face information with the preset face template. Finally, when it is detected that any operation in the above-mentioned first operation and the above-mentioned second operation is successfully matched , to perform the unlock operation. It can be seen that the mobile terminal performs two biometric matching methods at the same time. When one of the matching methods is successful, the unlocking is realized. Compared with a single biometric identification, it is beneficial to improve the stability of the unlocking operation of the mobile terminal. Moreover, the parallel operation of iris matching and Face matching is beneficial to improve the efficiency of the unlocking operation of the mobile terminal.

In a possible example, the above-mentioned program further includes an instruction for executing the following steps: when it is detected that any one of the above-mentioned first operation and the above-mentioned second operation is successfully matched, after performing the unlocking operation, when the above-mentioned matching is successful When the operation performed is the above-mentioned first operation, the above-mentioned second operation is interrupted; or, when the above-mentioned successful matching operation is the above-mentioned second operation, the above-mentioned first operation is interrupted.

In a possible example, the above program further includes an instruction for executing the following steps: before obtaining the human eye information and face information, when it is detected that the fingerprint information entered by the user fails to match the preset fingerprint template, and the number of failures is greater than When the first preset threshold is set, guide information is output, and the guide information is used to guide the user to input the above-mentioned human eye information and the above-mentioned face information.

In a possible example, the above-mentioned program further includes an instruction for executing the following steps: when it is detected that any one of the above-mentioned first operation and the above-mentioned second operation is successfully matched, after the unlocking operation is performed, according to the above-mentioned human eye information to determine the white area of a preset area in at least one eyeball; and determine whether the white area of the eye is less than a second preset threshold; and when it is determined that the white area of the eye is less than the second preset threshold, display the application of the first preset application an interface; and when it is determined that the area of the white of the eye is greater than or equal to the second preset threshold, displaying an application interface of the second preset application.

In a possible example, in the aspect of matching the above-mentioned face information with a preset face template, the instructions in the above-mentioned program are specifically used to perform the following steps: performing the third operation and the fourth operation in parallel, the above-mentioned third operation In order to match the above-mentioned face information with the above-mentioned preset face template according to the preset face unlocking strategy, the above-mentioned fourth operation is to determine the twisting direction of the above-mentioned human face according to the above-mentioned human face information; When it is the first direction, the first preset application is started in the background, and after the unlocking operation is performed, the application interface of the first preset application is displayed; and when it is determined that the twisting direction is the second direction, the background is started A second preset application, and after the above-mentioned unlocking operation is performed, an application interface of the second preset application is displayed.

Embodiments of the present invention further provide a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, the computer program causing the computer to execute a part of any unlocking control method as described in the above method embodiments Or all steps, the above-mentioned computer includes a mobile terminal.

Embodiments of the present invention further provide a computer program product, where the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute any one of the method embodiments described above. Part or all of the steps of an unlocking control method, the above-mentioned computer includes a mobile terminal.

It should be noted that, for the sake of simple description, the foregoing method embodiments are all expressed as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described action sequence. As in accordance with the present invention, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the device embodiments described above are only illustrative. For example, the division of the above-mentioned units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated. to another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical or other forms.

The units described above as separate components may or may not be physically separated, and components shown as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

The above-mentioned integrated units, if implemented in the form of software functional units and sold or used as independent products, may be stored in a computer-readable memory. Based on such understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory, Several instructions are included to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the above-mentioned methods of various embodiments of the present invention. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable memory, and the memory can include: a flash disk , Read-only memory (English: Read-Only Memory, referred to as: ROM), random access device (English: Random Access Memory, referred to as: RAM), magnetic disk or optical disk, etc.

The embodiments of the present invention have been introduced in detail above, and specific examples are used to illustrate the principles and implementations of the present invention. The descriptions of the above embodiments are only used to help understand the methods and core ideas of the present invention; at the same time, for Persons of ordinary skill in the art, according to the idea of the present invention, will have changes in the specific embodiments and application scope. To sum up, the contents of this specification should not be construed as limiting the present invention.

Claims (26)

1. A mobile terminal is characterized by comprising a face information acquisition device, an iris information acquisition device, a processor and a memory, wherein the face information acquisition device and the iris information acquisition device are both connected with the processor, the processor is connected with the memory, wherein,

the iris information acquisition device is used for acquiring human eye information, and the human eye information comprises iris information;

the face information acquisition device is used for acquiring face information;

the processor is used for executing a first operation and a second operation in parallel, the first operation is used for matching the iris information with a preset iris template, and the second operation is used for matching the face information with a preset face template;

the processor is further used for executing an unlocking operation when any one of the first operation and the second operation is successfully matched;

wherein,

when detecting that any one of the first operation and the second operation is successfully matched, after executing an unlocking operation, the processor is further configured to: determining the white area of a preset area in at least one eyeball according to the human eye information; and is used for judging whether the white area is smaller than a second preset threshold value; and an application interface used for displaying a first preset application when the white eye area is judged to be smaller than the second preset threshold; and the application interface is used for displaying a second preset application when the white eye area is judged to be larger than or equal to the second preset threshold.

2. The mobile terminal according to claim 1, wherein the processor, when detecting that any one of the first operation and the second operation is successfully matched, after performing an unlocking operation, is further configured to: when the successfully matched operation is the first operation, interrupting the second operation; or, the first operation is interrupted when the matching operation is the second operation.

3. The mobile terminal of claim 1, wherein before the processor obtains the eye information and the face information, the processor is further configured to: when detecting that the fingerprint information input by the user fails to be matched with a preset fingerprint template and the failure times are greater than a first preset threshold value, outputting guide information, wherein the guide information is used for guiding the user to input the human eye information and the human face information.

4. The mobile terminal of claim 2, wherein before the processor obtains the eye information and the face information, the processor is further configured to: when detecting that the fingerprint information input by the user fails to be matched with a preset fingerprint template and the failure times are greater than a first preset threshold value, outputting guide information, wherein the guide information is used for guiding the user to input the human eye information and the human face information.

5. The mobile terminal according to any of claims 1 to 4, wherein in the matching of the face information with a preset face template, the processor is specifically configured to: executing a third operation and a fourth operation in parallel, wherein the third operation is to match the face information with the preset face template according to a preset face unlocking strategy, and the fourth operation is to determine the twisting direction of the face according to the face information; the background is used for starting a first preset application when the twisting direction is judged to be the first direction, and displaying an application interface of the first preset application after the unlocking operation is executed; and when the twisting direction is judged to be the second direction, starting a second preset application in the background, and displaying an application interface of the second preset application after the unlocking operation is executed.

6. A mobile terminal is characterized by comprising a face information acquisition device, an iris information acquisition device, a processor and a memory, wherein the face information acquisition device and the iris information acquisition device are both connected with the processor, the processor is connected with the memory, wherein,

the iris information acquisition device is used for acquiring human eye information, and the human eye information comprises iris information;

the face information acquisition device is used for acquiring face information;

the processor is used for executing a first operation and a second operation in parallel, the first operation is used for matching the iris information with a preset iris template, and the second operation is used for matching the face information with a preset face template;

wherein,

the processor is further used for executing an unlocking operation when any one of the first operation and the second operation is successfully matched;

in the aspect of matching the face information with a preset face template, the processor is specifically configured to: executing a third operation and a fourth operation in parallel, wherein the third operation is to match the face information with the preset face template according to a preset face unlocking strategy, and the fourth operation is to determine the twisting direction of the face according to the face information; the background is used for starting a first preset application when the twisting direction is judged to be the first direction, and displaying an application interface of the first preset application after the unlocking operation is executed; and when the twisting direction is judged to be the second direction, starting a second preset application in the background, and displaying an application interface of the second preset application after the unlocking operation is executed.

7. The mobile terminal according to claim 6, wherein the processor, when detecting that any one of the first operation and the second operation is successfully matched, after performing an unlocking operation, is further configured to: when the successfully matched operation is the first operation, interrupting the second operation; or, the first operation is interrupted when the matching operation is the second operation.

8. The mobile terminal of claim 6 or 7, wherein before the processor obtains the eye information and the face information, the processor is further configured to: when detecting that the fingerprint information input by the user fails to be matched with a preset fingerprint template and the failure times are greater than a first preset threshold value, outputting guide information, wherein the guide information is used for guiding the user to input the human eye information and the human face information.

9. An unlock control method, characterized by comprising:

acquiring human eye information and human face information, wherein the human eye information comprises iris information;

executing a first operation and a second operation in parallel, wherein the first operation is to match the iris information with a preset iris template, and the second operation is to match the face information with a preset face template;

when any one of the first operation and the second operation is successfully matched, executing an unlocking operation;

wherein, after the step of executing an unlocking operation when detecting that any one of the first operation and the second operation is successfully matched, the method further comprises:

determining the white area of a preset area in at least one eyeball according to the human eye information; judging whether the eye white area is smaller than a second preset threshold value or not; when the eye white area is judged to be smaller than the second preset threshold value, displaying an application interface of a first preset application; and when the eye white area is judged to be larger than or equal to the second preset threshold value, displaying an application interface of a second preset application.

10. The method of claim 9, wherein after performing an unlocking operation when it is detected that either of the first operation and the second operation is successfully matched, the method further comprises:

when the successfully matched operation is the first operation, interrupting the second operation; or,

and when the successfully matched operation is the second operation, interrupting the first operation.

11. The method of claim 9, wherein prior to obtaining the eye information and the face information, the method further comprises:

when detecting that the fingerprint information input by the user fails to be matched with a preset fingerprint template and the failure times are greater than a first preset threshold value, outputting guide information, wherein the guide information is used for guiding the user to input the human eye information and the human face information.

12. The method of claim 10, wherein prior to obtaining the eye information and the face information, the method further comprises:

when detecting that the fingerprint information input by the user fails to be matched with a preset fingerprint template and the failure times are greater than a first preset threshold value, outputting guide information, wherein the guide information is used for guiding the user to input the human eye information and the human face information.

13. The method according to any one of claims 9 to 12, wherein the matching the face information with a preset face template comprises:

executing a third operation and a fourth operation in parallel, wherein the third operation is to match the face information with the preset face template according to a preset face unlocking strategy, and the fourth operation is to determine the twisting direction of the face according to the face information;

when the torsion direction is judged to be the first direction, starting a first preset application by a background, and displaying an application interface of the first preset application after the unlocking operation is executed;

and when the twisting direction is judged to be the second direction, starting a second preset application by the background, and displaying an application interface of the second preset application after the unlocking operation is executed.

14. An unlock control method, characterized by comprising:

acquiring human eye information and human face information, wherein the human eye information comprises iris information;

executing a first operation and a second operation in parallel, wherein the first operation is to match the iris information with a preset iris template, and the second operation is to match the face information with a preset face template;

when any one of the first operation and the second operation is successfully matched, executing an unlocking operation;

wherein,

the matching of the face information and a preset face template comprises the following steps:

executing a third operation and a fourth operation in parallel, wherein the third operation is to match the face information with the preset face template according to a preset face unlocking strategy, and the fourth operation is to determine the twisting direction of the face according to the face information;

when the torsion direction is judged to be the first direction, starting a first preset application by a background, and displaying an application interface of the first preset application after the unlocking operation is executed;

and when the twisting direction is judged to be the second direction, starting a second preset application by the background, and displaying an application interface of the second preset application after the unlocking operation is executed.

15. The method of claim 14, wherein after performing an unlocking operation when it is detected that either of the first operation and the second operation is successfully matched, the method further comprises:

when the successfully matched operation is the first operation, interrupting the second operation; or,

and when the successfully matched operation is the second operation, interrupting the first operation.

16. The method according to claim 14 or 15, wherein before the obtaining of the human eye information and the human face information, the method further comprises:

when detecting that the fingerprint information input by the user fails to be matched with a preset fingerprint template and the failure times are greater than a first preset threshold value, outputting guide information, wherein the guide information is used for guiding the user to input the human eye information and the human face information.

17. A mobile terminal, characterized in that the mobile terminal comprises a processing unit and a communication unit,

the processing unit is used for acquiring human eye information and human face information through the communication unit, wherein the human eye information comprises iris information; the iris matching system comprises a face information acquisition module, a face information acquisition module and a face information acquisition module, wherein the face information acquisition module is used for acquiring iris information of a user; and the unlocking operation is executed when any one of the first operation and the second operation is successfully matched;

wherein,

when detecting that any one of the first operation and the second operation is successfully matched, the processing unit is further configured to, after executing an unlocking operation: determining the white area of a preset area in at least one eyeball according to the human eye information; and is used for judging whether the white area is smaller than a second preset threshold value; and an application interface for displaying a first preset application when the white eye area is smaller than the second preset threshold; and the application interface is used for displaying a second preset application when the eye white area is larger than or equal to the second preset threshold.

18. The mobile terminal according to claim 17, wherein the processing unit, when detecting that any one of the first operation and the second operation is successfully matched, after performing an unlocking operation, is further configured to: when the successfully matched operation is the first operation, interrupting the second operation; or, when the successfully matched operation is the second operation, interrupting the first operation.

19. The mobile terminal of claim 17, wherein before the processing unit obtains the eye information and the face information through the communication unit, the processing unit is further configured to: when detecting that the fingerprint information input by the user fails to be matched with a preset fingerprint template and the failure times are greater than a first preset threshold value, outputting guide information through the communication unit, wherein the guide information is used for guiding the user to input the human eye information and the human face information.

20. The mobile terminal of claim 18, wherein before the processing unit obtains the eye information and the face information through the communication unit, the processing unit is further configured to: when detecting that the fingerprint information input by the user fails to be matched with a preset fingerprint template and the failure times are greater than a first preset threshold value, outputting guide information through the communication unit, wherein the guide information is used for guiding the user to input the human eye information and the human face information.

21. The mobile terminal according to any of claims 17 to 20, wherein in the aspect of matching the face information with a preset face template, the processing unit is specifically configured to: executing a third operation and a fourth operation in parallel, wherein the third operation is to match the face information with the preset face template according to a preset face unlocking strategy, and the fourth operation is to determine the twisting direction of the face according to the face information; the background is used for starting a first preset application when the twisting direction is judged to be the first direction, and displaying an application interface of the first preset application after the unlocking operation is executed; and when the twisting direction is judged to be the second direction, starting a second preset application in the background, and displaying an application interface of the second preset application after the unlocking operation is executed.

22. A mobile terminal, characterized in that,

the mobile terminal comprises a processing unit and a communication unit,

the processing unit is used for acquiring human eye information and human face information through the communication unit, wherein the human eye information comprises iris information; the iris matching system comprises a face information acquisition module, a face information acquisition module and a face information acquisition module, wherein the face information acquisition module is used for acquiring iris information of a user; and the unlocking operation is executed when any one of the first operation and the second operation is successfully matched;

wherein,

in the aspect of matching the face information with a preset face template, the processing unit is specifically configured to: executing a third operation and a fourth operation in parallel, wherein the third operation is to match the face information with the preset face template according to a preset face unlocking strategy, and the fourth operation is to determine the twisting direction of the face according to the face information; the background is used for starting a first preset application when the twisting direction is judged to be the first direction, and displaying an application interface of the first preset application after the unlocking operation is executed; and when the twisting direction is judged to be the second direction, starting a second preset application in the background, and displaying an application interface of the second preset application after the unlocking operation is executed.

23. The mobile terminal of claim 22, wherein the processing unit, when detecting that any one of the first operation and the second operation is successfully matched, after performing an unlocking operation, is further configured to: when the successfully matched operation is the first operation, interrupting the second operation; or, when the successfully matched operation is the second operation, interrupting the first operation.

24. The mobile terminal according to claim 22 or 23, wherein before the processing unit obtains the eye information and the face information through the communication unit, the processing unit is further configured to: when detecting that the fingerprint information input by the user fails to be matched with a preset fingerprint template and the failure times are greater than a first preset threshold value, outputting guide information through the communication unit, wherein the guide information is used for guiding the user to input the human eye information and the human face information.

25. A mobile terminal, comprising: a processor, memory, and one or more programs; the one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method as described in any of claims 9-16.

26. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any of claims 9-16, the computer comprising a mobile terminal.

Images