CN111340471B - Payment method, device and equipment based on face recognition - Google Patents

Abstract

The embodiment of the specification discloses a payment method, a payment device and payment equipment based on face recognition, wherein the method comprises the following steps: acquiring face image information; sending the face image information to a server; identifying the face image information to determine a first identification result; after determining the first recognition result, displaying a first payment interface on a display screen, wherein the first payment interface comprises a first payment confirmation button; after the click operation on the first payment confirmation button is acquired, acquiring a second recognition result of the server for the face image information, which is received within a preset time after the first payment interface is displayed; judging whether the first recognition result is consistent with the second recognition result or not to obtain a first judgment result; and when the first judgment result shows that the first identification result is consistent with the second identification result, performing payment based on the first identification result.

Description

A payment method, device and equipment based on face recognition

technical field

The embodiments of this specification relate to the field of computer technology, and in particular, to a payment method, device, and device based on face recognition.

Background technique

To improve the convenience of payment, face-scanning payment is becoming more and more common in supermarkets, shopping malls and subways. When recognizing the face, the terminal device needs to send the collected face image to the server in the cloud. Then, after the server in the cloud has completed the recognition, the recognition result is sent to the terminal device, and the terminal device uses the recognition result sent by the server. pay. However, this process often takes a long time, affecting the user's payment experience. However, if the collected face image is not sent to the server in the cloud, but the identification is performed by the terminal device, the accuracy of the identification result will be reduced due to the limitation of the storage space of the terminal device, thus affecting the security.

Therefore, there is an urgent need for a face-scanning payment method with short time-consuming and high security.

SUMMARY OF THE INVENTION

The embodiments of this specification provide a payment method, device and device based on face recognition, so as to solve the problem of long time-consuming existing in the existing payment method based on face recognition.

In order to solve the above-mentioned technical problems, the embodiments of this specification are implemented as follows:

A payment method based on face recognition provided by the embodiments of this specification, the method is applied to a terminal device, and the method includes:

Obtaining face image information, the face image information is the face image information obtained in the payment process based on face recognition;

sending the face image information to the server;

Recognizing the face image information to determine a first recognition result;

After the first identification result is determined, a first payment interface is displayed on the display screen, and the first payment interface includes a first payment confirmation button;

After obtaining the click operation on the first payment confirmation button, obtain the second recognition result of the face image information received by the server within a preset time after the first payment interface is displayed ;

Judging whether the first recognition result is consistent with the second recognition result, and obtaining a first judgment result;

When the first determination result indicates that the first identification result is consistent with the second identification result, payment is made based on the first identification result.

A payment device based on face recognition provided by the embodiments of this specification includes:

a face image acquisition module, configured to acquire face image information, where the face image information is the face image information acquired in the payment process based on face recognition;

a face image sending module for sending the face image information to a server;

a first recognition result determination module, configured to recognize the face image information and determine the first recognition result;

a first payment interface display module, configured to display a first payment interface on the display screen after the first identification result is determined, and the first payment interface includes a first payment confirmation button;

The second identification result obtaining module is configured to obtain, after obtaining the click operation on the first payment confirmation button, the information received by the server within a preset time after the first payment interface is displayed for the the second recognition result of the face image information;

a first judgment module, configured to judge whether the first identification result is consistent with the second identification result, and obtain a first judgment result;

A first payment module, configured to perform payment based on the first identification result when the first judgment result indicates that the first identification result is consistent with the second identification result.

An electronic device provided by the embodiments of this specification includes:

at least one processor; and,

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to:

Obtaining face image information, the face image information is the face image information obtained in the payment process based on face recognition;

sending the face image information to the server;

Recognizing the face image information to determine a first recognition result;

After the first identification result is determined, a first payment interface is displayed on the display screen, and the first payment interface includes a first payment confirmation button;

After obtaining the click operation on the first payment confirmation button, obtain the second recognition result of the face image information received by the server within a preset time after the first payment interface is displayed ;

Judging whether the first recognition result is consistent with the second recognition result, and obtaining a first judgment result;

When the first determination result indicates that the first identification result is consistent with the second identification result, payment is made based on the first identification result.

A computer-readable medium provided by an embodiment of the present specification stores computer-readable instructions thereon, and the computer-readable instructions can be executed by a processor to implement a payment method based on face recognition.

An embodiment of this specification achieves the following beneficial effects: by using local recognition and cloud recognition to identify the collected face image, after the local recognition result is returned, the user confirmation interface is displayed, not after the cloud recognition result is obtained. Then display the user confirmation interface, wait for the cloud recognition result in the process of the user confirmation link, and use the time of the user payment confirmation in the interaction link to wait for the cloud recognition result, which shortens the total time of the payment process and shortens the user's waiting time. Then, the payment account is jointly determined according to the cloud recognition result, the local recognition result and the user confirmation result, so as to improve the security of payment.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present specification or the prior art, the following briefly introduces the accompanying drawings required in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments described in this application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1 is a schematic flowchart of an overall solution of a payment method based on face recognition provided by an embodiment of this specification;

2 is a schematic flowchart of a payment method based on face recognition provided by an embodiment of this specification;

FIG. 3 is a schematic structural diagram of a payment device based on face recognition corresponding to FIG. 2 provided by the embodiment of this specification;

FIG. 4 is a schematic structural diagram of an electronic device corresponding to FIG. 2 according to an embodiment of the present specification.

Detailed ways

In order to make the objectives, technical solutions and advantages of one or more embodiments of this specification clearer, the technical solutions of one or more embodiments of this specification will be clearly and completely described below with reference to the specific embodiments of this specification and the corresponding drawings. . Obviously, the described embodiments are only some of the embodiments of the present specification, but not all of the embodiments. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments in the present specification without creative efforts fall within the protection scope of one or more embodiments of the present specification.

The technical solutions provided by the embodiments of the present specification will be described in detail below with reference to the accompanying drawings.

In the prior art, in order to improve the convenience of payment, many supermarkets, hospitals, subways, shopping malls and restaurants have introduced face-scanning payment. Face-scanning devices are used to collect face images, identify the payment account by recognizing the face image, and then use the face-scanning device to determine the payment account. debit in order to complete the payment. This payment method can complete the payment without relying on the terminal logged in with the user's payment account, which greatly improves the convenience of payment.

However, there are also certain problems in the current face-swiping payment. When recognizing the face image information, it can be completed by the terminal device that collects the face image information (referred to as the local device), or the local device can convert the face image information. Send to the server in the cloud, and the server will complete it. However, both schemes have certain disadvantages.

Using the server in the cloud for face image recognition takes a long time and the user waits for a long time, resulting in a poor user experience. Among them, the reason for the slow recognition speed of the server (the gap with the local device is within 1S) is that the data transmission process of sending data from the local device to the server takes a long time.

Using local equipment to recognize face images saves the transmission process of face image information and can improve the recognition speed. However, compared with server recognition, the recognition accuracy rate is low and the security is poor. This is because, limited by the hardware configuration of the local device, the data stored in the local device is not comprehensive enough. Taking face images as an example, the device terminal may only store 100,000 face images, while the server can store tens of millions of face images. . Therefore, the local recognition may only store the face image of the registered account, not including the face image of the non-registered account. If the registered user A looks very similar to the non-registered user B, then the non-registered user B pays with face recognition. , if it is local identification, there is a high probability that it will be mistakenly identified as registered user A, therefore, it will cause registered user A's property loss. In addition, the server also stores risk data models for attack prevention. These risk data models often occupy a large amount of memory and cannot be stored on local devices. If only local identification is used, the risk probability is also relatively large. For example, within one hour, registered user C uses face-swiping to pay from two cities, one city is Beijing and the other is Lhasa. Obviously, this is impossible in terms of time. Therefore, it is determined that registered user C’s Account may be compromised. However, the local device does not store this risk model. Therefore, this risk cannot be identified. If the face-scanning payment is successful, it will cause losses to the registered user C's property.

Specifically, in the prior art, the method of face-swiping payment using cloud recognition is as follows:

After the local device collects the face image information, it sends the face image information to the server in the cloud. After the server receives the face image information, it searches the database for face recognition. After the face recognition is successful, the recognition result will be sent to the local device. After receiving the identification result, the local device displays the identification result on the display screen and asks the user whether to make payment. After the user clicks the payment confirmation button, the local device sends the deduction information to the server in the cloud, and the server in the cloud determines the debit account and completes the deduction. Then, the information of the completion of the deduction is sent to the local device, and displayed on the display screen to notify the user that the payment has been completed.

In the above solution, the user can confirm whether the payment is completed only when the cloud recognition result is returned to the local device. Due to the long time for cloud recognition (assuming that the time is 3 seconds), in this process, the user can only wait. The time of cloud recognition plus the time of user payment confirmation (assuming the time is 3 seconds), then the entire payment process takes 6 seconds.

In order to solve the defects in the prior art, this scheme provides the following examples:

Based on the above problems in the prior art, the embodiments of the present specification provide a face-scanning payment method that improves user experience without reducing security.

FIG. 1 is a schematic flowchart of an overall solution of a payment method based on face recognition in an embodiment of the specification. As shown in FIG. 1 , the method includes: collecting a face image, then using local recognition and cloud recognition respectively for the face image, and displaying a user confirmation interface after the local recognition result is returned. In the process of user confirmation, wait for the cloud recognition result, and then jointly determine the payment account according to the cloud recognition result, the local recognition result and the user confirmation result.

In this way, since the user confirmation interface is displayed after the local identification (assumed time is 2 seconds), the cloud identification result is also returned to the local device within the time of user payment confirmation (assumed time is 3 seconds), then the entire The payment process takes 5 seconds, and the time determined by the user's payment is used to wait for the cloud recognition result, which shortens the total time of the payment process and the waiting time of the user. The final recognition result is determined by the cloud recognition result and the local recognition result. It is determined together with the user confirmation result, which also improves security.

Through the asynchronous decision-making method, this scheme utilizes the "time difference" of the user's waiting in the interactive link, shortens the time of the overall payment process, and integrates the local identification result and the cloud identification result as the final judgment basis, which improves the payment security.

Next, a payment method based on face recognition provided by the embodiments of the description will be described in detail with reference to the accompanying drawings:

FIG. 2 is a schematic flowchart of a payment method based on face recognition provided by an embodiment of the present specification. From a program perspective, the execution body of the process may be a program mounted on an application server or an application client. From the perspective of an executive body, the method is applied to a terminal device.

As shown in Figure 2, the process can include the following steps:

Step 202: Obtain face image information, where the face image information is the face image information obtained during the payment process based on face recognition.

It should be noted that the methods based on face recognition in the embodiments of this specification are generally applied to payment terminals, and payment terminals may refer to self-checkout electronic devices that implement self-service shopping, or face-scanning payment devices set at manual checkout counters. , can be set in supermarkets, hospitals, subways, shopping malls, restaurants and other places.

When using face-scanning payment, the face image information of the payer needs to be collected first. The camera device on the terminal equipment can be used for acquisition. Wherein, the instruction for face image collection may be directly set off after the payer or the cashier selects the payment method of face-swiping payment; it may also be a special button set on the terminal device of face-swiping payment. When the payment by face recognition is selected, a button to start the collection of face image information will be displayed on the display screen. When this button is clicked, the camera starts to run and collects face images within the set range.

Step 204: Send the face image information to the server.

After acquiring the face image information, the terminal device can send the face image information to the server, so that the server can identify the face image information and obtain a cloud recognition result.

Step 206: Recognize the face image information to determine a first recognition result.

The acquired face image information can also be recognized by using a local database, that is, local recognition, and a local recognition result can be obtained. The first recognition result is a local recognition result.

It should be noted that the first recognition result may include registered account information corresponding to the face image information, and the registered account information may be a registered account number, user name, or contact information, and the like. The registered account may be an email address, name, or mobile phone number, etc.

It should be noted that there is no sequence between step 204 and step 206, and they may be performed simultaneously after step 202 is performed. For example, two threads may be used to perform the above two steps respectively.

Step 208: After determining the first identification result, display a first payment interface on the display screen, where the first payment interface includes a first payment confirmation button.

When the local identification result is completed, that is, after the first identification result is determined, the user payment confirmation interface, that is, the first payment interface, can be displayed on the display screen. On the first payment interface, payment amount information and a first payment confirmation button may be included. After the user clicks the first payment confirmation button, the payment can be completed.

In some cases, the first payment interface may further include payment account information corresponding to the first identification result, for prompting the user to confirm the payment account information. If the payment account information displayed on the first payment interface is not the account information of the face-swiping payment user, the user may choose to reject the payment.

In other cases, the first payment interface may also not include payment account information corresponding to the first identification result, and the payment account information is displayed on the payment successful interface after the payment is completed.

Since the local recognition is faster than the cloud recognition, after obtaining the local recognition result, the user payment confirmation interface is displayed, which can reduce the waiting time of the user. While waiting for the user to confirm the result, you can wait for the cloud recognition result.

Step 210: After obtaining the click operation on the first payment confirmation button, obtain the first payment of the face image information received by the server within a preset time after the first payment interface is displayed. 2. Identification results.

Since cloud recognition is slower than local recognition, the terminal device may receive the cloud recognition result returned by the server, that is, the second recognition result for the face image information, during the period when the user payment confirmation interface is displayed. In this case, the second identification result may be stored first, and after the user confirms the payment, that is, after clicking the first payment confirmation button, the second identification result may be obtained from the storage address.

Step 212: Determine whether the first identification result is consistent with the second identification result, and obtain a first determination result.

Since there are two recognition results for the face image information, namely the first recognition result and the second recognition result, it is first necessary to determine whether the two recognition results are the same.

Step 214: When the first determination result indicates that the first identification result is consistent with the second identification result, make payment based on the first identification result.

In most cases, the first identification result and the second identification result are consistent, and in this case, the terminal device can use the account information corresponding to the first identification result to pay.

It should be noted that, after the first identification result is determined, some preprocessing operations of the payment service can be performed according to the first identification result while waiting for the user to confirm the payment, such as generating a deduction request. After the second identification result is the same, the next operation can be performed directly according to the previous preprocessing operation, and the deduction request is sent to the server, which can further save a part of the processing time.

It should be understood that the order of some steps in the method described in one or more embodiments of this specification may be interchanged according to actual needs, or some steps may be omitted or deleted.

The method in Fig. 2 uses local recognition and cloud recognition to recognize the collected face images. After the local recognition result is returned, the user confirmation interface is displayed instead of the user confirmation interface after the cloud recognition result is obtained. In the process of user confirmation, it waits for the cloud recognition result, and uses the time of user payment confirmation in the interactive link to wait for the cloud recognition result, which shortens the total time of the payment process and shortens the waiting time of users. Then, the payment account is jointly determined according to the cloud recognition result, the local recognition result and the user confirmation result, which also improves the security of payment.

Based on the method of FIG. 2 , some specific implementations of the method are also provided in the examples of this specification, which will be described below.

Optionally, the payment based on the first identification result may specifically include:

Determine the first account information corresponding to the face image information based on the first recognition result;

generating a first debit request for the first account corresponding to the first account information;

Sending the first debit request to the server.

In some embodiments, the first identification result may include first account information, and may also include relevant information for determining the first account information, such as name, contact information, and the like. A first debit request may be generated according to the payment request and the first account information, where the first debit request may include a debit account and a debit amount. The debit account may be the first account information, or may be the financial account information of the account corresponding to the first account information.

The first debit request is sent to the server, so that the server completes deduction according to the first debit request. The deduction channel can be determined according to the deduction method in the first account, and then the deduction is completed according to the deduction channel.

After the deduction is completed, the server can send the successful deduction information to the device terminal, and the device terminal controls the display screen to display the payment success information. In some embodiments, if the first identification result is not included in the first payment interface in step 208, the above-mentioned payment success information may include first account information.

For example, obtain face image information, and send the face image information to a server in the cloud. The local database is used to retrieve the face image information to obtain a local recognition result. Assuming that the local recognition is successful, the detected face image information is consistent with the face image of the registered account A. After the local identification result is obtained, the first payment interface will be displayed immediately, which will display the user's corresponding account information and payment information, such as "XXX account, your current payment amount is XXX yuan, whether to pay", among which, also There will be two buttons "Yes" and "No". While waiting for the user's confirmation, the terminal device will receive the cloud recognition result. Assuming that the cloud recognition result is also the registered account A, then when the user clicks the button "Yes", it will directly determine that the registered account A is the account information corresponding to the face-swiping payment user. , determine the deduction information according to the account information and the deduction amount information, and then send the deduction information to the server in the cloud. The server in the cloud determines the debit account according to the account information, obtains the automatic deduction settings in the deduction account, determines the deduction channel according to the automatic deduction settings, and completes the deduction from the account corresponding to the deduction channel. After the deduction is completed, the server in the cloud will send the information of successful deduction to the local device, and the local device will display the message "Successful payment" on the display.

Different from the above embodiments, in some embodiments, the first payment interface may further include first account information, and the specific steps are as follows:

After recognizing the face image information and determining the first recognition result, the method may further include:

Determine the first account information corresponding to the face image information according to the first recognition result;

The displaying of the first payment interface on the display screen may specifically include:

A first payment interface is displayed on the display screen, and the first payment interface includes the first account information and a first payment confirmation button.

Through the above method, displaying the first account information on the first payment interface is helpful for the face-swiping payment user to confirm the debit account. If the first account information is different from the face-swiping payment user's account, adjustments can be made in time.

In this embodiment, since the first payment interface displays the first account information, in order to avoid repeated display, after the payment is successful, when the payment success information is displayed on the display screen, if the account information actually deducted is the same as the first account information At the same time, the payment success information may not include the first account information.

Optionally, in a small number of cases, there are also cases where the first recognition result and the second recognition result are different, and the following methods can be used for processing at this time;

When the first judgment result indicates that the first recognition result is inconsistent with the second recognition result, determining the second account information corresponding to the face image information based on the second recognition result;

generating a second debit request for the second account corresponding to the second account information;

Sending the second debit request to the server.

Since the accuracy rate of the cloud recognition result is higher than that of the local recognition result, when the cloud recognition result is inconsistent with the local recognition result, the cloud recognition result can be the main one, that is, the second recognition result corresponding to the cloud recognition result is used for pay.

For example, when the local recognition result is registered account A and the cloud recognition result is registered account B, considering that the accuracy rate of cloud recognition is higher than that of local recognition, registered account B is determined as the account corresponding to the face-swiping payment user. Then, the registered account B is sent to the server in the cloud, and the server deducts the corresponding payment amount from the registered account B.

Optionally, after the sending the second debit request to the server, it may further include:

receiving a processing result of the server for the second debit request, where the processing result includes the second account information and debit information for the second account;

The processing result is displayed on the display screen.

In some embodiments, if the first payment interface in step 208 does not include the first account information, in order for the user to determine which account is used for payment, the second account information determined by the cloud identification result may be displayed on the display screen. show.

If the first payment interface in step 208 includes the first account information, since the actual debit account is different from the debit account confirmed by the user, the second account information determined by the cloud identification result can also be displayed on the display screen at this time. .

Optionally, if the first payment interface in step 208 includes the first account information, and the actual debit account is the second account corresponding to the cloud identification result, the method can also be used for processing:

Before the generating a second debit request for the second account corresponding to the second account information, the method may further include:

displaying a second payment interface on the display screen, the second payment interface including the second account information and a second payment confirmation button;

Judging whether a click operation for the second payment confirmation button is obtained, and a second judgment result is obtained;

The generating a second debit request for the second account corresponding to the second account information specifically includes:

When the second judgment result indicates that a click operation for the second payment confirmation button is obtained, a second debit request for the second account corresponding to the second account information is generated.

Since the first payment interface in step 208 includes the first account information, that is, the account to which the user confirms the payment is the first account, when the first identification result is different from the second identification result, and the second identification result is directly used for payment, there may be affect the user experience. In order to solve this technical problem, in this embodiment, before deduction, a second payment interface is displayed on the display screen, wherein the second payment interface includes the second account information, which is used to prompt the user whether to confirm to use the second account for payment. After the user clicks the second payment confirmation button, a second deduction request for the second account may be generated, so as to complete the deduction for the second account.

Optionally, the method may also include:

When the first judgment result indicates that the first identification result is inconsistent with the second identification result, after it is determined that the second identification result indicates that a second test is performed on the user, display on the display screen for Input box for entering account verification information;

obtaining the verification information entered in the input box;

Judging whether the verification information is consistent with the reserved information of the account information corresponding to the first identification result, and obtaining a third judgment result;

When the third judgment result indicates that the verification information is consistent with the reserved information of the account information corresponding to the first identification result, payment is made based on the first identification result.

It should be noted that the second recognition result may include the recognition result of the face image information, and may also include risk prompt information. If there are two registered accounts corresponding to the collected face image information, and the similarity is the same, such as the users of the two registered accounts are twin brothers, other methods can be used to verify at this time, such as filling in the information related to the registered account. .

The verification information can be the associated information of the registered account, such as mobile phone number, ID number, email address, etc. After acquiring the verification information input by the user, the terminal device can determine whether the verification information is consistent with the reserved information of the first account information, and if so, the first account information can be used for payment. In addition, the verification information can also be sent to a server in the cloud, and the server can determine whether the verification information is consistent with the reserved information of the first account information, or the server can determine the registered account corresponding to the verification information. If the registered account is the same as the first identification result, the first identification result can be used for direct payment; if it is different, the first identification result is rejected for payment, or the registered account corresponding to the verification information is used for payment.

For example, when the local identification result is registered account A, and the cloud identification result is that the second verification is required, the local device will perform another verification. For example, "Please fill in the mobile phone number of the registered account" is displayed on the screen. After the user fills in the mobile phone number, the local device sends the mobile phone number to the server in the cloud. The server jointly determines a registered account according to the face image information and the mobile phone number, and then sends the registered account to the local device. If the cloud recognition result is also registered account A, then use registered account A for payment; if the cloud recognition result is registered account B, then use registered account B for payment.

Optionally, the method may also include:

When the second recognition result indicates that the account corresponding to the face image information has a payment risk, the payment based on face recognition is terminated;

The payment failure information and risk prompt information are displayed on the display screen.

In some embodiments, when the local identification result is the registered account A, and the cloud identification result reports an error, when the local device obtains the cloud identification result, it is determined that there is a security problem in the payment, and the payment operation is not performed, and the display screen The message "Payment Failed" is displayed. The security problem at this time can be: cross-regional payment in a short time, but it is actually impossible to achieve, for example, continuous payment in Beijing and Hainan within one hour, it can be determined that there is a security problem at this time.

In addition, risk prompt information may also be displayed on the payment failure interface, and the risk prompt information may include existing problems and solutions. If it is a short-term cross-regional payment, the risk prompt information may include: the time and place of the last payment, the time and place of the application for payment this time, and the risk of account theft, and the user is advised to verify it, etc.

Optionally, the sending the face image information to the server may specifically include:

Using another thread to send the face image information to the server;

The acquiring the second recognition result of the face image information received by the server within a preset time after the first payment interface is displayed, specifically includes:

The second recognition result of the face image information received by the server and received by the other thread is acquired within a preset time after the first payment interface is displayed.

In order to satisfy the simultaneous relationship, two threads executed at the same time can be used to perform local identification and cloud identification respectively. That is, one thread is used for local identification, and another thread is used for cloud identification. After acquiring the face image information, a new thread can be created to send the face image information to the server. The second identification result sent by the server may also be directly sent to the other thread for storage. If the second identification result needs to be obtained, the other thread can be used to obtain it.

Wherein, execute the thread of “acquiring the second recognition result of the face image information received by the server within the preset time after the first payment interface is displayed”, and execute the thread of “acquiring the face image information of the face”. The image information is identified, and it is determined that the first identification result "can be the same thread or two threads.

Optionally, the method may also include:

If the other thread does not receive the second recognition result of the face image information by the server within a preset time after the first payment interface is displayed, payment is made based on the first recognition result .

In this embodiment, since the time difference between the cloud recognition and the local recognition is about one second, if the second recognition result is not received within the preset time, it may indicate that the server is faulty, such as downtime. In order not to affect the user experience , at this time, the local identification result can be used for payment. In addition, the face-swiping payment user can also be prompted to use other payment methods to pay.

Based on the same idea, the embodiments of the present specification also provide a device corresponding to the above method. FIG. 3 is a schematic structural diagram of a payment device based on face recognition corresponding to FIG. 2 according to an embodiment of the present specification. As shown in Figure 3, the device may include:

A face image obtaining module 302, configured to obtain face image information, where the face image information is the face image information obtained during the payment process based on face recognition;

a face image sending module 304, configured to send the face image information to a server;

a first recognition result determination module 306, configured to recognize the face image information and determine a first recognition result;

a first payment interface display module 308, configured to display a first payment interface on the display screen after determining the first identification result, where the first payment interface includes a first payment confirmation button;

The second identification result obtaining module 310 is configured to obtain, after obtaining the click operation on the first payment confirmation button, obtain the information received by the server within a preset time after the first payment interface is displayed the second recognition result of the face image information;

A first judgment module 312, configured to judge whether the first identification result is consistent with the second identification result, and obtain a first judgment result;

The first payment module 314 is configured to perform payment based on the first recognition result when the first judgment result indicates that the first recognition result is consistent with the second recognition result.

The device in FIG. 3 uses local recognition and cloud recognition to identify the collected face images. After the local recognition result is returned, the user confirmation interface is displayed instead of the user confirmation interface after the cloud recognition result is obtained. In the process of confirmation, it waits for the cloud recognition result, and uses the time of user payment confirmation in the interaction process to wait for the cloud recognition result, which shortens the total time of the payment process and shortens the waiting time of users. Then, the payment account is jointly determined according to the cloud recognition result, the local recognition result and the user confirmation result, so as to improve the security of payment.

Based on the device in FIG. 3 , some specific implementations of the method are also provided in the embodiments of this specification, which will be described below.

Optionally, the first payment module 314 may specifically include:

a first account information determination unit, configured to determine the first account information corresponding to the face image information based on the first recognition result;

a first debit request generating unit, configured to generate a first debit request for the first account corresponding to the first account information;

A first debit request sending unit, configured to send the first debit request to the server.

Optionally, the device may also include:

a first account information determination module, configured to determine the first account information corresponding to the face image information according to the first recognition result;

The first payment interface display module 308 is specifically configured to display a first payment interface on the display screen, where the first payment interface includes the first account information and a first payment confirmation button.

Optionally, the device may also include:

A second account information determination module, configured to determine, based on the second identification result, the first identification result corresponding to the face image information when the first determination result indicates that the first identification result is inconsistent with the second identification result. 2. Account information;

A second debit request generating module, configured to generate a second debit request for the second account corresponding to the second account information;

A second debit request sending module, configured to send the second debit request to the server.

Optionally, the device may also include:

a processing result receiving module, configured to receive a processing result of the server for the second debit request, where the processing result includes the second account information and debit information for the second account;

The processing result display module is used for displaying the processing result on the display screen.

Optionally, the device may also include:

a second payment interface display module, configured to display a second payment interface on the display screen, where the second payment interface includes the second account information and a second payment confirmation button;

a second judgment module, configured to judge whether a click operation for the second payment confirmation button is obtained to obtain a second judgment result;

The second debit request generation module is configured to generate a second account for the second account corresponding to the second account information when the second judgment result indicates that a click operation for the second payment confirmation button is obtained. Chargeback request.

Optionally, the device may also include:

The verification information input module is configured to, when the first judgment result indicates that the first identification result is inconsistent with the second identification result, after it is determined that the second identification result indicates that the user is to be checked twice An input box for inputting account verification information is displayed on the display screen;

a verification information acquisition module, used to acquire the verification information input in the input box;

a third judgment module, configured to judge whether the verification information is consistent with the reserved information of the account information corresponding to the first identification result, and obtain a third judgment result;

A second payment module, configured to perform payment based on the first identification result when the third judgment result indicates that the verification information is consistent with the reserved information of the account information corresponding to the first identification result.

Optionally, the device may also include:

a payment termination module, configured to terminate the payment based on face recognition when the second recognition result indicates that the account corresponding to the face image information has a payment risk;

An information prompt module, used for displaying payment failure information and risk prompt information on the display screen.

Optionally, the face image sending module 304 is specifically configured to use another thread to send the face image information to the server;

The second identification result obtaining module 310 is specifically configured to obtain the second identification result of the face image information received by the server received by the other thread within a preset time after the first payment interface is displayed. Identify the results.

Optionally, the device may also include:

The third payment module is configured to, if within a preset time after the first payment interface is displayed, the other thread does not receive the second recognition result of the face image information by the server, based on the Pay according to the first identification result.

Based on the same idea, the embodiments of this specification also provide a device corresponding to the above method.

FIG. 4 is a schematic structural diagram of an electronic device corresponding to FIG. 2 according to an embodiment of the present specification. As shown in FIG. 4, device 400 may include:

at least one processor 410; and,

a memory 430 in communication with the at least one processor; wherein,

The memory 430 stores instructions 420 executable by the at least one processor 410, the instructions being executed by the at least one processor 410 to enable the at least one processor 410 to:

Obtaining face image information, the face image information is the face image information obtained in the payment process based on face recognition;

sending the face image information to a server, so that the server can identify the face image information;

Recognizing the face image information to determine a first recognition result;

After the first identification result is determined, a first payment interface is displayed on the display screen, and the first payment interface includes a first payment confirmation button;

After obtaining the click operation on the first payment confirmation button, obtain the second recognition result of the face image information received by the server within a preset time after the first payment interface is displayed ;

Judging whether the first recognition result is consistent with the second recognition result, and obtaining a first judgment result;

When the first determination result indicates that the first identification result is consistent with the second identification result, payment is made based on the first identification result.

Based on the same idea, the embodiments of the present specification also provide a computer-readable medium corresponding to the above method. The computer-readable medium has computer-readable instructions stored thereon, and the computer-readable instructions are executable by a processor to implement the following methods:

Obtaining face image information, the face image information is the face image information obtained in the payment process based on face recognition;

sending the face image information to a server, so that the server can identify the face image information;

Recognizing the face image information to determine a first recognition result;

After the first identification result is determined, a first payment interface is displayed on the display screen, and the first payment interface includes a first payment confirmation button;

After obtaining the click operation on the first payment confirmation button, obtain the second recognition result of the face image information received by the server within a preset time after the first payment interface is displayed ;

Judging whether the first recognition result is consistent with the second recognition result, and obtaining a first judgment result;

When the first determination result indicates that the first identification result is consistent with the second identification result, payment is made based on the first identification result.

Each embodiment in this specification is described in a progressive manner, and the same and similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the electronic coupon sending device shown in FIG. 3 , since it is basically similar to the method embodiment, the description is relatively simple, and for related parts, please refer to the partial description of the method embodiment.

In the 1990s, an improvement in a technology could be clearly differentiated between improvements in hardware (for example, improvements in circuit structures such as diodes, transistors, switches, etc.) or improvements in software (improvements in method flow). However, with the development of technology, the improvement of many methods and processes today can be regarded as a direct improvement of the hardware circuit structure. Designers almost get the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that the improvement of a method flow cannot be realized by hardware entity modules. For example, a Programmable Logic Device (PLD) such as a Field Programmable Gate Array (FPGA) is an integrated circuit whose logical function is determined by the user programming the device. It is programmed by the designer to "integrate" a digital character system on a PLD, without the need for a chip manufacturer to design and manufacture a dedicated integrated circuit chip. And, instead of making integrated circuit chips by hand, these days, most of this programming is done using "logic compiler" software, which is similar to the software compilers used in program development and writing, but before compiling The original code also has to be written in a specific programming language, which is called Hardware Description Language (HDL), and there is not only one HDL, but many kinds, such as ABEL (Advanced Boolean Expression Language) , AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc. The most commonly used ones are VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog. It should also be clear to those skilled in the art that a hardware circuit for implementing the logic method process can be easily obtained by simply programming the method process in the above-mentioned several hardware description languages and programming it into the integrated circuit.

The controller may be implemented in any suitable manner, for example, the controller may take the form of eg a microprocessor or processor and a computer readable medium storing computer readable program code (eg software or firmware) executable by the (micro)processor , logic gates, switches, application specific integrated circuits (ASICs), programmable logic controllers and embedded microcontrollers, examples of controllers include but are not limited to the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicon Labs C8051F320, the memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art also know that, in addition to implementing the controller in the form of pure computer-readable program code, the controller can be implemented as logic gates, switches, application-specific integrated circuits, programmable logic controllers and embedded devices by logically programming the method steps. The same function can be realized in the form of a microcontroller, etc. Therefore, such a controller can be regarded as a hardware component, and the devices included therein for realizing various functions can also be regarded as a structure within the hardware component. Or even, the means for implementing various functions can be regarded as both a software module implementing a method and a structure within a hardware component.

The systems, devices, modules or units described in the above embodiments may be specifically implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device Or a combination of any of these devices.

For the convenience of description, when describing the above device, the functions are divided into various units and described respectively. Of course, when implementing the present application, the functions of each unit may be implemented in one or more software and/or hardware.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block in the flowcharts and/or block diagrams, and combinations of flows and/or blocks in the flowcharts and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in one or more of the flowcharts and/or one or more blocks of the block diagrams.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions An apparatus implements the functions specified in a flow or flows of the flowcharts and/or a block or blocks of the block diagrams.

These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in one or more of the flowcharts and/or one or more blocks of the block diagrams.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

Memory may include non-persistent memory in computer readable media, random access memory (RAM) and/or non-volatile memory in the form of, for example, read only memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media includes both persistent and non-permanent, removable and non-removable media, and storage of information may be implemented by any method or technology. Information may be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash Memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD), or other optical storage , magnetic tape cartridges, magnetic tape-disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media, such as modulated data signals and carrier waves.

It should also be noted that the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device comprising a series of elements includes not only those elements, but also Other elements not expressly listed, or which are inherent to such a process, method, article of manufacture, or apparatus are also included. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article of manufacture, or device that includes the element.

It will be appreciated by those skilled in the art that the embodiments of the present application may be provided as a method, a system or a computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including storage devices.

The above descriptions are merely examples of the present application, and are not intended to limit the present application. Various modifications and variations of this application are possible for those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included within the scope of the claims of this application.

Claims (18)

1. A payment method based on face recognition is applied to terminal equipment and comprises the following steps:

acquiring face image information, wherein the face image information is acquired in a payment process based on face recognition;

sending the face image information to a server;

identifying the face image information to determine a first identification result;

after determining the first recognition result, displaying a first payment interface on a display screen, the first payment interface comprising a first payment confirmation button;

after the click operation on the first payment confirmation button is acquired, acquiring a second recognition result of the server for the face image information, which is received within a preset time after the first payment interface is displayed;

judging whether the first recognition result is consistent with the second recognition result or not to obtain a first judgment result;

when the first judgment result shows that the first identification result is consistent with the second identification result, payment is carried out based on the first identification result;

paying based on the first recognition result, specifically comprising:

determining first account information corresponding to the face image information based on the first recognition result;

generating a first deduction request of a first account corresponding to the first account information;

sending the first deduction request to the server;

when the first judgment result shows that the first recognition result is inconsistent with the second recognition result, determining second account information corresponding to the face image information based on the second recognition result;

generating a second deduction request of a second account corresponding to the second account information;

and sending the second deduction request to the server.

2. The method of claim 1, after said identifying the face image information, determining a first identification result, the method further comprising:

determining first account information corresponding to the face image information according to the first identification result;

the displaying of the first payment interface on the display screen specifically includes:

displaying a first payment interface on a display screen, the first payment interface including the first account information and a first payment confirmation button.

3. The method of claim 1, after said sending the second deduction request to the server, further comprising:

receiving a processing result of the server for the second deduction request, wherein the processing result comprises the second account information and deduction information for the second account;

and displaying the processing result on the display screen.

4. The method of claim 1, prior to the generating a second debit request for a second account to which the second account information corresponds, further comprising:

displaying a second payment interface on the display screen, the second payment interface including the second account information and a second payment confirmation button;

judging whether click operation aiming at the second payment confirmation button is acquired or not to obtain a second judgment result;

the generating a second deduction request for a second account corresponding to the second account information specifically includes:

and when the second judgment result indicates that the click operation for the second payment confirmation button is acquired, generating a second deduction request for a second account corresponding to the second account information.

5. The method of claim 1, further comprising:

when the first judgment result shows that the first identification result is inconsistent with the second identification result, displaying an input box for inputting account verification information on the display screen after determining that the second identification result shows that the user is subjected to secondary verification;

acquiring verification information input in the input box;

judging whether the verification information is consistent with the reserved information of the account information corresponding to the first identification result or not, and obtaining a third judgment result;

and when the third judgment result shows that the verification information is consistent with the reservation information of the account information corresponding to the first identification result, payment is carried out based on the first identification result.

6. The method of claim 1, further comprising:

when the second recognition result shows that the account corresponding to the face image information has payment risk, terminating payment based on face recognition;

and displaying information of payment failure and risk prompt information on the display screen.

7. The method according to claim 1, wherein the sending the face image information to a server specifically comprises:

sending the face image information to a server by adopting another thread;

the acquiring a second recognition result of the server for the face image information, which is received within a preset time after the first payment interface is displayed, specifically includes:

and acquiring a second recognition result of the facial image information received by the other thread from the server within a preset time after the first payment interface is displayed.

8. The method of claim 7, further comprising:

and if the other thread does not receive a second recognition result of the server for the face image information within the preset time after the first payment interface is displayed, performing payment based on the first recognition result.

9. A payment device based on face recognition, comprising:

the system comprises a face image acquisition module, a face recognition module and a payment module, wherein the face image acquisition module is used for acquiring face image information, and the face image information is acquired in a payment process based on face recognition;

the face image sending module is used for sending the face image information to a server;

the first recognition result determining module is used for recognizing the face image information and determining a first recognition result;

the first payment interface display module is used for displaying a first payment interface on a display screen after the first recognition result is determined, wherein the first payment interface comprises a first payment confirmation button;

the second recognition result acquisition module is used for acquiring a second recognition result of the server for the face image information, which is received within the preset time after the first payment interface is displayed, after the click operation of the first payment confirmation button is acquired;

the first judgment module is used for judging whether the first identification result is consistent with the second identification result or not to obtain a first judgment result;

the first payment module is used for paying based on the first identification result when the first judgment result shows that the first identification result is consistent with the second identification result;

the second account information determining module is used for determining second account information corresponding to the face image information based on the second recognition result when the first judgment result shows that the first recognition result is inconsistent with the second recognition result;

the second deduction request generating module is used for generating a second deduction request of a second account corresponding to the second account information;

the second deduction request sending module is used for sending the second deduction request to the server;

the first payment module specifically comprises:

a first account information determining unit, configured to determine, based on the first recognition result, first account information corresponding to the face image information;

the first deduction request generating unit is used for generating a first deduction request of a first account corresponding to the first account information;

and the first deduction request sending unit is used for sending the first deduction request to the server.

10. The apparatus of claim 9, the apparatus further comprising:

the first account information determining module is used for determining first account information corresponding to the face image information according to the first recognition result;

the first payment interface display module is specifically configured to display a first payment interface on a display screen, where the first payment interface includes the first account information and a first payment confirmation button.

11. The apparatus of claim 9, the apparatus further comprising:

a processing result receiving module, configured to receive a processing result of the server for the second deduction request, where the processing result includes the second account information and deduction information for the second account;

and the processing result display module is used for displaying the processing result on the display screen.

12. The apparatus of claim 9, the apparatus further comprising:

the second payment interface display module is used for displaying a second payment interface on the display screen, and the second payment interface comprises the second account information and a second payment confirmation button;

the second judgment module is used for judging whether the click operation aiming at the second payment confirmation button is acquired or not to acquire a second judgment result;

and the second deduction request generating module is configured to generate a second deduction request for a second account corresponding to the second account information when the second judgment result indicates that a click operation for the second payment confirmation button is acquired.

13. The apparatus of claim 9, the apparatus further comprising:

the verification information input module is used for displaying an input frame for inputting account verification information on the display screen after determining that the second identification result represents that the user is subjected to secondary verification when the first judgment result represents that the first identification result is inconsistent with the second identification result;

the verification information acquisition module is used for acquiring the verification information input in the input box;

the third judging module is used for judging whether the verification information is consistent with the reserved information of the account information corresponding to the first identification result or not to obtain a third judgment result;

and the second payment module is used for paying based on the first identification result when the third judgment result shows that the verification information is consistent with the reserved information of the account information corresponding to the first identification result.

14. The apparatus of claim 9, the apparatus further comprising:

the payment termination module is used for terminating payment based on face recognition when the second recognition result shows that the account corresponding to the face image information has payment risk;

and the information prompt module is used for displaying information of payment failure and risk prompt information on the display screen.

15. The apparatus according to claim 9, wherein the facial image sending module is specifically configured to send the facial image information to a server by using another thread;

and the second recognition result acquisition module is specifically configured to acquire, within a preset time after the first payment interface is displayed, a second recognition result of the server for the face image information, which is received by the other thread.

16. The apparatus of claim 15, the apparatus further comprising:

and the third payment module is used for paying based on the first recognition result if the other thread does not receive the second recognition result of the server for the face image information within the preset time after the first payment interface is displayed.

17. An electronic device, comprising:

at least one processor; and the number of the first and second groups,

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to:

acquiring face image information, wherein the face image information is acquired in a payment process based on face recognition;

sending the face image information to a server;

identifying the face image information to determine a first identification result;

after determining the first recognition result, displaying a first payment interface on a display screen, the first payment interface comprising a first payment confirmation button;

after the click operation on the first payment confirmation button is acquired, acquiring a second recognition result of the server for the face image information, which is received within a preset time after the first payment interface is displayed;

judging whether the first recognition result is consistent with the second recognition result or not to obtain a first judgment result;

when the first judgment result shows that the first identification result is consistent with the second identification result, payment is carried out based on the first identification result;

paying based on the first recognition result, specifically comprising:

determining first account information corresponding to the face image information based on the first recognition result;

generating a first deduction request of a first account corresponding to the first account information;

sending the first deduction request to the server;

when the first judgment result shows that the first recognition result is inconsistent with the second recognition result, determining second account information corresponding to the face image information based on the second recognition result;

generating a second deduction request of a second account corresponding to the second account information;

and sending the second deduction request to the server.

18. A computer readable medium having computer readable instructions stored thereon which are executable by a processor to implement the face recognition based payment method of any one of claims 1 to 8.

Images