CN111340471B

CN111340471B - Payment method, device and equipment based on face recognition

Info

Publication number: CN111340471B
Application number: CN202010440539.4A
Authority: CN
Inventors: 赵鹏飞
Original assignee: Alipay Hangzhou Information Technology Co Ltd
Current assignee: Alipay Hangzhou Information Technology Co Ltd
Priority date: 2020-05-22
Filing date: 2020-05-22
Publication date: 2020-08-21
Anticipated expiration: 2040-05-22
Also published as: CN112150159B; CN111340471A; CN112150159A

Abstract

The embodiment of the specification discloses a payment method, a payment device and payment equipment based on face recognition, wherein the method comprises the following steps: acquiring face image information; sending the face image information to a server; identifying the face image information to determine a first identification result; after determining the first recognition result, displaying a first payment interface on a display screen, wherein the first payment interface comprises a first payment confirmation button; after the click operation on the first payment confirmation button is acquired, acquiring a second recognition result of the server for the face image information, which is received within a preset time after the first payment interface is displayed; judging whether the first recognition result is consistent with the second recognition result or not to obtain a first judgment result; and when the first judgment result shows that the first identification result is consistent with the second identification result, performing payment based on the first identification result.

Description

Payment method, device and equipment based on face recognition

Technical Field

The embodiment of the specification relates to the technical field of computers, in particular to a payment method, a payment device and payment equipment based on face recognition.

Background

In order to improve the convenience of payment, face-brushing payment is increasingly common in supermarkets, shopping malls and subways. When the face is identified, the terminal equipment needs to send the acquired face image to the server at the cloud end, then, after the server at the cloud end identifies, the identification result is sent to the terminal equipment, and the terminal equipment pays according to the identification result sent by the server. However, this process often takes a long time, affecting the user's payment experience. However, if the acquired face image is not sent to the cloud server, but is recognized by the terminal device, the accuracy of the recognition result is reduced due to the limitation to the storage space of the terminal device, and thus the security is affected.

Therefore, a method for face-brushing payment with short time and high safety is needed.

Disclosure of Invention

The embodiment of the specification provides a payment method, a payment device and payment equipment based on face recognition, and aims to solve the problem that the existing payment method based on face recognition consumes long time.

In order to solve the above technical problem, the embodiments of the present specification are implemented as follows:

the embodiment of the specification provides a payment method based on face recognition, which is applied to terminal equipment and comprises the following steps:

acquiring face image information, wherein the face image information is acquired in a payment process based on face recognition;

sending the face image information to a server;

identifying the face image information to determine a first identification result;

after determining the first recognition result, displaying a first payment interface on a display screen, the first payment interface comprising a first payment confirmation button;

after the click operation on the first payment confirmation button is acquired, acquiring a second recognition result of the server for the face image information, which is received within a preset time after the first payment interface is displayed;

judging whether the first recognition result is consistent with the second recognition result or not to obtain a first judgment result;

and when the first judgment result shows that the first identification result is consistent with the second identification result, performing payment based on the first identification result.

An embodiment of this specification provides a payment device based on face identification, includes:

the system comprises a face image acquisition module, a face recognition module and a payment module, wherein the face image acquisition module is used for acquiring face image information, and the face image information is acquired in a payment process based on face recognition;

the face image sending module is used for sending the face image information to a server;

the first recognition result determining module is used for recognizing the face image information and determining a first recognition result;

the first payment interface display module is used for displaying a first payment interface on a display screen after the first recognition result is determined, wherein the first payment interface comprises a first payment confirmation button;

the second recognition result acquisition module is used for acquiring a second recognition result of the server for the face image information, which is received within the preset time after the first payment interface is displayed, after the click operation of the first payment confirmation button is acquired;

the first judgment module is used for judging whether the first identification result is consistent with the second identification result or not to obtain a first judgment result;

and the first payment module is used for paying based on the first identification result when the first judgment result shows that the first identification result is consistent with the second identification result.

An electronic device provided in an embodiment of the present specification includes:

at least one processor; and the number of the first and second groups,

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to:

sending the face image information to a server;

Embodiments of the present specification provide a computer-readable medium having stored thereon computer-readable instructions executable by a processor to implement a payment method based on face recognition.

One embodiment of the present description achieves the following advantageous effects: the collected face image is identified by adopting local identification and cloud identification together, a user confirmation interface is displayed after a local identification result is returned, the user confirmation interface is not displayed after the cloud identification result is obtained, the cloud identification result is waited in the user confirmation link process, the cloud identification result is waited by using the time of user payment confirmation in the interaction link, the total time of a payment process is shortened, and the waiting time of a user is also shortened. And then, determining a payment account together according to the cloud identification result, the local identification result and the user confirmation result so as to improve the payment safety.

Drawings

In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without any creative effort.

Fig. 1 is a schematic overall scheme flow diagram of a payment method based on face recognition provided in an embodiment of the present specification;

fig. 2 is a schematic flowchart of a payment method based on face recognition according to an embodiment of the present disclosure;

fig. 3 is a schematic structural diagram of a payment apparatus based on face recognition, corresponding to fig. 2, provided in an embodiment of the present disclosure;

fig. 4 is a schematic structural diagram of an electronic device corresponding to fig. 2 provided in an embodiment of the present disclosure.

Detailed Description

To make the objects, technical solutions and advantages of one or more embodiments of the present disclosure more apparent, the technical solutions of one or more embodiments of the present disclosure will be described in detail and completely with reference to the specific embodiments of the present disclosure and the accompanying drawings. It is to be understood that the embodiments described are only a few embodiments of the present specification, and not all embodiments. All other embodiments that can be derived by a person skilled in the art from the embodiments given herein without making any creative effort fall within the scope of protection of one or more embodiments of the present specification.

The technical solutions provided by the embodiments of the present description are described in detail below with reference to the accompanying drawings.

In the prior art, in order to improve payment convenience, face-brushing payment is released in many supermarkets, hospitals, subways, shopping malls and restaurants, face-brushing equipment is used for collecting face images, a payment account is determined by identifying the face images, and then money is deducted from the payment account, so that payment can be completed. The payment mode can finish payment without depending on a terminal logged with a payment account of a user, and greatly improves the convenience of payment.

However, the existing face-brushing payment also has a certain problem, and when the face image information is identified, the face image information can be completed by a terminal device (local device for short) for collecting the face image information, or the face image information can be sent to a server at the cloud end by the local device and completed by the server. However, both of these solutions have certain disadvantages.

The server at the cloud end is adopted for face image recognition, so that the time is long, the waiting time of a user is long, and the user experience is poor. Among them, the reason for the slow server identification speed (within 1S of the local device) is that the data transmission process for sending data from the local device to the server takes a long time.

The local equipment is adopted to identify the face image, so that the transmission process of face image information is omitted, the identification speed can be improved, and compared with server identification, the identification accuracy is low and the safety is poor. This is because, limited by the hardware configuration of the local device, the data stored by the local device is not comprehensive enough, and taking a human face image as an example, the device terminal may only be capable of storing hundreds of thousands of human face images, and the server may be capable of storing hundreds of thousands of human face images. Therefore, local recognition may only store the facial image of the registered account, but not the facial image of the unregistered account, and if the registered user a and the unregistered user B are very similar in terms of length, there is a high probability that the unregistered user B is mistakenly recognized as the registered user a if the registered user a and the unregistered user B perform face brushing payment, and therefore property loss of the registered user a may be caused. Moreover, the server also stores anti-attack risk data models, and the risk data models often occupy a large memory and cannot be stored by local equipment, and if only local identification is adopted, the risk probability is also large. For example, the registered user C pays by face brushing from two cities, one is beijing and one is losa, respectively, within one hour, and obviously, it is impossible to implement on a time plane, and therefore, it is determined that the account of the registered user C may be stolen. The local device does not just store the risk model, and therefore cannot identify the risk, and if the face-brushing payment is successful, property of the registered user C is lost.

Specifically, the method for face-brushing payment by cloud identification in the prior art is as follows:

after the local equipment collects the face image information, the face image information is sent to a server at the cloud end, and after the server receives the face image information, the database is retrieved for face recognition. And when the face recognition is successful, the recognition result is sent to the local equipment. The local device displays the recognition result on the display screen after receiving the recognition result, and inquires the user whether to make a payment. After the user clicks the payment confirmation button, the local equipment sends the deduction information to the server at the cloud end, and the server at the cloud end determines the deduction account and finishes deduction. And then sending the information of payment completion to the local equipment, displaying the information on the display screen, and informing the user that the payment is completed.

In the scheme, the user can only confirm whether the payment is finished or not when the cloud identification result is returned to the local equipment. Due to the long time of cloud identification (assuming that the time is 3 seconds), the user can only wait in the process. The time of cloud identification plus the time of user payment confirmation (assuming time is 3 seconds), then the whole payment process takes 6 seconds.

In order to solve the defects in the prior art, the scheme provides the following embodiments:

based on the above problems in the prior art, embodiments of the present specification provide a method for improving user experience in face-brushing payment without reducing security.

Fig. 1 is a schematic flow chart of an overall scheme of a payment method based on face recognition in an embodiment of the present specification. As shown in fig. 1, the method includes: the method comprises the steps of collecting face images, then respectively adopting local recognition and cloud recognition for the face images, and displaying a user confirmation interface after local recognition results are returned. And waiting for the cloud identification result in the process of the user confirmation link, and then jointly determining the payment account according to the cloud identification result, the local identification result and the user confirmation result.

Therefore, the user confirmation interface is displayed after the local recognition (assuming that the time is 2 seconds) is finished, the cloud recognition result is returned to the local equipment within the time (assuming that the time is 3 seconds) of the user payment confirmation, so that the whole payment process needs 5 seconds, the time determined by the user payment is utilized to wait for the cloud recognition result, the total time of the payment process is shortened, the waiting time of the user is also shortened, the final recognition result is determined by the cloud recognition result, the local recognition result and the user confirmation result together, and the safety is also improved.

According to the scheme, the time of a payment total flow is shortened by using a 'time difference' of user waiting in an interaction link in an asynchronous decision mode, a local identification result and a cloud identification result are integrated to be used as a final judgment basis, and the payment safety is improved.

Next, a payment method based on face recognition provided in an embodiment of the specification will be specifically described with reference to the accompanying drawings:

fig. 2 is a schematic flowchart of a payment method based on face recognition according to an embodiment of the present disclosure. From the viewpoint of a program, the execution subject of the flow may be a program installed in an application server or an application client. From the perspective of the executing agent, the method is applied to a terminal device.

As shown in fig. 2, the process may include the following steps:

step 202: the method comprises the steps of obtaining face image information, wherein the face image information is obtained in a payment process based on face recognition.

It should be noted that the method based on face recognition in the embodiment of the present specification is generally applied to a payment terminal, and the payment terminal may refer to a self-service checkout electronic device that realizes self-service shopping, or may be a face-brushing payment device set in a manual checkout counter, and may be set in places such as a supermarket, a hospital, a subway, a shopping mall, and a restaurant.

When the face brushing payment is adopted, firstly, the face image information of a payer needs to be collected. The acquisition can be carried out by adopting a camera device on the terminal equipment. The instruction for acquiring the face image can be directly sent out after a payer or a cashier selects a payment mode of face brushing payment; or a special button arranged on the terminal equipment for face brushing payment. And after the face brushing payment is selected, a button for judging whether to start the acquisition of the face image information is displayed on the display screen. After the button is clicked, the camera device starts to operate, and the human face image in the set range is collected.

Step 204: and sending the face image information to a server.

After the face image information is acquired, the terminal device can send the face image information to the server, so that the server can recognize the face image information to obtain a cloud recognition result.

Step 206: and identifying the face image information and determining a first identification result.

The obtained face image information can be identified by a local database, namely local identification, so as to obtain a local identification result. And the first identification result is a local identification result.

It should be noted that the first recognition result may include registered account information corresponding to the face image information, where the registered account information may be a registered account number, a user name, or a contact address, and so on. The registered account may be a mailbox address, a name, a mobile phone number, or the like.

It should be noted that there is no sequence between step 204 and step 206, and the steps can be performed simultaneously after step 202 is executed. For example, two threads may be used to perform the above two steps, respectively.

Step 208: after determining the first recognition result, displaying a first payment interface on a display screen, the first payment interface including a first payment confirmation button.

When the local recognition result is completed, that is, the first recognition result is determined, a user payment confirmation interface, that is, a first payment interface, may be displayed on the display screen. On the first payment interface, payment amount information and a first payment confirmation button may be included. After the user clicks the first payment confirmation button, the payment may be completed.

In some cases, the first payment interface may further include payment account information corresponding to the first recognition result, and is used to prompt the user to confirm the payment account information. If the payment account information displayed on the first payment interface is not the account information of the user who swipes his face, the user may choose to reject the payment.

In other cases, the first payment interface may not include payment account information corresponding to the first recognition result, and the payment account information is displayed on the interface where the payment is successful after the payment is completed.

Since the local recognition is faster than the recognition speed of the cloud recognition, the user payment confirmation interface is displayed after the local recognition result is obtained, and the waiting time of the user can be reduced. And waiting for the cloud identification result in the period of waiting for the user to confirm the result.

Step 210: and after the clicking operation on the first payment confirmation button is acquired, acquiring a second recognition result of the server for the face image information, which is received within the preset time after the first payment interface is displayed.

Since the speed of cloud recognition is slower than that of local recognition, the terminal device may receive a cloud recognition result returned by the server, that is, a second recognition result for the face image information, during the period of displaying the user payment confirmation interface. In this case, the second recognition result may be stored, and the second recognition result may be obtained from the storage address after the user confirms payment, that is, after the user clicks the first payment confirmation button.

Step 212: and judging whether the first recognition result is consistent with the second recognition result or not to obtain a first judgment result.

Since there are two recognition results, i.e., the first recognition result and the second recognition result, for the face image information, it is first determined whether the two recognition results are the same at the next time.

Step 214: and when the first judgment result shows that the first identification result is consistent with the second identification result, performing payment based on the first identification result.

In most cases, the first recognition result and the second recognition result are consistent, and at this time, the terminal device may perform payment by using account information corresponding to the first recognition result.

It should be noted that after the first identification result is determined, some preprocessing operations of the payment service, such as generating a deduction request, may be performed according to the first identification result while waiting for the user to perform payment confirmation, and after it is determined that the first identification result is the same as the second identification result, the next operation may be directly performed according to the previous preprocessing operation, and the deduction request is sent to the server, so that a part of processing time may be further saved.

It should be understood that the order of some steps in the method described in one or more embodiments of the present disclosure may be interchanged according to actual needs, or some steps may be omitted or deleted.

In the method in fig. 2, the collected face image is identified by both local identification and cloud identification, and after the local identification result is returned, the user confirmation interface is displayed instead of displaying the user confirmation interface after the cloud identification result is obtained, so that the cloud identification result is waited in the user confirmation link process, the cloud identification result is waited by using the time for user payment confirmation in the interaction link, the total time of the payment process is shortened, and the waiting time of the user is also shortened. And then, the payment account is determined jointly according to the cloud identification result, the local identification result and the user confirmation result, so that the payment safety is improved.

Based on the method of fig. 2, the present specification also provides some specific embodiments of the method, which are described below.

Optionally, making a payment based on the first recognition result may specifically include:

determining first account information corresponding to the face image information based on the first recognition result;

generating a first deduction request of a first account corresponding to the first account information;

and sending the first deduction request to the server.

In some embodiments, the first identification result may include the first account information and may also include related information for determining the first account information, such as name, contact address, and the like. A first debit request may be generated based on the payment request and the first account information, wherein the first debit request may include a debit account and a debit amount. The deduction account may be the first account information, or may be financial account information of an account corresponding to the first account information.

And sending the first deduction request to a server so that the server can complete deduction according to the first deduction request. The deduction channel can be determined according to the deduction mode in the first account, and then deduction is completed according to the deduction channel.

After the deduction is completed, the server can send information of successful deduction to the equipment terminal, and the equipment terminal controls the display screen to display information of successful payment. In some embodiments, if the first payment interface of step 208 does not include the first recognition result, the payment success information may include the first account information.

For example, face image information is acquired and sent to a cloud server. And retrieving the face image information by adopting a local database to obtain a local identification result, and detecting that the face image information conforms to the reserved face image of the registered account A on the assumption that the local identification is successful. And immediately displaying a first payment interface after obtaining the local identification result, wherein the interface displays account information corresponding to the user and payment information, such as 'XXX account, pay amount of the current time is XXX element, and whether to pay', and the interface also has two buttons of 'yes' and 'no'. During the period of waiting for confirmation of the user, the terminal equipment receives the cloud identification result, and if the cloud identification result is also the registered account A, when the user clicks the button 'yes', the registered account A is directly determined to be account information corresponding to the user who pays by swiping the face, deduction information is determined according to the account information and deduction amount information, and then the deduction information is sent to the server at the cloud. The server at the cloud end determines a deduction account according to the account information, then obtains automatic deduction setting in the deduction account, then determines a deduction channel according to the automatic deduction setting, and then completes deduction from an account corresponding to the deduction channel. After the deduction is completed, the server at the cloud end sends information of successful deduction to the local equipment, and the local equipment displays information of 'successful payment' on the display screen.

Different from the foregoing embodiment, in some embodiments, the first payment interface may further include first account information, and the specific steps are as follows:

after the identifying the face image information and determining a first identification result, the method may further include:

determining first account information corresponding to the face image information according to the first identification result;

the displaying the first payment interface on the display screen may specifically include:

displaying a first payment interface on a display screen, the first payment interface including the first account information and a first payment confirmation button.

By the method, the first account information is displayed on the first payment interface, so that the confirmation of the face brushing payment user on the deduction account is facilitated, and if the first account information is different from the account of the face brushing payment user, the adjustment can be performed in time.

In this embodiment, since the first payment interface displays the first account information, in order to avoid repeated display, when the payment success information is displayed on the display screen after the payment is successful, if the account information of the actual deduction is the same as the first account information, the payment success information may not include the first account information.

Optionally, in a small part of cases, when the first recognition result is different from the second recognition result, the following method may be adopted for processing at this time;

when the first judgment result shows that the first recognition result is inconsistent with the second recognition result, determining second account information corresponding to the face image information based on the second recognition result;

generating a second deduction request of a second account corresponding to the second account information;

and sending the second deduction request to the server.

Because the accuracy of the cloud identification result is higher than that of the local identification result, when the cloud identification result is inconsistent with the local identification result, the cloud identification result can be used as the main point, namely, the payment is carried out by adopting the second identification result corresponding to the cloud identification result.

For example, when the local identification result is the registered account a and the cloud identification result is the registered account B, considering that the accuracy of the cloud identification is higher than that of the local identification, the registered account B is determined as the account corresponding to the face-brushing payment user. And then, sending the registered account B to a server at the cloud end, and deducting the corresponding payment amount from the registered account B by the server.

Optionally, after the sending the second deduction request to the server, the method may further include:

receiving a processing result of the server for the second deduction request, wherein the processing result comprises the second account information and deduction information for the second account;

and displaying the processing result on the display screen.

In some embodiments, if the first payment interface in step 208 does not include the first account information, the second account information determined by the cloud identification result may be displayed on the display screen in order for the user to determine which account is used for payment.

If the first payment interface in step 208 includes the first account information, since the actual deduction account is different from the deduction account confirmed by the user, the second account information determined by the cloud recognition result may also be displayed on the display screen.

Optionally, if the first payment interface in step 208 includes the first account information and the actual debit account is the second account corresponding to the cloud identification result, the method may further be adopted to perform processing:

before the generating of the second deduction request for the second account corresponding to the second account information, the method may further include:

displaying a second payment interface on the display screen, the second payment interface including the second account information and a second payment confirmation button;

judging whether click operation aiming at the second payment confirmation button is acquired or not to obtain a second judgment result;

the generating a second deduction request for a second account corresponding to the second account information specifically includes:

and when the second judgment result indicates that the click operation for the second payment confirmation button is acquired, generating a second deduction request for a second account corresponding to the second account information.

Since the first payment interface in step 208 includes the first account information, that is, the account that the user confirms payment is the first account, when the first recognition result is different from the second recognition result, the user experience may be affected when the payment is directly performed by using the second recognition result. In order to solve the technical problem, in the embodiment, before deducting money, a second payment interface is displayed on the display screen, where the second payment interface includes second account information for prompting the user whether to confirm that the payment is made using the second account. After the user clicks the second payment confirmation button, a second deduction request for the second account can be generated so as to complete the deduction for the second account.

Optionally, the method may further include:

when the first judgment result shows that the first identification result is inconsistent with the second identification result, displaying an input box for inputting account verification information on the display screen after determining that the second identification result shows that the user is subjected to secondary verification;

acquiring verification information input in the input box;

judging whether the verification information is consistent with the reserved information of the account information corresponding to the first identification result or not, and obtaining a third judgment result;

and when the third judgment result shows that the verification information is consistent with the reservation information of the account information corresponding to the first identification result, payment is carried out based on the first identification result.

It should be noted that the second recognition result may include a recognition result of the face image information, and may further include risk prompt information. If the two registered accounts corresponding to the acquired face image information have the same similarity, if the users of the two registered accounts are twins brothers, the verification can be performed by adopting other modes, such as filling in information related to the registered accounts.

The verification information may be associated information of the registered account, if the mobile phone number, the identification number, the mailbox, and the like. After the verification information input by the user is acquired, the terminal device may determine whether the verification information is consistent with the reservation information of the first account information, and if so, may perform payment using the first account information. In addition, the verification information can be sent to a server at the cloud end, the server judges whether the verification information is consistent with the reserved information of the first account information or not, or the server determines a registered account corresponding to the verification information, if the registered account corresponding to the verification information is the same as the first identification result, the first identification result can be adopted for direct payment, and if the registered account corresponding to the verification information is different from the first identification result, the payment is refused to be carried out by adopting the first identification result, or the payment is carried out by adopting the registered account corresponding to the verification information.

For example, when the local identification result is the registered account a and the cloud identification result is that secondary verification is required, the local device performs another verification, for example, "please fill in the mobile phone number of the registered account" is displayed on the display screen, and after the mobile phone number filled by the user is obtained, the local device sends the mobile phone number to the server at the cloud. And the server determines a registered account according to the facial image information and the mobile phone number, and then sends the registered account to local equipment. And if the cloud identification result is also the registered account A, the registered account A is adopted for payment, and if the cloud identification result is the registered account B, the registered account B is adopted for payment.

Optionally, the method may further include:

when the second recognition result shows that the account corresponding to the face image information has payment risk, terminating payment based on face recognition;

and displaying information of payment failure and risk prompt information on the display screen.

In some embodiments, when the local device obtains the cloud identification result, it is determined that the payment has a security problem, and the payment operation is not executed, and then the information of "payment failure" is displayed on the display screen, if the local identification result is the registered account a and the cloud identification result is reported incorrectly. The security issues at this point may be: a security issue may be determined to exist when payments are made across regions in a short amount of time, such as continuous payments in beijing and hainan for an hour, which is not practically achievable.

In addition, risk prompt information can be displayed on the interface of payment failure, and the risk prompt information can include existing problems and solutions. If the payment is short-time cross-regional payment, the risk prompt message may include: the time and place of the last payment and the time and place of the payment application, and the risk of the stolen number, the user is recommended to verify, and the like.

Optionally, the sending the face image information to a server may specifically include:

sending the face image information to a server by adopting another thread;

the acquiring a second recognition result of the server for the face image information, which is received within a preset time after the first payment interface is displayed, specifically includes:

and acquiring a second recognition result of the facial image information received by the other thread from the server within a preset time after the first payment interface is displayed.

In order to satisfy the simultaneous relationship, two threads which are executed simultaneously can be adopted to respectively perform local identification and cloud identification. That is, the local identification employs one thread, and the cloud identification employs another thread. After the face image information is obtained, a thread can be newly created to send the face image information to the server. And the second identification result sent by the server can also be directly sent to the other thread for storage. And if the second identification result needs to be acquired, the other thread can be acquired.

The method comprises the steps of executing a thread for acquiring a second recognition result of the server for the face image information received within a preset time after the first payment interface is displayed, and executing the thread for recognizing the face image information and determining that the first recognition result can be the same thread or two threads.

Optionally, the method may further include:

and if the other thread does not receive a second recognition result of the server for the face image information within the preset time after the first payment interface is displayed, performing payment based on the first recognition result.

In this embodiment, since the time difference between the cloud identification and the local identification is about one second, if the second identification result is not received within the preset time, it may indicate that the server has a fault, such as a downtime, and at this time, the local identification result may be used for payment in order not to affect the user experience. In addition, the user can be prompted to pay by swiping the face and pay by adopting other payment modes.

Based on the same idea, the embodiment of the present specification further provides a device corresponding to the above method. Fig. 3 is a schematic structural diagram of a payment apparatus based on face recognition, corresponding to fig. 2, provided in an embodiment of the present disclosure. As shown in fig. 3, the apparatus may include:

a face image obtaining module 302, configured to obtain face image information, where the face image information is obtained in a payment process based on face recognition;

a face image sending module 304, configured to send the face image information to a server;

a first recognition result determining module 306, configured to recognize the face image information and determine a first recognition result;

a first payment interface display module 308, configured to display a first payment interface on a display screen after determining the first recognition result, where the first payment interface includes a first payment confirmation button;

a second recognition result obtaining module 310, configured to obtain, after the click operation on the first payment confirmation button is obtained, a second recognition result of the server for the face image information, which is received within a preset time after the first payment interface is displayed;

a first determining module 312, configured to determine whether the first recognition result is consistent with the second recognition result, so as to obtain a first determining result;

and the first payment module 314 is configured to perform payment based on the first identification result when the first determination result indicates that the first identification result is consistent with the second identification result.

According to the device in the figure 3, the collected face image is identified by adopting local identification and cloud identification together, after the local identification result is returned, the user confirmation interface is displayed, the user confirmation interface is not displayed after the cloud identification result is obtained, the cloud identification result is waited in the user confirmation link process, the cloud identification result is waited by using the time of user payment confirmation in the interaction link, the total time of a payment process is shortened, and the waiting time of a user is also shortened. And then, determining a payment account together according to the cloud identification result, the local identification result and the user confirmation result so as to improve the payment safety.

The examples of this specification also provide some specific embodiments of the process based on the apparatus of fig. 3, which is described below.

Optionally, the first payment module 314 may specifically include:

a first account information determining unit, configured to determine, based on the first recognition result, first account information corresponding to the face image information;

the first deduction request generating unit is used for generating a first deduction request of a first account corresponding to the first account information;

and the first deduction request sending unit is used for sending the first deduction request to the server.

Optionally, the apparatus may further include:

the first account information determining module is used for determining first account information corresponding to the face image information according to the first recognition result;

the first payment interface display module 308 is specifically configured to display a first payment interface on a display screen, where the first payment interface includes the first account information and a first payment confirmation button.

Optionally, the apparatus may further include:

the second account information determining module is used for determining second account information corresponding to the face image information based on the second recognition result when the first judgment result shows that the first recognition result is inconsistent with the second recognition result;

the second deduction request generating module is used for generating a second deduction request of a second account corresponding to the second account information;

and the second deduction request sending module is used for sending the second deduction request to the server.

Optionally, the apparatus may further include:

a processing result receiving module, configured to receive a processing result of the server for the second deduction request, where the processing result includes the second account information and deduction information for the second account;

and the processing result display module is used for displaying the processing result on the display screen.

Optionally, the apparatus may further include:

the second payment interface display module is used for displaying a second payment interface on the display screen, and the second payment interface comprises the second account information and a second payment confirmation button;

the second judgment module is used for judging whether the click operation aiming at the second payment confirmation button is acquired or not to acquire a second judgment result;

and the second deduction request generating module is configured to generate a second deduction request for a second account corresponding to the second account information when the second judgment result indicates that a click operation for the second payment confirmation button is acquired.

Optionally, the apparatus may further include:

the verification information input module is used for displaying an input frame for inputting account verification information on the display screen after determining that the second identification result represents that the user is subjected to secondary verification when the first judgment result represents that the first identification result is inconsistent with the second identification result;

the verification information acquisition module is used for acquiring the verification information input in the input box;

the third judging module is used for judging whether the verification information is consistent with the reserved information of the account information corresponding to the first identification result or not to obtain a third judgment result;

and the second payment module is used for paying based on the first identification result when the third judgment result shows that the verification information is consistent with the reserved information of the account information corresponding to the first identification result.

Optionally, the apparatus may further include:

the payment termination module is used for terminating payment based on face recognition when the second recognition result shows that the account corresponding to the face image information has payment risk;

and the information prompt module is used for displaying information of payment failure and risk prompt information on the display screen.

Optionally, the facial image sending module 304 is specifically configured to send the facial image information to a server by using another thread;

the second recognition result obtaining module 310 is specifically configured to obtain, within a preset time after the first payment interface is displayed, a second recognition result of the server for the face image information, where the second recognition result is received by the other thread.

Optionally, the apparatus may further include:

and the third payment module is used for paying based on the first recognition result if the other thread does not receive the second recognition result of the server for the face image information within the preset time after the first payment interface is displayed.

Based on the same idea, the embodiment of the present specification further provides a device corresponding to the above method.

Fig. 4 is a schematic structural diagram of an electronic device corresponding to fig. 2 provided in an embodiment of the present disclosure. As shown in fig. 4, the apparatus 400 may include:

at least one processor 410; and the number of the first and second groups,

a memory 430 communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory 430 stores instructions 420 executable by the at least one processor 410 to enable the at least one processor 410 to:

sending the face image information to a server so that the server can identify the face image information;

Based on the same idea, the embodiment of the present specification further provides a computer-readable medium corresponding to the above method. The computer readable medium has computer readable instructions stored thereon that are executable by a processor to implement the method of:

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the electronic ticket sending device shown in fig. 3, since it is basically similar to the method embodiment, the description is simple, and the relevant points can be referred to the partial description of the method embodiment.

In the 90 s of the 20 th century, improvements in a technology could clearly distinguish between improvements in hardware (e.g., improvements in circuit structures such as diodes, transistors, switches, etc.) and improvements in software (improvements in process flow). However, as technology advances, many of today's process flow improvements have been seen as direct improvements in hardware circuit architecture. Designers almost always obtain the corresponding hardware circuit structure by programming an improved method flow into the hardware circuit. Thus, it cannot be said that an improvement in the process flow cannot be realized by hardware physical modules. For example, a Programmable Logic Device (PLD), such as a Field Programmable Gate Array (FPGA), is an integrated circuit whose Logic functions are determined by programming the Device by a user. A digital character system is "integrated" on a PLD by the designer's own programming without requiring the chip manufacturer to design and fabricate a dedicated integrated circuit chip. Furthermore, nowadays, instead of manually making an integrated Circuit chip, such Programming is often implemented by "logic compiler" software, which is similar to a software compiler used in program development and writing, but the original code before compiling is also written by a specific Programming Language, which is called Hardware Description Language (HDL), and HDL is not only one but many, such as abel (advanced Boolean Expression Language), ahdl (alternate Language Description Language), traffic, pl (core unified Programming Language), HDCal, JHDL (Java Hardware Description Language), langue, Lola, HDL, laspam, hardsradware (Hardware Description Language), vhjhd (Hardware Description Language), and vhigh-Language, which are currently used in most common. It will also be apparent to those skilled in the art that hardware circuitry that implements the logical method flows can be readily obtained by merely slightly programming the method flows into an integrated circuit using the hardware description languages described above.

The controller may be implemented in any suitable manner, for example, the controller may take the form of, for example, a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an Application Specific Integrated Circuit (ASIC), a programmable logic controller, and an embedded microcontroller, examples of which include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320, the memory controller may also be implemented as part of the control logic for the memory. Those skilled in the art will also appreciate that, in addition to implementing the controller as pure computer readable program code, the same functionality can be implemented by logically programming method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Such a controller may thus be considered a hardware component, and the means included therein for performing the various functions may also be considered as a structure within the hardware component. Or even means for performing the functions may be regarded as being both a software module for performing the method and a structure within a hardware component.

The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices, or any other non-transmission medium which can be used to store information which can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.

The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A payment method based on face recognition is applied to terminal equipment and comprises the following steps:

sending the face image information to a server;

when the first judgment result shows that the first identification result is consistent with the second identification result, payment is carried out based on the first identification result;

paying based on the first recognition result, specifically comprising:

sending the first deduction request to the server;

and sending the second deduction request to the server.

2. The method of claim 1, after said identifying the face image information, determining a first identification result, the method further comprising:

the displaying of the first payment interface on the display screen specifically includes:

3. The method of claim 1, after said sending the second deduction request to the server, further comprising:

and displaying the processing result on the display screen.

4. The method of claim 1, prior to the generating a second debit request for a second account to which the second account information corresponds, further comprising:

5. The method of claim 1, further comprising:

acquiring verification information input in the input box;

6. The method of claim 1, further comprising:

7. The method according to claim 1, wherein the sending the face image information to a server specifically comprises:

sending the face image information to a server by adopting another thread;

8. The method of claim 7, further comprising:

9. A payment device based on face recognition, comprising:

the first payment module is used for paying based on the first identification result when the first judgment result shows that the first identification result is consistent with the second identification result;

the second deduction request sending module is used for sending the second deduction request to the server;

the first payment module specifically comprises:

10. The apparatus of claim 9, the apparatus further comprising:

the first payment interface display module is specifically configured to display a first payment interface on a display screen, where the first payment interface includes the first account information and a first payment confirmation button.

11. The apparatus of claim 9, the apparatus further comprising:

12. The apparatus of claim 9, the apparatus further comprising:

13. The apparatus of claim 9, the apparatus further comprising:

14. The apparatus of claim 9, the apparatus further comprising:

15. The apparatus according to claim 9, wherein the facial image sending module is specifically configured to send the facial image information to a server by using another thread;

and the second recognition result acquisition module is specifically configured to acquire, within a preset time after the first payment interface is displayed, a second recognition result of the server for the face image information, which is received by the other thread.

16. The apparatus of claim 15, the apparatus further comprising:

17. An electronic device, comprising:

at least one processor; and the number of the first and second groups,

sending the face image information to a server;

paying based on the first recognition result, specifically comprising:

sending the first deduction request to the server;

and sending the second deduction request to the server.

18. A computer readable medium having computer readable instructions stored thereon which are executable by a processor to implement the face recognition based payment method of any one of claims 1 to 8.