CN106651340B

CN106651340B - Settlement method and device

Info

Publication number: CN106651340B
Application number: CN201510735998.4A
Authority: CN
Inventors: 陈永平
Original assignee: Advanced New Technologies Co Ltd
Current assignee: Advanced New Technologies Co Ltd; Advantageous New Technologies Co Ltd
Priority date: 2015-11-02
Filing date: 2015-11-02
Publication date: 2021-06-29
Anticipated expiration: 2035-11-02
Also published as: CN106651340A

Abstract

The embodiment of the invention provides a settlement method and a device, through the invention, when a user needs to settle the settlement information on a first terminal by using a settlement account, the user only needs to face an image acquisition device on the first terminal in front and then does a facial expression action which is the same as the preset facial expression action; when the first terminal determines that the facial expression action of the user is a preset facial expression action, the first terminal starts to acquire the lip language of the user through the image acquisition equipment on the first terminal and then sends the settlement account, the settlement information and the lip language to the server; when the server determines that the lip language is the lip language bound with the settlement account, the server settles the settlement information by using the settlement account. In the whole process, the user does not need to input at least 6 passwords of the settlement account on the first terminal, the operation of the user is simplified, and more time waste is avoided, so that the settlement efficiency and the user experience are improved.

Description

Settlement method and device

Technical Field

The invention relates to the technical field of internet, in particular to a settlement method and a settlement device.

Background

In life, people often need to purchase goods and pay the merchant the amount of money to be paid for the purchased goods.

For example, when a user purchases a commodity in a supermarket, the commodity to be purchased can be selected, then the commodity is settled at a cash register of the supermarket, a cashier of the supermarket inputs the commodity purchased by the user into a settlement system, the settlement system counts the amount of money to be paid for the purchased commodity, and then the user pays the amount of money to be paid for the purchased commodity to the supermarket. The user can pay the amount of money to be paid by the purchased goods to the supermarket by using the bank card.

Specifically, the user may perform a card swiping operation on the bank card in the settlement system to submit the card number of the bank card to the settlement system, and then the user may input the password of the bank card in the settlement system to submit the password of the bank card to the settlement system.

However, the inventor finds that the bank card has a large number of digits, generally including at least 6 digits, and when the user needs to pay, the user must input a password with more than 6 digits into the settlement system, which is cumbersome to operate and prone to input errors, and thus, the user needs to spend more time, resulting in low payment efficiency and low user experience.

Disclosure of Invention

In order to overcome the problems in the related art, the invention provides a settlement method and a settlement device.

According to a first aspect of the embodiments of the present invention, there is provided a settlement method applied to a first terminal, the method including:

when settlement information and a settlement account for settling the settlement information are acquired, acquiring facial expression actions of a user;

judging whether the facial expression action is a preset facial expression action or not;

when the facial expression is taken as a preset facial expression, lip language of the user is acquired;

sending the settlement information, the settlement account and the lip language to a server; so that the server settles the settlement information using the settlement account according to the lip language.

Wherein the facial expression actions include one or more combinations of eye actions, mouth actions, nose actions, cheek actions, and forehead actions.

Wherein, the judging whether the facial expression action is a preset facial expression action comprises:

sending the facial expression actions and the settlement account to the server; so that the server judges whether the facial expression action is the facial expression action bound with the settlement account;

and when a confirmation instruction which is returned by the server and used as the facial expression action bound with the settlement account is received, determining the facial expression action as a preset facial expression action.

Wherein, the obtaining of the lip language of the user comprises:

acquiring a plurality of images containing the mouth movement of the user or a video containing the mouth movement of the user;

determining the plurality of images or the video as the lip language of the user.

According to a second aspect of the embodiments of the present invention, there is provided a settlement method applied to a server, the method including:

receiving settlement information sent by a first terminal, a settlement account and a lip language for settling the settlement information;

judging whether the lip language is bound with the settlement account or not;

and when the lip language is the lip language bound with the settlement account, settling the settlement information by using the settlement account.

Further, the method further comprises:

receiving a first binding request which is sent by a second terminal and used for binding the settlement account with the lip language; the first binding request carries the settlement account and the lip language;

extracting the settlement account and the lip language from the first binding request;

and binding the settlement account with the lip language.

Further, the method further comprises:

receiving a second binding request sent by the second terminal and used for binding the settlement account with the facial expression action; the second binding request carries the settlement account and the facial expression action;

extracting the settlement account and the facial expression action from the second binding request;

and binding the settlement account with the facial expression action.

Further, the method further comprises:

receiving the facial expression action and the settlement account sent by the first terminal;

judging whether the facial expression action is bound with the settlement account or not;

and when the facial expression is the facial expression bound with the settlement account, sending a confirmation instruction of the facial expression as the facial expression bound with the settlement account to the first terminal.

According to a third aspect of the embodiments of the present invention, there is provided a settlement method applied to a second terminal, the method including:

acquiring a settlement account of a user and lip language of the user;

generating a first binding request for binding the settlement account and the lip language, wherein the first binding request carries the settlement account and the lip language;

and sending the first binding request to a server so that the server binds the settlement account with the lip language according to the first binding request.

Further, the method further comprises:

acquiring a settlement account of the user and facial expression actions of the user;

generating a second binding request for binding the settlement account with the facial expression action, wherein the second binding request carries the settlement account and the facial expression action;

sending the second binding request to the server to cause the server to bind the settlement account with the facial expression action according to the second binding request.

According to a fourth aspect of the embodiments of the present invention, there is provided a settlement apparatus applied to a first terminal, the apparatus including:

the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring facial expression actions of a user when settlement information and a settlement account for settling the settlement information are acquired;

the first judging module is used for judging whether the facial expression action is a preset facial expression action or not;

the second acquisition module is used for acquiring the lip language of the user when the facial expression is taken as a preset facial expression;

the first sending module is used for sending the settlement information, the settlement account and the lip language to a server; so that the server settles the settlement information using the settlement account according to the lip language.

Wherein, the first judging module comprises:

a transmitting unit for transmitting the facial expression action and the settlement account to the server; so that the server judges whether the facial expression action is the facial expression action bound with the settlement account;

and the first determination unit is used for determining the facial expression as a preset facial expression when receiving a confirmation instruction which is returned by the server and used for determining the facial expression as the facial expression bound with the settlement account.

Wherein the second obtaining module comprises:

a collecting unit for collecting a plurality of images containing the mouth movements of the user or a video containing the mouth movements of the user;

a second determining unit, configured to determine the multiple images or the video as the lip language of the user.

According to a fifth aspect of the embodiments of the present invention, there is provided a settlement apparatus applied to a server, the apparatus including:

the first receiving module is used for receiving settlement information sent by a first terminal, a settlement account used for settling the settlement information and lip language;

the second judgment module is used for judging whether the lip language is the lip language bound with the settlement account;

and the settlement module is used for settling the settlement information by using the settlement account when the lip language is bound with the settlement account.

Further, the apparatus further comprises:

the second receiving module is used for receiving a first binding request which is sent by a second terminal and used for binding the settlement account with the lip language; the first binding request carries the settlement account and the lip language;

the first extraction module is used for extracting the settlement account and the lip language from the first binding request;

and the first binding module is used for binding the settlement account with the lip language.

Further, the apparatus further comprises:

a third receiving module, configured to receive a second binding request sent by the second terminal and used for binding the settlement account with the facial expression action; the second binding request carries the settlement account and the facial expression action;

a second extraction module, configured to extract the settlement account and the facial expression from the second binding request;

and the second binding module is used for binding the settlement account with the facial expression action.

Further, the apparatus further comprises:

the fourth receiving module is used for receiving the facial expression action and the settlement account sent by the first terminal;

the third judging module is used for judging whether the facial expression action is bound with the settlement account;

and the second sending module is used for sending a confirmation instruction that the facial expression is the facial expression bound with the settlement account to the first terminal when the facial expression is the facial expression bound with the settlement account.

According to a sixth aspect of the embodiments of the present invention, there is provided a settlement apparatus applied to a second terminal, the apparatus including:

the third acquisition module is used for acquiring the settlement account of the user and the lip language of the user;

a first generating module, configured to generate a first binding request for binding the settlement account and the lip language, where the first binding request carries the settlement account and the lip language;

and the third sending module is used for sending the first binding request to a server so that the server binds the settlement account with the lip language according to the first binding request.

Further, the apparatus further comprises:

the fourth acquisition module is used for acquiring the settlement account of the user and the facial expression action of the user;

a second generation module, configured to generate a second binding request for binding the settlement account with the facial expression action, where the second binding request carries the settlement account and the facial expression action;

a fourth sending module, configured to send the second binding request to the server, so that the server binds the settlement account with the facial expression action according to the second binding request.

The technical scheme provided by the embodiment of the invention can have the following beneficial effects: by the method, when a user needs to settle the settlement information on the first terminal by using the settlement account, the user does not need to carry hardware equipment such as a mobile phone or a bank card, and only needs to face the image acquisition equipment on the first terminal in front and then perform a facial expression action which is the same as the preset facial expression action; when the first terminal determines that the facial expression action of the user is a preset facial expression action, the first terminal starts to acquire the lip language of the user through the image acquisition equipment on the first terminal and then sends the settlement account, the settlement information and the lip language to the server; when the server determines that the lip language is the lip language bound with the settlement account, the server settles the settlement information by using the settlement account. In the whole process, the user does not need to input at least 6 passwords of the settlement account on the first terminal, the operation of the user is simplified, and more time waste is avoided, so that the settlement efficiency and the user experience are improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

FIG. 1 is a flow diagram illustrating a settlement method according to an exemplary embodiment;

FIG. 2 is a flow diagram illustrating a settlement method according to an exemplary embodiment;

FIG. 3 is a flow diagram illustrating a settlement method according to an exemplary embodiment;

FIG. 4 is a flow diagram illustrating a settlement method according to an exemplary embodiment;

FIG. 5 is a schematic diagram of a scenario shown in accordance with an exemplary embodiment;

FIG. 6 is a schematic diagram of a scenario shown in accordance with an exemplary embodiment;

FIG. 7 is a schematic diagram of a scenario shown in accordance with an exemplary embodiment;

FIG. 8 is a block diagram illustrating a settlement device according to an exemplary embodiment;

FIG. 9 is a block diagram illustrating a settlement device according to an exemplary embodiment;

fig. 10 is a block diagram illustrating a settlement apparatus according to an exemplary embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.

Fig. 1 is a flow chart illustrating a settlement method according to an exemplary embodiment, as shown in fig. 1, applied to a first terminal, the method including the following steps.

In step S101, when settlement information and a settlement account for settling the settlement information are acquired, facial expression actions of a user are acquired;

in step S102, it is determined whether the facial expression motion is a preset facial expression motion;

when the facial expression action is a preset facial expression action, in step S103, a lip language of the user is acquired;

in step S104, the settlement information, the settlement account, and the lip language are transmitted to the server.

So that the server settles the settlement information using the settlement account according to the lip language.

The embodiment shown in fig. 1 of the invention supports that when a user needs to settle the settlement information on a first terminal by using the settlement account, the user does not need to carry hardware equipment such as a mobile phone or a bank card, and the user only needs to face the image acquisition equipment on the first terminal frontally and then make a facial expression action which is the same as the preset facial expression action; when the first terminal determines that the facial expression action of the user is a preset facial expression action, the first terminal starts to acquire the lip language of the user through the image acquisition equipment on the first terminal and then sends the settlement account, the settlement information and the lip language to the server; when the server determines that the lip language is the lip language bound with the settlement account, the server settles the settlement information by using the settlement account. In the whole process, the user does not need to input at least 6 passwords of the settlement account on the first terminal, the operation of the user is simplified, and more time waste is avoided, so that the settlement efficiency and the user experience are improved.

Fig. 2 is a flow chart illustrating a settlement method, as shown in fig. 2, applied to a server, according to an exemplary embodiment, the method including the following steps.

In step S201, the settlement information sent by the first terminal, the settlement account for settling the settlement information, and the lip language are received;

in step S202, determining whether the lip is a lip bound to the settlement account;

when the lip is the lip bound to the settlement account, the settlement information is settled using the settlement account in step S203.

The embodiment shown in fig. 2 of the invention supports that when a user needs to settle the settlement information on the first terminal by using the settlement account, the user does not need to carry hardware equipment such as a mobile phone or a bank card, and the user only needs to face the image acquisition equipment on the first terminal frontally and then make a facial expression action which is the same as the preset facial expression action; when the first terminal determines that the facial expression action of the user is a preset facial expression action, the first terminal starts to acquire the lip language of the user through the image acquisition equipment on the first terminal and then sends the settlement account, the settlement information and the lip language to the server; when the server determines that the lip language is the lip language bound with the settlement account, the server settles the settlement information by using the settlement account. In the whole process, the user does not need to input at least 6 passwords of the settlement account on the first terminal, the operation of the user is simplified, and more time waste is avoided, so that the settlement efficiency and the user experience are improved.

Fig. 3 is a flow chart illustrating a settlement method according to an exemplary embodiment, as shown in fig. 3, applied to a second terminal, the method including the following steps.

In step S301, a settlement account of the user and a lip language of the user are acquired;

in step S303, generating a first binding request for binding the settlement account with the lip language;

the first binding request carries the settlement account and the lip language;

in step S304, the first binding request is sent to the server.

Such that the server binds the settlement account with the lip language according to the first binding request.

The embodiment shown in fig. 3 of the invention supports that when a user needs to settle the settlement information on the first terminal by using the settlement account, the user does not need to carry hardware equipment such as a mobile phone or a bank card, and the user only needs to face the image acquisition equipment on the first terminal frontally and then make a facial expression action which is the same as the preset facial expression action; when the first terminal determines that the facial expression action of the user is a preset facial expression action, the first terminal starts to acquire the lip language of the user through the image acquisition equipment on the first terminal and then sends the settlement account, the settlement information and the lip language to the server; when the server determines that the lip language is the lip language bound with the settlement account, the server settles the settlement information by using the settlement account. In the whole process, the user does not need to input at least 6 passwords of the settlement account on the first terminal, the operation of the user is simplified, and more time waste is avoided, so that the settlement efficiency and the user experience are improved.

Fig. 4 is a flow chart illustrating a settlement method according to an exemplary embodiment, as shown in fig. 4, the method including the following steps.

In step S401, the second terminal obtains the settlement account of the user and the lip language of the user;

the second terminal can be a mobile phone, a tablet computer or a notebook computer used by a user. The second terminal is provided with image acquisition equipment which can be a camera and the like.

The settlement account may be an account with a payment function owned by the user, such as a payment account of a payment instrument, a bank account in a stored value card, a credit card, a bank savings card or a bankbook, and the like.

In the embodiment of the present invention, when a user needs to bind a settlement account of the user with a lip language of the user in a server, the user may use a second terminal to obtain a binding page for binding the settlement account of the user with the lip language of the user from the server, as shown in fig. 5, where the binding page includes a settlement account input box 1, a "ok" button 2, and a "cancel" button 3; the user may input the user's settlement account in the settlement account input box 1 and then click the ok button 2 to submit the input settlement account to the second terminal.

In addition, when the user wants to abandon the binding, the user can click the "cancel" button 3 in the binding page shown in fig. 5 to input a cancel operation to end the binding.

Further, when the second terminal acquires the settlement account, the user can be prompted to do lip language, after receiving the prompt of the second terminal, the user can face the image acquisition device on the second terminal in front to do lip language, and the second terminal acquires a plurality of images containing mouth movements of the user or videos containing the mouth movements of the user through the image acquisition device; and determining the plurality of images or the video as the lip language of the user.

In step S402, the second terminal generates a first binding request for binding the settlement account with the lip language;

wherein, the first binding request carries the settlement account and the lip language.

In step S403, the second terminal sends a first binding request to the server, so that the server binds the settlement account with the lip language according to the first binding request;

in step S404, the server receives a first binding request sent by the second terminal for binding the settlement account with the lip language;

in step S405, the server extracts the settlement account and the lip language from the first binding request;

in step S406, the server binds the settlement account with the lip language;

specifically, the server may store the settlement account and the lip language as a record in a first correspondence between the settlement account and the lip language stored in the server, so as to bind the settlement account and the lip language.

In the above, the flow in which the user binds the settlement account of the user with the lip language of the user in the server through the second terminal is completed through steps S401 to S406.

The user may then settle the settlement information using the settlement account at the first terminal; for example, a user purchases a commodity in a supermarket, and then settles the amount of the purchased commodity to a merchant of the supermarket on a first terminal provided on a cash register of the supermarket. The first terminal can be a payment terminal of a cash register of a supermarket or the like, image acquisition equipment is arranged on the first terminal, and the image acquisition equipment can be a camera or the like.

When the user needs to settle the settlement information on the first terminal using the settlement account, it can be realized by the following flow of step S407 to step S413.

In step S407, the first terminal acquires settlement information;

when the settlement information needs to be settled on the first terminal, the user or the staff of the merchant may input the settlement information into the first terminal first, and the first terminal may obtain the settlement information input by the user or the staff of the merchant.

In an embodiment of the invention, the settlement information includes a settlement amount and a collection account.

For example, when a user purchases a commodity in a supermarket and settles the amount of the purchased commodity to a merchant of the supermarket on a first terminal arranged on a cash register of the supermarket, the settlement information includes the amount of the purchased commodity and a payment account of the supermarket, and the payment account of the supermarket may be a bank account of the supermarket or the like.

In step S408, the first terminal acquires a settlement account for settling the settlement information;

the aim of the embodiment of the invention is to enable the server to deduct the amount of the commodity purchased by the user from the settlement account for settling the settlement information, and then add the amount of the commodity purchased by the user to the settlement account of the supermarket so as to finish the settlement of the settlement information. Currently, the first terminal has already acquired the settlement information, that is, the amount of money for the user to purchase the commodity and the payment account of the merchant have already been acquired, so the first terminal also needs to acquire the settlement account for settling the settlement information.

The first terminal displays the settlement information on a screen of the first terminal after acquiring the settlement information, the user can verify the settlement information displayed by the first terminal, if the user confirms that the settlement information displayed by the first terminal is correct, the user can input a settlement account of the user on the first terminal, and the first terminal acquires the settlement account input by the user and serves as the settlement account for settling the settlement information.

However, sometimes the settlement account contains more numbers or letters, for example, the card number of the bank card includes 16 digits or 19 digits, and the paybank account number is generally a mobile phone number containing 11 digits, so that when a user inputs the settlement account on the first terminal, the user needs to continuously trigger a plurality of letter buttons or number buttons to complete inputting the settlement account on the first terminal, which causes great inconvenience to the user and causes low user experience.

Therefore, in order to improve the user experience, in another embodiment of the invention, the user can bind the facial image feature of the user and the settlement account in the server in advance.

When a user needs to bind a settlement account of the user with facial image features of the user in a server, the user can use a second terminal to obtain a binding page for binding the settlement account of the user with the facial image features of the user from the server, as shown in fig. 6, the binding page comprises a settlement account input box 1, a "confirm" button 2 and a "cancel" button 3; the user may input the user's settlement account in the settlement account input box 1 and then click the ok button 2 to submit the input settlement account to the second terminal.

In addition, when the user wants to abandon the binding, the user can click the "cancel" button 3 in the binding page shown in fig. 6 to input a cancel operation to end the binding.

Further, after the user clicks the "ok" button 2, the front of the user may face the image acquisition device on the second terminal, and after the second terminal receives an operation that the user clicks the "ok" button 2, the first terminal may acquire the facial image features of the user through the image acquisition device, specifically, the first terminal may acquire the facial image of the user through the image acquisition device, and then acquire the facial image features of the user from the facial image of the user. Then the first terminal generates a third binding request for binding the settlement account and the facial image characteristics, wherein the third binding request carries the settlement account and the facial image characteristics; the first terminal then sends a third binding request to the server. The server receives a third binding request which is sent by the second terminal and used for binding the settlement account with the facial image characteristics; then the server extracts the settlement account and the facial image characteristics from the third binding request; and then the server binds the settlement account with the facial image characteristics.

The server may store the settlement account and the facial image feature as a record in a third correspondence between the locally stored settlement account and the facial image feature, so as to bind the settlement account and the facial image feature.

Therefore, if the user confirms that the settlement information displayed by the first terminal is correct, the user can face the image acquisition device on the first terminal, and then input settlement operation on the first terminal, wherein a settlement button is arranged on the first terminal, and the user can trigger the settlement button to realize the input of the settlement operation on the first terminal. When the first terminal receives the settlement operation, the first terminal collects the face image of the user through the image collecting device on the first terminal, the face image feature of the user is obtained from the face image of the user, and then the first terminal sends the face image feature to the server. The server receives the facial image characteristics sent by the first terminal, searches a settlement account bound with the facial image characteristics, and then sends the settlement account to the first terminal. The first terminal receives the settlement account sent by the server and determines the settlement account sent by the first terminal as a settlement account for settling the settlement information.

The method for acquiring the facial image characteristics of the user from the facial image of the user by the first terminal comprises the following steps:

acquiring a first partial image of each organ in a face image of a user; the organs include eyebrows, eyes, nose, mouth, and ears. Respectively carrying out illumination normalization processing on each first local module image to obtain a second local image with uniform brightness and of each organ; sampling and coding each second local image respectively to obtain a first feature vector corresponding to each second local image; respectively performing feature space dimensionality reduction on each first feature vector to obtain a second feature vector corresponding to each first feature vector, wherein the dimensionality of the second feature vector is smaller than that of the first feature vector; and fusing all the obtained second feature vectors to obtain a target feature vector which is used as the face image feature of the user.

Wherein, the server searches the settlement account bound with the facial image characteristics, including:

the server acquires a third corresponding relation between the locally stored settlement account and the facial image characteristics; and searching the face features in the third corresponding relation, then acquiring a settlement account corresponding to the face features, and taking the searched settlement account as the settlement account bound with the face image features.

In step S409, a facial expression action of the user is obtained, and it is determined whether the facial expression action is a preset facial expression action;

wherein the facial expression actions comprise one or more of eye actions, mouth actions, nose actions, cheek actions and forehead actions.

In the embodiment of the present invention, after the first terminal acquires the settlement account for settling the settlement information, the settlement information may be settled using the settlement account, but in order to ensure the property security of the user and prevent a lawbreaker from illegally acquiring the settlement account of the user and settling the illegal settlement information using the settlement account of the user to cause property loss to the user, the server needs to determine whether the user is an owner of the settlement account, and when it is determined that the user is the owner of the settlement account, the settlement information may be settled using the settlement account.

Generally, a user needs to input an account password of the settlement account to prove to a server that the user is the owner of the settlement account, but generally the account password contains multiple digits, for example, the password of a bank card is generally 6 digits, the number of digits contained in the payment password of a pay bank account is likely to be more, the user is greatly inconvenienced by inputting the multiple-digit password, and the user experience is low.

In the embodiment of the invention, the user binds the lip language of the user with the settlement account of the user in advance in the server, the lip language of the user is private, and other people do not know the lip language of the user.

Therefore, to improve the user experience, the user may prove to the server that the user is the owner of the settlement user by a lip language that is bound to the user's settlement account in advance.

The user can face the image acquisition equipment on the first terminal from the front, then a lip language bound with the settlement account in advance is made through the mouth, and the first terminal acquires the lip language of the user through the image acquisition equipment and sends the settlement account and the lip language to the server; and after receiving the lip language and the settlement account, the server judges whether the lip language is the lip language bound with the settlement account, and if the server determines that the lip language is the lip language bound with the settlement account, the server determines that the user is the owner of the settlement account, so that the settlement information can be settled by using the settlement account.

However, in an actual scenario, in order to settle the settlement information as soon as possible, after the first terminal acquires the settlement account for settling the settlement information, it starts to collect the lip language of the user, but the collected lip language may not be the lip language bound to the settlement account in advance, which the user wants to make, for example, the user is making a call or the user is communicating with a cashier in a supermarket, and the lip language may move during speaking and form the lip language, but the lip language is not the lip language bound to the settlement account in advance, which the user wants to make. However, the first terminal still obtains the lip language as the lip language of the user, and sends the obtained lip language, the settlement information and the settlement account to the server, the server determines whether the lip language is the lip language bound to the settlement account, and determines that the lip language of the user is not the lip language bound to the settlement account, so that the settlement information cannot be settled by using the settlement account, and the user's lip language is obtained again to successfully settle the settlement information by using the settlement account, and the above steps are repeated.

Therefore, in order to save system resources of the first terminal, and to save network resources between the first terminal and the server. In the embodiment of the invention, after the front face of the user faces the image acquisition device on the first terminal, if a user needs to make a lip language and wants the first terminal to be capable of acquiring the lip language made by the user, the user can firstly make a preset facial expression action as a starting point for making the lip language, and then make the lip language after making the preset facial expression action.

For a first terminal, the terminal judges whether the facial expression action of the user is acquired or not, judges whether the facial expression action of the user is a preset facial expression action or not after the facial expression action of the user is acquired, determines that the user needs to make a lip language when the facial expression action of the user is the preset facial expression action, and starts to acquire the lip language of the user through an image acquisition device on the first terminal.

If the first terminal cannot acquire the facial expression action of the user, or if the facial expression action of the user is acquired but the acquired facial expression action of the user is not the preset facial expression action, the step of acquiring the lip language of the user is not executed.

The preset facial expression action may be a uniform facial expression action previously set in the first terminal by the technician, such as blinking of the left eye, frowning, or left-falling of the mouth. That is to say, no matter which user, if the first terminal wants to be able to obtain the lip language made by itself, it must first make a uniform facial expression action and then make the lip language, when the first terminal obtains the facial expression action input by the user and determines that the facial expression action of the user is the uniform facial expression action, it will start to obtain the lip language of the user, otherwise, the first terminal will not execute the step of obtaining the lip language of the user.

However, if the preset facial expression actions are uniform, people all know the facial expression actions, and if lawbreakers steal the settlement account and the lip language bound with the settlement account, the server can settle illegal settlement information by using the settlement account according to the lip language, so that property loss is brought to users.

Therefore, in order to avoid property damage to the users, in another embodiment of the present invention, instead of using the uniform preset facial expression actions, each user may set its own preset facial expression actions in the server in advance.

When the user needs to set the own preset facial expression action in the server, the user can bind the user's settlement account with the user's facial expression action in the server, for example, the user can acquire a binding page for binding the user's settlement account with the user's facial expression action from the server by using the second terminal, as shown in fig. 7, the binding page includes a settlement account input box 1, an "ok" button 2 and a "cancel" button 3; the user may input the user's settlement account in the settlement account input box 1 and then click the ok button 2 to submit the input settlement account to the second terminal.

In addition, when the user wants to abandon the binding, the user can click the "cancel" button 3 in the binding page shown in fig. 7 to input a cancel operation to end the binding.

Further, after the user clicks the "ok" button 2, the user may face the image acquisition device on the second terminal and make a facial expression action, and after the second terminal receives an operation of clicking the "ok" button 2 by the user, the first terminal acquires the facial expression action of the user, specifically, the first terminal may acquire the facial expression action made by the user through the image acquisition device, and then the second terminal generates a second binding request for binding the settlement account with the facial expression action, where the second binding request carries the settlement account and the facial expression action; then the second terminal sends a second binding request to the server, and the server receives the second binding request sent by the second terminal and used for binding the settlement account with the facial expression action; then the server extracts the settlement account and the facial expression action from the second binding request; and finally binding the settlement account with the facial expression action.

The server may store the settlement account and the facial expression action as a record in a second corresponding relationship between the locally stored settlement account and the facial expression action, so as to bind the settlement account and the facial expression action.

Other people can set own preset facial expression actions in the server by the method. And the preset facial expression actions of each person set in the server are only known by the person.

In this way, after the first terminal acquires the facial expression action of the user, the first terminal sends the facial expression action and the settlement account to the server; the server receives the facial expression action and the settlement account sent by the first terminal; then the server judges whether the facial expression action is the facial expression action bound with the settlement account; when the facial expression acts as the facial expression act bound with the settlement account, the server sends a confirmation instruction that the facial expression acts as the facial expression act bound with the settlement account to the first terminal; and when the first terminal receives a confirmation instruction which is returned by the server and used for confirming the facial expression as the facial expression bound with the settlement account, determining the facial expression as a preset facial expression.

Therefore, even if a lawbreaker steals the settlement account and the lip language bound with the settlement account, if the lawbreaker does not steal the facial expression action bound with the settlement account, the first terminal does not execute the step of acquiring the lip language made by the lawbreaker, and the server cannot settle illegal settlement information by using the settlement account if the lip language is not acquired, thereby avoiding the loss brought to the user.

When the facial expression action is a preset facial expression action, in step S410, the first terminal acquires a lip language of the user;

when the front face of the user faces the image acquisition equipment on the first terminal to make a preset facial expression action, the user can make a lip language. When the first terminal determines that the facial expression is a preset facial expression, the first terminal can acquire a plurality of images containing mouth movements of the user or a video containing the mouth movements of the user through the image acquisition equipment; and determining the plurality of images or the video as the lip language of the user.

In step S411, the first terminal transmits the settlement information, the settlement account, and the lip language to the server;

In step S412, the server receives the settlement information, the settlement account and the lip language sent by the first terminal;

in step S413, the server determines whether the lip is a lip bound to the settlement account;

specifically, the server acquires a first corresponding relation between a locally stored settlement account and lip language; searching a lip language corresponding to the settlement account in the first corresponding relation; judging whether the received lip language is the same as the searched lip language; and when the received lip is the same as the searched lip, determining that the received lip is the lip bound with the settlement account.

In the embodiment of the invention, if a lawbreaker steals the settlement account, the lip language bound with the settlement account and the facial expression action bound with the settlement account, the lawbreaker can make the facial expression action first and then make the lip language, and because the facial expression action made by the lawbreaker is taken as the facial expression action bound with the settlement account, the first terminal can determine the facial expression action of the lawbreaker as the preset facial expression action and further can obtain the lip language of the lawbreaker, and because the lip language of the lawbreaker is taken as the lip language bound with the settlement account, the server can utilize the settlement account to settle illegal settlement information, so that loss is brought to a user.

Therefore, in order to avoid loss to the user, when the first terminal acquires the lip language of the user, the first terminal also acquires the face image feature of the user at the same time, and when the settlement information, the settlement account and the lip language are sent to the server, the face image feature is sent to the server at the same time.

In this way, when the server determines that the received lip is the same as the found lip, the server continues to determine whether the facial image feature is the facial image feature bound to the settlement account, and when the facial image feature is the facial image feature bound to the settlement account, determines that the received lip is the lip bound to the settlement account, and performs step S414.

Since the lawbreaker is almost impossible to forge the facial image feature of the user, the received lip can not be determined to be the lip bound to the settlement account when the first terminal cannot obtain the facial image feature of the user, and then the step S414 is not executed, that is, the lawbreaker cannot enable the server to settle the illegal settlement information by using the settlement account, so that the loss of the user is avoided.

The server judges whether the facial image features are facial image features bound with the settlement account or not, and the method comprises the following steps:

the server acquires a third corresponding relation between the locally stored settlement account and the facial image characteristics; searching the face image characteristics corresponding to the settlement account in the third corresponding relation; judging whether the received facial image features are the same as the searched facial image features; and when the received facial image features are the same as the searched facial image features, determining the facial image features as the facial image features bound with the settlement account.

When the lip is the lip bound to the settlement account, the server settles the settlement information using the settlement account in step S414.

The server may deduct the settlement amount included in the settlement information from the settlement account, and then add the deducted settlement amount to the collection account included in the settlement information, so as to settle the settlement information.

By the method of the embodiment of the invention, when a user needs to settle the settlement information on the first terminal by using the settlement account, the user does not need to carry hardware equipment such as a mobile phone or a bank card, and only needs to face the image acquisition equipment on the first terminal in front and then do a facial expression action which is the same as the preset facial expression action; when the first terminal determines that the facial expression action of the user is a preset facial expression action, the first terminal starts to acquire the lip language of the user through the image acquisition equipment on the first terminal and then sends the settlement account, the settlement information and the lip language to the server; when the server determines that the lip language is the lip language bound with the settlement account, the server settles the settlement information by using the settlement account. In the whole process, the user does not need to input at least 6 passwords of the settlement account on the first terminal, the operation of the user is simplified, and more time waste is avoided, so that the settlement efficiency and the user experience are improved.

Fig. 8 is a block diagram illustrating a settlement apparatus according to an exemplary embodiment, the apparatus including, as shown in fig. 8:

a first obtaining module 11, configured to obtain facial expression actions of a user when settlement information and a settlement account for settling the settlement information are obtained;

the first judging module 12 is configured to judge whether the facial expression action is a preset facial expression action;

a second obtaining module 13, configured to obtain the lip language of the user when the facial expression is a preset facial expression;

a first sending module 14, configured to send the settlement information, the settlement account, and the lip language to a server; so that the server settles the settlement information using the settlement account according to the lip language.

The embodiment shown in fig. 8 of the present invention supports that when a user needs to settle the settlement information on the first terminal by using the settlement account, the user does not need to carry hardware devices such as a mobile phone or a bank card, and the user only needs to face the image capturing device on the first terminal and then perform a facial expression action identical to the preset facial expression action; when the first terminal determines that the facial expression action of the user is a preset facial expression action, the first terminal starts to acquire the lip language of the user through the image acquisition equipment on the first terminal and then sends the settlement account, the settlement information and the lip language to the server; when the server determines that the lip language is the lip language bound with the settlement account, the server settles the settlement information by using the settlement account. In the whole process, the user does not need to input at least 6 passwords of the settlement account on the first terminal, the operation of the user is simplified, and more time waste is avoided, so that the settlement efficiency and the user experience are improved.

Wherein, the first judging module 12 includes:

Wherein the second obtaining module 13 includes:

Fig. 9 is a block diagram illustrating a settlement apparatus according to an exemplary embodiment, as shown in fig. 9, the apparatus including:

a first receiving module 21, configured to receive settlement information sent by a first terminal, a settlement account used for settling the settlement information, and a lip language;

the second judging module 22 is configured to judge whether the lip language is a lip language bound to the settlement account;

and the settlement module 23 is configured to settle the settlement information by using the settlement account when the lip language is the lip language bound to the settlement account.

The embodiment shown in fig. 9 of the present invention supports that when a user needs to settle the settlement information on the first terminal by using the settlement account, the user does not need to carry hardware devices such as a mobile phone or a bank card, and the user only needs to face the image capturing device on the first terminal and then perform a facial expression action identical to the preset facial expression action; when the first terminal determines that the facial expression action of the user is a preset facial expression action, the first terminal starts to acquire the lip language of the user through the image acquisition equipment on the first terminal and then sends the settlement account, the settlement information and the lip language to the server; when the server determines that the lip language is the lip language bound with the settlement account, the server settles the settlement information by using the settlement account. In the whole process, the user does not need to input at least 6 passwords of the settlement account on the first terminal, the operation of the user is simplified, and more time waste is avoided, so that the settlement efficiency and the user experience are improved.

Further, the apparatus further comprises:

Fig. 10 is a block diagram illustrating a settlement apparatus according to an exemplary embodiment, the apparatus including, as shown in fig. 10:

a third obtaining module 31, configured to obtain a settlement account of the user and a lip language of the user;

a first generating module 32, configured to generate a first binding request for binding the settlement account and the lip language, where the first binding request carries the settlement account and the lip language;

a third sending module 33, configured to send the first binding request to a server, so that the server binds the settlement account with the lip language according to the first binding request.

The embodiment shown in fig. 10 of the present invention supports that when a user needs to settle the settlement information on the first terminal by using the settlement account, the user does not need to carry hardware devices such as a mobile phone or a bank card, and the user only needs to face the image capturing device on the first terminal and then perform a facial expression action identical to the preset facial expression action; when the first terminal determines that the facial expression action of the user is a preset facial expression action, the first terminal starts to acquire the lip language of the user through the image acquisition equipment on the first terminal and then sends the settlement account, the settlement information and the lip language to the server; when the server determines that the lip language is the lip language bound with the settlement account, the server settles the settlement information by using the settlement account. In the whole process, the user does not need to input at least 6 passwords of the settlement account on the first terminal, the operation of the user is simplified, and more time waste is avoided, so that the settlement efficiency and the user experience are improved.

Further, the apparatus further comprises:

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims

1. A settlement method applied to a first terminal, the method comprising:

sending the settlement information, the settlement account and the lip language to a server; so that the server settles the settlement information using the settlement account according to the lip language;

the method for acquiring the settlement account for settling the settlement information comprises the following steps:

displaying the settlement information to a user so that the user can verify the settlement information and input settlement operation when the settlement information is correct;

when settlement operation is detected, acquiring the facial image characteristics of the user and sending the facial image characteristics to the server so that the server acquires a settlement account of the user according to the third corresponding relation and sends the settlement account to the first terminal, wherein the settlement account of the user is a settlement account for settling the settlement information; and the third corresponding relation is used for binding the facial image characteristics of the user and the settlement account.

2. The method of claim 1, wherein the facial expression movements comprise one or more combinations of eye movements, mouth movements, nose movements, cheek movements, and forehead movements.

3. The method of claim 1, wherein the determining whether the facial expression action is a preset facial expression action comprises:

4. The method of claim 1, wherein the obtaining the lip language of the user comprises:

5. A settlement method applied to a server is characterized by comprising the following steps:

judging whether the lip language is bound with the settlement account or not;

when the lip language is the lip language bound with the settlement account, settling the settlement information by using the settlement account;

6. The method of claim 5, further comprising:

and binding the settlement account with the lip language.

7. The method of claim 5, further comprising:

receiving a second binding request sent by a second terminal and used for binding the settlement account with the facial expression action; the second binding request carries the settlement account and the facial expression action;

and binding the settlement account with the facial expression action.

8. The method of claim 7, further comprising:

9. A settlement method applied to a second terminal, the method comprising:

acquiring a settlement account of a user and lip language of the user;

sending the first binding request to a server, so that the server binds the settlement account with the lip language according to the first binding request, and a first terminal obtains the settlement account;

the method for acquiring the settlement account comprises the following steps:

displaying settlement information to a user so that the user can verify the settlement information and input settlement operation when the settlement information is correct;

10. The method of claim 9, further comprising:

11. A settlement apparatus applied to a first terminal, the apparatus comprising:

the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring facial expression actions of a user when settlement information and a settlement account for settling the settlement information are acquired; the method for acquiring the settlement account comprises the following steps:

when settlement operation is detected, acquiring the facial image characteristics of the user and sending the facial image characteristics to the server so that the server acquires a settlement account of the user according to the third corresponding relation and sends the settlement account to the first terminal, wherein the settlement account of the user is a settlement account for settling the settlement information; the third corresponding relation is used for binding the facial image characteristics of the user and a settlement account;

12. The device of claim 11, wherein the facial expression movements comprise one or more combinations of eye movements, mouth movements, nose movements, cheek movements, and forehead movements.

13. The apparatus of claim 11, wherein the first determining module comprises:

14. The apparatus of claim 11, wherein the second obtaining module comprises:

15. A settlement apparatus applied to a server, the apparatus comprising:

the first receiving module is used for receiving settlement information sent by a first terminal, a settlement account used for settling the settlement information and lip language; the receiving method of the settlement account comprises the following steps:

16. The apparatus of claim 15, further comprising:

17. The apparatus of claim 15, further comprising:

the third receiving module is used for receiving a second binding request which is sent by a second terminal and used for binding the settlement account with the facial expression action; the second binding request carries the settlement account and the facial expression action;

18. The apparatus of claim 17, further comprising:

19. A settlement apparatus applied to a second terminal, the apparatus comprising:

a third sending module, configured to send the first binding request to a server, so that the server binds the settlement account with the lip language according to the first binding request, and a first terminal obtains the settlement account;

the method for acquiring the settlement account by the first terminal comprises the following steps:

20. The apparatus of claim 19, further comprising: