CN113627914A

CN113627914A - Face consumption method, face consumption system, face consumption equipment and storage medium

Info

Publication number: CN113627914A
Application number: CN202110984067.3A
Authority: CN
Inventors: 王伟洋
Original assignee: Hangzhou Hikvision Digital Technology Co Ltd
Current assignee: Hangzhou Hikvision Digital Technology Co Ltd
Priority date: 2021-08-25
Filing date: 2021-08-25
Publication date: 2021-11-09
Anticipated expiration: 2041-08-25
Also published as: CN113627914B

Abstract

The embodiment of the invention provides a face consumption method, a face consumption system, face consumption equipment and a storage medium, wherein the method comprises the following steps: acquiring a face image of a consumer; determining a consumption mode corresponding to the consumer based on the face image; under the condition that the consumption mode is the user-defined consumption mode, based on the user-defined consumption mode, uploading the consumption information of the consumer to consumption management equipment, so that the consumption management equipment completes consumption deduction based on the consumption information; and under the condition that the consumption mode is not the user-defined consumption mode, based on the consumption mode preset by the human face consumption equipment, uploading the consumption information of the consumer to the consumption management equipment, so that the consumption management equipment completes consumption deduction based on the consumption information. The embodiment of the invention provides the preset consumption mode and the user-defined consumption mode which are suitable for various consumption scenes, and the multi-scene adaptability of face consumption is improved.

Description

Face consumption method, face consumption system, face consumption equipment and storage medium

Technical Field

The invention relates to the technical field of electronic payment, in particular to a face consumption method, a face consumption system, face consumption equipment and a storage medium.

Background

The traditional card swiping consumption mode requires a consumer to carry a card, and the consumer needs to take out the card to swipe the card when consuming the card. However, when the consumer holds the full hand, the card-swiping consumption mode is very inconvenient, and therefore, the card-swiping consumption mode is not more and more suitable for the development of times. Based on this, electronic payment is due.

At present, electronic payment technology has developed more and more mature, and consumers can select an electronic payment mode to perform consumption settlement in many consumption scenes, for example, consumers can select a face recognition consumption mode to perform consumption settlement.

However, the existing face recognition consumption mode is single, namely, the consumption settlement is completed by comparing the face images of the consumers and then according to the comparison success result.

Disclosure of Invention

The embodiment of the invention aims to provide a face consumption method, a face consumption system, face consumption equipment and a storage medium, so that face recognition consumption modes are enriched, and multi-scene adaptability of face consumption is improved. The specific technical scheme is as follows:

in a first aspect, an embodiment of the present invention provides a face consumption method, which is applied to a face consumption device of a face consumption system, where the face consumption system further includes a consumption management device, and the method includes:

acquiring a face image of a consumer;

determining a corresponding consumption mode based on the face image;

under the condition that the consumption mode is a user-defined consumption mode, based on the user-defined consumption mode, uploading consumption information of the consumer to the consumption management equipment, so that the consumption management equipment completes consumption deduction based on the consumption information;

under the condition that the consumption mode is not a user-defined consumption mode, starting a preset consumption mode of the human face consumption equipment, and uploading consumption information of the consumer to the consumption management equipment so that the consumption management equipment completes consumption deduction based on the consumption information; wherein the preset consumption mode is as follows: the face recognition consumption mode, the consumption mode combining the face recognition with the first confirmation mode, and the consumption mode combining the face recognition with the second confirmation mode.

Optionally, the determining manner of the preset consumption mode includes:

if the total number of consumers is not greater than a preset lower limit threshold, the image comparison result between every two human face images in the human face image library meets a preset comparison condition or the human face consumption equipment is configured to consume with a fixed amount, determining that the preset consumption mode is a human face recognition consumption mode; wherein the preset comparison condition is that the similarity is smaller than a preset similarity threshold;

if the total number of the consumers is not smaller than a preset upper limit threshold, determining that the preset consumption mode is a consumption mode combining face recognition with a second confirmation mode;

and if the total number of the consumers is greater than the preset lower limit threshold and less than the preset upper limit threshold, determining that the preset consumption mode is a consumption mode combining face recognition with a first confirmation mode.

Optionally, the user-defined consumption mode includes one of a face recognition consumption mode, a consumption mode combining face recognition with a first confirmation mode, and a consumption mode combining face recognition with a second confirmation mode.

Optionally, the uploading the consumption information of the consumer to the consumption management device includes:

uploading consumption information of the consumer to the consumption management device when the consumption mode is a face recognition consumption mode;

under the condition that the consumption mode is a consumption mode combining face recognition and a first confirmation mode, displaying a first consumption confirmation operation interface on the face consumption equipment, and uploading consumption information of the consumer to the consumption management equipment when an operation instruction of the consumer on the first consumption confirmation operation interface is obtained;

and under the condition that the consumption mode is a consumption mode combining face recognition with a second confirmation mode, displaying a second consumption confirmation operation interface on the face consumption equipment, and after an operation instruction of the consumer on the second consumption confirmation operation interface is obtained, uploading the consumption information of the consumer to the consumption management equipment.

Optionally, when the consumption mode is a consumption mode combining face recognition and a first confirmation mode, displaying a first consumption confirmation operation interface on the face consumption device, and when an operation instruction of the consumer on the first consumption confirmation operation interface is obtained, uploading the consumption information of the consumer to the consumption management device, includes:

displaying a first consumption confirmation operation interface comprising a consumption confirmation button on the human face consumption equipment; and uploading the consumption information of the consumer to the consumption management equipment under the condition of acquiring a confirmation instruction sent by the consumer based on the consumption confirmation button.

Optionally, when the consumption mode is a consumption mode combining face recognition with a second confirmation mode, displaying a second consumption confirmation operation interface on the face consumption device, and after an operation instruction of the consumer on the second consumption confirmation operation interface is obtained, uploading the consumption information of the consumer to the consumption management device, where the method includes:

displaying a second consumption confirmation operation interface comprising gesture confirmation information on the human face consumption equipment; and uploading the consumption information of the consumer to the consumption management device after the consumer makes the same gesture as the target gesture based on the gesture confirmation information.

Optionally, the target gesture includes a default gesture, a preset gesture corresponding to the human face consumption device, or a gesture defined by the consumer.

Optionally, the face consumption system further includes a rights management platform;

prior to the determining a corresponding consumption pattern based on the facial image, the method further comprises:

receiving a plurality of consumer information issued by the authority management platform; wherein the plurality of consumer information comprises: face image information and identity identification information corresponding to each consumer;

comparing the face image with the face image information corresponding to each consumer, and taking the identity identification information corresponding to the face image information matched with the face image as the identity identification information of the consumer;

and taking the consumption amount information and the identity information of the consumer as the consumption information of the consumer.

In a second aspect, an embodiment of the present invention provides a face consumption system, where the face consumption system includes a face consumption device and a consumption management device;

the face consumption equipment is used for acquiring a face image of a consumer; determining a corresponding consumption mode based on the face image; uploading consumption information of the consumer to the consumption management equipment based on the custom consumption mode under the condition that the consumption mode is the custom consumption mode; under the condition that the consumption mode is not a user-defined consumption mode, starting a preset consumption mode of the human face consumption equipment, and uploading the consumption information of the consumer to the consumption management equipment;

the consumption management equipment is used for receiving the consumption information sent by the face consumption equipment and completing consumption deduction based on the consumption information;

wherein the preset consumption mode is as follows: the face recognition consumption mode, the consumption mode combining the face recognition with the first confirmation mode, and the consumption mode combining the face recognition with the second confirmation mode.

Optionally, the face consumption device is further configured to determine the preset consumption mode in the following manner:

Optionally, the human face consumption device is specifically configured to upload the consumption information of the consumer to the consumption management device when the consumption mode is a human face recognition consumption mode; under the condition that the consumption mode is a consumption mode combining face recognition and a first confirmation mode, displaying a first consumption confirmation operation interface on the face consumption equipment, and uploading consumption information of the consumer to the consumption management equipment when an operation instruction of the consumer on the first consumption confirmation operation interface is obtained; and under the condition that the consumption mode is a consumption mode combining face recognition with a second confirmation mode, displaying a second consumption confirmation operation interface on the face consumption equipment, and after an operation instruction of the consumer on the second consumption confirmation operation interface is obtained, uploading the consumption information of the consumer to the consumption management equipment.

Optionally, the face consumption device is specifically configured to display a first consumption confirmation operation interface including a consumption confirmation button on the face consumption device when the consumption mode is a consumption mode combining face recognition and a first confirmation mode; and uploading the consumption information of the consumer to the consumption management equipment under the condition of acquiring a confirmation instruction sent by the consumer based on the consumption confirmation button.

Optionally, the face consumption device is specifically configured to display a second consumption confirmation operation interface including gesture confirmation information on the face consumption device when the consumption mode is a consumption mode combining face recognition and a second confirmation mode; and uploading the consumption information of the consumer to the consumption management device after the consumer makes the same gesture as the target gesture based on the gesture confirmation information.

Optionally, the system further comprises a rights management platform;

the authority management platform is used for issuing a plurality of consumer information to the face consumption equipment; wherein the plurality of consumer information comprises: face image information and identity identification information corresponding to each consumer;

the face consumption equipment is also used for receiving a plurality of consumer information issued by the authority management platform; comparing the face image with the face image information corresponding to each consumer, and taking the identity identification information corresponding to the face image information matched with the face image as the identity identification information of the consumer; and taking the consumption amount information and the identity information of the consumer as the consumption information of the consumer.

In a third aspect, an embodiment of the present invention provides a face consumption device, including a processor, a communication interface, a memory, and a communication bus, where the processor and the communication interface complete communication between the memory and the face consumption device through the communication bus;

a memory for storing a computer program;

a processor adapted to perform the method steps of any of the above first aspects when executing a program stored in the memory.

In a fourth aspect, the present invention provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the method steps of any one of the above first aspects.

The embodiment of the invention has the following beneficial effects:

by adopting the method provided by the embodiment of the invention, the face image of the consumer is obtained; determining a corresponding consumption mode based on the face image; under the condition that the consumption mode is the user-defined consumption mode, based on the user-defined consumption mode, uploading the consumption information of the consumer to consumption management equipment, so that the consumption management equipment completes consumption deduction based on the consumption information; and under the condition that the consumption mode is not the user-defined consumption mode, starting a preset consumption mode of the human face consumption equipment, and uploading the consumption information of the consumer to the consumption management equipment so that the consumption management equipment completes consumption deduction based on the consumption information. By applying the method provided by the embodiment of the invention, the consumer can customize the consumption mode according to the preference of the consumer, and the personalized requirement of the consumer on the face recognition consumption mode is met. In addition, under the condition that a consumer does not define a consumption mode by self, the embodiment of the invention also provides a plurality of consumption modes which are suitable for various consumption scenes, such as a face recognition consumption mode, a consumption mode combining face recognition with a first confirmation mode, a consumption mode combining face recognition with a second confirmation mode and the like, and the multi-scene adaptability of face consumption is improved.

Of course, not all of the advantages described above need to be achieved at the same time in the practice of any one product or method of the invention.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by referring to these drawings.

Fig. 1 is a flowchart of a face consumption method according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of a face-consuming device displaying information about a consumer;

FIG. 3 is a flow chart of uploading consumption information to a consumption management device;

FIG. 4 is a schematic view of a first consumption confirmation interface;

FIG. 5 is a schematic view of a second consumption confirmation interface;

FIG. 6 is another schematic view of a second consumption confirmation interface;

FIG. 7 is a flow diagram of determining consumption information of a consumer;

fig. 8 is a flow chart of a face consumption method according to an embodiment of the present invention;

FIG. 9 is a schematic diagram of a structure of a face consumption system according to an embodiment of the present invention;

fig. 10 is a schematic structural diagram of another face consumption system according to an embodiment of the present invention;

fig. 11 is a schematic structural diagram of a face consumption device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In order to enrich face recognition consumption modes and improve multi-scene adaptability of face consumption, the embodiment of the invention provides a face consumption method, a face consumption system, face consumption equipment, a computer readable storage medium and a computer program product.

First, a face consumption method provided by the embodiment of the present invention is described below. The face consumption method provided by the embodiment of the invention can be applied to face consumption equipment of a face consumption system. The face consumption device may be any electronic device with an image recognition function, and is not limited in particular. In a specific consumption scenario, the consumption management device may be configured to manage consumption rights, consumption balances, and consumption supplements of a consumer.

Fig. 1 is a flowchart of a face consumption method according to an embodiment of the present invention, and as shown in fig. 1, the method includes:

and S101, acquiring a face image of the consumer.

And S102, determining a corresponding consumption mode based on the face image.

S103, under the condition that the consumption mode is a user-defined consumption mode, based on the user-defined consumption mode, the consumption information of the consumer is uploaded to the consumption management equipment, so that the consumption management equipment completes consumption deduction based on the consumption information.

S104, when the consumption mode is not the user-defined consumption mode, starting a preset consumption mode of the human face consumption equipment, and uploading the consumption information of the consumer to the consumption management equipment so that the consumption management equipment completes consumption deduction based on the consumption information.

Therefore, the method provided by the embodiment of the invention is adopted to obtain the face image of the consumer; determining a corresponding consumption mode based on the face image; under the condition that the consumption mode is the user-defined consumption mode, based on the user-defined consumption mode, uploading the consumption information of the consumer to consumption management equipment, so that the consumption management equipment completes consumption deduction based on the consumption information; and under the condition that the consumption mode is not the user-defined consumption mode, starting a preset consumption mode of the human face consumption equipment, and uploading the consumption information of the consumer to the consumption management equipment so that the consumption management equipment completes consumption deduction based on the consumption information. By applying the method provided by the embodiment of the invention, the consumer can customize the consumption mode according to the preference of the consumer, and the personalized requirement of the consumer on the face recognition consumption mode is met. In addition, under the condition that a consumer does not define a consumption mode by self, the embodiment of the invention also provides a plurality of consumption modes which are suitable for various consumption scenes, such as a face recognition consumption mode, a consumption mode combining face recognition with a first confirmation mode, a consumption mode combining face recognition with a second confirmation mode and the like, and the multi-scene adaptability of face consumption is improved.

In the embodiment of the invention, the face consumption equipment is equipment which can take the face as a consumption certificate, and the face consumption equipment can also support various consumption certificates such as fingerprints and card swiping. The face consumption equipment can be applied to consumption scenes such as schools, hospitals, enterprises, institutional canteens and the like. The human face consumption equipment can also be applied to consumption scenes such as chain stores, shopping malls and the like.

In the embodiment of the invention, aiming at the consumption settlement condition of the input amount, if the worker inputs the consumption amount of the consumer in the consumption settlement equipment and can determine that the consumption instruction is initiated, the face consumption equipment can capture the face image of the consumer to obtain the face image of the consumer; aiming at the condition that the face consumption equipment is configured to consume with fixed amount or count, if the face of the consumer appears in the snapshot lens of the face consumption equipment, the face consumption equipment can directly snapshot the face image of the consumer to acquire the face image of the consumer. If the face consumption device does not capture the face image of the consumer within the preset time, the consumption process can be ended. The preset time may be set according to a specific application scenario, for example, set to 20 seconds or 30 seconds, and is not limited in this respect.

If the face image of the consumer is captured by the face consumption device within the preset time, the captured face image of the consumer and the face images pre-stored by the face consumption device can be respectively compared in image similarity, and the face image with the highest similarity can be determined as the face image matched with the face image of the consumer. And the identity information to which the face image matched with the face image of the consumer belongs can be determined, namely the identity information of the consumer. And further, the identity information, the face image and the consumption amount of the consumer can be displayed in the face consumption equipment.

The image similarity comparison may use any image similarity comparison algorithm, such as a pixel point comparison algorithm, a center-of-gravity comparison algorithm, a projection comparison algorithm, a block comparison algorithm, and the like. The face image pre-stored in the face consumption device is as follows: the face image of the consumer who has consumed the face consumption device, and/or the face image of the consumer who will consume the face consumption device. The identification information may include the name of the consumer. In addition, based on different specific consumption scenes, the identification information may further include the work number or school number of the consumer.

Fig. 2 is a schematic diagram of a face consumption device displaying information related to a consumer, and as shown in fig. 2, the face consumption device may display a face image 201 of "zhang san" of the consumer, identification information 202 and a consumption amount 203 in an interface 200.

When the face consumption equipment captures the face image of the consumer, the face consumption equipment can also determine whether the consumption mode corresponding to the consumer is the user-defined consumption mode according to the face image. If the face image is associated with the user-defined consumption mode on the face consumption equipment, the consumption mode corresponding to the consumer can be determined to be the user-defined consumption mode, otherwise, the consumption mode corresponding to the consumer can be determined not to be the user-defined consumption mode. The user-defined consumption mode can comprise one of a face recognition consumption mode, a consumption mode combining face recognition with a first confirmation mode and a consumption mode combining face recognition with a second confirmation mode. If it is determined that the consumption mode corresponding to the consumer is the custom consumption mode, the above S103 may be executed.

Under the condition that the consumption mode corresponding to the consumer is determined not to be the user-defined consumption mode, whether the face consumption equipment is provided with a face recognition consumption mode, a consumption mode combining face recognition with a first confirmation mode and a consumption mode combining face recognition with a second confirmation mode can be searched; if the face consumption device is configured with any one of the face recognition consumption mode, the consumption mode combining the face recognition with the first confirmation mode, and the consumption mode combining the face recognition with the second confirmation mode, the configured consumption mode can be used as a preset consumption mode of the face consumption device, and the step S104 is executed according to the preset consumption mode.

In the embodiment of the invention, the face consumption equipment can be preconfigured with the intelligent switching function. And under the condition that the face consumption equipment is configured with any one of a face recognition consumption mode, a consumption mode combining face recognition with a first confirmation mode and a consumption mode combining face recognition with a second confirmation mode, the intelligent switching function can be closed. If the face consumption device is not configured with the face recognition consumption mode, the consumption mode combining the face recognition with the first confirmation mode, and the consumption mode combining the face recognition with the second confirmation mode, the intelligent switching function of the face consumption device can be started, then the preset consumption mode is determined under the condition that the intelligent switching function is started, and the step S104 is executed.

In an embodiment, when the face consumption device starts the intelligent switching function, the preset consumption mode may include mode a 1-mode A3:

mode a 1: if the total number of consumers is not greater than a preset lower limit threshold, the image comparison result between every two human face images in the human face image library meets a preset comparison condition or the human face consumption equipment is configured to consume with a fixed amount, determining that the preset consumption mode is a human face recognition consumption mode; and the preset comparison condition is that the similarity is smaller than a preset similarity threshold.

The face consumption system provided by the embodiment of the invention also comprises a right management platform. The face consumption equipment in the embodiment of the invention can acquire the identity identification information and the face image information of the personnel who probably use the face consumption equipment to carry out consumption settlement in advance, and upload and store the acquired identity identification information and the face image information of the personnel to the authority management platform. Under the condition that the face consumption equipment starts the intelligent switching function, the authority management platform can issue the stored identity identification information and face image information of the consumers to the face consumption equipment, and an image comparison result between every two face images in the face image library. The face consumption equipment can count the total number of the consumers issued by the authority management platform according to the received identity identification information and the face image information of the plurality of consumers issued by the authority management platform.

If the total number of the consumers is not greater than the preset lower threshold, the face consumption device may determine that the preset consumption mode is a face recognition consumption mode. The preset lower threshold may be set to 8 or 10 according to practical applications, and is not specifically limited herein.

If the similarity between every two face images in the face image library is smaller than a preset similarity threshold value, and the image comparison result between every two face images in the representation face image library meets a preset comparison condition, the face consumption equipment can determine that the preset consumption mode is a face recognition consumption mode. The preset similarity threshold may be set according to practical applications, and is not specifically limited herein.

If the face consumption device is configured to consume with a fixed amount, it may be determined that the preset consumption mode is a face recognition consumption mode. The face consumption device is configured to be a fixed-amount consumption representation: the amount of consumption settlement of the consumer using the human face consumption device is fixed, for example, the amount of consumption settlement is 50 yuan or 100 yuan. Typically, face consumption devices at consumer locations such as barbershops and beauty salons are configured for fixed-amount consumption.

Mode a 2: and if the total number of the consumers is not less than a preset upper limit threshold value, determining that the preset consumption mode is a consumption mode combining face recognition with a second confirmation mode. The preset upper threshold may be set according to an actual application, such as 200 or 250, and is not specifically limited herein. The preset upper threshold is larger than the preset lower threshold.

Mode a 3: and if the total number of the consumers is greater than the preset lower limit threshold and less than the preset upper limit threshold, determining that the preset consumption mode is a consumption mode combining face recognition with a first confirmation mode.

As can be seen, in this embodiment, when the intelligent switching function of the face consumption device is turned on, the preset consumption mode may be determined to be the face recognition consumption mode, the consumption mode in which the face recognition is combined with the first confirmation mode, or the consumption mode in which the face recognition is combined with the second confirmation mode according to the total number of consumers, the image comparison result between every two face images in the face image library, and whether the face consumption device is configured to consume with a fixed amount. The face recognition consumption mode can be applied to the consumption scene with low consumption safety requirements, so that the time for confirming consumption and waiting is saved; for the consumption scenes with a large number of consumers and certain requirements on the accuracy of the consumption result, the consumption information of the consumers can be confirmed by applying the consumption mode combining the face recognition with the first confirmation mode or the consumption mode combining the face recognition with the second confirmation mode, and the accuracy of the consumption result is ensured in the consumption scenes with the large number of consumers. Namely, the face consumption equipment can provide a plurality of consumption modes suitable for various consumption scenes for consumers according to specific consumption scenes, and the multi-scene adaptability of face consumption is improved.

In another embodiment, fig. 3 is a flowchart of uploading consumption information to a consumption management device, and as shown in fig. 3, the step of uploading the consumption information of the consumer to the consumption management device in S104 may include:

and S301, uploading the consumption information of the consumer to the consumption management equipment under the condition that the consumption mode is a face recognition consumption mode.

In the embodiment of the present invention, the consumption information may include: the consumption amount information and the identification information of the consumer. In the case where it is determined that the consumption pattern is a face recognition consumption pattern, the identification information 202 and the consumption amount information 203 of the consumer as shown in fig. 3 may be directly uploaded to the consumption management device. The consumption management device can search the account matched with the identity identification information of the consumer to finish consumption deduction.

For example, the identification information of the customer account three is "a 123456", the consumption amount is XXX, after receiving the identification information and the consumption amount information of the customer account three, the consumption management device finds that the account matched with the identification information "a 123456" is "× 6588", and then deducts the XXX element from the account "× 6588", so as to complete the consumption deduction of the customer account three, and after completing the deduction, may send a prompt message of "successful deduction" or "successful payment" to the face consumption device, where the prompt message may be text information displayed on a display interface of the face consumption device, or may be voice information played through a speaker of the face consumption device.

S302, when the consumption mode is a consumption mode combining face recognition and a first confirmation mode, displaying a first consumption confirmation operation interface on the face consumption equipment, and when an operation instruction of the consumer on the first consumption confirmation operation interface is obtained, uploading consumption information of the consumer to the consumption management equipment.

Specifically, under the condition that the consumption mode is a consumption mode combining face recognition and a first confirmation mode, a first consumption confirmation operation interface comprising a consumption confirmation button can be displayed on the face consumption equipment; and uploading the consumption information of the consumer to the consumption management equipment under the condition of acquiring a confirmation instruction sent by the consumer based on the consumption confirmation button.

The first consumption confirmation operation interface can be a display interface of the face consumption equipment, the first consumption confirmation operation interface can also be an interface popped up on the display interface of the face consumption equipment, and the area of the first consumption confirmation operation interface is not larger than the display interface. The first consumption confirmation operation interface can comprise a consumption confirmation button, identity identification information of a consumer, consumption amount information, a face image and the like.

The consumption confirmation button may include: an "ok" button and a "cancel" button. The consumer can check according to the consumption amount displayed by the first consumption confirmation operation interface and the self identity identification information, and if the check is correct, the consumer can trigger a confirmation button to show that the consumer confirms that the consumption information is correct; if the consumer disagrees with the consumption after the verification, a cancel button can be triggered to indicate that the consumer confirms that the consumption information is wrong and to cancel the consumption settlement.

If the consumer clicks a 'confirmation' button in the first consumption confirmation operation interface to determine that the consumer sends a confirmation instruction, the consumption information of the consumer can be uploaded to the consumption management device, and the consumption management device can search an account matched with the identity identification information of the consumer to complete consumption deduction. After the deduction is completed, the consumption management equipment can also send prompt information for prompting the successful payment to the face consumption equipment.

If the consumer clicks a 'cancel' button in the first consumption confirmation operation interface, the consumer is determined to send a command for canceling the consumption settlement, the human face consumption equipment can cancel the consumption settlement, and text prompt information for canceling the consumption settlement is displayed on a display interface of the human face consumption equipment or voice prompt information for canceling the consumption settlement is played through a loudspeaker of the human face consumption equipment.

For example, fig. 4 is a schematic diagram of a first consumption confirmation operation interface. As shown in fig. 4, in the case that it is determined that the consumption mode is a consumption mode combining face recognition and a first confirmation mode, the face consumption device may pop up a first consumption confirmation operation interface 400 in its display interface. The first consumption confirmation operating interface 400 includes consumption confirmation buttons: an "ok" button 410 and a "cancel" button 420, as well as a face image 401 of the consumer "zhang san", name job number information 402, and a spending amount 403. If the consumer three-point clicks the "confirm" button 410 in the first consumption confirmation operation interface 400, it may be determined that three-point issues a confirmation instruction, the consumption information of three-point may be uploaded to the consumption management device, the consumption management device finds that the account matching with the identification information "a 123456" of three-point of consumer is ". about. about.88", the consumption deduction of three-point of consumer may be completed by deducting the XXX element in the account ". about. about..

And S303, under the condition that the consumption mode is a consumption mode combining face recognition and a second confirmation mode, displaying a second consumption confirmation operation interface on the face consumption equipment, and after an operation instruction of the consumer on the second consumption confirmation operation interface is obtained, uploading the consumption information of the consumer to the consumption management equipment.

Specifically, under the condition that the consumption mode is a consumption mode combining face recognition and a second confirmation mode, a second consumption confirmation operation interface comprising gesture confirmation information can be displayed on the face consumption equipment; and uploading the consumption information of the consumer to the consumption management device after the consumer makes the same gesture as the target gesture based on the gesture confirmation information.

As an implementation manner of the embodiment of the present invention, the target gesture may be a default gesture, a preset gesture corresponding to the human face consuming device, or a gesture defined by the consumer.

In the embodiment of the invention, each consumer can customize the gesture for confirming the consumption information in advance according to own will. The human face consumption equipment can acquire the user-defined gesture of the consumer in advance and is used for confirming the consumption information when the consumer carries out consumption settlement. The consumer-defined gestures differ by the habits and preferences of individual consumers, for example, consumer A may define gestures that are: a "vertical thumb" gesture and a "palm horizontal swipe" gesture, wherein the "vertical thumb" gesture represents confirmation of consumption and the "palm horizontal swipe" gesture represents cancellation of consumption; the custom gesture for consumer B may be: an "outstretched" gesture and a "clenched" gesture, wherein the "outstretched" gesture represents a confirmation of consumption and the "clenched" gesture represents a cancellation of consumption.

The default posture is generally a head posture, and specifically may include: a "nodding" gesture and a "shaking head" gesture, wherein the "nodding" gesture represents a confirmation of consumption and the "shaking head" gesture represents a cancellation of consumption. In the embodiment of the present invention, the face consumption device may also be configured with a preset gesture different from the default gesture. For example, the human face consumption device may be configured with the preset gestures as: a "palm vertically swipe" gesture and a "palm horizontally swipe" gesture, wherein the "palm vertically swipe" gesture represents a confirmed consumption and the "palm horizontally swipe" gesture represents a cancelled consumption.

If the consumption mode is a consumption mode combining face recognition and a second confirmation mode, if the consumer stores a custom gesture in the face consumption device in advance, step S303 may specifically include: displaying a second consumption confirmation operation interface comprising gesture confirmation information on the human face consumption equipment; and uploading the consumption information of the consumer to a consumption management device after the consumer makes the same gesture as the target gesture based on the gesture confirmation information.

The second consumption confirmation operation interface can be a display interface of the face consumption equipment, the second consumption confirmation operation interface can also be an interface popped up on the display interface of the face consumption equipment, and the area of the second consumption confirmation operation interface is not larger than the display interface. The second consumption confirmation operation interface can comprise gesture confirmation information, identity identification information of the consumer, consumption amount information, a face image and the like.

For example, fig. 5 is a schematic diagram of a second consumption confirmation operation interface. If the consumer Zhang III stores the self-defined gesture in the face consumption equipment in advance: an "outstretched" gesture and a "clenched" gesture, wherein the "outstretched" gesture represents a confirmation of consumption and the "clenched" gesture represents a cancellation of consumption. As shown in fig. 5, in the case that the consumption mode is a consumption mode combining face recognition and a second confirmation mode, after the consumer triggers consumption, a second consumption confirmation operation interface 500 may pop up on the display interface of the face consumption device. The second consumption confirmation operation interface 500 includes posture confirmation information "confirm with palm-extended posture or cancel with fist-clenched posture" 510, and a face image 501 of "zhang san" of the consumer, name and job number information 502, and a consumption amount 503. The face consumption device then begins to detect the consumer's three-out gesture.

In the process of detecting the posture of the consumer opening three, the human face consumption equipment can prompt the consumer to open three to make a palm extending posture to confirm the consumption or make a fist making posture to cancel the consumption through voice. If the fact that the three consumers make the gesture of extending the palm is detected within the preset time, and it can be determined that the three consumers send confirmation instructions, the consumption information of the three consumers can be uploaded to the consumption management equipment, the consumption management equipment finds that the account matched with the identification information 'A123456' of the three consumers is '6588', the XXX element can be deducted from the account '6588', the consumption deduction of the three consumers is completed, and prompt information of 'deduction success' or 'payment success' can be sent to the face consumption equipment after the deduction is completed. If the consumer opens three to make the 'palm extending' gesture is not detected within the preset time, or the consumer opens three to make the 'fist making' gesture is detected, it can be determined that the consumer opens three to send a cancel instruction, and the consumer cancels the consumption of the consumer opens three. And moreover, the word prompt information of consumption cancellation can be displayed through the display interface of the face consumption equipment, or the voice prompt information of consumption cancellation can be played through the loudspeaker of the face consumption equipment.

And under the condition that the consumption mode is a consumption mode combining face recognition with a second confirmation mode, if the customer does not pre-store a self-defined gesture in the face consumption equipment, whether the face consumption equipment is correspondingly configured with a preset gesture can be searched, if the face consumption equipment is configured with the corresponding preset gesture, after a second consumption confirmation operation interface comprising gesture confirmation information is displayed on the face consumption equipment, if the customer makes the gesture same as the preset gesture, the consumption information of the customer is uploaded to the consumption management equipment.

And under the condition that the consumption mode is a consumption mode combining face recognition with a second confirmation mode, if the customer does not pre-store a self-defined gesture in the face consumption equipment and does not find a preset gesture corresponding to the face consumption equipment, confirming the consumption information through the default gesture of the face consumption equipment, specifically, after a second consumption confirmation operation interface comprising gesture confirmation information is displayed on the face consumption equipment, if the customer makes the gesture same as the default gesture, uploading the consumption information of the customer to the consumption management equipment. Wherein the default gestures are typically head gestures, such as a "nod" gesture, which indicates confirmation of consumption, and a "nod" gesture, which indicates cancellation of consumption.

For example, fig. 6 is another schematic diagram of the second consumption confirmation operation interface. The third consumer does not pre-store a self-defined gesture in the face consumption equipment, and does not find a preset gesture corresponding to the face consumption equipment. Then, in the case that the consumption mode is a consumption mode combining face recognition and a second confirmation mode, the consumption settlement of the third party of the consumer can be confirmed or cancelled according to a default gesture. The "nodding" gesture in the default gesture represents a confirmation of consumption "shaking head" gesture represents a cancellation of consumption.

As shown in fig. 6, after the consumer opens three times to trigger consumption, a second consumption confirmation operation interface 600 may pop up on the display interface of the human face consumption device, where the second consumption confirmation operation interface 600 includes gesture confirmation information "confirm by nodding gesture, or cancel by nodding gesture" 610, and a human face image 601 of the consumer "open three times", name and job number information 602, and consumption amount 603. The face consumption device then begins to detect the consumer's three-out gesture. In addition, in the process of detecting the posture of the consumer opening three, the human face consumption equipment can prompt the consumer to make a head nodding posture to confirm consumption or make a head shaking posture to cancel consumption through voice.

If the fact that the consumer makes a 'nodding' gesture in the third page is detected within the preset time, and it can be determined that the third page sends a confirmation instruction, the consumption information of the third page can be uploaded to the consumption management equipment, the consumption management equipment finds that the account matched with the identification information 'A123456' of the third page of the consumer is '6588', the XXX element can be deducted from the account '6588', the consumption deduction of the third page of the consumer is completed, and a prompt message of 'deduction success' or 'payment success' can be sent to the face consumption equipment after the deduction is completed.

If the consumer turns three out to make the 'nodding' gesture is not detected within the preset time, or the consumer turns three out to make the 'shaking' gesture is detected, it can be determined that the third piece of paper sends a cancel instruction, and the consumption of the consumer turns three out is cancelled. And moreover, the word prompt information of consumption cancellation can be displayed through the display interface of the face consumption equipment, or the voice prompt information of consumption cancellation can be played through the loudspeaker of the face consumption equipment.

As can be seen, in this embodiment, when the intelligent switching function of the face consumption device is turned on, the preset consumption mode may be determined to be the face recognition consumption mode, the consumption mode in which the face recognition is combined with the first confirmation mode, or the consumption mode in which the face recognition is combined with the second confirmation mode according to the total number of consumers, the image comparison result between every two face images in the face image library, and whether the face consumption device is configured to consume with a fixed amount. The face recognition consumption mode can be applied to the consumption scene with low consumption safety requirements, so that the time for confirming consumption and waiting is saved; for a consumption scene with a large number of consumers and certain requirements on the accuracy of a consumption result, the consumption information of the consumers can be confirmed by applying a consumption mode combining face recognition with a first confirmation mode or a consumption mode combining face recognition with a second confirmation mode, and the accuracy of the consumption result is ensured in the consumption scene with the large number of consumers; and to the consumption scene that has certain requirements such as sanitation and hygiene, can use the consumption mode of contactless face identification with the second mode of affirming, the consumer can confirm the consumption through the posture of contactless, the sanitary safety of consumer has been guaranteed, and, the consumer can customize the posture that is used for confirming the consumption information in advance, everyone can define different postures, can accomplish thousands of people different from one person to another, for example, some consumers can confirm the consumption information through head posture, some consumers can confirm the consumption information through face posture, some consumers can confirm the consumption information through health posture, for the consumer who does not want to confirm the consumption information with the posture, then can select to confirm the consumption information through the confirmation button, greatly satisfied consumer's individualized demand. Namely, the face consumption equipment can provide a plurality of consumption modes suitable for various consumption scenes for consumers according to specific consumption scenes, and the multi-scene adaptability of face consumption is improved. Moreover, the user can also liberate hands by confirming the consumption information through the head posture, and the consumption experience of the user is improved.

In yet another embodiment, the face consumption system further comprises a rights management platform. Before determining the corresponding consumption mode based on the face image in S102, consumption information of the consumer may also be determined. Fig. 7 is a flowchart of determining consumption information of a consumer, as shown in fig. 7, specifically including the following steps:

s701, receiving a plurality of consumer information issued by the authority management platform.

Wherein the plurality of consumer information comprises: the face image information and the identity identification information corresponding to each consumer. The identification information may include the name of the consumer. In addition, based on different specific consumption scenes, the identification information may further include the work number or school number of the consumer.

S702, comparing the face image with the face image information corresponding to each consumer, and taking the identity identification information corresponding to the face image information matched with the face image as the identity identification information of the consumer.

Any image similarity comparison algorithm can be used for comparing the face image of the consumer needing consumption settlement with the face image information of each consumer issued by the authority management platform. For example, a pixel point comparison algorithm, a center-of-gravity comparison algorithm, a projection comparison algorithm, a block comparison algorithm, and the like may be used to compare the face image of the consumer needing to perform consumption settlement with the face image information of each consumer issued by the rights management platform, so as to obtain the similarity between the face image of the consumer needing to perform consumption settlement and the face image of each consumer issued by each rights management platform. The face image with the highest similarity can be determined as the face image matched with the face image of the consumer needing consumption settlement. And then, the identity identification information of the consumer corresponding to the face image information matched with the face image of the consumer needing to perform consumption settlement can be used as the identity identification information of the consumer needing to perform consumption settlement.

S703, using the consumption amount information and the identity information of the consumer as the consumption information of the consumer.

The authority management platform is a platform for managing information such as face images, names, job numbers, card numbers, user-defined postures and the like of consumers, and can be bound with consumption management equipment or realize the management of consumption information together.

After the consumption amount information and the identification information of the consumer are used as the consumption information of the consumer, the consumption information of the consumer can be uploaded to the consumption management device according to the determined consumption mode. The consumption management equipment can search the account matched with the identity identification information in the consumption information of the consumer, and complete consumption deduction in the searched account according to the consumption amount information in the consumption information of the consumer.

Therefore, in this embodiment, before determining the consumption mode corresponding to the consumer, the consumption information of the consumer needing to perform consumption settlement can be determined through the facial image information and the identity information corresponding to the multiple consumers issued by the right management platform, and is used for subsequent consumption settlement. The consumption settlement can be carried out through the cooperation of the authority management platform, the face consumption equipment and the consumption management equipment in the face consumption system, so that the consumption settlement process is more complete, and the consumption settlement of consumers is safer.

As an implementation manner of the embodiment of the present invention, fig. 8 is a flowchart of a face consumption method according to the embodiment of the present invention. As shown in fig. 8, after the consumption calculation flow is started, the consumer checks out, and if the face consumption device is in a quota or counting mode (the quota mode means that the face consumption device is configured to consume with a fixed amount, and the counting mode means that the face consumption device is configured to consume according to the number of times), the face image comparison is directly performed; if the face consumption equipment is in a money input mode, a worker (such as a cashier) inputs the consumption money and then the face image comparison is carried out.

Determining identity identification information of the consumer by comparing the face image of the consumer with a face image prestored in a database of the face consumption equipment, and then displaying consumption information of the consumer on a display interface of the face consumption equipment; and judging whether the user-defined consumption mode of the consumer exists or not, if so, the consumption mode of the consumer is the user-defined consumption mode, and if not, acquiring the consumption mode preset by the face consumption equipment. The user-defined consumption mode can comprise a face recognition consumption mode, a consumption mode combining face recognition with a first confirmation mode or a consumption mode combining face recognition with a second confirmation mode; the consumption mode preset by the face consumption device can also comprise a face recognition consumption mode, a consumption mode combining face recognition with a first confirmation mode or a consumption mode combining face recognition with a second confirmation mode.

And if the consumption mode of the consumer is determined to be the face recognition consumption mode, the consumer can finish consumption settlement by directly brushing the face through the face consumption equipment.

If the consumption mode of the consumer is determined to be a consumption mode combining face recognition with a first confirmation mode, the consumer can click a consumption confirmation button displayed in a first consumption confirmation operation interface of the consumption equipment to initiate consumption deduction to the consumption management equipment, display a consumption result, account balance and the like, and then finish the consumption; the consumer can also click a cancel button displayed in a first consumption confirmation operation interface of the consumption equipment to directly cancel the consumption.

If the consumption mode of the consumer is determined to be the consumption mode combining the face recognition with the second confirmation mode, whether the user-defined gesture prestored by the consumer exists or not can be judged firstly. If the user-defined gesture prestored by the consumer is judged, the user-defined gesture of the consumer can be obtained, then gesture comparison is carried out, if the consumer hits the confirmation gesture, namely the consumer makes a gesture consistent with the user-defined confirmation consumption gesture, consumption deduction is initiated to the consumption management equipment, a consumption result, account balance and the like are displayed, and then the consumption is finished; if the consumer hits the cancellation gesture, the consumer is directly cancelled.

If the user-defined gesture prestored by the consumer is judged to be absent, the preset gesture corresponding to the human face consumption equipment can be continuously judged, if the preset gesture corresponding to the human face consumption equipment is present, the preset gesture corresponding to the human face consumption equipment can be obtained, then gesture comparison is carried out, if the consumer hits the confirmation gesture, namely the consumer makes a gesture consistent with the preset gesture for confirming consumption, consumption deduction is initiated to the consumption management equipment, a consumption result, an account balance and the like are displayed, and then the consumption is finished; if the consumer hits the cancellation gesture, the consumer is directly cancelled.

If the preset gesture corresponding to the face consumption equipment does not exist, a default gesture (head gesture) can be acquired, then head gesture recognition is carried out, if the consumer checks the head, consumption deduction is initiated to the consumption management equipment, a consumption result, an account balance and the like are displayed, and then the consumption is finished; if the consumer shakes his head to cancel, the consumer can directly cancel the consumption.

Therefore, in the embodiment, consumers can define consumption modes according to preferences of the consumers, each consumer can define different consumption modes, thousands of people can be achieved according to different people, and the personalized requirements of the consumers on face recognition consumption modes are met. Moreover, a face recognition consumption mode can be applied to a consumption scene with low consumption safety requirements, so that the time for confirming consumption and waiting is saved; for a consumption scene with a large number of consumers and certain requirements on the accuracy of a consumption result, the consumption information of the consumers can be confirmed by applying a consumption mode combining face recognition with a first confirmation mode or a consumption mode combining face recognition with a second confirmation mode, and the accuracy of the consumption result is ensured in the consumption scene with the large number of consumers; and to the consumption scene that has certain requirements such as sanitation and hygiene, etc., can employ the consumption mode of non-contact human face recognition and combining the second affirmation mode, the consumer can confirm the consumption through the posture affirmation mode of non-contact, the hygiene safety of the consumer has been guaranteed, and, the consumer can customize the posture used for confirming the consumption information in advance, everyone can define different postures, for example, some consumers can confirm the consumption information through the head posture, some consumers can confirm the consumption information through the face posture, some consumers can confirm the consumption information through the body posture, for the consumer who does not want to confirm the consumption information with the posture, can choose to confirm the consumption information through the affirmation button, greatly satisfied consumer's individualized demand. Namely, the face consumption equipment can provide a plurality of consumption modes suitable for various consumption scenes for consumers according to specific consumption scenes, and the multi-scene adaptability of face consumption is improved.

Corresponding to the face consumption method, the embodiment of the invention also provides a face consumption system. The following describes a face consumption system provided by an embodiment of the present invention. Fig. 9 is a schematic structural diagram of a face consumption system according to an embodiment of the present invention, and as shown in fig. 9, the face consumption system includes a face consumption device 901 and a consumption management device 902

The face consumption device 901 is used for acquiring a face image of a consumer; determining a corresponding consumption mode based on the face image; uploading consumption information of the consumer to the consumption management equipment based on the custom consumption mode under the condition that the consumption mode is the custom consumption mode; when the consumption mode is not the user-defined consumption mode, starting a preset consumption mode of the human face consumption device, and uploading the consumption information of the consumer to the consumption management device 902;

the consumption management device 902 is configured to receive the consumption information sent by the face consumption device, and complete consumption deduction based on the consumption information;

Therefore, the system provided by the embodiment of the invention is adopted to obtain the face image of the consumer; determining a corresponding consumption mode based on the face image; under the condition that the consumption mode is the user-defined consumption mode, based on the user-defined consumption mode, uploading the consumption information of the consumer to consumption management equipment, so that the consumption management equipment completes consumption deduction based on the consumption information; and under the condition that the consumption mode is not the user-defined consumption mode, starting a preset consumption mode of the human face consumption equipment, and uploading the consumption information of the consumer to the consumption management equipment so that the consumption management equipment completes consumption deduction based on the consumption information. The consumer can customize the consumption mode according to the preference of the consumer, and the personalized demand of the consumer on the face recognition consumption mode is met. In addition, under the condition that a consumer does not define a consumption mode by self, the embodiment of the invention also provides a plurality of consumption modes which are suitable for various consumption scenes, such as a face recognition consumption mode, a consumption mode combining face recognition with a first confirmation mode, a consumption mode combining face recognition with a second confirmation mode and the like, and the multi-scene adaptability of face consumption is improved.

Optionally, the face consumption device 901 is further configured to determine the preset consumption mode in the following manner:

Optionally, the human face consumption device 901 is specifically configured to upload the consumption information of the consumer to the consumption management device when the consumption mode is a human face recognition consumption mode; under the condition that the consumption mode is a consumption mode combining face recognition and a first confirmation mode, displaying a first consumption confirmation operation interface on the face consumption equipment, and uploading consumption information of the consumer to the consumption management equipment when an operation instruction of the consumer on the first consumption confirmation operation interface is obtained; and under the condition that the consumption mode is a consumption mode combining face recognition with a second confirmation mode, displaying a second consumption confirmation operation interface on the face consumption equipment, and after an operation instruction of the consumer on the second consumption confirmation operation interface is obtained, uploading the consumption information of the consumer to the consumption management equipment.

Optionally, the face consumption device 901 is specifically configured to display a first consumption confirmation operation interface including a consumption confirmation button on the face consumption device when the consumption mode is a consumption mode combining face recognition and a first confirmation mode; and uploading the consumption information of the consumer to the consumption management equipment under the condition of acquiring a confirmation instruction sent by the consumer based on the consumption confirmation button.

Optionally, the face consumption device 901 is specifically configured to display a second consumption confirmation operation interface including gesture confirmation information on the face consumption device when the consumption mode is a consumption mode combining face recognition and a second confirmation mode; and uploading the consumption information of the consumer to the consumption management device after the consumer makes the same gesture as the target gesture based on the gesture confirmation information.

Referring to fig. 10, the system further includes a rights management platform 1001;

the authority management platform 1001 is configured to issue a plurality of consumer information to the face consumption device; wherein the plurality of consumer information comprises: face image information and identity identification information corresponding to each consumer;

the face consumption device 901 is further configured to receive a plurality of consumer information issued by the rights management platform; comparing the face image with the face image information corresponding to each consumer, and taking the identity identification information corresponding to the face image information matched with the face image as the identity identification information of the consumer; and taking the consumption amount information and the identity information of the consumer as the consumption information of the consumer.

Therefore, by adopting the system provided by the embodiment of the invention, consumers can define consumption modes according to own preferences, each consumer can define different consumption modes, thousands of people can be realized from person to person, and the individual requirements of the consumers on face recognition consumption modes are met. Moreover, a face recognition consumption mode can be applied to a consumption scene with low consumption safety requirements, so that the time for confirming consumption and waiting is saved; for a consumption scene with a large number of consumers and certain requirements on the accuracy of a consumption result, the consumption information of the consumers can be confirmed by applying a consumption mode combining face recognition with a first confirmation mode or a consumption mode combining face recognition with a second confirmation mode, and the accuracy of the consumption result is ensured in the consumption scene with the large number of consumers; and to the consumption scene that has certain requirements such as sanitation and hygiene, etc., can employ the consumption mode of non-contact human face recognition and combining the second affirmation mode, the consumer can confirm the consumption through the posture affirmation mode of non-contact, the hygiene safety of the consumer has been guaranteed, and, the consumer can customize the posture used for confirming the consumption information in advance, everyone can define different postures, for example, some consumers can confirm the consumption information through the head posture, some consumers can confirm the consumption information through the face posture, some consumers can confirm the consumption information through the body posture, for the consumer who does not want to confirm the consumption information with the posture, can choose to confirm the consumption information through the affirmation button, greatly satisfied consumer's individualized demand. Namely, the face consumption equipment can provide a plurality of consumption modes suitable for various consumption scenes for consumers according to specific consumption scenes, and the multi-scene adaptability of face consumption is improved.

An embodiment of the present invention further provides a face consumption device, as shown in fig. 11, including a processor 1101, a communication interface 1102, a memory 1103 and a communication bus 1104, where the processor 1101, the communication interface 1102 and the memory 1103 complete mutual communication through the communication bus 1104,

a memory 1103 for storing a computer program;

the processor 1101 is configured to implement the steps of the face consumption method according to any of the above embodiments when executing the program stored in the memory 1103.

The communication bus mentioned in the above-mentioned face consumption device may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the human face consumption equipment and other equipment.

The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.

In another embodiment provided by the present invention, a computer-readable storage medium is further provided, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of any of the above-mentioned face consumption methods.

In yet another embodiment, the present invention further provides a computer program product containing instructions, which when run on a computer, causes the computer to execute any of the above-mentioned face consumption methods.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, the system, the face consumption device, the computer-readable storage medium, and the computer program product embodiments are substantially similar to the method embodiments, so that the description is simple, and the relevant points can be referred to only in the partial description of the method embodiments.

The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims

1. A face consumption method is characterized in that the face consumption method is applied to face consumption equipment of a face consumption system, the face consumption system further comprises consumption management equipment, and the method comprises the following steps:

acquiring a face image of a consumer;

determining a corresponding consumption mode based on the face image;

2. The method of claim 1, wherein the predetermined consumption pattern is determined by:

3. The method of claim 1, wherein the custom consumption pattern comprises one of a face recognition consumption pattern, a consumption pattern combining face recognition with a first confirmation method, and a consumption pattern combining face recognition with a second confirmation method.

4. The method of any of claims 1-3, wherein uploading the consumer's consumption information to the consumption management device comprises:

5. The method according to claim 4, wherein when the consumption mode is a consumption mode combining face recognition with a first confirmation mode, the displaying a first consumption confirmation operation interface on the face consumption device, and uploading the consumption information of the consumer to the consumption management device when an operation instruction of the consumer on the first consumption confirmation operation interface is acquired, includes:

6. The method according to claim 4, wherein when the consumption mode is a consumption mode combining face recognition and a second confirmation mode, the displaying a second consumption confirmation operation interface on the face consumption device, and after the operation instruction of the consumer on the second consumption confirmation operation interface is obtained, uploading the consumption information of the consumer to the consumption management device, includes:

7. The method of claim 6, wherein the target gesture comprises a default gesture, a preset gesture corresponding to the face consumption device, or a gesture customized by the consumer.

8. The method of claim 1, wherein the face consumption system further comprises a rights management platform;

9. A face consumption system is characterized in that the system comprises a face consumption device and a consumption management device;

10. The system of claim 9, wherein the face consumption device is further configured to determine the preset consumption pattern by:

11. The system of claim 9, wherein the custom consumption pattern comprises one of a face recognition consumption pattern, a consumption pattern combining face recognition with a first confirmation method, and a consumption pattern combining face recognition with a second confirmation method.

12. The system according to any one of claims 9-11,

the face consumption device is specifically configured to upload consumption information of the consumer to the consumption management device when the consumption mode is a face recognition consumption mode; under the condition that the consumption mode is a consumption mode combining face recognition and a first confirmation mode, displaying a first consumption confirmation operation interface on the face consumption equipment, and uploading consumption information of the consumer to the consumption management equipment when an operation instruction of the consumer on the first consumption confirmation operation interface is obtained; and under the condition that the consumption mode is a consumption mode combining face recognition with a second confirmation mode, displaying a second consumption confirmation operation interface on the face consumption equipment, and after an operation instruction of the consumer on the second consumption confirmation operation interface is obtained, uploading the consumption information of the consumer to the consumption management equipment.

13. The system of claim 12,

the face consumption equipment is specifically used for displaying a first consumption confirmation operation interface comprising a consumption confirmation button on the face consumption equipment under the condition that the consumption mode is a consumption mode combining face recognition and a first confirmation mode; and uploading the consumption information of the consumer to the consumption management equipment under the condition of acquiring a confirmation instruction sent by the consumer based on the consumption confirmation button.

14. The system of claim 12,

the face consumption equipment is specifically used for displaying a second consumption confirmation operation interface comprising gesture confirmation information on the face consumption equipment under the condition that the consumption mode is a consumption mode combining face recognition and a second confirmation mode; and uploading the consumption information of the consumer to the consumption management device after the consumer makes the same gesture as the target gesture based on the gesture confirmation information.

15. The system of claim 14, wherein the target gesture comprises a default gesture, a preset gesture corresponding to the face consumption device, or a gesture customized by the consumer.

16. The system of claim 9, further comprising a rights management platform;

17. The human face consumption equipment is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication through the communication bus by the memory;

a memory for storing a computer program;

a processor for implementing the method steps of any of claims 1 to 8 when executing a program stored in the memory.

18. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of the claims 1-8.