WO2021097827A1

WO2021097827A1 - Information confirmation method and apparatus, computer device and storage medium

Info

Publication number: WO2021097827A1
Application number: PCT/CN2019/120361
Authority: WO
Inventors: 吴晓; 胡龙耀; 耿路; 吴靖; 范育宸; 刘怀国; 刘润声
Original assignee: 连云港伍江数码科技有限公司
Priority date: 2019-11-22
Filing date: 2019-11-22
Publication date: 2021-05-27

Abstract

An information confirmation method and apparatus, a computer device and a storage medium, belonging to the field of video recognition technology. Said method comprises: acquiring article information of an article selected by an object and outputting the article information (S201); receiving confirmation feature information of the object performing a specific action (S202); and when the confirmation feature information matches pre-stored deletion confirmation information, determining that deletion confirmation of the object information is passed (S203). The method solves the problem that when shopping in an unmanned supermarket, more manual intervention is required, effectively saves manpower, and improves the efficiency of information deletion confirmation during shopping in an unmanned supermarket.

Description

Information confirmation method, device, computer equipment and storage medium

Technical field

The present invention relates to the field of video recognition technology, in particular to information confirmation methods, devices, computer equipment and storage media.

Background technique

With the development of society, unmanned supermarkets have gradually emerged. In practical applications, the unmanned supermarket is developing towards complete intelligence, that is, shopping is realized through the simplest human-computer interaction. In the process of implementing the present invention, the inventor found at least the following problems in the prior art: when generating item information, traditional unmanned supermarkets often need to manually delete the corresponding item information in the order through the supermarket system when selecting the wrong item. This makes shopping in an unmanned supermarket require more manual participation, and the efficiency is not high enough, and it does not conform to the original intention of the unmanned supermarket to reduce manpower.

Summary of the invention

Based on this, the present invention provides an information confirmation method, device, computer equipment and storage medium, which can realize the denial of shopping information in a more intelligent way.

The content of the embodiment of the present invention is as follows:

An information confirmation method includes the following steps: obtaining the article information of an article selected by an object and outputting the article information; receiving confirmation feature information of a specific action by the object, when the confirmation feature information is consistent with a pre-stored deletion confirmation When the information matches, it is determined that the deletion confirmation of the item information has passed.

In one of the embodiments, before the step of obtaining the item information of the item selected by the object and outputting the item information, the method further includes: obtaining verification feature information when the subject makes a verification action; When the stored verification information matches, it is determined that the identity verification of the object is passed.

In one of the embodiments, when the confirmation feature information matches the pre-stored deletion confirmation information, the step of determining that the deletion confirmation of the item information passes includes: when the confirmation feature information matches the pre-stored deletion confirmation information, When the shake-hand confirmation information and the confirmed biometric information match, it is determined that the deletion confirmation of the item information is passed.

In one of the embodiments, when the confirmation feature information matches the pre-stored shaking hand confirmation information and confirmation biometric information, before the step of determining that the deletion confirmation of the item information passes, the method further includes: obtaining from A definition instruction is used to prompt the object to perform a specific hand shaking action according to the custom instruction; obtain and store the hand shake confirmation information and confirmation biometric information when the object performs the specific hand shake action.

In one of the embodiments, before the step of obtaining the item information of the item selected by the object and outputting the item information, the method further includes: obtaining authentication feature information of the object, and performing authentication feature information on the object according to the authentication feature information. Authentication.

In one of the embodiments, the step of performing identity authentication on the object according to the authentication characteristic information includes: comparing the authentication characteristic information with pre-stored candidate authentication characteristic information, and judging whether there is a The candidate authentication feature information that matches the authentication feature information; if it exists, it is determined that the object passes the identity authentication.

In one of the embodiments, after the step of judging whether there is candidate authentication feature information matching the authentication feature information, the method further includes: if it does not exist, displaying registration request information; when the object is received according to the When the registration confirmation information is sent by the registration request information, the registered biometric information and/or coding information of the object is obtained, and the registered biometric information and/or coding information are stored as candidate authentication characteristic information; and the candidate authentication The feature information is bound to the corresponding item information.

Correspondingly, an embodiment of the present invention provides an information confirmation device, including: an item information acquisition module for acquiring item information of an item selected by an object and outputting the item information; a characteristic information receiving module for receiving the object's behavior The confirmation feature information of the specific action; and the information confirmation module is used to determine that the deletion confirmation of the item information is passed when the confirmation feature information matches the pre-stored deletion confirmation information.

In the above-mentioned information confirmation method and device, when the confirmation feature information of the subject when the subject performs a specific action matches the pre-stored deletion confirmation information, it is determined that the deletion confirmation of the item information is passed. It can effectively save manpower and improve the efficiency of the information deletion confirmation process.

A computer device includes a memory, a processor, and a computer program stored in the memory and running on the processor. The processor implements the following steps when the processor executes the computer program: obtains the item information of an item selected by an object and outputs it The item information; receiving the confirmation feature information of the specific action made by the object, and when the confirmation feature information matches the pre-stored deletion confirmation information, it is determined that the deletion confirmation of the item information is passed.

The above-mentioned computer device determines that the deletion confirmation of the item information is passed when the confirmation feature information when the subject performs a specific action matches the pre-stored deletion confirmation information. It can effectively save manpower and improve the efficiency of the information deletion confirmation process.

A computer-readable storage medium, on which a computer program is stored, when the computer program is executed by a processor, the following steps are realized: obtaining the item information of an item selected by an object and outputting the item information; receiving the object to make a specific The confirmation feature information of the action, when the confirmation feature information matches the pre-stored deletion confirmation information, it is determined that the deletion confirmation of the item information is passed.

The aforementioned computer-readable storage medium determines that the deletion confirmation of the item information is passed when the confirmation feature information when the subject performs a specific action matches the pre-stored deletion confirmation information. It can effectively save manpower and improve the efficiency of the information deletion confirmation process.

Description of the drawings

Figure 1 is an application environment diagram of an information confirmation method in an embodiment;

Figure 2 is a schematic flowchart of an information confirmation method in an embodiment;

Figure 3 is a schematic diagram of an object entering a specific area in an embodiment;

FIG. 4 is a schematic diagram of the process of shaking the head in an embodiment;

Fig. 5 is a schematic diagram of a process of shaking a hand in an embodiment;

FIG. 6 is a schematic diagram of the process of shaking a hand in another embodiment;

FIG. 7 is a schematic flowchart of an information confirmation method in another embodiment;

Figure 8 is a structural block diagram of an information confirmation device in an embodiment;

FIG. 9 is a structural block diagram of a video detection system in an embodiment;

Fig. 10 shows the internal structure of a computer device in an embodiment.

Detailed ways

In order to make the objectives, technical solutions, and advantages of the present invention clearer, the following further describes the present invention in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention.

The information confirmation method provided in this application can be applied to the application environment as shown in FIG. 1. The application environment can include a video detection system 101, an information input device 102, and an information output device 103, and the entire application environment can be integrated into a video detection system. The information input device 102 obtains the user's biological characteristics, videos, images and other information in a specific area. The video detection system 101 determines the object's item information according to the information input by the information input device 102, and at the same time controls the information output device 103 to output the corresponding item information In addition, the video detection system 101 according to the processing information input device 102 inputs the action information when the object performs a specific action, and judges whether the item information is deleted and confirmed according to the action information. Among them, the video detection system 101, the information input device 102, and the information output device 103 may all be terminals or servers. In the embodiment of the present invention, the terminal may be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices. The server may be implemented by an independent server or a server cluster composed of multiple servers.

In one embodiment, the information input device 102 obtains information such as the human body characteristics in a specific area covered, and transmits the information such as the human body characteristics to the video detection system 101. The video detection system processes the human body characteristic information obtained by the information input device 102 and stores it in the memory, and at the same time confirms the deletion of the item information according to the actions of the object. The information output device 103 is connected to the video detection system 101, and feeds back the image and other output of the video detection system in real time.

The embodiments of the present invention provide an information confirmation method, device, computer equipment, and storage medium. Detailed descriptions are given below.

In one embodiment, as shown in Figure 2, a method for information confirmation is provided. Taking the method applied to the video detection system in FIG. 1 as an example, the method includes the following steps:

S201: Obtain item information of the item selected by the object and output the item information.

Among them, the object can refer to a natural person, a robot, or an animal, etc., and can be one, two, or even multiple (when there are multiple objects, the item information of these objects can be confirmed separately). At the same time, the object can refer to consumers who enter a specific area (a specific area can refer to areas such as unmanned vending equipment, unmanned supermarkets, unmanned freezers, etc.). As shown in FIG. 3, there are two objects 302 in the dotted area (specific area 301), and the information input device 102 obtains the item information of the two objects 302.

Among them, items can refer to commodities in specific areas such as unmanned vending equipment, unmanned supermarkets, and unmanned freezers.

The item information may be a shopping list for determining the current shopping based on the item (the shopping behavior between the object entering and leaving the specific area can be regarded as a shopping). At the same time, the displayed item information may be the item information of all or part of the items selected by the object. When the item information is part of the item information, the item information of this part can be deleted and confirmed first, and the other item information can be confirmed after the deletion confirmation is completed.

Before obtaining the item information, it may include the process of binding the item information with the object. Therefore, when the item information of an object needs to be obtained, the corresponding item information can be determined according to the binding relationship.

Among them, the output item information can be displayed, broadcast, printed item information, etc. The present embodiment does not limit the manner of outputting item information, and only needs to allow the object to know the item information.

S202: Receive confirmation feature information of a specific action performed by the object.

Among them, the confirmation feature information can refer to information such as action feature information, biometric information, and so on. The action feature information refers to information such as action posture and action amplitude. Biometric information refers to fingerprints, facial features, iris, body shape and other information.

The specific action can be a preset action by the system or a self-defined action by the object. Further, the specific motion may be a head motion, a limb (arm, palm, etc.) motion, etc. It can be (swinging the head left and right), nodding (swinging the head up and down), shaking hands (swinging the palm up and down or left and right), etc. The embodiment of the present invention does not limit the frequency, angle, amplitude, etc. of a specific action.

The confirmation feature information of the object can be obtained through video recognition technology. Video recognition technology is a relatively mature and stable recognition technology so far, which can realize the recognition of human body, biological body, etc. Video recognition technology uses certain optical modules to obtain environmental images, video information, etc., and uses image analysis and other technologies to extract the required information in environmental images and video information and make corresponding judgments to make up for the incomprehensibility of conventional recognition technology . The current video recognition technology includes face recognition, video recognition, image recognition, text recognition, behavior recognition, iris recognition, eyeball focus positioning and other recognition technologies. The video detection technology can be realized by a camera device, etc. The camera device can also be a camera installed in a specific area, etc., or a mobile terminal of the subject. The video recognition technology can be applied to the various embodiments of the present invention, that is, the video recognition technology can be used to obtain confirmation feature information, confirm biometric information, verify biometric information, register biometric information, and so on.

S203: When the confirmation feature information matches the pre-stored deletion confirmation information, it is determined that the deletion confirmation of the item information is passed.

The pre-stored deletion confirmation information refers to the action characteristics, biometrics, and other information corresponding to the specific action. When the confirmation feature information matches the deletion confirmation information, it can be considered that the object’s current action is the same as the pre-stored specific action. Unanimous.

In addition, the deletion confirmation can be regarded as a denial of the item information.

At present, the purpose of unmanned supermarkets and other environments is to reduce the labor costs of management personnel and cashiers to a greater extent. However, in these environments, people are often required to perform manual operations on the terminal to determine shopping information, etc., which still requires a lot of manpower of shoppers. At the same time, if the terminal fails or is powered off, the information cannot be confirmed or denied, which brings great inconvenience to the shopping process. This embodiment judges whether the deletion confirmation of the item information is passed according to the confirmation characteristic information when the object performs a specific action. If the confirmation characteristic information matches the pre-stored deletion confirmation information, it is judged that the deletion confirmation of the article information is passed. The object can deny the item information by making a simple gesture. Therefore, there is no need for the object to perform manual operations on the terminal, which can effectively save manpower and improve the efficiency of the information denial process.

In one embodiment, after the deletion confirmation of the item information is passed, the corresponding item information can be deleted or hidden.

In an embodiment, when the confirmation feature information matches the pre-stored confirmation information, after the step of determining that the confirmation of the item information is passed, the method further includes: acquiring the numerical value transfer path information of the object, and passing the corresponding The transfer path of the value transfer.

That is, after the item information deletion confirmation is completed, the settlement information of the object is generated based on the deleted item information and the payment path of the object is determined, and the corresponding amount is deducted from the payment path. If all items are newly deleted and confirmed, then the subsequent steps such as generating settlement information may not be generated.

In one embodiment, before the step of obtaining the item information of the item selected by the object and outputting the item information, the method further includes: obtaining verification feature information when the object performs a verification action; when the verification feature information is stored in advance When the verification information matches, it is determined that the identity verification of the object is passed.

Among them, the verification action can be a preset action of the system or a self-defined action of the object. Further, the verification action may be a head action, a limb (arm, palm, etc.) action, etc. It can be movements such as shaking head, nodding head, or shaking hands. The verification action can be consistent with the aforementioned specific action, or it can be inconsistent.

Further, the object can generate information such as the action posture, the amplitude of the action, and the biological characteristics when performing the verification action. Therefore, verification feature information can refer to information such as action feature information, biometric information, and so on.

Verification information refers to the information used to verify the identity of an object, and the verification information can be action feature information, biometric information, and so on. In addition, the verification feature information and the pre-stored verification information may match completely, or the similarity may be greater than a certain threshold.

In one embodiment, the verification information includes: action feature information; after the step of obtaining the verification feature information when the object performs a verification action, the step includes: comparing the verification feature information with pre-stored action feature information Correct.

The action feature information may refer to feature information related to shaking hands or nodding.

In this embodiment, the verification feature information is compared with the pre-stored action feature information, and when the two match (that is, the action performed by the object matches the pre-stored action), it is determined that the corresponding object has passed the identity verification.

In an embodiment, the verification information includes: verification biometric information; after the step of obtaining verification characteristic information when the object performs a verification action, the step includes: combining the verification characteristic information with pre-stored verification biometric information Make comparisons.

In this embodiment, the verification feature information is compared with the pre-stored verification biometric information, and when the two match, it is determined that the corresponding object's identity verification is passed.

The above two embodiments compare the verification feature information with the pre-stored unique feature information, which can accurately verify the identity of the object.

In an embodiment, the action feature information, the verification biometric information, and the body feature information can be combined with the verification feature information for comparison, so as to further improve the accuracy of identity verification. Among them, the physical feature information may be information such as the height, weight, and body shape of the subject.

In the embodiment of the present invention, confirming biometric information, verifying biometric information, and registering biometric information can all be fingerprints, facial images, iris, body shape and other information that can represent the physiological characteristics of the object.

In one embodiment, the pre-stored deletion confirmation information includes: shaking head confirmation information and confirming biometric information.

Among them, the head shaking confirmation information refers to information such as the posture and amplitude of the subject's head shaking motion. Therefore, the specific action corresponding to the confirmation feature information can refer to shaking the head. Among them, the shaking of the head can be a single shaking of the head (one shaking of the head), two shaking of the head, or multiple shaking of the head. The frequency of shaking the head can be fast or slow, and the amplitude can be large or small. In addition, the embodiment of the present invention does not limit the angle of the head swing when shaking the head.

Further, one head shaking motion may be as shown in FIG. 4, and the single head shaking in FIG. 4 includes 5 decomposition motions. Among them, decomposition action 1: head straightening; decomposition action 2: no body movement, the head drives the neck to swing on the left side at the junction of the neck and shoulders; decomposition action 3: the head returns to the straight state; Decomposition action 4: no body movement, the head drives the neck to swing on the right side at the junction of the neck and shoulders; decomposition action 5: the head returns to a straight state. Two nods can be repeated single nodding, multiple nodding and so on. Of course, the head can first swing to the left or to the right first. It can also swing to one side only.

Therefore, when the confirmation characteristic information matches the pre-stored deletion confirmation information, the step of determining that the deletion confirmation of the item information is passed includes: when the confirmation characteristic information matches the pre-stored shaking head confirmation information and confirming the biometric characteristics When the information matches, it is determined that the deletion confirmation of the item information is passed.

In this embodiment, the confirmation feature information in the process of shaking the head of the subject is compared with the confirmation information of the shaking head and the confirmation biometric information. The subject can delete and confirm the item information as long as the subject performs a simple head movement, without the need for terminal operations and other processes. , Can effectively improve the efficiency of object information denial.

In one embodiment, the pre-stored deletion confirmation information includes: shaking hand confirmation information and confirming biometric information.

Among them, the shaking hand confirmation information refers to information such as the posture and amplitude of the object when the subject performs the shaking hand motion. Therefore, the specific action corresponding to the confirmation feature information can refer to shaking the hand. Among them, the shaking hand can be a single shaking hand (one shaking hand, for example, as shown in FIG. 5, the palm is from left to right and then from right to left once), two shaking hands, or multiple shaking hands. The frequency of shaking hands can be fast or slow, and the amplitude can be large or small. At the same time, the shaking hand can be performed with one hand (both left and right hands) or both hands, and the shaking hand can also be shaking hands up and down or waving hands.

Further, FIG. 6 is a schematic diagram of the process of shaking hands. A shaking hand action can be as shown in Figure 6, and a single shaking hand can include 3 decomposition actions (1, 2 and 3). According to the sequence of 1→2→3→2→1, it will cycle once as a single hand shake, and the two hand shakes can be repeated once single shake, multiple shakes and so on. It can be seen from Figure 6 that the starting position of the shaking hand can be varied (Figure 6 shows 6 shaking methods), and the embodiment of the present invention does not limit the starting position of the shaking process, the angle of the palm, the direction of the palm, etc. .

Therefore, when the confirmation feature information matches the pre-stored deletion confirmation information, the step of determining that the deletion confirmation of the item information has passed includes: when the confirmation feature information matches the pre-stored shaking hand confirmation information and confirming the biological When the feature information matches, it is determined that the deletion confirmation of the item information has passed.

In this embodiment, the confirmation feature information in the process of the subject shaking hand is compared with the shaking hand confirmation information and the confirmation biometric information. The subject can delete and confirm the item information only by performing simple hand movements, without the need for terminal operations and other processes. , Can effectively improve the efficiency of object information denial.

In one embodiment, if the confirmation feature information is not received after a period of time after the item information is displayed or the confirmation feature information does not match the pre-stored deletion confirmation information, it can be considered that the denial of the item information is not passed or the confirmation of the item information is considered passed.

In one embodiment, if information is received that the object performs other actions (such as nodding, etc.), it can be considered that the object confirms the corresponding item information.

In one embodiment, when the confirmation feature information matches the pre-stored deletion confirmation information, before the step of determining that the deletion confirmation of the item information is passed, the method further includes: acquiring a custom instruction, according to the The custom instruction prompts the subject to perform a specific head shaking motion; obtains and stores the head shaking confirmation information and confirmation biometric information when the subject performs the specific head shaking motion.

Among them, the custom instruction refers to an instruction that triggers a custom process of an action. The instruction can be triggered by the object through an action-defined button set in a specific area (unmanned supermarket or user terminal, etc.). At the same time, the process can be performed during the registration and authentication phase of the object or other phases after the registration and authentication.

For some special objects (for example: the elderly, people with impaired movements, people with insufficient hand integrity, etc.), due to health problems, they may be restricted from shaking their hands, so these objects can be customized One of the specific actions. In this embodiment, the shaking hand confirmation information and the confirming biometric information are determined according to the user-defined shaking hand action, and the user can define the posture, angle, amplitude, frequency, etc. of the shaking hand according to his own situation and habits. Taking full account of the different needs of the objects, the personalized treatment of different objects can effectively expand the scope of the targeted objects.

In one embodiment, when the confirmation feature information matches the pre-stored deletion confirmation information, before the step of determining that the deletion confirmation of the item information is passed, the method further includes: acquiring a custom instruction, according to the The custom instruction prompts the object to perform a specific shaking hand action; acquiring and storing the shaking hand confirmation information and confirmation biometric information when the object performs the specific shaking hand action.

In one embodiment, the subject can adjust the amplitude, frequency, etc. of the movement according to the preset shaking head and shaking hand movements of the system. New actions can also be reset, that is, actions other than shaking head and hand can be set as custom actions. At the same time, the verification action can also be customized.

Further, the object's action customization can be done through a terminal connected to the video detection system. It can also be performed by an imaging device or the like installed in a specific area. When the camera device is fixedly set in a specific area and the object is outside the optimal scanning area of the camera device due to height or other reasons, the motion information of the object can be captured by adjusting the angle of the camera device.

In one embodiment, the object may undergo registration authentication (obtaining the object's authentication information for candidate identity authentication) and identity authentication (determining whether the corresponding object is an authenticated object according to the information in the registration authentication process) before selecting an item the process of. After the registration authentication is passed, authentication is performed according to the authentication feature information (the authentication can be regarded as identity authentication). If the corresponding object is determined to be an authenticated object after identity authentication, the object is allowed to perform item selection and information confirmation. Of course, the process of identity authentication and registration authentication may not be performed on the object during the realization of the method of information confirmation.

It should be noted that, in the embodiment of the present invention, the description of registration authentication or identity authentication refers to the described authentication method. For unspecified "authentication", it refers to identity authentication.

Among them, the authentication feature information refers to the feature information used to authenticate the object, and the authentication feature information may be unique information such as biological feature information, physical feature information, and two-dimensional code information of the object.

In one embodiment, before the step of obtaining verification characteristic information when the object performs a verification action, the method further includes: obtaining authentication characteristic information of the object, and performing identity authentication on the object according to the authentication characteristic information.

In addition, authenticating an object can be to determine whether the corresponding authentication feature information is legal, and if it is legal, it can be determined that the corresponding object has passed the authentication; it can also be determined whether the corresponding authentication feature information is stored, and if it is stored, it can be determined that the corresponding object has passed the authentication. Certification. Taking shopping in an unmanned supermarket as an example, in order to distinguish different objects, the object needs to be authenticated before the object leaves the unmanned supermarket or the product is settled, and the object who fails the authentication is not sure the settler of this shopping. The objects that have passed the authentication are those that have been authenticated or that meet the corresponding authentication conditions. The objects that do not meet the authentication conditions are not the objects to be targeted. Therefore, in this step, the objects that have not passed the authentication are filtered.

This embodiment is a process of performing identity authentication on an object. The object is authenticated according to the authentication feature information, which can filter objects that have not passed the authentication, and improve the efficiency of the article information denial process.

In one embodiment, the step of performing identity authentication on the object according to the authentication characteristic information includes: comparing the authentication characteristic information with pre-stored candidate authentication characteristic information, and judging whether there is a The candidate authentication feature information that matches the authentication feature information; if it exists, it is determined that the object passes the identity authentication.

In this embodiment, the authentication feature information is compared with the candidate authentication feature information to determine whether there is candidate authentication feature information that matches the authentication feature information. If it exists, it means that the corresponding object is authenticated; if it does not exist, it means that the corresponding object is not authenticated. The subject’s authentication process is simple and accurate.

In one embodiment, before the step of comparing the authentication characteristic information with the pre-stored candidate authentication characteristic information, the method further includes: acquiring the biological characteristic information of the object, and storing the biological characteristic information as the candidate authentication characteristic information; Or, the object is prompted to perform a specific action, the action feature information in the process of the object performing the specific action is obtained, and the action feature information is stored as candidate authentication feature information.

In one embodiment, after the step of judging whether there is candidate authentication feature information that matches the authentication feature information, the method further includes: if it does not exist, displaying registration request information; when the object is received according to the registration When the registration confirmation information sent by the information is requested, the registered biometric information and/or coding information of the object is obtained, and the registered biometric information and/or coding information are stored as candidate authentication characteristic information; and the candidate authentication characteristic is stored The information is bound to the corresponding item information.

The process of binding candidate authentication feature information with corresponding item information may be: determining the item selected by the corresponding object, generating corresponding item information for the object based on the item, and establishing the item information and the corresponding candidate authentication feature Correspondence between information. When the object selects an item again, the information of the newly added item can be added to the corresponding item information according to the corresponding relationship.

Among them, the coding information can refer to the object number, user name, barcode, one-dimensional code, two-dimensional code, etc.

The realization process of obtaining the encoding information of the object may be: prompting the object to provide the encoding information, and the object inputs the corresponding encoding information through an external interface. It can also be: prompt the object to provide coding information, the object displays the two-dimensional code on the mobile terminal, and the system scans the two-dimensional code to obtain the corresponding two-dimensional code information. It can also be: after receiving the registration confirmation information sent by the object, the unique coding information is automatically generated for the object and fed back to the object.

In this embodiment, when the object authentication fails, it is determined whether to perform registration authentication according to the willingness of the object. When an object that has not passed authentication is willing to perform registration authentication (send registration confirmation information), the registered biometric information and/or coding information of the object that has passed authentication is used as candidate authentication feature information.

In one embodiment, when the registration confirmation information is received, the object may also be prompted to perform a specific (such as shaking hand, etc.) action, and the candidate authentication feature information can be determined based on the action feature information and/or biometric information during the execution of the specific action by the object . If the candidate authentication feature information contains action feature information, the object can be required to perform a specific action in the process of authenticating the object.

In one embodiment, after the step of performing identity authentication on the object according to the authentication feature information, the method further includes: storing the authentication result of the object authentication; if the object authentication fails, obtaining the object display information of the object, Display the object display information.

For example, when the object is authenticated, information such as "Authenticated" can be displayed. When the object is not authenticated, the object display information of the object can be displayed, such as "first visit to our store" and so on.

In an embodiment, the step of comparing the authentication feature information with the pre-stored candidate authentication feature information includes: comparing the authentication feature information with the pre-stored candidate biometric information.

In this embodiment, biometric feature information is used as authentication feature information.

In an embodiment, the step of comparing the authentication feature information with pre-stored candidate authentication feature information includes: comparing the authentication feature information with pre-stored candidate encoding information.

In this embodiment, the encoded information is determined as pre-stored authentication feature information.

This embodiment and the previous embodiment compare the authentication feature information with pre-stored candidate authentication information (candidate biometric information and candidate encoding information) to accurately authenticate the object and improve the accuracy of information determination.

In one embodiment, the confirmation feature information of the specific action taken by the object is received, and when the confirmation feature information matches the pre-stored deletion confirmation information, it is determined that after the step of confirming the deletion of the item information is passed, It also includes: generating a shopping list based on the item information confirmed by deletion (that is, deleting the item information confirmed by deletion).

In an embodiment, as shown in FIG. 7, an information confirmation method is provided, which includes the following steps:

S701. Obtain authentication feature information of the object, compare the authentication feature information with pre-stored candidate authentication feature information, and determine whether there is candidate authentication feature information that matches the authentication feature information; Said object has passed identity authentication.

S702. Obtain verification feature information when the authenticated object performs a verification action, and compare the verification feature information with pre-stored action feature information.

S703: When the verification feature information matches the pre-stored verification information, it is determined that the identity verification of the object is passed.

S704: Obtain item information of the item selected by the object and output the item information.

S705. Receive confirmation feature information of a specific action performed by the object, and when the confirmation feature information matches the pre-stored shaking hand confirmation information and confirmed biometric information, it is determined that the deletion confirmation of the item information has passed.

In this embodiment, the item information of the object that has passed the identity verification is acquired, and when the confirmation feature information of the object when the object performs a specific action matches the pre-stored deletion confirmation information, it is determined that the deletion confirmation of the item information is passed. It can effectively save manpower and improve the efficiency of the information deletion confirmation process.

In order to better understand the above method, an application example of the information confirmation method of the present invention is described in detail below. Arrange the camera device in the unmanned supermarket (using video recognition technology to detect the behavior characteristics and biological characteristics of the object from entering to leaving the unmanned supermarket), taking the object as a consumer from the perspective of the video detection system as an example Narrate. When consumers A and B enter the unmanned supermarket, they will confirm the information. The specific process is as follows:

1) The video detection system receives authentication feature information such as facial and body characteristics of A and B collected by a camera device facing the door of an unmanned supermarket.

2) The video detection system judges whether there is candidate authentication feature information matching these authentication feature information among the stored candidate authentication information. If there is candidate authentication feature information matching A's authentication feature information, then A passes the authentication; if there is no candidate authentication feature information matching B's feature information, then B fails the authentication.

3) The video detection system stores the authentication results of A and B, and performs authentication marks on A and B based on the authentication results (A mark means that the authentication is passed, and B mark is that the authentication has not passed), and at the same time controls the display to synchronously display the authentication results of A and B.

4) Ask the uncertified B through the broadcast whether it needs to be registered and authenticated and ask B to move to the registered display at the door of the unmanned supermarket for registration and certification. When B stands on the registration display, it prompts B to move his head left and right, extract B’s facial features and other biometric information, and use the biometric information as B’s candidate authentication feature information, and set a registered mark for B. The registration mark and candidate authentication feature information are stored, and the registration display prompts B to register successfully.

5) Real-time monitoring of A's information through video detection technology, determine the item selected by A, determine the item information according to the selected item, bind the item information with A, and generate a corresponding shopping list. And during the shopping process of A, the information of the newly selected items by A is added to the shopping list.

6) When A’s item selection is over and the purchase is ready to be settled, A is prompted to perform two-hand shake action, and obtain the verification feature information when A performs two-hand shake action. When the verification feature information matches the pre-stored action feature information , It is determined that A’s identity verification is passed.

7) Obtain the item information of A, and display the corresponding shopping information (including

shopping information

1, 2 and 3) one by one, prompting A to judge whether the shopping information is wrong. If it is wrong, ask A to shake his hands twice. If shopping information 1 is displayed, when the confirmation feature information of the two-hand shake action is received, when the confirmation feature information matches the pre-stored shaking hand confirmation information and confirmed biometric information, it is determined that the item information is deleted and confirmed Passed; delete the item information corresponding to shopping information 1. If the

shopping information

2 and 3 are displayed, and the confirmation feature information of the two shaking hands is not received, it is considered that the

shopping information

2 and 3 are confirmed by the user.

8) According to the confirmed

shopping information

2 and 3, the settlement information is generated, prompting A to complete the settlement process.

In this embodiment, after determining that an object is an authenticated object, the authenticated object is authenticated, and the item information of the object that has passed the authentication is obtained. When the object performs a specific action, the confirmation feature information and the pre-stored deletion When the confirmation information matches, it is determined that the deletion confirmation of the item information is passed. It can effectively save manpower and improve the efficiency of the information deletion confirmation process.

It should be noted that for the foregoing method embodiments, for simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described sequence of actions, because According to the present invention, certain steps can be performed in other order or simultaneously.

Based on the same idea as the information confirmation method in the above embodiment, the present invention also provides an information confirmation device, which can be used to execute the above information confirmation method. For ease of description, in the schematic structural diagram of the embodiment of the information confirmation device, only the parts related to the embodiment of the present invention are shown. Those skilled in the art can understand that the illustrated structure does not constitute a limitation on the device, and may include a More or fewer components, or combinations of certain components, or different component arrangements.

As shown in Fig. 8, the information confirmation device includes an article information acquisition module 801, a characteristic information receiving module 802, and an information confirmation module 803. The detailed description is as follows:

The item information acquiring module 801 is used to acquire item information of the item selected by the object and output the item information.

The characteristic information receiving module 802 is configured to receive the confirmation characteristic information of a specific action taken by the object.

And, the information confirmation module 803 is configured to determine that the deletion confirmation of the item information is passed when the confirmation feature information matches the pre-stored deletion confirmation information.

In one embodiment, it further includes: an information comparison module, configured to compare the verification feature information with pre-stored action feature information and/or verification biometric information.

In one embodiment, the information confirmation module 803 is further configured to determine that the deletion confirmation of the item information is passed when the confirmation feature information matches the pre-stored shake-hand confirmation information and the confirmation biometric information.

In one embodiment, the information confirmation module 803 includes: a custom instruction receiving sub-module, configured to obtain a custom instruction, and prompt the object to perform a specific shaking action according to the custom instruction; and a custom information acquisition sub-module, It is used to acquire and store the shaking hand confirmation information and confirming biometric information when the object performs the specific shaking hand action.

In one embodiment, it further includes: an authentication module, configured to obtain authentication feature information of the object, and perform identity authentication on the object according to the authentication feature information.

In one embodiment, the authentication module includes: an information comparison sub-module, configured to compare the authentication feature information with pre-stored candidate authentication feature information, and determine whether there is a candidate that matches the authentication feature information Authentication feature information; an authentication sub-module for determining that the object passes the identity authentication if it exists.

In one embodiment, the authentication module further includes: a registration request sub-module, which is used to display registration request information if it does not exist; and an authentication information acquisition sub-module, which is used when the object is received and sent according to the registration request information. When registering confirmation information, obtain the registered biometric information and/or encoding information of the object, and store the registered biometric information and/or encoding information as candidate authentication feature information; the item information binding sub-module is used to store The candidate authentication feature information is bound to the corresponding item information.

It should be noted that the information confirmation device of the present invention corresponds to the information confirmation method of the present invention in a one-to-one correspondence. The technical features and beneficial effects described in the above embodiments of the information confirmation method are all applicable to the embodiments of the information confirmation device. For the content, please refer to the description in the method embodiment of the present invention, which will not be repeated here, and it is hereby declared.

In addition, in the implementation of the information confirmation device of the above example, the logical division of each program module is only an example. In actual applications, the above functions can be changed according to needs, for example, due to the configuration requirements of the corresponding hardware or the convenience of software implementation. The allocation is completed by different program modules, that is, the internal structure of the information confirmation device is divided into different program modules to complete all or part of the functions described above.

In one embodiment, as shown in FIG. 9, a video detection system 101 is provided, which includes a video processing module, a video detection module, an identity information verification module, an identity information authentication module, an identity information binding module, and a video information storage Module, behavior information review module, behavior information storage module, behavior information definition module, display output module and extended function module. These modules are connected through a software link, a hardware link and a communication bus to realize an information confirmation method.

Among them, the video processing module is used to process the action behavior information and biometric information transmitted by the video detection module (including object identity verification, item information confirmation, action definition, etc.), and transmit the data obtained after analysis to the video storage Module for storage. The video processing module has a video output interface, and the video output interface is connected to a display, a player, or a speaker through a physical or wireless connection.

The video detection module is used to detect images, videos, texts, QR codes, human faces and other information within the detection range.

The video information storage module is used to store dynamic and static information such as data, user identity, and user actions in the video processing module (the video information storage module may be a non-volatile memory).

The identity information review module is used to analyze the information output by the video-conferencing processor module, determine the new users and/or old users among them, and identify the identified users.

The identity information authentication module is used to authenticate unauthenticated users and mark the authenticated users as authenticated.

The identity information binding module is used to bind the user's characteristic information with the item information.

The display output module is used for real-time output of video recognition results, commodity settlement and other information through the display, etc. (the display output module can be connected to external output devices such as the display through a wired or wireless manner).

The behavior information review module is used to judge the match between the motion behavior in the data detected by the video detection module and the motion behavior in the behavior information storage module.

The behavior information storage module stores the audit data of the behavior information audit module and the data of the behavior information definition module (where the behavior information storage module can be a storage, storage space or storage address independent of other storage in the video detection system) .

The behavior information definition module is used to correct, update, and add user behaviors, customize one's own habitual behavior, and confirm or replace the custom action information according to the user's satisfaction with the custom action information.

The expansion function module is used to expand the functions of the video detection system.

In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. 10. The computer equipment includes a processor, a memory, a network interface, and a database connected through a system bus. Among them, the processor of the computer device is used to provide calculation and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The database of the computer equipment is used to store data such as verification information and confirmation information. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, an information confirmation method is realized.

Those skilled in the art can understand that the structure shown in FIG. 10 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may Including more or fewer parts than shown in the figure, or combining some parts, or having a different arrangement of parts.

In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and running on the processor. When the processor executes the computer program, the following steps are implemented: Item information and output the item information; receive the confirmation feature information of the object performing a specific action, and when the confirmation feature information matches the pre-stored deletion confirmation information, it is determined that the deletion confirmation of the item information is passed.

In one embodiment, the processor further implements the following steps when executing the computer program: acquiring verification characteristic information when the object performs a verification action; when the verification characteristic information matches the pre-stored verification information, determining the identity of the object Verification passed.

In an embodiment, the processor further implements the following step when executing the computer program: when the confirmation feature information matches the pre-stored shaking hand confirmation information and confirmation biometric information, it is determined that the deletion confirmation of the item information is passed.

In one embodiment, the processor further implements the following steps when executing the computer program: acquiring a custom instruction, and prompting the object to perform a specific shaking hand based on the custom instruction; acquiring and storing the object to execute the specific shaking hand Shake your hand to confirm the information and confirm the biometric information during the action.

In an embodiment, the processor further implements the following steps when executing the computer program: acquiring authentication characteristic information of the object, and performing identity authentication on the object according to the authentication characteristic information.

In one embodiment, the processor further implements the following step when executing the computer program: comparing the authentication feature information with pre-stored candidate authentication feature information, and determining whether there is a candidate authentication feature matching the authentication feature information Information; if it exists, it is determined that the object passes the identity authentication.

In one embodiment, the processor further implements the following steps when executing the computer program: if it does not exist, display the registration request information; when receiving the registration confirmation information sent by the object according to the registration request information, obtain the object's Registering biometric information and/or encoding information, storing the registered biometric information and/or encoding information as candidate authentication feature information; binding the candidate authentication feature information with corresponding item information.

In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented: obtaining the item information of the item selected by the subject and outputting the item information; receiving The confirmation feature information for the object to perform a specific action, and when the confirmation feature information matches the pre-stored deletion confirmation information, it is determined that the deletion confirmation of the item information is passed.

In an embodiment, when the computer program is executed by the processor, the following steps are further implemented: obtaining verification characteristic information when the object performs a verification action; when the verification characteristic information matches the pre-stored verification information, determining the object Authentication passed.

In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: when the confirmation feature information matches the pre-stored shaking hand confirmation information and confirmation biometric information, it is determined that the deletion confirmation of the item information passes .

In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: acquiring a custom instruction, prompting the object to perform a specific hand-shaking action according to the custom instruction; acquiring and storing the object to execute the specific Shaking hand confirmation information and confirming biometric information when shaking hands.

In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: obtaining authentication characteristic information of the object, and performing identity authentication on the object according to the authentication characteristic information.

In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: the authentication feature information is compared with the pre-stored candidate authentication feature information, and it is determined whether there is a candidate authentication that matches the authentication feature information. Characteristic information; if it exists, it is determined that the object passes the identity authentication.

In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: if it does not exist, display the registration request information; when the registration confirmation information sent by the object according to the registration request information is received, obtain the object Store the registered biometric information and/or code information as candidate authentication feature information; bind the candidate authentication feature information with the corresponding item information.

A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program, and the program can be stored in a computer readable storage medium, as Independent product sales or use. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connections (electronic devices) with one or more wiring, portable computer disk cases (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable and editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, because it can be used, for example, by optically scanning the paper or other medium, followed by editing, interpretation, or other suitable media if necessary. The program is processed in a way to obtain the program electronically and then stored in the computer memory.

It should be understood that each part of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if it is implemented by hardware, as in another embodiment, it can be implemented by any one or a combination of the following technologies known in the art: Discrete logic circuits, application-specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.

The terms "including" and "having" and any variations thereof in the embodiments of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device that includes a series of steps or (module) units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optional The ground also includes other steps or units inherent to these processes, methods, products, or equipment.

The technical features of the above-mentioned embodiments can be combined arbitrarily. In order to make the description concise, all possible combinations of the various technical features in the above-mentioned embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, All should be considered as the scope of this specification.

The above-mentioned embodiments only express several embodiments of the present invention, and cannot be understood as a limitation of the patent scope of the present invention. It should be pointed out that for those of ordinary skill in the art, without departing from the concept of the present invention, several modifications and improvements can be made, and these all fall within the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention should be subject to the appended claims.

Claims

An information confirmation method, characterized in that it comprises the following steps:

Obtain the item information of the item selected by the object and output the item information;

Receiving confirmation feature information of a specific action taken by the object;

When the confirmation feature information matches the pre-stored deletion confirmation information, it is determined that the deletion confirmation of the item information is passed.
The information confirmation method according to claim 1, wherein before the step of obtaining the article information of the article selected by the object and outputting the article information, the method further comprises:

Obtain verification feature information when the object performs a verification action;

When the verification feature information matches the pre-stored verification information, it is determined that the identity verification of the object is passed.
The information confirmation method according to claim 1, wherein the deletion confirmation information comprises: shaking head confirmation information and confirming biometric information;

When the confirmation feature information matches the pre-stored deletion confirmation information, before the step of determining that the deletion confirmation of the item information passes, the method further includes:

Acquire a custom instruction, and prompt the subject to perform a specific head shaking movement according to the custom instruction;

Acquire and store head shaking confirmation information and confirmation biometric information when the object performs the specific shaking head action.
The information confirmation method according to claim 1, wherein the deletion confirmation information comprises: shaking hands confirmation information and confirming biometric information;

When the confirmation feature information matches the pre-stored deletion confirmation information, before the step of determining that the deletion confirmation of the item information passes, the method further includes:

Acquiring a custom instruction, and prompting the object to perform a specific hand-shaking action according to the custom instruction;

Acquire and store the shaking hand confirmation information and confirmed biometric information when the object performs the specific shaking hand action.
The information confirmation method according to claim 1, wherein before the step of obtaining the article information of the article selected by the object and outputting the article information, the method further comprises:

Obtain authentication feature information of the object, and perform identity authentication on the object according to the authentication feature information.
The information confirmation method according to claim 5, wherein the step of performing identity authentication on the object according to the authentication characteristic information comprises:

The authentication feature information is compared with the pre-stored candidate authentication feature information to determine whether there is candidate authentication feature information that matches the authentication feature information; if so, it is determined that the object passes the identity authentication.
The information confirmation method according to claim 6, wherein after the step of judging whether there is candidate authentication feature information that matches the authentication feature information, the method further comprises:

If it does not exist, display the registration request information;

When receiving the registration confirmation information sent by the object according to the registration request information, obtain the registered biometric information and/or coding information of the object, and use the registered biometric information and/or coding information as candidate authentication features Information is stored;

Bind the candidate authentication feature information with the corresponding item information.
An information confirmation device, characterized in that it comprises:

The item information acquisition module is used to acquire the item information of the item selected by the object and output the item information;

The characteristic information receiving module is used to receive the confirmation characteristic information of the specific action taken by the object;

And, the information confirmation module is configured to determine that the deletion confirmation of the item information is passed when the confirmation feature information matches the pre-stored deletion confirmation information.
A computer device, comprising a memory, a processor, and a computer program stored on the memory and running on the processor, wherein the processor implements the computer program described in any one of claims 1 to 7 when the processor executes the computer program. The steps of the method described.
A computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of the method according to any one of claims 1 to 7 when the computer program is executed by a processor.