CN114267106A - Identity recognition method, device and equipment - Google Patents

Identity recognition method, device and equipment Download PDF

Info

Publication number
CN114267106A
CN114267106A CN202111580440.5A CN202111580440A CN114267106A CN 114267106 A CN114267106 A CN 114267106A CN 202111580440 A CN202111580440 A CN 202111580440A CN 114267106 A CN114267106 A CN 114267106A
Authority
CN
China
Prior art keywords
information
user
living body
image
frame image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111580440.5A
Other languages
Chinese (zh)
Inventor
周亮
李旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alipay Hangzhou Information Technology Co Ltd
Original Assignee
Alipay Hangzhou Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alipay Hangzhou Information Technology Co Ltd filed Critical Alipay Hangzhou Information Technology Co Ltd
Priority to CN202111580440.5A priority Critical patent/CN114267106A/en
Publication of CN114267106A publication Critical patent/CN114267106A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Collating Specific Patterns (AREA)

Abstract

The embodiment of the specification discloses an identity identification method, an identity identification device and identity identification equipment. The scheme comprises the following steps: triggering operation by obtaining face brushing authentication of a user on target equipment; based on the face brushing authentication triggering operation, intercepting a video frame image meeting an identification condition from a video image collected by a camera of the target equipment; and identifying the user based on the video frame image.

Description

Identity recognition method, device and equipment
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method, an apparatus, and a device for identity recognition.
Background
With the rapid development of electronic information and internet technologies, the security and accuracy of identity recognition and verification become more important, and face recognition refers in particular to a computer technology utilizing analysis and comparison. It belongs to the technology of biological feature recognition, and is used for distinguishing organism individuals from the biological features of organisms (generally specially referring to people).
Face recognition is a biometric technology for identity recognition based on facial feature information of a person. A series of related technologies, also commonly called face recognition and face recognition, are used to collect images or video streams containing faces by using a camera or a video camera, automatically detect and track the faces in the images, and further recognize the detected faces.
Therefore, there is a need to provide a more reliable identification scheme.
Disclosure of Invention
The embodiment of the specification provides an identity recognition method, an identity recognition device and identity recognition equipment, and aims to solve the problem of low recognition efficiency of the existing identity recognition method.
In order to solve the above technical problem, the embodiments of the present specification are implemented as follows:
an identity identification method provided by an embodiment of the present specification includes:
acquiring a face brushing authentication trigger operation of a user on a target device;
based on the face brushing authentication triggering operation, intercepting a video frame image meeting an identification condition from a video image collected by a camera of the target equipment; the initial acquisition time of the video image is earlier than the execution time of the face brushing authentication triggering operation;
and identifying the user based on the video frame image.
An identity recognition device provided by the embodiments of this specification includes:
the face brushing authentication triggering operation acquisition module is used for acquiring the face brushing authentication triggering operation of a user on the target equipment;
the video frame image intercepting module is used for intercepting a video frame image meeting the identification condition from a video image collected by a camera of the target equipment based on the face brushing authentication triggering operation; the initial acquisition time of the video image is earlier than the execution time of the face brushing authentication triggering operation;
and the identity recognition module is used for carrying out identity recognition on the user based on the video frame image.
An identity recognition device provided in an embodiment of the present specification includes:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to:
acquiring a face brushing authentication trigger operation of a user on a target device;
based on the face brushing authentication triggering operation, intercepting a video frame image meeting an identification condition from a video image collected by a camera of the target equipment; the initial acquisition time of the video image is earlier than the execution time of the face brushing authentication triggering operation;
and identifying the user based on the video frame image.
Embodiments of the present specification provide a computer readable medium having stored thereon computer readable instructions executable by a processor to implement an identification method.
At least one embodiment of the present description can achieve the following advantageous effects: triggering operation by obtaining face brushing authentication of a user on target equipment; based on the face brushing authentication triggering operation, intercepting a video frame image meeting an identification condition from a video image collected by a camera of the target equipment; and identifying the user based on the video frame image. In the method, the image acquisition process does not need to be displayed for the user in the whole identity identification process, and after the user clicks the face brushing authentication button, the identity identification of the user is completed in a state that the user does not sense, so that the time for the user to complete the image acquisition process is saved, and the identity identification efficiency of the user is improved.
Drawings
In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without any creative effort.
Fig. 1 is a schematic flow chart of an identity recognition method provided in an embodiment of the present disclosure;
fig. 2 is a schematic interface flow diagram of a face-brushing unlocking scheme in an identity recognition method provided in an embodiment of the present specification;
fig. 3 is a schematic interface flow diagram of a face-brushing unlocking scheme in an identity recognition method provided in the embodiment of the present specification;
fig. 4 is a schematic structural diagram of an identification apparatus provided in an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of an identification device according to an embodiment of the present disclosure.
Detailed Description
To make the objects, technical solutions and advantages of one or more embodiments of the present disclosure more apparent, the technical solutions of one or more embodiments of the present disclosure will be described in detail and completely with reference to the specific embodiments of the present disclosure and the accompanying drawings. It is to be understood that the embodiments described are only a few embodiments of the present specification, and not all embodiments. All other embodiments that can be derived by a person skilled in the art from the embodiments given herein without making any creative effort fall within the protection scope of one or more embodiments of the present disclosure.
The technical solutions provided by the embodiments of the present description are described in detail below with reference to the accompanying drawings.
In the prior art, for example, a self-service cabinet machine with a face brushing function is used, when a user brushes a face to perform identity recognition, face acquisition and recognition with perception are required to be performed, and an approximate face recognition flow is as follows: the user clicks the relevant button of brushing face authentication, shows the head portrait in the interface of screen and gathers the frame to the suggestion user puts into corresponding scanning frame with the head portrait, looks ahead at the screen, and user's the flow of brushing face can show in the screen of cabinet-type air conditioner, and the user can know the process of brushing face in the whole journey. However, it is possible to use a single-layer,
in practical application, the in-process of brushing the face, the user need accomplish face's discernment according to appointed gesture, after having gathered user's face information, upload again to the server and discern, the discernment passes through, opens cabinet-type air conditioner door, and the time overlength that whole process user need wait, and the process of whole unblanking lets the user experience very slowly. In addition, some users do not want to display their face information on public equipment in public places, and worry about privacy security risks.
Therefore, based on the above defects, the method provided by the embodiment of the present specification can reduce the safety problem of worrying about face information acquisition and privacy on the face acquisition page when the user brushes the face at the implement end by non-perception face brushing and not showing the face brushing process, and can also shorten the waiting time of the user for face brushing.
In order to solve the defects in the prior art, the scheme provides the following embodiments:
fig. 1 is a schematic flow chart of an identity recognition method provided in an embodiment of the present specification. From the viewpoint of a program, the execution subject of the flow may be a program installed in an application server or an application client. In this embodiment, the execution subject of the flow may be a server corresponding to a self-service container machine with a face brushing function. Be provided with image acquisition device on this self-service counter machine, for example: the camera, can also be provided with display device, for example: the display screen can hold a plurality of commodities in the self-service cabinet machine for self-service purchase of users. The server can receive the image information collected by the image collecting device, compare and verify the image information, and can also generate a trigger instruction for triggering the opening of the cabinet door so as to indicate the opening of the cabinet door and also generate response prompt information to be displayed on a screen of the cabinet machine.
As shown in fig. 1, the process may include the following steps:
step 110: and acquiring a face brushing authentication trigger operation of the user on the target equipment.
The target device may be a cabinet type device having a face brushing function. The face brushing authentication trigger operation may be an operation behavior in which the user clicks a face brushing authentication button. The user clicks on this button to trigger the identification process.
Step 120: based on the face brushing authentication triggering operation, intercepting a video frame image meeting an identification condition from a video image collected by a camera of the target equipment; and the initial acquisition time of the video image is earlier than the execution time of the face brushing authentication triggering operation.
In this step, before receiving a face brushing authentication trigger operation of the user, the image capture device provided on the target device may be in an on state, for example: the camera on the cabinet machine can be always in an open state to collect video images in a relevant range. Namely, the initial acquisition time of the video image is earlier than the execution time of the face brushing authentication triggering operation.
The video frame image satisfying the condition may be an image from which the user identity can be recognized, for example: the image with the definition meeting the identification condition can be obtained. The image satisfying the recognition condition may be one frame image or a plurality of frame images.
Step 130: and identifying the user based on the video frame image.
When the user is identified based on the intercepted image, the head portrait information of the user can be extracted based on the video frame image, and the user identity can be determined based on the comparison between the head portrait information of the user and the pre-stored head portrait information.
It should be understood that the order of some steps in the method described in one or more embodiments of the present disclosure may be interchanged according to actual needs, or some steps may be omitted or deleted.
The method in fig. 1 triggers an operation by acquiring a face brushing authentication of a user for a target device; based on the face brushing authentication triggering operation, intercepting a video frame image meeting an identification condition from a video image collected by a camera of the target equipment; and identifying the user based on the video frame image. In the method, the image acquisition process does not need to be displayed for the user in the whole identity identification process, and after the user clicks the face brushing authentication button, the identity identification of the user is completed in a state that the user does not sense, so that the time for the user to complete the image acquisition process is saved, and the identity identification efficiency of the user is improved.
Based on the process of fig. 1, some specific embodiments of the process are also provided in the examples of this specification, which are described below.
Optionally, in an actual application scenario, one camera or a plurality of cameras may be arranged on the cabinet, and the cameras may be always in an open state or may be opened after receiving an opening instruction. In the scheme, before the user executes the face brushing authentication triggering operation, the image information corresponding to the user is acquired; specifically, the image information of the user may be collected from the time when the user enters the camera collecting range, or the image information of the user may be collected when it is detected that the user is within a preset distance range from the cabinet unit.
As an implementation manner, before acquiring the face brushing authentication trigger operation of the user on the target device, the method may further include:
acquiring living body detection information in a to-be-detected area corresponding to the target equipment; the living body detection information is used for indicating that users meeting image acquisition conditions exist in the area to be detected;
and triggering identity recognition operation based on the face image based on the living body detection information, and carrying out image acquisition on the user in the area to be detected.
In this embodiment, the region to be detected may be a set acquisition range of the camera, or may be a preset range to be detected, for example: a cabinet radius of 2 meters, etc. The in-vivo detection information may be used to indicate that there is a user in the region to be detected who satisfies an image acquisition condition. When the living body user is detected to exist in the area to be detected, the identity recognition operation based on the face image is triggered, and the image acquisition is carried out on the user in the area to be detected. The camera can be always in an open state but only when a living body of a user is detected in the area to be detected, image acquisition is performed.
Before the obtaining of the living body detection information in the to-be-detected region corresponding to the target device, the method may further include:
acquiring continuous multi-frame image data;
and judging whether the living body to be identified exists in the image corresponding to the multi-frame image data or not according to the multi-frame image data.
In practical application, the living body detection can be a method for determining the real physiological characteristics of an object in some identity verification scenes, and in the application of face recognition, the living body detection can verify whether a user operates for the real living body by combining actions of blinking, mouth opening, head shaking, head nodding and the like and by using technologies of face key point positioning, face tracking and the like. Common attack means such as photos, face changing, masks, sheltering, screen copying and the like can be effectively resisted, so that a user is helped to discriminate fraudulent behaviors, and the benefit of the user is guaranteed; an infrared camera can be further installed on the cabinet machine, and a better attack prevention effect is achieved by utilizing infrared pictures. The reflection characteristics of real human faces and attack media such as paper sheets, screens, stereo masks and the like are different, so that the imaging is also different, and the difference is more obvious in the aspect of infrared wave reflection.
In addition, after the living body is identified, it is possible to further identify whether the living body is a living body of the user, but not other living bodies of animals, and in this case, a judgment may be made based on physical characteristics of a human, for example: judging whether the user living body is the user living body according to the body characteristics such as weight, height and the like which are easy to recognize, and triggering the identity recognition operation based on the face image to acquire the image of the user in the area to be detected when the user living body is the user living body.
By the method, the image of the user in the area to be detected can be acquired when the user enters the living body of the user in the area to be detected, so that image information is provided for subsequent face recognition, and the face recognition efficiency is improved.
Optionally, a first camera may be disposed on the target device; the first camera can be always in an open state; the acquiring of the living body detection information in the to-be-detected region corresponding to the target device may specifically include:
detecting whether living body information exists from image information shot by the first camera;
and if the living body information exists in the image information, acquiring the living body information.
The target equipment can be also provided with a second camera; the acquiring of the living body detection information in the to-be-detected region corresponding to the target device may specifically include:
when the first camera detects that the living body information exists in the image information, generating a trigger instruction;
starting the second camera to collect living body information based on the trigger instruction;
acquiring the living body information.
Specifically, the target device may be provided with only a first camera, the first camera is always in an open state, but video recording is performed, and only after a living user is detected to enter a to-be-detected range, the first camera is triggered to start image acquisition on the user. Of course, the target device may also be provided with a first camera and a second camera. The first camera is always in an opening state and used for detecting whether a living body user exists in a region to be detected, the second camera is opened only when a trigger instruction is received, and image acquisition is carried out on the living body user after the second camera is opened.
Optionally, when a video frame image meeting the identification condition is captured from a video image acquired by a camera, the following method may be adopted:
the method comprises the steps of intercepting a video frame image meeting definition identification requirements within a preset time length before triggering operation corresponding to the condition that a user clicks face brushing unlocking.
The identification condition is used for indicating that a video frame image meeting the identification condition is intercepted from a video image collected by a camera of the target device, and specifically may include:
and based on the trigger instruction, intercepting the video frame image which meets the definition preset condition and corresponds to the user within the preset time before the moment of executing the face brushing authentication trigger operation from the video image. The video image is an image corresponding to the user to be identified.
In the first method, when the user executes the trigger operation, the video frame image meeting the definition identification requirement is directly captured from the video frame before the trigger operation, so that the time for executing the face brushing process after the user clicks the face brushing operation can be saved, the identity identification efficiency of the user is improved, and the face brushing operation experience of the user is also improved.
And secondly, intercepting the video frame image corresponding to the trigger moment.
The capturing a video frame image satisfying the identification condition from a video image acquired by a camera of the target device may specifically include:
acquiring the trigger time of the trigger operation based on the trigger instruction;
and intercepting the video frame image which corresponds to the trigger moment and meets the definition preset condition from the video image.
The video frame image corresponding to the trigger time may be determined to be an image of the user to be identified, so as to determine that the identified user image is an image corresponding to the user who performs the trigger operation.
In the second method, the video frame image meeting the definition preset condition corresponding to the trigger moment is intercepted, so that the time for executing the face brushing process after the user clicks the face brushing operation can be saved, and the accuracy rate of user identity identification can be improved.
Optionally, after the obtaining of the living body detection information in the to-be-detected region corresponding to the target device, the method may further include:
displaying resource activity information on a screen of the target device; the resource activity information at least comprises commodity discount information in the target equipment and activity information of merchants where the target equipment is located.
The resource may be a virtual resource, such as: coupons, red packs, etc. The resource activity information may represent merchant offer information. The merchants can be merchants corresponding to the commodities in the cabinet, and can also be merchants entering the advertisement of the cabinet.
The resource activity information displayed on the screen can be determined according to the information such as the gender, the time period information, the historical selling of the cabinet air conditioner and the like of the user. When the living body user is identified, the gender information of the living body user can be further identified, and the gender information of the living body user is identified according to the gender characteristics. Different user groups have different demands on commodities; the demand for the goods may also vary from time period to time period; the displayed resource activity information may also be determined according to historical sales information of the cabinet, parking information of merchants, and the like, for example: according to the historical selling information, the exposure rate of the commodity with low selling amount can be improved, or hot sales commodities can be recommended to the user. And corresponding activity information can be displayed for the resident merchants to improve the exposure rate of the commodities of the resident merchants and the like. Therefore, when determining the goods displayed on the screen of the cabinet, the determination can be performed according to the gender of the user, the time period information, the historical selling information of the cabinet, the goods information in the cabinet, the resident merchant of the cabinet and the like. For example: before the user walks to the cabinet machine, the camera shoots and identifies the gender of the user, and the coupon or the commodity is recommended to the user according to the time period, the activity information of the resident commodity, the historical selling information of the cabinet machine and/or the information of the single coupon.
According to the method, in the process that the user waits for face brushing identification, in order to avoid loss of part of the user, the user can recommend coupons or commodities to the user in combination with brand coupons of merchants in the process that the user waits for acquisition identification and unlocking, and send out the coupons in combination with the merchants or a centralized platform, so that commodity information or coupon information is passed out in advance, the user is attracted to receive the coupons, and the coupon picking rate is improved.
The target device is a self-service cabinet machine, and after the identification of the user is performed based on the video frame image, the method may further include:
if the identity recognition of the user is successful, opening a cabinet door of the self-service cabinet machine with a face brushing function for the user; the cabinet door opening time and the user identity recognition success time have interval duration; if the identity recognition of the user is unsuccessful, displaying first prompt information on a screen of the self-service cabinet machine with the face brushing function; the first prompt information can be used for prompting a user to execute face brushing operation in a matched manner; and within the interval duration, providing a resource obtaining function corresponding to the resource activity information for the user on the screen.
For example: when a user walks to a machine tool, a resident camera is arranged behind a poster for collection, the user is prompted to click to swipe the face to open the door in a dialog box mode, commodities are recommended to the user, after the user clicks to swipe the face to open the door, a face photo is uploaded, at this time, if a merchant configures a brand ticket for the machine tool or a coupon is configured on a platform, an interactive style of recommended commodities or tickets appears in a page, after the identification is successful, a file in the dialog box becomes unlocking, the recommended commodities can be displayed at this time, but the commodity recommendation does not depend on the face identification, and whether the current machine tool is matched with tickets or is active or not can be judged in advance. After the user identification is successful, a coupon getting function can be provided for the user, the user can click to get the corresponding coupon for the user to use when the user settles the commodity, of course, the coupon has the corresponding service life, and the user is allowed to settle by using the coupon within the service life.
By the method, the machine tool end does not need to recommend commodities or query activities after identifying the user, but queries whether to prepare coupons or participate in activities after clicking and refreshing the faces according to the dimension of the machine tool; the method improves the advanced exposure of the coupon or brand commodity information and improves the receiving rate of the coupon.
Optionally, after providing the resource obtaining function corresponding to the resource activity information for the user on the screen, the method may further include:
acquiring the resource pickup information of the user;
and storing the resources into the account of the user for settling the commodity in the target equipment within a preset time period.
During settlement, the coupon can be converted into a resource amount corresponding to the electronic money, and the electronic money with the same amount is offset for payment.
Optionally, after the identifying the user based on the video frame image, the method may further include:
if the identity recognition of the user is successful, displaying a prompt page on a screen of the self-service cabinet machine with the face brushing function; the prompt page comprises account information of a user and information of commodities which can be selected in the self-service cabinet machine with the face brushing function; the account information comprises account identification information and account head portrait information. And the account head portrait information is a cartoon head portrait corresponding to the video frame image. By the implementation method, the information such as the account identification, the account head portrait and the commodity can be displayed for the user after the user identity identification is successful, the user can check the account identification and the account head portrait, determine that the account information is the account information of the user, and check the commodity information which can be selected.
After the user selects the coupon information, automatic settlement can be carried out, during settlement, whether available coupon information exists in the account of the user or not can be identified, namely whether the coupon information exists in the account of the user or not can be identified, if yes, whether the coupon information is in the service life or not can be further determined, and if the coupon information is in the service life, the coupon can be used for carrying out combined settlement.
Before displaying the resource activity information on the screen of the target device, the method may further include:
judging whether the commodity in the target equipment corresponds to resource activity information or not;
if the commodity in the target equipment corresponds to the resource activity information, displaying the resource activity information on a screen of the target equipment;
if the commodity in the target equipment has no resource activity information, displaying recommended commodity information on a screen of the target equipment; the recommended commodity information is commodity information contained in the target device.
As an implementation manner, when the commodity in the cabinet does not have activity information, and the merchant where the cabinet is located does not have activity information, the information of the commodity which can be selected in the cabinet can be displayed for the user in the process that the user waits for the face brushing identification unlocking.
By the method, besides manual dimension issuing, whether the activity recommends commodities in advance can be judged through the machine end, and exposure of the commodities of brand merchants is assisted.
Specifically, in the implementation process of the above embodiment, the flow of the face brushing unlocking may be described with reference to fig. 2:
fig. 2 is an interface flow diagram of a face-brushing unlocking scheme in an identity recognition method provided in an embodiment of the present specification. As shown in fig. 2, an interface 210 is displayed in the screen of the cabinet, the interface 210 at least includes a "swipe face to open the door" button 201 and first prompt information 202, and the first prompt information 202 may be used to prompt the user to click the "swipe face to open the door" button 201 to unlock the lock, so as to purchase a commodity. For example: the first prompt message 202 may be a "click to swipe the face to open the door" prompt message in the interface 210, which points to the "swipe the face to open the door" button 201 to prompt the user to click the button to unlock the lock. After the user clicks the button 201 of 'swiping face to open door', an interface 220 is displayed in the screen, the user is prompted to 'unlock in the middle' in the interface 220, an account head portrait 203 of the user is displayed, after the user identity identification is successful, the lock of the cabinet air conditioner is unlocked, second prompt information 204 is displayed in the interface 230, and the user is prompted to open the door to select commodities by the second prompt information 204. In addition, the account avatar 203 of the user and the account information identification information, such as: the account avatar 203 may be a cartoon avatar corresponding to the intercepted user avatar. After the user selects the commodity, the interface 240 may be entered, the interface 240 may be a settlement interface, and the prompt message "during settlement, please later" may be displayed in the interface 240, and the avatar information and the account identification information of the user may also be displayed.
The flow of coupon display may be described in conjunction with FIG. 3:
fig. 3 is an interface flow diagram of a face-brushing unlocking scheme in an identity recognition method provided in an embodiment of the present specification. As shown in fig. 3, an interface 310 is displayed in the screen of the cabinet, the interface 310 at least includes a "swipe face to open the door" button 301 and a third prompt message 302, and the third prompt message 302 can be used to prompt the user to click the "swipe face to open the door" button 201 to unlock the lock, so as to purchase a commodity. When a user clicks a 'face brushing and door opening' button 301, the user uploads the captured face photo after clicking the face brushing and door opening, and at this time, if a merchant configures a brand ticket for the machine or a platform configures a coupon, an interaction style of a recommended commodity or ticket appears in an interface 320. At this time, a prompt message "under recognition" may also be displayed in the interface 320. After the successful recognition, the dialog box of the interface 330 displays "unlocking", and can simultaneously display the commodity needing to be pushed every day and the account information (account identification and account head portrait) of the user, at this time, the interface 340 is jumped to, the interface 340 can display the coupon information and the getting function button, and the user can click the "getting" button to get.
By the method, the face brushing of the machine tool end does not show the face acquisition process and the video stream, and only shows the head portrait of the user; the whole process is displayed by taking a business scene as a progress, and the progress display of face brushing is removed; the user does not need to sense the process of brushing the face and checking the body, and the actual operation scene is displayed instead of the process of brushing the face after clicking to brush the face; meanwhile, the machine tool end does not need to recommend commodities or query activities after identifying a user, but queries whether coupons are matched or participate in activities after clicking and brushing the faces according to the dimensions of the machine tool, so that the advance exposure of the coupon or brand commodity information is improved, and the coupon picking rate is prompted.
Based on the same idea, the embodiment of the present specification further provides a device corresponding to the above method. Fig. 4 is a schematic structural diagram of an identification apparatus provided in an embodiment of the present disclosure. As shown in fig. 4, the apparatus may include:
the face brushing authentication triggering operation acquisition module is used for acquiring the face brushing authentication triggering operation of a user on the target equipment;
the video frame image intercepting module is used for intercepting a video frame image meeting the identification condition from a video image collected by a camera of the target equipment based on the face brushing authentication triggering operation; the initial acquisition time of the video image is earlier than the execution time of the face brushing authentication triggering operation;
and the identity recognition module is used for carrying out identity recognition on the user based on the video frame image.
The examples of this specification also provide some specific embodiments of the apparatus based on the apparatus of fig. 4, which is described below.
Optionally, the apparatus may further include:
the living body detection information acquisition module is used for acquiring the living body detection information in the to-be-detected area corresponding to the target equipment; the living body detection information is used for indicating that users meeting image acquisition conditions exist in the area to be detected;
and the identity recognition operation triggering module is used for triggering identity recognition operation based on the face image based on the living body detection information and carrying out image acquisition on the user in the area to be detected.
Optionally, a first camera may be disposed on the target device; the first camera can be in an open state; the living body detection information acquiring module may specifically include:
a living body information detecting unit for detecting whether or not there is living body information from the image information taken by the first camera;
a living body information acquisition unit configured to acquire living body information if the living body information exists in the image information.
Optionally, a second camera may be further disposed on the target device; the living body detection information acquiring module may specifically include:
a trigger instruction generating unit, configured to generate a trigger instruction when the first camera detects that the living body information exists in the image information;
the camera opening unit is used for opening the second camera to collect the living body information based on the trigger instruction;
a living body information acquisition unit for acquiring the living body information.
Optionally, the video frame image capturing module 420 may be specifically configured to:
and based on the trigger instruction, intercepting the video frame image which meets the definition preset condition and corresponds to the user within the preset time before the moment of executing the face brushing authentication trigger operation from the video image.
Optionally, the video frame image capturing module 420 may be specifically configured to:
acquiring the trigger time of the trigger operation based on the trigger instruction;
and intercepting the video frame image which corresponds to the trigger moment and meets the definition preset condition from the video image.
Optionally, the apparatus may further include:
the resource activity information display module is used for displaying resource activity information on a screen of the target equipment; the resource activity information at least comprises commodity discount information in the target equipment and activity information of merchants where the target equipment is located.
Optionally, the target device may be a self-service cabinet, and the apparatus may further include:
the cabinet door opening module is used for opening a cabinet door of the self-service cabinet machine with the face brushing function for the user if the identity recognition of the user is successful; the cabinet door opening time and the user identity recognition success time have interval duration; and within the interval duration, providing a resource obtaining function corresponding to the resource activity information for the user on the screen.
Optionally, the apparatus may further include:
the receiving information acquisition module is used for acquiring the receiving information of the user for the resources;
and the commodity settlement module is used for storing the resources into the account of the user and settling the commodity in the target equipment within a preset time period.
Optionally, the apparatus may further include:
the prompt page display module is used for displaying a prompt page on a screen of the self-service cabinet machine with the face brushing function if the identity identification of the user is successful; the prompt page comprises account information of a user and information of commodities which can be selected in the self-service cabinet machine with the face brushing function; the account information comprises account identification information and account head portrait information.
Optionally, the apparatus may further include:
the target commodity information acquisition module is used for acquiring target commodity information selected by the user after a cabinet door of the self-service cabinet machine is opened;
the judging module is used for judging whether the account of the user has the resource corresponding to the target commodity information or not to obtain a judging result;
and the payment module is used for carrying out automatic payment by adopting the resources and the electronic money in the account based on the commodity information if the judgment result shows that the account of the user has the resources corresponding to the target commodity information.
Optionally, the apparatus may be further configured to:
acquiring continuous multi-frame image data;
and judging whether the living body to be identified exists in the image corresponding to the multi-frame image data or not according to the multi-frame image data.
Optionally, the apparatus may be further configured to:
judging whether the commodity in the target equipment corresponds to resource activity information or not;
if the commodity in the target equipment corresponds to the resource activity information, displaying the resource activity information on a screen of the target equipment;
if the commodity in the target equipment has no resource activity information, displaying recommended commodity information on a screen of the target equipment; the recommended commodity information is commodity information contained in the target device.
Based on the same idea, the embodiment of the present specification further provides a device corresponding to the above method.
Fig. 5 is a schematic structural diagram of an identification device according to an embodiment of the present disclosure. As shown in fig. 5, the apparatus 500 may include:
at least one processor 510; and the number of the first and second groups,
a memory 530 communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory 530 stores instructions 520 executable by the at least one processor 510 to enable the at least one processor 510 to:
acquiring a face brushing authentication trigger operation of a user on a target device;
based on the face brushing authentication triggering operation, intercepting a video frame image meeting an identification condition from a video image collected by a camera of the target equipment; the initial acquisition time of the video image is earlier than the execution time of the face brushing authentication triggering operation;
and identifying the user based on the video frame image.
Based on the same idea, the embodiment of the present specification further provides a computer-readable medium corresponding to the above method. The computer readable medium has computer readable instructions stored thereon that are executable by a processor to implement the method of:
acquiring a face brushing authentication trigger operation of a user on a target device;
based on the face brushing authentication triggering operation, intercepting a video frame image meeting an identification condition from a video image collected by a camera of the target equipment; the initial acquisition time of the video image is earlier than the execution time of the face brushing authentication triggering operation;
and identifying the user based on the video frame image.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the apparatus embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
In the 90 s of the 20 th century, improvements in a technology could clearly distinguish between improvements in hardware (e.g., improvements in circuit structures such as diodes, transistors, switches, etc.) and improvements in software (improvements in process flow). However, as technology advances, many of today's process flow improvements have been seen as direct improvements in hardware circuit architecture. Designers almost always obtain the corresponding hardware circuit structure by programming an improved method flow into the hardware circuit. Thus, it cannot be said that an improvement in the process flow cannot be realized by hardware physical modules. For example, a Programmable Logic Device (PLD), such as a Field Programmable Gate Array (FPGA), is an integrated circuit whose Logic functions are determined by programming the Device by a user. A digital character system is "integrated" on a PLD by the designer's own programming without requiring the chip manufacturer to design and fabricate a dedicated integrated circuit chip. Furthermore, nowadays, instead of manually making an Integrated Circuit chip, such Programming is often implemented by "logic compiler" software, which is similar to a software compiler used in program development and writing, but the original code before compiling is also written by a specific Programming Language, which is called Hardware Description Language (HDL), and HDL is not only one but many, such as abel (advanced Boolean Expression Language), ahdl (alternate Hardware Description Language), traffic, pl (core universal Programming Language), HDCal (jhdware Description Language), lang, Lola, HDL, laspam, hardward Description Language (vhr Description Language), vhal (Hardware Description Language), and vhigh-Language, which are currently used in most common. It will also be apparent to those skilled in the art that hardware circuitry that implements the logical method flows can be readily obtained by merely slightly programming the method flows into an integrated circuit using the hardware description languages described above.
The controller may be implemented in any suitable manner, for example, the controller may take the form of, for example, a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an Application Specific Integrated Circuit (ASIC), a programmable logic controller, and an embedded microcontroller, examples of which include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320, the memory controller may also be implemented as part of the control logic for the memory. Those skilled in the art will also appreciate that, in addition to implementing the controller as pure computer readable program code, the same functionality can be implemented by logically programming method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Such a controller may thus be considered a hardware component, and the means included therein for performing the various functions may also be considered as a structure within the hardware component. Or even means for performing the functions may be regarded as being both a software module for performing the method and a structure within a hardware component.
The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices, or any other non-transmission medium which can be used to store information which can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims (16)

1. An identity recognition method, comprising:
acquiring a face brushing authentication trigger operation of a user on a target device;
based on the face brushing authentication triggering operation, intercepting a video frame image meeting an identification condition from a video image collected by a camera of the target equipment; the initial acquisition time of the video image is earlier than the execution time of the face brushing authentication triggering operation;
and identifying the user based on the video frame image.
2. The method of claim 1, before obtaining a face brushing authentication trigger operation of a user on a target device, further comprising:
acquiring living body detection information in a to-be-detected area corresponding to the target equipment; the living body detection information is used for indicating that users meeting image acquisition conditions exist in the area to be detected;
and triggering identity recognition operation based on the face image based on the living body detection information, and carrying out image acquisition on the user in the area to be detected.
3. The method of claim 2, the target device having a first camera disposed thereon; the first camera is in an open state; the acquiring of the living body detection information in the to-be-detected region corresponding to the target device specifically includes:
detecting whether living body information exists from image information shot by the first camera;
and if the living body information exists in the image information, acquiring the living body information.
4. The method of claim 3, the target device further having a second camera disposed thereon; the acquiring of the living body detection information in the to-be-detected region corresponding to the target device specifically includes:
when the first camera detects that the living body information exists in the image information, generating a trigger instruction;
starting the second camera to collect living body information based on the trigger instruction;
acquiring the living body information.
5. The method according to claim 1, wherein the capturing a video frame image satisfying the identification condition from a video image captured by a camera of the target device specifically includes:
and based on the trigger instruction, intercepting the video frame image which meets the definition preset condition and corresponds to the user within the preset time before the moment of executing the face brushing authentication trigger operation from the video image.
6. The method according to claim 1, wherein the capturing a video frame image satisfying the identification condition from a video image captured by a camera of the target device specifically includes:
acquiring the trigger time of the trigger operation based on the trigger instruction;
and intercepting the video frame image which corresponds to the trigger moment and meets the definition preset condition from the video image.
7. The method according to claim 2, after the obtaining of the living body detection information in the to-be-detected region corresponding to the target device, further comprising:
displaying resource activity information on a screen of the target device; the resource activity information at least comprises commodity discount information in the target equipment and activity information of merchants where the target equipment is located.
8. The method of claim 1, wherein the target device is a self-service cabinet, and further comprising, after identifying the user based on the video frame image:
if the identity recognition of the user is successful, opening a cabinet door of the self-service cabinet machine with a face brushing function for the user; the cabinet door opening time and the user identity recognition success time have interval duration; and within the interval duration, providing a resource obtaining function corresponding to the resource activity information for the user on the screen.
9. The method of claim 8, further comprising, after providing a resource pickup function corresponding to the resource activity information for a user on the screen:
acquiring the resource pickup information of the user;
and storing the resources into the account of the user for settling the commodity in the target equipment within a preset time period.
10. The method of claim 8, after identifying the user based on the video frame image, further comprising:
if the identity recognition of the user is successful, displaying a prompt page on a screen of the self-service cabinet machine with the face brushing function; the prompt page comprises account information of a user and information of commodities which can be selected in the self-service cabinet machine with the face brushing function; the account information comprises account identification information and account head portrait information.
11. The method of claim 8, further comprising:
after a cabinet door of the self-service cabinet machine is opened, target commodity information selected by the user is acquired;
judging whether the account of the user has resources corresponding to the target commodity information or not to obtain a judgment result;
and if the judgment result shows that the account of the user has the resource corresponding to the target commodity information, automatically paying by adopting the resource and the electronic money in the account based on the commodity information.
12. The method according to claim 2, before the obtaining of the living body detection information in the to-be-detected region corresponding to the target device, further comprising:
acquiring continuous multi-frame image data;
judging whether a living body to be identified exists in an image corresponding to the multi-frame image data or not according to the multi-frame image data;
the acquiring of the living body detection information in the to-be-detected region corresponding to the target device specifically includes:
and if the living body to be identified exists in the image corresponding to the multi-frame image data, acquiring the living body detection information in the to-be-detected area corresponding to the target equipment.
13. The method of claim 7, further comprising, prior to displaying resource activity information on a screen of the target device:
judging whether the commodity in the target equipment corresponds to resource activity information or not;
if the commodity in the target equipment corresponds to the resource activity information, displaying the resource activity information on a screen of the target equipment;
if the commodity in the target equipment has no resource activity information, displaying recommended commodity information on a screen of the target equipment; the recommended commodity information is commodity information contained in the target device.
14. An identification device comprising:
the face brushing authentication triggering operation acquisition module is used for acquiring the face brushing authentication triggering operation of a user on the target equipment;
the video frame image intercepting module is used for intercepting a video frame image meeting the identification condition from a video image collected by a camera of the target equipment based on the face brushing authentication triggering operation; the initial acquisition time of the video image is earlier than the execution time of the face brushing authentication triggering operation;
and the identity recognition module is used for carrying out identity recognition on the user based on the video frame image.
15. An identification device comprising:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to:
acquiring a face brushing authentication trigger operation of a user on a target device;
based on the face brushing authentication triggering operation, intercepting a video frame image meeting an identification condition from a video image collected by a camera of the target equipment; the initial acquisition time of the video image is earlier than the execution time of the face brushing authentication triggering operation;
and identifying the user based on the video frame image.
16. A computer readable medium having computer readable instructions stored thereon which are executable by a processor to implement a method of identification as claimed in any of claims 1 to 13.
CN202111580440.5A 2021-12-22 2021-12-22 Identity recognition method, device and equipment Pending CN114267106A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111580440.5A CN114267106A (en) 2021-12-22 2021-12-22 Identity recognition method, device and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111580440.5A CN114267106A (en) 2021-12-22 2021-12-22 Identity recognition method, device and equipment

Publications (1)

Publication Number Publication Date
CN114267106A true CN114267106A (en) 2022-04-01

Family

ID=80828745

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111580440.5A Pending CN114267106A (en) 2021-12-22 2021-12-22 Identity recognition method, device and equipment

Country Status (1)

Country Link
CN (1) CN114267106A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114757218A (en) * 2022-04-26 2022-07-15 中冶赛迪重庆信息技术有限公司 Bar information identification method, device, equipment and medium
CN115273153A (en) * 2022-09-26 2022-11-01 成都一颗牛油果科技有限公司 Image acquisition system for gymnasium storage cabinet

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109981444A (en) * 2019-03-01 2019-07-05 杭州比智科技有限公司 Information-pushing method and device based on interaction device
CN110992103A (en) * 2019-12-06 2020-04-10 创新奇智(成都)科技有限公司 Intelligent counter commodity sales promotion method based on face interaction
CN111126229A (en) * 2019-12-17 2020-05-08 中国建设银行股份有限公司 Data processing method and device
CN111539740A (en) * 2020-05-15 2020-08-14 支付宝(杭州)信息技术有限公司 Payment method, device and equipment
CN113128898A (en) * 2021-04-30 2021-07-16 上海商汤智能科技有限公司 Vending machine management method and device, electronic equipment and storage medium
CN113409087A (en) * 2021-06-29 2021-09-17 厦门互啪智能科技有限公司 Control method, device and equipment of intelligent civilian aircraft
CN113780212A (en) * 2021-09-16 2021-12-10 平安科技(深圳)有限公司 User identity verification method, device, equipment and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109981444A (en) * 2019-03-01 2019-07-05 杭州比智科技有限公司 Information-pushing method and device based on interaction device
CN110992103A (en) * 2019-12-06 2020-04-10 创新奇智(成都)科技有限公司 Intelligent counter commodity sales promotion method based on face interaction
CN111126229A (en) * 2019-12-17 2020-05-08 中国建设银行股份有限公司 Data processing method and device
CN111539740A (en) * 2020-05-15 2020-08-14 支付宝(杭州)信息技术有限公司 Payment method, device and equipment
CN113128898A (en) * 2021-04-30 2021-07-16 上海商汤智能科技有限公司 Vending machine management method and device, electronic equipment and storage medium
CN113409087A (en) * 2021-06-29 2021-09-17 厦门互啪智能科技有限公司 Control method, device and equipment of intelligent civilian aircraft
CN113780212A (en) * 2021-09-16 2021-12-10 平安科技(深圳)有限公司 User identity verification method, device, equipment and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114757218A (en) * 2022-04-26 2022-07-15 中冶赛迪重庆信息技术有限公司 Bar information identification method, device, equipment and medium
CN115273153A (en) * 2022-09-26 2022-11-01 成都一颗牛油果科技有限公司 Image acquisition system for gymnasium storage cabinet

Similar Documents

Publication Publication Date Title
JP4991440B2 (en) Product sales apparatus, product sales management system, product sales management method and program
CN105247541B (en) Financial account information is extracted in the improved digital picture from card
CN110866429A (en) Missed scanning identification method and device, self-service cash register terminal and system
CN109215254B (en) Physical store application system, user information processing method and device
US20160300247A1 (en) Sales data processing apparatus, server and method for acquiring attribute information
CN109213310B (en) Information interaction equipment, data object information processing method and device
JP2022048234A (en) Information processing system, customer identification device, information processing method, and program
CN111539740A (en) Payment method, device and equipment
US11625754B2 (en) Method for providing text-reading based reward-type advertisement service and user terminal for executing same
US20230316247A1 (en) Methods and systems for collecting and releasing virtual objects between disparate augmented reality environments
JP2016181100A (en) Information processing system, commodity registration apparatus, settlement apparatus, information processing method, and program
US11526923B1 (en) Financial alert system based on user photographs associated with user spending behavior
JP2022105052A (en) Information processing system, customer identification apparatus, information processing method and program
JP2002032553A (en) System and method for management of customer information and computer readable recording medium with customer information management program recorded therein
CN107730245A (en) Automatic accounting method, unmanned shop based on unmanned shop
CN114267106A (en) Identity recognition method, device and equipment
JP2017102846A (en) Customer servicing evaluation device and customer servicing evaluation method
JP2002032558A (en) System and method for management of customer information and computer readable recording medium with customer information management program recorded therein
JP2006215842A (en) Human movement line tracing system and advertisement display control system
US20170262870A1 (en) Information processing apparatus, method of controlling same, and non-transitory computer-readable storage medium
TWM570489U (en) Smart store shopping system
EP3640866A1 (en) Commodity data processing system
TWI760521B (en) Smart store shopping system and purchasing method using thereof
JP2016058074A (en) Behavior analysis device and behavior analysis program
WO2021230123A1 (en) Store system, information processing device, information processing method, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination