CN113886791A - Identity information determining method and device, electronic equipment and storage medium - Google Patents

Identity information determining method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN113886791A
CN113886791A CN202111219097.1A CN202111219097A CN113886791A CN 113886791 A CN113886791 A CN 113886791A CN 202111219097 A CN202111219097 A CN 202111219097A CN 113886791 A CN113886791 A CN 113886791A
Authority
CN
China
Prior art keywords
image
matched
user
determining
sequence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111219097.1A
Other languages
Chinese (zh)
Inventor
李嘉茂
王文浩
朱冬晨
王磊
张晓林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Institute of Microsystem and Information Technology of CAS
Original Assignee
Shanghai Institute of Microsystem and Information Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Institute of Microsystem and Information Technology of CAS filed Critical Shanghai Institute of Microsystem and Information Technology of CAS
Priority to CN202111219097.1A priority Critical patent/CN113886791A/en
Publication of CN113886791A publication Critical patent/CN113886791A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/587—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2221/00—Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/21—Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/2111—Location-sensitive, e.g. geographical location, GPS
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2221/00—Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/21—Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/2151—Time stamp

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Library & Information Science (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Collating Specific Patterns (AREA)

Abstract

The embodiment of the application discloses a method, a device, electronic equipment and a storage medium for determining identity information, which comprises the steps of obtaining a to-be-verified face image of a user, and generating a first image sequence based on a dynamic target if the to-be-verified face image is matched with any candidate face image in a candidate face image set; wherein each first image in the sequence of first images comprises an object, the position of the object in each first image being different. And then acquiring a second image sequence corresponding to the user, wherein each second image in the second image sequence is a facial image of the user, which is acquired when the user gazes at the target, and the identity information of the user is determined according to the first image sequence and the second image sequence. According to the authentication method and the authentication system, the first image sequence watched by the user is randomly generated based on the dynamic target, so that the authentication system can be effectively prevented from being deceived by others by means of static pictures, video recording and the like, and the safety and reliability of the system can be improved.

Description

Identity information determining method and device, electronic equipment and storage medium
Technical Field
The present invention relates to the field of machine vision technologies, and in particular, to a method and an apparatus for determining identity information, an electronic device, and a storage medium.
Background
With the development of computer technology and the upgrading of various sensor technologies, intelligent identity authentication is widely applied to production and life. For example, unlocking of door access systems, card punching systems, and various electronic screens.
Traditional intelligent identity authentication based on passwords and fingerprints requires direct contact interaction, and hidden dangers in the aspect of health exist. The emerging intelligent identity authentication based on the camera for acquiring the face and the iris is easy to crack by static image deception although no direct contact type interaction exists. Although there are techniques in the prior art for dealing with still images through various kinds of in-vivo authentication, such as designating a user to make a fixed motion of blinking, swinging the head, and the like. However, the intelligent identity authentication can be realized by means of a dynamic video recorded in advance, and the safety and reliability of the system cannot be ensured.
Disclosure of Invention
The embodiment of the application provides a method and a device for determining identity information, electronic equipment and a storage medium, which can effectively prevent others from deceiving an authentication system by means of static pictures, video recording and the like, and can improve the safety and reliability of the system.
The embodiment of the application provides a method for determining identity information, which comprises the following steps:
acquiring a facial image to be verified of a user;
if the face image to be verified is matched with any candidate face image in the candidate face image set, generating a first image sequence based on a dynamic target; each first image in the sequence of first images comprises a target, the position of the target in each first image being different;
acquiring a second image sequence corresponding to a user; each second image in the second sequence of images is a facial image of the user captured while the user gazes at the target;
and determining the identity information of the user according to the first image sequence and the second image sequence.
Further, each first image comprises a first time identifier and first position information of the target;
each second image includes a second time identifier and second position information of a gaze drop point when the user gazes at the target.
Further, determining identity information of the user according to the first image sequence and the second image sequence comprises:
determining a first set of images to be matched from the first image sequence;
determining a second image set to be matched from the second image sequence according to the first image set to be matched; a first image to be matched in the first image set to be matched is in one-to-one correspondence with a second image to be matched in the second image set to be matched, and a first time identifier of the first image to be matched in one-to-one correspondence is matched with a second time identifier of the second image to be matched;
determining a position error set according to first position information of a first image to be matched and second position information of a second image to be matched which correspond to each other one by one;
and if the difference value between at least one position error and the preset error exists in the position error set within the preset interval, determining the identity information of the user as the legal user identity.
Further, the method further comprises:
when a user watches a target, acquiring a face image to be rechecked of the user;
matching the facial image to be rechecked with the facial image to be verified to obtain a first matching result;
matching the face image to be rechecked with the candidate face image set to obtain a second matching result;
and obtaining a target matching result based on the first matching result and the second matching result.
Correspondingly, the embodiment of the present application further provides an apparatus for determining identity information, including:
the first acquisition module is used for acquiring a facial image to be verified of a user;
the generating module is used for generating a first image sequence based on a dynamic target if the face image to be verified is matched with any candidate face image in the candidate face image set; each first image in the sequence of first images comprises a target, the position of the target in each first image being different;
the second acquisition module is used for acquiring a second image sequence corresponding to the user; each second image in the second sequence of images is a facial image of the user captured while the user gazes at the target;
and the first determining module is used for determining the identity information of the user according to the first image sequence and the second image sequence.
Further, the air conditioner is provided with a fan,
each first image comprises a first time identifier and first position information of the target;
each second image includes a second time identifier and second position information of a gaze drop point when the user gazes at the target.
Further, the first determining module includes:
a first determining submodule for determining a first set of images to be matched from the first sequence of images;
the second determining submodule is used for determining a second image set to be matched from the second image sequence according to the first image set to be matched; a first image to be matched in the first image set to be matched is in one-to-one correspondence with a second image to be matched in the second image set to be matched, and a first time identifier of the first image to be matched in one-to-one correspondence is matched with a second time identifier of the second image to be matched;
the third determining submodule is used for determining a position error set according to the first position information of the first image to be matched and the second position information of the second image to be matched which correspond to each other one by one;
and the fourth determining submodule is used for determining that the identity information of the user is a legal user identity if at least one difference value between the position error and the preset error exists in the position error set within a preset interval.
Further, the apparatus further comprises:
the third acquisition module is used for acquiring a face image to be rechecked of the user when the user watches the target;
the first matching module is used for matching the facial image to be rechecked with the facial image to be verified to obtain a first matching result;
the second matching module is used for matching the face image to be rechecked with the candidate face image set to obtain a second matching result;
and the second determining module is used for obtaining a target matching result based on the first matching result and the second matching result.
Accordingly, an embodiment of the present application further provides an electronic device, which includes a processor and a memory, where the memory stores at least one instruction, at least one program, a code set, or a set of instructions, and the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by the processor to implement the method for determining the identity information.
Accordingly, an embodiment of the present application further provides a computer-readable storage medium, in which at least one instruction, at least one program, a code set, or a set of instructions is stored, and the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by a processor to implement the above method for determining identity information.
The embodiment of the application has the following beneficial effects:
the embodiment of the application discloses a method, a device, electronic equipment and a storage medium for determining identity information, which comprises the steps of obtaining a to-be-verified face image of a user, and generating a first image sequence based on a dynamic target if the to-be-verified face image is matched with any candidate face image in a candidate face image set; wherein each first image in the sequence of first images comprises an object, the position of the object in each first image being different. And then acquiring a second image sequence corresponding to the user, wherein each second image in the second image sequence is a facial image of the user, which is acquired when the user gazes at the target, and the identity information of the user is determined according to the first image sequence and the second image sequence. According to the authentication method and the authentication system, the first image sequence watched by the user is randomly generated based on the dynamic target, so that the authentication system can be effectively prevented from being deceived by others by means of static pictures, video recording and the like, and the safety and reliability of the system can be improved. Moreover, by determining the face image to be rechecked, the situation that different users are replaced to identify in the identity determination process can be prevented, the accuracy of identity determination can be improved, and the safety and the reliability of the system can be further improved.
Drawings
In order to more clearly illustrate the technical solutions and advantages of the embodiments of the present application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a schematic diagram of an application environment provided by an embodiment of the present application;
fig. 2 is a schematic flowchart of a method for determining identity information according to an embodiment of the present application;
fig. 3 is a schematic flowchart of determining identity information of a user according to an embodiment of the present application;
fig. 4 is a schematic diagram of first location information of a first graph to be matched and second location information of a second graph to be matched, provided by an embodiment of the present application;
fig. 5 is a schematic flowchart of another identity information determination method provided in an embodiment of the present application;
fig. 6 is a schematic structural diagram of an apparatus for determining identity information according to an embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings. It should be apparent that the described embodiment is only one embodiment of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
An "embodiment" as referred to herein relates to a particular feature, structure, or characteristic that may be included in at least one implementation of the present application. In the description of the embodiments of the present application, it should be understood that the terms "first", "second" and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implying any number of technical features indicated. Thus, features defined as "first", "second" and "third" may explicitly or implicitly include one or more of the features. Moreover, the terms "first," "second," and "third," etc. are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in other sequences than described or illustrated herein. Furthermore, the terms "comprises" and "comprising," as well as any variations thereof, are intended to cover non-exclusive inclusions.
Please refer to fig. 1, which is a schematic diagram of an application environment according to an embodiment of the present application, including: the dynamic target motion estimation method comprises a computing processing device 101, an image display device 103, an image acquisition device 105 and a dynamic target 107, wherein the computing processing device 101 can be connected with the image display device 103, and the computing processing device 101 can be connected with the image acquisition device 105. The computing processing device 101 may obtain a to-be-verified face image of the user based on the image capturing device 105, and if the to-be-verified face image matches any candidate face image in the candidate face image set, generate a first image sequence on the image display device 103 based on the dynamic target; wherein each first image in the sequence of first images comprises an object, the position of the object in each first image being different. And then acquiring a second image sequence corresponding to the user, wherein each second image in the second image sequence is a facial image of the user, which is acquired when the user gazes at the target, and the identity information of the user is determined according to the first image sequence and the second image sequence.
In the embodiment of the application, the first image sequence watched by the user is randomly generated based on the dynamic target, so that the authentication system can be effectively prevented from being deceived by others by means of static pictures, video recording and the like, and the safety and reliability of the system can be improved. Moreover, by determining the face image to be rechecked, the situation that different users are replaced to identify in the identity determination process can be prevented, the accuracy of identity determination can be improved, and the safety and the reliability of the system can be further improved.
A specific embodiment of the identity information determination method of the present application is described below, and fig. 2 is a schematic flow chart of the identity information determination method provided in the embodiment of the present application, and the present specification provides the method operation steps as shown in the embodiment or the flow chart, but more or less operation steps may be included based on conventional or non-inventive labor. The order of steps recited in the embodiments is only one of many possible orders of execution and does not represent the only order of execution, and in actual execution, the steps may be performed sequentially or in parallel as in the embodiments or methods shown in the figures (e.g., in the context of parallel processors or multi-threaded processing). Specifically, as shown in fig. 2, the method includes:
s201: and acquiring a facial image to be verified of the user.
In the embodiment of the application, the computing processing device may acquire, through the image acquisition device, a to-be-verified facial image of the user, that is, an image including a face of a current observer.
S203: if the face image to be verified is matched with any candidate face image in the candidate face image set, generating a first image sequence based on a dynamic target; each first image of the sequence of first images comprises an object, the position of which in each first image is different.
In this embodiment of the application, after obtaining a to-be-verified face image of a user, a computing processing device may match the to-be-verified face image with each candidate face image in a candidate face image set, and if the matching is successful, that is, there is a candidate face image in the candidate face image set that matches the to-be-verified face image, a first image sequence may be generated on an image display device based on a dynamic target, where each first image in the first image sequence may include a target, a position of the target in each first image is different, that is, the target is dynamic and is moving, and a specific movement trajectory may be random.
In a particular embodiment, the computational processing device may recognize face data F from a facial image to be verified0And the face data F0Comparing with the data in the face database established in advance, and if the face data F0And matching with certain data in the face database, and randomly generating a video containing a moving target in real time. The face data may include features such as eyes, nose, mouth, and the like.
In an embodiment of the application, each first image may include a target, a first time identifier, and first location information of the target. That is, each of the first images may include a serial number corresponding to each of the first images, coordinates of a center of symmetry of the object in a first direction of the image display apparatus, and coordinates of the center of symmetry of the object in a second direction of the image display apparatus, wherein the first direction may be perpendicular to the second direction. That is, the center of symmetry of the object is on the horizontal and vertical coordinates on the image display device. Alternatively, the first image may be represented as P (n, x)i,yi) N may represent the sequence number of the first image, xiMay represent the coordinate of the center of symmetry of the object in a first direction, yiThe coordinates of the center of symmetry of the object in the second direction may be represented.
S205: acquiring a second image sequence corresponding to a user; each second image in the sequence of second images is an image of the user's face captured while the user is gazing at the target.
In the embodiment of the application, after the first image sequence is generated on the image display device, that is, after the video of the moving object is generated, the video containing the moving object can be controlled to be played, in the playing process, prompt information can be generated on the image display device to indicate a user to watch the object, and meanwhile, the image acquisition device can be controlled to acquire the facial image of the user to obtain the second image sequence corresponding to the user.
In the embodiment of the application, each second image in the second image sequence may include a second time identifier and second position information of a gaze point when the user gazes at the target. In a specific embodiment, the computing processing device may obtain position data corresponding to a pupil center and position data corresponding to an eyeball center in a face image when the user gazes at the target, and further determine the gaze direction according to the position data corresponding to the pupil center and the position data corresponding to the eyeball center, and further determine a gaze landing point of the gaze direction on the image display device and second position information corresponding to the gaze landing point according to a transformation rule between a coordinate system corresponding to the second image and a coordinate system corresponding to the image display device. Alternatively, the second image may be represented as Q (m, x)j,yj) M may represent the number of second images, xjMay represent the coordinate of the line of sight falling point in the first direction of the image display device, yjCoordinates of the line of sight falling point in the second direction of the image display apparatus may be represented.
S207: and determining the identity information of the user according to the first image sequence and the second image sequence.
Fig. 3 is a schematic flowchart of a process for determining identity information of a user according to an embodiment of the present application, and in an alternative implementation, the identity information of the user may be determined by the following steps, which include:
s301: a first set of images to be matched is determined from the first sequence of images.
In this embodiment of the application, the computing processing device may determine the first set of images to be matched from the first image sequence, that is, may extract a partial image from the first image sequence as the first set of images to be matched, or may use all images in the first image sequence as the first set of images to be matched, and the specific extraction rule is not limited in this specification.
S303: determining a second image set to be matched from the second image sequence according to the first image set to be matched; and the first images to be matched in the first image set to be matched correspond to the second images to be matched in the second image set to be matched one by one, and the first time identifications of the first images to be matched and the second time identifications of the second images to be matched which correspond one by one are matched.
In this embodiment of the application, the computing processing device may determine, according to the first set of images to be matched, the second set of images to be matched from the second image sequence, where a first image to be matched in the first set of images to be matched corresponds to a second image to be matched in the second set of images to be matched one to one, and a first time identifier of the first image to be matched that corresponds to the first time identifier of the second image to be matched is matched with a second time identifier of the second image to be matched.
In an alternative real-time manner, the computing processing device may determine, according to a first time identifier of any first image to be matched of the first image set to be matched, a second image to be matched that is the same as the first time identifier from the second image set to be matched, as the second image to be matched that corresponds to the first image to be matched, where n is m in the foregoing.
In another optional embodiment, the computing processing device may determine, according to a first time identifier of any one of the first images to be matched in the first image set to be matched, a second image to be matched, whose difference value with the first time identifier is within a preset difference value interval, from the second image set to be matched, as the second image to be matched corresponding to the first image to be matched.
S305: and determining a position error set according to the first position information of the first image to be matched and the second position information of the second image to be matched which are in one-to-one correspondence.
Fig. 4 is a schematic diagram of first location information of a first to-be-matched graph and second location information of a second to-be-matched graph provided in an embodiment of the present application. In an alternative embodiment, the calculation processing device may determine the position error set according to the first position information of the first corresponding image to be matched and the second position information of the second image to be matched. As in fig. 4, a1 is first position information of a first image to be matched and second position information of a B1 second image to be matched in a one-to-one correspondence, a2 is first position information of a first image to be matched and second position information of a B2 second image to be matched, A3 is first position information of a first image to be matched and second position information of a B3 second image to be matched in a one-to-one correspondence. The computing device may determine a position error based on a1 and B1, a position error based on a2 and B2, and a position error based on A3 and B3, resulting in a set of position errors.
In one particular embodiment, the computing device may determine the position error information according to the following equation:
Figure BDA0003311187710000091
wherein (x)i,yi) May represent first position information of an object in a first image to be matched, (x)j,yj) Second position information of the object in the second image to be matched may be represented.
S307: and if the difference value between at least one position error and the preset error exists in the position error set within the preset interval, determining the identity information of the user as the legal user identity.
In the embodiment of the application, after the position error set is determined, the computing and processing device may determine whether a position error of a difference value of the preset error in the position error set exists in a preset interval, and if it is determined that at least one difference value of the position error and the preset error in the position error set exists in the preset interval, the identity information of the user may be determined to be a legal user identity.
In a specific implementation manner, when there is a position error Diff smaller than a preset error, that is, a tolerance threshold lower limit Thre, the computing and processing device may consider that the gazing trajectory of the user is correct, and may further determine that the identity information of the user is a valid user identity. When each position error in the position error set is greater than or equal to the lower limit of the tolerance threshold, the computing and processing device can consider that the gazing track of the user is wrong, and further can judge that the identity information of the user is an illegal user identity.
In another optional implementation manner, the calculation processing device may determine that the gazing trajectory of the user is correct when determining that a difference between each position error in the position error set and the preset error is within a preset interval, and may further determine that the identity information of the user is a legal user identity, and if the calculation processing device determines that a difference between one position error and the preset error is outside the preset interval, may determine that the gazing trajectory of the user is wrong, and may further determine that the identity information of the user is an illegal user identity.
By adopting the method for determining the identity information provided by the embodiment of the application, the first image sequence watched by the user is randomly generated based on the dynamic target, so that the authentication system can be effectively prevented from being deceived by other people by means of static pictures, video recording and the like, and the safety and reliability of the system can be improved.
A specific embodiment of a method for determining identity information according to the present application is described below, and fig. 5 is a schematic flow chart of another method for determining identity information according to the embodiment of the present application, where the present specification provides the method operation steps as shown in the embodiment or the flow chart, but more or fewer operation steps may be included based on conventional or non-inventive labor. The order of steps recited in the embodiments is only one of many possible orders of execution and does not represent the only order of execution, and in actual execution, the steps may be performed sequentially or in parallel as in the embodiments or methods shown in the figures (e.g., in the context of parallel processors or multi-threaded processing). Specifically, as shown in fig. 5, the method includes:
s501: and acquiring a facial image to be verified of the user.
In the embodiment of the application, the computing processing device may acquire, through the image acquisition device, a to-be-verified facial image of the user, that is, an image including a face of a current observer.
S503: if the face image to be verified is matched with any candidate face image in the candidate face image set, generating a first image sequence based on a dynamic target; each first image of the sequence of first images comprises an object, the position of which in each first image is different.
In this embodiment of the application, after obtaining a to-be-verified face image of a user, a computing processing device may match the to-be-verified face image with each candidate face image in a candidate face image set, and if the matching is successful, that is, there is a candidate face image in the candidate face image set that matches the to-be-verified face image, a first image sequence may be generated on an image display device based on a dynamic target, where each first image in the first image sequence may include a target, a position of the target in each first image is different, that is, the target is dynamic and is moving, and a specific movement trajectory may be random.
In a particular embodiment, the computational processing device may recognize face data F from a facial image to be verified0And the face data F0Comparing with the data in the face database established in advance, and if the face data F0And matching with certain data in the face database, and randomly generating a video containing a moving target in real time. The face data may include features such as eyes, nose, mouth, and the like.
In an embodiment of the application, each first image may include a target, a first time identifier, and first location information of the target. That is, each of the first images may include a serial number corresponding to each of the first images, coordinates of a center of symmetry of the object in a first direction of the image display apparatus, and coordinates of the center of symmetry of the object in a second direction of the image display apparatus, wherein the first direction may be perpendicular to the second direction. That is, the center of symmetry of the target is in the figureLike the horizontal and vertical coordinates on the display device. Alternatively, the first image may be represented as P (n, x)i,yi) N may represent the sequence number of the first image, xiMay represent the coordinate of the center of symmetry of the object in a first direction, yiThe coordinates of the center of symmetry of the object in the second direction may be represented.
S505: acquiring a second image sequence corresponding to a user; each second image in the sequence of second images is an image of the user's face captured while the user is gazing at the target.
In the embodiment of the application, after the first image sequence is generated on the image display device, that is, after the video of the moving object is generated, the video containing the moving object can be controlled to be played, in the playing process, prompt information can be generated on the image display device to indicate a user to watch the object, and meanwhile, the image acquisition device can be controlled to acquire the facial image of the user to obtain the second image sequence corresponding to the user.
In the embodiment of the application, each second image in the second image sequence may include a second time identifier and second position information of a gaze point when the user gazes at the target. In a specific embodiment, the computing processing device may obtain position data corresponding to a pupil center and position data corresponding to an eyeball center in a face image when the user gazes at the target, and further determine the gaze direction according to the position data corresponding to the pupil center and the position data corresponding to the eyeball center, and further determine a gaze landing point of the gaze direction on the image display device and second position information corresponding to the gaze landing point according to a transformation rule between a coordinate system corresponding to the second image and a coordinate system corresponding to the image display device. Alternatively, the second image may be represented as Q (m, x)j,yj) M may represent the number of second images, xjMay represent the coordinate of the line of sight falling point in the first direction of the image display device, yjCoordinates of the line of sight falling point in the second direction of the image display apparatus may be represented.
507: and determining the identity information of the user according to the first image sequence and the second image sequence.
In this embodiment of the application, the computing processing device may determine a first set of images to be matched from the first image sequence, and determine a second set of images to be matched from the second image sequence according to the first set of images to be matched, where the first image to be matched in the first set of images to be matched corresponds to the second image to be matched in the second set of images to be matched one to one, and a first time identifier of the first image to be matched and a second time identifier of the second image to be matched that correspond to one are matched. Then, a position error set can be determined according to the first position information of the first image to be matched and the second position information of the second image to be matched, which are in one-to-one correspondence. And if the difference value between at least one position error and the preset error exists in the position error set within the preset interval, determining the identity information of the user as the legal user identity.
S509: acquiring a face image to be rechecked of a user;
in the embodiment of the application, the computing processing device can acquire the image of the face to be reviewed of the user.
In an alternative embodiment, the computing processing device may acquire the image of the face to be reviewed of the user based on the image acquisition device when the user gazes at the target, that is, the face data F1 of the user is acquired based on the image acquisition device during the process that the user gazes at the target.
In another alternative embodiment, the computing device may also determine the facial image to be reviewed of the user in the second image sequence.
S511: and matching the face image to be rechecked with the face image to be verified and the candidate face image set to obtain a target matching result.
In the embodiment of the application, the computing processing device can match the face image to be rechecked with the face image to be verified to obtain a first matching result in the process that a user watches a target, and match the face image to be rechecked with the candidate face image set to obtain a second matching result. And if the face image to be rechecked is matched with the face image to be verified and is matched with the face image to be verified in the candidate face image set, namely the user in the whole identification process is the same user and the user is a legal user which is input into the face database.
In another optional implementation manner, after determining that the identity information of the user is a legal user identity, the computing processing device may match the face image to be reviewed with the face image to be verified to obtain a first matching result, and match the face image to be reviewed with the candidate face image set to obtain a second matching result.
In the embodiment of the application, the face image to be rechecked is determined, so that the situation that different users are replaced to identify in the identity determination process can be prevented, the accuracy of identity determination can be improved, and the safety and the reliability of the system can be improved.
By adopting the method for determining the identity information provided by the embodiment of the application, the first image sequence watched by the user is randomly generated based on the dynamic target, so that the authentication system can be effectively prevented from being deceived by other people by means of static pictures, video recording and the like, and the safety and reliability of the system can be improved. Moreover, by determining the face image to be rechecked, the situation that different users are replaced to identify in the identity determination process can be prevented, the accuracy of identity determination can be improved, and the safety and the reliability of the system can be further improved.
Fig. 6 is a schematic structural diagram of the apparatus for determining identity information provided in the embodiment of the present application, and as shown in fig. 6, the apparatus may include:
the first obtaining module 601 may be configured to obtain a to-be-verified face image of a user;
the generating module 603 may be configured to generate a first image sequence based on the dynamic target if the face image to be verified matches any of the candidate face images in the set of candidate face images; each first image in the sequence of first images comprises a target, the position of the target in each first image being different;
the second obtaining module 605 may be configured to obtain a second image sequence corresponding to the user; each second image in the second sequence of images is a facial image of the user captured while the user gazes at the target;
the first determination module 607 may be configured to determine the identity information of the user from the first image sequence and the second image sequence.
In the embodiment of the application, each first image may include a first time identifier and first position information of a target; each second image may include a second time identification and second location information of a gaze drop point when the user gazes at the target.
In this embodiment of the application, the first determining module 607 may include:
a first determining sub-module operable to determine a first set of images to be matched from the first sequence of images;
the second determining submodule can be used for determining a second image set to be matched from the second image sequence according to the first image set to be matched; a first image to be matched in the first image set to be matched is in one-to-one correspondence with a second image to be matched in the second image set to be matched, and a first time identifier of the first image to be matched in one-to-one correspondence is matched with a second time identifier of the second image to be matched;
the third determining submodule can be used for determining a position error set according to the first position information of the first image to be matched and the second position information of the second image to be matched which correspond to each other one by one;
the fourth determining submodule may be configured to determine that the identity information of the user is a valid user identity if a difference between at least one position error in the position error set and the preset error is within a preset interval.
In this embodiment, the apparatus may further include:
the third acquisition module can be used for acquiring a face image to be rechecked of the user when the user watches the target;
the first matching module can be used for matching the facial image to be rechecked with the facial image to be verified to obtain a first matching result;
the second matching module can be used for matching the face image to be rechecked with the candidate face image set to obtain a second matching result;
the second determining module may be configured to obtain a target matching result based on the first matching result and the second matching result.
The device and method embodiments in the embodiments of the present application are based on the same application concept.
By adopting the device for determining the identity information, provided by the embodiment of the application, the first image sequence watched by the user is randomly generated based on the dynamic target, so that the authentication system can be effectively prevented from being deceived by other people by means of static pictures, video recording and the like, and the safety and reliability of the system can be improved. Moreover, by determining the face image to be rechecked, the situation that different users are replaced to identify in the identity determination process can be prevented, the accuracy of identity determination can be improved, and the safety and the reliability of the system can be further improved.
The present invention further provides an electronic device, which can be disposed in a server to store at least one instruction, at least one program, a code set, or a set of instructions related to implementing a method for determining identity information in the method embodiment, where the at least one instruction, the at least one program, the code set, or the set of instructions are loaded from the memory and executed to implement the method for determining identity information.
The present invention also provides a storage medium, which can be disposed in a server to store at least one instruction, at least one program, a code set, or a set of instructions related to implementing a method for determining identity information in the method embodiments, where the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by the processor to implement the method for determining identity information.
Optionally, in this embodiment, the storage medium may be located in at least one network server of a plurality of network servers of a computer network. Optionally, in this embodiment, the storage medium may include, but is not limited to, a storage medium including: various media that can store program codes, such as a usb disk, a Read-only Memory (ROM), a removable hard disk, a magnetic disk, or an optical disk.
As can be seen from the embodiments of the method, the apparatus, the electronic device, or the storage medium for determining identity information provided by the present application, the method in the present application includes acquiring a to-be-verified face image of a user, and generating a first image sequence based on a dynamic target if the to-be-verified face image matches any one of a set of candidate face images; wherein each first image in the sequence of first images comprises an object, the position of the object in each first image being different. And then acquiring a second image sequence corresponding to the user, wherein each second image in the second image sequence is a facial image of the user, which is acquired when the user gazes at the target, and the identity information of the user is determined according to the first image sequence and the second image sequence. According to the authentication method and the authentication system, the first image sequence watched by the user is randomly generated based on the dynamic target, so that the authentication system can be effectively prevented from being deceived by others by means of static pictures, video recording and the like, and the safety and reliability of the system can be improved. Moreover, by determining the face image to be rechecked, the situation that different users are replaced to identify in the identity determination process can be prevented, the accuracy of identity determination can be improved, and the safety and the reliability of the system can be further improved.
In the present invention, unless otherwise expressly stated or limited, the terms "connected" and "connected" are to be construed broadly, e.g., as meaning either a fixed connection or a removable connection, or an integral part; can be mechanically or electrically connected; either directly or indirectly through intervening media, either internally or in any other relationship. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
It should be noted that: the foregoing sequence of the embodiments of the present application is for description only and does not represent the superiority and inferiority of the embodiments, and the specific embodiments are described in the specification, and other embodiments are also within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in the order of execution in different embodiments and achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown or connected to enable the desired results to be achieved, and in some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
All the embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment is described with emphasis on differences from other embodiments. Especially, for the embodiment of the device, since it is based on the embodiment similar to the method, the description is simple, and the relevant points can be referred to the partial description of the method embodiment.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.

Claims (10)

1. A method for determining identity information, comprising:
acquiring a facial image to be verified of a user;
if the to-be-verified face image is matched with any candidate face image in the candidate face image set, generating a first image sequence based on a dynamic target; each first image of the sequence of first images comprises the object, the position of the object in each first image being different;
acquiring a second image sequence corresponding to the user; each second image in the sequence of second images is an image of the user's face captured while the user gazes at the target;
and determining the identity information of the user according to the first image sequence and the second image sequence.
2. The method of claim 1,
each first image comprises a first time identifier and first position information of the target;
each second image comprises a second time identifier and second position information of a sight line drop point when the user gazes at the target.
3. The method of claim 2, wherein determining the identity information of the user from the first image sequence and the second image sequence comprises:
determining a first set of images to be matched from the first image sequence;
determining a second image set to be matched from the second image sequence according to the first image set to be matched; a first image to be matched in the first image set to be matched is in one-to-one correspondence with a second image to be matched in the second image set to be matched, and the first time identifier of the first image to be matched and the second time identifier of the second image to be matched are in one-to-one correspondence;
determining a position error set according to the first position information of the first image to be matched and the second position information of the second image to be matched in a one-to-one correspondence manner;
and if the difference value between at least one position error and a preset error exists in the position error set within a preset interval, determining that the identity information of the user is a legal user identity.
4. The method according to any one of claims 1-3, further comprising:
when the user watches the target, acquiring a face image to be rechecked of the user;
matching the facial image to be rechecked with the facial image to be verified to obtain a first matching result;
matching the face image to be rechecked with the candidate face image set to obtain a second matching result;
and obtaining a target matching result based on the first matching result and the second matching result.
5. An apparatus for determining identity information, comprising:
the first acquisition module is used for acquiring a facial image to be verified of a user;
a generating module, configured to generate a first image sequence based on a dynamic target if the to-be-verified face image matches any candidate face image in a candidate face image set; each first image of the sequence of first images comprises the object, the position of the object in each first image being different;
the second acquisition module is used for acquiring a second image sequence corresponding to the user; each second image in the sequence of second images is an image of the user's face captured while the user gazes at the target;
and the first determining module is used for determining the identity information of the user according to the first image sequence and the second image sequence.
6. The apparatus of claim 5,
each first image comprises a first time identifier and first position information of the target;
each second image comprises a second time identifier and second position information of a sight line drop point when the user gazes at the target.
7. The apparatus of claim 6, wherein the first determining module comprises:
a first determining submodule for determining a first set of images to be matched from the first sequence of images;
the second determining submodule is used for determining a second image set to be matched from the second image sequence according to the first image set to be matched; a first image to be matched in the first image set to be matched is in one-to-one correspondence with a second image to be matched in the second image set to be matched, and the first time identifier of the first image to be matched and the second time identifier of the second image to be matched are in one-to-one correspondence;
a third determining submodule, configured to determine a position error set according to the first position information of the first image to be matched and the second position information of the second image to be matched, which are in one-to-one correspondence;
and the fourth determining submodule is used for determining that the identity information of the user is a legal user identity if the difference value between at least one position error and a preset error exists in the position error set within a preset interval.
8. The apparatus of any of claims 5-7, further comprising:
the third acquisition module is used for acquiring a face image to be rechecked of the user when the user watches the target;
the first matching module is used for matching the facial image to be rechecked with the facial image to be verified to obtain a first matching result;
the second matching module is used for matching the facial image to be rechecked with the candidate facial image set to obtain a second matching result;
and the second determining module is used for obtaining a target matching result based on the first matching result and the second matching result.
9. An electronic device, comprising a processor and a memory, wherein at least one instruction, at least one program, a set of codes, or a set of instructions is stored in the memory, and wherein the at least one instruction, the at least one program, the set of codes, or the set of instructions is loaded and executed by the processor to implement the method for determining identity information according to any one of claims 1-4.
10. A computer readable storage medium having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, which is loaded and executed by a processor to implement the method of determining identity information according to any one of claims 1 to 4.
CN202111219097.1A 2021-10-19 2021-10-19 Identity information determining method and device, electronic equipment and storage medium Pending CN113886791A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111219097.1A CN113886791A (en) 2021-10-19 2021-10-19 Identity information determining method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111219097.1A CN113886791A (en) 2021-10-19 2021-10-19 Identity information determining method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN113886791A true CN113886791A (en) 2022-01-04

Family

ID=79003805

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111219097.1A Pending CN113886791A (en) 2021-10-19 2021-10-19 Identity information determining method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113886791A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105184277A (en) * 2015-09-29 2015-12-23 杨晴虹 Living body human face recognition method and device
CN106203024A (en) * 2015-05-05 2016-12-07 北京海鑫科金高科技股份有限公司 Method and system are signed in a kind of long-distance video face
CN107622188A (en) * 2016-07-15 2018-01-23 阿里巴巴集团控股有限公司 Verification method, device, system and equipment based on biological characteristic
US20210294883A1 (en) * 2020-03-20 2021-09-23 Electronics And Telecommunications Research Institute Method and apparatus of active identity verification based on gaze path analysis

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106203024A (en) * 2015-05-05 2016-12-07 北京海鑫科金高科技股份有限公司 Method and system are signed in a kind of long-distance video face
CN105184277A (en) * 2015-09-29 2015-12-23 杨晴虹 Living body human face recognition method and device
CN107622188A (en) * 2016-07-15 2018-01-23 阿里巴巴集团控股有限公司 Verification method, device, system and equipment based on biological characteristic
US20210294883A1 (en) * 2020-03-20 2021-09-23 Electronics And Telecommunications Research Institute Method and apparatus of active identity verification based on gaze path analysis

Similar Documents

Publication Publication Date Title
CN110705507B (en) Identity recognition method and device
JP6451861B2 (en) Face authentication device, face authentication method and program
US10546183B2 (en) Liveness detection
CN109359548B (en) Multi-face recognition monitoring method and device, electronic equipment and storage medium
CN105184277B (en) Living body face recognition method and device
US10432624B2 (en) Identity verification method, terminal, and server
CN106156578B (en) Identity verification method and device
CN108369785A (en) Activity determination
CN109886080A (en) Human face in-vivo detection method, device, electronic equipment and readable storage medium storing program for executing
CN111241883B (en) Method and device for preventing cheating of remote tested personnel
CN108734092B (en) Person authentication device
CN107736874B (en) Living body detection method, living body detection device, living body detection equipment and computer storage medium
JP2023145582A (en) Multi-factor authentication for virtual reality
Makowski et al. Biometric identification and presentation-attack detection using micro-and macro-movements of the eyes
JP2013210902A (en) Biometric authentication device, biometric authentication method, and computer program for biometric authentication
WO2021180001A1 (en) Identity verification
US10872437B2 (en) Face authentication method
CN113886791A (en) Identity information determining method and device, electronic equipment and storage medium
US20140016859A1 (en) Systems, methods, and media for optical recognition
US11507646B1 (en) User authentication using video analysis
JP2016139353A (en) Image determination system and image determination method
Maeder et al. A visual attention approach to personal identification
CN113705428A (en) Living body detection method and apparatus, electronic device, and computer-readable storage medium
CN110909704A (en) Living body detection method and device, electronic equipment and storage medium
CN110110630B (en) Face recognition method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination