CN113486847A - Eyeball tracking-based in vivo detection method and device - Google Patents

Eyeball tracking-based in vivo detection method and device Download PDF

Info

Publication number
CN113486847A
CN113486847A CN202110849341.6A CN202110849341A CN113486847A CN 113486847 A CN113486847 A CN 113486847A CN 202110849341 A CN202110849341 A CN 202110849341A CN 113486847 A CN113486847 A CN 113486847A
Authority
CN
China
Prior art keywords
target object
living body
eyeball
action
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110849341.6A
Other languages
Chinese (zh)
Inventor
张�诚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bank of China Ltd
Original Assignee
Bank of China Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bank of China Ltd filed Critical Bank of China Ltd
Priority to CN202110849341.6A priority Critical patent/CN113486847A/en
Publication of CN113486847A publication Critical patent/CN113486847A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Eye Examination Apparatus (AREA)

Abstract

The invention provides a living body detection method and a living body detection device based on eyeball tracking, which can be used in the technical field of artificial intelligence, and the method comprises the following steps: displaying living body detection action and target object action prompt information, wherein the target object action prompt information is used for prompting the target object to adjust eyeball direction and eyesight when acting; capturing target object motion data, the target object motion data being made by the target object based on the presented liveness detection motion and the target object motion prompt information; when the target object is preliminarily determined to be a living body according to the target object action data, eyeball data characteristic information of the target object is obtained; and when the similarity of the eyeball data characteristic information and the historical eyeball data characteristic information of the target object is greater than a preset value, determining that the target object is a living body. The invention can realize the in-vivo detection based on the eyeball tracking and has high reliability.

Description

Eyeball tracking-based in vivo detection method and device
Technical Field
The invention relates to the technical field of artificial intelligence, in particular to a living body detection method and a living body detection device based on eyeball tracking.
Background
Along with the development of mobile internet technology, hacker attack means are continuously developed and innovated, the traditional safety protection means can not protect novel attack means, particularly face recognition living body detection technology, and along with the appearance of lip language recognition, blinking, head shaking and other living body detection technologies, the hacker attack means are applied and popularized in various fields, but problems occur, such as photo attack, video attack and the like, so that the living body detection technology is deceived, and the problem occurs in the service development process.
Disclosure of Invention
The embodiment of the invention provides a living body detection method based on eyeball tracking, which is used for realizing living body detection based on eyeball tracking and has high reliability, and the method comprises the following steps:
displaying living body detection action and target object action prompt information, wherein the target object action prompt information is used for prompting the target object to adjust eyeball direction and eyesight when acting;
capturing target object motion data, the target object motion data being made by the target object based on the presented liveness detection motion and the target object motion prompt information;
when the target object is preliminarily determined to be a living body according to the target object action data, eyeball data characteristic information of the target object is obtained;
and when the similarity of the eyeball data characteristic information and the historical eyeball data characteristic information of the target object is greater than a preset value, determining that the target object is a living body.
The embodiment of the invention provides a living body detection device based on eyeball tracking, which is used for realizing living body detection based on eyeball tracking and has high reliability, and the device comprises:
the action display module is used for displaying the living body detection action and the action prompt information of the target object, and the action prompt information of the target object is used for prompting the target object to adjust the direction and the sight of eyeballs when the target object acts;
the motion data capturing module is used for capturing target object motion data, and the target object motion data is made by the target object based on the displayed living body detection motion and the target object motion prompt information;
the preliminary judgment module is used for obtaining eyeball data characteristic information of the target object when the target object is preliminarily determined to be a living body according to the target object action data;
and the living body determining module is used for determining the target object as a living body when the similarity of the eyeball data characteristic information and the historical eyeball data characteristic information of the target object is greater than a preset value.
The embodiment of the present invention further provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the living body detection method based on eye tracking is implemented.
An embodiment of the present invention further provides a computer-readable storage medium, which stores a computer program for executing the above-mentioned eyeball tracking-based in-vivo detection method.
In the embodiment of the invention, the living body detection action and the action prompt information of the target object are displayed, and the action prompt information of the target object is used for prompting the target object to adjust the direction and the sight of the eyeball when the target object acts; capturing target object motion data, the target object motion data being made by the target object based on the presented liveness detection motion and the target object motion prompt information; when the target object is preliminarily determined to be a living body according to the target object action data, eyeball data characteristic information of the target object is obtained; and when the similarity of the eyeball data characteristic information and the historical eyeball data characteristic information of the target object is greater than a preset value, determining that the target object is a living body. In the process, the target object is guided to complete the in-vivo detection according to the set data, and comparison is carried out based on the historical eyeball data characteristic information, so that the difficulty of attacking an attacker through playing videos or synthetic images can be improved, the in-vivo detection safety is effectively improved, and the behavior that the attacker attacks through recording videos for multiple times is prevented.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts. In the drawings:
FIG. 1 is a flowchart illustrating an eye tracking-based in-vivo detection method according to an embodiment of the present invention;
FIG. 2 is a detailed flowchart of an eye tracking-based in-vivo detection method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of an eye tracking-based biopsy device according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating a preliminary determination module according to an embodiment of the present disclosure;
FIG. 5 is a diagram of a computer device in an embodiment of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the embodiments of the present invention are further described in detail below with reference to the accompanying drawings. The exemplary embodiments and descriptions of the present invention are provided to explain the present invention, but not to limit the present invention.
In the description of the present specification, the terms "comprising," "including," "having," "containing," and the like are used in an open-ended fashion, i.e., to mean including, but not limited to. Reference to the description of the terms "one embodiment," "a particular embodiment," "some embodiments," "for example," etc., means that a particular feature, structure, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. The sequence of steps involved in the embodiments is for illustrative purposes to illustrate the implementation of the present application, and the sequence of steps is not limited and can be adjusted as needed.
Fig. 1 is a flowchart of an eyeball tracking-based in-vivo detection method according to an embodiment of the present invention, as shown in fig. 1, the method includes:
step 101, displaying a living body detection action and target object action prompt information, wherein the target object action prompt information is used for prompting that the direction and the sight of eyeballs are adjusted when a target object acts;
step 102, capturing target object motion data, wherein the target object motion data is made by a target object based on the displayed living body detection motion and target object motion prompt information;
103, acquiring eyeball data characteristic information of the target object when the target object is preliminarily determined to be a living body according to the target object action data;
and 104, when the similarity of the eyeball data characteristic information and the historical eyeball data characteristic information of the target object is greater than a preset value, determining that the target object is a living body.
In the embodiment, the living body detection is finished by guiding the target object according to the set data, and the comparison is carried out based on the historical eyeball data characteristic information, so that the difficulty of attacking an attacker through playing videos or synthetic images can be improved, the safety of the living body detection is effectively improved, and the behavior of attacking the attacker through recording videos and playing the videos for multiple times is prevented.
In specific implementation, steps 101 and 102 may be performed in the front end, and steps 103 and 104 may be performed in the background. When the similarity between the eyeball data characteristic information and the historical eyeball data characteristic information of the target object is greater than a preset value and the target object is determined to be a living body, the preset value can be determined according to actual needs, for example 90%, and the preset value can be dynamically adjusted.
In an embodiment, the liveness detection action comprises one or any combination of shaking, blinking and nodding.
In one embodiment, preliminarily determining the target object as a living body based on the target object motion data includes:
and when the target object action in the target object action data is determined to be consistent with the displayed living body detection action and the eyeball position in the target object action data meets the preset position requirement, preliminarily determining the target object as the living body.
In one embodiment, the eyeball data feature information includes a feature value of a line of sight direction and an image.
In combination with the above embodiments, a detailed flowchart is given below, and fig. 2 is a detailed flowchart of an eyeball tracking-based in-vivo detection method in an embodiment of the present invention, which includes:
step 201, displaying a living body detection action and target object action prompt information, wherein the target object action prompt information is used for prompting that the direction and the sight of eyeballs are adjusted when a target object acts;
step 202, capturing target object motion data, wherein the target object motion data is made by a target object based on the displayed living body detection motion and target object motion prompt information;
step 203, when it is determined that the target object action in the target object action data is consistent with the displayed living body detection action and the eyeball position in the target object action data meets the preset position requirement, preliminarily determining that the target object is a living body;
step 204, eyeball data characteristic information of the target object is obtained;
step 205, when the similarity between the eyeball data characteristic information and the historical eyeball data characteristic information of the target object is greater than a preset value, determining that the target object is a living body.
In summary, in the method provided in the embodiment of the present invention, the living body detection action and the target object action prompt information are displayed, and the target object action prompt information is used for prompting the target object to adjust the eyeball direction and the gaze when the target object performs an action; capturing target object motion data, the target object motion data being made by the target object based on the presented liveness detection motion and the target object motion prompt information; when the target object is preliminarily determined to be a living body according to the target object action data, eyeball data characteristic information of the target object is obtained; and when the similarity of the eyeball data characteristic information and the historical eyeball data characteristic information of the target object is greater than a preset value, determining that the target object is a living body. In the process, the target object is guided to complete the in-vivo detection according to the set data, and comparison is carried out based on the historical eyeball data characteristic information, so that the difficulty of attacking an attacker through playing videos or synthetic images can be improved, the in-vivo detection safety is effectively improved, and the behavior that the attacker attacks through recording videos for multiple times is prevented.
The embodiment of the invention also provides a living body detection device based on eyeball tracking, and the principle of the living body detection device based on eyeball tracking is similar to that of the living body detection device based on eyeball tracking, and the details are not repeated here.
Fig. 3 is a schematic diagram of an eyeball tracking-based biopsy device in an embodiment of the invention, as shown in fig. 3, including:
the action display module 301 is configured to display a living body detection action and target object action prompt information, where the target object action prompt information is used to prompt a target object to adjust an eyeball direction and an eye sight when the target object acts;
a motion data capturing module 302 for capturing target object motion data, wherein the target object motion data is made by the target object based on the displayed living body detection motion and the target object motion prompt information;
a preliminary judgment module 303, configured to obtain eyeball data characteristic information of the target object when the target object is preliminarily determined to be a living body according to the target object motion data;
a living body determining module 304, configured to determine that the target object is a living body when a similarity between the eyeball data characteristic information and historical eyeball data characteristic information of the target object is greater than a preset value.
In an embodiment, the liveness detection action comprises one or any combination of shaking, blinking and nodding.
Fig. 4 is a schematic diagram of a preliminary determining module according to an embodiment of the present invention, in which the preliminary determining module includes:
a living body preliminary judgment module 401, configured to: when it is determined that the target object action in the target object action data is consistent with the displayed living body detection action and the eyeball position in the target object action data meets the preset position requirement, preliminarily determining that the target object is a living body;
a feature information extraction module 402 configured to: eyeball data characteristic information of the target object is obtained.
In one embodiment, the eyeball data feature information includes a feature value of a line of sight direction and an image.
In summary, in the apparatus provided in the embodiment of the present invention, the living body detection action and the target object action prompt information are displayed, where the target object action prompt information is used to prompt the target object to adjust the eyeball direction and the gaze when the target object performs an action; capturing target object motion data, the target object motion data being made by the target object based on the presented liveness detection motion and the target object motion prompt information; when the target object is preliminarily determined to be a living body according to the target object action data, eyeball data characteristic information of the target object is obtained; and when the similarity of the eyeball data characteristic information and the historical eyeball data characteristic information of the target object is greater than a preset value, determining that the target object is a living body. In the process, the target object is guided to complete the in-vivo detection according to the set data, and comparison is carried out based on the historical eyeball data characteristic information, so that the difficulty of attacking an attacker through playing videos or synthetic images can be improved, the in-vivo detection safety is effectively improved, and the behavior that the attacker attacks through recording videos for multiple times is prevented.
An embodiment of the present invention further provides a computer device, and fig. 5 is a schematic diagram of a computer device in an embodiment of the present invention, where the computer device is capable of implementing all steps in the living body detection method based on eye tracking in the foregoing embodiment, and the computer device specifically includes the following contents:
a processor (processor)501, a memory (memory)502, a communication Interface (Communications Interface)503, and a communication bus 504;
the processor 501, the memory 502 and the communication interface 503 complete mutual communication through the communication bus 504; the communication interface 503 is used for implementing information transmission between related devices such as server-side devices, detection devices, and user-side devices;
the processor 501 is used to call the computer program in the memory 502, and when the processor executes the computer program, the processor realizes all the steps in the eyeball tracking-based living body detection method in the above embodiment.
An embodiment of the present invention also provides a computer-readable storage medium capable of implementing all the steps in the eyeball tracking-based living body detection method in the above-described embodiment, wherein the computer-readable storage medium has stored thereon a computer program which, when executed by a processor, implements all the steps of the eyeball tracking-based living body detection method in the above-described embodiment.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims (10)

1. A living body detection method based on eyeball tracking is characterized by comprising the following steps:
displaying living body detection action and target object action prompt information, wherein the target object action prompt information is used for prompting the target object to adjust eyeball direction and eyesight when acting;
capturing target object motion data, the target object motion data being made by the target object based on the presented liveness detection motion and the target object motion prompt information;
when the target object is preliminarily determined to be a living body according to the target object action data, eyeball data characteristic information of the target object is obtained;
and when the similarity of the eyeball data characteristic information and the historical eyeball data characteristic information of the target object is greater than a preset value, determining that the target object is a living body.
2. The eye tracking-based biopsy method according to claim 1, wherein the biopsy action comprises one or any combination of shaking head, blinking and nodding head.
3. The eyeball tracking-based living body detection method according to claim 1, wherein the preliminary determination of the target object as a living body based on the target object motion data comprises:
and when the target object action in the target object action data is determined to be consistent with the displayed living body detection action and the eyeball position in the target object action data meets the preset position requirement, preliminarily determining the target object as the living body.
4. The eyeball-tracking-based living body detection method according to claim 1, wherein the eyeball data characteristic information includes a characteristic value of a sight line direction and an image.
5. An eyeball-tracking-based living body detection device, comprising:
the action display module is used for displaying the living body detection action and the action prompt information of the target object, and the action prompt information of the target object is used for prompting the target object to adjust the direction and the sight of eyeballs when the target object acts;
the motion data capturing module is used for capturing target object motion data, and the target object motion data is made by the target object based on the displayed living body detection motion and the target object motion prompt information;
the preliminary judgment module is used for obtaining eyeball data characteristic information of the target object when the target object is preliminarily determined to be a living body according to the target object action data;
and the living body determining module is used for determining the target object as a living body when the similarity of the eyeball data characteristic information and the historical eyeball data characteristic information of the target object is greater than a preset value.
6. The eye tracking-based liveness detection device according to claim 5, wherein the liveness detection action comprises one or any combination of shaking, blinking and nodding.
7. The eyeball tracking-based living body detection apparatus according to claim 5, wherein the preliminary judgment module comprises:
a living body preliminary judgment module for: when it is determined that the target object action in the target object action data is consistent with the displayed living body detection action and the eyeball position in the target object action data meets the preset position requirement, preliminarily determining that the target object is a living body;
a feature information extraction module to: eyeball data characteristic information of the target object is obtained.
8. The eyeball-tracking-based liveness detection apparatus according to claim 5, wherein the eyeball data characteristic information includes a characteristic value of the direction of sight and an image.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method of any of claims 1 to 4 when executing the computer program.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program for executing the method of any one of claims 1 to 4.
CN202110849341.6A 2021-07-27 2021-07-27 Eyeball tracking-based in vivo detection method and device Pending CN113486847A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110849341.6A CN113486847A (en) 2021-07-27 2021-07-27 Eyeball tracking-based in vivo detection method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110849341.6A CN113486847A (en) 2021-07-27 2021-07-27 Eyeball tracking-based in vivo detection method and device

Publications (1)

Publication Number Publication Date
CN113486847A true CN113486847A (en) 2021-10-08

Family

ID=77943931

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110849341.6A Pending CN113486847A (en) 2021-07-27 2021-07-27 Eyeball tracking-based in vivo detection method and device

Country Status (1)

Country Link
CN (1) CN113486847A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109544384A (en) * 2018-11-06 2019-03-29 平安科技(深圳)有限公司 Subsidy distribution method, device, terminal, storage medium based on bio-identification
CN111159678A (en) * 2019-12-26 2020-05-15 联想(北京)有限公司 Identity recognition method, device and storage medium
CN111160251A (en) * 2019-12-30 2020-05-15 支付宝实验室(新加坡)有限公司 Living body identification method and device
CN111353404A (en) * 2020-02-24 2020-06-30 支付宝实验室(新加坡)有限公司 Face recognition method, device and equipment
CN111781722A (en) * 2020-07-01 2020-10-16 业成科技(成都)有限公司 Eyeball tracking structure, electronic device and intelligent glasses
CN111881431A (en) * 2020-06-28 2020-11-03 百度在线网络技术(北京)有限公司 Man-machine verification method, device, equipment and storage medium
CN112528259A (en) * 2020-12-23 2021-03-19 平安普惠企业管理有限公司 Identity authentication method, identity authentication device, computer equipment and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109544384A (en) * 2018-11-06 2019-03-29 平安科技(深圳)有限公司 Subsidy distribution method, device, terminal, storage medium based on bio-identification
CN111159678A (en) * 2019-12-26 2020-05-15 联想(北京)有限公司 Identity recognition method, device and storage medium
CN111160251A (en) * 2019-12-30 2020-05-15 支付宝实验室(新加坡)有限公司 Living body identification method and device
CN111353404A (en) * 2020-02-24 2020-06-30 支付宝实验室(新加坡)有限公司 Face recognition method, device and equipment
CN111881431A (en) * 2020-06-28 2020-11-03 百度在线网络技术(北京)有限公司 Man-machine verification method, device, equipment and storage medium
CN111781722A (en) * 2020-07-01 2020-10-16 业成科技(成都)有限公司 Eyeball tracking structure, electronic device and intelligent glasses
CN112528259A (en) * 2020-12-23 2021-03-19 平安普惠企业管理有限公司 Identity authentication method, identity authentication device, computer equipment and storage medium

Similar Documents

Publication Publication Date Title
EP3362946B1 (en) Eye pose identification using eye features
US11132544B2 (en) Visual fatigue recognition method, visual fatigue recognition device, virtual reality apparatus and storage medium
EP3477436B1 (en) Method, storage medium and apparatus for eye tracking by removal of a reflection area
CN108734078B (en) Image processing method, image processing apparatus, electronic device, storage medium, and program
US10872244B2 (en) Road marking extraction from in-vehicle video
Emery et al. OpenNEEDS: A dataset of gaze, head, hand, and scene signals during exploration in open-ended VR environments
US11556784B2 (en) Multi-task fusion neural network architecture
CN113785263A (en) Virtual model for communication between an autonomous vehicle and an external observer
CN111160251B (en) Living body identification method and device
CN110770742A (en) Facial feature point-based shaking motion recognition system and method
CN117795550A (en) Image quality sensitive semantic segmentation for use in training image generation countermeasure networks
US11823353B2 (en) System and method for generating bokeh image for DSLR quality depth-of-field rendering and refinement and training method for the same
CN116433809A (en) Expression driving method and model training method
CN113486847A (en) Eyeball tracking-based in vivo detection method and device
CN116091292B (en) Data processing method and related device
US11989911B2 (en) Method and apparatus for tracking eye based on eye reconstruction
KR102662230B1 (en) Image processing method and apparatus
CN112733575B (en) Image processing method, device, electronic equipment and storage medium
CN110678904A (en) Beauty treatment method and device, unmanned aerial vehicle and handheld platform
CN110266937A (en) The control method of terminal device and camera
CN114613018B (en) Living body detection method, living body detection device, storage medium and electronic equipment
US20240070955A1 (en) Refinement of facial keypoint metadata generation for video conferencing or other applications
CN112950516B (en) Method and device for enhancing local contrast of image, storage medium and electronic equipment
CN117593679B (en) Fake video detection method, fake video detection device, electronic equipment and storage medium
CN113435378A (en) Living body detection method, device and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination