WO2021217764A1 - Procédé de détection du caractère vivant d'un visage humain basé sur l'imagerie de polarisation - Google Patents

Procédé de détection du caractère vivant d'un visage humain basé sur l'imagerie de polarisation Download PDF

Info

Publication number
WO2021217764A1
WO2021217764A1 PCT/CN2020/092040 CN2020092040W WO2021217764A1 WO 2021217764 A1 WO2021217764 A1 WO 2021217764A1 CN 2020092040 W CN2020092040 W CN 2020092040W WO 2021217764 A1 WO2021217764 A1 WO 2021217764A1
Authority
WO
WIPO (PCT)
Prior art keywords
polarization
face
target
images
detected
Prior art date
Application number
PCT/CN2020/092040
Other languages
English (en)
Chinese (zh)
Inventor
张堃博
孙哲南
田雨
王乐源
Original Assignee
天津中科智能识别产业技术研究院有限公司
中国科学院自动化研究所
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 天津中科智能识别产业技术研究院有限公司, 中国科学院自动化研究所 filed Critical 天津中科智能识别产业技术研究院有限公司
Publication of WO2021217764A1 publication Critical patent/WO2021217764A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/40—Spoof detection, e.g. liveness detection
    • G06V40/45—Detection of the body part being alive

Definitions

  • the present invention relates to the technical field of face recognition, in particular to a method for detecting a living body of a face based on polarization imaging.
  • Face recognition technology has been widely used due to its convenient, fast, non-contact and other characteristics.
  • facial information is becoming more and more accessible.
  • Some criminals use photos, videos or masks containing facial information to attack the face recognition authentication system to obtain the identity permissions of legitimate users, posing a threat to the protection of personal identity and privacy information, and even seriously affecting the security of citizens’ identity and property .
  • the first is based on the cooperation of the user.
  • the user performs actions such as blinking, turning the head, opening the mouth, and reading according to the instructions, and uses the algorithm to analyze the facial motion to make judgments. Whether it is a real face;
  • the second method uses infrared or multi-spectral imaging devices to analyze the difference in reflectance characteristics of real and fake faces to the spectrum to achieve live body detection.
  • live body detection methods that use texture information, depth information, and so on.
  • the purpose of the present invention is to address the technical shortcomings existing in the prior art and provide a method for live detection of human faces based on polarization imaging, which can realize real-time and accurate live detection of human faces and has extremely high environmental robustness. , Can effectively deal with various deceptive attacks.
  • a method for living body detection based on polarization imaging including the steps:
  • the polarization facial feature learning and classification network model based on the twin neural network structure is used to perform polarization analysis on the polarization image to identify the authenticity of the target to be detected.
  • a multi-angle polarization image acquisition device is used to acquire real-time polarization images of the target to be detected at different angles.
  • the multi-angle polarization image acquisition device includes one of a micro-polarizer array type polarization camera, a split focal plane type polarization camera, and a split path type polarization camera.
  • the multi-angle polarization image acquisition device integrates a polarization element containing four angles on the surface of the CMOS photosensitive element, which can achieve four polarization images of the same object with the same resolution but different polarization directions in one shot.
  • a polarization collecting device is used to obtain the polarization images of the target to be detected at four angles of 0°, 45°, 90°, and 135°.
  • the polarization analysis of the polarization image using the polarization facial feature learning and classification network model based on the twin neural network structure is to use a deep learning method to combine the polarization degree map of the real face and the polarization degree map of the deceptive attack They are labeled separately, sent to the convolutional neural network for learning, feature extraction of facial polarization visual information, and support vector machine SVM for classification and identification, finally realizing the distinction between true and false faces.
  • the present invention uses the physical property of polarization to classify true and false faces, which can effectively overcome the shortcomings of the existing methods and effectively resist the biological characteristics of the recognition system.
  • a variety of presentation attacks have good user experience and detection accuracy, and at the same time, it is more robust in a variety of environments.
  • the invention utilizes the physical association between the polarized optical information and the face material, and by analyzing the characteristic difference of the reflected light, effectively distinguishes the face skin and deceptive attacks.
  • the method does not require any cooperation from the user (blinking, turning head, opening mouth, etc.) , At the same time, it can automatically and deeply learn the texture information of real faces, effectively distinguish real faces and deceive fake faces.
  • the invention can detect a variety of face spoofing attacks including printing paper attacks, printing photo attacks, screen display attacks, rubber mask attacks, silicone mask attacks, etc., and can complete living body detection under multiple light source settings including visible light, near-infrared light, polarization Visible light and polarized near-infrared light can be used in indoor and outdoor scenes.
  • Fig. 1 is an implementation flow chart of a method for live detection of a face based on polarization imaging
  • Figure 2 is a schematic diagram of the flow of polarized face live detection
  • Figure 3 is a working principle diagram of the polarization collection device
  • Fig. 4 is a schematic diagram of collecting a four-direction polarization image of a human face by using a chip integrated with a four-direction polarization sensor;
  • Figure 5 is a polarized image of a human face in various situations.
  • the present invention uses polarized image information as input, and uses a trained and automated polarization facial feature knowledge learning and classification network model (face living detection algorithm model) based on the twin neural network structure to perform polarization analysis on the input polarized image to achieve The detection of the authenticity of the human face, so as to realize the detection of the living body.
  • face living detection algorithm model face living detection algorithm model
  • the method for detecting a living body of a human face based on polarization imaging of the present invention includes the following steps:
  • a multi-angle polarization image acquisition device can be used to collect real-time polarization images of the target to be detected at four different angles of 0 degrees, 45 degrees, 90 degrees, and 135 degrees. , And then through the analysis of these images to identify, as shown in Figure 3.
  • the polarization collection device is used to obtain the polarization images of the four angles of 0°, 45°, 90°, and 135° of the face to be detected
  • the four polarization images are recorded as I 0 , I 45 , I 90 , I 135 .
  • the Stokes vector to characterize the polarization:
  • the multi-angle polarization image acquisition device used may be a polarization image sensor.
  • the polarization image sensor as shown in FIG. 4, integrates a polarization element containing four directions and angles on the surface of a traditional CMOS photosensitive element, which can achieve four polarization images of the same object in one shot.
  • the camera can obtain four grayscale images with the same resolution (1224 x 1024 pixels) but with different polarization directions, as shown in Figure 4.
  • a SONY chip integrated polarization image sensor can be used with a resolution of 1224x1024 pixels, which can obtain four-angle target polarization images in real time and analyze four-angle grayscale images at the same time, with high integration and compact size.
  • the polarization image is not limited to the above-mentioned four angle polarization images of 0°, 45°, 90° and 135°. It can also be three outside, or five and other different numbers. indivual.
  • different light sources can be used to provide illumination according to the actual acquisition environment.
  • no light source can be used or a conventional white light source can be used to provide illumination.
  • a conventional white light source can be used to provide illumination.
  • near-infrared light sources can be used to provide illumination.
  • the existing devices that can achieve real-time multi-angle polarization image acquisition can be micro-polarizer array polarization cameras, split-focus plane polarization cameras, split-path polarization cameras, etc., all of which can be used in the present invention to perform polarization.
  • the real face and the fake face show the difference in intensity value and intensity distribution in the polarization diagram
  • the attack on photographic paper printing, ordinary white paper printing, and 3D By analyzing the polarization map of deceptive attacks such as masks and the polarization of real faces, accurate classification can be achieved.
  • the polarization map of the real face and the polarization map of the deceptive attack can be marked separately, sent to the convolutional neural network for learning, and SVM is used for classification and identification, and finally real and fake faces are realized.
  • the twin neural network structure is used for feature extraction of face polarization visual information
  • support vector machine SVM is used for feature classification to identify true and false faces.
  • the true and false face polarization maps can be analyzed in terms of mean, standard deviation, kurtosis, etc., so as to realize the classification of true and false faces.
  • the present invention uses polarized image information as input, learns the knowledge of face physical materials by using a deep neural network, establishes correlation with the essential characteristics of the physical materials of the target to be detected, and trains an automated face detection algorithm model.
  • the specific implementation steps are as follows:
  • Step S1 Set up four-angle polarization face image sensing equipment and light source device.
  • the polarization sensor adopts the chip integrated type, which can obtain the polarization images of four angles (0 degree, 45 degree, 90 degree and 135 degree) synchronously in real time. Corresponding gray image can be obtained;
  • Step S2 Collect a polarized face data set, which contains no less than 30 persons to be collected. Paper printing, photo printing, screen display, rubber mask, silicone mask and other attack methods, visible light, infrared light, polarization Visible light, polarized infrared light and other light source settings, indoor, outdoor, daytime, night and other scenes;
  • the database contains four types of attacks: photo printing attacks, paper printing attacks, screen display attacks, and mask attacks, as well as visible light, near-infrared light, polarized visible light, and polarized near-infrared light.
  • photo printing attacks paper printing attacks
  • screen display attacks and mask attacks
  • visible light near-infrared light
  • polarized visible light polarized near-infrared light.
  • Step S3 training a polarization facial feature learning and classification network model based on the twin neural network model
  • Step S4 test the polarization face feature learning and classification network model, and have the ability to correctly distinguish between true and false faces on known and unknown data;
  • Step S5 Apply the trained algorithm model to the display scene and deploy it to the chip-integrated polarization perception recognition system to realize the application of polarized face live detection, which can realize the face of multiple attacks, multiple scenarios, and multiple people. Real-time accurate Lupin live face recognition.
  • the training and testing of the present invention use relatively small data resources.
  • the polarization face image data set of 30 people only needs to be trained for 150 epochs.
  • the image is down-sampled to 224 ⁇ 224 pixels and sent to the network.
  • the detection of the present invention The model has the characteristics of generality under small data training conditions. Using the same polarization sensor, it can detect the authenticity of unknown face targets in a large number of unknown scenes, and achieve 100% detection accuracy.
  • the present invention can finally realize real-time multi-person live detection above 15fps, and the detection distance can reach 5 meters. It can resist paper printing, photo printing, screen display attacks, rubber masks, silicone masks and other types of presentation attacks. It can be used in daytime and also Indoor and outdoor scenes at night, with strong versatility and scalability.
  • the invention utilizes the physical property of the target's polarization characteristic to perform living body detection, has extremely high robustness to the environment, and can be effectively applied to various complex scenes, such as indoor, outdoor, daytime, night and other scenes. Since it is difficult for the forged human face to be completely consistent with the real human face in terms of material, texture, roughness, etc., regardless of the technical means used, the present invention can effectively detect a variety of known and unknown deceptive attacks. Including paper and photo printing attacks, screen display attacks, silicone face-like attacks and other attacks.
  • the present invention can realize the task of face detection in daytime and night indoor and outdoor scenes for various attack types such as paper printing, photo printing, screen display, silicone mask, rubber mask, etc.
  • the present invention adopts a non-contact real-time detection method, does not require active cooperation of the user, and can realize accurate detection even in the state of non-cooperation of the user, and the user experience is better.
  • the present invention is different from the existing pure deep learning methods, does not need to rely on a large number of data sets, and can obtain high-accuracy detection results with small samples, which has higher recognition accuracy than traditional methods. There is no need to manually design and change the recognition algorithm for multiple attack types.
  • the hardware system of the present invention has simple structure, small size, light weight, and high integration, is easy to install, and can be applied to a variety of detection environments.
  • the living body detection method of the present invention has the characteristics of high accuracy, strong robustness and wide versatility, and can be quickly deployed and applied under various lighting conditions after a small amount of data training.
  • the invention can replace the existing traditional biometric anti-spoofing technology in a variety of applications with high requirements for identity authentication, such as transportation, financial services, customs clearance certification, insurance issuance, election examination, public security, etc., thereby realizing automatic and efficient , Accurate and intelligent face detection in vivo, which improves the safety protection of the biometric system.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Collating Specific Patterns (AREA)

Abstract

Procédé de détection de caractère vivant d'un visage humain basé sur l'imagerie de polarisation comprenant les étapes consistant à : collecter, à une pluralité d'angles en temps réel, des images de polarisation d'une cible à détecter; et effectuer une analyse de polarisation sur les images de polarisation en utilisant un modèle de réseau de classification et d'apprentissage de caractéristique de visage humain de polarisation basé sur une structure de réseau neuronal siamois, de manière à reconnaître si la cible à détecter est réelle ou fausse. Le procédé utilise un moyen de détection en temps réel sans contact, ne nécessite pas de coopération active d'un utilisateur et peut mettre en œuvre une détection précise même dans un état de non-coopération de l'utilisateur, ce qui permet d'obtenir une bonne expérience utilisateur.
PCT/CN2020/092040 2020-04-27 2020-05-25 Procédé de détection du caractère vivant d'un visage humain basé sur l'imagerie de polarisation WO2021217764A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010342742.8A CN111539348A (zh) 2020-04-27 2020-04-27 一种基于偏振成像的人脸活体检测方法
CN202010342742.8 2020-04-27

Publications (1)

Publication Number Publication Date
WO2021217764A1 true WO2021217764A1 (fr) 2021-11-04

Family

ID=71978819

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/092040 WO2021217764A1 (fr) 2020-04-27 2020-05-25 Procédé de détection du caractère vivant d'un visage humain basé sur l'imagerie de polarisation

Country Status (2)

Country Link
CN (1) CN111539348A (fr)
WO (1) WO2021217764A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114842034A (zh) * 2022-04-19 2022-08-02 山东省人工智能研究院 一种基于放大模糊操作痕迹的图片真假检测方法

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112232152B (zh) * 2020-09-30 2021-12-03 墨奇科技（北京）有限公司 非接触式指纹识别方法、装置、终端和存储介质
CN113570598B (zh) * 2021-09-22 2021-12-10 海门市恒昌织带有限公司 基于人工智能的纺织毛刷辊磨损分析及寿命预测方法
CN115909457A (zh) * 2022-11-23 2023-04-04 大连工业大学 一种基于偏振成像ai识别口罩佩戴检测方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9830506B2 (en) * 2015-11-09 2017-11-28 The United States Of America As Represented By The Secretary Of The Army Method of apparatus for cross-modal face matching using polarimetric image data
CN110222647A (zh) * 2019-06-10 2019-09-10 大连民族大学 一种基于卷积神经网络的人脸活体检测方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104809441B (zh) * 2015-04-29 2018-02-16 北京旷视科技有限公司 活体验证方法及装置
US10853624B2 (en) * 2017-10-17 2020-12-01 Sony Corporation Apparatus and method
CN108038480A (zh) * 2018-02-09 2018-05-15 宁波静芯号网络科技有限公司 一种基于脸部静脉防伪的人脸识别系统装置
CN109886166A (zh) * 2019-01-31 2019-06-14 杭州创匠信息科技有限公司 基于偏振特性的防伪方法和装置
CN110244309A (zh) * 2019-06-21 2019-09-17 浙江舜宇光学有限公司 深度的检测系统和方法

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9830506B2 (en) * 2015-11-09 2017-11-28 The United States Of America As Represented By The Secretary Of The Army Method of apparatus for cross-modal face matching using polarimetric image data
CN110222647A (zh) * 2019-06-10 2019-09-10 大连民族大学 一种基于卷积神经网络的人脸活体检测方法

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
SUN PENGCHENG, ZENG DAN, LI XIAOYAN, YANG LIN, LI LIYUAN, CHEN ZHOUXIA, CHEN FANSHENG: "A 3D Mask Presentation Attack Detection Method Based on Polarization Medium Wave Infrared Imaging", SYMMETRY, vol. 12, no. 3, 3 March 2020 (2020-03-03), pages 3 - 8, XP055866938 *
YANG JIANWEI, LEI ZHEN, LI STAN Z: "Learn Convolutional Neural Network for Face Anti-Spoofing", ARXIV:1408.5601V2[CS.CV, 26 August 2014 (2014-08-26), pages 4 - 5, XP055429154 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114842034A (zh) * 2022-04-19 2022-08-02 山东省人工智能研究院 一种基于放大模糊操作痕迹的图片真假检测方法
CN114842034B (zh) * 2022-04-19 2022-12-02 山东省人工智能研究院 一种基于放大模糊操作痕迹的图片真假检测方法

Also Published As

Publication number Publication date
CN111539348A (zh) 2020-08-14

Similar Documents

Publication Publication Date Title
WO2021217764A1 (fr) Procédé de détection du caractère vivant d'un visage humain basé sur l'imagerie de polarisation
CN106446873B (zh) 人脸检测方法及装置
CN104091176B (zh) 人像比对在视频中的应用技术
CN109101871A (zh) 一种基于深度和近红外信息的活体检测装置、检测方法及其应用
Yi et al. EagleEye: Wearable camera-based person identification in crowded urban spaces
Raghavendra et al. Exploring the usefulness of light field cameras for biometrics: An empirical study on face and iris recognition
US7065232B2 (en) Three-dimensional ear biometrics system and method
WO2019134536A1 (fr) Détection de corps vivant de visage humain basée sur un modèle de réseau neuronal
WO2019137178A1 (fr) Détection de vivacité de visage
Johnson et al. Quality in face and iris research ensemble (Q-FIRE)
CN1627317A (zh) 利用主动光源获取人脸图像的方法
CN102609724B (zh) 一种基于双摄像头的周围环境信息提示方法
CN108446690B (zh) 一种基于多视角动态特征的人脸活体检测方法
Parveen et al. Face anti-spoofing methods
CN108090428A (zh) 一种人脸识别方法及其系统
CN109492534A (zh) 一种基于Faster RCNN的跨场景多姿态的行人检测方法
CN109255319A (zh) 针对静态照片的人脸识别支付信息防伪方法
CN112396011A (zh) 一种基于视频图像心率检测及活体检测的人脸识别系统
Tian et al. Face anti-spoofing by learning polarization cues in a real-world scenario
Peng et al. Presentation attack detection based on two-stream vision transformers with self-attention fusion
Jingade et al. DOG-ADTCP: A new feature descriptor for protection of face identification system
Sudhakar et al. Facial identification of twins based on fusion score method
Abaza et al. Human ear detection in the thermal infrared spectrum
Reddy et al. Tracking people in real time video footage using facial recognition
Nene et al. Facial Recognition System Using LBPH Algorithm and Raspberry Pi

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20933144

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20933144

Country of ref document: EP

Kind code of ref document: A1