CN108629260A - Live body verification method and device and storage medium - Google Patents

Live body verification method and device and storage medium Download PDF

Info

Publication number
CN108629260A
CN108629260A CN201710218512.9A CN201710218512A CN108629260A CN 108629260 A CN108629260 A CN 108629260A CN 201710218512 A CN201710218512 A CN 201710218512A CN 108629260 A CN108629260 A CN 108629260A
Authority
CN
China
Prior art keywords
verified
live body
illumination
light
human face
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710218512.9A
Other languages
Chinese (zh)
Other versions
CN108629260B (en
Inventor
范浩强
陈可卿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Megvii Technology Co Ltd
Beijing Maigewei Technology Co Ltd
Original Assignee
Beijing Megvii Technology Co Ltd
Beijing Maigewei Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Megvii Technology Co Ltd, Beijing Maigewei Technology Co Ltd filed Critical Beijing Megvii Technology Co Ltd
Publication of CN108629260A publication Critical patent/CN108629260A/en
Application granted granted Critical
Publication of CN108629260B publication Critical patent/CN108629260B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/14Image acquisition
    • G06V30/148Segmentation of character regions
    • G06V30/153Segmentation of character regions using recognition of characters or words
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/40Spoof detection, e.g. liveness detection
    • G06V40/45Detection of the body part being alive
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/08Network architectures or network communication protocols for network security for authentication of entities
    • H04L63/0861Network architectures or network communication protocols for network security for authentication of entities using biometrical features, e.g. fingerprint, retina-scan

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Biomedical Technology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Computer Security & Cryptography (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Collating Specific Patterns (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Image Processing (AREA)

Abstract

The embodiment provides a kind of live body verification methods and device and a kind of storage medium.Live body verification method includes:Step S110:Obtain the one or more light images acquired for the object to be verified under the irradiation of detection light;Step S120:Determine whether object to be verified belongs to live body based on the reflective character that object to be verified is showed in one or more light images, to obtain illumination live body verification result;And step S130:At least determine whether object to be verified is verified by live body based on illumination live body verification result.The above method, device and storage medium can effectively improve the safety of live body verification.

Description

Live body verification method and device and storage medium
Technical field
The present invention relates to field of face identification, relate more specifically to a kind of live body verification method and device and storage medium.
Background technology
The authentication system for being currently based on face has been used widely.With the authentication system based on face Popularization, the method for having derived some malicious attack face authentications.
In the authentication system based on face of most original, based on the human face photo of current shooting with it is pre-stored Comparison between human face photo, to carry out authentication.However, this based on face when will be placed in by the photo of counterfeiter When before the camera in the authentication system that photo compares, this authentication system compared based on human face photo may lead to Cross subscriber authentication.In other words, malicious user can use the photo by counterfeiter to carry out malicious attack (that is, photo is attacked Hit), this authentication system compared based on human face photo cannot resist photo attack.
Invention content
The present invention is proposed in view of the above problem.The present invention provides a kind of live body verification method and device and storages Medium.
According to an aspect of the present invention, a kind of live body verification method is provided.This method includes:Step S110:Acquisition is directed to One or more light images that object to be verified under the irradiation of detection light is acquired;Step S120:Based on to be verified right As the reflective character showed in one or more light images determines whether object to be verified belongs to live body, to obtain light According to live body verification result;And step S130:At least determine whether object to be verified passes through work based on illumination live body verification result Experience card.
Illustratively, during irradiating object to be verified, the pattern of detection light at least changes once.
Illustratively, during irradiating object to be verified, between the pattern of detection light is at the time of each two is continuous It changes.
Illustratively, during irradiating object to be verified, the pattern of detection light changes or presets at random Alright.
Illustratively, method further includes:Step S140:Output action instructs, wherein action command is used to indicate to be verified Object executes corresponding action;Step S150:Obtain the multiple motion images acquired for object to be verified;Step S160: The action performed by object to be verified is detected based on multiple motion images;And step S170:According to motion detection result and move Make instruction and determine whether object to be verified belongs to live body, to obtain action live body verification result;Step S130 includes:Based on illumination Live body verification result and action live body verification result determine whether object to be verified is verified by live body.
Illustratively, step S170 includes:If more based on being acquired in the period no more than the first preset time A motion images detect the action kept strokes indicated by executed by object to be verified and action command, it is determined that wait for Identifying object belongs to live body, if be not detected by be verified based on the multiple motion images acquired in the first preset time The action kept strokes indicated by object executes and action command, it is determined that object to be verified is not belonging to live body.
Illustratively, method further includes:It is counted once, to obtain during executing step S140 to step S170 every time Verification number must be acted;After step S170, method further includes:If action live body verification result indicates object to be verified not Belong to live body, then export the first error message, and judge whether action verification number reaches the first frequency threshold value, if action is tested Card number reaches the first frequency threshold value, then goes to step S130, if action verification number is not up to the first frequency threshold value, returns Return the step S140 or return to step S110 in the case where step S110 is executed before step S140, wherein the first mistake Information is used to prompt the live body authentication failed for object to be verified.
Illustratively, before step S110, method further includes:Step S108:Judge the Image Acquisition of object to be verified Whether condition meets preset requirement, if Image Acquisition condition meets preset requirement, goes to step S110, wherein image is adopted Collection condition include object to be verified the location of in the image acquisition region of image collecting device and/or object to be verified with The relative angle of image collecting device.
Illustratively, before step S108 or with step S108 simultaneously, method further includes:Step S106:Output the One prompt message, wherein the first prompt message is for prompting object to be verified by face's face image collecting device and close to figure As harvester.
Illustratively, step S106 includes:By one or more defeated in speech form, image format and written form Go out the first prompt message.
Illustratively, step S108 includes:Obtain the realtime graphic for object to be verified acquisition;Output is used for school in real time The predeterminable area of quasi- Image Acquisition condition and the human face region in realtime graphic are for showing;And according in realtime graphic The human face region detected judges whether Image Acquisition condition meets preset requirement, if human face region is located in predeterminable area simultaneously And human face region proportion in realtime graphic is more than the first preset ratio, it is determined that Image Acquisition condition meets default want It asks, if human face region is not in predeterminable area or human face region proportion in realtime graphic is pre- no more than first If ratio, it is determined that Image Acquisition condition is unsatisfactory for preset requirement.
Illustratively, method further includes:If human face region proportion in realtime graphic ratio default no more than first Example, then output first acquires prompt message in real time, to prompt object to be verified and image collecting device close.
Illustratively, step S108 includes:Obtain the realtime graphic for object to be verified acquisition;Output is used for school in real time The predeterminable area of quasi- Image Acquisition condition and the human face region in realtime graphic are for showing;And sentence according in human face region Whether disconnected Image Acquisition condition meets preset requirement, if human face region is located in predeterminable area and human face region is in preset areas Proportion is more than the second preset ratio in domain, it is determined that Image Acquisition condition meets preset requirement, if human face region does not have In predeterminable area or human face region proportion in predeterminable area is not more than the second preset ratio, it is determined that image is adopted Collection condition is unsatisfactory for preset requirement.
Illustratively, defeated in real time if human face region proportion in predeterminable area is not more than the second preset ratio Go out the second acquisition prompt message, to prompt object to be verified and image collecting device close.
Illustratively, method further includes:Relative position relation between real-time judge human face region and predeterminable area;And Third is exported in real time based on the relative position relation between human face region and predeterminable area and acquires prompt message, is changed with prompt and is waited for Relative position relation between identifying object and image collecting device is so that human face region is close with predeterminable area.
Illustratively, step S108 includes:Obtain the posture information of image collecting device;And judged according to posture information Whether image collecting device is in vertical placement status, if it is, determining that Image Acquisition condition meets preset requirement, otherwise really Determine Image Acquisition condition and is unsatisfactory for preset requirement.
Illustratively, method further includes:It is counted once, to obtain during executing step S110 to step S120 every time It obtains illumination and verifies number;After step S120, method further includes:If illumination live body verification result indicates object to be verified not Belong to live body, then export the second error message, and judge whether illumination verification number reaches the second frequency threshold value, if illumination is tested Card number reaches the second frequency threshold value, then goes to step S130, if illumination verification number is not up to the second frequency threshold value, returns Return step S108 or return to step S110, wherein the second error message is used to prompt the live body verification for object to be verified to lose It loses.
Illustratively, before step S110 or during executing step S110 and step S120, live body authentication Method further includes:Export the second prompt message, wherein the second prompt message is for prompting object to be verified in the second preset time It remains stationary as.
Illustratively, the second prompt message is count down information corresponding with the second preset time.
Illustratively, detection light is obtained by dynamically changing color and/or the position of the light emitted to object to be verified.
Illustratively, detection light is obtained in the following manner by display screen emissions, detection light:Screen is shown by change The content of upper display carrys out the pattern that dynamic changes the light of display screen emissions, to emit detection light to object to be verified.
According to a further aspect of the invention, a kind of live body verification device is provided, including:Light image acquisition module, is used for Obtain the one or more light images acquired for the object to be verified under the irradiation of detection light;Illumination live body verifies mould Block, the reflective character for being showed in one or more light images based on object to be verified determine that object to be verified is It is no to belong to live body, to obtain illumination live body verification result;And live body is verified determining module, lives for being at least based on illumination Body verification result determines whether object to be verified is verified by live body.
Illustratively, during irradiating object to be verified, the pattern of detection light at least changes once.
Illustratively, during irradiating object to be verified, between the pattern of detection light is at the time of each two is continuous It changes.
Illustratively, during irradiating object to be verified, the pattern of detection light changes or presets at random Alright.
Illustratively, live body verification device further includes:Command output module is instructed for output action, wherein action refers to Order is used to indicate object to be verified and executes corresponding action;Motion images acquisition module is directed to object institute to be verified for obtaining Multiple motion images of acquisition;Motion detection module, it is dynamic performed by object to be verified for being detected based on multiple motion images Make;And action live body authentication module, for determining whether object to be verified belongs to according to motion detection result and action command Live body, to obtain action live body verification result;Live body is verified determining module:By determination sub-module, for being based on Illumination live body verification result and action live body verification result determine whether object to be verified is verified by live body.
Illustratively, action live body authentication module includes:Live body determination sub-module, if for based on no more than first The multiple motion images acquired in the period of preset time detect indicated by executed by object to be verified and action command The action kept strokes, it is determined that object to be verified belongs to live body, if more based on what is acquired in the first preset time The action kept strokes indicated by executed by object to be verified and action command is not detected in a motion images, it is determined that Object to be verified is not belonging to live body.
Illustratively, live body verification device further includes:First counting module, for each run command output module extremely It is counted during run action live body authentication module once, verification number is acted with acquisition;Live body verifies device:The One authentication error execution module exports the if indicating that object to be verified is not belonging to live body for action live body verification result One error message, and judge whether action verification number reaches the first frequency threshold value, if action verification number reaches for the first time Number threshold value, then start live body and be verified determining module, if action verification number is not up to the first frequency threshold value, opens again Dynamic command output module restarts light in the case where light image acquisition module is run before command output module According to image collection module, wherein the first error message is used to prompt the live body authentication failed for object to be verified.
Illustratively, live body verification device further includes:Condition judgment module, the Image Acquisition for judging object to be verified Whether condition meets preset requirement, if Image Acquisition condition meets preset requirement, starts light image acquisition module, In, Image Acquisition condition includes object to be verified the location of in the image acquisition region of image collecting device and/or waits for The relative angle of identifying object and image collecting device.
Illustratively, live body verification device further includes:First prompt message output module, for sentencing in condition judgment module Judge object to be verified before whether the Image Acquisition condition of disconnected object to be verified meets preset requirement or with condition judgment module Image Acquisition condition whether meet preset requirement simultaneously, export the first prompt message, wherein the first prompt message is for carrying Show object to be verified by face's face image collecting device and close to image collecting device.
Illustratively, the first prompt message output module includes:First prompt message output sub-module, for passing through voice The first prompt message of one or more outputs in form, image format and written form.
Illustratively, condition judgment module includes:First realtime graphic acquisition submodule, for obtaining for be verified right As the realtime graphic of acquisition;First real-time output sub-module, for exporting the preset areas for calibrating Image Acquisition condition in real time Human face region in domain and realtime graphic is for showing;And first judging submodule, for being examined according in realtime graphic The human face region measured judges whether Image Acquisition condition meets preset requirement, if human face region be located in predeterminable area and Human face region proportion in realtime graphic is more than the first preset ratio, it is determined that and Image Acquisition condition meets preset requirement, If human face region is not in predeterminable area or human face region proportion in realtime graphic is default no more than first Ratio, it is determined that Image Acquisition condition is unsatisfactory for preset requirement.
Illustratively, live body verification device further includes:First acquisition prompt output module, if for human face region in reality When image in proportion be not more than the first preset ratio, then in real time output first acquisition prompt message, it is to be verified right to prompt As close with image collecting device.
Illustratively, condition judgment module includes:Second realtime graphic acquisition submodule, for obtaining for be verified right As the realtime graphic of acquisition;Second real-time output sub-module, for exporting the preset areas for calibrating Image Acquisition condition in real time Human face region in domain and realtime graphic is for showing;And second judgment submodule, for judging according in human face region Whether Image Acquisition condition meets preset requirement, if human face region is located in predeterminable area and human face region is in predeterminable area Middle proportion is more than the second preset ratio, it is determined that Image Acquisition condition meets preset requirement, if human face region does not have position In in predeterminable area or human face region in predeterminable area proportion be not more than the second preset ratio, it is determined that Image Acquisition Condition is unsatisfactory for preset requirement.
Illustratively, live body verification device further includes:Second acquisition prompt output module, if for human face region pre- If proportion is not more than the second preset ratio in region, then the second acquisition of output in real time prompt message, to be verified right to prompt As close with image collecting device.
Illustratively, live body verification device further includes:Real-time judge module is used for real-time judge human face region and preset areas Relative position relation between domain;And third acquisition prompt output module, for based between human face region and predeterminable area Relative position relation export third acquisition prompt message in real time, changed between object to be verified and image collecting device with prompt Relative position relation so that human face region is close with predeterminable area.
Illustratively, condition judgment module includes:Posture information acquisition module, the posture for obtaining image collecting device Information;And third judging submodule, for judging whether image collecting device is in vertical placement status according to posture information, If it is, determining that Image Acquisition condition meets preset requirement, otherwise determine that Image Acquisition condition is unsatisfactory for preset requirement.
Illustratively, live body verification device further includes:Second counting module, for obtaining mould in each run light image It is counted during block to operation illumination live body authentication module once, number is verified to obtain illumination;Live body verification device also wraps It includes:Second authentication error execution module, it is defeated if indicating that object to be verified is not belonging to live body for illumination live body verification result Go out the second error message, and judge whether illumination verification number reaches the second frequency threshold value, if illumination verification number reaches the Two frequency threshold values then start live body and are verified determining module, if illumination verification number is not up to the second frequency threshold value, weigh New entry condition judgment module or restarting light image acquisition module, wherein the second error message is waited for for prompting to be directed to The live body authentication failed of identifying object.
Illustratively, live body verification device further includes:Second prompt message output module, for obtaining mould in light image Before one or more light images that block acquisition is acquired for the object to be verified under the irradiation of detection light or in illumination Image collection module obtain the one or more light images acquired for object to be verified under the irradiation of detection light and Illumination live body authentication module is waited for based on the reflective character determination that object to be verified is showed in one or more light images During whether identifying object belongs to live body, the second prompt message is exported, wherein the second prompt message is to be verified for prompting Object remains stationary as in the second preset time.
Illustratively, the second prompt message is count down information corresponding with the second preset time.
Illustratively, detection light is obtained by dynamically changing color and/or the position of the light emitted to object to be verified.
Illustratively, detection light is obtained in the following manner by display screen emissions, detection light:Screen is shown by change The content of upper display carrys out the pattern that dynamic changes the light of display screen emissions, to emit detection light to object to be verified.
According to a further aspect of the invention, a kind of live body verification device, including processor and memory are provided, wherein deposit Computer program instructions are stored in reservoir, for executing following steps when computer program instructions are run by processor:Step S110:Obtain the one or more light images acquired for the object to be verified under the irradiation of detection light;Step S120: Determine whether object to be verified belongs to based on the reflective character that object to be verified is showed in one or more light images Live body, to obtain illumination live body verification result;And step S130:It is to be verified right at least to be determined based on illumination live body verification result As if it no is verified by live body.
Illustratively, during irradiating object to be verified, the pattern of detection light at least changes once.
Illustratively, during irradiating object to be verified, between the pattern of detection light is at the time of each two is continuous It changes.
Illustratively, during irradiating object to be verified, the pattern of detection light changes or presets at random Alright.
Illustratively, it is additionally operable to execute following steps when computer program instructions are run by processor:Step S140:Output Action command, wherein action command is used to indicate object to be verified and executes corresponding action;Step S150:It obtains for be tested Multiple motion images that card object is acquired;Step S160:It is detected based on multiple motion images dynamic performed by object to be verified Make;And step S170:Determine whether object to be verified belongs to live body according to motion detection result and action command, to be moved Make live body verification result;The step S130 of used execution when computer program instructions are run by processor includes:Based on illumination Live body verification result and action live body verification result determine whether object to be verified is verified by live body.
Illustratively, the step S170 of used execution when computer program instructions are run by processor includes:If base In the multiple motion images acquired in the period no more than the first preset time detect it is being executed by object to be verified, with The action kept strokes indicated by action command, it is determined that object to be verified belongs to live body, if based on when first is default In multiple motion images for being acquired be not detected it is being executed by object to be verified, with keeping strokes indicated by action command Action, it is determined that object to be verified is not belonging to live body.
Illustratively, it is additionally operable to execute following steps when computer program instructions are run by processor:Executing step every time It is counted during rapid S140 to step S170 once, verification number is acted with acquisition;In computer program instructions by processor After the step S170 of used execution when operation, it is additionally operable to execute following step when computer program instructions are run by processor Suddenly:If action live body verification result indicates that object to be verified is not belonging to live body, the first error message is exported, and judge to act Whether verification number reaches the first frequency threshold value, if action verification number reaches the first frequency threshold value, goes to step S130, If action verification number is not up to the first frequency threshold value, return to step S140 or in step S110 before step S140 Return to step S110 in the case of execution, wherein the first error message is used to prompt the live body verification for object to be verified to lose It loses.
Illustratively, it when computer program instructions are run by processor before the step S110 of used execution, calculates Machine program instruction is additionally operable to execute following steps when being run by processor:Step S108:Judge the Image Acquisition of object to be verified Whether condition meets preset requirement, if Image Acquisition condition meets preset requirement, goes to step S110, wherein image is adopted Collection condition include object to be verified the location of in the image acquisition region of image collecting device and/or object to be verified with The relative angle of image collecting device.
Illustratively, when computer program instructions are run by processor before the step S108 of used execution or with meter The step S108 of calculation machine program instruction used execution when being run by processor simultaneously, by processor transported by computer program instructions It is additionally operable to execute following steps when row:Step S106:Export the first prompt message, wherein the first prompt message is waited for for prompting Identifying object is by face's face image collecting device and close to image collecting device.
Illustratively, the step S106 of used execution when computer program instructions are run by processor includes:Pass through language The first prompt message of one or more outputs in sound form, image format and written form.
Illustratively, the step S108 of used execution when computer program instructions are run by processor includes:Obtain needle Treat the realtime graphic of identifying object acquisition;Predeterminable area and realtime graphic of the output for calibrating Image Acquisition condition in real time In human face region for showing;And whether Image Acquisition condition is judged according to the human face region detected in realtime graphic Meet preset requirement, if human face region is located in predeterminable area and human face region proportion in realtime graphic is more than the One preset ratio, it is determined that Image Acquisition condition meets preset requirement, if human face region be not in predeterminable area or Human face region proportion in realtime graphic is not more than the first preset ratio, it is determined that Image Acquisition condition is unsatisfactory for default want It asks.
Illustratively, it is additionally operable to execute when computer program instructions are run by processor:If human face region is schemed in real time As in proportion be not more than the first preset ratio, then in real time output first acquisition prompt message, with prompt object to be verified with Image collecting device is close.
Illustratively, the step S108 of used execution when computer program instructions are run by processor includes:Obtain needle Treat the realtime graphic of identifying object acquisition;Predeterminable area and realtime graphic of the output for calibrating Image Acquisition condition in real time In human face region for showing;And judge whether Image Acquisition condition meets preset requirement according in human face region, if Human face region is located in predeterminable area and human face region proportion in predeterminable area is more than the second preset ratio, it is determined that Image Acquisition condition meets preset requirement, if human face region is not in predeterminable area or human face region is in predeterminable area Middle proportion is not more than the second preset ratio, it is determined that Image Acquisition condition is unsatisfactory for preset requirement.
Illustratively, it is additionally operable to execute when computer program instructions are run by processor:If human face region is in preset areas In domain proportion be not more than the second preset ratio, then in real time output second acquisition prompt message, with prompt object to be verified with Image collecting device is close.
Illustratively, it is additionally operable to execute when computer program instructions are run by processor:Real-time judge human face region with it is pre- If the relative position relation between region;And it is exported in real time based on the relative position relation between human face region and predeterminable area Third acquires prompt message, changes the relative position relation between object and image collecting device to be verified so that people with prompt Face region and predeterminable area are close.
Illustratively, the step S108 of used execution when computer program instructions are run by processor includes:Obtain figure As the posture information of harvester;And judge whether image collecting device is in vertical placement status according to posture information, such as Fruit is, it is determined that Image Acquisition condition meets preset requirement, otherwise determines that Image Acquisition condition is unsatisfactory for preset requirement.
Illustratively, it is additionally operable to execute following steps when computer program instructions are run by processor:Executing step every time It is counted during rapid S110 to step S120 once, number is verified to obtain illumination;In computer program instructions by processor After the step S120 of used execution when operation, it is additionally operable to execute following step when computer program instructions are run by processor Suddenly:If illumination live body verification result indicates that object to be verified is not belonging to live body, the second error message is exported, and judge illumination Whether verification number reaches the second frequency threshold value, if illumination verification number reaches the second frequency threshold value, goes to step S130, If illumination verification number is not up to the second frequency threshold value, return to step S108 or return to step S110, wherein the second mistake Information is used to prompt the live body authentication failed for object to be verified.
Illustratively, it before the step S110 of used execution or is being counted when computer program instructions are run by processor When being run by processor during the step S110 and step S120 of used execution, computer program refers to calculation machine program instruction Order is additionally operable to execute following steps when being run by processor:Export the second prompt message, wherein the second prompt message is for prompting Object to be verified remains stationary as in the second preset time.
Illustratively, the second prompt message is count down information corresponding with the second preset time.
Illustratively, detection light is obtained by dynamically changing color and/or the position of the light emitted to object to be verified.
Illustratively, detection light is obtained in the following manner by display screen emissions, detection light:Screen is shown by change The content of upper display carrys out the pattern that dynamic changes the light of display screen emissions, to emit detection light to object to be verified.
According to a further aspect of the invention, a kind of storage medium is provided, stores program instruction, program on a storage medium Instruction is used to execute following steps at runtime:Step S110:It obtains for the object institute to be verified under the irradiation of detection light One or more light images of acquisition;Step S120:It is showed in one or more light images based on object to be verified Reflective character determine whether object to be verified belongs to live body, to obtain illumination live body verification result;And step S130:Extremely Determine whether object to be verified is verified by live body based on illumination live body verification result less.
Illustratively, during irradiating object to be verified, the pattern of detection light at least changes once.
Illustratively, during irradiating object to be verified, between the pattern of detection light is at the time of each two is continuous It changes.
Illustratively, during irradiating object to be verified, the pattern of detection light changes or presets at random Alright.
Illustratively, program instruction is additionally operable to execute following steps at runtime:Step S140:Output action instructs, In, action command is used to indicate object to be verified and executes corresponding action;Step S150:Acquisition is acquired for object to be verified Multiple motion images;Step S160:The action performed by object to be verified is detected based on multiple motion images;And step S170:Determine whether object to be verified belongs to live body according to motion detection result and action command, to obtain action live experience card As a result;The used step S130 executed includes program instruction at runtime:Based on illumination live body verification result and action live body Verification result determines whether object to be verified is verified by live body.
Illustratively, the used step S170 executed includes program instruction at runtime:If based on no more than the The multiple motion images acquired in the period of one preset time detect being executed by object to be verified, signified with action command The action kept strokes shown, it is determined that object to be verified belongs to live body, if based on being acquired in the first preset time The action kept strokes indicated by executed by object to be verified and action command is not detected in multiple motion images, then really Fixed object to be verified is not belonging to live body.
Illustratively, program instruction is additionally operable to execute following steps at runtime:Step S140 is being executed every time to step It is counted during S170 once, verification number is acted with acquisition;In program instruction used the step of executing at runtime After S170, program instruction is additionally operable to execute following steps at runtime:If action live body verification result indicates to be verified right As being not belonging to live body, then the first error message is exported, and judge whether action verification number reaches the first frequency threshold value, if dynamic Make verification number and reach the first frequency threshold value, then goes to step S130, if action verification number is not up to the first frequency threshold value, The then return to step S140 or return to step S110 in the case where step S110 is executed before step S140, wherein first Error message is used to prompt the live body authentication failed for object to be verified.
Illustratively, before program instruction is used for the step S110 of execution at runtime, program instruction is gone back at runtime For executing following steps:Step S108:Judge whether the Image Acquisition condition of object to be verified meets preset requirement, if figure As acquisition condition meets preset requirement, then step S110 is gone to, wherein Image Acquisition condition includes that object to be verified is adopted in image The relative angle of location and/or object to be verified and image collecting device in the image acquisition region of acquisition means.
Illustratively, it is being run before the program instruction at runtime used step S108 executed or with program instruction When used execution step S108 simultaneously, program instruction is additionally operable to execute following steps at runtime:Step S106:Output First prompt message, wherein the first prompt message is for prompting object to be verified by face's face image collecting device and close Image collecting device.
Illustratively, the used step S106 executed includes program instruction at runtime:Pass through speech form, image shape The first prompt message of one or more outputs in formula and written form.
Illustratively, the used step S108 executed includes program instruction at runtime:It obtains and is directed to object to be verified The realtime graphic of acquisition;Human face region in predeterminable area and realtime graphic of the output for calibrating Image Acquisition condition in real time For showing;And judge whether Image Acquisition condition meets default want according to the human face region detected in realtime graphic It asks, if human face region is located in predeterminable area and human face region proportion in realtime graphic is more than the first default ratio Example, it is determined that Image Acquisition condition meets preset requirement, if human face region is not in predeterminable area or human face region Proportion is not more than the first preset ratio in realtime graphic, it is determined that Image Acquisition condition is unsatisfactory for preset requirement.
Illustratively, program instruction is additionally operable to execute at runtime:If human face region proportion in realtime graphic No more than the first preset ratio, then output first acquires prompt message in real time, to prompt object and image collecting device to be verified It is close.
Illustratively, the used step S108 executed includes program instruction at runtime:It obtains and is directed to object to be verified The realtime graphic of acquisition;Human face region in predeterminable area and realtime graphic of the output for calibrating Image Acquisition condition in real time For showing;And judge whether Image Acquisition condition meets preset requirement according in human face region, if human face region is located at In predeterminable area and human face region proportion in predeterminable area is more than the second preset ratio, it is determined that Image Acquisition condition Meet preset requirement, if human face region be not in predeterminable area or human face region proportion is not in predeterminable area More than the second preset ratio, it is determined that Image Acquisition condition is unsatisfactory for preset requirement.
Illustratively, program instruction is additionally operable to execute at runtime:If human face region proportion in predeterminable area No more than the second preset ratio, then output second acquires prompt message in real time, to prompt object and image collecting device to be verified It is close.
Illustratively, program instruction is additionally operable to execute at runtime:Between real-time judge human face region and predeterminable area Relative position relation;And third acquisition prompt is exported based on the relative position relation between human face region and predeterminable area in real time Information, the relative position relation between object to be verified and image collecting device is changed with prompt so that human face region with it is default Region is close.
Illustratively, the used step S108 executed includes program instruction at runtime:Obtain image collecting device Posture information;And judge whether image collecting device is in vertical placement status according to posture information, if it is, determining figure As acquisition condition meets preset requirement, otherwise determine that Image Acquisition condition is unsatisfactory for preset requirement.
Illustratively, program instruction is additionally operable to execute following steps at runtime:Step S110 is being executed every time to step It is counted during S120 once, number is verified to obtain illumination;In program instruction used the step of executing at runtime After S120, program instruction is additionally operable to execute following steps at runtime:If illumination live body verification result indicates to be verified right As being not belonging to live body, then the second error message is exported, and judge whether illumination verification number reaches the second frequency threshold value, if light Reach the second frequency threshold value according to verification number, then goes to step S130, if illumination verification number is not up to the second frequency threshold value, Then return to step S108 or return to step S110, wherein the second error message is used to prompt the live body for object to be verified to test Card failure.
Illustratively, before the program instruction at runtime used step S110 executed or program instruction at runtime During the step S110 and step S120 of used execution, program instruction is additionally operable to execute following steps at runtime:It is defeated Go out the second prompt message, wherein the second prompt message is for prompting object to be verified to be remained stationary as in the second preset time.
Illustratively, the second prompt message is count down information corresponding with the second preset time.
Illustratively, detection light is obtained by dynamically changing color and/or the position of the light emitted to object to be verified.
Illustratively, detection light is obtained in the following manner by display screen emissions, detection light:Screen is shown by change The content of upper display carrys out the pattern that dynamic changes the light of display screen emissions, to emit detection light to object to be verified.
According to a further aspect of the invention, a kind of live body verification device, including light source, image collecting device, processing are provided Device and memory, wherein light source is used to emit detection light to object to be verified;Image collecting device is for acquiring object to be verified One or more light images under the irradiation of detection light;Computer program instructions, computer program are stored in memory For executing following steps when instruction is run by processor:Step S110:Obtain one or more light images;Step S120: Determine whether object to be verified belongs to based on the reflective character that object to be verified is showed in one or more light images Live body, to obtain illumination live body verification result;And step S130:It is to be verified right at least to be determined based on illumination live body verification result As if it no is verified by live body.
Illustratively, during irradiating object to be verified, the pattern of detection light at least changes once.
Illustratively, during irradiating object to be verified, between the pattern of detection light is at the time of each two is continuous It changes.
Illustratively, during irradiating object to be verified, the pattern of detection light changes or presets at random Alright.
Illustratively, it is additionally operable to execute following steps when computer program instructions are run by processor:Step S140:Output Action command, wherein action command is used to indicate object to be verified and executes corresponding action;Step S150:It obtains for be tested Multiple motion images that card object is acquired;Step S160:It is detected based on multiple motion images dynamic performed by object to be verified Make;And step S170:Determine whether object to be verified belongs to live body according to motion detection result and action command, to be moved Make live body verification result;The step S130 of used execution when computer program instructions are run by processor includes:Based on illumination Live body verification result and action live body verification result determine whether object to be verified is verified by live body;Image collecting device is also used In the multiple motion images of acquisition.
Illustratively, the step S170 of used execution when computer program instructions are run by processor includes:If base In the multiple motion images acquired in the period no more than the first preset time detect it is being executed by object to be verified, with The action kept strokes indicated by action command, it is determined that object to be verified belongs to live body, if based on when first is default In multiple motion images for being acquired be not detected it is being executed by object to be verified, with keeping strokes indicated by action command Action, it is determined that object to be verified is not belonging to live body.
Illustratively, it is additionally operable to execute following steps when computer program instructions are run by processor:Executing step every time It is counted during rapid S140 to step S170 once, verification number is acted with acquisition;In computer program instructions by processor After the step S170 of used execution when operation, it is additionally operable to execute following step when computer program instructions are run by processor Suddenly:If action live body verification result indicates that object to be verified is not belonging to live body, the first error message is exported, and judge to act Whether verification number reaches the first frequency threshold value, if action verification number reaches the first frequency threshold value, goes to step S130, If action verification number is not up to the first frequency threshold value, return to step S140 or in step S110 before step S140 Return to step S110 in the case of execution, wherein the first error message is used to prompt the live body verification for object to be verified to lose It loses.
Illustratively, it when computer program instructions are run by processor before the step S110 of used execution, calculates Machine program instruction is additionally operable to execute following steps when being run by processor:Step S108:Judge the Image Acquisition of object to be verified Whether condition meets preset requirement, if Image Acquisition condition meets preset requirement, goes to step S110, wherein image is adopted Collection condition include object to be verified the location of in the image acquisition region of image collecting device and/or object to be verified with The relative angle of image collecting device.
Illustratively, when computer program instructions are run by processor before the step S108 of used execution or with meter The step S108 of calculation machine program instruction used execution when being run by processor simultaneously, by processor transported by computer program instructions It is additionally operable to execute following steps when row:Step S106:Export the first prompt message, wherein the first prompt message is waited for for prompting Identifying object is by face's face image collecting device and close to image collecting device.
Illustratively, the step S106 of used execution when computer program instructions are run by processor includes:Pass through language The first prompt message of one or more outputs in sound form, image format and written form.
Illustratively, the live body verification device further comprises display device, wherein computer program instructions are handled The step S108 of used execution includes when device operation:Obtain the realtime graphic for object to be verified acquisition;Output is used in real time Human face region in the predeterminable area and realtime graphic of calibration Image Acquisition condition is for showing;And scheme according in real time The human face region detected as in judges whether Image Acquisition condition meets preset requirement, if human face region is located at predeterminable area Interior and human face region proportion in realtime graphic is more than the first preset ratio, it is determined that Image Acquisition condition meets default It is required that if human face region is not in predeterminable area or human face region proportion in realtime graphic is not more than first Preset ratio, it is determined that Image Acquisition condition is unsatisfactory for preset requirement;Image collecting device is additionally operable to obtain the realtime graphic; Display device is for showing predeterminable area and human face region.
Illustratively, it is additionally operable to execute when computer program instructions are run by processor:If human face region is schemed in real time As in proportion be not more than the first preset ratio, then in real time output first acquisition prompt message, with prompt object to be verified with Image collecting device is close.
Illustratively, the live body verification device further comprises display device, wherein computer program instructions are handled The step S108 of used execution includes when device operation:Obtain the realtime graphic for object to be verified acquisition;Output is used in real time Human face region in the predeterminable area and realtime graphic of calibration Image Acquisition condition is for showing;And according in face area Domain judges whether Image Acquisition condition meets preset requirement, if human face region is located in predeterminable area and human face region is pre- If proportion is more than the second preset ratio in region, it is determined that Image Acquisition condition meets preset requirement, if human face region It is not in predeterminable area or human face region proportion in predeterminable area is not more than the second preset ratio, it is determined that figure As acquisition condition is unsatisfactory for preset requirement;Image collecting device is additionally operable to obtain the realtime graphic;Display device is for showing Predeterminable area and human face region.
Illustratively, it is additionally operable to execute when computer program instructions are run by processor:If human face region is in preset areas In domain proportion be not more than the second preset ratio, then in real time output second acquisition prompt message, with prompt object to be verified with Image collecting device is close.
Illustratively, it is additionally operable to execute when computer program instructions are run by processor:Real-time judge human face region with it is pre- If the relative position relation between region;And it is exported in real time based on the relative position relation between human face region and predeterminable area Third acquires prompt message, changes the relative position relation between object and image collecting device to be verified so that people with prompt Face region and predeterminable area are close.
Illustratively, the step S108 of used execution when computer program instructions are run by processor includes:Obtain figure As the posture information of harvester;And judge whether image collecting device is in vertical placement status according to posture information, such as Fruit is, it is determined that Image Acquisition condition meets preset requirement, otherwise determines that Image Acquisition condition is unsatisfactory for preset requirement.
Illustratively, it is additionally operable to execute following steps when computer program instructions are run by processor:Executing step every time It is counted during rapid S110 to step S120 once, number is verified to obtain illumination;In computer program instructions by processor After the step S120 of used execution when operation, it is additionally operable to execute following step when computer program instructions are run by processor Suddenly:If illumination live body verification result indicates that object to be verified is not belonging to live body, the second error message is exported, and judge illumination Whether verification number reaches the second frequency threshold value, if illumination verification number reaches the second frequency threshold value, goes to step S130, If illumination verification number is not up to the second frequency threshold value, return to step S108 or return to step S110, wherein the second mistake Information is used to prompt the live body authentication failed for object to be verified.
Illustratively, it before the step S110 of used execution or is being counted when computer program instructions are run by processor When being run by processor during the step S110 and step S120 of used execution, computer program refers to calculation machine program instruction Order is additionally operable to execute following steps when being run by processor:Export the second prompt message, wherein the second prompt message is for prompting Object to be verified remains stationary as in the second preset time.
Illustratively, the second prompt message is count down information corresponding with the second preset time.
Illustratively, detection light is obtained by dynamically changing color and/or the position of the light emitted to object to be verified.
Illustratively, detection light is obtained in the following manner by display screen emissions, detection light:Screen is shown by change The content of upper display carrys out the pattern that dynamic changes the light of display screen emissions, to emit detection light to object to be verified.
According to a further aspect of the invention, a kind of live body verification device is provided, including:Light source is used for object to be verified Emit detection light;Image collecting device, for acquiring one or more illumination patterns of the object to be verified under the irradiation of detection light Picture;Information carrying means for one or more light images to be sent to server, and receives server from server and passes through Following manner obtain about object to be verified whether by live body verify verification information:Based on object to be verified at one or The reflective character showed in multiple light images determines whether object to be verified belongs to live body, to obtain the verification of illumination live body As a result, simultaneously at least determining whether object to be verified is verified by live body based on illumination live body verification result;And processing unit, it uses It is verified or does not pass through operation in being executed based on verification information.
According to a further aspect of the invention, it provides a kind of live body verification device, including information carrying means, processor and deposits Reservoir, wherein information carrying means is used to receive one or more light images of object to be verified from client, and will be about Whether the verification information verified by live body is sent to client to object to be verified, wherein one or more light images are needles To the acquired acquisition of object to be verified under the irradiation of detection light;It is stored with computer program instructions in memory, calculates For executing following steps when machine program instruction is run by processor:Step S110:Obtain one or more light images;Step S120:Whether object to be verified is determined based on the reflective character that object to be verified is showed in one or more light images Belong to live body, to obtain illumination live body verification result;And step S130:It is at least determined based on illumination live body verification result to be tested Whether card object is verified by live body, to obtain verification information.
Illustratively, during irradiating object to be verified, the pattern of detection light at least changes once.
Illustratively, during irradiating object to be verified, between the pattern of detection light is at the time of each two is continuous It changes.
Illustratively, during irradiating object to be verified, the pattern of detection light changes or presets at random Alright.
Illustratively, it is additionally operable to execute following steps when computer program instructions are run by processor:Step S140:Output Action command, wherein action command is used to indicate object to be verified and executes corresponding action;Step S150:It obtains for be tested Multiple motion images that card object is acquired;Step S160:It is detected based on multiple motion images dynamic performed by object to be verified Make;And step S170:Determine whether object to be verified belongs to live body according to motion detection result and action command, to be moved Make live body verification result;The step S130 of used execution when computer program instructions are run by processor includes:Based on illumination Live body verification result and action live body verification result determine whether object to be verified is verified by live body;Information carrying means is also used In action command is sent to client and receives multiple motion images from client.
Illustratively, the step S170 of used execution when computer program instructions are run by processor includes:If base In the multiple motion images acquired in the period no more than the first preset time detect it is being executed by object to be verified, with The action kept strokes indicated by action command, it is determined that object to be verified belongs to live body, if based on when first is default In multiple motion images for being acquired be not detected it is being executed by object to be verified, with keeping strokes indicated by action command Action, it is determined that object to be verified is not belonging to live body.
Illustratively, it is additionally operable to execute following steps when computer program instructions are run by processor:Executing step every time It is counted during rapid S140 to step S170 once, verification number is acted with acquisition;In computer program instructions by processor After the step S170 of used execution when operation, it is additionally operable to execute following step when computer program instructions are run by processor Suddenly:If action live body verification result indicates that object to be verified is not belonging to live body, the first error message is exported, and judge to act Whether verification number reaches the first frequency threshold value, if action verification number reaches the first frequency threshold value, goes to step S130, If action verification number is not up to the first frequency threshold value, return to step S140 or in step S110 before step S140 Return to step S110 in the case of execution, wherein the first error message is used to prompt the live body verification for object to be verified to lose It loses;Information carrying means is additionally operable to the first error message being sent to client to be exported by client.
Illustratively, it when computer program instructions are run by processor before the step S110 of used execution, calculates Machine program instruction is additionally operable to execute following steps when being run by processor:Step S108:Judge the Image Acquisition of object to be verified Whether condition meets preset requirement, if Image Acquisition condition meets preset requirement, goes to step S110, wherein image is adopted Collection condition include object to be verified the location of in the image acquisition region of image collecting device and/or object to be verified with The relative angle of image collecting device.
Illustratively, when computer program instructions are run by processor before the step S108 of used execution or with meter The step S108 of calculation machine program instruction used execution when being run by processor simultaneously, by processor transported by computer program instructions It is additionally operable to execute following steps when row:Step S106:Export the first prompt message, wherein the first prompt message is waited for for prompting Identifying object is by the image collecting device of face's face client and close to image collecting device;Information carrying means be additionally operable to by First prompt message is sent to client to be exported by client.
Illustratively, the step S106 of used execution when computer program instructions are run by processor includes:Pass through language The first prompt message of one or more outputs in sound form, image format and written form.
Illustratively, the live body verification device further comprises display device, wherein computer program instructions are handled The step S108 of used execution includes when device operation:Obtain the realtime graphic for object to be verified acquisition;Output is used in real time Human face region in the predeterminable area and realtime graphic of calibration Image Acquisition condition is for showing;And scheme according in real time The human face region detected as in judges whether Image Acquisition condition meets preset requirement, if human face region is located at predeterminable area Interior and human face region proportion in realtime graphic is more than the first preset ratio, it is determined that Image Acquisition condition meets default It is required that if human face region is not in predeterminable area or human face region proportion in realtime graphic is not more than first Preset ratio, it is determined that Image Acquisition condition is unsatisfactory for preset requirement;Information carrying means is additionally operable to from described in client reception Predeterminable area and human face region are simultaneously sent to client to be exported by client for showing by realtime graphic.
Illustratively, it is additionally operable to execute when computer program instructions are run by processor:If human face region is schemed in real time As in proportion be not more than the first preset ratio, then in real time output first acquisition prompt message, with prompt object to be verified with Image collecting device is close;Information carrying means is additionally operable to the first acquisition prompt message being sent to client with defeated by client Go out.
Illustratively, the step S108 of used execution when computer program instructions are run by processor includes:Obtain needle Treat the realtime graphic of identifying object acquisition;Predeterminable area and realtime graphic of the output for calibrating Image Acquisition condition in real time In human face region for showing;And judge whether Image Acquisition condition meets preset requirement according in human face region, if Human face region is located in predeterminable area and human face region proportion in predeterminable area is more than the second preset ratio, it is determined that Image Acquisition condition meets preset requirement, if human face region is not in predeterminable area or human face region is in predeterminable area Middle proportion is not more than the second preset ratio, it is determined that Image Acquisition condition is unsatisfactory for preset requirement;Information carrying means is also For receiving the realtime graphic from client;Information carrying means is additionally operable to receive the realtime graphic from client and will be pre- If region and human face region are sent to client to be exported by client for showing.
Illustratively, it is additionally operable to execute when computer program instructions are run by processor:If human face region is in preset areas In domain proportion be not more than the second preset ratio, then in real time output second acquisition prompt message, with prompt object to be verified with Image collecting device is close;Information carrying means is additionally operable to the second acquisition prompt message being sent to client with defeated by client Go out.
Illustratively, it is additionally operable to execute when computer program instructions are run by processor:Real-time judge human face region with it is pre- If the relative position relation between region;And it is exported in real time based on the relative position relation between human face region and predeterminable area Third acquires prompt message, changes the relative position relation between object and image collecting device to be verified so that people with prompt Face region and predeterminable area are close;Information carrying means is additionally operable to third acquisition prompt message being sent to client with by client End output.
Illustratively, the step S108 of used execution when computer program instructions are run by processor includes:Obtain figure As the posture information of harvester;And judge whether image collecting device is in vertical placement status according to posture information, such as Fruit is, it is determined that Image Acquisition condition meets preset requirement, otherwise determines that Image Acquisition condition is unsatisfactory for preset requirement.
Illustratively, it is additionally operable to execute following steps when computer program instructions are run by processor:Executing step every time It is counted during rapid S110 to step S120 once, number is verified to obtain illumination;In computer program instructions by processor After the step S120 of used execution when operation, it is additionally operable to execute following step when computer program instructions are run by processor Suddenly:If illumination live body verification result indicates that object to be verified is not belonging to live body, the second error message is exported, and judge illumination Whether verification number reaches the second frequency threshold value, if illumination verification number reaches the second frequency threshold value, goes to step S130, If illumination verification number is not up to the second frequency threshold value, return to step S108 or return to step S110, wherein the second mistake Information is used to prompt the live body authentication failed for object to be verified;Information carrying means is additionally operable to send the second error message To client to be exported by client.
Illustratively, it before the step S110 of used execution or is being counted when computer program instructions are run by processor When being run by processor during the step S110 and step S120 of used execution, computer program refers to calculation machine program instruction Order is additionally operable to execute following steps when being run by processor:Export the second prompt message, wherein the second prompt message is for prompting Object to be verified remains stationary as in the second preset time;Information carrying means is additionally operable to the second prompt message being sent to client End by client to be exported.
Illustratively, the second prompt message is count down information corresponding with the second preset time.
Illustratively, detection light is obtained by dynamically changing color and/or the position of the light emitted to object to be verified.
Illustratively, detection light is obtained in the following manner by display screen emissions, detection light:Screen is shown by change The content of upper display carrys out the pattern that dynamic changes the light of display screen emissions, to emit detection light to object to be verified.
According to a further aspect of the invention, a kind of live body verification device is provided, including:Light source is used for object to be verified Emit detection light;Image collecting device, for acquiring one or more illumination patterns of the object to be verified under the irradiation of detection light Picture;Information carrying means for one or more light images to be sent to server, and receives server from server and passes through The illumination live body verification result that following manner obtains:The light showed in one or more light images based on object to be verified Reflection characteristic determines whether object to be verified belongs to live body, to obtain illumination live body verification result;And processing unit, for extremely Determine whether object to be verified is verified by live body based on illumination live body verification result less.
According to a further aspect of the invention, a kind of live body verification device, including information carrying means and processing unit are provided, Wherein, information carrying means is used to receive one or more light images of object to be verified from client, and will be about to be tested The judgement information whether card object belongs to live body is sent to client, wherein one or more light images are to be directed to detecting The acquired acquisition of object to be verified under the irradiation of light;Processing unit is used for based on object to be verified in one or more illumination The reflective character showed in image determines whether object to be verified belongs to live body, living to obtain illumination live body verification result Body verification result is used at least determine whether object to be verified is tested by live body based on the illumination live body verification result by client Card.
Real human face and the face on screen or photo can be effectively identified with device according to the method for the embodiment of the present invention, Therefore the safety of live body verification system can be effectively improved.
Description of the drawings
The embodiment of the present invention is described in more detail in conjunction with the accompanying drawings, the above and other purposes of the present invention, Feature and advantage will be apparent.Attached drawing is used for providing further understanding the embodiment of the present invention, and constitutes explanation A part for book is not construed as limiting the invention for explaining the present invention together with the embodiment of the present invention.In the accompanying drawings, Identical reference label typically represents same parts or step.
Fig. 1 shows for realizing the exemplary electronic device of live body verification method and device according to an embodiment of the invention Schematic block diagram;
Fig. 2 shows the schematic flow charts of live body verification method according to an embodiment of the invention;
Fig. 3 shows the schematic flow chart of live body verification method in accordance with another embodiment of the present invention;
Fig. 4 describes the implementation process of live body verification method according to an embodiment of the invention;
Fig. 5 shows the schematic block diagram of live body verification device according to an embodiment of the invention;And
Fig. 6 shows the schematic block diagram of live body verification system according to an embodiment of the invention.
Specific implementation mode
In order to enable the object, technical solutions and advantages of the present invention become apparent, root is described in detail below with reference to accompanying drawings According to example embodiments of the present invention.Obviously, described embodiment is only a part of the embodiment of the present invention, rather than this hair Bright whole embodiments, it should be appreciated that the present invention is not limited by example embodiment described herein.Based on described in the present invention The embodiment of the present invention, those skilled in the art's obtained all other embodiment in the case where not making the creative labor It should all fall under the scope of the present invention.
In order to solve problem as described above, a kind of live body verification method of offer of the embodiment of the present invention and device.The live body Reflective character that verification method and device are presented under detection light based on object to be verified verifies whether object to be verified belongs to In live body.This method can effectively preventing malice user be used by the progress malicious attack such as the photo of counterfeiter or video.This Kind live body verification method and device can be adapted for various field of identity authentication and similar field, for example, it is suitable for electronics quotient Business, mobile payment, the technical fields such as open a bank account.
First, it describes referring to Fig.1 for realizing live body verification method according to an embodiment of the invention and device Exemplary electronic device 100.
As shown in Figure 1, electronic equipment 100 include one or more processors 102, it is one or more storage device 104, defeated Enter device 106, output device 108, image collecting device 110 and light source 112, these components by bus system 114 and/or its Bindiny mechanism's (not shown) interconnection of its form.It should be noted that the component and structure of electronic equipment 100 shown in FIG. 1 only show Example property, and not restrictive, as needed, the electronic equipment can also have other assemblies and structure.
The processor 102 can be central processing unit (CPU) or have data-handling capacity and/or instruction execution The processing unit of the other forms of ability, and it is desired to execute to control other components in the electronic equipment 100 Function.
The storage device 104 may include one or more computer program products, and the computer program product can To include various forms of computer readable storage mediums, such as volatile memory and/or nonvolatile memory.It is described easy The property lost memory is such as may include random access memory (RAM) and/or cache memory (cache).It is described non- Volatile memory is such as may include read-only memory (ROM), hard disk, flash memory.In the computer readable storage medium On can store one or more computer program instructions, processor 102 can run described program instruction, to realize hereafter institute The client functionality (realized by processor) in the embodiment of the present invention stated and/or other desired functions.In the meter Can also store various application programs and various data in calculation machine readable storage medium storing program for executing, for example, the application program use and/or The various data etc. generated.
The input unit 106 can be the device that user is used for inputting instruction, and may include keyboard, mouse, wheat One or more of gram wind and touch screen etc..
The output device 108 can export various information (such as image and/or sound) to external (such as user), and And may include one or more of display, loud speaker etc..
Described image harvester 110 can acquire various images, such as facial image (including video frame), and by institute The image of acquisition is stored in the storage device 104 so that other components use.Image collecting device 110 can be camera shooting Head.It should be appreciated that image collecting device 110 is only example, electronic equipment 100 can not include image collecting device 110.At this In the case of kind, other image acquisition device images can be utilized, and the image of acquisition is sent to electronic equipment 100.
Light source 112 can be the device that can be shone, and may include the special light sources such as light emitting diode, can also include Show the unconventional light sources such as screen.Situation in the mobile terminal that live body verification method and device are implemented in such as smart mobile phone Under, input unit 106, output device 108 and light source 112 can be same display screens.
Illustratively, the exemplary electronic device for realizing live body verification method according to the ... of the embodiment of the present invention and device can To be realized in the equipment of personal computer or remote server etc..
In the following, live body verification method according to the ... of the embodiment of the present invention will be described with reference to figure 2.Fig. 2 shows according to the present invention one The schematic flow chart of the live body verification method 200 of a embodiment.As shown in Fig. 2, live body verification method 200 includes following step Suddenly.
In step S210, the one or more illumination acquired for the object to be verified under the irradiation of detection light are obtained Image.
Object to be verified can refer to the part (such as face) on people or the person, can also refer to photo, for showing people The objects such as the screen or mask of face.
Illustratively, light source can be utilized to emit detection light to object to be verified.Light source can be controlled by processor to send out Light.Illustratively, light source can share other light-emitting devices (for example, the light in at least partly region of display screen, projecting apparatus Source) it is used as light source.In another example light source can also be special light source (for example, shining according to the one or more that certain way is arranged Diode or laser diode, such as the flash lamp etc. for camera), or display screen and other kinds of light source Combination etc..
The pattern of detection light can include but is not limited to the color of detection light, the position of light-emitting zone, detection light intensity, The frequency etc. of the irradiating angle of detection light, the wavelength of detection light, detection light.
Illustratively, during irradiating object to be verified, the pattern of detection light can not change, that is, It says, single constant light may be used to irradiate object to be verified in light source.For example, in a preferred embodiment, it is used Light source is the display screen of mobile terminal.On the display screen, color and the brightness etc. of each pixel can be controlled so that display Screen can emit the light that specific pattern is presented, such as structure light, at this point, the particular color that screen is shown in specific pixel region Or brightness can be the pattern for the specific detection light chosen after being optimized according to lot of experimental data, in such detection light Under pattern, identifying object progress live body can rapidly and accurately be treated by special algorithm corresponding with the pattern of the detection light and tested Card.In this case, one or more light images can be acquired under the irradiation of constant detection light, based on light image into Row live body is verified.
Compare it is appreciated that during irradiating object to be verified, the pattern of detection light at least changes once.This In the case of, the frequency acquisition of the pattern change frequency and image that control detection light can be coordinated, so that in the inspection of each pattern At least one light image can be collected by surveying under light.
More preferably, it changes between the pattern of detection light is at the time of each two is continuous.The moment can be with It is the time point of any specific in predetermined period.For example, the pattern of detection light can change once every 1 second.Do not stop to change The pattern of detection light can obtain abundanter reflective character information, be conducive to more accurately and efficiently implement to be based on light The live body of reflection characteristic is verified.
Optionally, during irradiating object to be verified, the pattern of detection light is changing at random or pre-set 's.In one example, the pattern of detection light be completely random change.For example, in a preferred embodiment, being used Light source be mobile terminal display screen.On the display screen, the color that each region can be controlled, for each region, A certain rgb value is randomly selected within the scope of scheduled rgb value every time to be shown as the color value in the region.The division in region It can arbitrarily set, for example, each region may include one or more pixels, the size of two different zones can be identical, It can also be different.
In another example, the pattern of detection light can be pre-set.For example, can set detection light is total to prolonged exposure 10 seconds, change one mode per second, the color of the detection light emitted every time, position, intensity etc. were pre-set.In live body In verification process, light source can emit the detection light of 10 kinds of patterns successively according to pre-set mode.Pre-set The pattern of detection light can be obtained based on first experience, to live body verification for relatively effective pattern, this is conducive to carry The accuracy rate and efficiency of high live body verification.
For example, can dynamically change the inspection for being irradiated to object to be verified by dynamically changing the luminescent color of detection light Survey the pattern of light.In another example can also be by dynamically changing the position of the light-emitting zone of detection light (that is, changing detection light Position) carry out the pattern that dynamic changes the detection light for being irradiated to object to be verified.For another example can also be by dynamically changing simultaneously The position of the luminescent color of detection light and the light-emitting zone of detection light carrys out dynamic and changes the detection light for being irradiated to object to be verified Pattern.
For example, can dynamically change the position of the light-emitting zone of detection light by changing the position of light source, this can be with Change the position that detection light is irradiated to object to be verified.In another example can also by change light source emergent ray angle come The dynamic position for changing detection light and being irradiated to object to be verified.
In a preferred embodiment, used light source is the display screen of mobile terminal, and image collector is set to this The camera (such as front camera) for being located at the same side with display screen of mobile terminal.Relative to using additional dedicated optical The scheme in source, this programme can be realized using existing mobile terminals such as mobile phones, do not limited, can test the live body by external condition Card scheme is preferably applied for carrying out remotely open an account equal application scenarios by individual mobile terminal.
Further, in the further preferred scheme of above preferred embodiment, the pattern of used light is the face of light The integrated mode of the position of color and light-emitting zone, such as:Synchronization sends out different colours in the different location of display screen Light, alternatively, color of the synchronization in the light that the different location of display screen sends out the light of same color but different moments send out Difference etc..Using the scheme of the integrated mode of the position of the color and light-emitting zone of light, relative to select change light intensity etc. other The scheme of the pattern of light, not only live body verification the verifying results are more preferable, but also can reduce stimulation of the light to human eye, to promote user's body It tests.
In the case of irradiation of the object to be verified by detection light, can utilizing image collecting device, (such as electronics is set Standby 100 image collecting device 110) image of the acquisition object to be verified under the irradiation of detection light, obtain the light image. Image collecting device can be controlled by processor to acquire image.One or more light images are transmitted to by image collecting device The processor that live body verifies system is verified for live body.Illustratively, the collected illumination under the irradiation of the light of same pattern The number of image can be one or more, and the present invention limits not to this.It will be appreciated by persons skilled in the art that living Experience card is mainly based upon the verification of face progress, therefore, according to embodiment hereof, in acquisition light image and subsequent action When image and realtime graphic, it is therefore intended that the image comprising face is collected, for carrying out live body verification.
Illustratively, light image can be by client device (such as mobile terminal, long-distance video cabinet including camera Member's machine (Video Teller Machine, VTM) etc.) electronic equipment 100 is sent to by the processor 102 of electronic equipment 100 It is handled, the image collecting device 110 (such as camera) that can also include by electronic equipment 100 acquires and is transmitted to processing Device 102 is handled.
In step S220, determined based on the reflective character that object to be verified is showed in one or more light images Whether object to be verified belongs to live body, to obtain illumination live body verification result.
The human skin of such as face skin is a kind of irreflexive material, and face is three-dimensional;In contrast, all As the display screen of liquid crystal display (LCD) or Organic Light Emitting Diode (OLED) display is considered self luminous object Body and also generally include partial specular reflection component, and photo etc. be typically plane and also to generally include partial mirror anti- Component is penetrated, and either shows screen or photo, reflection characteristic on the whole is three-dimensional that is uniform and lacking face Characteristic.The reflective character of face is different from display screen or the reflective character of photo, it is possible thereby to be tested by being based on The reflective character of card object judges whether object to be verified is to belong to live body.
In step S230, at least determine whether object to be verified is verified by live body based on illumination live body verification result.
It in one example, can be directly using illumination live body verification result as final live body verification result, that is, if Illumination live body verification result indicates that object to be verified belongs to live body, it is determined that object to be verified is verified by live body, if illumination Live body verification result indicates that object to be verified is not belonging to live body, it is determined that object to be verified is not verified by live body.This verification The calculation amount of mode is smaller, and efficiency is higher.In another example, illumination live body can be tested in conjunction with other live body verification modes Card result is combined consideration with other live body verification results obtained based on other live body verification modes, is waited for final determination Whether identifying object is verified by live body.The accuracy rate of this verification mode is higher.
As described above, not due to the reflective character of the reflective character of face and the display objects such as screen or photo Together, therefore based on reflective character the face on the face or photo played back on real human face and screen can effectively be distinguished.Cause This, live body verification method and device according to the ... of the embodiment of the present invention can effectively defend screen or photo attacker, so as to Improve safety and the user experience of the identity authorization system or similar system using the live body verification method and device.
Illustratively, live body verification method according to the ... of the embodiment of the present invention can be in setting with memory and processor It is realized in standby, device or system.
Live body verification method according to the ... of the embodiment of the present invention can be deployed at Image Acquisition end, for example, can be deployed in It is mobile at the Image Acquisition end of the financial systems such as bank management system or to be deployed in smart mobile phone, tablet computer etc. At terminal.Alternatively, live body verification method according to the ... of the embodiment of the present invention is deployed in server end (or cloud in which can also be distributed End) and client at.For example, can emit light in client and acquire the image of object to be verified, client will be collected Image sends server end (or high in the clouds) to, carries out live body verification by server end (or high in the clouds), and verification result is returned to Client, server have the data operation ability of bigger relative to client, transfer to server end to carry out live body verification, energy Verifying speed is enough promoted, user experience is promoted, further, since server has the arithmetic speed of bigger therefore can be used more multiple Miscellaneous live body verification algorithm can promote the accuracy rate of vivo identification by carrying out live body verification in server end.
Screen or photo can be defendd to attack although carrying out live body verification based on reflective character, the attack of attacker There are many mode is possible, certain others attack patterns are possible to break through the live body verification carried out based on reflective character, such as Three-dimensional artificial mask is attacked.The case where being attacked for mask, the live body verification method based on reflective character is possibly can not be fine Ground is defendd.Therefore, in order to further improve live body verification method, the safety of raising live body verification can be based on light reflection On the basis of the live body verification of characteristic, verified further combined with other live body verification modes.One kind is described below to show The realization method of example property.
Fig. 3 shows the schematic flow chart of live body verification method 300 in accordance with another embodiment of the present invention.Shown in Fig. 3 Live body verification method 300 step S310 to S330 and live body verification method 200 shown in Fig. 2 step S210 to S230 phases Corresponding, those skilled in the art can understand step S310 to S330 shown in Fig. 3 with the associated description of reference chart 2, herein no longer It repeats.According to the present embodiment, live body verification method 300 can also include step S340 to S370, also, step S330 can be wrapped It includes:Determine whether object to be verified is verified by live body based on illumination live body verification result and action live body verification result.
In step S340, output action instruction, wherein action command is used to indicate object to be verified and executes corresponding move Make.
Illustratively, it can be instructed randomly or by pre-defined rule output action.Action command may include individually referring to It enables, or the instruction sequence being made of series of instructions.For example, action command can indicate that object to be verified is nodded, shakes the head, blinked Eye is opened one's mouth, etc..
In step S350, the multiple motion images acquired for object to be verified are obtained.
It is to be verified right to be directed to while output action instructs or within a period of time after output action instruction As carrying out Image Acquisition, multiple motion images are obtained.Illustratively, multiple motion images can be continuous video frame.Action Image can equally be acquired by above-mentioned image collecting device 110, or by other image acquisition devices.
In step S360, the action performed by object to be verified is detected based on multiple motion images.
Illustratively, Face datection and key point identification can be carried out in each motion images, and are based on multiple actions Facial contour and/or face key point in image judge the action performed by face, for example, passing through identify facial contour And/or variation tendency of the face key point in multiple the continuous motion images got judges the action performed by face.With Afterwards, it can be determined that whether the action indicated by action and action command performed by face is consistent.
In step S370, determine whether object to be verified belongs to live body according to motion detection result and action command, to obtain Obtain action live body verification result.
Illustratively, if indicated by object to be verified action and action command performed in multiple motion images Keep strokes, it is determined that object to be verified belongs to live body, if the action that object to be verified is performed in multiple motion images It is inconsistent or object to be verified is not carried out any action (i.e. not in multiple motion images with the action indicated by action command Detect the action of object to be verified), it is determined that object to be verified is not belonging to live body.Certainly, aforesaid way is only example, action Live body verifies whether by that can have other methods of determination, for example, object to be verified performed in multiple motion images it is more A action, multiple actions include and the action kept strokes indicated by action command, it is determined that object to be verified belongs to living Body.
Illustratively, in step S330, if illumination live body verification result and action live body verification result indicate to be tested Card object belongs to live body, it is determined that object to be verified is verified by live body, if illumination live body verification result and action live experience Any of card result indicates that object to be verified is not belonging to live body, it is determined that object to be verified is not verified by live body.When So, aforesaid way is only example, and live body is verified whether by that can have other methods of determination.
It should be noted that the above-mentioned live body verification step (step S340-S370) based on action and the work based on reflective character The priority execution sequence of body verification step (step S310-S320) can arbitrarily be set, and the present invention limits not to this.
Including the live body verification method of the live body verification step based on action can be independently executed by Image Acquisition end, example It such as, can be by the shiftings such as the Image Acquisition end of the financial systems such as bank management system or smart mobile phone, tablet computer Dynamic terminal independently executes.Alternatively, including the live body verification method of the live body verification step based on action can also be by server (or high in the clouds) and client cooperation is held to execute.For example, action command can be generated in server end or client, adopted by client Collect the motion images of object to be verified, client sends collected motion images to server end (or high in the clouds), by servicing Device end (or high in the clouds) carries out the verification of the live body based on action, and verification result is returned to client.
Live body verification mode based on action can defend the attack patterns such as mask attack, and based on reflective character Live body verification mode be combined together, can effectively defend the attack of multiple types, to be further ensured that live body verify system And the safety of relevant identity authorization system or similar system, while it being also beneficial to the information security and its equity of protection user, With being extremely widely applied value and market prospects.
According to embodiments of the present invention, step S370 may include:If based in the period no more than the first preset time Interior acquired multiple motion images detect being executed by object to be verified, dynamic with keeping strokes indicated by action command Make, it is determined that object to be verified belongs to live body, if do not examined based on the multiple motion images acquired in the first preset time Measure the action kept strokes indicated by executed by object to be verified and action command, it is determined that object to be verified does not belong to In live body.
Random output action instruction (such as words or the phonetic order such as " please nod ", " please open one's mouth ") is to be verified to indicate Object executes corresponding action (such as nod, open one's mouth), is detected to human face region key point to judge object to be verified Whether performed action is consistent with the action command of output.If being detected in the first preset time performed by object to be verified Action with export action command it is consistent, it is determined that object to be verified belongs to live body;If being detected in the first preset time Action performed by object to be verified and the action command exported are inconsistent, or are not detected in the first preset time to be tested The action for demonstrate,proving object, then can determine that object to be verified is not belonging to live body.
According to embodiments of the present invention, live body verification method 300 can also include:Step S340 is being executed every time to step It is counted during S370 once, verification number is acted with acquisition;After step s 370, method 300 can also include:If Action live body verification result indicates that object to be verified is not belonging to live body, then exports the first error message, and judges action verification time Whether number reaches the first frequency threshold value, if action verification number reaches the first frequency threshold value, step S330 is gone to, if dynamic Make verification number and be not up to the first frequency threshold value, then return to step S340 or is executed before step S340 in step S310 In the case of return to step S310, wherein the first error message be used for prompt be directed to object to be verified live body authentication failed.
Illustratively, counter can be set, for being the live body verification step (step S340-S370) based on action It executes number to be counted, often executes a live body verification step based on action, counter can add one.The output of counter As a result it is action verification number.It, can be by counter after entire live body verification method (live body verification method 300) termination It resets.
If current action live body verification result indicates that object to be verified is not belonging to live body, the first mistake letter can be exported Breath.First error message can prompt the authentication failed for being directed to object to be verified and prompt to re-start live body verification.If this When the live body verification step based on action execution number (action verification number) preset first frequency threshold value has not yet been reached, then The live body verification step based on action can be attempted to re-execute.Optionally, if the live body verification step based on reflective character Suddenly (step S310-S320) is executed before the live body verification step based on action, then can return directly to step S310, i.e., A live body verification step based on reflective character and the live body verification step based on action are re-executed, is tested with promoting live body The accuracy of card.
First frequency threshold value can be any appropriate value, can be set as needed, the present invention limits not to this System.
Due in actual live body verification process, may having a various fortuitous events, for example, user do not make in time it is specified The image act, acquired is not clear enough, Face datection result is not accurate enough etc., these situations may cause user to be misidentified as Non-living body.Therefore, user experience and security of system in order to balance can set frequency threshold value, allow user in zone of reasonableness Interior multiple trial live body verification.If user is not correctly identified as live body yet when reaching frequency threshold value, it can be determined Really it is not belonging to live body.
According to embodiments of the present invention, before step S210 (or S310), live body verification method 200 (or 300) can be with Including:Step S208:Judge whether the Image Acquisition condition of object to be verified meets preset requirement, if Image Acquisition condition is full Sufficient preset requirement then goes to step S210 (or S310), wherein Image Acquisition condition includes object to be verified in image collector The relative angle of location and/or object to be verified and image collecting device in the image acquisition region set.
Before executing live body verification step or other live body verification steps based on reflective character, it can treat first The Image Acquisition condition of identifying object is detected, and judges whether it meets preset requirement.It can be in only object still to be tested Image Acquisition condition just executed in the case of meeting preset requirement the subsequent live body verification step based on reflective character or its His live body verification step, can ensure the quality of image (including light image, motion images etc.) verified for live body in this way, Be conducive to the face in correct detection image, to be conducive to improve the accuracy rate of live body verification.
According to embodiments of the present invention, before step S208 or with step S208 simultaneously, live body verification method 200 (or 300) can also include:Step S206:Export the first prompt message, wherein the first prompt message is for prompting object to be verified By face's face image collecting device and close to image collecting device.
Any suitable way output may be used in first prompt message.Illustratively, step S206 may include:Pass through The first prompt message of one or more outputs in speech form, image format and written form.For example, can be in mobile terminal Display screen on output " asking face screen " (face screen is equivalent to face image collecting device) as word, Huo Zheke Signal language as " asking face screen " is sent out with the loud speaker by mobile terminal.
Illustratively, live body verification method can be by the application (APP) on the electronic equipments such as mobile terminal To realize.It is somebody's turn to do when user opens in application, the first prompt message of output can be first begin to, to prompt user to be protected with mobile terminal Suitable relative position relation is held, is verified for live body in order to which the camera of mobile terminal acquires ideal facial image. In one example, the first prompt message can before the Image Acquisition condition of object to be verified meets preset requirement constantly or It exports at intervals.
Export the first prompt message can in order to instruct user adjust in time live body verify device and itself relative position Relationship, meanwhile, the interaction of this user and system can also promote user experience.
According to embodiments of the present invention, step S208 may include:Obtain the realtime graphic for object to be verified acquisition;It is real When predeterminable area and realtime graphic of the output for calibrating Image Acquisition condition in human face region for showing;And according to The human face region detected in realtime graphic judges whether Image Acquisition condition meets preset requirement, if human face region is located at In predeterminable area and human face region proportion in realtime graphic is more than the first preset ratio, it is determined that Image Acquisition condition Meet preset requirement, if human face region be not in predeterminable area or human face region proportion is not in realtime graphic More than the first preset ratio, it is determined that Image Acquisition condition is unsatisfactory for preset requirement.
In one example, it can judge that the image of object to be verified is adopted according to the image acquired for object to be verified Whether collection condition meets preset requirement.For example, mobile terminal can be acquired realtime graphic by camera and carry out Face datection. Face datection can obtain human face region, and human face region is the image block for including face.It can be schemed in real time according to human face region The location of as in and human face region proportion in realtime graphic judges the Image Acquisition condition of object to be verified Whether preset requirement is met.For example, predeterminable area can be delimited in realtime graphic.It can be limited by predeterminable area to be verified Position of the object in the image acquisition region of image collecting device.The size of human face region can reflect object to be verified and figure As the distance and relative angle of harvester.Predeterminable area and the first preset ratio can be set as needed, and the present invention is not This is limited.
For example, if the human face region of object to be verified is located in predeterminable area, but human face region is in realtime graphic Proportion is less than the first preset ratio (such as 2/3rds), it is likely that is object to be verified relative to image collecting device Be too greatly inclined and/or range image harvester farther out, at this time it is considered that Image Acquisition condition be unsatisfactory for preset requirement.
Illustratively, live body verification method 200 (or 300) can also include:If human face region institute in realtime graphic Accounting example is not more than the first preset ratio, then the first acquisition of output in real time prompt message, to prompt object to be verified and image to adopt Acquisition means are close.
Optionally, the first acquisition prompt message can by one kind in speech form, image format and written form or A variety of outputs.If for example, finding that human face region proportion in realtime graphic is not more than the first preset ratio, can show Such as " please be close to camera " (or " please be close to mobile phone ") this kind of prompt message is shown on screen.
According to embodiments of the present invention, step S208 may include:Obtain the realtime graphic for object to be verified acquisition;It is real When predeterminable area and realtime graphic of the output for calibrating Image Acquisition condition in human face region for showing;And according to The human face region detected in realtime graphic judges whether Image Acquisition condition meets preset requirement, if human face region is located at In predeterminable area and human face region proportion in predeterminable area is more than the second preset ratio, it is determined that Image Acquisition condition Meet preset requirement, if human face region be not in predeterminable area or human face region proportion is not in predeterminable area More than the second preset ratio, it is determined that Image Acquisition condition is unsatisfactory for preset requirement.
In one example, it can judge that the image of object to be verified is adopted according to the image acquired for object to be verified Whether collection condition meets preset requirement.For example, mobile terminal can be acquired realtime graphic by camera and carry out Face datection. Face datection can obtain human face region, and human face region is the image block for including face.It can be schemed in real time according to human face region The location of as in and human face region proportion in predeterminable area judges the Image Acquisition condition of object to be verified Whether preset requirement is met.For example, predeterminable area can be shown on the display screen.It can be limited by predeterminable area to be verified Relative position between object and screen.The size of human face region can reflect object to be verified at a distance from image collecting device And relative angle, such as when detecting face apart from screen from the distant to the near, the human face region of real-time display is by small on the screen Become larger, and so that the human face region size shown on screen is met preset condition when face sufficiently closes to screen, certainly, on screen The human face region of real-time display can also only be sized to meet preset condition under conditions of face sufficiently closes to screen, This is not construed as limiting.Predeterminable area and the second preset ratio can be set as needed, and the present invention limits not to this.
For example, if the human face region of object to be verified is located in predeterminable area, but human face region is in predeterminable area Proportion is less than the second preset ratio (such as 2/3rds), it is likely that is object to be verified relative to image collecting device Be too greatly inclined and/or range image harvester farther out, at this time it is considered that Image Acquisition condition be unsatisfactory for preset requirement.
Illustratively, live body verification method 200 (or 300) can also include:If human face region institute in predeterminable area Accounting example is not more than the second preset ratio, then the second acquisition of output in real time prompt message, to prompt object to be verified and image to adopt Acquisition means are close.
Optionally, the second acquisition prompt message can by one kind in speech form, image format and written form or A variety of outputs.If for example, finding that human face region proportion in predeterminable area is not more than the second preset ratio, can show Such as " please be close to camera " (or " please be close to mobile phone ") this kind of prompt message is shown on screen.
According to embodiments of the present invention, method 200 (or 300) can also include:Real-time judge human face region and predeterminable area Between relative position relation;And third is exported based on the relative position relation between human face region and predeterminable area in real time and is adopted Collect prompt message, the relative position relation between object and image collecting device to be verified is changed so that human face region with prompt It is close with predeterminable area.
For example, when realizing live body verification method and device according to the ... of the embodiment of the present invention on mobile terminals, Ke Yi Real-time display human face region (image block for including face extracted from realtime graphic) and use on the display screen of mobile terminal In the icon (i.e. the predeterminable area of real-time display on the screen) for indicating predeterminable area.Real-time display human face region and for indicating The icon of predeterminable area can facilitate user to know which kind of situation is its current Image Acquisition condition be in, the difference with preset requirement It is much away from having, to facilitate user to adjust itself or image collecting device (or the live body comprising image collecting device verifies device) Posture, to enter subsequent live body Qualify Phase as early as possible.Therefore, real-time display human face region and the figure for indicating predeterminable area Mark can improve user experience, and can improve the efficiency of live body verification.
Further, it is also possible to third acquisition prompt message be exported, to prompt user to change object and image collector to be verified Relative position relation between setting is so that human face region is close with predeterminable area.Optionally, third acquisition prompt message can be with Pass through one or more outputs in speech form, image format and written form.If for example, finding that human face region is not at In predeterminable area, then can show on the display screen such as " please close to circle center " (predeterminable area on the display screen with Circular icon is shown) this kind of prompt message.It is directed toward predeterminable area further, it is also possible to be shown on the display screen from human face region Arrow facilitates user to understand and how to move itself or image collecting device so that human face region enters predeterminable area as early as possible.On One can be shown or select simultaneously and show by stating " please be close to circle center " this kind of text prompt information and this kind of picture cues information of arrow Show.
According to embodiments of the present invention, step S208 may include:Obtain the posture information of image collecting device;And according to Posture information judges whether image collecting device is in vertical placement status, if it is, it is pre- to determine that Image Acquisition condition meets If it is required that otherwise determining that Image Acquisition condition is unsatisfactory for preset requirement.
For example, when live body verification method according to the ... of the embodiment of the present invention is applied to mobile terminal scene, image collector The posture information for setting (i.e. the camera of mobile terminal) can be using the gyro sensor and/or acceleration built in mobile terminal The devices such as sensor measure.When mobile terminal is in vertical placement status, image collecting device is also at vertical state, this In the case of kind, more satisfactory facial image can be collected.Therefore, it can be waited for based on the posture of image collecting device to weigh Whether the Image Acquisition condition of identifying object meets the requirements.
According to embodiments of the present invention, live body verification method 200 (or 300) can also include:Step S210 is being executed every time It is primary to counting during step S220 (or step S310 to step S320), verify number to obtain illumination;In step After S220 (or S320), live body verification method 200 (or 300) can also include:If the expression of illumination live body verification result waits for Identifying object is not belonging to live body, then exports the second error message, and judges whether illumination verification number reaches the second frequency threshold value, If illumination verification number reaches the second frequency threshold value, step S230 (or S330) is gone to, if illumination verification number does not reach To the second frequency threshold value, then return to step S208 or return to step S210 (or S310), wherein the second error message is for prompting For the live body authentication failed of object to be verified.
Similarly with the live body verification step based on action, for live body verification step (Fig. 2 institutes based on reflective character The step S210-S220 or shown in Fig. 3 step S310-S320 shown) for, if it is determined that object to be verified is not belonging to live body, It can equally attempt to re-execute the live body verification step based on reflective character, principle and advantage and the live body based on action Verification step is similar, and details are not described herein again.
It illustratively, can also be since step S208 in the case where live body verification method includes above-mentioned steps S208 It re-executes.
According to embodiments of the present invention, before step S210 (or S310) or in execution step S210 (or S310) and step During S220 (or S320), live body verification method 200 (or 300) can also include:Export the second prompt message, wherein Second prompt message is for prompting object to be verified to be remained stationary as in the second preset time.
Illustratively, the second preset time can be the live body verification step (step shown in Fig. 2 based on reflective character S210-S220 or shown in Fig. 3 step S310-S320) the execution time.It is held in the live body verification step based on reflective character When row, i.e., when irradiating object to be verified using detection light, object to be verified can be prompted to be remained stationary as within this period, in order to avoid Influence image collection effect and live body verification result.Illustratively, if object to be verified movement in the second preset time is led Cause the Image Acquisition condition of object to be verified no longer to meet preset requirement, then it can be with return to step S206 or step S208, again Execute one or more steps in following steps:Judge Image Acquisition condition, the first prompt message of output, the various acquisitions of output Prompt message and etc..
Illustratively, the second prompt message can be count down information corresponding with the second preset time.Optionally, The realization of one or more forms in word, dynamic image and voice may be used in clocking information.Count down information can facilitate User understands authentication progress, and can improve the interactive experience of user.
The 4 a kind of implementation process for describing live body verification method according to the ... of the embodiment of the present invention below in conjunction with the accompanying drawings.Shown in Fig. 4 Application scenarios be mobile terminal.
As shown in figure 4, first, word as " asking face screen " is shown on the display screen of mobile terminal, prompt Face's face screen is shown icon (being indicated with circle) and the base for indicating predeterminable area by user on the display screen In the human face region that realtime graphic detects.When user changes position and/or the posture of itself face, and/or change mobile end It, can word and the figure for indicating predeterminable area as continuously display " asking face screen " when the position at end and/or posture Mark, both information can remain unchanged.However, the size and location of human face region may all change, therefore, can show in real time Show continually changing human face region, user is facilitated to check.Then, when the Image Acquisition condition of object to be verified meets preset requirement When, next stage, i.e. the live body verification step based on reflective character can be entered.
In the implementation procedure of the live body verification step based on reflective character, can show on the display screen " please protect Hold motionless " as word (as shown in the 2nd and 3 width images of Fig. 4), prompt user to remain stationary as, while can also show Count down information is shown on screen.It uses and is indicated in for indicating preset areas in count down information the 3rd width image shown in Fig. 4 Colored progress bar on the icon (i.e. circle) in domain indicates.
After the live body verification step based on reflective character is completed, it can start to execute the live body verification based on action Step.As shown in the 4th width image of Fig. 4, show that word as " please nod ", instruction user execute corresponding on the display screen Action.
Finally, final live body verification result, word as such as " live body is verified " are exported on the display screen.
According to a further aspect of the invention, a kind of live body verification device is provided.Fig. 5 is shown according to an embodiment of the present invention Live body verification device 500 schematic block diagram.
As shown in figure 5, live body verification device 500 according to the ... of the embodiment of the present invention includes light image acquisition module 510, light It is verified determining module 530 according to live body authentication module 520 and live body.The modules can respectively be executed above in conjunction with figure Each step/function of the live body verification method of 2-4 descriptions.Below only to the main of each component of live body verification device 500 Function is described, and omits the detail content having been described above.
Light image acquisition module 510 is used to obtain one acquired for the object to be verified under the irradiation of detection light A or multiple light images.Light image acquisition module 510 can be as shown in Figure 1 electronic equipment in processor 102 run The program instruction that is stored in storage device 104 is realized.
The light that illumination live body authentication module 520 is used to be showed in one or more light images based on object to be verified Reflection characteristic determines whether object to be verified belongs to live body, to obtain illumination live body verification result.Illumination live body authentication module 520 The program instruction that is stored in 102 Running storage device 104 of processor in electronic equipment that can be as shown in Figure 1 is realized.
Live body is verified determining module 530 at least whether determining object to be verified based on illumination live body verification result It is verified by live body.Live body is verified the operation of the processor 102 in the electronic equipment that determining module 530 can be as shown in Figure 1 The program instruction that is stored in storage device 104 is realized.
Those of ordinary skill in the art may realize that lists described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is implemented in hardware or software, depends on the specific application and design constraint of technical solution.Professional technician Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed The scope of the present invention.
Fig. 6 shows the schematic block diagram of live body verification system 600 according to an embodiment of the invention.Live body verification system System 600 includes image collecting device 610, storage device 620, processor 630 and light source 640.
Image collecting device 610 be used for acquire object to be verified image (including light image, motion images and in real time figure Picture).Image collecting device 610 is optional, and it can not include image collecting device 610 that live body, which verifies system 600,.In this feelings Under condition, other image acquisition devices can be utilized for the image of live body verification, and the image of acquisition is sent to live body Verification system 600.
The storage device 620 stores for realizing the corresponding steps in live body verification method according to the ... of the embodiment of the present invention Computer program instructions.
The processor 630 is for running the computer program instructions stored in the storage device 620, to execute basis The corresponding steps of the live body verification method of the embodiment of the present invention, and verify and fill for realizing live body according to the ... of the embodiment of the present invention It sets the light image acquisition module 510 in 500, illumination live body authentication module 520 and live body and is verified determining module 530.
In one embodiment, verify the live body when computer program instructions are run by the processor 630 System 600 executes following steps:Step S110:Obtain one acquired for the object to be verified under the irradiation of detection light Or multiple light images;Step S120:It is showed in one or more of light images based on the object to be verified Reflective character determines whether the object to be verified belongs to live body, to obtain illumination live body verification result;And step S130: At least determine whether the object to be verified is verified by live body based on the illumination live body verification result.
In addition, according to embodiments of the present invention, additionally providing a kind of storage medium, storing program on said storage Instruction, the live body verification method when described program instruction is run by computer or processor for executing the embodiment of the present invention Corresponding steps, and verify the corresponding module in device for realizing live body according to the ... of the embodiment of the present invention.The storage medium Such as may include the storage card of smart phone, the storage unit of tablet computer, the hard disk of personal computer, read-only memory (ROM), Erasable Programmable Read Only Memory EPROM (EPROM), portable compact disc read-only memory (CD-ROM), USB storage, Or the arbitrary combination of above-mentioned storage medium.
In one embodiment, the computer program instructions can to calculate when by computer or processor operation Machine or processor realize each function module of live body verification device according to the ... of the embodiment of the present invention, and/or can execute Live body verification method according to the ... of the embodiment of the present invention.
In one embodiment, the computer program instructions are used to execute following steps at runtime:Step S110:It obtains Take the one or more light images acquired for the object to be verified under the irradiation of detection light;Step S120:Based on institute It states the reflective character that object to be verified is showed in one or more of light images and determines that the object to be verified is It is no to belong to live body, to obtain illumination live body verification result;And step S130:It is true to be at least based on the illumination live body verification result Whether the fixed object to be verified is verified by live body.
Each module in live body verification system according to the ... of the embodiment of the present invention can pass through reality according to the ... of the embodiment of the present invention The processor computer program instructions that store in memory of operation of the electronic equipment of live body verification are applied to realize, or can be with The computer instruction stored in the computer readable storage medium of computer program product according to the ... of the embodiment of the present invention is counted Calculation machine is realized when running.
According to a further aspect of the invention, a kind of live body verification device, including light source, image collecting device, processor are provided And memory, wherein light source is used to emit detection light to object to be verified;Image collecting device exists for acquiring object to be verified One or more light images under the irradiation of detection light;Computer program instructions are stored in memory, computer program refers to For executing following steps when order is run by processor:Step S110:Obtain one or more light images;Step S120:Base Determine whether object to be verified belongs to living in the reflective character that object to be verified is showed in one or more light images Body, to obtain illumination live body verification result;And step S130:Object to be verified is at least determined based on illumination live body verification result Whether verified by live body.
Illustratively, live body verification method 200 or 300 can individual live body verify device on realize.In addition, above-mentioned Live body verification step (step S340-S370) based on action can also be realized on the individual live body verification device.
According to a further aspect of the invention, a kind of live body verification device is provided, including:Light source, for being sent out to object to be verified Penetrate detection light;Image collecting device, for acquiring one or more light images of the object to be verified under the irradiation of detection light; Information carrying means, for one or more light images to be sent to server, and from server receive server by with Under type obtain about object to be verified whether by live body verify verification information:Based on object to be verified at one or more The reflective character showed in a light image determines whether object to be verified belongs to live body, to obtain illumination live body verification knot Fruit, and at least determine whether object to be verified is verified by live body based on illumination live body verification result;Processing unit, for being based on Verification information execution is verified or does not pass through operation.
Illustratively, it live body verification method 200 or 300 can be realized on discrete device, such as in client kimonos It is realized on business device.In this case, client may include light source, image collecting device and information carrying means.Optionally, Client can upload onto the server collected light image, and live body verification is carried out by server.Client receives clothes It is engaged in after the verification information that device is sent, execution is verified or not by operation, such as exports and be verified about live body or do not lead to The information crossed, allows or refusal user executes subsequent business operation, etc..
In addition, client can equally upload onto the server collected motion images, executed based on dynamic by server The live body verification step (such as above-mentioned steps S340-S370) of work, and by server combination illumination live body verification result and action Live body verification result determines whether object to be verified is verified by live body.Required action command can be by client or server It generates.
Illustratively, which can be sent one or more light images by network or other technologies To server, and by network or other technologies verification information is received from server.For example, the network can be internet, WLAN, mobile communications network etc., other technologies are such as may include Bluetooth communication, infrared communication.For example, institute It can be universal server or tailored version server to state server, can be virtual server or Cloud Server etc..Information passes Defeated device may include modem, network adapter, bluetooth transmit and receive unit or infrared transmitting and receiving unit etc., such as It the operations such as can also be encoded, be decoded to the information for sending or receiving.
Due to based on the reflective character of object to be verified determine it is to be verified whether belong to live body and at least be based on illumination Live body verification result determines whether the judgement verified by live body is operated in server completion to object to be verified, therefore can save The computing resource of the processing unit of client, it is possible thereby to reduce the requirement to client performance and the system of live body verification device This is caused, and the experience of user can be promoted.
According to a further aspect of the invention, a kind of live body verification device is provided, including:Light source, for being sent out to object to be verified Penetrate detection light;Image collecting device, for acquiring one or more light images of the object to be verified under the irradiation of detection light; Information carrying means, for one or more light images to be sent to server, and from server receive server by with The illumination live body verification result that under type obtains:The light showed in one or more light images based on object to be verified is anti- It penetrates characteristic and determines whether object to be verified belongs to live body, to obtain illumination live body verification result;Processing unit, for being at least based on Illumination live body verification result determines whether object to be verified is verified by live body.
Illustratively, it live body verification method 200 or 300 can be realized on discrete device, such as in client kimonos It is realized on business device.In this case, client may include light source, image collecting device and information carrying means.Optionally, Client can upload onto the server collected light image, carry out part live body verification by server, i.e., only obtain light According to live body verification result.After client receives the illumination live body verification result of server transmission, it is at least based on illumination live body Verification result determines whether object to be verified is verified by live body.Then, client, which can execute, is verified or does not pass through behaviour Make, such as export and be verified about live body or unsanctioned information, allows or refusal user executes subsequent business operation, etc. Deng.
In addition, client can equally upload onto the server collected motion images, executed based on dynamic by server The live body verification step (such as above-mentioned steps S340-S370) of work, server obtain action live body verification result and are transmitted To client.Client can determine whether object to be verified leads in conjunction with illumination live body verification result and action live body verification result Experience of making a living is demonstrate,proved.Required action command can be generated by client or server.
Illustratively, which can be sent one or more light images by network or other technologies To server, and by network or other technologies illumination live body verification result is received from server.For example, the network can be Internet, WLAN, mobile communications network etc., other technologies are such as may include Bluetooth communication, infrared communication. For example, the server can be universal server or tailored version server, can be virtual server or Cloud Server etc.. Information carrying means may include modem, network adapter, bluetooth transmitting and receiving unit or infrared transmitting and receiving unit Deng, such as the operations such as can also be encoded, be decoded to the information for sending or receiving.
Due to determining that the judgement to be verified for whether belonging to live body is operated in service based on the reflective character of object to be verified Device is completed, therefore can save the computing resource of the processing unit of client, it is possible thereby to reduce the requirement to client performance And the manufacturing cost of live body verification device, and the experience of user can be promoted.
According to a further aspect of the invention, a kind of live body verification device, including information carrying means, processor and storage are provided Device, wherein described information transmitting device is used to receive one or more light images of object to be verified from client, and will close In object to be verified, whether the verification information verified by live body is sent to client, wherein one or more light images are For the acquired acquisition of object to be verified under the irradiation of detection light;It is stored with computer program instructions in memory, counts For executing following steps when calculation machine program instruction is run by processor:Step S110:Obtain one or more light images;Step Rapid S120:Determine that object to be verified is based on the reflective character that object to be verified is showed in one or more light images It is no to belong to live body, to obtain illumination live body verification result;And step S130:At least waited for based on the determination of illumination live body verification result Whether identifying object is verified by live body, to obtain verification information.
As described above, live body verification method 200 or 300 can be realized on discrete device, for example, in client and It is realized on server.The present embodiment describes one kind that at least part of live body verification method 200 or 300 is realized on the server Implementation.
According to a further aspect of the invention, a kind of live body verification device, including information carrying means and processing unit are provided, In, described information transmitting device is used to receive one or more light images of object to be verified from client, and will be about waiting for The judgement information whether identifying object belongs to live body is sent to client, wherein one or more light images are to be directed to examining Survey the acquired acquisition of object to be verified under the irradiation of light;The processing unit is used for based on object to be verified at one or more The reflective character showed in a light image determines whether object to be verified belongs to live body, to obtain illumination live body verification knot Fruit, the illumination live body verification result are used at least determine that object to be verified is based on the illumination live body verification result by client It is no to be verified by live body.
As described above, live body verification method 200 or 300 can be realized on discrete device, for example, in client and It is realized on server.The present embodiment describe live body verification method 200 or 300 at least part realize on the server it is another Kind implementation.
Live body verification method and device according to the ... of the embodiment of the present invention, can effectively defend screen or photo attacker, from And safety and the user experience of identity authorization system or similar system using the live body verification method and device can be improved.
Although describing example embodiment by reference to attached drawing here, it should be understood that the above example embodiment is merely exemplary , and be not intended to limit the scope of the invention to this.Those of ordinary skill in the art can carry out various changes wherein And modification, it is made without departing from the scope of the present invention and spiritual.All such changes and modifications are intended to be included in appended claims Within required the scope of the present invention.
Those of ordinary skill in the art may realize that lists described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is implemented in hardware or software, depends on the specific application and design constraint of technical solution.Professional technician Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed The scope of the present invention.
In several embodiments provided herein, it should be understood that disclosed device and method can pass through it Its mode is realized.For example, apparatus embodiments described above are merely indicative, for example, the division of the unit, only Only a kind of division of logic function, formula that in actual implementation, there may be another division manner, such as multiple units or component can be tied Another equipment is closed or is desirably integrated into, or some features can be ignored or not executed.
In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that the implementation of the present invention Example can be put into practice without these specific details.In some instances, well known method, structure is not been shown in detail And technology, so as not to obscure the understanding of this description.
Similarly, it should be understood that in order to simplify the present invention and help to understand one or more of each inventive aspect, To in the description of exemplary embodiment of the present invention, each feature of the invention be grouped together into sometimes single embodiment, figure, Or in descriptions thereof.However, the method for the present invention should be construed to reflect following intention:It is i.e. claimed The present invention claims the more features of feature than being expressly recited in each claim.More precisely, such as corresponding power As sharp claim reflects, inventive point is that the spy of all features less than some disclosed single embodiment can be used It levies to solve corresponding technical problem.Therefore, it then follows thus claims of specific implementation mode are expressly incorporated in this specific Embodiment, wherein each claim itself is as a separate embodiment of the present invention.
It will be understood to those skilled in the art that other than mutually exclusive between feature, any combinations pair may be used All features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed any method Or all processes or unit of equipment are combined.Unless expressly stated otherwise, this specification (including want by adjoint right Ask, make a summary and attached drawing) disclosed in each feature can be replaced by providing the alternative features of identical, equivalent or similar purpose.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments In included certain features rather than other feature, but the combination of the feature of different embodiments means in of the invention Within the scope of and form different embodiments.For example, in detail in the claims, embodiment claimed it is one of arbitrary It mode can use in any combination.
The all parts embodiment of the present invention can be with hardware realization, or to run on one or more processors Software module realize, or realized with combination thereof.It will be understood by those of skill in the art that can use in practice Microprocessor or digital signal processor (DSP) realize some moulds in live body verification device according to the ... of the embodiment of the present invention The some or all functions of block.The present invention is also implemented as the part or complete for executing method as described herein The program of device (for example, computer program and computer program product) in portion.It is such to realize that the program of the present invention store It on a computer-readable medium, or can be with the form of one or more signal.Such signal can be from internet It downloads and obtains on website, either provide on carrier signal or provide in any other forms.
It should be noted that the present invention will be described rather than limits the invention for above-described embodiment, and ability Field technique personnel can design alternative embodiment without departing from the scope of the appended claims.In the claims, Any reference mark between bracket should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not Element or step listed in the claims.Word "a" or "an" before element does not exclude the presence of multiple such Element.The present invention can be by means of including the hardware of several different elements and being come by means of properly programmed computer real It is existing.In the unit claims listing several devices, several in these devices can be by the same hardware branch To embody.The use of word first, second, and third does not indicate that any sequence.These words can be explained and be run after fame Claim.
The above description is merely a specific embodiment or to the explanation of specific implementation mode, protection of the invention Range is not limited thereto, and any one skilled in the art in the technical scope disclosed by the present invention, can be easily Expect change or replacement, should be covered by the protection scope of the present invention.Protection scope of the present invention should be with claim Subject to protection domain.

Claims (29)

1. a kind of live body verification method, including:
Step S110:Obtain the one or more light images acquired for the object to be verified under the irradiation of detection light;
Step S120:The reflective character showed in one or more of light images based on the object to be verified is true Whether the fixed object to be verified belongs to live body, to obtain illumination live body verification result;And
Step S130:At least determine whether the object to be verified is verified by live body based on the illumination live body verification result.
2. the method for claim 1, wherein during irradiating the object to be verified, the mould of the detection light Formula at least changes once.
3. method as claimed in claim 2, wherein during irradiating the object to be verified, the mould of the detection light Formula at the time of each two is continuous between change.
4. method as claimed in claim 2, wherein during irradiating the object to be verified, the mould of the detection light Formula is changing at random or pre-set.
5. the method for claim 1, wherein the method further includes:
Step S140:Output action instructs, wherein the action command is used to indicate the object to be verified and executes corresponding move Make;
Step S150:Obtain the multiple motion images acquired for the object to be verified;
Step S160:The action performed by the object to be verified is detected based on the multiple motion images;And
Step S170:Determine whether the object to be verified belongs to live body according to motion detection result and the action command, with Obtain action live body verification result;
The step S130 includes:
Determine whether the object to be verified passes through based on the illumination live body verification result and the action live body verification result Live body is verified.
6. method as claimed in claim 5, wherein the step S170 includes:
If detected by described based on the multiple motion images acquired in the period no more than the first preset time The action kept strokes indicated by object to be verified the executes and action command, it is determined that the object category to be verified In live body, if be not detected by described to be tested based on the multiple motion images acquired in first preset time Demonstrate,prove the action kept strokes indicated by object the executes and action command, it is determined that the object to be verified is not belonging to Live body.
7. method as claimed in claim 5, wherein
The method further includes:
It is counted during executing the step S140 to the step S170 every time once, verification number is acted with acquisition;
After the step S170, the method further includes:
If the action live body verification result indicates that the object to be verified is not belonging to live body, the first error message is exported, And judge whether the action verification number reaches the first frequency threshold value, if action verification number reaches the first time Number threshold value, then go to the step S130, if action verification number is not up to first frequency threshold value, returns to institute It states step S140 or returns to the step S110 in the case where the step S110 is executed before the step S140, In, first error message is used to prompt the live body authentication failed for the object to be verified.
8. the method for claim 1, wherein before the step S110, the method further includes:
Step S108:Judge whether the Image Acquisition condition of the object to be verified meets preset requirement, if described image is adopted Collection condition meets the preset requirement, then goes to the step S110, wherein described image acquisition condition includes described to be verified Object is the location of in the image acquisition region of image collecting device and/or the object to be verified is acquired with described image The relative angle of device.
9. method as claimed in claim 8, wherein before the step S108 or with the step S108 simultaneously, institute The method of stating further includes:
Step S106:Export the first prompt message, wherein first prompt message is for prompting the object to be verified by face Portion's face described image harvester and close described image harvester.
10. method as claimed in claim 9, wherein the step S106 includes:Pass through speech form, image format and text One or more outputs first prompt message in font formula.
11. method as claimed in claim 8, wherein the step S108 includes:
Obtain the realtime graphic for the object acquisition to be verified;
Human face region in predeterminable area and the realtime graphic of the output in real time for calibrating described image acquisition condition is used In display;And
Judge whether described image acquisition condition meets the preset requirement according to the human face region,
If the human face region is located in predeterminable area and human face region proportion in the realtime graphic is big In the first preset ratio, it is determined that described image acquisition condition meets the preset requirement,
If the human face region is not in the predeterminable area or human face region institute in the realtime graphic Accounting example is not more than first preset ratio, it is determined that described image acquisition condition is unsatisfactory for the preset requirement.
12. method as claimed in claim 11, wherein the method further includes:
If human face region proportion in the realtime graphic is not more than first preset ratio, export in real time First acquisition prompt message, to prompt the object to be verified and described image harvester close.
13. method as claimed in claim 8, wherein the step S108 includes:
Obtain the realtime graphic for the object acquisition to be verified;
Human face region in predeterminable area and the realtime graphic of the output in real time for calibrating described image acquisition condition is used In display;And
Judge whether described image acquisition condition meets the preset requirement according to the human face region,
If the human face region is located in predeterminable area and human face region proportion in the predeterminable area is big In the second preset ratio, it is determined that described image acquisition condition meets the preset requirement, if the human face region does not have position In in the predeterminable area or human face region proportion in predeterminable area ratio default no more than described second Example, it is determined that described image acquisition condition is unsatisfactory for the preset requirement.
14. method as claimed in claim 13, wherein the method further includes:
If human face region proportion in the predeterminable area is not more than second preset ratio, export in real time Second acquisition prompt message, to prompt the object to be verified and described image harvester close.
15. the method as described in claim 11 or 13, wherein the method further includes:
Relative position relation between human face region described in real-time judge and the predeterminable area;And
Third is exported in real time based on the relative position relation between the human face region and the predeterminable area acquires prompt message, Change the relative position relation between the object to be verified and described image harvester so that the face area with prompt Domain and the predeterminable area are close.
16. method as claimed in claim 8, wherein the step S108 includes:
Obtain the posture information of described image harvester;And
Judge whether described image harvester is in vertical placement status according to the posture information, if it is, determining institute It states Image Acquisition condition and meets the preset requirement, otherwise determine that described image acquisition condition is unsatisfactory for the preset requirement.
17. method as claimed in claim 8, wherein
The method further includes:
It is counted during executing the step S110 to the step S120 every time once, number is verified to obtain illumination;
After the step S120, the method further includes:
If the illumination live body verification result indicates that the object to be verified is not belonging to live body, the second error message is exported, And judge whether the illumination verification number reaches the second frequency threshold value, if illumination verification number reaches described second Number threshold value, then go to the step S130, if illumination verification number is not up to second frequency threshold value, returns to institute It states step S108 or returns to the step S110, wherein second error message is directed to the object to be verified for prompting Live body authentication failed.
18. the method for claim 1, wherein before the step S110 or executing the step S110 and institute During stating step S120, the live body verification method further includes:
Export the second prompt message, wherein second prompt message is for prompting the object to be verified when second is default It is interior to remain stationary as.
19. method as claimed in claim 18, wherein second prompt message is corresponding with second preset time Count down information.
20. the method for claim 1, wherein the detection light is emitted by dynamically changing to the object to be verified Light color and/or position obtain.
21. the method for claim 1, wherein the detection light passes through following by display screen emissions, the detection light Mode obtains:Dynamically change the mould of the light of the display screen emissions by changing the content shown on the display screen Formula, to emit the detection light to the object to be verified.
22. a kind of live body verifies device, including processor and memory, wherein be stored with computer program in the memory Instruction, for executing following steps when the computer program instructions are run by the processor:
Step S110:Obtain the one or more light images acquired for the object to be verified under the irradiation of detection light;
Step S120:The reflective character showed in one or more of light images based on the object to be verified is true Whether the fixed object to be verified belongs to live body, to obtain illumination live body verification result;And
Step S130:At least determine whether the object to be verified is verified by live body based on the illumination live body verification result.
23. a kind of storage medium, stores program instruction on said storage, described program instruction is used to hold at runtime Row following steps:
Step S110:Obtain the one or more light images acquired for the object to be verified under the irradiation of detection light;
Step S120:The reflective character showed in one or more of light images based on the object to be verified is true Whether the fixed object to be verified belongs to live body, to obtain illumination live body verification result;And
Step S130:At least determine whether the object to be verified is verified by live body based on the illumination live body verification result.
24. a kind of live body verifies device, including light source, image collecting device, processor and memory, wherein
The light source is used to emit detection light to object to be verified;
Described image harvester is for acquiring one or more light of the object to be verified under the irradiation of the detection light According to image;
Computer program instructions are stored in the memory, the computer program instructions are used for when being run by the processor Execute following steps:
Step S110:Obtain one or more of light images;
Step S120:The reflective character showed in one or more of light images based on the object to be verified is true Whether the fixed object to be verified belongs to live body, to obtain illumination live body verification result;And
Step S130:At least determine whether the object to be verified is verified by live body based on the illumination live body verification result.
25. a kind of live body verifies device, including:
Light source, for emitting detection light to object to be verified;
Image collecting device, for acquiring one or more illumination patterns of the object to be verified under the irradiation of the detection light Picture;
Information carrying means for one or more of light images to be sent to server, and is received from the server The server obtain in the following manner about the object to be verified whether the verification information verified by live body:It is based on The reflective character that the object to be verified is showed in one or more of light images determines the object to be verified Whether belong to live body, to obtain illumination live body verification result, and is at least waited for based on described in illumination live body verification result determination Whether identifying object is verified by live body;And
Processing unit is verified or does not pass through operation for being based on the verification information execution.
26. a kind of live body verifies device, including information carrying means, processor and memory, wherein
Described information transmitting device is used to receive one or more light images of object to be verified from client, and will be about institute Stating object to be verified, whether the verification information verified by live body is sent to client, wherein one or more of illumination patterns Seem for the acquired acquisition of object to be verified under the irradiation of detection light;
Computer program instructions are stored in the memory, the computer program instructions are used for when being run by the processor Execute following steps:
Step S110:Obtain one or more of light images;
Step S120:The reflective character showed in one or more of light images based on the object to be verified is true Whether the fixed object to be verified belongs to live body, to obtain illumination live body verification result;And
Step S130:At least determine whether the object to be verified is verified by live body based on the illumination live body verification result, To obtain the verification information.
27. a kind of live body verifies device, including:
Light source, for emitting detection light to object to be verified;
Image collecting device, for acquiring one or more illumination patterns of the object to be verified under the irradiation of the detection light Picture;
Information carrying means for one or more of light images to be sent to server, and is received from the server The illumination live body verification result that the server obtains in the following manner:Based on the object to be verified one or more The reflective character showed in a light image determines whether the object to be verified belongs to live body, is tested with obtaining illumination live body Demonstrate,prove result;And
Processing unit, at least determining whether the object to be verified is tested by live body based on the illumination live body verification result Card.
28. a kind of live body verifies device, including information carrying means and processing unit, wherein
Described information transmitting device is used to receive one or more light images of object to be verified from client, and will be about institute It states object to be verified and whether belongs to the judgement information of live body and be sent to client, wherein one or more of light images are For the acquired acquisition of object to be verified under the irradiation of detection light;
The light that the processing unit is used to be showed in one or more of light images based on the object to be verified is anti- It penetrates characteristic and determines whether the object to be verified belongs to live body, to obtain illumination live body verification result, the illumination live body verification As a result it is used at least determine whether the object to be verified is verified by live body based on the illumination live body verification result by client.
29. a kind of live body verifies device, including:
Light image acquisition module, one or more acquired for obtaining the object to be verified being directed under the irradiation of detection light A light image;
Illumination live body authentication module, for what is showed in one or more of light images based on the object to be verified Reflective character determines whether the object to be verified belongs to live body, to obtain illumination live body verification result;And
Live body is verified determining module, at least determining that the object to be verified is based on the illumination live body verification result It is no to be verified by live body.
CN201710218512.9A 2017-03-17 2017-04-05 Living body verification method and apparatus, and storage medium Active CN108629260B (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN2017101622458 2017-03-17
CN2017101616851 2017-03-17
CN201710161685 2017-03-17
CN201710162245 2017-03-17

Publications (2)

Publication Number Publication Date
CN108629260A true CN108629260A (en) 2018-10-09
CN108629260B CN108629260B (en) 2022-02-08

Family

ID=63575988

Family Applications (3)

Application Number Title Priority Date Filing Date
CN202011596232.XA Active CN112651348B (en) 2017-03-17 2017-04-05 Identity authentication method and device and storage medium
CN201710218218.8A Active CN108573203B (en) 2017-03-17 2017-04-05 Identity authentication method and device and storage medium
CN201710218512.9A Active CN108629260B (en) 2017-03-17 2017-04-05 Living body verification method and apparatus, and storage medium

Family Applications Before (2)

Application Number Title Priority Date Filing Date
CN202011596232.XA Active CN112651348B (en) 2017-03-17 2017-04-05 Identity authentication method and device and storage medium
CN201710218218.8A Active CN108573203B (en) 2017-03-17 2017-04-05 Identity authentication method and device and storage medium

Country Status (1)

Country Link
CN (3) CN112651348B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109766849A (en) * 2019-01-15 2019-05-17 深圳市凯广荣科技发展有限公司 A kind of biopsy method, detection device and self-help terminal equipment
CN109993124A (en) * 2019-04-03 2019-07-09 深圳市华付信息技术有限公司 Based on the reflective biopsy method of video, device and computer equipment
CN111046696A (en) * 2018-10-12 2020-04-21 宏碁股份有限公司 Living body identification method and electronic device
CN111723655A (en) * 2020-05-12 2020-09-29 五八有限公司 Face image processing method, device, server, terminal, equipment and medium
US11954940B2 (en) 2019-07-19 2024-04-09 Nec Corporation Method and system for chrominance-based face liveness detection

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10885363B2 (en) * 2018-10-25 2021-01-05 Advanced New Technologies Co., Ltd. Spoof detection using structured light illumination
CN109448193A (en) * 2018-11-16 2019-03-08 广东电网有限责任公司 Identity information recognition methods and device
CN109618100B (en) * 2019-01-15 2020-11-27 北京旷视科技有限公司 Method, device and system for judging field shooting image
CN110135326B (en) * 2019-05-10 2021-10-29 中汇信息技术(上海)有限公司 Identity authentication method, electronic equipment and computer readable storage medium
CN110766033B (en) * 2019-05-21 2021-02-23 北京嘀嘀无限科技发展有限公司 Image processing method, image processing device, electronic equipment and storage medium
CN110443237B (en) * 2019-08-06 2023-06-30 北京旷视科技有限公司 Certificate identification method, device, electronic equipment and computer readable storage medium
CN110705350B (en) * 2019-08-27 2020-08-25 阿里巴巴集团控股有限公司 Certificate identification method and device
US10974537B2 (en) 2019-08-27 2021-04-13 Advanced New Technologies Co., Ltd. Method and apparatus for certificate identification
CN110909264B (en) * 2019-11-29 2023-08-29 北京三快在线科技有限公司 Information processing method, device, equipment and storage medium
CN111523438B (en) * 2020-04-20 2024-02-23 支付宝实验室(新加坡)有限公司 Living body identification method, terminal equipment and electronic equipment
CN111680616A (en) * 2020-06-04 2020-09-18 中国建设银行股份有限公司 Qualification authentication method, device, equipment and medium for subsidy retriever
CN111784498A (en) * 2020-06-22 2020-10-16 北京海益同展信息科技有限公司 Identity authentication method and device, electronic equipment and storage medium

Citations (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001069520A2 (en) * 2000-03-10 2001-09-20 Ethentica, Inc. Biometric sensor
CN1426760A (en) * 2001-12-18 2003-07-02 中国科学院自动化研究所 Identity discriminating method based on living body iris
CN1842296A (en) * 2004-08-03 2006-10-04 松下电器产业株式会社 Living body determination device, authentication device using the device, and living body determination method
CN102262727A (en) * 2011-06-24 2011-11-30 常州锐驰电子科技有限公司 Method for monitoring face image quality at client acquisition terminal in real time
CN102622588A (en) * 2012-03-08 2012-08-01 无锡数字奥森科技有限公司 Dual-certification face anti-counterfeit method and device
CN103310179A (en) * 2012-03-06 2013-09-18 上海骏聿数码科技有限公司 Method and system for optimal attitude detection based on face recognition technology
CN103440479A (en) * 2013-08-29 2013-12-11 湖北微模式科技发展有限公司 Method and system for detecting living body human face
CN104104867A (en) * 2014-04-28 2014-10-15 三星电子(中国)研发中心 Method for controlling image photographing device for photographing and device thereof
CN104184956A (en) * 2014-08-29 2014-12-03 宇龙计算机通信科技(深圳)有限公司 Mobile communication terminal photographing method and system and mobile communication terminal
CN104766063A (en) * 2015-04-08 2015-07-08 宁波大学 Living body human face identifying method
CN104881632A (en) * 2015-04-28 2015-09-02 南京邮电大学 Hyperspectral face recognition method
US20150310259A1 (en) * 2011-07-12 2015-10-29 Microsoft Technology Licensing, Llc Using facial data for device authentication or subject identification
CN105069438A (en) * 2015-08-19 2015-11-18 南昌欧菲生物识别技术有限公司 Manufacturing method for fingerprint detection device
CN105117695A (en) * 2015-08-18 2015-12-02 北京旷视科技有限公司 Living body detecting device and method
CN105389553A (en) * 2015-11-06 2016-03-09 北京汉王智远科技有限公司 Living body detection method and apparatus
CN105518711A (en) * 2015-06-29 2016-04-20 北京旷视科技有限公司 In-vivo detection method, in-vivo detection system, and computer program product
CN105512632A (en) * 2015-12-09 2016-04-20 北京旷视科技有限公司 In vivo detection method and device
CN105518713A (en) * 2015-02-15 2016-04-20 北京旷视科技有限公司 Living human face verification method and system, computer program product
CN105912986A (en) * 2016-04-01 2016-08-31 北京旷视科技有限公司 In vivo detection method, in vivo detection system and computer program product
CN106407914A (en) * 2016-08-31 2017-02-15 北京旷视科技有限公司 Method for detecting human faces, device and remote teller machine system

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006230603A (en) * 2005-02-23 2006-09-07 Canon Inc Imaging apparatus, biometric identification system, and image acquisition method
CN111898108B (en) * 2014-09-03 2024-06-04 创新先进技术有限公司 Identity authentication method, device, terminal and server
CN105989263A (en) * 2015-01-30 2016-10-05 阿里巴巴集团控股有限公司 Method for authenticating identities, method for opening accounts, devices and systems
US9922238B2 (en) * 2015-06-25 2018-03-20 West Virginia University Apparatuses, systems, and methods for confirming identity
CN105518714A (en) * 2015-06-30 2016-04-20 北京旷视科技有限公司 Vivo detection method and equipment, and computer program product
CN105488495A (en) * 2016-01-05 2016-04-13 上海川织金融信息服务有限公司 Identity identification method and system based on combination of face characteristics and device fingerprint
CN105868693A (en) * 2016-03-21 2016-08-17 深圳市商汤科技有限公司 Identity authentication method and system
CN106384237A (en) * 2016-08-31 2017-02-08 北京志光伯元科技有限公司 Member authentication-management method, device and system based on face identification

Patent Citations (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001069520A2 (en) * 2000-03-10 2001-09-20 Ethentica, Inc. Biometric sensor
CN1426760A (en) * 2001-12-18 2003-07-02 中国科学院自动化研究所 Identity discriminating method based on living body iris
CN1842296A (en) * 2004-08-03 2006-10-04 松下电器产业株式会社 Living body determination device, authentication device using the device, and living body determination method
CN102262727A (en) * 2011-06-24 2011-11-30 常州锐驰电子科技有限公司 Method for monitoring face image quality at client acquisition terminal in real time
US20150310259A1 (en) * 2011-07-12 2015-10-29 Microsoft Technology Licensing, Llc Using facial data for device authentication or subject identification
CN103310179A (en) * 2012-03-06 2013-09-18 上海骏聿数码科技有限公司 Method and system for optimal attitude detection based on face recognition technology
CN102622588A (en) * 2012-03-08 2012-08-01 无锡数字奥森科技有限公司 Dual-certification face anti-counterfeit method and device
CN103440479A (en) * 2013-08-29 2013-12-11 湖北微模式科技发展有限公司 Method and system for detecting living body human face
CN104104867A (en) * 2014-04-28 2014-10-15 三星电子(中国)研发中心 Method for controlling image photographing device for photographing and device thereof
CN104184956A (en) * 2014-08-29 2014-12-03 宇龙计算机通信科技(深圳)有限公司 Mobile communication terminal photographing method and system and mobile communication terminal
CN105518713A (en) * 2015-02-15 2016-04-20 北京旷视科技有限公司 Living human face verification method and system, computer program product
CN104766063A (en) * 2015-04-08 2015-07-08 宁波大学 Living body human face identifying method
CN104881632A (en) * 2015-04-28 2015-09-02 南京邮电大学 Hyperspectral face recognition method
CN105518711A (en) * 2015-06-29 2016-04-20 北京旷视科技有限公司 In-vivo detection method, in-vivo detection system, and computer program product
CN105117695A (en) * 2015-08-18 2015-12-02 北京旷视科技有限公司 Living body detecting device and method
CN105069438A (en) * 2015-08-19 2015-11-18 南昌欧菲生物识别技术有限公司 Manufacturing method for fingerprint detection device
CN105389553A (en) * 2015-11-06 2016-03-09 北京汉王智远科技有限公司 Living body detection method and apparatus
CN105512632A (en) * 2015-12-09 2016-04-20 北京旷视科技有限公司 In vivo detection method and device
CN105912986A (en) * 2016-04-01 2016-08-31 北京旷视科技有限公司 In vivo detection method, in vivo detection system and computer program product
CN106407914A (en) * 2016-08-31 2017-02-15 北京旷视科技有限公司 Method for detecting human faces, device and remote teller machine system

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111046696A (en) * 2018-10-12 2020-04-21 宏碁股份有限公司 Living body identification method and electronic device
CN109766849A (en) * 2019-01-15 2019-05-17 深圳市凯广荣科技发展有限公司 A kind of biopsy method, detection device and self-help terminal equipment
CN109766849B (en) * 2019-01-15 2023-06-20 深圳市凯广荣科技发展有限公司 Living body detection method, detection device and self-service terminal equipment
CN109993124A (en) * 2019-04-03 2019-07-09 深圳市华付信息技术有限公司 Based on the reflective biopsy method of video, device and computer equipment
US11954940B2 (en) 2019-07-19 2024-04-09 Nec Corporation Method and system for chrominance-based face liveness detection
CN111723655A (en) * 2020-05-12 2020-09-29 五八有限公司 Face image processing method, device, server, terminal, equipment and medium
CN111723655B (en) * 2020-05-12 2024-03-08 五八有限公司 Face image processing method, device, server, terminal, equipment and medium

Also Published As

Publication number Publication date
CN108573203B (en) 2021-01-26
CN112651348A (en) 2021-04-13
CN108573203A (en) 2018-09-25
CN108629260B (en) 2022-02-08
CN112651348B (en) 2024-04-05

Similar Documents

Publication Publication Date Title
CN108629260A (en) Live body verification method and device and storage medium
CN106407914B (en) Method and device for detecting human face and remote teller machine system
US11757873B2 (en) Biometric methods for online user authentication
CN108804884A (en) Identity authentication method, device and computer storage media
CN108875546A (en) Face auth method, system and storage medium
CN108875473A (en) Living body verification method, device and system and storage medium
CN105117695B (en) In vivo detection equipment and biopsy method
CN104537292B (en) The method and system detected for the electronic deception of biological characteristic validation
KR101393717B1 (en) Facial recognition technology
KR101415287B1 (en) Method, computer-readable storage device and computing device for liveness detercion
CN106529512B (en) Living body faces verification method and device
CN108875452A (en) Face identification method, device, system and computer-readable medium
CN108573202A (en) Identity identifying method, device and system and terminal, server and storage medium
CN107004114A (en) Blood-vessel image filming apparatus and individual authentication system
CN108875338A (en) unlocking method, device and system and storage medium
CN110114777A (en) Use identification, certification and/or the guiding of the user for watching information progress attentively
CN109325460B (en) A kind of face identification method, optical center scaling method and terminal
CN108875468A (en) Biopsy method, In vivo detection system and storage medium
CN109756458A (en) Identity identifying method and system
CN109167922A (en) Image processing method, device and electronic equipment
CN108875476A (en) Automatic near-infrared face registration and recognition methods, device and system and storage medium
CN108140114A (en) Iris recognition
CN110013217A (en) Detection consumes illegal drugs method, apparatus, terminal device and the medium of personnel
CN109543635A (en) Biopsy method, device, system, unlocking method, terminal and storage medium
CN108875508A (en) In vivo detection algorithm update method, device, client, server and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant