CN107341481A - It is identified using structure light image - Google Patents

It is identified using structure light image Download PDF

Info

Publication number
CN107341481A
CN107341481A CN201710566948.7A CN201710566948A CN107341481A CN 107341481 A CN107341481 A CN 107341481A CN 201710566948 A CN201710566948 A CN 201710566948A CN 107341481 A CN107341481 A CN 107341481A
Authority
CN
China
Prior art keywords
image
light image
identification
light
speckle
Prior art date
Application number
CN201710566948.7A
Other languages
Chinese (zh)
Inventor
许星
Original Assignee
深圳奥比中光科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳奥比中光科技有限公司 filed Critical 深圳奥比中光科技有限公司
Priority to CN201710566948.7A priority Critical patent/CN107341481A/en
Publication of CN107341481A publication Critical patent/CN107341481A/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00221Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
    • G06K9/00228Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00201Recognising three-dimensional objects, e.g. using range or tactile information

Abstract

The present invention provides a kind of device being identified using structure light image, including the projection module for emitting structural light image to the region comprising face, the imaging modules for gathering the structure light image comprising face and utilizes structure light image progress Face datection and the process circuit of identification.Here structure light image is infrared speckle image, due to infrared speckle image i.e. remain face 2 d texture information characteristics again it is directly related with three dimensional depth feature, other infrared light is not by external environmental interference, therefore the method for the present invention can with round-the-clock be realized, and face is identified, and can be achieved with accurately identifying without carrying out In vivo detection.

Description

It is identified using structure light image

Technical field

The invention belongs to field of computer technology, is to be related to one kind to be identified using structure light image more specifically Apparatus and method.

Background technology

Human body has many unique features, such as face, fingerprint, iris, human ear etc., and these features are collectively referred to as biological spy Sign.Living things feature recognition is widely used in the various fields such as security protection, household, Intelligent hardware, at present more ripe biological characteristic Identification such as fingerprint recognition, iris recognition etc. have been widely used in the terminals such as mobile phone, computer.And for features such as faces, it is most The related research of pipe is very deep, and the identification for features such as faces is not popularized then yet, and this is primarily due to existing Recognition methods causes the stability of discrimination and identification relatively low in the presence of limitation.These limitations mainly include by ambient light light intensity and Direction of illumination influences, human face expression influences discrimination and is easily cheated by artificial feature etc..

The identification of the features such as existing face, face Two-dimensional Color Image is based primarily upon, can be tight when environmental light intensity is weaker Ghost image rings recognition effect.In addition, when the direction difference of illumination, there can be shade on facial image, equally can also influence to identify Effect.Gathered in the case of referenced facial image is in no expression, and be currently at what is gathered under smile expression Facial image, the effect of recognition of face can also decline.In addition, if identified object is not real human face, but the face of two dimension During picture, it often can also pass through identification.

The problem of for the above, the living things feature recognition based on near-infrared or thermal infrared images is generally used at present, it is near red Outer image will not can be improved identification stability by the interference of ambient light, but but be difficult to solve asking for artificial feature deception Topic;Thermal infrared images is only imaged to real human face, therefore can solve the problems, such as artificial feature deception, but thermal infrared images point Resolution is low, has a strong impact on recognition effect.

Based on described above, still lack a kind of more comprehensive biological characteristic solution at present.

The content of the invention

The present invention is in order to solve the problems, such as to lack in the prior art a kind of comprehensive face recognition scheme, there is provided one kind utilizes The device and method that structure light image is identified.

In order to solve the above problems, the technical solution adopted by the present invention is as described below:

The present invention provides a kind of device being identified using structure light image, it is characterised in that including:Module is projected, is used for The emitting structural light image extremely region comprising face;Imaging modules, for gathering the structure light image for including face;Processing Circuit, Face datection and identification are carried out using the structure light image.

In some embodiments, the structure light image includes infrared speckle image.

In some embodiments, the speckle particle density of the infrared speckle image is arranged to not block the face Main textural characteristics.

In some embodiments, the human face detection and tracing is calculated using the detection based on machine learning and identification Method, the Sample Storehouse that model learning is used in the algorithm are made up of coloured image and/or gray level image.

In some embodiments, described device also includes:Visual light imaging module, it is visible comprising face for gathering Light image;The process circuit carries out Face datection and identification using the structure light image and the visible images.

In some embodiments, it is described to carry out Face datection using the structure light image and identify to include following step Suddenly:Depth image is calculated using the structure light image;Enter pedestrian using the structure light image and the depth image Face detects and identification.

In some embodiments, described device also includes:Thermal infrared imaging module, it is hot red comprising face for gathering Outer image;The process circuit carries out Face datection and identification using the structure light image and the thermal infrared images.

The present invention also provides a kind of method being identified using structure light image, it is characterised in that comprises the following steps: Using projecting the light image of module emitting structural to the region comprising face;The structure of face is included using imaging modules collection Light image;The structure light image is carried out by Face datection and identification by process circuit.

In some embodiments, the structure light image includes infrared speckle image.

In some embodiments, the speckle particle density of the infrared speckle image is arranged to not block the face Main textural characteristics.

Beneficial effects of the present invention are:A kind of device and method being identified using structure light image is provided, passes through profit Face is directly detected and identified with infrared speckle image, because infrared speckle image remains face 2 d texture letter It is again directly related with three dimensional depth feature to cease feature, infrared light is not by external environmental interference, therefore the method for the present invention can in addition With round-the-clock realize and face is identified, can be achieved with accurately identifying without carrying out In vivo detection.

Brief description of the drawings

The recognition of face schematic diagram of a scenario according to an embodiment of the present invention shown in Fig. 1.

Fig. 2 is the structural representation of face identification device according to an embodiment of the invention.

Fig. 3 be it is according to an embodiment of the invention utilize structure light image carry out recognition of face block diagram.

Fig. 4 is according to an embodiment of the invention to utilize structure light image and visible images to carry out recognition of face step Figure.

Fig. 5 is according to an embodiment of the invention to utilize structure light image and depth image to carry out recognition of face step Figure.

Fig. 6 is according to an embodiment of the invention to utilize structure light image and thermal infrared images to carry out recognition of face step Figure.

Fig. 7 is the task executing method block diagram according to embodiments of the present invention based on recognition of face.

Embodiment

In order that technical problem to be solved of the embodiment of the present invention, technical scheme and beneficial effect are more clearly understood, Below in conjunction with drawings and Examples, the present invention will be described in further detail.It should be appreciated that specific implementation described herein Example is not intended to limit the present invention only to explain the present invention.

It should be noted that when element is referred to as " being fixed on " or " being arranged at " another element, it can be directly another On one element or it is connected on another element.When an element is known as " being connected to " another element, it can To be directly to another element or be indirectly connected on another element.In addition, connection can be used to fix Effect can also be used to circuit communication act on.

It is to be appreciated that term " length ", " width ", " on ", " under ", "front", "rear", "left", "right", " vertical ", The orientation or position relationship of the instruction such as " level ", " top ", " bottom " " interior ", " outer " are to be closed based on orientation shown in the drawings or position System, it is for only for ease of and describes the embodiment of the present invention and simplify description, rather than the device or element of instruction or hint meaning must There must be specific orientation, with specific azimuth configuration and operation, therefore be not considered as limiting the invention.

In addition, term " first ", " second " are only used for describing purpose, and it is not intended that instruction or hint relative importance Or the implicit quantity for indicating indicated technical characteristic.Thus, define " first ", the feature of " second " can be expressed or Implicitly include one or more this feature.In the description of the embodiment of the present invention, " multiple " are meant that two or two More than, unless otherwise specifically defined.

The invention provides a kind of devices and methods therefor that living things feature recognition is carried out using structure light image.Following Will be so that face characteristic identifies as an example in elaboration.

Face recognition technology can be used for safety check, monitoring, now with the popularization of intelligent terminal such as mobile phone, flat board, Face recognition technology can also be applied to unlock, pay, or even many aspects such as amusement game.Intelligent terminal, such as hand Machine, flat board, computer, TV etc. are provided with color camera greatly, after image of the color camera collection comprising face, utilize this Image carries out Face datection and identification, so as to further perform other related applications using the result of identification.However, for picture For the mobile terminal devices such as mobile phone, flat board, its application environment usually changes, and environmental change can influence the imaging of color camera, Such as light it is weaker when face can not be then imaged well.On the other hand, color camera None- identified is identified object Whether it is real human face.

The present invention will provide a kind of face that can distinguish truth from false also not by the face identification method and dress of ambient light interference Put.

The recognition of face schematic diagram of a scenario according to an embodiment of the present invention shown in Fig. 1.User 10 holds recognition of face Device 11(Mobile terminal, such as mobile phone, flat board), the inside of mobile terminal 11 preposition a projection module 111 and imaging mould Group 112, when the user oriented head of mobile terminal 11 and after have activated recognition of face task, projection module 111 is thrown to user face Penetrate structure light image(Such as speckle image 12), imaging modules 112, which are used to gather, includes the image of face, also includes in image scattered Spot image 12.Process circuit (not marked in figure) is also configured with inside terminal 11, for realizing to containing speckle image 12 The processing of facial image.For face identification system, process circuit, which generally requires, performs following task:Image preprocessing, face Detection, face segmentation, feature extraction, recognition of face and task of correlation is performed according to recognition result, such as unblock, payment Deng.The process circuit can be single special processor or multiple processor groups into, required execution task with The form of software algorithm, which is written in process circuit, to be performed.Process circuit can also perform corresponding appoint according to current application Business, such as the application for needing depth image, then it can perform the task of depth calculation.

In certain embodiments, face identification device 11 can also be fixed terminal device, such as computer, TV, machine Top box, game machine, safety check gate etc..

In certain embodiments, face identification device 11 can also be separated multiple devices composition, such as by camera (Include projection module 111 and imaging modules 112)And computing device composition, connected between camera and computing device to pass Transmission of data, connected mode include wired and wireless connection.Usually, camera is used for obtaining the structure light image of face, image The corresponding task that further performed by the process circuit in computing device is transferred to after computing device by network connection.Can be with Understand, on camera some process circuits can also be set to carry out executable portion task.

Fig. 2 is the structural representation of face identification device according to an embodiment of the invention.Projection module 111 includes light Source, lens and structure light maker(Such as diffraction optical element DOE), it is collimated by or focuses on after source emissioning light beam, then Outwards launch speckle image 12 after DOE beam splitting.Usually, light source is near-infrared laser, for example, edge-emitting laser or VCSEL lasers, sightless speckle image 12 can outwards be launched using near-infrared laser, thus will not to it is artificial into regarding Feel interference, on the other hand, near-infrared laser is easily gathered by infrared imaging module 112.It is understood that light source can use Any suitable wavelength, it is without limitations herein.

Projection module 111 is connected with imaging modules 112 with the mainboard 115 in face identification device 11, is additionally useful for performing The processor 113 of calculating task is connected also by mainboard with projection module and imaging modules 112.

In one embodiment, the Visible Light Camera for obtaining texture image is also provided in face identification device 11 114, such as RGB camera, gray scale camera etc..Visible Light Camera 114 can also be combined into one with imaging modules 112, that is, be imaged Imaging sensor (such as CMOS, CCD) each Pixel surface inside module 112 is respectively provided for the optical filtering that different wave length passes through Piece, to gather structure light image and visible images respectively.

In one embodiment, the thermal infrared for obtaining target thermal infrared images is also provided in face identification device 11 Camera 114.

Fig. 3 be it is according to an embodiment of the invention utilize structure light image carry out recognition of face block diagram.Including following Step.

In step 301, by projecting the projective structure light into the area of space comprising face of module 111, such as speckle 12.

In step 302, the speckle image for including face is gathered using imaging modules 112.

In step 303, according to the speckle image collected, the human face region image in speckle image is detected.

In step 304, recognition of face is carried out based on detected human face region image.

In step 303, the step of Face datection is based on directly on speckle image, and this is due to speckle image and other Structure light image(Such as phase fringes, binary-coding)Compare, most information of face are all retained, and change an angle To say, speckle image is equal to visible ray gray level image and adds some noises, therefore when carrying out Face datection, in one embodiment First speckle image can be pre-processed, for example noise remove etc. is carried out using morphological images processing method.For striped, The structure light images such as binary-coding, when being projected to face, the face information more than half will be blocked by structure light image, and It is blocked partially due to area is larger and continuously lead to not recover by image algorithm, and speckle image is although be covered in face On, but because speckle particle is smaller, and discontinuously, larger distortion will not be caused to face texture.

Recognition of face task typically has face authentication to be identified with face, and face authentication refers to known current face and is present in face In database, the task of face authentication is to identify that whom the face is;Face identification refer to do not know current face whether there is in In face database, face identification task be to judge, output exist with the absence of result.But either any side Formula, recognition of face inherently comprise the steps of:Feature extraction and characteristic matching.By based on detecting in step 304 Human face region image carries out recognition of face, main to include carrying out feature extraction to human face region speckle image, further utilizes Feature carries out recognition of face.

Fig. 4 is according to an embodiment of the invention to utilize structure light image and visible images to carry out recognition of face step Figure.Comprise the following steps.

In step 401, by projecting the projective structure light into the area of space comprising face of module 111, such as speckle 12.

In step 402, the speckle image for including face is gathered using imaging modules 112.

In step 403, the visible images for including face are gathered using Visible Light Camera 114.

In step 404, according to the speckle image and visible images collected, speckle image and visible images are detected In human face region image.

In step 405, recognition of face is carried out based on detected human face region image.

Wherein, step 402 can be carried out synchronously with step 403, for example control imaging modules 112 and visible ray by controller Camera 114 synchronizes collection.Visible images can be coloured image, such as RGB image or gray level image, this In visible images refer to reflecting face textural characteristics and do not include the image of structure optical information.When projection module projection And during visible ray, in order to be had an impact when preventing structure light from being gathered to visible images, step 402 should stagger with step 403 Carry out, its sequencing can arbitrarily be set.

When carrying out human face region detection in step 404, pedestrian can be entered to speckle image and visible images respectively Face is detected, and only wherein piece image can also be detected, with reference to the relative position relation of two cameras so as to directly obtaining Human face region on another piece image, relative position relation are needed by being demarcated in advance.Usually, it is seen that the people of light image Face detection tech more mature and reliable, therefore in one embodiment, by carrying out human face region detection to visible images, its The secondary relative position relation according to testing result and two cameras obtains the human face region on speckle image.

In step 405, recognition of face can be carried out merely with the human face region image in speckle image, can also combined Human face region image in visible images, to improve the accuracy of identification.

Fig. 5 is according to an embodiment of the invention to utilize structure light image and depth image to carry out recognition of face step Figure.Comprise the following steps.

In step 501, by projecting the projective structure light into the area of space comprising face of module 111, such as speckle 12.

In step 502, the speckle image for including face is gathered using imaging modules 112.

In step 503, corresponding depth image is calculated using speckle image.

In step 504, according to obtained speckle image and depth image, speckle image and the people in depth image are detected Face area image.

In step 505, recognition of face is carried out based on detected human face region image.

In step 503, depth image corresponding to speckle image can be calculated based on structure light trigonometry, specifically, Speckle image is carried out to the deviation value of each pixel of matching primitives acquisition with reference speckle image, because deviation value is direct with depth Correlation, therefore depth value can be calculated according to deviation value.

When carrying out human face region detection in step 504, due to speckle image with depth image be it is one-to-one, therefore Only need to detect wherein piece image, usually, image segmentation is carried out in depth image to extract human face region more For convenience, therefore in one embodiment, it is secondly direct according to testing result by carrying out human face region detection to depth image Obtain the human face region on speckle image.

In step 505, recognition of face can be carried out merely with the human face region image in speckle image, can also combined Human face region image in depth image, to improve the accuracy of identification.Using depth image another advantage is that, can sentence Whether disconnected face is stereoscopic face, to prevent the possibility that can also be identified using planar picture, improves the peace of recognition of face Quan Xing.If it should be noted that when carrying out three-dimensional detection using depth image, can not then be utilized to depth image in step 504 Image split realize human face region extract.

Fig. 6 is according to an embodiment of the invention to utilize structure light image and thermal infrared images to carry out recognition of face step Figure.Comprise the following steps.

In step 601, by projecting the projective structure light into the area of space comprising face of module 111, such as speckle 12.

In step 602, the speckle image for including face is gathered using imaging modules 112.

In step 603, the thermal infrared images for including face is gathered using thermal infrared camera 114.

In step 604, according to obtained speckle image and thermal infrared images, detect in speckle image and depth image Human face region image.

In step 605, recognition of face is carried out based on detected human face region image.

When carrying out human face region detection in step 604, first thermal infrared images can be detected, due to thermal infrared figure As unique imaging characteristic, it can easily recognise that there is face according to thermal infrared images, or whether be real human face. When detecting real human face, then into step 605, if not detecting face, or detect when being false face, then need not enter Enter the identification step to face.Therefore, thermal infrared images assume responsibility for the task of In vivo detection herein.

In step 605, recognition of face can be carried out merely with the human face region image in speckle image, can also combined Human face region image in thermal infrared images, to improve the accuracy of identification.

Above in several recognition of face embodiments, process substantially is only described, it is to be understood that by above mistake The equivalent substitution of one or more of journey step, adjustment will be also dropped into protection scope of the present invention.Next to wherein The Face datection that is related to, recognition of face are introduced.

Face datection.The main purpose of Face datection is detected in image with the presence or absence of the position where face and face Put, Face datection algorithm mainly includes knowledge based rule, invariant features, template matches and statistical model totally four class method. In the step of various embodiments above, it is related to speckle image, visible images, thermal infrared images and depth image, for Different images carry out that during Face datection institute suitable algorithm should be selected.For example for visible images, it can use based on constant Feature (such as colour of skin feature)Face datection algorithm;And for depth image, due to reflection be face three-dimensional information, because This, is more applicable using the method matched based on three-dimensional template;For thermal infrared images, threshold can be easily passed through in general pattern Value distinguishes face, therefore can carry out Face datection according to knowledge rule (threshold value);, can essentially for speckle image Regard as and some noises are added on ordinary gamma image, when carrying out Face datection, a kind of method is will by image procossing Speckle carries out Face datection after being eliminated as much as, another scheme is directly to carry out Face datection using speckle image.

Because facial image is often influenceed to cause picture quality relatively low by different degrees of extraneous factor, now it is based on The Face datection algorithm of statistical model can provide more accurate testing result.Say from the statistical significance, Face datection problem It is a grader problem, i.e., the pixel on image is only possible to be two kinds of situations, and one kind is face, and one kind is not face.Than As Adaboost algorithm has been demonstrated there is very high verification and measurement ratio in terms of Face datection.

Face datection algorithm is varied, the method for the above by way of example only, any suitable algorithm can by with To carry out Face datection.

Recognition of face.Detect after facial image, it is necessary to the facial image be identified, face recognition algorithms mainly have Using the method based on outward appearance of overall textural characteristics, subspace method, neural network and based on shape and texture based on Method of model etc..Can select different methods for different images, for example, for depth image preferably by based on The face identification method of model.For visible images, earliest face identification method is the algorithm based on geometric properties, the calculation Method is sub by extracting images to be recognized and the feature in template image, then calculates the similarity between two kinds of feature, than Such as similarity is weighed to realize recognition of face using minimum distance metric.Any suitable algorithm can be used into pedestrian Face identifies.

Carrying out Face datection and recognition of face constantly, thermal infrared images is but warm although possessing the function of vivo identification Infrared camera cost is higher, and thermal infrared images can influence with many factors such as identified person's moods in addition, cause merely with heat The effect that infrared image carries out recognition of face is undesirable.And when carrying out human face detection and tracing using visible images, on the one hand Influenceed seriously by illumination etc., another aspect visible images are held due to the two-dimensional signal for being only capable of reflecting identified person's face It is easily caused the hidden danger that can be also identified when by the use of the two dimensional image of identified person as identified object.Carried out using depth image During human face detection and tracing, vivo identification can be easily carried out, it is less yet with the feature of depth image, carrying out face Difficulty is larger when identification feature compares.

The 2 d texture information of most faces is contained on speckle image, the speckle on image is then directly and people in addition The three-dimensional information of face is related, therefore not only can be very good to carry out human face detection and tracing using the speckle image of face, may be used also To determine whether live body.It should be noted that live body mentioned here judges that not individually carrying out an In vivo detection appoints Business, but the identification phase effectively reduced when measurand is non-three-dimensional real human body can be had using speckle image by saying Like degree.As an example it is assumed that current recognition of face task be judge current identified face whether with the people that is stored in system Whether face is same face, the standard speckle image of testee's real human face is saved in memory first, then to quilt Tester's face gathers current speckle image, finally carries out similarity identification to current speckle image and standard speckle image, from And determine whether same face.If it is apparent that when gathering current speckle image, collected object is real human face, similar The result of degree identification will be displayed as same face;If collected object is false when including testee's face two dimension photograph, Although there is testee's face identical 2 d texture information in the speckle image collected, but the speckle on speckle image Reflection is plane information rather than steric information, therefore causes final similarity identification result to be non-same face.

Coloured image, gray level image, depth can be used for based on any by carrying out human face detection and tracing using speckle image The detection of image and recognizer, in some algorithms based on machine learning, the Sample Storehouse for study is preferably by multiple The speckle image composition of face, can also be made up of coloured image, gray level image or depth image in certain embodiments. It fact proved, when speckle image is identified the model that the Sample Storehouse being made up of coloured image learns, can be good at Avoid the wrong identification as caused by false 2-dimentional photo.

The density of speckle particle influences whether the performance of recognition of face in speckle image, will be blocked if speckle image is overstocked More face texture informations, if speckle image is excessively sparse and can cause three-dimensional feature information that it is reflected very little.Therefore The density of speckle image should be controlled in rational scope, i.e., will not block the main texture information of face too much(Such as eye Eyeball, nose, face etc.)The three-dimensional feature of face can relatively accurately be reflected again.In certain embodiments, projection module is set The speckle image of a variety of density can be projected by being set to, and when carrying out human face detection and tracing, then project low-density speckle image, when When needing to carry out 3-D scanning task, then high density speckle image is projected out.In certain embodiments, projection module can project Go out a variety of density and can meet the speckle image for not blocking the main texture information of face, the relatively low speckle image of density is used for people When face identifies, recognition speed is fast, but accuracy of identification is low, and then recognition speed is slow for the higher speckle image of density, but accuracy of identification It is high.

In the face identification method corresponding to Fig. 4 ~ Fig. 6 or the recognition of face of the speckle image progress using different densities In method, it is all based on what two kinds or more different images were identified, such be advantageous in that goes for more Scene and raising discrimination.When two kinds or more of image is identified, typically there are two kinds of identification integration methods, Yi Zhongshi Fusion based on decision-making, i.e., various images are identified respectively, then merged recognition result to obtain final knowledge Other result;Another kind is data fusion, image that will be two kinds or more directly as face identification system input, in face During recognizer, foundation of the feature all as final result on various images.

Human face detection and tracing can be used in multiple-task, such as the unblock of smart machine, payment etc..Usually, The execution of task includes three steps:Mission-enabling, recognition of face and tasks carrying.

In certain embodiments, because the safe class of different tasks is different, if the task for different safety class It is clearly irrational using same face recognition scheme, for the relatively low task of safe class, for example unlock, can use Relatively simple, quick face recognition scheme;And for the higher task of safe class, for example pay, then it is suitable using more Complicated, accurate face recognition scheme.

Fig. 7 is the task executing method block diagram according to embodiments of the present invention based on recognition of face.Comprise the following steps:

In step 701, current task is activated.Activation can be carried out by various ways, such as button, inertia measurement equipment (IMU) Deng.In one embodiment, task is that mobile device is locked to equipment opening by resting state solution, and activating the task can be by some Button performs, such as home keys, on & off switch, volume key etc., can also pick up shifting by the IMU device of inside, such as user The mobile corresponding acceleration of generation is obtained dynamic equipment by IMU device rapidly(Such as user picks up mobile device from a certain place and drawn The acceleration risen), current task is activated when acceleration reaches a certain threshold value.In one embodiment, task is payment task, Activate the task directly can be performed by the virtual push button on related software, it is to be appreciated that the method for activating task can By by other it is any it is suitable in a manner of.

In step 702, the safe class of current identification mission is judged.The peace to current task is needed after activation task Congruent level is judged.In one embodiment, various possible tasks are pre-set with corresponding safe class, for example unblock is appointed Be engaged in for safe class 1, software open task be safe class 2, payment task be safe class 3, safe class is higher to be meaned The privacy of current task is higher, higher to the accuracy requirement of recognition of face.After activation, current task is pacified The judgement of congruent level.

In step 703, face identification method corresponding with safe class is performed.Describe 4 kinds of faces altogether in Fig. 3 ~ Fig. 6 Recognition methods, the hardware and software algorithm that different recognition methods need are different, in one embodiment, if current face identifies dress Above method can be performed by putting, and above method is classified according to the accuracy of algorithm, and by accuracy to difference Method is classified and matched with safe class.The step in, phase is performed according to the safe class that is obtained in previous step The face identification method answered, for example for the minimum unblock task of level of security, perform face identification method as shown in Figure 3. In certain embodiments, it is close come the task for different level of securitys, speckle image by projecting the speckle image of different densities Level of security corresponding to degree is higher is also higher.It is understood that it is more than any two and different-effect face identification method It can be used in the present invention with corresponding different safe class.

In step 704, corresponding task is performed according to face recognition result.For example for unlocking task, work as recognition of face As a result when the object for showing to preserve in identified object and system is same people, performs corresponding instruct and unlocked.It can manage Solution, recognition result, which generally comprises front and negative results, different results, should perform different tasks, or does not perform and appoint What task.In certain embodiments, the result of recognition of face is except determining whether same people or belonging in standard personage storehouse The situation such as a member outside, should also include the position of face and/or the distance recognized, only when the position of face and/or distance reach To can just perform corresponding task during preset value.

Different face identification devices does not cause face identification method that it can realize also not due to the difference of hardware configuration Together, therefore in the above description, the face identification method performed by different safety class also can difference.Safe class Quantity and the quantity of face identification method are also not necessarily the same, it is to be understood that the explanation scope of the claimed of the above will not Limited to by this.In addition, even if identical hardware configuration, different recognizers can also be set with corresponding different safety etc. Level.

It is classified in the present embodiment with the safety of system application, it is to be understood that other any classifications are all wrapped Containing within the scope of the invention.

The device that face is identified above can also be used in the identification of other human body biological characteristics with scheme, In some embodiments, human ear can be identified using structure light image and further perform corresponding task.It will be situated between below Continue a kind of call task that mobile terminal is performed using ear recognition.

Human ear is also that can distinguish the biological characteristic of identity, in some applications, especially for mobile communication terminal It is finally that terminal is performed into call task close to ear for call task, in existing method, when terminal caller, Call needs to answer by keys or buttons, but terminal is conversed close in one's ear.One will be provided in the present invention More easily answering method is planted, i.e., when a call comes, is answered without carrying out keys or buttons, but directly by terminal close to people Ear, and judge whether to answer by the identification to human ear.

When mobile communication terminal has incoming call, that is, activation call task is performed, and pop instruction indicates whether to answer. In one embodiment, the safe class of the task of call is arranged to higher, i.e., the only owner of terminal or the one or two people specified can To answer;In some embodiments, it is also possible to which the safe class of the task of call is arranged into low, i.e., owner can answer.

Next, perform human ear identification method corresponding with safe class.The safety that can be answered for only one or two people Grade, terminal constantly perform the detection to current human ear and protected with identifying and judging whether to belong to during close to human ear One in the not individual ear of the people deposited, if i.e. task is answered in execution, if otherwise performing rejection task.For owner all The safe class that can be answered, terminal perform the detection and identification to human ear, and determine whether during close to human ear Human ear, if i.e. task is answered in execution.

In one embodiment, the detection to face or human ear also includes face or human ear with identification relative to identification terminal Position or distance etc. identification, i.e., not only to identify face or human ear, it is also necessary to judge whether face or human ear are in conjunction Behind suitable position, then perform the task of next step.In one embodiment, just open to answer when human ear sufficiently closes to terminal and appoint Business, such as, this distance could be arranged within 5cm.

Using the identification to human ear except call task can be performed, other changes to the SOT state of termination are can also carry out, For example current state is to carry out the state put outside sound using loudspeaker, when terminal close to human ear and it is identified after by terminal shape State become by receiver send sound only close to when the state that can just hear.

Above content is to combine specific preferred embodiment further description made for the present invention, it is impossible to is assert The specific implementation of the present invention is confined to these explanations.For those skilled in the art, do not taking off On the premise of from present inventive concept, some equivalent substitutes or obvious modification can also be made, and performance or purposes are identical, all should When being considered as belonging to protection scope of the present invention.

Claims (10)

  1. A kind of 1. device being identified using structure light image, it is characterised in that including:Module is projected, for emitting structural The light image extremely region comprising face;Imaging modules, for gathering the structure light image for including face;Process circuit, Face datection and identification are carried out using the structure light image.
  2. 2. device according to claim 1, it is characterised in that the structure light image includes infrared speckle image.
  3. 3. device according to claim 2, it is characterised in that the speckle particle density of the infrared speckle image is set Not block the main textural characteristics of the face.
  4. 4. device according to claim 1, it is characterised in that the human face detection and tracing is to utilize to be based on machine learning Detection and recognizer, the Sample Storehouse that model learning is used in the algorithm be made up of coloured image and/or gray level image.
  5. 5. device according to claim 1, it is characterised in that also include:Visual light imaging module, included for gathering The visible images of face;The process circuit carries out face inspection using the structure light image and the visible images Survey and identify.
  6. 6. device according to claim 1, it is characterised in that it is described using the structure light image carry out Face datection and Identification comprises the following steps:Depth image is calculated using the structure light image;Utilize the structure light image and institute State depth image and carry out Face datection and identification.
  7. 7. device according to claim 1, it is characterised in that also include:Thermal infrared imaging module, included for gathering The thermal infrared images of face;
    The process circuit carries out Face datection and identification using the structure light image and the thermal infrared images.
  8. A kind of 8. method being identified using structure light image, it is characterised in that comprise the following steps:Using projecting module The emitting structural light image extremely region comprising face;The structure light image of face is included using imaging modules collection;It is logical Cross process circuit and the structure light image is subjected to Face datection and identification.
  9. 9. according to the method for claim 8, it is characterised in that the structure light image includes infrared speckle image.
  10. 10. according to the method for claim 9, it is characterised in that the speckle particle density of the infrared speckle image is set It is set to the main textural characteristics for not blocking the face.
CN201710566948.7A 2017-07-12 2017-07-12 It is identified using structure light image CN107341481A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710566948.7A CN107341481A (en) 2017-07-12 2017-07-12 It is identified using structure light image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710566948.7A CN107341481A (en) 2017-07-12 2017-07-12 It is identified using structure light image

Publications (1)

Publication Number Publication Date
CN107341481A true CN107341481A (en) 2017-11-10

Family

ID=60219737

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710566948.7A CN107341481A (en) 2017-07-12 2017-07-12 It is identified using structure light image

Country Status (1)

Country Link
CN (1) CN107341481A (en)

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107992811A (en) * 2017-11-27 2018-05-04 北京小米移动软件有限公司 Face identification method and device
CN108304828A (en) * 2018-03-08 2018-07-20 西安知微传感技术有限公司 A kind of three-dimensional living body faces identification device and method
CN108347516A (en) * 2018-01-16 2018-07-31 宁波金晟芯影像技术有限公司 A kind of face identification system and method for 3D identifications
CN108549867A (en) * 2018-04-12 2018-09-18 Oppo广东移动通信有限公司 Image processing method, device, computer readable storage medium and electronic equipment
CN108564032A (en) * 2018-04-12 2018-09-21 Oppo广东移动通信有限公司 Image processing method, device, electronic equipment and computer readable storage medium
CN108573170A (en) * 2018-04-12 2018-09-25 Oppo广东移动通信有限公司 Information processing method and device, electronic equipment, computer readable storage medium
CN108683902A (en) * 2018-03-31 2018-10-19 深圳奥比中光科技有限公司 Target image obtains System and method for
CN108875544A (en) * 2018-04-11 2018-11-23 北京旷视科技有限公司 Face identification method, device, system and storage medium
CN108924421A (en) * 2018-07-16 2018-11-30 Oppo广东移动通信有限公司 Image processing method, device, computer readable storage medium and electronic equipment
CN108965849A (en) * 2018-07-27 2018-12-07 北京小米移动软件有限公司 Image processing method, apparatus and system
CN109274864A (en) * 2018-09-05 2019-01-25 深圳奥比中光科技有限公司 Depth camera, depth calculation System and method for
CN109499010A (en) * 2018-12-21 2019-03-22 苏州雷泰医疗科技有限公司 Based on infrared and radiotherapy auxiliary system and its method of visible light three-dimensional reconstruction
CN109583304A (en) * 2018-10-23 2019-04-05 宁波盈芯信息科技有限公司 A kind of quick 3D face point cloud generation method and device based on structure optical mode group
CN109753925A (en) * 2018-12-29 2019-05-14 深圳三人行在线科技有限公司 A kind of method and apparatus that iris feature extracts
CN109948399A (en) * 2017-12-20 2019-06-28 宁波盈芯信息科技有限公司 A kind of the face method of payment and device of smart phone
CN110110582A (en) * 2019-03-14 2019-08-09 广州市金其利信息科技有限公司 In conjunction with the face identification method and system of 3D structure light, infrared light and visible light
CN110191266A (en) * 2018-04-28 2019-08-30 Oppo广东移动通信有限公司 Data processing method, device, electronic equipment and computer readable storage medium
WO2019196683A1 (en) * 2018-04-12 2019-10-17 Oppo广东移动通信有限公司 Method and device for image processing, computer-readable storage medium, and electronic device
WO2019200574A1 (en) * 2018-04-18 2019-10-24 深圳阜时科技有限公司 Identity authentication method, identity authentication device, and electronic apparatus
WO2019206129A1 (en) * 2018-04-28 2019-10-31 Oppo广东移动通信有限公司 Data processing method, apparatus, electronic device, and computer-readable storage medium
CN110852310A (en) * 2020-01-14 2020-02-28 长沙小钴科技有限公司 Three-dimensional face recognition method and device, terminal equipment and computer readable medium
WO2020052283A1 (en) * 2018-09-10 2020-03-19 Oppo广东移动通信有限公司 Electronic apparatus, and control method and control apparatus therefor, and computer-readable storage medium
US10771689B2 (en) 2018-04-28 2020-09-08 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and device, computer-readable storage medium and electronic device
EP3621294A4 (en) * 2018-07-16 2020-09-30 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method and device for image processing, computer readable storage medium and electronic device
EP3624006A4 (en) * 2018-04-28 2020-11-18 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method, apparatus, computer-readable storage medium, and electronic device
EP3671551A4 (en) * 2018-08-01 2020-12-30 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Data processing method and apparatus, computer-readable storage medium and electronic device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102622591A (en) * 2012-01-12 2012-08-01 北京理工大学 3D (three-dimensional) human posture capturing and simulating system
CN104077576A (en) * 2014-07-03 2014-10-01 南昌欧菲生物识别技术有限公司 Fingerprint recognition method and terminal device having fingerprint recognition function
CN105513221A (en) * 2015-12-30 2016-04-20 四川川大智胜软件股份有限公司 ATM (Automatic Teller Machine) cheat-proof device and system based on three-dimensional human face identification

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102622591A (en) * 2012-01-12 2012-08-01 北京理工大学 3D (three-dimensional) human posture capturing and simulating system
CN104077576A (en) * 2014-07-03 2014-10-01 南昌欧菲生物识别技术有限公司 Fingerprint recognition method and terminal device having fingerprint recognition function
CN105513221A (en) * 2015-12-30 2016-04-20 四川川大智胜软件股份有限公司 ATM (Automatic Teller Machine) cheat-proof device and system based on three-dimensional human face identification

Cited By (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107992811A (en) * 2017-11-27 2018-05-04 北京小米移动软件有限公司 Face identification method and device
CN109948399A (en) * 2017-12-20 2019-06-28 宁波盈芯信息科技有限公司 A kind of the face method of payment and device of smart phone
CN108347516A (en) * 2018-01-16 2018-07-31 宁波金晟芯影像技术有限公司 A kind of face identification system and method for 3D identifications
CN108304828A (en) * 2018-03-08 2018-07-20 西安知微传感技术有限公司 A kind of three-dimensional living body faces identification device and method
CN108683902A (en) * 2018-03-31 2018-10-19 深圳奥比中光科技有限公司 Target image obtains System and method for
WO2019184184A1 (en) * 2018-03-31 2019-10-03 深圳奥比中光科技有限公司 Target image acquisition system and method
CN108875544A (en) * 2018-04-11 2018-11-23 北京旷视科技有限公司 Face identification method, device, system and storage medium
CN108549867B (en) * 2018-04-12 2019-12-20 Oppo广东移动通信有限公司 Image processing method, image processing device, computer-readable storage medium and electronic equipment
CN108573170A (en) * 2018-04-12 2018-09-25 Oppo广东移动通信有限公司 Information processing method and device, electronic equipment, computer readable storage medium
CN108564032A (en) * 2018-04-12 2018-09-21 Oppo广东移动通信有限公司 Image processing method, device, electronic equipment and computer readable storage medium
EP3654243A4 (en) * 2018-04-12 2020-11-25 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method and device for image processing, computer-readable storage medium, and electronic device
CN108573170B (en) * 2018-04-12 2020-06-12 Oppo广东移动通信有限公司 Information processing method and device, electronic equipment and computer readable storage medium
CN108549867A (en) * 2018-04-12 2018-09-18 Oppo广东移动通信有限公司 Image processing method, device, computer readable storage medium and electronic equipment
WO2019196683A1 (en) * 2018-04-12 2019-10-17 Oppo广东移动通信有限公司 Method and device for image processing, computer-readable storage medium, and electronic device
WO2019200574A1 (en) * 2018-04-18 2019-10-24 深圳阜时科技有限公司 Identity authentication method, identity authentication device, and electronic apparatus
WO2019206129A1 (en) * 2018-04-28 2019-10-31 Oppo广东移动通信有限公司 Data processing method, apparatus, electronic device, and computer-readable storage medium
CN110191266A (en) * 2018-04-28 2019-08-30 Oppo广东移动通信有限公司 Data processing method, device, electronic equipment and computer readable storage medium
EP3624006A4 (en) * 2018-04-28 2020-11-18 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method, apparatus, computer-readable storage medium, and electronic device
US10771689B2 (en) 2018-04-28 2020-09-08 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and device, computer-readable storage medium and electronic device
CN108924421B (en) * 2018-07-16 2020-09-11 Oppo广东移动通信有限公司 Image processing method, image processing device, computer-readable storage medium and electronic equipment
EP3621294A4 (en) * 2018-07-16 2020-09-30 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method and device for image processing, computer readable storage medium and electronic device
CN108924421A (en) * 2018-07-16 2018-11-30 Oppo广东移动通信有限公司 Image processing method, device, computer readable storage medium and electronic equipment
CN108965849A (en) * 2018-07-27 2018-12-07 北京小米移动软件有限公司 Image processing method, apparatus and system
EP3671551A4 (en) * 2018-08-01 2020-12-30 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Data processing method and apparatus, computer-readable storage medium and electronic device
CN109274864A (en) * 2018-09-05 2019-01-25 深圳奥比中光科技有限公司 Depth camera, depth calculation System and method for
WO2020052283A1 (en) * 2018-09-10 2020-03-19 Oppo广东移动通信有限公司 Electronic apparatus, and control method and control apparatus therefor, and computer-readable storage medium
CN109583304A (en) * 2018-10-23 2019-04-05 宁波盈芯信息科技有限公司 A kind of quick 3D face point cloud generation method and device based on structure optical mode group
CN109499010A (en) * 2018-12-21 2019-03-22 苏州雷泰医疗科技有限公司 Based on infrared and radiotherapy auxiliary system and its method of visible light three-dimensional reconstruction
CN109753925A (en) * 2018-12-29 2019-05-14 深圳三人行在线科技有限公司 A kind of method and apparatus that iris feature extracts
CN110110582A (en) * 2019-03-14 2019-08-09 广州市金其利信息科技有限公司 In conjunction with the face identification method and system of 3D structure light, infrared light and visible light
CN110852310A (en) * 2020-01-14 2020-02-28 长沙小钴科技有限公司 Three-dimensional face recognition method and device, terminal equipment and computer readable medium

Similar Documents

Publication Publication Date Title
US9767358B2 (en) Systems and methods for performing iris identification and verification using mobile devices
US10095927B2 (en) Quality metrics for biometric authentication
CN105023010B (en) A kind of human face in-vivo detection method and system
CN106204815B (en) A kind of access control system based on human face detection and recognition
KR20180102637A (en) Systems and methods of biometric analysis
US9971920B2 (en) Spoof detection for biometric authentication
KR101393717B1 (en) Facial recognition technology
CN103106401B (en) Mobile terminal iris recognition device with human-computer interaction mechanism
Wilder et al. Comparison of visible and infra-red imagery for face recognition
KR101720957B1 (en) 4d photographing apparatus checking finger vein and fingerprint at the same time
Wang et al. Near-and far-infrared imaging for vein pattern biometrics
CN102414698B (en) To the controlled access of the function of wireless device
US9652663B2 (en) Using facial data for device authentication or subject identification
US7881524B2 (en) Information processing apparatus and information processing method
KR20180022019A (en) Method and apparatus for liveness test
JP5010905B2 (en) Face recognition device
CN101964056B (en) Bimodal face authentication method with living body detection function and system
JP4679121B2 (en) Human identification device and method using infrared rays
CN101763671B (en) System for monitoring persons by using cameras
US9934436B2 (en) System and method for 3D iris recognition
US8666121B2 (en) Vein authentication device which verifies a target that is compared to the extracted piece of vein information of a finger
CN100454329C (en) Photographed body authenticating device,method and program, face authenticating device, portable telephone
CN104935893B (en) Monitor method and apparatus
CN105574518B (en) Method and device for detecting living human face
EP1134691B1 (en) Image processing apparatus and method for extracting feature of faces

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 518057 11-13 / F, joint headquarters building, high tech Zone, No.63 Xuefu Road, Yuehai street, Nanshan District, Shenzhen City, Guangdong Province

Applicant after: Obi Zhongguang Technology Group Co., Ltd

Address before: 518057 11-13 / F, joint headquarters building, high tech Zone, No.63 Xuefu Road, Yuehai street, Nanshan District, Shenzhen City, Guangdong Province

Applicant before: SHENZHEN ORBBEC Co.,Ltd.