CN110337656A - For the optical sensor of recognition of face, device, method and electronic equipment - Google Patents

For the optical sensor of recognition of face, device, method and electronic equipment Download PDF

Info

Publication number
CN110337656A
CN110337656A CN201980000833.9A CN201980000833A CN110337656A CN 110337656 A CN110337656 A CN 110337656A CN 201980000833 A CN201980000833 A CN 201980000833A CN 110337656 A CN110337656 A CN 110337656A
Authority
CN
China
Prior art keywords
face
facial image
pixel
optical signal
pixel unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201980000833.9A
Other languages
Chinese (zh)
Inventor
吴勇辉
潘雷雷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Goodix Technology Co Ltd
Original Assignee
Shenzhen Huiding Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Huiding Technology Co Ltd filed Critical Shenzhen Huiding Technology Co Ltd
Publication of CN110337656A publication Critical patent/CN110337656A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/166Detection; Localisation; Normalisation using acquisition arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/40Spoof detection, e.g. liveness detection
    • G06V40/45Detection of the body part being alive

Abstract

It is a kind of for the optical sensor of recognition of face, device, method and electronic equipment, it is able to ascend the safety of recognition of face, this is used for the optical sensor of recognition of face, it include: pixel array, the first pixel unit set in the pixel array is for receiving the reflected light signal reflected by least two optical signals that light source successively emits from face, and at least two facial images are obtained according to the reflected light signal, wherein, at least two optical signal corresponds to different wavelength bands, and at least two facial image is for determining the true and false of the face.

Description

For the optical sensor of recognition of face, device, method and electronic equipment
Technical field
This application involves technical field of face recognition, and pass more particularly, to a kind of optics for recognition of face Sensor, device, method and electronic equipment.
Background technique
Safe and convenient and fast user experience is brought to user using the electronic equipment of face recognition technology still to pass through The human face data of the forgeries such as user picture (for example, printing or electronics) or made 3D face mold is face A security risk in identification application.Therefore, how to identify true and false face, with promoted the safety of recognition of face be one urgently Problem to be solved.
Summary of the invention
The embodiment of the present application provides a kind of for the optical sensor of recognition of face, device, method and electronic equipment, energy Identify the true and false of face, enough so as to promote the safety of recognition of face.
In a first aspect, providing a kind of optical sensor for recognition of face, comprising:
Pixel array, the first pixel unit set in the pixel array are successively emitted at least for receiving by light source The reflected light signal that two kinds of optical signals are reflected from face, and at least two facial images are obtained according to the reflected light signal, In, at least two optical signal corresponds to different wavelength bands, and at least two facial image is for determining the face It is true and false.
In some possible implementations, at least two optical signal include the first optical signal, the second optical signal and Third optical signal, wherein first optical signal corresponds to first band range, and second optical signal corresponds to second band model It encloses, the third optical signal corresponds to third wavelength band, the first band range, the second band range and the third Wavelength band is different two-by-two;At least two facial image includes the first facial image, the second facial image and third face Image, respectively corresponds first optical signal, second optical signal and the third optical signal, first facial image, Second facial image and the third facial image are for determining the true and false of the face.
In some possible implementations, the first band range, the second band range and the third wave One of respectively following three kinds of wavelength bands of segment limit: the wavelength band including 560nm, the wavelength band including 980nm, Wavelength band including 940nm.
In some possible implementations, the pixel unit in the first pixel unit set is not provided with optical filter.
In some possible implementations, other in the pixel array in addition to the first pixel unit set Pixel unit is not provided with optical filter, or the optical filter of setting specific band range.
In some possible implementations, the optical filter of the specific band range be include 940nm wavelength band Optical filter.
In some possible implementations, the first pixel unit set includes the part picture in the pixel array Plain unit.
In some possible implementations, the quantity of the pixel unit in the first pixel unit set and the picture The ratio of the total quantity of pixel unit in pixel array is less than the first ratio.
In some possible implementations, pixel unit in the first pixel unit set is discrete be distributed in it is described In pixel array.
In some possible implementations, the quantity of continuous pixel unit is less than in the first pixel unit set Or it is equal to specific threshold.
In some possible implementations, the first pixel unit set includes whole pictures in the pixel array Plain unit.
In some possible implementations, other in the pixel array in addition to the first pixel unit set The facial image of pixel unit acquisition is used for recognition of face.
Second aspect provides a kind of device for recognition of face, comprising:
Such as the optical sensor of the recognition of face in first aspect to second aspect and its any possible implementation;
Light source, for successively emitting at least two optical signals, at least two optical signal corresponds to different wavelength bands;
Wherein, the first pixel unit set of the optical sensor be used to receive the light source successively emits it is described extremely The reflected light signal that few two kinds of optical signals are reflected from face, and at least two facial images are obtained according to the reflected light signal, At least two facial image is for determining the true and false of the face.
In some possible implementations, the light source is specifically used for:
Successively emit the first optical signal, the second optical signal and third optical signal to the face, wherein the first light letter Number corresponding first band range, second optical signal correspond to second band range, and the third optical signal corresponds to third wave band Range, the first band range, the second band range and the third wavelength band are different two-by-two.
In some possible implementations, the light source is a light source, the optical signal that the light source can emit Wavelength band includes the first band range, the second band range and third wavelength band.
In some possible implementations, the light source includes the first sub-light source, the second sub-light source and third sub-light source, It is respectively used to emit the first band range, the optical signal of the second band range and the third wavelength band.
In some possible implementations, described device further include:
Light source control module successively emits first optical signal to the face for controlling the light source, and described Two optical signals and the third optical signal.
In some possible implementations, the optical sensor is specifically used for:
First optical signal, the second optical signal and third optical signal are successively received by the first pixel unit set The reflected light signal reflected respectively from the face, and the first facial image is obtained according to the reflected light signal respectively, second Facial image and third facial image.
In some possible implementations, described device further include:
Processor, for according to first facial image, second facial image and the third facial image to be true Determine the true and false of the face.
In some possible implementations, the processor is also used to:
According to calibration parameter, to first facial image, second facial image and the third facial image into Row calibration;
According to first facial image after calibration, second facial image and the third facial image determine institute State the true and false of face.
In some possible implementations, the processor is also used to:
According to references object to the first band range, the light of the second band range and the third wavelength band Relationship between the response of spectrum determines the calibration parameter.In some possible implementations, the optical sensor is also used In:
Successively emit the first band range, the second band range and institute to the references object in the light source When stating the optical signal of third wavelength band, three width images of the references object are acquired respectively;
The processor is also used to:
According to the relationship of the pixel value of the three width image, determine the calibration parameter, the calibration parameter be used for so that The pixel value of the three width image is in same range.
In some possible implementations, the processor is also used to:
According to first facial image after calibration, second facial image and the third facial image are closed At obtaining colorized face images, wherein each pixel in the colorized face images includes the face to the first wave Three response pixel values of the spectrum of segment limit, the second band range and the third wavelength band;
The colorized face images are subjected to feature extraction, obtain the characteristic information of the colorized face images;
According to the characteristic information of the colorized face images, the true and false of the face is determined.
In some possible implementations, the processor is specifically used for:
According to sampled pixel values of the first pixel unit in the first pixel unit set in first facial image, Determine the corresponding first response pixel value of the first pixel in the colorized face images, wherein the first response pixel value Indicate response of the face to the spectrum of the first band range, first pixel corresponds to first pixel unit;
According to sampled pixel values of the first pixel unit in the first pixel unit set in second facial image, Determine the corresponding second response pixel value of first pixel, wherein the second response pixel value indicates the face to institute State the response of the spectrum of second band range;And
According to sampled pixel values of the first pixel unit in the first pixel unit set in the third facial image, Determine the corresponding third response pixel value of first pixel, wherein the third response pixel value indicates the face to institute State the response of the spectrum of third wavelength band.
In some possible implementations, the processor is specifically used for:
It is handled by characteristic information of the deep learning network to the colorized face images, determines the true of the face It is false.
In some possible implementations, the processor is also used to:
According to the face of other pixel units acquisition in the pixel array in addition to the first pixel unit set Image carries out recognition of face.
In some possible implementations, the processor is specifically used for:
By the face figure of other pixel units acquisition in the pixel array in addition to the first pixel unit set As being matched with the facial image template of registration, determine whether recognition of face succeeds.
In some possible implementations, the processor is also used to:
The case where in the facial image and the facial image template matching registered and the face is real human face Under, determine recognition of face success.
The third aspect provides a kind of method for recognition of face, which comprises
When light source successively emits at least two optical signals, successively connect by the first pixel unit set of optical sensor The reflected light signal that at least two optical signal is reflected from the face is received, and obtains at least two according to the reflected light signal A facial image, wherein at least two optical signal corresponds to different wavelength bands;
The true and false of the face is determined according at least two facial image.
In some possible implementations, the light source successively emits at least two optical signals to face, comprising:
The light source successively emits the first optical signal, the second optical signal and third optical signal to the face, wherein described First optical signal corresponds to first band range, and second optical signal corresponds to second band range, and the third optical signal is corresponding Third wavelength band.
In some possible implementations, the first band range, the second band range and the third wave Segment limit is respectively one of following three kinds of wavelength bands:
Wavelength band including 560nm, the wavelength band including 980nm, the wavelength band including 940nm.
In some possible implementations, the light source is a light source, the optical signal that the light source can emit Wavelength band includes the first band range, the second band range and third wavelength band.
In some possible implementations, the light source includes the first sub-light source, the second sub-light source and third sub-light source, It is respectively used to emit the first band range, the optical signal of the second band range and the third wavelength band.
In some possible implementations, the method also includes:
It controls the light source and successively emits first optical signal, second optical signal and the third to the face Optical signal.
It is described that institute is successively received by the first pixel unit set of optical sensor in some possible implementations The reflected light signal that at least two optical signals are reflected from the face is stated, and at least two people are obtained according to the reflected light signal Face image, comprising:
First optical signal, the second optical signal are successively received by the pixel unit in the first pixel unit set The reflected light signal reflected respectively from the face with third optical signal, and obtained respectively according to the reflected light signal the first Face image, the second facial image and third facial image.
In some possible implementations, the method also includes:
According to first facial image, second facial image and the third facial image determine the face It is true and false.
It is described according to first facial image, second facial image and institute in some possible implementations It states third facial image and determines the true and false of the face, comprising:
According to calibration parameter, to first facial image, second facial image and the third facial image into Row calibration;
According to first facial image after calibration, second facial image and the third facial image are determined The face it is true and false.
In some possible implementations, the method also includes:
According to references object to the first band range, the light of the second band range and the third wavelength band Relationship between the response of spectrum determines the calibration parameter.
In some possible implementations, it is described according to references object to the first band range, second wave Relationship between segment limit and the response of the spectrum of the third wavelength band, determines the calibration parameter, comprising:
Successively emit the first band range, the second band range and institute to the references object in the light source When stating the optical signal of third wavelength band, the reference is acquired by the pixel unit in the first pixel unit set respectively Three width images of object;
According to the relationship of the pixel value of the three width image, determine the calibration parameter, the calibration parameter be used for so that The pixel value of the three width image is in same range.
In some possible implementations, first facial image according to after calibration, second face Image and the third facial image, determine the true and false of the face, comprising:
According to first facial image after calibration, second facial image and the third facial image are closed At obtaining colorized face images, wherein each pixel in the colorized face images includes the face to the first wave Three response pixel values of the spectrum of segment limit, the second band range and the third wavelength band;
The colorized face images are subjected to feature extraction, obtain the characteristic information of the colorized face images;
According to the characteristic information of the colorized face images, the true and false of the face is determined.
In some possible implementations, first facial image according to after calibration, second face Image and the third facial image are synthesized, and colorized face images are obtained, comprising:
According to sampled pixel values of the first pixel unit in the first pixel unit set in first facial image, Determine the corresponding first response pixel value of the first pixel in the colorized face images, wherein the first response pixel value Indicate response of the face to the spectrum of the first band range, first pixel corresponds to first pixel unit;
According to sampled pixel values of the first pixel unit in the first pixel unit set in second facial image, Determine the corresponding second response pixel value of first pixel, wherein the second response pixel value indicates the face to institute State the response of the spectrum of second band range;And
According to sampled pixel values of the first pixel unit in the first pixel unit set in the third facial image, Determine the corresponding third response pixel value of first pixel, wherein the third response pixel value indicates the face to institute State the response of the spectrum of third wavelength band.
In some possible implementations, the characteristic information according to the colorized face images determines the people Face it is true and false, comprising:
It is handled by characteristic information of the deep learning network to the colorized face images, determines the true of the face It is false.
In some possible implementations, the method also includes:
According to the face of other pixel units acquisition in the pixel array in addition to the first pixel unit set Image carries out recognition of face.
In some possible implementations, it is described according in the pixel array remove the first pixel unit set with The facial image of outer other pixel units acquisition carries out recognition of face, comprising:
By the face figure of other pixel units acquisition in the pixel array in addition to the first pixel unit set As being matched with the facial image template of registration, determine whether recognition of face succeeds.
In some possible implementations, it is described by the pixel array in addition to the first pixel unit set Other pixel units acquisition facial image matched with the facial image template of registration, determine recognition of face whether at Function, comprising:
In the facial image and the facial image template matching registered and in the case that the face is real human face, really Determine recognition of face success.
Fourth aspect provides a kind of electronic equipment, including such as second aspect to second aspect and its any possible reality The device for recognition of face in existing mode.
5th aspect, provides a kind of computer-readable medium, for storing computer program, the computer program packet It includes for executing the instruction in the above-mentioned third aspect and its any possible implementation.
6th aspect, provides a kind of computer program product including instruction, when computer runs the computer journey When the described instruction of sequence product, the computer execute in the above-mentioned third aspect and its any possible implementation for people Face knows method for distinguishing.
Specifically, which can run on the electronic equipment of above-mentioned fourth aspect.
Based on the above-mentioned technical proposal, the optical signal that at least two wavelength bands are successively emitted by light source, is passed by optics Sensor, which carries out multi collect, can obtain at least two spectral responses of target to be identified, may further based on this at least two Spectral response carries out vivo identification, is conducive to the safety for promoting recognition of face.
Detailed description of the invention
Fig. 1 is the reflection spectrum curve of human skin.
Fig. 2 is the schematic diagram according to the optical sensor for recognition of face of the embodiment of the present application.
Fig. 3 is the schematic diagram according to the device for recognition of face of the embodiment of the present application.
Fig. 4 is the schematic flow chart according to the method for recognition of face of the embodiment of the present application.
Fig. 5 is the overall flow figure according to the method for recognition of face of the embodiment of the present application.
Fig. 6 is the schematic block diagram according to the electronic equipment of the embodiment of the present application.
Specific embodiment
Below in conjunction with attached drawing, technical solutions in the embodiments of the present application is described.
It should be understood that the embodiment of the present application can be applied to various face identification systems, the application scenarios common as one kind, Face identification system provided by the embodiments of the present application can be applied in the mobile terminals such as smart phone, tablet computer and door lock, door Access control system or other electronic equipments.
In traditional face identification system, active false proof is by the way of interaction, for example, being become using blink or expression Modes, this modes such as change usually require a few frame images of continuous acquisition, reduce recognition speed.
Usually, by the shadow of the factors such as the skin thickness of human skin tissue, hemoglobin concentration, melanin content It ringing, human skin tissue has certain particularity to the light reflecting properties of specific band range, as shown in Figure 1, human body Skin is in the wavelength band of 560nm or so, and the wavelength band of 980nm is with special spectral response, this special spectrum sound It should be not present on the spectral response curve of the artificial materials such as paper, mold.
Accordingly, this application provides a kind of methods of face active false proof, can acquire target to be identified to multiple specific The response of the spectrum of wavelength band is based further on the spectral response and carries out active false proof, is conducive to promote recognition speed, simultaneously The safety of recognition of face can also be promoted.
It it should be understood that the target to be identified in the embodiment of the present application can be face, or may be other portions of human body Position, such as finger, palm, the embodiment of the present application are not construed as limiting this.
Fig. 2 is a kind of schematic diagram of optical sensor 20 for recognition of face provided by the embodiments of the present application, The optical sensor 20 includes:
Pixel array 200, the first pixel unit set 21 in the pixel array are successively emitted for receiving by light source The reflected light signal that is reflected from face of at least two optical signals, and at least two face figures are obtained according to the reflected light signal Picture, wherein at least two optical signal corresponds to different wavelength bands, and at least two facial image is for described in determination Face it is true and false.
In the embodiment of the present application, it does not need to make pixel array special design, it only need to be based at least two different waves The optical signal of segment limit, response of the target to be identified to the spectrum of at least two wavelength bands can be obtained by carrying out multi collect, Vivo identification may further be carried out based on the response of at least two spectrum, be conducive to the safety for promoting recognition of face.
In the embodiment of the present application, the wavelength band of the light source can be specially designed, optional real as one Existing mode, can design the wavelength band of the light source according to the reflection spectrum curve of human skin, for example, designing the light The wavelength band of wavelength band or other visible-ranges or 980nm or so that the wavelength band in source is 560nm or so, or Person may be the wavelength band of recognition of face performance preferably infrared band range, such as 940nm or so, alternatively, can also be with According to the other biological feature of living body, suitable wavelength band is selected, as long as there can be apparent discrimination with prosthese.
It should be understood that in this embodiment, at least two facial image can be in the pixel array of optical sensor The acquisition of whole pixel units, or the partial pixel unit acquisition that is also possible in pixel array, that is to say, that can be with Vivo identification is done using entire pixel array, or only can also do vivo identification using partial pixel unit, latter is realized Mode advantageously reduces the power consumption of mould group, improves acquisition speed and recognition speed.
When doing vivo identification using the partial pixel unit of the pixel array, described first is removed in the pixel array The facial image of other pixel units acquisition except pixel unit set is used for recognition of face, for example, can will it is described other The facial image of pixel unit acquisition is matched with the facial image template of registration, it is determined whether successful match, i.e., described the The facial image of pixel unit acquisition in one pixel unit set can be used for active false proof, remove institute in the pixel array Stating other pixel units except the first pixel unit set can be used for recognition of face, to determine the facial image and note of acquisition Whether the facial image template of volume matches.
When doing vivo identification using the partial pixel unit of the pixel array, sensor drive module can close institute Other pixel units in pixel array in addition to the first pixel unit set are stated, so as to reduce the power consumption of mould group, Promote acquisition speed and recognition speed.
Optionally, described when the first pixel unit set includes the partial pixel unit in the pixel array The ratio of the total quantity of the quantity and pixel unit in the pixel array of pixel unit in first pixel unit set is small In the first ratio, such as 5%, to avoid recognition of face performance is influenced.
Optionally, pixel unit in the first pixel unit set is discrete to be distributed in the pixel array.It can Guarantee that vivo identification function does not influence recognition of face performance.
Optionally, in the embodiment of the present application, continuous pixel unit in the first pixel unit set can be set Quantity be less than or equal to specific threshold, for example, 6, pass through continuous pixel list in setting the first pixel unit set The number of member is less than certain threshold value, and can be avoided influences recognition of face performance.
As one embodiment, the pixel unit in the first pixel unit set can be not provided with optical filter, for example, Transparent processing, or setting transparent material are done, advantageously ensures that the first pixel unit set can collect the light source The optical signal of the wavelength band of transmitting.In other embodiments, the pixel unit in the first pixel unit set can also be with The optical filter of specific band is set, for example, for filtering out the stray light for influencing recognition of face and vivo identification.
Optionally, other pixel units in the pixel array in addition to the first pixel unit set are not provided with filtering Mating plate, or the optical filter of setting specific band range, for example, optical filter, such as 940nm of infrared band or so wavelength band Optical filter.
Optionally, in some embodiments, at least two optical signal includes the first optical signal, the second optical signal and the Two optical signals, wherein first optical signal corresponds to first band range, and second optical signal corresponds to second band range, The third optical signal corresponds to third wavelength band, the first band range, the second band range and the third wave Segment limit is different two-by-two, and the first pixel unit set 21 is specifically used for:
When the light source successively emits first optical signal, second optical signal and the third optical signal, according to Reflected light letter secondary to receive first optical signal, that second optical signal and the third optical signal are reflected from the face Number, and respectively corresponded according to the reflected light signal and obtain the first facial image, the second facial image and third facial image, In, first facial image, second facial image and third facial image for determining the true and false of face, i.e., these three Facial image may be used as vivo identification.
Optionally, in the application one embodiment, the first band range, the second band range and described Three wavelength bands are respectively one of following three kinds of wavelength bands:
Wavelength band including 560nm, the wavelength band including 980nm, the wavelength band including 940nm.
Optionally, in other embodiments, above three wavelength band can be determined in visible light wave range, described first Wavelength band, the second band range and the third wavelength band can be respectively red spectral band, blue wave band and green light One kind of wave band.For example, it is 440nm~475nm that the wavelength band of blue light, which can be center wave band, upper cut-off wave band is about 550nm;It is 520nm~550nm that the wavelength band of green light, which can be center wave band, and upper cut-off wave band is about 620nm, lower cut-off wave Duan Yuewei 460nm;It is about 550nm that the wavelength band of feux rouges, which can be lower cut-off wave band,.
Therefore, in the embodiment of the present application, photoelectric sensor can carry out face based on the optical signal of three kinds of wavelength bands The acquisition of image, so that response of the face to the spectrum of three kinds of wavelength bands is obtained, it may further be based on three kinds of spectrum Response carries out vivo identification, is conducive to the safety for promoting recognition of face.
Fig. 3 is according to the schematic diagram of the device for recognition of face of the embodiment of the present application, as shown in figure 3, should Device 30 may include: light source 31, and for successively emitting at least two optical signals, at least two optical signal corresponds to different Wavelength band;
First pixel unit set of optical sensor 32, the optical sensor 32 is successively sent out for receiving the light source The reflected light signal that at least two optical signal penetrated is reflected from face, and at least two are obtained according to the reflected light signal Facial image, at least two facial image is for determining the true and false of the face.
It should be understood that the optical sensor 32 can correspond to the optical sensor 20 in embodiment illustrated in fig. 2, it is specific real The associated description of previous embodiment can be now referred to, which is not described herein again.
Optionally, in some embodiments, at least two optical signal may include the first optical signal, the second optical signal With third optical signal, first optical signal corresponds to first band range, and second optical signal corresponds to second band range, institute It states third optical signal and corresponds to third wavelength band.Wherein, the first band range, the second band range and the third Wavelength band realizes the associated description that can refer to previous embodiment, and which is not described herein again.
Optionally, in some embodiments, the light source 31 is a light source, the optical signal that the light source 31 can emit Wavelength band include the first band range, the second band range and the third wavelength band.It is three kinds i.e. above-mentioned Optical signal is emitted by same light source, for example, it can be made to emit the light of different-waveband range by controlling the frequency of light source Signal.
Optionally, in other embodiments, the light source 31 be include the first sub-light source, the second sub-light source and third sub-light The combination of light sources in source, wherein first sub-light source, second sub-light source and the third sub-light source are respectively used to transmitting institute First band range, the optical signal of the second band range and the third wavelength band are stated, i.e., above-mentioned three kinds of optical signals are Emitted by different light sources, each light source can be used for emitting the optical signal of a wavelength band.
Optionally, in the application one embodiment, described device 30 further include:
Light source control module successively emits first optical signal to the face for controlling the light source 31, described Second optical signal and the third optical signal.
For example, the light source control module can control the light source 31 and successively emit if the light source 31 is a light source The optical signal of different-waveband range, alternatively, the light source control module can control described if the light source includes multiple light sources Multiple light sources successively shine, to emit the optical signal of different-waveband range.
Optionally, light source 31 can be the built-in light source of described device 30, or be also possible to the external of described device 30 Light source, or the light source in the electronic equipment that described device 30 is installed can also be multiplexed to emit the light letter for vivo identification Number, in this case, described device 30 can not include the light source 31, the embodiment of the present application is not construed as limiting this.
Optionally, in one embodiment, the optical sensor 32 is specifically used for:
When the light source 31 successively emits the first optical signal, the second optical signal and third optical signal to the face, lead to It crosses the first pixel unit set and successively receives first optical signal, the second optical signal and third optical signal are respectively from described The reflected light signal of face reflection, and the first facial image is obtained according to the reflected light signal respectively, the second facial image and Third facial image.
Optionally, in some embodiments, described device 30 can also include:
Processor 33, for according to first facial image, second facial image and the third facial image Determine the true and false of the face.
It should be understood that if the first pixel unit set only includes the partial pixel unit of pixel array, it is described the first Face image, second facial image and the third facial image can be local facial image, if first picture Plain unit set includes whole pixel units of pixel array, first facial image, second facial image and described Third facial image can be complete facial image.
Wherein, first facial image is response of people's face to the spectrum of first band range, the second face figure As being response of the face to the spectrum of the second band range, the third facial image is the face to third wave band model The response of the spectrum enclosed.Since the face has special needs to three kinds of spectrum, based on the response of three kinds of spectrum, The true and false of face can effectively be distinguished.
It, can be according to a spectral response in the response of above-mentioned three kinds of spectrum, really as an optional implementation Determine the true and false of face, is adopted in this way, the optical signal that can also only use a wavelength band in man face image acquiring carries out face Collection, is based further on a spectral response and does vivo identification.
But artificial material (such as paper) may be with living person to the wave band model to the response of the spectrum of some wavelength band The response of the spectrum enclosed, which exists, to partly overlap, if the response of the spectrum based on the wavelength band carries out vivo identification, may lead Cause misrecognition.In the embodiment of the present application, target to be identified can be acquired by the first pixel unit set for multiple wave bands The response of the spectrum of range, the response of the spectrum of multiple wavelength band may include the target to be identified to first band range Spectrum response, the target to be identified is to the response of the spectrum of second band range and the target to be identified to third wave The response of the spectrum of segment limit, that is to say, that the corresponding spectrum of each pixel unit in the first pixel unit set is rung It should be able to include response of the face to the spectrum of three kinds of different-waveband ranges, in this way, even if some of artificial material and living person There is overlapping in the response of the spectrum of wavelength band, can also be distinguished by the response of the spectrum of other wavelength bands, thus It is able to ascend the accuracy of vivo identification.
In the embodiment of the present application, for the test object of a pure color, for example, white paper, for different wave bands For the spectrum of range, it is desirable to which the difference of the collected spectral response of pixel unit in the first pixel unit set is not Greatly, that is to say, that this first pixel unit set is same or similar for the response of the optical signal of three kinds of wavelength bands, still, In practical application, the size of the first pixel unit set three kinds of spectral responses collected may have certain difference, In this way, if some spectral response is excessive, may cause other spectral responses cannot be by effective district when three kinds of spectral responses of synthesis Point, in order to promote the discrimination of living body and prosthese, in the embodiment of the present application, the first pixel unit set can also be acquired Facial image is calibrated.
Optionally, in some embodiments, the processor 33 is also used to:
According to calibration parameter, to first facial image, second facial image and the third facial image into Row calibration;
According to first facial image after calibration, second facial image and the third facial image determine institute State the true and false of face.
Using the references object as test object, the calibration parameter is determined, which can be pure color object, example Such as white paper, yellowish pink object etc., it is expected that the references object of the first pixel unit set acquisition is to the first wave The response of the spectrum of segment limit, the second band range and the third wavelength band is based on this purpose in same level, right The references object of the first pixel unit collective entity acquisition is to the first band range, the second band range Response with the spectrum of the third wavelength band is calibrated, and determines the calibration parameter.
Specifically, successively emit the first band range, the second band to the references object in the light source When the optical signal of range and the third wavelength band, the references object is acquired by the first pixel unit set respectively Three width images, be denoted as the first image, the second image and third image.Further, the processor 33 is according to three width The relationship of the pixel value of respective pixel unit in image determines that the calibration parameter, the calibration parameter are used for so that described The pixel value of three width images is in same range.
It is assumed that the pixel value of the first pixel unit P1 is 200 in the first image, the first pixel described in the second image The pixel value of unit P1 acquisition is 100, and the pixel value that the first pixel unit P1 is acquired in third image is 50, above three picture Plain value respectively indicates the response of three kinds of spectrum, proportionate relationship 4:2:1, in order to enable the first pixel unit P1 acquisition is described References object in same level, can calibrate the response of three kinds of spectrum to it, such as can be by this in the second image The pixel value of one pixel unit P1 acquisition multiplied by 2, pixel value that the first pixel unit P1 in third image is acquired multiplied by 4, In this way, in subsequent colorized face images of three pixel values synthesis including three kinds of spectral responses based on pixel unit acquisition When, it can preferably distinguish every kind of spectral response.
Optionally, in other embodiments, the calibration parameter is preset value, for example, can be according to three kinds of spectrum The empirical value of response determines, or can also be determined according to above-mentioned calibration steps, for example, determining calibration ginseng through the above steps After number, the calibration parameter can be prestored, the calibration of the facial image for subsequent acquisition, i.e., the calibration of subsequent facial image The calibration parameter is all used, the embodiment of the present application is not construed as limiting this.
It should be understood that in the embodiment of the present application, the response of three kinds of spectrum can refer to three kinds of spectral responses in same range Difference be less than specific threshold or three kinds of spectral responses pixel value it is suitable, in other words, be in same level.
Optionally, in the embodiment of the present application, the school of each pixel unit in the first pixel unit set can be determined Then quasi- parameter is calibrated according to pixel value of the calibration parameter of each pixel unit to subsequent acquisition, alternatively, can also incite somebody to action The calibration parameter of each pixel unit is averaged, and unified calibration parameter is obtained, according to the unified calibration parameter to first The pixel value of all pixels unit acquisition in pixel unit set is calibrated, and the embodiment of the present application is for the specifically side of calibration Formula is not construed as limiting.
Optionally, in some embodiments, the processor 33 is also used to:
According to first facial image after calibration, second facial image and the third facial image are closed At obtaining colorized face images, wherein each pixel in the colorized face images includes the face to the first wave Three response pixel values of the spectrum of segment limit, the second band range and the third wavelength band;
The colorized face images are subjected to feature extraction, obtain the characteristic information of the colorized face images;
According to the characteristic information of the colorized face images, the true and false of the face is determined.
For example, the processor 33 can be according to the first pixel unit in the first pixel unit set described the first Sampled pixel values in face image determine the corresponding first response pixel value of the first pixel in the colorized face images, In, the first response pixel value indicates response of the face to the spectrum of the first band range, first pixel Corresponding first pixel unit;
According to sampled pixel values of the first pixel unit in the first pixel unit set in second facial image, Determine the corresponding second response pixel value of first pixel, wherein the second response pixel value indicates the face to institute State the response of the spectrum of second band range;And
According to sampled pixel values of the first pixel unit in the first pixel unit set in the third facial image, Determine the corresponding third response pixel value of first pixel, wherein the third response pixel value indicates the face to institute State the response of the spectrum of third wavelength band.
Specifically, the colorized face images may include three Color Channels, such as RGB, a kind of spectral response pair Answer a Color Channel, that is to say, that each pixel in colorized face images includes (i.e. described three responses of three pixel values Pixel value), respectively correspond three kinds of spectral responses.To determine three kinds of light of the first pixel unit P1 in the first pixel unit set It is illustrated for spectrum response, it can be by first facial image after calibration, second facial image and the third Corresponding three pixel values of first pixel unit P1 described in facial image, as respective pixel in the colorized face images The pixel value of three Color Channels.Each pixel unit in the first pixel unit set can be determined in a similar way Three kinds of spectrum response, to obtain this colorized face images.
Further, which can carry out vivo identification according to the colored human face, to identify the true and false of face, example Such as, the processor 33 can extract the characteristic information of the colored human face, for example, color character information, is specifically as follows coloration, Then saturation degree and purity (Hue, Saturation, Value, HSV) information input the characteristic information of the colour local facial Classify to deep learning network, determines the true and false of face.
Optionally, in the embodiment of the present application, which can be convolutional neural networks or other depth Learning network.By taking convolutional neural networks as an example, illustrate specific training process.
Firstly, building convolutional neural networks structure, such as two layers of convolutional neural networks can be used, or can also use Three Tiered Network Architecture or more structure etc..
Secondly, the initial training parameter and the condition of convergence of the convolutional neural networks is arranged.
What the initial training parameter can be randomly generated, or obtain based on experience value, or be also possible to according to big The parameter of the good convolutional neural networks model of the true and false human face data pre-training of amount.
Non-limiting as example, which may include at least one of the following:
1, the colorized face images of real human face are determined as that the probability from real human face is greater than the first probability, for example, 98%;
2, the colorized face images of dummy's face are judged as that the probability from dummy's face is greater than the second probability, such as 95%;
3, the colorized face images of real human face are determined as that the probability from dummy's face is less than third probability, for example, 2%;
4, it is judged as the probability from real human face less than the 4th probability, such as 3% colorized face images of dummy's face.
Then, the feature letter of the colorized face images of a large amount of real human face and dummy's face is inputted to the convolutional neural networks Breath, the convolutional neural networks can be handled based on characteristic information of the initial training parameter to above-mentioned colorized face images, really The fixed judgement to each colorized face images is as a result, further, according to the judgement as a result, the structure of adjustment convolutional neural networks And/or the training parameter of each layer, until determining that result meets the condition of convergence, so far, training is completed.It later, can be by subsequent need The characteristic information of the colorized face images for the face to be identified is input to the convolutional neural networks, which can make It is handled with characteristic information of the trained parameter to the colorized face images, determines whether the colorized face images come from very Real face.
Optionally, in some embodiments, the processor 33 is also used to:
According to the people of other pixel units acquisition in addition to the first pixel unit set in the pixel array Face image carries out recognition of face.
For example, the processor 33 can be in the mesh to be identified for the facial image and registration that other described pixel units acquire In the case where target facial image template matching, vivo identification further is carried out to the target to be identified, in the target to be identified Recognition of face success is determined in the case where for real human face, thereby executing the operation for triggering the recognition of face, for example, carrying out terminal The operation such as unlock or payment.
In other embodiments, which can also be in the case where target to be identified be real human face, further Judge in pixel array in addition to the first pixel unit set other pixel units acquisition facial image whether with The facial image template matching of the target to be identified of registration determines recognition of face success in the event of a match, further holds Row triggers the operation of the recognition of face, for example, carrying out the operation such as terminal unlocking or payment.
It should be understood that the device 30 for recognition of face according to the embodiment of the present application is readily applicable to other biological feature Identify scene, such as fingerprint recognition scene, for example, when acquiring fingerprint image, the finger based on the acquisition of partial pixel unit At least two spectral responses are based further at least two spectral response, determine the true and false of finger.
In the embodiment of the present application, the device 30 for recognition of face may include the processor 33, such as at this The micro-control unit (Micro Control Unit, MCU) that device 33 can be used in the device 30 of recognition of face for this is managed, or Person, in other embodiments, the device 30 for being used for recognition of face can not include the processor 33, in this case, the place Managing function performed by device 33 can be by the processor in electronic equipment that the device 30 for recognition of face is installed, example If master control (Host) module executes, the embodiment of the present application is not construed as limiting this.
Above in association with Fig. 2 to Fig. 3, the Installation practice of the application is described in detail, below in conjunction with Fig. 4, detailed description is originally The embodiment of the method for application, it should be appreciated that embodiment of the method is corresponded to each other with Installation practice, and similar description is referred to device Embodiment.
Fig. 4 is the schematic flow chart of the method 40 for recognition of face of another embodiment of the application, as shown in figure 4, This method 40 includes:
S41, when light source successively emits at least two optical signals, by the first pixel unit set of optical sensor according to The secondary reflected light signal for receiving at least two optical signal and being reflected from the face, and according to the reflected light signal obtain to Few two facial images, wherein at least two optical signal corresponds to different wavelength bands;
S42 determines the true and false of the face according at least two facial image.
It should be understood that this method 40 can be executed by the device for recognition of face, such as the device 30 in previous embodiment, Specifically, S41 can be executed by the optical sensor in the device 30, S42 can by the processor in the device 30, such as MCU is executed;Alternatively, the electronic equipment that this method 40 can also be installed by the device for recognition of face executes, for example, S42 can be executed by the processor in electronic equipment, such as Host module, and the embodiment of the present application is not construed as limiting this.
Optionally, in some embodiments, the light source successively emits at least two optical signals to face, comprising: described Light source successively emits the first optical signal, the second optical signal and third optical signal to the face, wherein first optical signal pair First band range is answered, second optical signal corresponds to second band range, and the third optical signal corresponds to third wavelength band.
Optionally, in some embodiments, the first band range, the second band range and the third wave band Range is respectively one of following three kinds of wavelength bands: the wavelength band including 560nm, the wavelength band including 980nm, packet Include the wavelength band of 940nm.
Optionally, in some embodiments, the light source is a light source, the wave for the optical signal that the light source can emit Segment limit includes the first band range, the second band range and third wavelength band.
Optionally, in some embodiments, the light source includes the first sub-light source, the second sub-light source and third sub-light source, It is respectively used to emit the first band range, the optical signal of the second band range and the third wavelength band.
Optionally, in some embodiments, the method 40 further include:
It controls the light source and successively emits first optical signal, second optical signal and the third to the face Optical signal.
Optionally, in some embodiments, described that institute is successively received by the first pixel unit set of optical sensor The reflected light signal that at least two optical signals are reflected from the face is stated, and at least two people are obtained according to the reflected light signal Face image, comprising:
First optical signal, the second optical signal are successively received by the pixel unit in the first pixel unit set The reflected light signal reflected respectively from the face with third optical signal, and obtained respectively according to the reflected light signal the first Face image, the second facial image and third facial image.
Optionally, in some embodiments, the method 40 further include:
According to first facial image, second facial image and the third facial image determine the face It is true and false.
Optionally, in some embodiments, described according to first facial image, second facial image and described Third facial image determines the true and false of the face, comprising:
According to calibration parameter, to first facial image, second facial image and the third facial image into Row calibration;
According to first facial image after calibration, second facial image and the third facial image are determined The face it is true and false.
Optionally, in some embodiments, the method 40 further include:
According to references object to the first band range, the light of the second band range and the third wavelength band Relationship between the response of spectrum determines the calibration parameter.
Optionally, in some embodiments, it is described according to references object to the first band range, the second band Relationship between the response of the spectrum of range and the third wavelength band, determines the calibration parameter, comprising:
Successively emit the first band range, the second band range and institute to the references object in the light source When stating the optical signal of third wavelength band, the reference is acquired by the pixel unit in the first pixel unit set respectively Three width images of object;
According to the relationship of the pixel value of the three width image, determine the calibration parameter, the calibration parameter be used for so that The pixel value of the three width image is in same range.
Optionally, in some embodiments, first facial image according to after calibration, the second face figure Picture and the third facial image, determine the true and false of the face, comprising:
According to first facial image after calibration, second facial image and the third facial image are closed At obtaining colorized face images, wherein each pixel in the colorized face images includes the face to the first wave Three response pixel values of the spectrum of segment limit, the second band range and the third wavelength band;
The colorized face images are subjected to feature extraction, obtain the characteristic information of the colorized face images;
According to the characteristic information of the colorized face images, the true and false of the face is determined.
Optionally, in some embodiments, first facial image according to after calibration, the second face figure Picture and the third facial image are synthesized, and colorized face images are obtained, comprising:
According to sampled pixel values of the first pixel unit in the first pixel unit set in first facial image, Determine the corresponding first response pixel value of the first pixel in the colorized face images, wherein the first response pixel value Indicate response of the face to the spectrum of the first band range, first pixel corresponds to first pixel unit;
According to sampled pixel values of the first pixel unit in the first pixel unit set in second facial image, Determine the corresponding second response pixel value of first pixel, wherein the second response pixel value indicates the face to institute State the response of the spectrum of second band range;And
According to sampled pixel values of the first pixel unit in the first pixel unit set in the third facial image, Determine the corresponding third response pixel value of first pixel, wherein the third response pixel value indicates the face to institute State the response of the spectrum of third wavelength band.
Optionally, in some embodiments, the characteristic information according to the colorized face images, determines the face It is true and false, comprising: handled by characteristic information of the deep learning network to the colorized face images, determine the face It is true and false.
Optionally, in some embodiments, the method 40 further include:
According to the face of other pixel units acquisition in the pixel array in addition to the first pixel unit set Image carries out recognition of face.
Optionally, in some embodiments, it is described according in the pixel array remove the first pixel unit set with The facial image of outer other pixel units acquisition carries out recognition of face, comprising:
In the case where the facial image is matched with the facial image registered and the face is real human face, people is determined Face identifies successfully.
Hereinafter, illustrating the overall flow of the method for recognition of face according to the embodiment of the present application, such as Fig. 5 in conjunction with Fig. 5 Shown, this method may include following content:
S51 passes through the first pixel unit collection in light source the first optical signal of transmission, the second optical signal and third optical signal Conjunction acquires the first facial image, the second facial image and third facial image respectively;
In S52, to first facial image, second facial image and the third facial image carry out school It is quasi-;
Specific implementation refers to the related description of previous embodiment, and which is not described herein again.
In S53, according to first facial image after calibration, second facial image and the third face figure As being synthesized, colorized face images are obtained;
In S54, the color character information of the colorized face images, such as HSV information are extracted;
In S55, is classified according to the color character information of the colorized face images, determine the true and false of face.Tool Body, which can be input to deep learning network, to determine the true and false of face.
As shown in fig. 6, the electronic equipment 60 may include using the embodiment of the present application also provides a kind of electronic equipment 60 In the device 61 of recognition of face, which can be in aforementioned device embodiment for recognition of face Device 30, it can be used to execute the content in embodiment of the method described in Fig. 4 to Fig. 5, for sake of simplicity, no longer superfluous here It states.
It should be understood that the processor or processing unit of the embodiment of the present application can be a kind of IC chip, there is signal Processing capacity.During realization, each step of above method embodiment can be patrolled by the integrated of the hardware in processor The instruction for collecting circuit or software form is completed.Above-mentioned processor can be general processor, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field Programmable Gate Array, FPGA) or other can Programmed logic device, discrete gate or transistor logic, discrete hardware components.It may be implemented or execute the application implementation Disclosed each method, step and logic diagram in example.General processor can be microprocessor or the processor can also be with It is any conventional processor etc..The step of method in conjunction with disclosed in the embodiment of the present application, can be embodied directly in hardware decoding Processor executes completion, or in decoding processor hardware and software module combination execute completion.Software module can position In random access memory, flash memory, read-only memory, programmable read only memory or electrically erasable programmable memory, register In the storage medium of equal this fields maturation.The storage medium is located at memory, and processor reads the information in memory, in conjunction with it Hardware completes the step of above method.
It is appreciated that the recognition of face of the embodiment of the present application can also include memory, memory can be volatibility and deposit Reservoir or nonvolatile memory, or may include both volatile and non-volatile memories.Wherein, nonvolatile memory can Be read-only memory (Read-Only Memory, ROM), programmable read only memory (Programmable ROM, PROM), Erasable Programmable Read Only Memory EPROM (Erasable PROM, EPROM), electrically erasable programmable read-only memory (Electrically EPROM, EEPROM) or flash memory.Volatile memory can be random access memory (Random Access Memory, RAM), it is used as External Cache.By exemplary but be not restricted explanation, many forms RAM is available, such as static random access memory (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), Synchronous Dynamic Random Access Memory (Synchronous DRAM, SDRAM), Double Data Rate synchronous dynamic Random access memory (Double Data Rate SDRAM, DDR SDRAM), enhanced Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links dynamic random access memory (Synchlink DRAM, SLDRAM) and straight Meet rambus random access memory (Direct Rambus RAM, DR RAM).It should be noted that system described herein and side The memory of method is intended to include but is not limited to the memory of these and any other suitable type.
The embodiment of the present application also proposed a kind of computer readable storage medium, the computer-readable recording medium storage one A or multiple programs, the one or more program include instruction, and the instruction is when by the portable electronic including multiple application programs When equipment executes, method that the portable electronic device can be made to execute Fig. 4 to embodiment illustrated in fig. 5.
The embodiment of the present application also proposed a kind of computer program, which includes instruction, when the computer journey When sequence is computer-executed, the method that allows computer to execute Fig. 4 to embodiment illustrated in fig. 5.
The embodiment of the present application also provides a kind of chip, which includes input/output interface, at least one processor, extremely A few memory and bus, for storing instruction, at least one processor is for calling this extremely for at least one processor Instruction in a few memory, the method to execute Fig. 4 to embodiment illustrated in fig. 5.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed Scope of the present application.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that arriving, disclosed systems, devices and methods can To realize by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit Division, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or group Part can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown Or the mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, device or unit it is indirect Coupling or communication connection can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product It is stored in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially in other words The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, institute Computer software product is stated to be stored in a storage medium, including some instructions are used so that computer equipment (can be with It is personal computer, server or the network equipment etc.) execute all or part of step of each embodiment the method for the application Suddenly.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), deposits at random The various media that can store program code such as access to memory (Random Access Memory, RAM), magnetic or disk.
The above, the only specific embodiment of the application, but the protection scope of the application is not limited thereto, it is any Those familiar with the art within the technical scope of the present application, can easily think of the change or the replacement, and should all contain Lid is within the scope of protection of this application.Therefore, the protection scope of the application shall be subject to the protection scope of the claim.

Claims (43)

1. a kind of optical sensor for recognition of face characterized by comprising
Pixel array, the first pixel unit set in the pixel array is for receiving at least two successively emitted by light source The reflected light signal that optical signal is reflected from face, and at least two facial images are obtained according to the reflected light signal, wherein institute It states at least two optical signals and corresponds to different wavelength bands, at least two facial image is for determining the true of the face It is false.
2. optical sensor according to claim 1, which is characterized in that at least two optical signal is believed including the first light Number, the second optical signal and third optical signal, wherein first optical signal corresponds to first band range, second optical signal Corresponding second band range, the third optical signal correspond to third wavelength band, the first band range, the second band Range and the third wavelength band are different two-by-two;
At least two facial image include the first facial image, the second facial image and third facial image, described first Facial image, the second facial image and third facial image are respectively by first optical signal, second optical signal and described Third optical signal obtains after face reflection, first facial image, second facial image and the third party Face image is for determining the true and false of the face.
3. optical sensor according to claim 2, which is characterized in that the first band range, the second band Range and the third wavelength band are respectively one of following three kinds of wavelength bands:
Wavelength band including 560nm, the wavelength band including 980nm, the wavelength band including 940nm.
4. optical sensor according to any one of claim 1 to 3, which is characterized in that the first pixel unit collection Pixel unit in conjunction is not provided with optical filter.
5. optical sensor according to any one of claim 1 to 4, which is characterized in that remove institute in the pixel array It states other pixel units except the first pixel unit set and is not provided with optical filter, or the optical filter of setting specific band range.
6. optical sensor according to claim 5, which is characterized in that the optical filter of the specific band range is to include The optical filter of 940nm wavelength band.
7. optical sensor according to any one of claim 1 to 6, which is characterized in that the first pixel unit collection It closes including the partial pixel unit in the pixel array.
8. optical sensor according to any one of claim 1 to 7, which is characterized in that the first pixel unit collection The ratio of the quantity of pixel unit in conjunction and the total quantity of the pixel unit in the pixel array is less than the first ratio.
9. optical sensor according to any one of claim 1 to 8, which is characterized in that the first pixel unit collection The quantity of continuous pixel unit is less than or equal to specific threshold in conjunction.
10. optical sensor according to any one of claim 1 to 9, which is characterized in that the first pixel unit collection Pixel unit in conjunction is discrete to be distributed in the pixel array.
11. optical sensor according to any one of claims 7 to 10, which is characterized in that removed in the pixel array The facial image of other pixel units acquisition except the first pixel unit set is used for recognition of face.
12. a kind of device for recognition of face characterized by comprising
Optical sensor as described in any one of claims 1 to 11;
Light source, for successively emitting at least two optical signals, at least two optical signal corresponds to different wavelength bands;
Wherein, the first pixel unit set of the optical sensor is for receiving the light source successively emits described at least two The reflected light signal that kind optical signal is reflected from face, and at least two facial images are obtained according to the reflected light signal, it is described At least two facial images are for determining the true and false of the face.
13. device according to claim 12, which is characterized in that the light source is specifically used for:
Successively emit the first optical signal, the second optical signal and third optical signal to the face, wherein first optical signal pair First band range is answered, second optical signal corresponds to second band range, and the third optical signal corresponds to third wavelength band, The first band range, the second band range and the third wavelength band are different two-by-two.
14. device according to claim 13, which is characterized in that the light source is a light source, and the light source can be sent out The wavelength band for the optical signal penetrated includes the first band range, the second band range and third wavelength band.
15. device according to claim 13, which is characterized in that the light source includes the first sub-light source, the second sub-light source With third sub-light source, it is respectively used to emit the first band range, the second band range and the third wavelength band Optical signal.
16. device described in any one of 3 to 15 according to claim 1, which is characterized in that described device further include: light source control Molding block successively emits first optical signal to the face for controlling the light source, second optical signal and described Third optical signal.
17. device described in any one of 3 to 16 according to claim 1, which is characterized in that the optical sensing implement body is used In:
First optical signal, the second optical signal and third optical signal difference are successively received by the first pixel unit set The reflected light signal reflected from the face, and the first facial image, the second face are obtained according to the reflected light signal respectively Image and third facial image.
18. device according to claim 17, which is characterized in that described device further include:
Processor, for determining institute according to first facial image, second facial image and the third facial image State the true and false of face.
19. device according to claim 18, which is characterized in that the processor is also used to:
According to calibration parameter, to first facial image, second facial image and the third facial image carry out school It is quasi-;
According to first facial image after calibration, second facial image and the third facial image determine the people Face it is true and false.
20. device according to claim 19, which is characterized in that the processor is also used to:
According to references object to the first band range, the spectrum of the second band range and the third wavelength band Relationship between response determines the calibration parameter.
21. device according to claim 20, which is characterized in that the optical sensor is also used to: the light source to The references object successively emits the first band range, the light letter of the second band range and the third wavelength band Number when, acquire three width images of the references object respectively;
The processor is also used to:
According to the relationship of the pixel value of the three width image, determine that the calibration parameter, the calibration parameter are used for so that described The pixel value of three width images is in same range.
22. the device according to claim 20 or 21, which is characterized in that the processor is also used to:
According to first facial image after calibration, second facial image and the third facial image are synthesized, Obtain colorized face images, wherein each pixel in the colorized face images includes the face to the first band Three response pixel values of the spectrum of range, the second band range and the third wavelength band;
The colorized face images are subjected to feature extraction, obtain the characteristic information of the colorized face images;
According to the characteristic information of the colorized face images, the true and false of the face is determined.
23. device according to claim 22, which is characterized in that the processor is specifically used for:
According to sampled pixel values of the first pixel unit in the first pixel unit set in first facial image, determine The corresponding first response pixel value of the first pixel in the colorized face images, wherein the first response pixel value indicates Response of the face to the spectrum of the first band range, first pixel correspond to first pixel unit;
According to sampled pixel values of the first pixel unit in the first pixel unit set in second facial image, determine The corresponding second response pixel value of first pixel, wherein the second response pixel value indicates the face to described the The response of the spectrum of two wavelength bands;And
According to sampled pixel values of the first pixel unit in the first pixel unit set in the third facial image, determine The corresponding third of first pixel responds pixel value, wherein the third response pixel value indicates the face to described the The response of the spectrum of three wavelength bands.
24. the device according to claim 22 or 23, which is characterized in that the processor is specifically used for: by depth It practises network to handle the characteristic information of the colorized face images, determines the true and false of the face.
25. device described in any one of 8 to 24 according to claim 1, which is characterized in that the processor is also used to:
By in the pixel array in addition to the first pixel unit set other pixel units acquisition facial image with The facial image template of registration is matched, and determines whether recognition of face succeeds.
26. device according to claim 25, which is characterized in that the processor is also used to:
In the facial image and the facial image template matching registered and in the case that the face is real human face, really Determine recognition of face success.
27. a kind of method for recognition of face, which is characterized in that the described method includes:
When light source successively emits at least two optical signals, institute is successively received by the first pixel unit set of optical sensor The reflected light signal that at least two optical signals are reflected from the face is stated, and at least two people are obtained according to the reflected light signal Face image, wherein at least two optical signal corresponds to different wavelength bands;
The true and false of the face is determined according at least two facial image.
28. according to the method for claim 27, which is characterized in that the light source successively emits at least two light letter to face Number, comprising:
The light source successively emits the first optical signal, the second optical signal and third optical signal to the face, wherein described first Optical signal corresponds to first band range, and second optical signal corresponds to second band range, and the third optical signal corresponds to third Wavelength band, the first band range, the second band range and the third wavelength band are different two-by-two.
29. according to the method for claim 28, which is characterized in that the first band range, the second band range It is respectively one of following three kinds of wavelength bands: the wavelength band including 560nm with the third wavelength band, including The wavelength band of 980nm, the wavelength band including 940nm.
30. the method according to claim 28 or 29, which is characterized in that the light source is a light source, the light source energy The wavelength band of the optical signal enough emitted includes the first band range, the second band range and third wavelength band.
31. the method according to any one of claim 28 to 30, which is characterized in that the light source includes the first sub-light Source, the second sub-light source and third sub-light source, are respectively used to emit the first band range, the second band range and described The optical signal of third wavelength band.
32. the method according to any one of claim 28 to 31, which is characterized in that the method also includes: control institute It states light source and successively emits first optical signal, second optical signal and the third optical signal to the face.
33. the method according to any one of claim 28 to 32, which is characterized in that described to pass through the of optical sensor One pixel unit set successively receives the reflected light signal that at least two optical signal is reflected from the face, and according to described Reflected light signal obtains at least two facial images, comprising:
First optical signal, the second optical signal and are successively received by the pixel unit in the first pixel unit set The reflected light signal that three optical signals are reflected from the face respectively, and the first face figure is obtained according to the reflected light signal respectively Picture, the second facial image and third facial image.
34. according to the method for claim 33, which is characterized in that the method also includes:
According to first facial image, second facial image and the third facial image determine the true of the face It is false.
35. according to the method for claim 34, which is characterized in that it is described according to first facial image, described second Facial image and the third facial image determine the true and false of the face, comprising:
According to calibration parameter, to first facial image, second facial image and the third facial image carry out school It is quasi-;
According to first facial image after calibration, second facial image and the third facial image, determine described in Face it is true and false.
36. according to the method for claim 35, which is characterized in that the method also includes:
According to references object to the first band range, the spectrum of the second band range and the third wavelength band Relationship between response determines the calibration parameter.
37. according to the method for claim 36, which is characterized in that it is described according to references object to the first band model It encloses, the relationship between the response of the spectrum of the second band range and the third wavelength band determines the calibration parameter, Include:
Successively emit the first band range, the second band range and described to the references object in the light source When the optical signal of three wavelength bands, the references object is acquired by the pixel unit in the first pixel unit set respectively Three width images;
According to the relationship of the pixel value of the three width image, determine that the calibration parameter, the calibration parameter are used for so that described The pixel value of three width images is in same range.
38. the method according to claim 36 or 37, which is characterized in that the first face figure according to after calibration Picture, second facial image and the third facial image, determine the true and false of the face, comprising:
According to first facial image after calibration, second facial image and the third facial image are synthesized, Obtain colorized face images, wherein each pixel in the colorized face images includes the face to the first band Three response pixel values of the spectrum of range, the second band range and the third wavelength band;
The colorized face images are subjected to feature extraction, obtain the characteristic information of the colorized face images;
According to the characteristic information of the colorized face images, the true and false of the face is determined.
39. according to the method for claim 38, which is characterized in that first facial image according to after calibration, Second facial image and the third facial image are synthesized, and colorized face images are obtained, comprising:
According to sampled pixel values of the first pixel unit in the first pixel unit set in first facial image, determine The corresponding first response pixel value of the first pixel in the colorized face images, wherein the first response pixel value indicates Response of the face to the spectrum of the first band range, first pixel correspond to first pixel unit;
According to sampled pixel values of the first pixel unit in the first pixel unit set in second facial image, determine The corresponding second response pixel value of first pixel, wherein the second response pixel value indicates the face to described the The response of the spectrum of two wavelength bands;And
According to sampled pixel values of the first pixel unit in the first pixel unit set in the third facial image, determine The corresponding third of first pixel responds pixel value, wherein the third response pixel value indicates the face to described the The response of the spectrum of three wavelength bands.
40. the method according to claim 38 or 39, which is characterized in that the feature according to the colorized face images Information determines the true and false of the face, comprising:
It is handled by characteristic information of the deep learning network to the colorized face images, determines the true and false of the face.
41. the method according to any one of claim 38 to 40, which is characterized in that the method also includes:
By in the pixel array in addition to the first pixel unit set other pixel units acquisition facial image with The facial image template of registration is matched, and determines whether recognition of face succeeds.
42. according to the method for claim 41, which is characterized in that described to remove first pixel in the pixel array The facial image of other pixel units acquisition other than unit set is matched with the facial image template of registration, determines face Identify whether success, comprising:
In the facial image and the facial image template matching registered and in the case that the face is real human face, really Determine recognition of face success.
43. a kind of electronic equipment characterized by comprising
The device for recognition of face as described in any one of claim 12 to 26.
CN201980000833.9A 2019-05-27 2019-05-27 For the optical sensor of recognition of face, device, method and electronic equipment Pending CN110337656A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/088654 WO2020237483A1 (en) 2019-05-27 2019-05-27 Optical sensor, apparatus and method for facial recognition, and electronic device

Publications (1)

Publication Number Publication Date
CN110337656A true CN110337656A (en) 2019-10-15

Family

ID=68150222

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980000833.9A Pending CN110337656A (en) 2019-05-27 2019-05-27 For the optical sensor of recognition of face, device, method and electronic equipment

Country Status (2)

Country Link
CN (1) CN110337656A (en)
WO (1) WO2020237483A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113297977A (en) * 2021-05-26 2021-08-24 奥比中光科技集团股份有限公司 Living body detection method and device and electronic equipment
CN113609924A (en) * 2021-07-15 2021-11-05 奥比中光科技集团股份有限公司 Spectrum data determination method and device, terminal and storage medium
WO2021244414A1 (en) * 2020-06-05 2021-12-09 吉林求是光谱数据科技有限公司 Facial recognition monitoring system based on spectrum and multi-band fusion, and recognition method
US11410412B2 (en) * 2020-01-21 2022-08-09 Egis Technology Inc. Anti-counterfeiting method and system for under-screen fingerprint identification

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI794696B (en) * 2020-12-14 2023-03-01 晶元光電股份有限公司 Optical sensing device
CN112800956A (en) * 2021-01-27 2021-05-14 杭州海康威视数字技术股份有限公司 Fingerprint in-vivo detection system, method and device
CN113743343A (en) * 2021-09-10 2021-12-03 维沃移动通信有限公司 Image information acquisition module, information processing method and device and electronic equipment

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103268499A (en) * 2013-01-23 2013-08-28 北京交通大学 Human body skin detection method based on multi-spectral imaging
JP2014027597A (en) * 2012-07-30 2014-02-06 Toyota Central R&D Labs Inc Image processor, object identification device, and program
CN105160289A (en) * 2015-07-03 2015-12-16 深圳市金立通信设备有限公司 Face identification method and terminal
CN107205139A (en) * 2017-06-28 2017-09-26 重庆中科云丛科技有限公司 The imaging sensor and acquisition method of multichannel collecting
CN107408298A (en) * 2015-03-13 2017-11-28 日本电气株式会社 Life entity detection device, life body detecting method and recording medium
CN107609459A (en) * 2016-12-15 2018-01-19 平安科技(深圳)有限公司 A kind of face identification method and device based on deep learning
CN107808115A (en) * 2017-09-27 2018-03-16 联想(北京)有限公司 A kind of biopsy method, device and storage medium
CN108710844A (en) * 2018-05-14 2018-10-26 安徽质在智能科技有限公司 The authentication method and device be detected to face

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102622588B (en) * 2012-03-08 2013-10-09 无锡中科奥森科技有限公司 Dual-certification face anti-counterfeit method and device
CN102831400B (en) * 2012-07-31 2015-01-28 西北工业大学 Multispectral face identification method, and system thereof
EP3534328A4 (en) * 2016-10-31 2019-11-06 Nec Corporation Image processing device, image processing method, facial recogntion system, program, and recording medium
US10204262B2 (en) * 2017-01-11 2019-02-12 Microsoft Technology Licensing, Llc Infrared imaging recognition enhanced by 3D verification
CN107169405B (en) * 2017-03-17 2020-07-03 上海云从企业发展有限公司 Method and device for living body identification based on binocular camera
KR102317180B1 (en) * 2017-06-08 2021-10-27 (주)이더블유비엠 Apparatus and method of face recognition verifying liveness based on 3d depth information and ir information

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014027597A (en) * 2012-07-30 2014-02-06 Toyota Central R&D Labs Inc Image processor, object identification device, and program
CN103268499A (en) * 2013-01-23 2013-08-28 北京交通大学 Human body skin detection method based on multi-spectral imaging
CN107408298A (en) * 2015-03-13 2017-11-28 日本电气株式会社 Life entity detection device, life body detecting method and recording medium
CN105160289A (en) * 2015-07-03 2015-12-16 深圳市金立通信设备有限公司 Face identification method and terminal
CN107609459A (en) * 2016-12-15 2018-01-19 平安科技(深圳)有限公司 A kind of face identification method and device based on deep learning
CN107205139A (en) * 2017-06-28 2017-09-26 重庆中科云丛科技有限公司 The imaging sensor and acquisition method of multichannel collecting
CN107808115A (en) * 2017-09-27 2018-03-16 联想(北京)有限公司 A kind of biopsy method, device and storage medium
CN108710844A (en) * 2018-05-14 2018-10-26 安徽质在智能科技有限公司 The authentication method and device be detected to face

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11410412B2 (en) * 2020-01-21 2022-08-09 Egis Technology Inc. Anti-counterfeiting method and system for under-screen fingerprint identification
WO2021244414A1 (en) * 2020-06-05 2021-12-09 吉林求是光谱数据科技有限公司 Facial recognition monitoring system based on spectrum and multi-band fusion, and recognition method
US11443550B2 (en) 2020-06-05 2022-09-13 Jilin Qs Spectrum Data Technology Co. Ltd Face recognition monitoring system based on spectrum and multi-band fusion and recognition method using same
CN113297977A (en) * 2021-05-26 2021-08-24 奥比中光科技集团股份有限公司 Living body detection method and device and electronic equipment
CN113297977B (en) * 2021-05-26 2023-12-22 奥比中光科技集团股份有限公司 Living body detection method and device and electronic equipment
CN113609924A (en) * 2021-07-15 2021-11-05 奥比中光科技集团股份有限公司 Spectrum data determination method and device, terminal and storage medium

Also Published As

Publication number Publication date
WO2020237483A1 (en) 2020-12-03

Similar Documents

Publication Publication Date Title
CN110337656A (en) For the optical sensor of recognition of face, device, method and electronic equipment
CN209168144U (en) Fingerprint identification device and terminal device
US10943083B2 (en) Fingerprint identification apparatus and method and terminal device
CN105518711B (en) Biopsy method, In vivo detection system and computer program product
US10694982B2 (en) Imaging apparatus, authentication processing apparatus, imaging method, authentication processing method
CN109446981B (en) Face living body detection and identity authentication method and device
CN105874472B (en) Multiband bio-identification camera system with iris color identification
CN102804229B (en) Determine equipment, finger print input device, determine method and determine program
KR101286454B1 (en) Fake face identification apparatus and method using characteristic of eye image
TWI727219B (en) Method for generating representation of image, imaging system, and machine-readable storage devices
CN107341481A (en) It is identified using structure light image
CN106372611A (en) Identity identification method and system based on palm vein features, and image acquisition apparatus
CN101493884A (en) Multi-optical spectrum image collecting device and method
US20100215223A1 (en) Vein Pattern Management System, Vein Pattern Registration Apparatus, Vein Pattern Authentication Apparatus, Vein Pattern Registration Method, Vein Pattern Authentication Method, Program, and Vein Data Configuration
KR20170078729A (en) Systems and methods for spoof detection in iris based biometric systems
CN111462379A (en) Access control management method, system and medium containing palm vein and face recognition
CN105874461A (en) Biometric authentication device and biometric authentication method
CN110008813A (en) Face identification method and system based on In vivo detection technology
EP2148295A1 (en) Vein pattern management system, vein pattern registration device, vein pattern authentication device, vein pattern registration method, vein pattern authentication method, program, and vein data structure
WO2020237482A1 (en) Optical sensor, apparatus and method for facial recognition, and electronic device
CN110383289A (en) Device, method and the electronic equipment of recognition of face
KR101919090B1 (en) Apparatus and method of face recognition verifying liveness based on 3d depth information and ir information
CN108875338A (en) unlocking method, device and system and storage medium
CN111104833A (en) Method and apparatus for in vivo examination, storage medium, and electronic device
CN106529436A (en) Identity consistency authentication method and device, and mobile terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination