Specific embodiment
With reference to embodiment and compares attached drawing the utility model is described in further details.It is wherein identical
Appended drawing reference indicates identical component, unless stated otherwise.It is emphasized that following the description is only exemplary,
Rather than in order to limit the scope of the utility model and its application.
Fig. 1 is the electronic equipment front schematic view according to the utility model one embodiment.Electronic equipment 10 includes shell
105, display screen 106, the binocular vision module being made of first camera 101 and second camera 102, can also include light emitting mould
The sensors 104 such as block 103 and some sensors, such as loudspeaker, environment light/proximity sensor.
Display screen 106 can be liquid crystal display (LCD), organic light-emitting diode (OLED) display screen (OLED) etc., for showing
Application program image is also possible to the display screen of any other form according to actual needs.Display screen can also include touching simultaneously
Setting capacitance touching control electrode in function, such as display screen is touched, using the input unit as human-computer interaction.
Sensor is for sending or collecting the information such as electronic device exterior information, such as illumination, sound.Multiple sensors can
The different parts that also can be set at top in other positions or scattering device in electronic equipment are arranged.In some implementations
In example, some sensors also be can be set at the back side of electronic equipment.
Binocular vision module includes first camera 101 and second camera 102, in order to enable the electronic equipment have it is round-the-clock
Visual capacity, first camera 101 and second camera 102 be configured to infrared camera, such as to the close of 840nm or 950nm
The light beam of infrared wavelength is sensitive, certainly, in other examples can also light beam to other infrared wavelengths it is sensitive.Optical transmitter module
103, for providing corresponding infrared beam illumination, can be infrared floodlight, infrared structure light projector etc..In infrared beam
Under illumination, first camera 101 can acquire the left and right infrared image of target, two width figures with second camera 102 under different perspectives
Parallax as between pixel then reflects the three-dimensional information of target, in some embodiments, then can be based in two images
Parallax information can then recover the 3-D image of target.In order to promote screen accounting, first camera 101, second camera 102 with
And optical transmitter module 103 is arranged on 103 back side of display screen, on display screen 103 with first camera 101, second camera 102 with
And the corresponding pixel region of optical transmitter module 103 can still carry out content and show.The specific plan of establishment will be set forth later.
In one embodiment, electronic equipment can also include third camera (not shown), and third camera is for adopting
Collect visible images, such as color camera for the application such as self-timer.
In one embodiment, electronic equipment can also include more infrared cameras, such as the of infrared imaging
Four cameras etc. carry out binocular by two or more infrared cameras or multi-vision visual are imaged.
Fig. 2 is the structure composition schematic diagram according to the electronic equipment of the utility model one embodiment.Electronic equipment 20 wraps
It includes display screen 211, environment light/proximity sensor 201, infrared camera 210 and (includes at least the first infrared camera and the second infrared phase
Machine), color camera 212, processor 206, microphone 202, radio frequency and baseband processor 203, interface 204, memory 205, electricity
Pond 207, MEMS sensor 208, audio devices 209 etc. can realize data transmission by circuit connection between different units
With signal communication.Here it is only illustrated with the composed structure of one embodiment, in other embodiments, electronic equipment can also be with
Comprising less structure or include other more composed structures.Electronic equipment can be mobile phone, computer, game machine, plate,
TV, wearable device etc..
Processor 206 is used to carry out entire electronic equipment whole control, and processor 206 can be single processor
It may include multiple processor units, for example be made of the processor unit of different function.In some embodiments, processor
206 are also possible to integrated system-on-chip (SOC), include central processing unit, on-chip memory, controller, communication interface etc..?
In some embodiments, processor 206 is application processor AP, such as mobile application processor, is mainly responsible in electronic equipment and removes
Communicate the realization, such as text-processing, image procossing, recognition of face etc. of outer other function.
Display screen 211 is presented to the user for showing image under the control of processor 206 to apply etc., is in addition shown
Screen 211 also may include touch function, and display is also used as man-machine interactive interface at this time, for receiving the input of user.Generally
Protective cover, such as glass cover-plate etc. can be also arranged on 211 surface of display screen in order to protect display screen 211 not damaged in ground.
Microphone 202 can be used to realize the interactive voice with user for receiving voice messaging.
Radio frequency and baseband processor 203 are responsible for the communication function of electronic equipment, such as reception and translated speech or text etc.
Signal is to realize the information interchange between remote user.
Interface 204 is used for so that electronic equipment is attached with outside, to further realize data transmission, power transmission etc.
Function, interface 204 are controlled by the communication interface in processor 206.Interface 204 may include USB interface, WIFI interface etc..
Memory 205 is used to save data, for example application data, system data, processor 206 are in the process of implementation
The temporary designator and data of preservation.Memory 205 can be made of single or multiple memories, can be RAM, FLASH etc.
Any form of memory that can be used for saving data.It is understood that memory may act as a part of electronic equipment,
Can also exist independently of electronic equipment, such as cloud memory, the data saved can be waited by interface 204 and be set with electronics
Standby communication.Application program such as face recognition application are generally held in non-volatile readable storage medium, when the execution application
When, processor will call corresponding program to execute from the storage medium, and specific recognition of face will illustrate later.
Environment light/proximity sensor 201 can be integrated single-sensor and be also possible to independent ambient light sensing
Device and proximity sensor.Wherein ambient light sensor is used to obtain the Lighting information of current environment locating for electronic equipment, one
In a embodiment, the adjust automatically of screen intensity may be implemented based on the Lighting information, human eye is more comfortably shown with providing
Brightness;Whether proximity sensor can measure has object close to electronic equipment, some functions may be implemented based on this, for example connecing
The touch function for closing screen when answering a call when face sufficiently closes to prevents from accidentally touching.In some embodiments, proximity sensor
It can also quickly judge the approximate distance between face and electronic equipment.
Battery 207 is for providing electric power.Loudspeaker 209 is for realizing voice output.
MEMS sensor 208 is for obtaining the current status information of electronic equipment, such as position, direction, acceleration, gravity
Deng, therefore MEMS sensor 208 may include the sensors such as accelerometer, gravitometer, gyroscope.In one embodiment,
MEMS sensor 208 can be used to activate some face recognition applications, such as when user picks up electronic equipment, MEMS sensor
208 this available variation, while this variation is transferred to processor 206, processor 206 adjusts memory-aided face to know
Other application program is to carry out face recognition application.
Color camera 212 is for acquiring image, and, processor controls phase
Machine 212 acquires image, and image transmitting is shown to display.In some embodiments, camera 101 may include light field
Camera, wide angle camera, focal length camera etc..Color camera 212 can be set in any position of electronic equipment, such as preposition plane
The positions such as the top or bottom end of (identical as plane where display) etc., postposition plane, for example coloured silk is set in electronic equipment front
Form and aspect machine 212 is to acquire user's facial image;Color camera 212 is also disposed in postposition plane for taking pictures to scene
Deng.In one embodiment, color camera 212 is arranged on preposition and postposition plane, and the two can also be with independent acquisition image
It can also be controlled with device 206 processed with synchronous acquisition image.
Infrared camera 210 contains at least two infrared camera, as shown in Figure 1, multiple infrared cameras composition binocular or more mesh
Vision module.Infrared camera 210 is used to acquire the Infrared Targets image under the irradiation of corresponding infrared wavelength light beam, such as
The infrared image of 840nm or 950nm, provide illumination can be light emitting mould group as shown in Figure 1, can also be with electronic equipment
Except light source, such as environment light.After infrared camera 210 collects several Infrared Targets images, it is based on several Infrared Targets
Parallax between image can reflect or restore the depth information of target, and be realized further based on parallax or depth information
Using, such as recognition of face etc..
Fig. 3 is the electronic equipment schematic cross-section according to the utility model one embodiment, only schematically provides electricity in figure
The part of devices of sub- equipment, the electronic equipment include the first infrared camera 33, the second infrared camera 34, display screen 32 and cover board
31.Electronic equipment can also include light emitting mould group (not shown), for emit and the light beam of infrared camera corresponding wavelength,
To provide infrared illumination to target.Wherein, the first infrared camera 33 and the second infrared camera 34 exist for acquiring exterior object
Infrared image under Infrared irradiation, the first infrared camera 33 and the second infrared camera 34 form binocular vision depth camera,
When carrying out Image Acquisition, due to there is interval (also known as baseline) in the first infrared camera 33 and the second infrared camera 34 between each other
When leading to that same object is imaged, there are parallaxes between the image of acquisition, and parallax then reflects the actual distance of object,
That is depth information.
In one embodiment, field angle, resolution ratio, focal length of the first infrared camera 33 and the second infrared camera 34 etc. is joined
At least one of number is not identical.Such as first infrared camera 33 high resolution in the second infrared camera 34, the first infrared phase
First infrared image captured by machine 33 since high resolution can be applied further, such as face characteristic extract with
Recognition of face, and the second infrared image captured by the second infrared camera 34 will carry out parallax estimation or depth with the first infrared image
Degree calculates.
In one embodiment, protection is played in the surface that cover board 31 is covered on the display screen 32 for imaging for glass material
Effect, cover board 31 are also possible to other transparent materials and are made.In one embodiment, cover board 31 is also possible to the one of display screen 32
Part.
In some embodiments, electronic equipment further includes optical filter 35, and setting is in the first infrared camera 33 and display screen 32
Between, between the second infrared camera 34 and display screen 32, be configured for reducing visible light-transmissive so that external use
Family cannot observe directly the first infrared camera 33 and the second infrared camera 34, promote visual sense of beauty.
In one embodiment, optical filter 35 is optical switch, such as liquid crystal shutter, is in nontransparent shape when power is off
State, light can not pass through;Pellucidity is in when being powered, light can pass through.Optical switch is also possible to other types material
Material is made, such as electrochromic material, thermochromatic material, or allows to whether change light by certain optical texture
Pass through.
In one embodiment, optical filter 35 is single-way perspective membrane, and single-way perspective membrane allows external light logical as far as possible
It crosses display screen to enter optics module and internal light is prevented to pass through display screen, i.e., single-way perspective membrane is towards one side plane of optics module
The transmitance of visible light is less than reflectivity (for example transmitance is 5%~30%, and reflectivity is 90%~95%), and towards
One side plane of display screen for visible light transmitance be greater than reflectivity (such as transmitance be 60%~95%, reflectivity 5%
~30%).For infrared camera, single-way perspective membrane should be configured to infrared light light transmittance with higher, further, single
There is higher transmitance for infrared light towards one side plane of display screen to perspective film, transmitance generally required to be greater than reflectivity,
To ensure image quality.
In one embodiment, optical filter 35 is optical filter, for preventing visible light by making and infrared camera pair
The light beam for the range of wavelengths answered passes through.For example, when infrared camera is for when the infrared light of 840nm is imaged, optical filter to be only
Infrared light is allowed to pass through, without allowing visible light to pass through.
In one embodiment, optical filter 35 is another special optical filter, and this special optical filter is to visible
The transmitance of light is lower, and higher to the transmitance of infrared light, for example is 10%~50% to the transmitance of visible light, and to red
The transmitance of outer light is 60~99%, and external environmental light after this special optical filter by being irradiated in optics module, through light
After learning the reflection of mould group, again through this special optical filter a possibility that substantially reduce, to reach below hiding display screen the
One, the effect of two infrared cameras.
It is the situation of optical filter for optical filter 35, when a kind of preferable implementation, the first and second infrared camera only includes
Imaging sensor (such as CCD or CMOS) and imaging len, without being reconfigured optical filter, with inside traditional infrared camera
The mode of image sensor surface setting optical filter is compared, and cost and manufacture difficulty can be further reduced.
It is understood that above several optical filters are not the restriction to the utility model, it is any that similar function may be implemented
The optical filter of energy can be used in the utility model.
It is understood that optical filter 35 can be independent optical device, be also possible to the first and second infrared camera or
Person's cover board combines, for example when optical filter 35 is film, can be arranged in the form of plated film in cover board or surface optical device
Optical filter.
Fig. 4 is according to the electronic equipment schematic cross-section of another embodiment of the utility model, which includes the
One infrared camera 43, the second infrared camera 44, display screen and cover board 41.Unlike embodiment illustrated in fig. 3, display screen packet
Include at least three parts: the first sub- display screen 421, the second sub- display screen 422 and the sub- display screen 423 of third, first camera 43
It is separately positioned on the back side (or following) of the first sub- display screen 421 with the sub- display screen 423 of third with second camera 44, with further
Promote screen accounting.
In view of display screen intercycle property structure will affect the image quality of camera, (for example beam diffraction will affect imaging
Quality), the first sub- display screen 421 is configured to the performance different with the second sub- display screen 422 from the sub- display screen 423 of third.?
In one embodiment, the first sub- display screen 421 and the sub- display screen 423 of third are transparent display screen, such as by all-transparent material
Manufactured OLED display screen.At this point, the second sub- display screen 422 can be that transparent display screen is also possible to nontransparent display screen,
Generally, the cost of transparent display screen therefore can in one embodiment higher than nontransparent display screen, the second sub- display screen
422 are configured to nontransparent display screen to reduce equipment cost.
In one embodiment, the first sub- display screen 421 is also arranged as different performances from the sub- display screen 423 of third,
For example the high resolution of first infrared camera 43 corresponding with the first sub- display screen 421 is in the sub- display screen 423 of third corresponding
The resolution ratio of two infrared cameras 44, generally, the image quality of the first infrared camera 43 are also higher than the second infrared camera 44, are
This, is set below the sub- display screen 423 of third for the pixel resolution of the first sub- display screen 421, and/or, display aperture opening ratio is set
It is set to and is higher than the sub- display screen 423 of third.
It is understood that the setting of the first, second and third sub- display screen is not limited to above embodiments, in corresponding camera
Under the specific requirement of imaging, each sub- display screen can be configured accordingly.
In one embodiment, electronic equipment further includes optical filter (not shown), and setting is in first camera 43 and the
Between one sub- display screen 421, and/or it is arranged between second camera 44 and the sub- display screen 423 of third, and be configured for subtracting
Few visible light-transmissive promotes view so that external user cannot observe directly first camera 43 and/or second camera 44
Feel aesthetic feeling.Explanation in Fig. 3 about optical filter is equally applicable to the present embodiment.
For embodiment shown in Fig. 3,4, wherein infrared camera generally requires to carry out active infrared optical illumination in imaging,
Therefore relevant electronic equipment also includes the infrared light supplies such as light emitting mould group, such as infrared floodlight, infrared projector.Light hair
It penetrates mould group and is arranged below display screen and coupled with infrared camera, also be can be set in display screen aperture, or and display screen
Independent to separate, positioned at other positions of electronic equipment, when infrared camera work, infrared light supply, which is synchronized, is opened.When camera or
When light source is arranged below display screen, in order to promote imaging or lighting quality as far as possible, in display screen camera below or
(such as the first and third son display of corresponding with camera or light source pixel region on display screen in imaging perhaps illumination of person's light source
Screen) processing closed state.In one embodiment, the imaging of camera or light source or illumination frequencies just with the refresh frame of display screen
Rate is identical, and the two mutually staggers, will not interfere with each other.
Electronic equipment described in the various embodiments described above contains at least two infrared cameras, the available target for having parallax
Infrared image, is based on the electronic equipment, and the utility model also will be provided for the method for realizing recognition of face.
Shown in fig. 5 is the face identification method schematic diagram according to the electronic equipment of the utility model one embodiment.It is first
First, such as step S501, using the first infrared camera and first infrared (IR) image of the second infrared camera acquisition comprising face and
Second infrared (IR) image, the first IR image and the 2nd IR image are then transferred to processor to execute recognition of face.Secondly,
Processor carries out Face datection to the first IR image comprising face and the 2nd IR image and realizes Face datection such as step 502
There are many modes, such as in one embodiment, is utilized respectively if eigenface, neural network et al. face detection algorithm are to the first IR
Image and IR image carry out Face datection, or only can carry out face to one of the first IR image and the 2nd IR image
Detection, then determines that the face location in another image, the purpose of Face datection are according to the positional relationship between two cameras
Find out the human face region in image, according to different face recognition algorithms needs, the output of Face datection can also there are many, than
Square pixels region as only included face main feature (such as eyes, nose and mouth), or the human face region that will test out
The image exported after being normalized, or be the curved profile area image etc. comprising face.It is understood that should
The result of face datection step output is not limited to above several situations.
Again, such as step 503, the facial image in the first IR image that will test and the 2nd IR image is input to nerve
For network model to carry out recognition of face, i.e. processor will be further to the people in the first IR image detected and the 2nd IR image
Face image identified, recognition of face task includes to judge whether current face is consistent with the face pre-saved or find out to work as
Preceding face is the tasks such as one in the face database pre-saved.Herein by housebroken neural network model to the first IR
Image and the 2nd IR image directly carry out recognition of face, unlike traditional approach, do not need first to scheme the first IR here
As carrying out disparity computation with the 2nd IR image to obtain the depth information of target.The neural network model can be to the first IR image
Face characteristic extraction and recognition of face are carried out with the 2nd IR image, and needs training in advance.It such as in the training process, will be right
(" false face " described herein is primarily referred to as the two-dimensional person in photo or picture for multiple real human faces and multiple false faces
Face) the first IR image and the 2nd IR image are acquired respectively, and (real human face or false face) is labeled to these images;
Then these images are input in neural network model, the nerve net to be trained to parameters in model, after training
Network model will have three-dimensional judgement and two kinds of functions of recognition of face to the first IR image of input and the 2nd IR image.Then
In the recognition of face stage, the facial image in the first IR image currently obtained and the 2nd IR image is input to neural network
To carry out recognition of face in model.It is understood that due to the two images of the same target used in the training stage, for
Pixel in real human face two images is distinguished in the presence of parallax relevant to 3D shape, and for the false people of planar picture etc.
Face, there will be no parallaxes relevant to 3D shape to distinguish between the pixel in two images, therefore, with traditional single-view image
Trained neural network model is compared, and the neural network model trained here will be provided with three-dimensional detection function.
In one embodiment, neural network model also may include the first sub-neural network model and the second sub- nerve net
Network model, wherein whether the first sub-neural network model is for realizing being vertical to face in the first IR image and the 2nd IR image
Body face is detected, and the second sub-neural network model is known for realizing to the face of first and/or the 2nd in IR image
Not.First sub-neural network model the training stage input be the first IR image being collected in advance, the 2nd IR image and
Whether be real human face markup information;And what the second sub-neural network model inputted in the training stage is the first IR image and
At least one of two IR images.In cognitive phase, will first with the first sub-neural network model to the first IR image and
Whether the face in the 2nd IR image is that real human face (whether being stereoscopic face) is detected, if testing result is true people
Face just will do it the recognition of face of next step, i.e., using the second sub-neural network model in the first IR image and the 2nd IR image
At least one carry out recognition of face.That is the face figure in the first IR image and the 2nd IR image that will test in step S503
As being input in neural network model to carry out recognition of face;The step is again the following steps are included: firstly, the first IR image of detection
And whether the 2nd face in IR image is stereoscopic face;Then, in the first IR image and/or the 2nd IR image
Face is identified.
Relevant instruction finally is executed further according to recognition result, for example face unlock application or recognition of face payment are answered
With if identifying, current face is consistent with pre-stored face, will execute unlock or payment instruction.
Above is carried out in the method for recognition of face using the first IR image and the 2nd IR image, due to not needing to calculate
Depth image, and disparity computation needs to consume biggish computing resource and causes speed slow, so as to save computing resource with
Promote user experience.
Electronic equipment provided by the utility model at least possesses following beneficial to effect compared with traditional device and method
Fruit: firstly, screen accounting is lower.Due to being arranged the devices such as infrared camera, infrared light supply under screen, the same of recognition of face is being realized
When as big as possible improve screen accounting.Then recognition efficiency is higher.Two width IR images are directly subjected to recognition of face, without warp
The biggish algorithmic procedure of this calculation amount of disparity computation is crossed, recognition of face efficiency can be significantly promoted, promotes user experience.
In the description of the present invention, it should be noted that term " center ", " longitudinal direction ", " transverse direction ", "upper", "lower",
The orientation or positional relationship of the instructions such as "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom" "inner", "outside" is
It is based on the orientation or positional relationship shown in the drawings, is merely for convenience of describing the present invention and simplifying the description, rather than indicate
Or imply that signified device or element must have a particular orientation, be constructed and operated in a specific orientation, therefore cannot understand
For limitations of the present invention.In addition, term " first ", " second " are used for description purposes only, and should not be understood as instruction or
Imply relative importance.
In the description of the present invention, it should be noted that unless otherwise clearly defined and limited, term " is pacified
Dress ", " connected ", " connection " shall be understood in a broad sense, for example, it may be being fixedly connected, may be a detachable connection, or integrally
Connection;It can be mechanical connection, be also possible to be electrically connected;Can be directly connected, can also indirectly connected through an intermediary,
It can be the connection inside two elements.For the ordinary skill in the art, on can understanding as the case may be
State the concrete meaning of term in the present invention.
It should be noted that it can directly on the other element when element is referred to as " being fixed on " another element
Or there may also be elements placed in the middle.When an element is considered as " connection " another element, it, which can be, is directly connected to
To another element or it may be simultaneously present centering elements.Term as used herein " vertical ", " horizontal ", " left side ",
" right side " and similar statement for illustrative purposes only, are not meant to be the only embodiment.
Unless otherwise defined, all technical and scientific terms used herein are led with the technology for belonging to the utility model
The normally understood meaning of the technical staff in domain is identical.Terminology used in the description of the utility model herein only be
The purpose of description specific embodiment, it is not intended that in limitation the utility model.Each technical characteristic of embodiment described above
It can be combined arbitrarily, for simplicity of description, not to all possible combination of each technical characteristic in above-described embodiment
It is all described, as long as being all considered to be the model of this specification record however, there is no contradiction in the combination of these technical features
It encloses.
It may be noted that each step/component described in this application can be split as more multistep according to the needs of implementation
Two or more step/components or the part operation of step/component can also be combined into new step/component by suddenly/component,
To realize the purpose of this utility model.
The above-mentioned face identification method according to the utility model electronic equipment can realize in hardware, firmware, or by reality
It is now the software or computer code that are storable in recording medium (such as CD ROM, RAM, floppy disk, hard disk or magneto-optic disk), or
Person is implemented through the original storage of network downloading in long-range recording medium or nonvolatile machine readable media and will be stored
Computer code in local recording medium, so that method described herein, which can be stored in, uses general purpose computer, dedicated
Such software processing on processor or the programmable or recording medium of specialized hardware (such as ASIC or FPGA).It can manage
Solution, computer, processor, microprocessor controller or programmable hardware include that can store or receive software or computer code
Storage assembly (for example, RAM, ROM, flash memory etc.), when the software or computer code are by computer, processor or hardware access
And when executing, processing method described herein is realized.In addition, when general purpose computer accesses for realizing the processing being shown here
When code, general purpose computer is converted to the special purpose computer for being used for executing the processing being shown here by the execution of code.
It, cannot the above content is specific preferred embodiment further detailed description of the utility model is combined
Assert that the specific implementation of the utility model is only limited to these instructions.For those skilled in the art of the present invention
For, without departing from the concept of the premise utility, several equivalent substitute or obvious modifications, and performance can also be made
Or purposes is identical, all shall be regarded as belonging to the protection scope of the utility model.