CN109840475A - Face identification method and electronic equipment - Google Patents
Face identification method and electronic equipment Download PDFInfo
- Publication number
- CN109840475A CN109840475A CN201811628451.4A CN201811628451A CN109840475A CN 109840475 A CN109840475 A CN 109840475A CN 201811628451 A CN201811628451 A CN 201811628451A CN 109840475 A CN109840475 A CN 109840475A
- Authority
- CN
- China
- Prior art keywords
- camera
- display screen
- image
- face
- sub
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 238000005286 illumination Methods 0.000 claims abstract description 13
- 230000015654 memory Effects 0.000 claims abstract description 13
- 230000005055 memory storage Effects 0.000 claims abstract description 3
- 230000003287 optical effect Effects 0.000 claims description 42
- 238000003062 neural network model Methods 0.000 claims description 18
- 238000003384 imaging method Methods 0.000 claims description 17
- 230000004438 eyesight Effects 0.000 claims description 12
- 238000012549 training Methods 0.000 claims description 8
- 230000005540 biological transmission Effects 0.000 claims description 5
- 230000001815 facial effect Effects 0.000 claims description 5
- 239000012780 transparent material Substances 0.000 claims description 5
- 238000001514 detection method Methods 0.000 abstract description 9
- 230000006870 function Effects 0.000 description 15
- 230000000875 corresponding effect Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 9
- 239000000203 mixture Substances 0.000 description 7
- 238000002310 reflectometry Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 239000012528 membrane Substances 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 239000000463 material Substances 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 238000003860 storage Methods 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000003796 beauty Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 210000000887 face Anatomy 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000004321 preservation Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000001727 in vivo Methods 0.000 description 1
- 238000003331 infrared imaging Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000004218 nerve net Anatomy 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 238000009738 saturating Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
Landscapes
- Controls And Circuits For Display Device (AREA)
Abstract
The present invention proposes a kind of face identification method, comprising: S1: receiving RGB image and IR image comprising face；S2: the face in detection image；S3: the face detected is identified；S4: relevant instruction is executed according to recognition result.The present invention also proposes a kind of electronic equipment, including shell, display screen, the first, second camera, light emitting mould group, memory and processor, first, second camera is respectively used to RGB image and IR image of the acquisition comprising face, light emitting mould group is used to provide infrared illumination to second camera, first, second camera forms binocular depth camera, and the back side of display screen is arranged in second camera；Memory storage has program；Processor runs described program, to execute above-mentioned face identification method for controlling electronic devices.Face identification method and electronic equipment of the invention can not only carry out accurately recognition of face, also have lower cost, higher screen accounting.
Description
Technical field
The present invention relates to electronic technology field, in particular to a kind of face identification method and electronic equipment.
Background technique
The depth camera that available depth and color image (RGBD) are arranged on intelligent terminal has been increasingly becoming
Trend can carry out the functions such as human face rebuilding, recognition of face and payment by depth information.Based on structure light (SL) technology, when
Between the depth camera of flight method (TOF) technology be successfully applied on a variety of smart machines, however asked at present there are still some
Topic.
Depth camera based on structure light SL and time flight method TOF technology includes projective module group and acquisition mould
Group completes RGBD image collecting function and needs to integrate multiple devices along with the color camera mould group for extracting color image,
Lead to that at high cost, volume is big, this limits to very much for some micromodule equipments, such as mobile phone.
In addition, can not only be reduced in the equipment with display using the depth camera being made of multiple optics modules
The screen accounting of equipment, excessive mould group also can larger production design difficulty so that product is unsightly.
Summary of the invention
The purpose of the present invention is to solve use in the equipment for having display in the prior art by multiple optics modules
The depth camera of composition, screen accounting is lower, and the design difficulty of product is big, the inaesthetic problem of product, proposes one kind
Face identification method and electronic equipment.
Face identification method of the invention, comprising the following steps: S1: RGB image and IR image comprising face are received；
S2: the face in the RGB image and IR image is detected；S3: the RGB image detected and the face in IR image are known
Not；S4: relevant instruction is executed according to recognition result.
In a preferred embodiment, the step S3 includes following sub-step: S31: the RGB image is converted into ash
Spend image；S32: the depth information of face in the gray level image and the IR image is calculated using Binocular Vision Principle；
S33: recognition of face is carried out in conjunction at least one of the depth information and the RGB image, gray level image or IR image.
In a preferred embodiment, the step S3 includes following sub-step: S31: establishing and trains neural network mould
Type；S32: the facial image in the RGB image currently obtained and IR image is input in neural network model to carry out face
Identification.It is highly preferred that the step S32 is again the following steps are included: S321: detecting in the RGB image and the IR image
Whether face is stereoscopic face；S322: the face in the RGB image and/or the IR image is identified.
Electronic equipment of the invention, including shell, setting are in positive display screen, first camera, second camera, He Guangfa
Mould group, memory and processor are penetrated, the first camera is for acquiring the image of external people or object under visible light illumination, institute
It states second camera and is used for for acquiring infrared image of the external people or object under Infrared irradiation, the light emitting mould group to institute
It states second camera and infrared illumination is provided, the first camera and second camera form binocular depth camera, the second camera
The back side of the display screen is set；The memory storage has program；The processor runs described program, to control
It states first camera and the second camera acquires RGB image and IR image comprising face respectively, and the control electronics is set
It is standby to execute any of the above face identification method.
In a preferred embodiment, the first camera is independently arranged with the display screen；Alternatively, the first camera
Couple setting with the display screen, the centre of the display screen or edge have a through-hole, the first camera setting with
At the corresponding position of the through-hole, the corresponding display screen area of the through-hole is used for through light beam and is not used in display image,
And only allow light beam through the image quality to ensure the first camera.
In a preferred embodiment, the first camera and second camera are arranged at the back side of the display screen, institute
Stating display screen includes the first sub- display screen, the second sub- display screen and the sub- display screen of third, and the first camera and second camera are divided
The back side of described first sub- display screen and the sub- display screen of third is not set.It is highly preferred that the first sub- display screen and third
Sub- display screen is transparent display screen, and the first sub- display screen is the transparent window made of transparent material, is only used for allowing light
Beam passes through, and is not used in display；The sub- display screen of third is for display imaging and light beam is allowed to pass through, the sub- display screen of third
The resolution ratio of second sub- display screen described in resolution ratio is low, and the display aperture opening ratio of the sub- display screen of third is more aobvious than second son
The display aperture opening ratio of display screen is high.
In a preferred embodiment, the light emitting mould group is independently arranged with the display screen；Alternatively, the light emitting
Mould group couples setting with the display screen, and the back side of the display screen is arranged in the light emitting mould group, or setting is being shown
In the aperture of screen.
In a preferred embodiment, it is additionally provided with optical filter between the second camera and the display screen, for subtracting
The transmission of few visible light.It is highly preferred that the optical filter is optical switch, it is in non-transparent state when power is off, light can not
Pass through, pellucidity is in when being powered, light can pass through；Alternatively, the optical filter is single-way perspective membrane, it is described unidirectional saturating
Reflectivity, the side plane pair towards display screen are less than for the transmitance of visible light to a side plane of optics module depending on film surface
It is greater than reflectivity in the transmitance of infrared light, is prevented so that external infrared light be allowed to enter optics module by display screen
Internal light passes through display screen；Alternatively, the optical filter is optical filter, for preventing visible light by making and described second
The light beam in camera corresponding wavelength section passes through；And when the optical filter is optical filter, the second camera only includes image
Sensor and imaging len, without being reconfigured optical filter.
Compared with prior art, the beneficial effects of the present invention are as follows:
Face identification method and electronic equipment of the invention, using first camera and second camera composition binocular camera into
Row recognition of face, and the second camera device for acquiring infrared image is arranged under screen, accurately face can not only be carried out
Identification also has lower cost, higher screen accounting.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
The attached drawing of other embodiments is obtained according to these attached drawings.
Fig. 1 is the structure composition schematic diagram of the electronic equipment of one embodiment of the invention.
Fig. 2 is the electronic equipment front schematic view of one embodiment of the invention.
Fig. 3 is the electronic equipment front schematic view of another embodiment of the present invention.
Fig. 4 is the electronic equipment front schematic view of another embodiment of the invention.
Fig. 5 is the electronic equipment front schematic view of another embodiment of the invention.
Fig. 6 is the cross section structure schematic diagram of the electronic equipment of one embodiment of the invention.
Fig. 7 is the cross section structure schematic diagram of the electronic equipment of another embodiment of the present invention.
Fig. 8 is the face identification method schematic diagram of one embodiment of the invention.
Fig. 9 is the method schematic diagram that recognition of face is carried out using RGB image and IR image of one embodiment of the invention.
Figure 10 is that the method for carrying out recognition of face using RGB image and IR image of another embodiment of the invention is illustrated
Figure.
Specific embodiment
With reference to embodiment and compares attached drawing the present invention is described in further details.Wherein identical attached drawing
Label indicates identical component, unless stated otherwise.It is emphasized that following the description is only exemplary, without
It is to limit the scope of the invention and its apply.
Fig. 1 is the structure composition schematic diagram of electronic equipment according to an embodiment of the invention.Electronic equipment 10 includes aobvious
Display screen 111, environment light/proximity sensor 101, camera 112, depth camera 110, processor 106, microphone 102, radio frequency and base
Provided with processor 103, interface 104, memory 105, battery 107, MEMS sensor 108, audio devices 109 etc., different units
Between can pass through circuit connection realize data transmission and signal communication.Here it is only said with the composed structure of one embodiment
Bright, in other embodiments, electronic equipment also may include less structure or comprising other more composed structure.Electronics
Equipment can be mobile phone, computer, game machine, plate, TV, wearable device etc..
Processor 106 is used to carry out entire electronic equipment whole control, and processor 106 can be single processor
It may include multiple processor units, for example be made of the processor unit of different function.In some embodiments, processor
106 are also possible to integrated system-on-chip (SOC), include central processing unit, on-chip memory, controller, communication interface etc..?
In some embodiments, processor 106 is application processor AP, such as mobile application processor, is mainly responsible in electronic equipment and removes
Communicate the realization, such as text-processing, image procossing, recognition of face etc. of outer other function.
Display screen 111 is presented to the user for showing image under the control of processor 106 to apply etc., is in addition shown
Screen 111 also may include touch function, and display is also used as man-machine interactive interface at this time, for receiving the input of user.Generally
Cover board, such as glass cover-plate protective cover can be also arranged on 111 surface of display screen in order to protect display screen 111 not damaged in ground
Deng.
Microphone 102 can be used to realize the interactive voice with user for receiving voice messaging.
Radio frequency and baseband processor 103 are responsible for the communication function of electronic equipment, such as reception and translated speech or text etc.
Signal is to realize the information interchange between remote user.
Interface 104 is used for so that electronic equipment is attached with outside, to further realize data transmission, power transmission etc.
Function, interface 104 are controlled by the communication interface in processor 106.Interface 104 may include USB interface, WIFI interface etc..
Memory 105 is used to save data, for example application data, system data, processor 106 are in the process of implementation
The temporary designator and data of preservation.Memory 105 can be made of single or multiple memories, can be RAM, FLASH etc.
Any form of memory that can be used for saving data.It is understood that memory may act as a part of electronic equipment,
Can also exist independently of electronic equipment, such as cloud memory, the data saved can be waited by interface 104 and be set with electronics
Standby communication.Application program such as face recognition application are generally held in non-volatile readable storage medium, when the execution application
When, processor will call corresponding program to execute from the storage medium, and specific recognition of face will illustrate later.
Environment light/proximity sensor 101 can be integrated single-sensor and be also possible to independent ambient light sensing
Device and proximity sensor.Wherein ambient light sensor is used to obtain the Lighting information of current environment locating for electronic equipment, one
In a embodiment, the adjust automatically of screen intensity may be implemented based on the Lighting information, human eye is more comfortably shown with providing
Brightness；Whether proximity sensor can measure has object close to electronic equipment, some functions may be implemented based on this, for example connecing
The touch function for closing screen when answering a call when face sufficiently closes to prevents from accidentally touching.In some embodiments, proximity sensor
It can also quickly judge the approximate distance between face and electronic equipment.
Battery 107 is for providing electric power.Loudspeaker 109 is for realizing voice output.
MEMS sensor 108 is for obtaining the current status information of electronic equipment, such as position, direction, acceleration, gravity
Deng, therefore MEMS sensor 108 may include the sensors such as accelerometer, gravitometer, gyroscope.In one embodiment,
MEMS sensor 108 can be used to activate some face recognition applications, such as when user picks up electronic equipment, MEMS sensor
108 this available variation, while this variation is transferred to processor 106, processor 106 calls the people of memory 105
Face recognition application is to carry out face recognition application.
Camera 112 is for acquiring image, and, processor controls camera 112
Image is acquired, and image transmitting is shown to display.In some embodiments, the unlock journey such as based on recognition of face
Sequence, when unlocking program activation, camera acquires image, and processor handles image, including human face detection and tracing, and root
Unlock task is executed according to recognition result.Camera 112 can be single camera and be also possible to multiple cameras；In some embodiments,
Camera 112 can also may include acquisition black light comprising RGB camera, the gray scale camera for acquiring visible optical information
The infrared of information, ultraviolet-cameras etc.；In some embodiments, camera 112 may include light-field camera, wide angle camera, focal length phase
Machine etc..
Camera 112 can be set in any position of electronic equipment, for example preposition plane is (with plane phase where display screen
The positions such as top or bottom end together) etc., postposition plane, in the embodiment shown in fig. 1, electronic equipment front are provided with camera 112
For acquiring user's facial image；Camera 112 is also disposed in postposition plane for taking pictures etc. to scene.Implement at one
In example, camera 112 is arranged on preposition and postposition plane, and the two can be with independent acquisition image also with device 106 processed control
System is with synchronous acquisition image.When camera 112 is arranged on preposition plane, it can both be independently arranged and be also possible to display screen 111
When coupling setting, for example being independently arranged, camera 112 is placed in the electronics area on 111 periphery of display screen, when coupling is set
When setting, camera 112 is arranged in the through-hole of display screen 111, is specifically detailed in subsequent elaboration.
Depth camera 110 can be the depth camera of the technologies such as structure light, time flight (TOF), binocular vision, be used for
Target depth image is obtained, relevant application, such as human face rebuilding, In vivo detection can further be executed based on the depth image
Etc., it will be illustrated by taking binocular vision depth camera as an example in the present invention.
In order to promote the screen accounting of electronic equipment as far as possible, the present invention, which takes, merges depth camera 110 with camera 112
Mode realizes identical function with less device to reduce cost, reduce power consumption, or at least partly device setting is being shielded
Act or less with further promotion shield accounting.
Fig. 2 is electronic equipment front schematic view according to an embodiment of the invention.Electronic equipment 20 include shell 205,
The sensor at positive display screen 204 and top is set, wherein the sensor at top includes first camera 201, the second phase
Machine 202, light emitting mould group 203 can also include such as loudspeaker, environment light/proximity sensor sensor (not shown).
Display screen 204 can be liquid crystal display (LCD), organic light-emitting diode (OLED) display screen (OLED) etc., for showing application program
Image is also possible to the display screen of any other form according to actual needs.Display screen 204 simultaneously can also be comprising touching function
Can, for example capacitance touching control electrode is set in display screen, using the input unit as human-computer interaction.
Multiple sensors can be set at top, also can be set at other positions or scattering device in electronic equipment
Different parts.In some embodiments, some sensors also can be set at the back side of electronic equipment.Sensor is for sending
Or collect the information such as electronic device exterior information, such as illumination, sound.
In the embodiment depicted in figure 2, first camera 201 can be used for acquiring the figure of exterior object under visible light illumination
Picture, such as color image or White-light image, second camera 202 is used to acquire infrared image of the exterior object under Infrared irradiation,
Light emitting mould group 103 can be at least one of the infrared light supplies or flash lamp such as infrared floodlight, infrared projector, be used for
Illumination is provided to first camera 201 and/or second camera 202 under the application of part scene, can be sent out by vertical cavity surface laser
The optical elements such as the light sources such as emitter (VCSEL), light emitting diode (LED) and diffusing globe, diffraction optical element (DOE) composition, light
Emitting mould train 103 can also be approached the replacement of the light source in sensor or the two is mutually integrated.Preferably, light emitting mould group
103 include infrared light supply, for providing infrared illumination to second camera 202.
In the embodiment depicted in figure 2, first camera 201, light emitting mould group 203 are independently arranged with display screen 204, and second
Camera 202 is arranged on the display screen back side, and first camera 201 and second camera 202 form binocular vision depth camera, to realize
To the recognition capability of target object depth information.It is understood that compared with the prior art, since second camera 202 is set
It sets at the display screen back side, in contrast, reduces the area requirements in display screen peripheral region to a certain extent, to improve
Shield accounting.
Fig. 3 is electronic equipment front schematic view in accordance with another embodiment of the present invention.Electronic equipment 30 includes shell
305, the sensor at positive display screen 304 and top is set, wherein the sensor at top includes first camera 301, the
Two cameras 302, light emitting mould group 303.Unlike embodiment illustrated in fig. 2, first camera 301 is no longer and display screen independence
Setting, but couple setting, i.e., first camera 301 is arranged at position corresponding with through-hole 306 in display screen 304, shows
The corresponding region of through-hole 306 in display screen 304 is no longer used to display image, and light beam is only allowed to penetrate to ensure first camera 301
Image quality.In addition, light emitting mould group 303 and second camera 302 are equally arranged on the display screen back side in the present embodiment.
Compared with Fig. 2, the electronic equipment of the present embodiment has higher screen accounting.Other are equally applicable to this implementation to the explanation of Fig. 2
Example.It is understood that the shape of through-hole 306 may include arbitrary form, such as round, rectangular or irregular form.
Fig. 4 is the electronic equipment front schematic view of another embodiment according to the present invention.Electronic equipment 40 includes shell
405, the sensor at positive display screen 404 and top is set, wherein the sensor at top includes first camera 401, the
Two cameras 402, light emitting mould group 403.Compared with embodiment illustrated in fig. 3, the through-hole 406 that display screen 404 is opened is located at the side of screen
Edge position, first camera 401 are arranged on the corresponding position of through-hole 406, and in contrast, the present embodiment has higher screen and accounts for
Than.Other are equally applicable to the present embodiment to the explanation of Fig. 2, Fig. 3.
Fig. 5 is the electronic equipment front schematic view of another embodiment according to the present invention.Electronic equipment 50 includes shell
505, the sensor at positive display screen 504 and top is set, wherein the sensor at top includes first camera 501, the
Two cameras 502, light emitting mould group 503.Compared with Fig. 3 and embodiment illustrated in fig. 4, first camera 501, second camera 502 and light
Emitting mould train 503 is arranged at the back side of display screen 504, and in contrast, the present embodiment has higher screen accounting.Other are to figure
2, the explanation of Fig. 3, Fig. 4 are equally applicable to the present embodiment.
The merely exemplary setting signal for providing several sensors of the above various embodiments, it is to be understood that sensor is set
It is remote unlikely above several with position to set mode.For example first camera horizontal, vertical, diagonal can be arranged with second camera, first
Parallax range between camera and second camera according to actual needs can be larger or smaller, in addition first camera, second
Camera also can be set at screen centerline position, middle position or any other position.
Details relationship between first camera, second camera and screen be set forth below.
Fig. 6 is the section arrangement schematic diagram of electronic equipment according to an embodiment of the invention, is only schematically provided in figure
The part of devices of electronic equipment, the electronic equipment include first camera 63, second camera 64, display screen 62 and cover board 61.It is aobvious
Display screen 62 is provided with through-hole (or as shown in Fig. 2, first camera 63 and display screen 62 are independently arranged) in the position of first camera 63,
Camera is arranged in the corresponding region of through-hole, is specifically arranged in through-hole, and through-hole here can be among display screen
Hole (as shown in Figure 3), be also possible to show platen edge notch (as shown in Figure 4) etc..Second camera 64 is arranged on aobvious
62 back side of display screen (or lower section) through the light beam of display screen 62 and is imaged with reception from electronic device exterior.At one
In embodiment, electronic equipment further includes light emitting mould group (not shown), such as infrared light supply.
Wherein, first camera 63 is for acquiring the image of exterior object under visible light illumination, such as color image or white light
Image, second camera 64 is for acquiring infrared image of the exterior object under Infrared irradiation, first camera 63 and second camera
64 composition binocular vision depth cameras, when carrying out Image Acquisition, first camera 63 is with second camera 64 due to depositing between each other
When at interval, (also known as baseline) leads to that same object is imaged, there are parallaxes between the image of acquisition, and parallax is then anti-
Mirror the actual distance of object, i.e. depth information.Unlike traditional binocular, binocular here is using different wave length
Image camera, i.e., it is infrared camera that one, which is Visible Light Camera one, it is advantageous that the more feature letters of available target
Breath, this setting also have biggish advantage when carrying out face recognition application, are specifically shown in subsequent explanation.
In one embodiment, in the parameters such as field angle, resolution ratio, focal length of first camera 63 and second camera 64 extremely
Few one not identical.For example the high resolution of first camera 63 is in second camera 64, and other than it can carry out Depth Imaging,
One camera 63 can also be individually used for progress visible light and take pictures, and second camera 64 is only used in binocular imaging；Or second
The field angle of camera 64 be less than first camera 63 field angle, finer subject image available in this way, be conducive into
Row human face detection and tracing.
In one embodiment, protection is played in the surface that cover board 61 is covered on the display screen 62 for imaging for glass material
Effect, cover board 61 are also possible to other transparent materials and are made.In one embodiment, cover board 61 is also possible to the one of display screen 62
Part.
In some embodiments, electronic equipment further includes optical filter (not shown), and setting is in second camera 64 and shows
It between display screen 62, and is configured for reducing visible light-transmissive, so that external user cannot observe directly second
Camera 64 promotes visual sense of beauty.
In one embodiment, optical filter is optical switch, such as liquid crystal shutter, is in nontransparent shape when power is off
State, light can not pass through；Pellucidity is in when being powered, light can pass through.Optical switch is also possible to other types material
Material is made, such as electrochromic material, thermochromatic material, or allows to whether change light by certain optical texture
Pass through.
In one embodiment, optical filter is single-way perspective membrane, and single-way perspective membrane allows external light to pass through as far as possible
Display screen enters optics module and internal light is prevented to pass through display screen, i.e., single-way perspective membrane is towards one side plane pair of optics module
It is less than reflectivity (for example transmitance is 5%~30%, and reflectivity is 90%~95%) in the transmitance of visible light, and towards aobvious
One side plane of display screen for visible light transmitance be greater than reflectivity (such as transmitance be 60%~95%, reflectivity be 5%~
30%).When second camera 64 is infrared camera, single-way perspective membrane should be configured to infrared light light transmittance with higher,
Further, single-way perspective membrane has higher transmitance for infrared light towards one side plane of display screen, generally requires transmitance
Greater than reflectivity, to ensure image quality.
In one embodiment, optical filter is optical filter, for preventing visible light right with second camera 64 by making
The light beam for the range of wavelengths answered passes through.For example, when second camera 64 is used to that the infrared light of 840nm to be imaged, optical filter
Only infrared light is allowed to pass through, without allowing visible light to pass through.
In one embodiment, optical filter is another special optical filter, and this special optical filter is to visible light
Transmitance it is lower, it is and higher to the transmitance of infrared light, for example be 10%~50% to the transmitance of visible light, and to infrared
The transmitance of light is 60~99%, and external environmental light after this special optical filter by being irradiated in optics module, through optics
After the reflection of mould group, substantially reduced again through a possibility that this special optical filter, to reach the second phase below hiding cover board
The effect of machine 64.
It is the situation of optical filter for optical filter, one kind is preferably achieved in that, second camera 54 is only passed comprising image
Sensor (such as CCD or CMOS) and imaging len are passed with inside traditional infrared camera in image without being reconfigured optical filter
The mode of sensor surfaces setting optical filter is compared, and cost and manufacture difficulty can be further reduced.
It is understood that above several optical filters are not limitation of the invention, any similar functions that may be implemented
Optical filter can be used in the present invention.
It is understood that optical filter can be independent optical device, it is also possible to and second camera 54 or cover board
It combines, such as when optical filter is film, can be arranged in the form of plated film in cover board or second camera surface optical device
Optical filter.
Fig. 7 is the section arrangement schematic diagram of electronic equipment in accordance with another embodiment of the present invention.The electronic equipment includes
First camera 73, second camera 74, display screen and cover board 71.First camera 73 is for acquiring exterior object in radiation of visible light
Under image, such as color image or White-light image, second camera 74 is infrared under Infrared irradiation for acquiring exterior object
Image, first camera 73 and second camera 74 form binocular vision depth camera.Compared with embodiment illustrated in fig. 6, display screen packet
Include at least three parts: the first sub- display screen 721, the second sub- display screen 722 and the sub- display screen 723 of third.
In view of display screen intercycle property structure will affect the image quality of camera, (for example beam diffraction will affect imaging
Quality), the first sub- display screen 721 is configured to the performance different with the second sub- display screen 722 from the sub- display screen 723 of third.?
In one embodiment, the first sub- display screen 721 and the sub- display screen 723 of third are transparent display screen, such as by all-transparent material
Manufactured OLED display screen.At this point, the second sub- display screen 722 can be that transparent display screen is also possible to nontransparent display screen,
Generally, the cost of transparent display screen therefore can in one embodiment higher than nontransparent display screen, the second sub- display screen
722 are configured to nontransparent display screen to reduce equipment cost.
In one embodiment, the first corresponding first camera 73 of sub- display screen 721 is Visible Light Camera, in order to promote the
The image quality of one camera 73, the first sub- display screen 721 are configured to the transparent window made of transparent material, are only used for allowing light
Beam passes through, and is not used in display；The third corresponding second camera 74 of sub- display screen 723 is infrared camera, in some applications, infrared
Camera is relatively lower to the quality requirement of imaging, therefore the sub- display screen 723 of third still can be used for showing imaging, but resolution ratio,
The performances such as aperture opening ratio and the second sub- 722 different from of display screen, such as resolution ratio are relatively low, and display aperture opening ratio is relatively high.
It is understood that the setting of the first, second and third sub- display screen is not limited to above embodiments, in corresponding camera
Under the specific requirement of imaging, each sub- display screen can be configured accordingly.
In one embodiment, electronic equipment further includes optical filter (not shown), and setting is in second camera 74 and the
It between three sub- display screens 723 and is configured to reduce visible light-transmissive, so that external user cannot observe directly the
Two cameras 74 promote visual sense of beauty.Explanation in Fig. 6 about optical filter is equally applicable to the present embodiment.
For embodiment shown in Fig. 6,7, wherein infrared camera generally requires to carry out active infrared optical illumination in imaging,
Therefore relevant electronic equipment also includes the infrared light supplies such as light emitting mould group, such as infrared floodlight, infrared projector.Light hair
It penetrates mould group and is arranged below display screen and coupled with infrared camera, also be can be set in display screen aperture, or and display screen
Independent to separate, positioned at other positions of electronic equipment, when infrared camera work, infrared light supply, which is synchronized, is opened.When camera or
When light source is arranged below display screen, in order to promote imaging or lighting quality as far as possible, in display screen camera below or
(such as the first and third son display of corresponding with camera or light source pixel region on display screen in imaging perhaps illumination of person's light source
Screen) it is in close state.In one embodiment, the imaging of camera or light source or illumination frequencies just with the refreshing of display screen
Frame per second is identical, and the two mutually staggers, will not interfere with each other.
Electronic equipment described in the various embodiments described above contains at least two cameras, i.e., for carrying out the of visual light imaging
One camera and second camera for infrared imaging, are based on the electronic equipment, and the present invention also will be provided for realizing that face is known
Method for distinguishing.
Shown in Fig. 8 is face identification method schematic diagram according to an embodiment of the invention.Firstly, such as step S801,
Using Visible Light Camera and infrared camera (being illustrated by taking color camera as an example) acquisition comprising face RGB image with it is infrared
Image, RGB image and infrared (IR) image are then transferred to processor to execute recognition of face, such as step S801.Secondly, place
Reason device carries out Face datection to the RGB image comprising face and IR image and realizes that the mode of Face datection has such as step S802
It is a variety of, such as in one embodiment, be utilized respectively such as eigenface, neural network et al. face detection algorithm to RGB image and
IR image carries out Face datection, or only can carry out Face datection to one of RGB image and IR image, then according to two
Positional relationship between a camera determines that the face location in another image, the purpose of Face datection are the faces found out in image
Region, according to different face recognition algorithms needs, the output of Face datection can also there are many, such as it is only main comprising face
The square pixels region of feature (such as eyes, nose and mouth), or the human face region that will test out be normalized after export
Image, or be the curved profile area image etc. comprising face.It is understood that the face datection step exports
Result be not limited to above several situations.
Again, such as step S803, processor will further know the RGB image detected and the face in IR image
Not, recognition of face task is preparatory comprising judging whether current face is consistent with the face pre-saved or finds out current face
The tasks such as one in the face database of preservation.Theoretically, recognition of face can be completed merely with RGB image or IR image,
But since RGB image and IR image are two dimensional images, it is easy to be cracked by human face photo.It in this step, will be sharp simultaneously
Recognition of face is carried out with RGB image and IR image, there are parallaxes by between two images to realize the solid detection to face
To promote the precision and safety of recognition of face.Last such as step S804, executes relevant instruction further according to recognition result, than
Application or recognition of face payment application such as are unlocked for face, current face is consistent with pre-stored face if identifying, will hold
Row unlock or payment instruction.Further, it will be explained later using the method that RGB image carries out recognition of face with IR image
It states.
Fig. 9 is that the method according to an embodiment of the invention for carrying out recognition of face using RGB image and IR image is illustrated
Figure.Firstly, RGB image is converted into gray level image, i.e., the color image of script triple channel is converted into single-pass such as step S901
The gray level image in road, the mode of conversion is by a variety of, for example directly selects one of RGB triple channel as gray level image, or
Three-channel data calculated by certain formula to be converted into a manner of single channel numerical value etc..Secondly, being utilized such as step S902
Binocular Vision Principle calculates the depth information of face in gray level image and IR image；Generally, to gray level image and IR image
The matching of correlated characteristic is carried out after carrying out the detection of face characteristic, then calculates the parallax between each feature, is based on two phases
The depth value of pixel where relative positional relationship and trigonometry between machine can directly calculate feature.Finally, as walked
Rapid S903 carries out recognition of face in conjunction with depth information, since depth information reflects the three-dimensional of real human face, it is possible thereby to avoid
The misrecognition that 2-dimentional photo occurs.Specifically, it can combine in depth information and RGB, gray level image or IR image at least
A kind of carry out recognition of face, for example three-dimensional judgement is carried out to face using depth information, if three-dimensional then utilize RGB image, ash
Degree at least one of image and IR image carry out face characteristic extraction and recognition of face with identify face attribute (whether
It is identical as target face or whether be some face in target face database)；Last such as step S904, further according to recognition result
Execute relevant instruction.In one embodiment, human eye sight can also be detected using depth information, it is current to judge
Whether sight falls into target area, if then carrying out subsequent instructions execution, (does not know otherwise it is assumed that current human eye is not watched attentively
Not Yi Tu), do not execute subsequent instructions, thus it can be prevented that accidentally touching (misrecognition).
Above is carried out in the method for recognition of face using RGB image and IR image, due to needing to calculate depth image,
And disparity computation needs to consume biggish computing resource and causes speed slow, recognition speed is low, so that user experience is bad.
Figure 10 is that the method for carrying out recognition of face with IR image using RGB image of another embodiment according to the present invention is shown
It is intended to.Firstly, such as step S1001, establish simultaneously training neural network model, the neural network model can to RGB image and
IR image carries out face characteristic extraction and recognition of face.It in the training process, will be to multiple real human faces and multiple false people
Face acquires RGB image and IR image respectively, and is labeled to these images；Then these RGB images and IR image are inputted
Into neural network model, to be trained to parameters in model, the neural network model after training will be to the RGB of input
Image and IR image have three-dimensional judgement and two kinds of functions of recognition of face.Then in recognition of face stage, such as step
Facial image in the RGB image currently obtained and IR image is input in neural network model to carry out face knowledge by S1002
Not.It is understood that due to the two images of the same target used in the training stage, in real human face two images
Pixel distinguished in the presence of parallax relevant to 3D shape, and the picture for the false face of planar picture etc., in two images
There will be no parallaxes relevant to 3D shape to distinguish between element, therefore, the neural network mould with the training of traditional single-view image
Type is compared, and the neural network model trained here will be provided with three-dimensional detection function.Last such as step S1003, further according to identification
As a result relevant instruction is executed.
In one embodiment, neural network model also may include the first sub-neural network model and the second sub- nerve net
Network model, wherein the first sub-neural network model for realizing to face in RGB image and IR image whether be stereoscopic face into
Row detection, the second sub-neural network model identify for realizing to the face in RGB image and/or IR image.First son
Neural network model the training stage input be the RGB image being collected in advance, IR image and whether be real human face
Markup information；And what the second sub-neural network model inputted in the training stage is at least one of RGB image and IR image.?
Whether cognitive phase will be true people to the face in RGB image and IR image first with the first sub-neural network model
Face (whether being stereoscopic face) is detected, if testing result is the recognition of face that real human face just will do it next step, i.e.,
Recognition of face is carried out at least one of RGB image and IR image using the second sub-neural network model.That is in step S1002
Facial image in the RGB image currently obtained and IR image is input in neural network model to carry out recognition of face；It should
Step is again the following steps are included: firstly, whether the face detected in the RGB image and the IR image is stereoscopic face；So
Afterwards, the face in the RGB image and/or the IR image is identified.
In the embodiment shown in fig. 10, due to being answered to largely reduce algorithm without calculating parallax
Miscellaneous degree can significantly promote recognition efficiency, promote user experience.
Electronic equipment provided by the present invention and based on face identification method performed by the electronic equipment, and it is traditional
Device and method are compared, and at least possess following the utility model has the advantages that firstly, screen accounting is higher.Since the devices such as infrared camera being arranged
Under screen, and in order to which only color camera is arranged on the screen for visual light imaging quality, the screen of existing binocular vision equipment
On at least two apertures or a biggish aperture of rectangle, in comparison, the present invention realizes under higher screen accounting
Identical function.In a preferred embodiment, the devices such as infrared camera, color camera and light emitting mould group are arranged at aobvious
The back side of display screen, so that electronic equipment of the invention has higher screen accounting.
In addition, electronic equipment cost of the invention is lower.Due to the binocular of color camera and the infrared camera composition of use
Vision, therefore binocular vision reflection is met to the requirement of depth information, infrared camera is also achieved to illumination-insensitive
It is required that the recognition of face task at daytime or night may be implemented.With traditional double color cameras or color camera with it is infrared
Structure light, infrared TOF camera are compared, and cost is lower.
In addition, electronic equipment recognition of face of the invention is more efficient.RGB image and IR image are directly subjected to face knowledge
Not, the biggish algorithmic procedure of this calculation amount of disparity computation is needed not move through, recognition of face efficiency can be significantly promoted, is promoted and is used
Family experience.
In the description of the present invention, it should be noted that term " center ", " longitudinal direction ", " transverse direction ", "upper", "lower",
The orientation or positional relationship of the instructions such as "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom" "inner", "outside" is
It is based on the orientation or positional relationship shown in the drawings, is merely for convenience of description of the present invention and simplification of the description, rather than instruction or dark
Show that signified device or element must have a particular orientation, be constructed and operated in a specific orientation, therefore should not be understood as pair
Limitation of the invention.In addition, term " first ", " second " are used for description purposes only, it is not understood to indicate or imply opposite
Importance.
In the description of the present invention, it should be noted that unless otherwise clearly defined and limited, term " installation ", " phase
Even ", " connection " shall be understood in a broad sense, for example, it may be being fixedly connected, may be a detachable connection, or be integrally connected；It can
To be mechanical connection, it is also possible to be electrically connected；It can be directly connected, can also can be indirectly connected through an intermediary
Connection inside two elements.For the ordinary skill in the art, above-mentioned term can be understood as the case may be
Concrete meaning in the present invention.
It should be noted that it can directly on the other element when element is referred to as " being fixed on " another element
Or there may also be elements placed in the middle.When an element is considered as " connection " another element, it, which can be, is directly connected to
To another element or it may be simultaneously present centering elements.Term as used herein " vertical ", " horizontal ", " left side ",
" right side " and similar statement for illustrative purposes only, are not meant to be the only embodiment.
Unless otherwise defined, all technical and scientific terms used herein and belong to technical field of the invention
The normally understood meaning of technical staff is identical.Term as used herein in the specification of the present invention is intended merely to description tool
The purpose of the embodiment of body, it is not intended that in the limitation present invention.Each technical characteristic of embodiment described above can carry out arbitrarily
Combination, for simplicity of description, it is not all possible to each technical characteristic in above-described embodiment combination be all described, so
And as long as there is no contradiction in the combination of these technical features, it all should be considered as described in this specification.
It may be noted that each step/component described in this application can be split as more multistep according to the needs of implementation
Two or more step/components or the part operation of step/component can also be combined into new step/component by suddenly/component,
To achieve the object of the present invention.
The method of above-mentioned recognition of face according to the present invention can be realized in hardware, firmware, or be implemented as to store
Software or computer code in recording medium (such as CD ROM, RAM, floppy disk, hard disk or magneto-optic disk), or be implemented logical
The original storage of network downloading is crossed in long-range recording medium or nonvolatile machine readable media and local record will be stored in
Computer code in medium, thus method described herein can be stored in using general purpose computer, application specific processor or
Such software processing in the programmable or recording medium of specialized hardware (such as ASIC or FPGA).It is appreciated that computer,
Processor, microprocessor controller or programmable hardware include the storage assembly that can store or receive software or computer code
(for example, RAM, ROM, flash memory etc.), when the software or computer code are by computer, processor or hardware access and execution
When, realize processing method described herein.In addition, when general purpose computer accesses the code for realizing the processing being shown here
When, general purpose computer is converted to the special purpose computer for being used for executing the processing being shown here by the execution of code.
The above content is a further detailed description of the present invention in conjunction with specific preferred embodiments, and it cannot be said that
Specific implementation of the invention is only limited to these instructions.For those skilled in the art to which the present invention belongs, it is not taking off
Under the premise of from present inventive concept, several equivalent substitute or obvious modifications can also be made, and performance or use is identical, all answered
When being considered as belonging to protection scope of the present invention.
Claims (10)
1. a kind of face identification method, which comprises the following steps:
S1: RGB image and IR image comprising face are received；
S2: the face in the RGB image and IR image is detected；
S3: the RGB image detected and the face in IR image are identified；
S4: relevant instruction is executed according to recognition result.
2. face identification method according to claim 1, which is characterized in that the step S3 includes following sub-step:
S31: the RGB image is converted into gray level image；
S32: the depth information of face in the gray level image and the IR image is calculated using Binocular Vision Principle；
S33: face is carried out in conjunction at least one of the depth information and the RGB image, gray level image or IR image
Identification.
3. face identification method according to claim 1, which is characterized in that the step S3 includes following sub-step:
S31: establishing and training neural network model；
S32: the facial image in the RGB image currently obtained and IR image is input in neural network model to carry out face
Identification.
4. face identification method according to claim 3, which is characterized in that the step S32 again the following steps are included:
S321: whether the face detected in the RGB image and the IR image is stereoscopic face；
S322: the face in the RGB image and/or the IR image is identified.
5. a kind of electronic equipment characterized by comprising
Shell；
It is arranged in positive display screen, first camera, second camera, light emitting mould group, memory and processor；
The first camera is for acquiring the image of external people or object under visible light illumination, and the second camera is for acquiring
Infrared image of the external people or object under Infrared irradiation, the light emitting mould group are used to provide to the second camera infrared
Optical illumination；
The first camera and second camera form binocular depth camera, and the back of the display screen is arranged in the second camera
Face；The memory storage has program；The processor runs described program, to control the first camera and described second
Camera acquires RGB image and IR image comprising face respectively, and the control electronic equipment executes claim 1-4 such as and appoints
Face identification method described in one.
6. electronic equipment according to claim 5, which is characterized in that the first camera is independently set with the display screen
It sets；Alternatively, the first camera couples setting with the display screen, the centre of the display screen or edge have through-hole,
The first camera is arranged at position corresponding with the through-hole, and the corresponding display screen area of the through-hole is used to penetrate light
Beam and it is not used in display image.
7. electronic equipment according to claim 5, which is characterized in that the first camera and second camera are arranged at institute
State the back side of display screen, the display screen includes the first sub- display screen, the second sub- display screen and the sub- display screen of third, and described first
Camera and second camera are separately positioned on the back side of the described first sub- display screen and the sub- display screen of third.
8. electronic equipment according to claim 7, which is characterized in that the first sub- display screen and the sub- display screen of third are equal
For transparent display screen, the first sub- display screen is the transparent window made of transparent material, is only used for that light beam is allowed to pass through, does not have to
In display；The sub- display screen of third is for showing imaging and light beam being allowed to pass through, the resolution ratio institute of the sub- display screen of third
The resolution ratio for stating the second sub- display screen is low, the display of the display aperture opening ratio display screen than described second of the sub- display screen of third
Aperture opening ratio is high.
9. electronic equipment according to claim 5, which is characterized in that the light emitting mould group is independently set with the display screen
It sets；Alternatively, the light emitting mould group couples setting with the display screen, the back of the display screen is arranged in the light emitting mould group
Face, or be arranged in the aperture of display screen.
10. electronic equipment according to claim 5, which is characterized in that between the second camera and the display screen also
It is provided with optical filter, for reducing the transmission of visible light.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811628451.4A CN109840475A (en) | 2018-12-28 | 2018-12-28 | Face identification method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811628451.4A CN109840475A (en) | 2018-12-28 | 2018-12-28 | Face identification method and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109840475A true CN109840475A (en) | 2019-06-04 |
Family
ID=66883475
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811628451.4A Pending CN109840475A (en) | 2018-12-28 | 2018-12-28 | Face identification method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109840475A (en) |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110139014A (en) * | 2019-06-10 | 2019-08-16 | 北京迈格威科技有限公司 | Different mesh camera and data processing method applied to different mesh camera |
| CN110661972A (en) * | 2019-09-27 | 2020-01-07 | 维沃移动通信有限公司 | Image processing method, image processing apparatus, electronic device, and medium |
| CN110769151A (en) * | 2019-09-27 | 2020-02-07 | 维沃移动通信有限公司 | Image processing method, image processing apparatus, electronic device, and medium |
| CN110781856A (en) * | 2019-11-04 | 2020-02-11 | 浙江大华技术股份有限公司 | Heterogeneous face recognition model training method, face recognition method and related device |
| CN111259814A (en) * | 2020-01-17 | 2020-06-09 | 杭州涂鸦信息技术有限公司 | Living body detection method and system |
| CN111741281A (en) * | 2020-06-30 | 2020-10-02 | Oppo广东移动通信有限公司 | Image processing method, terminal and storage medium |
| WO2021027580A1 (en) * | 2019-08-09 | 2021-02-18 | Oppo广东移动通信有限公司 | Terminal |
| CN112861586A (en) * | 2019-11-27 | 2021-05-28 | 马上消费金融股份有限公司 | Living body detection, image classification and model training method, device, equipment and medium |
| CN113014747A (en) * | 2019-12-18 | 2021-06-22 | 中移物联网有限公司 | Under-screen camera module, image processing method and terminal |
| CN113128320A (en) * | 2020-01-16 | 2021-07-16 | 浙江舜宇智能光学技术有限公司 | Face living body detection method and device based on TOF camera and electronic equipment |
| CN113223209A (en) * | 2020-01-20 | 2021-08-06 | 深圳绿米联创科技有限公司 | Door lock control method and device, electronic equipment and storage medium |
| WO2021169614A1 (en) * | 2020-02-27 | 2021-09-02 | 昆山国显光电有限公司 | Display panel and display device |
| CN113591602A (en) * | 2021-07-08 | 2021-11-02 | 娄浩哲 | Single-view-angle-based human face three-dimensional contour feature reconstruction device and reconstruction method |
| CN113673285A (en) * | 2020-05-15 | 2021-11-19 | 深圳市光鉴科技有限公司 | Depth reconstruction method, system, device and medium for snapshot by depth camera |
| JP2022501686A (en) * | 2019-08-19 | 2022-01-06 | 深▲セン▼市商湯科技有限公司Shenzhen Sensetime Technology Co., Ltd. | Biological detection methods and devices, electronic devices and storage media |
| CN114040089A (en) * | 2020-07-21 | 2022-02-11 | Oppo广东移动通信有限公司 | Image processing method, device, equipment and computer readable storage medium |
| WO2022032549A1 (en) * | 2020-08-11 | 2022-02-17 | 中国科学院自动化研究所 | Anti-counterfeiting facial detection method, system and apparatus based on cross-modality conversion assistance |
| CN114419718A (en) * | 2022-03-10 | 2022-04-29 | 荣耀终端有限公司 | Electronic equipment and face recognition method |
| TWI791208B (en) * | 2020-04-29 | 2023-02-01 | 大陸商Ｏｐｐｏ廣東移動通信有限公司 | Control method, electronic device, and computer-readable storage medium |
| US11711953B2 (en) | 2020-09-03 | 2023-07-25 | Samsung Display Co., Ltd. | Display panel and display apparatus including the same |
| CN116708984A (en) * | 2023-08-04 | 2023-09-05 | 荣耀终端有限公司 | Camera module, electronic equipment and control method thereof |
Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000102044A (en) * | 1998-09-17 | 2000-04-07 | Sharp Corp | Display image evaluation method and display image evaluation system |
| US20110207505A1 (en) * | 2010-02-24 | 2011-08-25 | Samsung Electronics Co. Ltd. | Method and apparatus for preventing flicker phenomenon on display of mobile terminal |
| CN102346991A (en) * | 2010-07-30 | 2012-02-08 | 鸿富锦精密工业（深圳）有限公司 | Display device with photographing function |
| CN104918034A (en) * | 2015-05-29 | 2015-09-16 | 深圳奥比中光科技有限公司 | 3D image capturing device, capturing method and 3D image system |
| CN105654028A (en) * | 2015-09-29 | 2016-06-08 | 厦门中控生物识别信息技术有限公司 | True and false face identification method and apparatus thereof |
| CN106506742A (en) * | 2016-11-16 | 2017-03-15 | 广东欧珀移动通信有限公司 | A kind of front-facing camera mounting structure of mobile terminal and mobile terminal |
| CN106921767A (en) * | 2017-03-07 | 2017-07-04 | 捷开通讯(深圳)有限公司 | A kind of mobile terminal of screen accounting high |
| CN107688775A (en) * | 2017-07-11 | 2018-02-13 | 浙江新再灵科技股份有限公司 | Binocular camera recognition of face right discriminating system and method based on elevator scene |
| CN107734102A (en) * | 2017-11-16 | 2018-02-23 | 珠海市魅族科技有限公司 | Terminal device |
| CN107872631A (en) * | 2017-12-06 | 2018-04-03 | 广东欧珀移动通信有限公司 | Image capturing method, device and mobile terminal based on dual camera |
| CN107948500A (en) * | 2017-11-01 | 2018-04-20 | 广东欧珀移动通信有限公司 | Image processing method and device |
| CN207706295U (en) * | 2018-01-04 | 2018-08-07 | 北京天诚盛业科技有限公司 | Shell, recognition of face photographing module and bimodulus face recognition device |
| CN108427939A (en) * | 2018-03-30 | 2018-08-21 | 百度在线网络技术（北京）有限公司 | model generating method and device |
| CN108491805A (en) * | 2018-03-27 | 2018-09-04 | 百度在线网络技术（北京）有限公司 | Identity identifying method and device |
| CN108667968A (en) * | 2018-05-16 | 2018-10-16 | 维沃移动通信有限公司 | A kind of display module and mobile terminal |
| CN208094669U (en) * | 2018-03-30 | 2018-11-13 | 杭州海康威视数字技术股份有限公司 | A kind of binocular camera |
| CN108876833A (en) * | 2018-03-29 | 2018-11-23 | 北京旷视科技有限公司 | Image processing method, image processing apparatus and computer readable storage medium |
| CN108875546A (en) * | 2018-04-13 | 2018-11-23 | 北京旷视科技有限公司 | Face auth method, system and storage medium |
| CN109068043A (en) * | 2018-09-27 | 2018-12-21 | 维沃移动通信有限公司 | A kind of image imaging method and device of mobile terminal |
-
2018
- 2018-12-28 CN CN201811628451.4A patent/CN109840475A/en active Pending
Patent Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000102044A (en) * | 1998-09-17 | 2000-04-07 | Sharp Corp | Display image evaluation method and display image evaluation system |
| US20110207505A1 (en) * | 2010-02-24 | 2011-08-25 | Samsung Electronics Co. Ltd. | Method and apparatus for preventing flicker phenomenon on display of mobile terminal |
| CN102346991A (en) * | 2010-07-30 | 2012-02-08 | 鸿富锦精密工业（深圳）有限公司 | Display device with photographing function |
| CN104918034A (en) * | 2015-05-29 | 2015-09-16 | 深圳奥比中光科技有限公司 | 3D image capturing device, capturing method and 3D image system |
| CN105654028A (en) * | 2015-09-29 | 2016-06-08 | 厦门中控生物识别信息技术有限公司 | True and false face identification method and apparatus thereof |
| CN106506742A (en) * | 2016-11-16 | 2017-03-15 | 广东欧珀移动通信有限公司 | A kind of front-facing camera mounting structure of mobile terminal and mobile terminal |
| CN106921767A (en) * | 2017-03-07 | 2017-07-04 | 捷开通讯(深圳)有限公司 | A kind of mobile terminal of screen accounting high |
| CN107688775A (en) * | 2017-07-11 | 2018-02-13 | 浙江新再灵科技股份有限公司 | Binocular camera recognition of face right discriminating system and method based on elevator scene |
| CN107948500A (en) * | 2017-11-01 | 2018-04-20 | 广东欧珀移动通信有限公司 | Image processing method and device |
| CN107734102A (en) * | 2017-11-16 | 2018-02-23 | 珠海市魅族科技有限公司 | Terminal device |
| CN107872631A (en) * | 2017-12-06 | 2018-04-03 | 广东欧珀移动通信有限公司 | Image capturing method, device and mobile terminal based on dual camera |
| CN207706295U (en) * | 2018-01-04 | 2018-08-07 | 北京天诚盛业科技有限公司 | Shell, recognition of face photographing module and bimodulus face recognition device |
| CN108491805A (en) * | 2018-03-27 | 2018-09-04 | 百度在线网络技术（北京）有限公司 | Identity identifying method and device |
| CN108876833A (en) * | 2018-03-29 | 2018-11-23 | 北京旷视科技有限公司 | Image processing method, image processing apparatus and computer readable storage medium |
| CN108427939A (en) * | 2018-03-30 | 2018-08-21 | 百度在线网络技术（北京）有限公司 | model generating method and device |
| CN208094669U (en) * | 2018-03-30 | 2018-11-13 | 杭州海康威视数字技术股份有限公司 | A kind of binocular camera |
| CN108875546A (en) * | 2018-04-13 | 2018-11-23 | 北京旷视科技有限公司 | Face auth method, system and storage medium |
| CN108667968A (en) * | 2018-05-16 | 2018-10-16 | 维沃移动通信有限公司 | A kind of display module and mobile terminal |
| CN109068043A (en) * | 2018-09-27 | 2018-12-21 | 维沃移动通信有限公司 | A kind of image imaging method and device of mobile terminal |
Cited By (33)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110139014A (en) * | 2019-06-10 | 2019-08-16 | 北京迈格威科技有限公司 | Different mesh camera and data processing method applied to different mesh camera |
| WO2021027580A1 (en) * | 2019-08-09 | 2021-02-18 | Oppo广东移动通信有限公司 | Terminal |
| JP7110412B2 (en) | 2019-08-19 | 2022-08-01 | 深▲セン▼市商湯科技有限公司 | LIFE DETECTION METHOD AND DEVICE, ELECTRONIC DEVICE, AND STORAGE MEDIUM |
| JP2022501686A (en) * | 2019-08-19 | 2022-01-06 | 深▲セン▼市商湯科技有限公司Shenzhen Sensetime Technology Co., Ltd. | Biological detection methods and devices, electronic devices and storage media |
| CN110769151B (en) * | 2019-09-27 | 2021-10-15 | 维沃移动通信有限公司 | Image processing method, image processing apparatus, electronic device, and medium |
| CN110661972A (en) * | 2019-09-27 | 2020-01-07 | 维沃移动通信有限公司 | Image processing method, image processing apparatus, electronic device, and medium |
| CN110769151A (en) * | 2019-09-27 | 2020-02-07 | 维沃移动通信有限公司 | Image processing method, image processing apparatus, electronic device, and medium |
| US12003860B2 (en) | 2019-09-27 | 2024-06-04 | Vivo Mobile Communication Co., Ltd. | Image processing method and electronic device |
| US11678066B2 (en) | 2019-09-27 | 2023-06-13 | Vivo Mobile Communication Co., Ltd. | Image processing method, electronic device and medium |
| CN110781856A (en) * | 2019-11-04 | 2020-02-11 | 浙江大华技术股份有限公司 | Heterogeneous face recognition model training method, face recognition method and related device |
| CN110781856B (en) * | 2019-11-04 | 2023-12-19 | 浙江大华技术股份有限公司 | Heterogeneous face recognition model training method, face recognition method and related device |
| CN112861586A (en) * | 2019-11-27 | 2021-05-28 | 马上消费金融股份有限公司 | Living body detection, image classification and model training method, device, equipment and medium |
| CN113014747A (en) * | 2019-12-18 | 2021-06-22 | 中移物联网有限公司 | Under-screen camera module, image processing method and terminal |
| CN113128320A (en) * | 2020-01-16 | 2021-07-16 | 浙江舜宇智能光学技术有限公司 | Face living body detection method and device based on TOF camera and electronic equipment |
| CN113128320B (en) * | 2020-01-16 | 2023-05-16 | 浙江舜宇智能光学技术有限公司 | Human face living body detection method and device based on TOF camera and electronic equipment |
| CN111259814A (en) * | 2020-01-17 | 2020-06-09 | 杭州涂鸦信息技术有限公司 | Living body detection method and system |
| CN111259814B (en) * | 2020-01-17 | 2023-10-31 | 杭州涂鸦信息技术有限公司 | Living body detection method and system |
| CN113223209A (en) * | 2020-01-20 | 2021-08-06 | 深圳绿米联创科技有限公司 | Door lock control method and device, electronic equipment and storage medium |
| US11650633B2 (en) | 2020-02-27 | 2023-05-16 | Kunshan Go-Visionox Opto-Electronics Co., Ltd | Display panel and display apparatus |
| WO2021169614A1 (en) * | 2020-02-27 | 2021-09-02 | 昆山国显光电有限公司 | Display panel and display device |
| TWI791208B (en) * | 2020-04-29 | 2023-02-01 | 大陸商Ｏｐｐｏ廣東移動通信有限公司 | Control method, electronic device, and computer-readable storage medium |
| CN113673285B (en) * | 2020-05-15 | 2023-09-12 | 深圳市光鉴科技有限公司 | Depth reconstruction method, system, equipment and medium during capturing of depth camera |
| CN113673285A (en) * | 2020-05-15 | 2021-11-19 | 深圳市光鉴科技有限公司 | Depth reconstruction method, system, device and medium for snapshot by depth camera |
| CN111741281A (en) * | 2020-06-30 | 2020-10-02 | Oppo广东移动通信有限公司 | Image processing method, terminal and storage medium |
| CN114040089A (en) * | 2020-07-21 | 2022-02-11 | Oppo广东移动通信有限公司 | Image processing method, device, equipment and computer readable storage medium |
| WO2022032549A1 (en) * | 2020-08-11 | 2022-02-17 | 中国科学院自动化研究所 | Anti-counterfeiting facial detection method, system and apparatus based on cross-modality conversion assistance |
| US11711953B2 (en) | 2020-09-03 | 2023-07-25 | Samsung Display Co., Ltd. | Display panel and display apparatus including the same |
| CN113591602A (en) * | 2021-07-08 | 2021-11-02 | 娄浩哲 | Single-view-angle-based human face three-dimensional contour feature reconstruction device and reconstruction method |
| CN113591602B (en) * | 2021-07-08 | 2024-04-30 | 娄浩哲 | Face three-dimensional contour feature reconstruction device and reconstruction method based on single view angle |
| CN114419718A (en) * | 2022-03-10 | 2022-04-29 | 荣耀终端有限公司 | Electronic equipment and face recognition method |
| CN114419718B (en) * | 2022-03-10 | 2022-08-02 | 荣耀终端有限公司 | Electronic equipment and face recognition method |
| CN116708984A (en) * | 2023-08-04 | 2023-09-05 | 荣耀终端有限公司 | Camera module, electronic equipment and control method thereof |
| CN116708984B (en) * | 2023-08-04 | 2024-04-19 | 荣耀终端有限公司 | Camera module, electronic equipment and control method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109840475A (en) | Face identification method and electronic equipment | |
| CN209170442U (en) | Electronic equipment with high screen accounting | |
| CN209328043U (en) | With the electronic equipment shielded comprehensively | |
| EP3872658B1 (en) | Face recognition method and electronic device | |
| US20200293754A1 (en) | Task execution method, terminal device, and computer readable storage medium | |
| CN109544618B (en) | Method for obtaining depth information and electronic equipment | |
| CN103106401B (en) | Mobile terminal iris recognition device with human-computer interaction mechanism | |
| US9304594B2 (en) | Near-plane segmentation using pulsed light source | |
| CN103839054B (en) | Multi-functional mobile intelligent terminal sensor supporting iris recognition | |
| CN109274789A (en) | Electronic equipment | |
| CN109068043A (en) | A kind of image imaging method and device of mobile terminal | |
| CN101533473B (en) | Equipment for acquisition and processing of binocular iris images with single USB interfaces | |
| CN110099226B (en) | Array camera module, depth information acquisition method thereof and electronic equipment | |
| CN104865701B (en) | Head-mounted display device | |
| CN105320941A (en) | Biometric identification apparatus based on fusion of iris and human face and biometric identification method using apparatus | |
| CN109788174A (en) | A kind of light compensation method and terminal | |
| CN109240021A (en) | Shield lower optical system and electronic equipment | |
| CN108279496B (en) | Eyeball tracking module and method of video glasses and video glasses | |
| CN112668540B (en) | Biological characteristic acquisition and recognition system and method, terminal equipment and storage medium | |
| CN209170443U (en) | Electronic equipment | |
| CN109766806A (en) | Efficient face identification method and electronic equipment | |
| CN108415875A (en) | The method of Depth Imaging mobile terminal and face recognition application | |
| WO2022068193A1 (en) | Wearable device, intelligent guidance method and apparatus, guidance system and storage medium | |
| CN109409249A (en) | Information processing method and electronic equipment | |
| CN103945093B (en) | Based on the visible near-infrared integral camera device of ARM platform recognitions of face and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 11-13 / F, joint headquarters building, high tech Zone, 63 Xuefu Road, Yuehai street, Nanshan District, Shenzhen, Guangdong 518000 Applicant after: Obi Zhongguang Technology Group Co., Ltd Address before: 12 / F, joint headquarters building, high tech Zone, 63 Xuefu Road, Nanshan District, Shenzhen, Guangdong 518000 Applicant before: SHENZHEN ORBBEC Co.,Ltd. |