CN107563302A - Remove the face restoring method and device of glasses - Google Patents
Remove the face restoring method and device of glasses Download PDFInfo
- Publication number
- CN107563302A CN107563302A CN201710676984.9A CN201710676984A CN107563302A CN 107563302 A CN107563302 A CN 107563302A CN 201710676984 A CN201710676984 A CN 201710676984A CN 107563302 A CN107563302 A CN 107563302A
- Authority
- CN
- China
- Prior art keywords
- user
- structure light
- infrared structure
- glasses
- light source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Length Measuring Devices By Optical Means (AREA)
Abstract
The invention discloses a kind of face restoring method and device for removing glasses, wherein, method includes：Infrared structure light source is projected to the user of wearing spectacles, and shoots the infrared structure light image modulated after infrared structure light source transmitted through glasses；Phase corresponding to deformation position pixel in infrared structure light image is demodulated, the depth of view information of user's eye is generated according to phase；The eye profile of user is generated according to the depth of view information of user's eye, colors countenance is carried out to eye profile according to the Skin Color Information of user's face, generation removes the user images of glasses.Thus, face reduction mode is enriched, improves the degree of accuracy and the efficiency of face reduction.
Description
Technical field
The present invention relates to technical field of information processing, more particularly to a kind of face restoring method and device for removing glasses.
Background technology
In daily life, often photographed some portrait photographs to wear glasses, such as some stars or strange beauty
Deng；Either user's photo before checking is worn glasses etc..User be merely able to guess other side remove glasses apperance or
It is to recall former apperance.
In correlation technique, glasses can be removed by photo handling software, but the face reduction efficiency of this mode is not
Height, and it is not accurate enough.
The content of the invention
The present invention provides a kind of face restoring method and device for removing glasses, to solve in the prior art, to remove glasses
When carrying out face reduction, the technical problem under inefficient and accuracy rate.
The embodiment of the present invention provides a kind of face restoring method for removing glasses, including：Projected to the user of wearing spectacles
Infrared structure light source, and the infrared structure light source is shot through the infrared structure light image modulated after the glasses；Demodulation institute
Phase corresponding to deformation position pixel in infrared structure light image is stated, the depth of view information of user's eye is generated according to the phase；
The eye profile of user is generated according to the depth of view information of user's eye, according to the Skin Color Information of user's face to the eye
Profile carries out colors countenance, and generation removes the user images of glasses.
Another embodiment of the present invention provides a kind of face reduction apparatus for removing glasses, including：Taking module is projected, is used for
Infrared structure light source is projected to the user of wearing spectacles, and it is red through being modulated after the glasses to shoot the infrared structure light source
External structure light image；Generation module is demodulated, for demodulating phase corresponding to deformation position pixel in the infrared structure light image,
The depth of view information of user's eye is generated according to the phase；Generation module, for being given birth to according to the depth of view information of user's eye
Into the eye profile of user, colors countenance is carried out to the eye profile according to the Skin Color Information of user's face, generation removes eye
The user images of mirror.
Further embodiment of this invention provides a kind of terminal, including memory and processor, and meter is stored in the memory
Calculation machine readable instruction, when the instruction is by the computing device so that the computing device first aspect present invention is implemented
The face restoring method of removal glasses described in example.
A further embodiment of the present invention provides a kind of non-transitorycomputer readable storage medium, is stored thereon with computer journey
Sequence, when the computer program is executed by processor realize as described in first aspect present invention embodiment remove glasses face also
Former method.
Technical scheme provided in an embodiment of the present invention can include the following benefits：
By projecting infrared structure light source to the user of wearing spectacles, and modulated after shooting infrared structure light source transmitted through glasses
Infrared structure light image, then demodulate phase corresponding to deformation position pixel in infrared structure light image, and given birth to according to phase
Into the depth of view information of user's eye, finally according to the eye profile of the depth of view information of user's eye generation user, according to user plane
The Skin Color Information in portion carries out the user images that colors countenance generation removes glasses to eye profile.Thus, face reduction is enriched
Mode, improve the degree of accuracy and the efficiency of face reduction.
The additional aspect of the present invention and advantage will be set forth in part in the description, and will partly become from the following description
Obtain substantially, or recognized by the practice of the present invention.
Brief description of the drawings
Of the invention above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments
Substantially and it is readily appreciated that, wherein：
Fig. 1 is the flow chart of the face restoring method of removal glasses according to an embodiment of the invention；
Fig. 2 (a) is the schematic diagram of a scenario one of structural light measurement according to an embodiment of the invention；
Fig. 2 (b) is the schematic diagram of a scenario two of structural light measurement according to an embodiment of the invention；
Fig. 2 (c) is the schematic diagram of a scenario three of structural light measurement according to an embodiment of the invention；
Fig. 2 (d) is the schematic diagram of a scenario four of structural light measurement according to an embodiment of the invention；
Fig. 2 (e) is the schematic diagram of a scenario five of structural light measurement according to an embodiment of the invention；
Fig. 3 (a) is the local diffraction structure schematic diagram of collimation beam splitting element according to an embodiment of the invention；
Fig. 3 (b) is the local diffraction structure schematic diagram of collimation beam splitting element in accordance with another embodiment of the present invention；
Fig. 4 is the structured flowchart of the face reduction apparatus of removal glasses according to an embodiment of the invention；
Fig. 5 be it is in accordance with another embodiment of the present invention removal glasses face reduction apparatus structured flowchart and
Fig. 6 is the structural representation of terminal device according to an embodiment of the invention.
Embodiment
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning to end
Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to for explaining the present invention, and is not considered as limiting the invention.
Below with reference to the accompanying drawings the face restoring method and device of the removal glasses of the embodiment of the present invention are described.
Fig. 1 is the flow chart of the face restoring method of removal glasses according to an embodiment of the invention.
As shown in figure 1, the face restoring method of the removal glasses may include：
Step 101, infrared structure light source is projected to the user of wearing spectacles, and after shooting infrared structure light source transmitted through glasses
The infrared structure light image of modulation.
Step 102, phase corresponding to deformation position pixel in infrared structure light image is demodulated, user's eye is generated according to phase
The depth of view information in portion.
It is appreciated that when removing glasses progress face reduction, effect can be produced to carry out processing by photo handling software
Rate is not high and the problems such as the degree of accuracy is inadequate.
In order to solve the above-mentioned technical problem, in an embodiment of the present invention, structured light technique, infrared structure light source energy are passed through
Glasses are enough penetrated, are directly beaten in user's eye, can be believed when obtaining the depth of view information of user's eye with obtaining the profile of eye
Breath, so as to by 3D modeling information, by the removal of sunglasses, and according to Skin Color Information around, colors countenance is carried out to ocular,
Generation removes the user picture after glasses, thus, enriches face reduction mode, improves the degree of accuracy and the effect of face reduction
Rate.
Specifically, infrared structure light source can be projected to the user of wearing spectacles by modes such as infrared transmitters, can be with
Understand be infrared transmitter power it is higher, the ability that infrared structure light source penetrates glasses is stronger, can be according to practical application
Need to select suitable power to be projected.
As a kind of mode in the cards, in order to further improve the efficiency of face reduction and the degree of accuracy, can identify
The colour of lens of glasses, the projection intensity of infrared structure light source is adjusted according to colour of lens.So as to further meet user's need
Ask, improve Consumer's Experience.
Wherein, the infrared structure light image modulated after infrared structure light source transmitted through glasses is shot while projection.
Specifically, infrared structure light source, the knot of structure light source can be projected to the user of wearing spectacles in actual applications
Structure feature has many kinds, such as, laser stripe, Gray code, sine streak or, non-homogeneous speckle etc., thus, due to structure
Light source can be based on eye profile and depth of view information the collection of three-dimensional eye information is carried out to user, compared to only by
The mode of the two-dimentional face reduction of image processing software processing, the degree of accuracy is higher, is easy to ensure the degree of accuracy of face reduction.
In order that those skilled in the art is more apparent from, how to the user of wearing spectacles to project infrared knot
Structure light source, and the infrared structure light image modulated after infrared structure light source transmitted through glasses is shot, below with a kind of widely used
Its concrete principle is illustrated exemplified by optical grating projection technology (fringe projection technology), wherein, optical grating projection technology belongs to sensu lato
Area-structure light.
When being projected using area-structure light, as shown in Fig. 2 (a), sine streak is produced by computer programming, by this
Sine streak is by projection to measured object, the degree of crook modulated using CCD camera shooting striped by object, demodulation
The curved stripes obtain phase, then phase is converted into the height of the whole audience.Certain wherein crucial point is exactly system
Demarcation, including the calibration of camera of the demarcation of system geometric parameter and CCD camera and projector equipment, are otherwise likely to produce
Error or error coupler.Because its exterior parameter is not demarcated, correct depth of view information can not possibly be calculated by phasometer.
Specifically, the first step, programming produce sine streak figure, because subsequently to utilize deforming stripe figure to obtain phase,
For example phase is obtained using four step phase-shifting methods, therefore four width phase difference pi/2 striped is produced here, then by the four spokes line
Timesharing is projected on measured object (mask), is collected such as the figure on Fig. 2 (b) left sides, while to be gathered shown on the right of Fig. 2 (b)
The striped of the plane of reference.
Second step, phase recovery is carried out, calculated by phase modulation by modulation bar graph by four width collected, obtained here
To phase diagram be to block phase diagram because the result that four step Phase-shifting algorithms obtain be by arctan function calculate gained, thus
It is limited between [- pi, pi], that is to say, that whenever its value exceedes the scope, it can restart again.Obtained phase main value
As shown in Fig. 2 (c).
Wherein, it is necessary to which the saltus step that disappears, it is continuous phase that will block phase recovery, such as Fig. 2 (d) institutes under second step
Show, the left side is the continuous phase modulated, and the right is to refer to continuous phase.
3rd step, subtract each other to obtain phase difference by the continuous phase modulated and with reference to continuous phase, the phase difference then characterizes
Depth of view information of the measured object with respect to the plane of reference, then phase and depth of field conversion formula (wherein relevant parameter is by demarcating) are substituted into,
Obtain the threedimensional model of the object under test as shown in Fig. 2 (e).
It should be appreciated that in actual applications, according to the difference of concrete application scene, employed in the embodiment of the present invention
Structure light in addition to above-mentioned grating, can also be other arbitrary graphic patterns.
, wherein it is desired to, it is emphasized that as a kind of possible implementation, the present invention projects pattern to user's face
Light, so as to according to the spot at random set in pattern light according to preset algorithm, be produced after user's face is projected
Displacement (equivalent to modulation) restore the related depth of view information of face face.
In the present embodiment, the diffraction element of essentially flat board can be used, the diffraction element has particular phases distribution
Embossment diffraction structure, cross section is floats with two or more concavo-convex step embossment structures, or multiple concavo-convex steps
Carve structure, the thickness substantially l microns of substrate, each step it is highly non-uniform, be 0.7 micron one 0.9 microns.Fig. 3 (a) is
The present embodiment collimation beam splitting element local diffraction structure, Fig. 3 (b) be along the A of section A one cross sectional side view, abscissa and
The unit of ordinate is micron.
So as to, multi beam diffraction light is obtained after diffraction is carried out to light beam due to common diffraction element, but per beam diffraction light light
Strong difference is big, also big to the risk of human eye injury, even carries out re-diffraction, the uniformity of obtained light beam to diffraction light
It is relatively low, object is projected in image information processing device using such light beam, drop shadow effect is poor.
Collimation beam splitting element in the present embodiment not only has the function that to collimate uncollimated rays, also has light splitting
Effect, i.e., through speculum reflection non-collimated light after collimate beam splitting element toward different angle be emitted multi-beam collimation light beam,
And the area of section approximately equal of the multi-beam collimation light beam of outgoing, flux of energy approximately equal, and then to spread out using the light beam
Scatterplot light after penetrating carries out image procossing or the effect of projection is more preferable, meanwhile, laser emitting light is dispersed to every light beam, further
The risk of injury human eye is reduced, and due to being pattern light, relative to other uniform structure lights of arrangement, reaches same
During collection effect, the electric energy consumed is lower.
Based on foregoing description, in the present embodiment, infrared structure light source is projected to the user of wearing spectacles, and shoot infrared
The infrared structure light image modulated after structure light source transmitted through glasses, demodulate in infrared structure light image corresponding to deformation position pixel
Phase, the depth of view information of user's eye is generated according to phase.
It is emphasized that specifically, the principle based on structure light is understood, under different acquisition condition and environmental condition,
The structure light image result obtained by structure light for same object under test is different, such as, in structure light
Structure light image result is not under the frontlighting environment of 2 meters of equipment and pickup user A distances and under the backlighting condition of 3 meters of distance
The same.
Therefore, in order to mitigate the difficulty of face reduction, and the efficiency that raising reduces to the face of user, according to logical in advance
The structure light processing parameter during checking characteristic information of structure light processing registration is crossed, generation projection source projects wearing spectacles
User, and shoot the infrared structure light image that projection source is modulated by the user of wearing spectacles.
It should be noted that according to the difference of concrete application scene, infrared structure light source is projected to the user of wearing spectacles,
And the implementation for shooting the infrared structure light image modulated after infrared structure light source transmitted through glasses is different, is illustrated below：
The first example, infrared structure light source is projected to the user's face of wearing spectacles, and it is saturating to shoot infrared structure light source
The infrared structure light image modulated by user's face is crossed after glasses.
Further, phase corresponding to deformation position pixel in infrared structure light image is demodulated, user is generated according to phase
The depth of view information of eye.
In this example, due to differences such as user's eye features, the depth of view information of the user's eye measured is also different, and this
The difference of kind depth of view information, can be reflected via phase, such as, more three-dimensional with user's eye face, phase distortion is bigger,
It is deeper etc. so as to the depth of view information of user's eye, thus, phase corresponding to deformation position pixel in demodulation structure light image, according to
Phase generates the depth of view information of user's eye.Wherein, the 3D models of user's eye are generated according to the depth of view information.
Second of example, the eyeglasses-wearing region of user in preview screen is identified, adjusted according to eyeglasses-wearing region infrared
The crevice projection angle of the projector, to eyeglasses-wearing region project infrared structure light source, and after shooting infrared structure light source transmitted through glasses
The infrared structure light image modulated by user's eye.
In this example, carry out projecting infrared structure light source just for eyeglasses-wearing region, it is more smart so as to obtain
The really infrared structure light image based on ocular, the accuracy of face reduction is further improved, meets user's request.
Step 103, the eye profile of user is generated according to the depth of view information of user's eye, is believed according to the colour of skin of user's face
Breath carries out colors countenance to eye profile, and generation removes the user images of glasses.
Specifically, can be to obtain the profile information of circumference of eyes when obtaining the depth of view information of user's eye.So that can
Face reduction is carried out automatically to remove glasses.It is understood that after glasses are removed, in order to further improve face reduction
Authenticity be the degree of accuracy, it is necessary to obtain the Skin Color Information of circumference of eyes skin, and eye profile is carried out according to Skin Color Information
Colors countenance, that is, keep the naturality of face reduction, and generation removes the user images of glasses.
In summary, the face restoring method of the removal glasses of the embodiment of the present invention, by being thrown to the user of wearing spectacles
Infrared structure light source is penetrated, and shoots the infrared structure light image modulated after infrared structure light source transmitted through glasses, is then demodulated infrared
Phase corresponding to deformation position pixel in structure light image, and according to the depth of view information of phase generation user's eye, last basis
The eye profile of the depth of view information generation user of user's eye, color is carried out according to the Skin Color Information of user's face to eye profile
Processing generation removes the user images of glasses.Thus, face reduction mode is enriched, improves the degree of accuracy and the effect of face reduction
Rate.
In order to realize above-described embodiment, the invention also provides a kind of face reduction apparatus for removing glasses, Fig. 4 is basis
The structured flowchart of the face reduction apparatus of the removal glasses of one embodiment of the invention, is clapped as shown in figure 4, the device includes projection
Take the photograph module 100, demodulation generation module 200 and generation module 300.
Wherein, taking module 100 is projected, for projecting infrared structure light source to the user of wearing spectacles, and is shot infrared
The infrared structure light image modulated after structure light source transmitted through glasses.
Generation module 200 is demodulated, for demodulating phase corresponding to deformation position pixel in infrared structure light image, according to phase
The depth of view information of position generation user's eye.
Generation module 300, for generating the eye profile of user according to the depth of view information of user's eye, according to user's face
Skin Color Information to eye profile carry out colors countenance, generation remove glasses user images.
In one embodiment of the invention, projection taking module 100 is specifically used for：Thrown to the user's face of wearing spectacles
Infrared structure light source is penetrated, and shoots the infrared structure light image modulated after infrared structure light source transmitted through glasses by user's face；
Demodulation generation module 200 is specifically used for：Phase corresponding to deformation position pixel in infrared structure light image is demodulated, is given birth to according to phase
Into the depth of view information of user's face；The depth of view information of user's eye is extracted from the depth of view information of user's face.
In one embodiment of the invention, projection taking module 100 is specifically additionally operable to：Identify user in preview screen
Eyeglasses-wearing region；The crevice projection angle of infrared projector is adjusted according to eyeglasses-wearing region；It is infrared to eyeglasses-wearing region project
Structure light source, and shoot the infrared structure light image modulated after infrared structure light source transmitted through glasses by user's eye.
In one embodiment of the invention, the architectural feature of infrared structure light source, including：Laser stripe, Gray code, just
String striped, uniform speckle or, non-homogeneous speckle.
As a kind of mode in the cards, in order to further improve the efficiency of face reduction and the degree of accuracy, such as Fig. 5 institutes
Show, on the basis of Fig. 4, in addition to：Identification module 400 and adjusting module 500.
Wherein, identification module 400 is used for the colour of lens for identifying glasses, and adjusting module 500 is used to be adjusted according to colour of lens
The projection intensity of whole infrared structure light source.So as to further meet user's request, improve Consumer's Experience.
It should be noted that the foregoing explanation to removing the face restoring method of glasses, is also applied for of the invention real
The face reduction apparatus of the removal glasses of example is applied, unpub details in the embodiment of the present invention, will not be repeated here.
In summary, the face reduction apparatus of the removal glasses of the embodiment of the present invention, by being thrown to the user of wearing spectacles
Infrared structure light source is penetrated, and shoots the infrared structure light image modulated after infrared structure light source transmitted through glasses, is then demodulated infrared
Phase corresponding to deformation position pixel in structure light image, and according to the depth of view information of phase generation user's eye, last basis
The eye profile of the depth of view information generation user of user's eye, color is carried out according to the Skin Color Information of user's face to eye profile
Processing generation removes the user images of glasses.Thus, face reduction mode is enriched, improves the degree of accuracy and the effect of face reduction
Rate.
The embodiment of the present invention also proposes a kind of terminal device.Above-mentioned terminal includes image processing circuit, image procossing electricity
Road can utilize hardware and/or component software to realize, it may include define ISP (Image Signal Processing, image letter
Number processing) pipeline various processing units.Fig. 6 is the image processing circuit in the terminal proposed according to one embodiment of the invention
Structural representation.As shown in fig. 6, for purposes of illustration only, each of the image processing techniques related to the embodiment of the present invention is only shown
Aspect.
As shown in fig. 6, image processing circuit includes imaging device 1010, ISP processors 1030 and control logic device 1040.
Imaging device 1010 may include the camera and structured light projector with one or more lens 1012, imaging sensor 1014
1016.Structured light projector 1016 is by structured light projection to measured object.Wherein, the structured light patterns can be laser stripe, Gray
Code, sine streak or, speckle pattern of random alignment etc..Imaging sensor 1014 catches the knot that projection is formed to measured object
Structure light image, and structure light image is sent to ISP processors 1030, structure light image is solved by ISP processors 1030
Adjust the depth information for obtaining measured object.Meanwhile imaging sensor 1014 can also catch the color information of measured object.Certainly,
The structure light image and color information of measured object can be caught respectively by two imaging sensors 1014.
Wherein, by taking pattern light as an example, ISP processors 1030 are demodulated to structure light image, are specifically included, from this
The speckle image of measured object is gathered in structure light image, by the speckle image of measured object with reference speckle image according to pre-defined algorithm
View data calculating is carried out, each speckle point for obtaining speckle image on measured object dissipates relative to reference to the reference in speckle image
The displacement of spot.The depth value of each speckle point of speckle image is calculated using trigonometry conversion, and according to the depth
Angle value obtains the depth information of measured object.
It is, of course, also possible to obtain the depth image by the method for binocular vision or based on jet lag TOF method
Information etc., is not limited herein, as long as can obtain or belong to this by the method for the depth information that measured object is calculated
The scope that embodiment includes.
, can quilt after the color information that ISP processors 1030 receive the measured object that imaging sensor 1014 captures
View data corresponding to surveying the color information of thing is handled.ISP processors 1030 are analyzed view data can with acquisition
For determination and/or the image statistics of one or more control parameters of imaging device 1010.Imaging sensor 1014 can
Including colour filter array (such as Bayer filters), imaging sensor 1014 can obtain each imaging with imaging sensor 1014
The luminous intensity and wavelength information that pixel is caught, and the one group of raw image data that can be handled by ISP processors 1030 is provided.
ISP processors 1030 handle raw image data pixel by pixel in various formats.For example, each image pixel can
Bit depth with 8,10,12 or 14 bits, ISP processors 1030 can be carried out at one or more images to raw image data
Reason operation, image statistics of the collection on view data.Wherein, image processing operations can be by identical or different bit depth
Precision is carried out.
ISP processors 1030 can also receive pixel data from video memory 1020.Video memory 1020 can be storage
Independent private memory in the part of device device, storage device or electronic equipment, and may include DMA (Direct
Memory Access, direct direct memory access (DMA)) feature.
When receiving raw image data, ISP processors 1030 can carry out one or more image processing operations.
After ISP processors 1030 get color information and the depth information of measured object, it can be merged, obtained
3-D view.Wherein, can be extracted by least one of appearance profile extracting method or contour feature extracting method corresponding
The feature of measured object.Such as pass through active shape model method ASM, active appearance models method AAM, PCA PCA, discrete
The methods of cosine transform method DCT, the feature of measured object is extracted, is not limited herein.It will be extracted respectively from depth information again
The feature of measured object and feature progress registration and the Fusion Features processing that measured object is extracted from color information.Herein refer to
Fusion treatment can be the feature that will be extracted in depth information and color information directly combination or by different images
Middle identical feature combines after carrying out weight setting, it is possibility to have other amalgamation modes, finally according to the feature after fusion, generation
3-D view.
The view data of 3-D view can be transmitted to video memory 1020, to carry out other place before shown
Reason.ISP processors 1030 from the reception processing data of video memory 1020, and to the processing data carry out original domain in and
Image real time transfer in RGB and YCbCr color spaces.The view data of 3-D view may be output to display 1060, for
User watches and/or further handled by graphics engine or GPU (Graphics Processing Unit, graphics processor).
In addition, the output of ISP processors 1030 also can be transmitted to video memory 1020, and display 1060 can be from video memory
1020 read view data.In one embodiment, video memory 1020 can be configured as realizing one or more frame bufferings
Device.In addition, the output of ISP processors 1030 can be transmitted to encoder/decoder 1050, so as to encoding/decoding image data.Compile
The view data of code can be saved, and be decompressed before being shown in the equipment of display 1060.Encoder/decoder 1050 can
Realized by CPU or GPU or coprocessor.
The image statistics that ISP processors 1030 determine, which can be transmitted, gives the unit of control logic device 1040.Control logic device
1040 may include the processor and/or microcontroller that perform one or more routines (such as firmware), and one or more routines can root
According to the image statistics of reception, the control parameter of imaging device 1010 is determined.
It it is below the step of realizing the facial method of adjustment of face 3D models with image processing techniques in Fig. 6：
Infrared structure light source is projected to the user of wearing spectacles, and shoots the infrared structure light source through after the glasses
The infrared structure light image of modulation；
Phase corresponding to deformation position pixel in the infrared structure light image is demodulated, user's eye is generated according to the phase
The depth of view information in portion；
The eye profile of user is generated according to the depth of view information of user's eye, according to the Skin Color Information pair of user's face
The eye profile carries out colors countenance, and generation removes the user images of glasses.
In order to realize above-described embodiment, the present invention also proposes a kind of non-transitorycomputer readable storage medium, deposited thereon
Computer program is contained, removal glasses as in the foregoing embodiment can be realized when the computer program is executed by processor
Face restoring method.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or the spy for combining the embodiment or example description
Point is contained at least one embodiment or example of the present invention.In this manual, to the schematic representation of above-mentioned term not
Identical embodiment or example must be directed to.Moreover, specific features, structure, material or the feature of description can be with office
Combined in an appropriate manner in one or more embodiments or example.In addition, in the case of not conflicting, the skill of this area
Art personnel can be tied the different embodiments or example and the feature of different embodiments or example described in this specification
Close and combine.
Although embodiments of the invention have been shown and described above, it is to be understood that above-described embodiment is example
Property, it is impossible to limitation of the present invention is interpreted as, one of ordinary skill in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changed, replacing and modification.
Claims (10)
- A kind of 1. face restoring method for removing glasses, it is characterised in that including：Infrared structure light source is projected to the user of wearing spectacles, and shoots after the infrared structure light source passes through the glasses and modulates Infrared structure light image；Phase corresponding to deformation position pixel in the infrared structure light image is demodulated, user's eye is generated according to the phase Depth of view information；The eye profile of user is generated according to the depth of view information of user's eye, according to the Skin Color Information of user's face to described Eye profile carries out colors countenance, and generation removes the user images of glasses.
- 2. the method as described in claim 1, it is characterised in that the user to wearing spectacles projects infrared structure light source, And the infrared structure light source is shot through the infrared structure light image modulated after the glasses, including：Infrared structure light source is projected to the user's face of wearing spectacles, and shoots the infrared structure light source through after the glasses The infrared structure light image modulated by the user's face；Phase corresponding to deformation position pixel in the demodulation infrared structure light image, user's eye is generated according to the phase The depth of view information in portion, including：Phase corresponding to deformation position pixel in the infrared structure light image is demodulated, the user plane is generated according to the phase The depth of view information in portion；The depth of view information of user's eye is extracted from the depth of view information of the user's face.
- 3. the method as described in claim 1, it is characterised in that the user to wearing spectacles projects infrared structure light source, And the infrared structure light source is shot through the infrared structure light image modulated after the glasses, including：Identify the eyeglasses-wearing region of user in preview screen；The crevice projection angle of infrared projector is adjusted according to the eyeglasses-wearing region；To the eyeglasses-wearing region project infrared structure light source, and shoot after the infrared structure light source passes through the glasses and pass through Cross the infrared structure light image of user's eye modulation.
- 4. the method as described in claim 1, it is characterised in that also include：Identify the colour of lens of the glasses；The projection intensity of the infrared structure light source is adjusted according to the colour of lens.
- 5. the method as described in claim 1, it is characterised in that the architectural feature of the infrared structure light source, including：Laser stripe, Gray code, sine streak, uniform speckle or, non-homogeneous speckle.
- A kind of 6. face reduction apparatus for removing glasses, it is characterised in that including：Taking module is projected, for projecting infrared structure light source to the user of wearing spectacles, and shoots the infrared structure light source Through the infrared structure light image modulated after the glasses；Generation module is demodulated, for demodulating phase corresponding to deformation position pixel in the infrared structure light image, according to described Phase generates the depth of view information of user's eye；Generation module, for generating the eye profile of user according to the depth of view information of user's eye, according to user's face Skin Color Information carries out colors countenance to the eye profile, and generation removes the user images of glasses.
- 7. device as claimed in claim 6, it is characterised in that the projection taking module is specifically used for：Infrared structure light source is projected to the user's face of wearing spectacles, and shoots the infrared structure light source through after the glasses The infrared structure light image modulated by the user's face；The demodulation generation module is specifically used for：Phase corresponding to deformation position pixel in the infrared structure light image is demodulated, the user plane is generated according to the phase The depth of view information in portion；The depth of view information of user's eye is extracted from the depth of view information of the user's face.
- 8. device as claimed in claim 6, it is characterised in that the projection taking module is specifically additionally operable to：Identify the eyeglasses-wearing region of user in preview screen；The crevice projection angle of infrared projector is adjusted according to the eyeglasses-wearing region；To the eyeglasses-wearing region project infrared structure light source, and shoot after the infrared structure light source passes through the glasses and pass through Cross the infrared structure light image of user's eye modulation.
- 9. a kind of terminal device, it is characterised in that including memory, processor and be stored on the memory and can be described The computer program run on processor, it is characterised in that during the computing device described program, realize such as claim 1- The face restoring method of removal glasses described in 5 any one.
- 10. a kind of non-transitorycomputer readable storage medium, is stored thereon with computer program, it is characterised in that the program The face restoring method of the removal glasses as described in claim any one of 1-5 is realized when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710676984.9A CN107563302B (en) | 2017-08-09 | 2017-08-09 | Face restoration method and device for removing glasses |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710676984.9A CN107563302B (en) | 2017-08-09 | 2017-08-09 | Face restoration method and device for removing glasses |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107563302A true CN107563302A (en) | 2018-01-09 |
| CN107563302B CN107563302B (en) | 2020-10-02 |
Family
ID=60974392
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710676984.9A Active CN107563302B (en) | 2017-08-09 | 2017-08-09 | Face restoration method and device for removing glasses |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107563302B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109445583A (en) * | 2018-10-19 | 2019-03-08 | Oppo广东移动通信有限公司 | Page control method, device and mobile terminal |
| CN114827561A (en) * | 2022-03-07 | 2022-07-29 | 成都极米科技股份有限公司 | Projection control method, projection control device, computer equipment and computer-readable storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103020579A (en) * | 2011-09-22 | 2013-04-03 | 上海银晨智能识别科技有限公司 | Face recognition method and system, and removing method and device for glasses frame in face image |
| CN106991379A (en) * | 2017-03-09 | 2017-07-28 | 广东欧珀移动通信有限公司 | Human body skin recognition methods and device and electronic installation with reference to depth information |
| CN106991377A (en) * | 2017-03-09 | 2017-07-28 | 广东欧珀移动通信有限公司 | With reference to the face identification method, face identification device and electronic installation of depth information |
-
2017
- 2017-08-09 CN CN201710676984.9A patent/CN107563302B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103020579A (en) * | 2011-09-22 | 2013-04-03 | 上海银晨智能识别科技有限公司 | Face recognition method and system, and removing method and device for glasses frame in face image |
| CN106991379A (en) * | 2017-03-09 | 2017-07-28 | 广东欧珀移动通信有限公司 | Human body skin recognition methods and device and electronic installation with reference to depth information |
| CN106991377A (en) * | 2017-03-09 | 2017-07-28 | 广东欧珀移动通信有限公司 | With reference to the face identification method, face identification device and electronic installation of depth information |
Non-Patent Citations (1)
| Title |
|---|
| DONG GUAN等: "Research of spectacle frame measurement system based on structured light method", 《PROCEEDINGS OF SPIE》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109445583A (en) * | 2018-10-19 | 2019-03-08 | Oppo广东移动通信有限公司 | Page control method, device and mobile terminal |
| CN114827561A (en) * | 2022-03-07 | 2022-07-29 | 成都极米科技股份有限公司 | Projection control method, projection control device, computer equipment and computer-readable storage medium |
| CN114827561B (en) * | 2022-03-07 | 2023-03-28 | 成都极米科技股份有限公司 | Projection control method, projection control device, computer equipment and computer-readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107563302B (en) | 2020-10-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107682607B (en) | Image acquiring method, device, mobile terminal and storage medium | |
| CN107451561A (en) | Iris recognition light compensation method and device | |
| CN107368730A (en) | Unlock verification method and device | |
| CN107480613A (en) | Face identification method, device, mobile terminal and computer-readable recording medium | |
| CN107610077A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107734264B (en) | Image processing method and device | |
| CN107464280A (en) | The matching process and device of user's 3D modeling | |
| CN107623814A (en) | The sensitive information screen method and device of shooting image | |
| CN107509045A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107481317A (en) | The facial method of adjustment and its device of face 3D models | |
| CN107423716A (en) | Face method for monitoring state and device | |
| CN107707831A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107564050A (en) | Control method, device and terminal device based on structure light | |
| CN107483428A (en) | Auth method, device and terminal device | |
| CN107707838A (en) | Image processing method and device | |
| CN107707835A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107509043A (en) | Image processing method and device | |
| CN107610078A (en) | Image processing method and device | |
| CN107590828A (en) | The virtualization treating method and apparatus of shooting image | |
| CN107644440A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107483815A (en) | The image pickup method and device of moving object | |
| CN107705277A (en) | Image processing method and device | |
| CN107610076A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107613239A (en) | Video communication background display methods and device | |
| CN107622496A (en) | Image processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: OPPO Guangdong Mobile Communications Co., Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: Guangdong OPPO Mobile Communications Co., Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |