CN108324247A - A kind of designated position wrinkle of skin appraisal procedure and system - Google Patents
A kind of designated position wrinkle of skin appraisal procedure and system Download PDFInfo
- Publication number
- CN108324247A CN108324247A CN201810085940.3A CN201810085940A CN108324247A CN 108324247 A CN108324247 A CN 108324247A CN 201810085940 A CN201810085940 A CN 201810085940A CN 108324247 A CN108324247 A CN 108324247A
- Authority
- CN
- China
- Prior art keywords
- skin
- face
- wrinkle
- pixel
- cloud server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/44—Detecting, measuring or recording for evaluating the integumentary system, e.g. skin, hair or nails
- A61B5/441—Skin evaluation, e.g. for skin disorder diagnosis
- A61B5/442—Evaluating skin mechanical properties, e.g. elasticity, hardness, texture, wrinkle assessment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
Abstract
The invention discloses a kind of designated position wrinkle of skin appraisal procedure and systems, belong to Skin Detection field；Method includes when detecting pickup area of the face of user in image collecting device, by image collecting device, shooting is associated with the facial image that same face specifies face location respectively under different light source irradiations, and by facial image, simultaneously designated position mark is sent in Cloud Server skin detection mirror；Cloud Server handles to obtain the unit normal vector of each pixel by stereo photometry and processing obtains the case depth information of each pixel and forms face's stereo-picture of face；Then face's stereo-picture is judged using the wrinkle of skin assessment models that training is formed in advance according to station location marker, to obtain wrinkle of skin assessment result and export.Advantage is：In conjunction with the function of skin detection and vanity mirror, the ability of wrinkle of skin three-dimensional reconstruction and three-dimensional assessment is provided so that user is capable of the wrinkle of skin situation of accurate perception itself.
Description
Technical field
The present invention relates to Skin Detection field more particularly to a kind of designated position wrinkle of skin appraisal procedure and it is
System.
Background technology
With the promotion of people's quality of the life, more and more people especially women begins to focus on the skin of itself,
What is risen therewith is the beauty mechanism being seen everywhere, and the miscellaneous maintenance product for skin in the market.
People go to beauty mechanism to obtain beauty services for the skin health state timely understood, typically selection, by
Beautician in beauty mechanism makes assessment to the skin condition of user, and beautician is normally based on when making assessment
The subjective experience of people, there may be differences for the result that everyone evaluates, thus user cannot be made accurately to understand oneself face
Whether the health status of portion's skin, such as canthus have whether wrinkle, face have decree line etc..
It is current in the market, although there are some skin detection equipment, such as skin detection instrument etc., these skins inspection
The price of measurement equipment is more expensive, and operate it is extremely complex, be not suitable for user use at home.These skin detections are set simultaneously
Standby testing principle is generally only the data processing that plane is carried out by the collected sensing data of some sensors, be will not relate to
The problem of being rebuild to three dimensional face, therefore preferable detection result is had for skins such as Oily, skin water shortages, and
It is bad for the detection result of the skin of facial skin wrinkle, it cannot be satisfied the demand of user.
Invention content
According to the prior art protect present in the above problem, now provide a kind of designated position wrinkle of skin appraisal procedure and
The technical solution of system, it is intended in conjunction with the function of skin detection and vanity mirror, provide wrinkle of skin three-dimensional reconstruction and three-dimensional assessment
Ability so that user is capable of the wrinkle of skin situation of accurate perception itself, promotes user experience.
Above-mentioned technical proposal specifically includes：
A kind of designated position wrinkle of skin appraisal procedure, wherein wrinkled to the skin of face using a skin detection mirror
Line is assessed, and the skin detection mirror includes an image collecting device, and one and the position that is connect with described image harvester
Detection device；One interface operating device, the skin detection mirror remotely connect a Cloud Server, further include：
Step S1, the position detecting device is detecting the shooting area whether face appears in described image harvester
Domain；
If so, executing step S2；
If it is not, forming a prompt message, user is made to adjust the placement position of face, return to step S1；
Step S2, it under different light source irradiations, is shot respectively using described image harvester and is associated with same people
The different facial images of the specified face location of face；
The interface operating device provides preset multiple station location markers about face location, according to the face of shooting position
It sets, user selects station location marker corresponding with the face location in the operation interface；
Step S3, the described skin detection mirror sends the station location marker of the facial image and the facial image together
To in the Cloud Server；
Step S4, the Cloud Server handle to obtain the list of each pixel in the facial image by stereo photometry
Position normal vector；
Step S5, the case depth that the Cloud Server handles to obtain each pixel according to the unit normal vector are believed
Breath；
Step S6, the Cloud Server are located at according to the case depth information of each pixel and each pixel
Location information on the facial image forms face's stereo-picture of face；
Step S7, the Cloud Server train to form corresponding wrinkle of skin assessment mould in advance according to different face locations
Type, the Cloud Server use the wrinkle of skin assessment models pair corresponding with the station location marker according to the station location marker
Face's stereo-picture is judged, to obtain the corresponding wrinkle of skin assessment result of the specified face location and export
To the user terminal for remotely connecting the Cloud Server, so that user checks.
Designated position wrinkle of skin appraisal procedure is preferred, the designated position wrinkle of skin appraisal procedure, wherein the step
In rapid S1, at least shooting obtains the facial image under 3 different light source irradiations, and all light sources are not at same
On straight line.
Preferably, designated position wrinkle of skin appraisal procedure, wherein the light source is 12.
Preferably, designated position wrinkle of skin appraisal procedure, wherein the step S2 is specifically included：
Step S41, using a pixel as pending pixel；
Step S42, judge the pending pixel whether be bloom pixel：
If so, turning to step S43；
If it is not, then turning to step S44；
Step S43 is replaced, then using the pixel of the non-bloom of same position in the different facial images
Turn to step S44；
Step S44, processing obtain the surface normal of the pending pixel；
Step S45 handles to obtain the unit normal vector of the pixel according to the surface normal of the pixel.
Preferably, designated position wrinkle of skin appraisal procedure, wherein the step S3 is specifically included：
For each pixel, preset constraint formulations are established according to the unit normal vector, and according to it is described about
Beam formula manipulation obtains the case depth information of the pixel.
Preferably, designated position wrinkle of skin appraisal procedure, wherein the constraint formulations are specially：
Wherein,
V1And V2It is the tangential vector of the facial surface of face；
N is used to indicate the unit vector of the pixel；
X and y is used to indicate the location information of plane of the pixel on facial image；
Z is for indicating the case depth information.
Preferably, designated position wrinkle of skin appraisal procedure, wherein in the step S7, the face location corresponds to
The wrinkle of skin assessment models include：The first assessment models for the crow's foot for assessing face；
First assessment models are gathered according to pre-prepd first training, learn to be formed using deep neural network；
The first training set includes multiple first training datas pair, and each first training data centering includes
The assessment score of the stereoscopic image data of face with crow's foot of different shapes and the corresponding stereoscopic image data.
Preferably, designated position wrinkle of skin appraisal procedure, wherein in the step S7, the face location corresponds to
The wrinkle of skin assessment models include：The second assessment models for the decree line for assessing face；
Second assessment models are gathered according to pre-prepd second training, learn to be formed using deep neural network；
The second training set includes multiple second training datas pair, and each second training data centering includes
The assessment score of the stereoscopic image data of face with decree line of different shapes and the corresponding stereoscopic image data.
A kind of wrinkle of skin assessment system, wherein including：
An image collecting device, a position detecting device is arranged in the skin detection mirror in skin detection mirror；
The position detecting device is connect with described image harvester, and whether the face to detect user appears in
In the shooting area of described image harvester, described image is adopted when in the shooting area for appearing in described image harvester
Acquisition means are shot using described image harvester under different light source irradiations and are associated with the specified face of same face respectively
The different facial images of position；, and generate the station location marker of the specified face location；
Cloud Server, remotely connects the skin detection mirror, the skin detection mirror be used for the facial image and
The station location marker is sent to the Cloud Server together, and the Cloud Server uses the appraisal procedure of above-mentioned wrinkle of skin,
The wrinkle of skin of face is assessed according to the facial image, and assessment result is exported to long-range with the Cloud Server
The user terminal of connection, so that user checks.
The advantageous effect of above-mentioned technical proposal is：In conjunction with the function of skin detection and vanity mirror, use is accurately collected
After the specified face location image of person, the ability of wrinkle of skin three-dimensional reconstruction and three-dimensional assessment is provided so that user can be accurate
The wrinkle of skin situation of itself is grasped, and targetedly obtains the wrinkle of skin situation for specifying face location, promotes user's body
It tests.
Description of the drawings
Fig. 1 is in the preferred embodiment of the present invention, and a kind of overall procedure of designated position wrinkle of skin appraisal procedure shows
It is intended to；
Fig. 2 be the present invention preferred embodiment in, on the basis of Fig. 1, the idiographic flow schematic diagram of step S4；
Fig. 3 is the concrete structure schematic diagram of wrinkle of skin assessment system in the preferred embodiment of the present invention；
Fig. 4 is the schematic diagram of skin detection mirror in the preferred embodiment of the present invention.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation describes, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art obtained under the premise of not making creative work it is all its
His embodiment, shall fall within the protection scope of the present invention.
It should be noted that in the absence of conflict, the feature in embodiment and embodiment in the present invention can phase
Mutually combination.
The invention will be further described in the following with reference to the drawings and specific embodiments, but not as limiting to the invention.
According to the above-mentioned problems in the prior art, a kind of designated position skin wrinkle is provided in technical scheme of the present invention
Line appraisal procedure, wherein wrinkle assessment is carried out to the skin of face using a skin detection mirror, skin detection mirror includes a figure
As harvester, one and the position detecting device that is connect with image collecting device；One interface operating device, skin detection mirror are remote
Journey connects a Cloud Server, further includes：
Step S1, position detecting device is detecting the shooting area whether face appears in image collecting device；
If so, executing step S2；
If it is not, forming a prompt message, user is made to adjust the placement position of face, return to step S1；
Step S2, it under different light source irradiations, is shot respectively using image collecting device and is associated with same face
The different facial images of specified face location；
Interface operating device provides preset multiple station location markers about face location, according to the face location of shooting,
User selects station location marker corresponding with face location in operation interface；
Step S3, the station location marker of facial image and facial image is sent to Cloud Server by skin detection mirror together
In；
Step S4, Cloud Server handle to obtain the unit normal direction of each pixel in facial image by stereo photometry
Amount；
Step S5, Cloud Server handle to obtain the case depth information of each pixel according to unit normal vector；
Step S6, Cloud Server are located at facial image according to the case depth information of each pixel and each pixel
On location information formed face face's stereo-picture；
Step S7, Cloud Server train to form corresponding wrinkle of skin assessment models according to different face locations in advance,
Cloud Server sentences face's stereo-picture using wrinkle of skin assessment models corresponding with station location marker according to station location marker
It is disconnected, to obtain the corresponding wrinkle of skin assessment result of specified face location and export whole to the user of long-range connection Cloud Server
End, so that user checks.
Specifically, in the present embodiment, above-mentioned skin detection mirror can be with common for designated position wrinkle of skin appraisal procedure
Vanity mirror is transformed as the ontology of minute surface, i.e., above-mentioned skin detection mirror is made one can be to the change of people's normal use
Adornment mirror can be integrated into the work(of wrinkle of skin detect and assess while providing people's routine use in vanity mirror in this way
Energy.
In the present embodiment, an image collecting device is set on above-mentioned skin detection mirror, which can be
Camera on skin detection mirror is set, the surface of skin detection mirror is particularly provided at, facilitates shooting user people
The general image of face.
When user needs to test the designated position detection wrinkle of skin of oneself face, in order to ensure that image is adopted
Acquisition means accurately collect the face image that user specifies face location, can detect use in real time by position detecting device
Whether the face location of person appears in the shooting area of image collecting device, then passes through when face location appears in shooting area
Image acquisition device obtains the face image of user；
The station location marker of wherein specified face location can be carried out by the picture recognition module provided in image collecting device
Identification obtain, canthus position in this way, when picture recognition module identify shooting be canthus image when form a station location marker i.e.
Canthus identifies.
In the present embodiment, the image collecting device on skin detection mirror shoots the same face respectively under different light sources
Facial image, above-mentioned different light source be different directions point light source, be placed on the different positions around skin detection mirror
It sets, to form the different facial images of same face under different point light source irradiations.It is same in these facial images
Pixel is identical relative to the position of facial image, differs only in the brightness of pixel, can be hereinafter described in detail.
In the present embodiment, skin detection mirror remotely connects a Cloud Server, and above-mentioned shooting is associated with same
The different facial images and station location marker of face are uploaded in Cloud Server.
Specifically, a wireless communication module such as WiFi module can be set in skin detection mirror, pass through indoor road
By being remotely connected to Cloud Server.
In the present embodiment, after the facial image that cloud server is uploaded to skin detection mirror, it will be clapped under different point light sources
The different facial images taken the photograph carry out integrated treatment.Specifically, it is according to each pixel on facial image in Cloud Server
What point was handled, and the light source direction that differs only in point light source of the same pixel in different facial images is different
And the brightness of the pixel thereby resulted in is different, therefore the attribute of different facial images can be integrated into the same pixel
In point, such as the attribute of a pixel includes the letters such as its light source direction and brightness value in different facial images
Breath.
In the present embodiment, Cloud Server is handled each pixel by stereo photometry, to obtain different pixels
The unit normal vector of point, then handles to obtain the case depth information of each pixel according to unit normal vector.There is surface deep
After spending information, Cloud Server can establish face's stereo-picture of face according to pixel, i.e., carry out 3-D view to face
It rebuilds.
In the present embodiment, after the face's stereo-picture for obtaining face, according to station location marker, rheme as above, which is set, is identified as eye
When footmark is known, the wrinkle of skin assessment models formed using advance training assess face's stereo-picture, and export about
The wrinkle of skin assessment result of canthus position in facial image.It is whole that assessment result is remotely issued to corresponding user by Cloud Server
End, so that user checks.Specifically, in above-mentioned wrinkle of skin assessment models, input data is the stereo-picture of face, exports number
According to the assessment result for corresponding wrinkle of skin region in the stereo-picture.Further, which can be assessment point
Number.The concrete operating principle of above-mentioned wrinkle of skin assessment models can hereinafter be described in detail.
To sum up, in technical solution of the present invention, using the image collecting device on skin detection mirror, in different light source knit stitch
Different facial images shot respectively to same face, Cloud Server according to these facial images, using stereo photometry into
Row processing ultimately forms the stereo-picture of face, and stereo-picture is sent into the assessment models of image recognition and wrinkle assessment
In, the corresponding assessment result of final output.Compared with prior art, in technical solution of the present invention, using stereo photometry and
The three-dimensional image that the modes such as case depth information establish face is solved, and wrinkle assessment, Neng Gouzhen are carried out to the image
The situation of reaction user wrinkle of skin on the face on the spot.And the function of skin detection is integrated into vanity mirror, user day is facilitated
It is often used.
It should be noted that shooting integrality based on the considerations of facial image, the skin detection mirror in the present invention is should be
Vanity mirror with certain minute surface area, such as it is placed in the vanity mirror made up on table, or it is directly installed on bedroom metope
On vanity mirror etc., avoid using the technology that the present invention can be realized with the hand held middle vanity mirror used more small and exquisite on the market
Scheme.
In the preferred embodiment of the present invention, in step S1, at least shooting obtains face under 3 different light source irradiations
Image, all light sources are not on same straight line.
Further, in preferred embodiment of the invention, above-mentioned light source is specially 12, i.e., around skin detection mirror
12 light sources are set, and the light source direction of these light sources is different, and all light sources are not on same straight line.
In the preferred embodiment of the present invention, as shown in Figure 2, above-mentioned steps S4 is specifically included：
Step S41, using a pixel as pending pixel；
Step S42, judge pending pixel whether be bloom pixel：
If so, turning to step S43；
If it is not, then turning to step S44；
Step S43 is replaced using the pixel of the non-bloom of same position in different facial images, is subsequently diverted to
Step S44；
Step S44, processing obtain the surface normal of pending pixel；
Step S45 handles to obtain the unit normal vector of pixel according to the surface normal of pixel.
Specifically, in the present embodiment, since the pixel of bloom is unable to judge accurately its wrinkle of skin image, into
Row face image needs to reject the pixel of bloom first when rebuilding.The mode of rejecting is：Pixel is judged by threshold method first
Point whether be bloom pixel (its brightness value is bloom pixel higher than preset threshold value).Subsequently, for being judged as
The pixel of bloom is substituted using the pixel of the non-bloom of same position in other facial images, specifically, such as above
In, the attribute of different facial images participates in calculating, such as the category of a pixel by the attribute as each pixel
Property value in include brightness value of the pixel in different facial images, then for a pixel, reject bloom
The principle of pixel is exactly to reject the brightness value for being higher than predetermined threshold value in a pixel, leaves behind the brightness value of non-bloom.
In the present embodiment, after rejecting bloom pixel, the pixel of all non-blooms is handled successively, with
The surface normal of each pixel is obtained, and obtains the unit normal vector of each pixel in turn.
The process for solving surface normal specifically includes：
For coloured image, the brightness of each pixel is indicated by the value of tri- Color Channels of R, G, B.This reality
It applies in example and the processing procedure of surface normal is illustrated by taking R values as an example.
Assuming that the face surface in the present invention meets ideal Lambertian scattering models, then the luminance equation of pixel
It should be：
IR=ρRL·nR； (1)
Wherein, I is used to indicate that the brightness of pixel, L to be used to indicate the direction vector of light source, and ρ is for indicating pixel pair
The texture reflectivity for the surface region answered, n are used to indicate the unit normal vector of the corresponding surface region of pixel.
The direction vector of above-mentioned each light source knows in advance, may be used shot under different light source directions it is one group high
Light black ball image is realized, can obtain the side of illumination by searching for the position of highlight in each bloom black ball image
To the light source direction as point light source.
In above-mentioned steps, the brightness of the pixel of non-bloom under the irradiation of different light sources can be represented as：
IR=(I1R,I2R,...,IqR)T； (2)
Wherein, q is used to indicate the quantity of light source, wherein eliminating the light source corresponding to bloom pixel, T is turning for matrix
Set calculating.
Correspondingly, the unit normal vector of each pixel can be represented as：
nR=(n1R,n2R,...,nqR)T； (3)
By calculating, the direction vector of q light source is should be：
It is multiplied by L simultaneously at the both ends of above-mentioned formula (1)-1It can obtain：
L-1IR=ρR·nR； (5)
Then the equation left side vector field homoemorphism of above-mentioned formula (5) is the value of texture reflectivity, and the direction of left side vector is
The direction of surface normal.
After obtaining the surface normal in the channels R of pixel, the unit normal vector in the channels R is calculated, i.e.,：
nR=(nRa,nRb,nRc)T； (6)
Wherein, (a, b, c) is vector direction coordinate of the pixel in normal direction quantity space.
The unit normal vector of the pixel channel B and the channels G can be respectively obtained according to above-mentioned formula (1)-(6)：
nB=(nBa,nBb,nBc)T； (7)
nG=(nGa,nGb,nGc)T； (8)
The unit normal vector of a final pixel can take the average value of the unit normal vector of above-mentioned RGB channel, and table
It is shown as：
N=(na,nb,nc)T； (9)
The gradient (- n of each pixel can also be calculated according to above-mentioned formula (9)a/nc,-nb/nc), and can be with
Establish the normal direction spirogram of facial skin wrinkle.
In the preferred embodiment of the present invention, above-mentioned steps S5 is specifically included：
For each pixel, preset constraint formulations are established according to unit normal vector, and handle according to constraint formulations
To the case depth information of pixel.
Further, be based on tangent plane principle, the normal direction of body surface every bit should with it is tangential vertical, then can establish
Following constraint formulations：
Wherein, V1And V2It is the tangential vector on face surface, (x, y, z) is spatial coordinate of the pixel on face surface,
Wherein (x, y) is the plane coordinates of pixel, i.e., the location information of plane of the pixel on facial image is (in step S4
Location information), z is for indicating depth value of the pixel on facial image.
There is the facial image of m pixel for a width, so that it may to obtain 2m constraint equation, the per unit system of each pixel
Vector n is known, and the location information x and y of the plane of each pixel are also known, and depth value z is a scalar, because
The constraint equation of all pixels point can be formed an equation matrix by this, and each picture is obtained with by solving equation matrix
The case depth information of vegetarian refreshments.
After obtaining the case depth information of each pixel, just there is spatial coordinate (x, y, z), can thus build people
Face's stereo-picture of face and carry out 3D display.
In the preferred embodiment of the present invention, in above-mentioned steps S7, the corresponding wrinkle of skin of face location assesses mould
Type includes：The first assessment models for the crow's foot for assessing face；
First assessment models are gathered according to pre-prepd first training, learn to be formed using deep neural network；
First training set includes multiple first training datas pair, and each first training data centering includes having difference
The assessment score of the stereoscopic image data of the face of the crow's foot of shape and corresponding stereoscopic image data.
Specifically, in the present embodiment, multiple first training datas pair are prepared in advance, each first training data centering includes
The stereo-picture of one width crow's foot, and the assessment score to being obtained after stereo-picture progress manually evaluation.First training
The quantity of data pair is more, and the assessment result for the first assessment models that training is formed is more accurate.
In the present embodiment, above-mentioned first assessment models dedicated for assess face crow's foot.In the mistake of practical application
Cheng Zhong, above-mentioned first assessment models find out the stereo-picture of crow's foot from whole face's stereo-picture first, then right
The stereo-picture of crow's foot is assessed, one assessment result of final output, which may be used assessment score
Mode provides.
In another preferred embodiment of the present invention, in above-mentioned steps S7, the corresponding wrinkle of skin assessment of face location
Model includes：The second assessment models for the decree line for assessing face；
Second assessment models are gathered according to pre-prepd second training, learn to be formed using deep neural network；
Second training set includes multiple second training datas pair, and each second training data centering includes having difference
The assessment score of the stereoscopic image data of the face of the decree line of shape and corresponding stereoscopic image data.
Specifically, in the present embodiment, multiple second training datas pair are prepared in advance, each second training data centering includes
The stereo-picture of one width decree line, and the assessment score to being obtained after stereo-picture progress manually evaluation.Second training number
According to quantity it is more, training formed the second assessment models assessment result it is more accurate.
In the present embodiment, above-mentioned second assessment models dedicated for assess face decree line.In the process of practical application
In, above-mentioned second assessment models find out the stereo-picture of decree line from whole face's stereo-picture first, then to decree
The stereo-picture of line is assessed, one assessment result of final output, which equally may be used the side of assessment score
Formula provides.
In another preferred embodiment of the present invention, above-mentioned first can be used simultaneously in wrinkle of skin assessment models
Assessment models and the second assessment models, so as to comprehensively assess user crow's foot and decree line situation.
In the preferred embodiment of the present invention, based on designated position wrinkle of skin appraisal procedure above, one is now provided
Kind wrinkle of skin assessment system A, the system is specifically as shown in Figure 3, including：
One image collecting device A11, a position detecting device A12 is set in skin detection mirror A1, skin detection mirror A1；
Position detecting device A12 is connect with image collecting device A11, and whether the face to detect user appears in figure
As harvester shooting area in, image collecting device is not when in the shooting area for appearing in image collecting device A11
Under same light source irradiation, is shot respectively using image collecting device A11 and be associated with the difference that same face specifies face location
Facial image, and generate specify face location station location marker；
Cloud Server A2, long-range to connect skin detection mirror A1, skin detection mirror A1 is used to mark facial image and position
Knowledge is sent to Cloud Server A2 together, and Cloud Server A2 uses the appraisal procedure of wrinkle of skin above, according to facial image
The wrinkle of skin of face is assessed, and assessment result is exported to the user terminal B remotely being connect with Cloud Server A2, with
It is checked for user.
Further, the specular appearance schematic diagram of above-mentioned skin detection mirror A1 is as shown in Figure 4, skin detection mirror A1's
Point light sources of the plurality of LEDs lamp bead A13 as different directions can also be set around minute surface ontology A12, carry out assistant images acquisition
Device A11 shoots face.
The foregoing is merely preferred embodiments of the present invention, are not intended to limit embodiments of the present invention and protection model
It encloses, to those skilled in the art, should can appreciate that all with made by description of the invention and diagramatic content
Equivalent replacement and obviously change obtained scheme, should all be included within the scope of the present invention.
Claims (9)
1. a kind of designated position wrinkle of skin appraisal procedure, which is characterized in that using a skin detection mirror to the skin of face into
Row wrinkle is assessed, and the skin detection mirror includes an image collecting device, and the position being connect with described image harvester
One interface operating device of detection device is set, the skin detection mirror remotely connects a Cloud Server, further includes：
Step S1, the position detecting device is detecting the shooting area whether face appears in described image harvester；
If so, executing step S2；
If it is not, forming a prompt message, user is made to adjust the placement position of face, return to step S1；
Step S2, it under different light source irradiations, is shot respectively using described image harvester and is associated with same face
The different facial images of specified face location；
The interface operating device provides preset multiple station location markers about face location, according to the face location of shooting,
User selects station location marker corresponding with the face location in the operation interface；
The station location marker of the facial image and the facial image is sent to institute by step S3, the described skin detection mirror together
It states in Cloud Server；
Step S4, the Cloud Server handle to obtain the per unit system of each pixel in the facial image by stereo photometry
Vector；
Step S5, the Cloud Server handle to obtain the case depth information of each pixel according to the unit normal vector；
Step S6, the Cloud Server are located at described according to the case depth information of each pixel and each pixel
Location information on facial image forms face's stereo-picture of face；
Step S7, the Cloud Server train to form corresponding wrinkle of skin assessment models according to different face locations in advance,
The Cloud Server is according to the station location marker using the wrinkle of skin assessment models corresponding with the station location marker to institute
It states face's stereo-picture to be judged, to obtain the corresponding wrinkle of skin assessment result of the specified face location and export extremely
The user terminal for remotely connecting the Cloud Server, so that user checks.
2. wrinkle of skin appraisal procedure in designated position as described in claim 1, which is characterized in that in the step S1, at least
Shooting obtains the facial image under 3 different light source irradiations, and all light sources are not on same straight line.
3. wrinkle of skin appraisal procedure in designated position as claimed in claim 2, which is characterized in that the light source is 12.
4. wrinkle of skin appraisal procedure in designated position as described in claim 1, which is characterized in that the step S4 is specifically wrapped
It includes：
Step S41, using a pixel as pending pixel；
Step S42, judge the pending pixel whether be bloom pixel：
If so, turning to step S43；
If it is not, then turning to step S44；
Step S43 is replaced using the pixel of the non-bloom of same position in the different facial images, is subsequently diverted to
Step S44；
Step S44, processing obtain the surface normal of the pending pixel；
Step S45 handles to obtain the unit normal vector of the pixel according to the surface normal of the pixel.
5. wrinkle of skin appraisal procedure in designated position as described in claim 1, which is characterized in that the step S5 is specifically wrapped
It includes：
For each pixel, preset constraint formulations are established according to the unit normal vector, and according to constraint public affairs
Formula handles to obtain the case depth information of the pixel.
6. wrinkle of skin appraisal procedure in designated position as claimed in claim 5, which is characterized in that the constraint formulations are specific
For：
Wherein,
V1And V2It is the tangential vector of the facial surface of face；
N is used to indicate the unit vector of the pixel；
X and y is used to indicate the location information of plane of the pixel on facial image；
Z is for indicating the case depth information.
7. wrinkle of skin appraisal procedure in designated position as described in claim 1, which is characterized in that described in the step S7
The corresponding wrinkle of skin assessment models of face location include：The first assessment models for the crow's foot for assessing face；
First assessment models are gathered according to pre-prepd first training, learn to be formed using deep neural network；
The first training set includes multiple first training datas pair, and each first training data centering includes having
The assessment score of the stereoscopic image data of the face of crow's foot of different shapes and the corresponding stereoscopic image data.
8. wrinkle of skin appraisal procedure in designated position as described in claim 1, which is characterized in that described in the step S7
The corresponding wrinkle of skin assessment models of face location include：The second assessment models for the decree line for assessing face；
Second assessment models are gathered according to pre-prepd second training, learn to be formed using deep neural network；
The second training set includes multiple second training datas pair, and each second training data centering includes having
The assessment score of the stereoscopic image data of the face of decree line of different shapes and the corresponding stereoscopic image data.
9. a kind of wrinkle of skin assessment system, which is characterized in that including：
An image collecting device, a position detecting device is arranged in the skin detection mirror in skin detection mirror；
The position detecting device is connect with described image harvester, and whether the face to detect user appears in described
In the shooting area of image collecting device, described image acquisition dress when in the shooting area for appearing in described image harvester
It sets under different light source irradiations, is shot respectively using described image harvester and be associated with the specified face location of same face
Different facial images, and generate the station location marker of the specified face location；
Cloud Server, remotely connects the skin detection mirror, and the skin detection mirror is used for the facial image and described
Station location marker is sent to the Cloud Server together, and the Cloud Server is used as described in any one of claim 1-8
The appraisal procedure of wrinkle of skin assesses the wrinkle of skin of face according to the facial image, and assessment result is exported
To the user terminal remotely being connect with the Cloud Server, so that user checks.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810085940.3A CN108324247B (en) | 2018-01-29 | 2018-01-29 | Method and system for evaluating skin wrinkles at specified positions |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810085940.3A CN108324247B (en) | 2018-01-29 | 2018-01-29 | Method and system for evaluating skin wrinkles at specified positions |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108324247A true CN108324247A (en) | 2018-07-27 |
| CN108324247B CN108324247B (en) | 2021-08-10 |
Family
ID=62926061
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810085940.3A Active CN108324247B (en) | 2018-01-29 | 2018-01-29 | Method and system for evaluating skin wrinkles at specified positions |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108324247B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109948476A (en) * | 2019-03-06 | 2019-06-28 | 南京七奇智能科技有限公司 | A kind of face skin detection system based on computer vision and its implementation |
| CN110236960A (en) * | 2019-05-23 | 2019-09-17 | 乐伊嘉 | A kind of atomizing facial mask |
| CN110443765A (en) * | 2019-08-02 | 2019-11-12 | 厦门美图之家科技有限公司 | Image processing method, device and electronic equipment |
| CN111199171A (en) * | 2018-11-19 | 2020-05-26 | 华为技术有限公司 | Wrinkle detection method and terminal equipment |
| CN113487670A (en) * | 2020-10-26 | 2021-10-08 | 青岛海信电子产业控股股份有限公司 | Cosmetic mirror and state adjusting method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102104767A (en) * | 2009-10-16 | 2011-06-22 | 苹果公司 | Facial pose improvement with perspective distortion correction |
| CN105378657A (en) * | 2013-05-29 | 2016-03-02 | 诺基亚技术有限公司 | Apparatus and associated methods |
| CN106506959A (en) * | 2016-11-15 | 2017-03-15 | 上海传英信息技术有限公司 | Photographic means and camera installation |
| CN106650215A (en) * | 2016-10-11 | 2017-05-10 | 武汉嫦娥医学抗衰机器人股份有限公司 | Skin type detection and individuation evaluation system and method based on cloud platform |
| CN106780726A (en) * | 2016-12-23 | 2017-05-31 | 陕西科技大学 | The dynamic non-rigid three-dimensional digital method of fusion RGB D cameras and colored stereo photometry |
| CN107392858A (en) * | 2017-06-16 | 2017-11-24 | 广东欧珀移动通信有限公司 | Image highlight area processing method, device and terminal device |
| CN107437073A (en) * | 2017-07-19 | 2017-12-05 | 竹间智能科技（上海）有限公司 | Face skin quality analysis method and system based on deep learning with generation confrontation networking |
-
2018
- 2018-01-29 CN CN201810085940.3A patent/CN108324247B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102104767A (en) * | 2009-10-16 | 2011-06-22 | 苹果公司 | Facial pose improvement with perspective distortion correction |
| CN105378657A (en) * | 2013-05-29 | 2016-03-02 | 诺基亚技术有限公司 | Apparatus and associated methods |
| CN106650215A (en) * | 2016-10-11 | 2017-05-10 | 武汉嫦娥医学抗衰机器人股份有限公司 | Skin type detection and individuation evaluation system and method based on cloud platform |
| CN106506959A (en) * | 2016-11-15 | 2017-03-15 | 上海传英信息技术有限公司 | Photographic means and camera installation |
| CN106780726A (en) * | 2016-12-23 | 2017-05-31 | 陕西科技大学 | The dynamic non-rigid three-dimensional digital method of fusion RGB D cameras and colored stereo photometry |
| CN107392858A (en) * | 2017-06-16 | 2017-11-24 | 广东欧珀移动通信有限公司 | Image highlight area processing method, device and terminal device |
| CN107437073A (en) * | 2017-07-19 | 2017-12-05 | 竹间智能科技（上海）有限公司 | Face skin quality analysis method and system based on deep learning with generation confrontation networking |
Non-Patent Citations (1)
| Title |
|---|
| E.JULIASTUTI ET AL.: "Prototype of Photometric Stereo System using 6 and 9 LED light source to reconstruct human skin texture", 《APPLIED MECHANICS AND MATERIALS》 * |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111199171A (en) * | 2018-11-19 | 2020-05-26 | 华为技术有限公司 | Wrinkle detection method and terminal equipment |
| CN111199171B (en) * | 2018-11-19 | 2022-09-23 | 荣耀终端有限公司 | Wrinkle detection method and terminal equipment |
| US11978231B2 (en) | 2018-11-19 | 2024-05-07 | Honor Device Co., Ltd. | Wrinkle detection method and terminal device |
| CN109948476A (en) * | 2019-03-06 | 2019-06-28 | 南京七奇智能科技有限公司 | A kind of face skin detection system based on computer vision and its implementation |
| CN109948476B (en) * | 2019-03-06 | 2022-12-13 | 南京七奇智能科技有限公司 | Human face skin detection system based on computer vision and implementation method thereof |
| CN110236960A (en) * | 2019-05-23 | 2019-09-17 | 乐伊嘉 | A kind of atomizing facial mask |
| CN110236960B (en) * | 2019-05-23 | 2022-12-27 | 广州金御化妆品有限公司 | Spray type mask |
| CN110443765A (en) * | 2019-08-02 | 2019-11-12 | 厦门美图之家科技有限公司 | Image processing method, device and electronic equipment |
| CN113487670A (en) * | 2020-10-26 | 2021-10-08 | 青岛海信电子产业控股股份有限公司 | Cosmetic mirror and state adjusting method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108324247B (en) | 2021-08-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108324247A (en) | A kind of designated position wrinkle of skin appraisal procedure and system | |
| CN107358648B (en) | Real-time full-automatic high quality three-dimensional facial reconstruction method based on individual facial image | |
| CN106250870B (en) | A kind of pedestrian's recognition methods again of joint part and global similarity measurement study | |
| CN105534694B (en) | A kind of characteristics of human body's visualization device and method | |
| CN108363964A (en) | A kind of pretreated wrinkle of skin appraisal procedure and system | |
| Bogo et al. | FAUST: Dataset and evaluation for 3D mesh registration | |
| Yuan et al. | A mixed reality virtual clothes try-on system | |
| CN104221054B (en) | Character attribute deduction system and study data generating device | |
| CN105718869B (en) | The method and apparatus of face face value in a kind of assessment picture | |
| ES2692391T3 (en) | Improved virtual test simulation service | |
| CN105631861B (en) | Restore the method for 3 D human body posture from unmarked monocular image in conjunction with height map | |
| CN102520796B (en) | Sight tracking method based on stepwise regression analysis mapping model | |
| CN103356163B (en) | Based on fixation point measuring device and the method thereof of video image and artificial neural network | |
| CN110074788B (en) | Body data acquisition method and device based on machine learning | |
| CN110251066A (en) | Based on the not positive system and method for subjective distance measuring measurement ophthalmic refractive | |
| Jia et al. | Imaged based estimation of food volume using circular referents in dietary assessment | |
| CN106056056A (en) | Long-distance non-contact luggage volume detection system and method thereof | |
| CN105556508A (en) | Devices, systems and methods of virtualizing a mirror | |
| WO2018075053A1 (en) | Object pose based on matching 2.5d depth information to 3d information | |
| KR101928531B1 (en) | Three-dimensional micro surface imaging device Using multiple layer and multiple section lighting control | |
| KR101792541B1 (en) | Smart Device Skin care service system using Skin Diagnostic Information | |
| CN108364286A (en) | A kind of visual wrinkle of skin appraisal procedure and system | |
| CN107533580A (en) | The multiple parameters for the biological information that part as live plant is shown over the display | |
| CN105354825A (en) | Intelligent device for automatically identifying position of reading material in read-write scene and application of intelligent device | |
| CN107976157A (en) | A kind of wireless hand-held three-dimensional scanning device in acquisition object surface three-dimensional morphology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20211207 Address after: 310000 room 1-304, building 2, Xinming commercial center, Gongshu District, Hangzhou City, Zhejiang Province Patentee after: Hangzhou Taitai Enterprise Management Co.,Ltd. Address before: Room 303, building 6, 156 Wuchang Avenue, Wuchang Street, Yuhang District, Hangzhou City, Zhejiang Province 310000 Patentee before: HANGZHOU MEIJIE TECHNOLOGY Co.,Ltd. |