CN106934073A - Face comparison system, method and mobile terminal based on three-dimensional image - Google Patents
Face comparison system, method and mobile terminal based on three-dimensional image Download PDFInfo
- Publication number
- CN106934073A CN106934073A CN201710299508.XA CN201710299508A CN106934073A CN 106934073 A CN106934073 A CN 106934073A CN 201710299508 A CN201710299508 A CN 201710299508A CN 106934073 A CN106934073 A CN 106934073A
- Authority
- CN
- China
- Prior art keywords
- face
- dimensional
- dimensional model
- human face
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional objects
- G06V20/653—Three-dimensional objects by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present invention relates to threedimensional model process field, disclose a kind of face comparison system based on three-dimensional image, face control methods, and the mobile terminal of face contrast, the mobile terminal such as mobile phone, flat board, wearable device etc. can be realized based on three-dimensional image.The present invention is using the three-dimensional imaging scanner set on mobile terminal, face to user carries out 3-D scanning, and the human face three-dimensional model of user is contrasted with the human face three-dimensional model in database, it is determined that both different informations, and different information is carried out merging display with the human face three-dimensional model of user.The present invention can carry out face's contrast with star or good friend, the psychological needs of user can be met, with certain recreational, technical support can be provided for simulation shaping and beauty again, and mode of operation is simple and convenient, and mobility is strong, do not limited by place, user can also be controlled operation to threedimensional model, can be simple and clear from multiple angle response difference information, display mode.
Description
Technical field
The present invention relates to threedimensional model process field, especially a kind of face comparison system based on three-dimensional image,
A kind of face control methods based on three-dimensional image, and one kind can realize that face is contrasted based on three-dimensional image
Mobile terminal, the mobile terminal such as mobile phone, flat board, wearable device etc..
Background technology
Lift face is to improve appearance through surgical operation, is often referred to face's integer, such as cuts double-edged eyelid, low bank between fields chin, augmentation rhinoplasty, tender
Lip, the nest that brews alcoholic beverages, straightening of teeth, smoothing wrinkle, except acne, plant eyelashes, depilation etc., use enhancing confidence.With entering for modern medical techniques
Step, medical cosmetic starts fashionable, and increasing people participates.
However, shaping and beauty has certain risk, if cosmetic surgery fails or is not reaching to the effect of anticipation, it is made
Into consequence be difficult remedy, can not do well change again until user be satisfied with untill, to overcome the defect, can be by three
Dimension shaping scanner gathers the three-dimensional data locally or systemically of user, generates initial three-dimensional three-dimensional model, and original based on this
Three-dimensional stereo model carries out corresponding editor's adjustment, to reach shaping effect expected from user, and is built to the corresponding shaping of user
View, enables users to see effect after shaping before plastic operation.But it is expensive due to the three-dimensional shaping scanner of specialty, use
The effect checked after oneself shaping is wanted at family, generally requires and goes to related shaping medical institutions.
To meet the demand of user, the effect after facilitating user to understand oneself shaping, or meet the entertainment requirements of user,
Various simulation lift face APP for being applied to the intelligent mobile terminals such as mobile phone, flat board come into vogue, and user can directly by simulating lift face
APP carries out editing and processing to the photo of oneself, easy to use simple to operate to simulate cosmetic surgery.But existing simulation lift face
APP is usually that user's upload pictures or current shooting photo are processed, and lift face is simulated based on two-dimension picture, can not
The three-dimensional stereo model of user is generated, user directly can not operate to model, mould true to nature is carried out from multi-angle, many-side
Intend lift face, Consumer's Experience is poor.
In addition, through investigation and analysis, most of users have the psychological needs that face contrast is carried out with star, wonder oneself
With the difference of star specifically at which position, and wonder specific variance data, and do not have corresponding technology branch at present
Hold or product is realized.
The content of the invention
Goal of the invention of the invention is：For above-mentioned problem, there is provided a kind of people based on three-dimensional image
Face comparison system, a kind of face control methods based on three-dimensional image, and one kind can based on three-dimensional image come
Realize the mobile terminal of face contrast, the mobile terminal such as mobile phone, flat board, wearable device etc..
Scheme one：Face comparison system based on three-dimensional image.
For one aspect of the present invention, the present invention proposes a kind of face comparison system based on three-dimensional image,
The face comparison system mainly includes three-dimensional reconstruction unit, face comparison unit, display unit, comparison database and is arranged at
Three-dimensional scanner on mobile terminal.
The three-dimensional scanner, face three-dimensional information and facial image for gathering user.
The three-dimensional reconstruction unit, three-dimensional reconstruction, generation first are carried out according to the face three-dimensional information and facial image
Human face three-dimensional model, and first human face three-dimensional model is exported to the display unit shown.
The face comparison unit, for will be stored in first human face three-dimensional model and the comparison database the
Two human face three-dimensional models are contrasted, and judge the difference between first human face three-dimensional model and second human face three-dimensional model
Different information, and the different information is exported to the display unit shown.
Further, in face comparison system of the present invention, the comparison database may include star's face three-dimensional that is stored with
Star's database of model, accordingly, second human face three-dimensional model includes star's human face three-dimensional model, face comparison unit
First human face three-dimensional model of user and star's human face three-dimensional model are contrasted, is judged between user's face and star's face
Different information.
Further, in face comparison system of the present invention, the comparison database may also comprise and be stored with what good friend shared
Good friend's database of good friend's human face three-dimensional model, accordingly, second human face three-dimensional model includes good friend's human face three-dimensional model,
Face comparison unit is contrasted first human face three-dimensional model of user and good friend's human face three-dimensional model, judge user's face with
Different information between good friend's face.
Certainly, the comparison database can simultaneously include star's database and good friend's database.
Scheme two：Face control methods based on three-dimensional image.
For another aspect of the present invention, the present invention proposes a kind of face based on three-dimensional image to analogy
Method, the face control methods is mainly included the following steps that：
Face-scanning step：By the three-dimensional scanner on mobile terminal, the face three-dimensional information and facial image of user are gathered；
Three-dimensional reconstruction step：Three-dimensional reconstruction is carried out according to the face three-dimensional information and facial image, the first face of generation is three-dimensional
Model, and first human face three-dimensional model is shown；
Face contrasts step：First human face three-dimensional model is entered with the second human face three-dimensional model of storage in comparison database
Row contrast, judges the different information between first human face three-dimensional model and second human face three-dimensional model；
Step display：By the different information and first human face three-dimensional model fusion display.
Further, face contrast step includes：Star contrastive pattern, as the people with star for receiving user's selection
When the contrast that face model is compared is instructed, star's human face three-dimensional model is called from the comparison database as described second
Human face three-dimensional model, first human face three-dimensional model and star's human face three-dimensional model are contrasted, and are judged between the two
Different information.
Further, face contrast step includes：Good friend contrastive pattern, as the people with good friend for receiving user's selection
When the contrast that face model is compared is instructed, the good friend's human face three-dimensional model for calling good friend to share from the comparison database is made
It is second human face three-dimensional model, first human face three-dimensional model and good friend's human face three-dimensional model is contrasted, judges
Different information between the two.
Scheme three：Face contrast mobile terminal based on three-dimensional image.
For another aspect of the present invention, the present invention proposes a kind of face contrast movement based on three-dimensional image
Terminal, face contrast mobile terminal mainly includes：
Processor；
Three-dimensional scanner, it is connected to the processor, face three-dimensional information and facial image for gathering user；
Display screen, it is connected to the processor；
Memory, it is connected to the processor, for storing computer program；
The memory and computer program are configured to using the processor so that the mobile terminal performs at least scheme
The step of included in face control methods described in two any one implementation method.
In sum, by adopting the above-described technical solution, the beneficial effects of the invention are as follows：
1）Present system carries out 3-D scanning using the three-dimensional imaging scanner set on mobile terminal, the face to user,
And the human face three-dimensional model of user is contrasted with the human face three-dimensional model in database, it is determined that both different informations, and
Different information is carried out merging display with the human face three-dimensional model of user.The present invention can meet the psychological needs of user, have
Certain is recreational, and can provide technical support for simulation shaping and beauty, and mode of operation is simple and convenient, and mobility is strong, no
Limited by place, user can be controlled operation to threedimensional model, can be straight from multiple angle response difference information, display mode
See and understand, be not only suitable for computer end operation, be also applied for independently operating on mobile terminals.
2）User can install on mobile terminals face contrast APP, directly operation face contrast on mobile terminals
APP, calls the three-dimensional scanner on mobile terminal to gather face 3-D view, then carry out on mobile terminals at follow-up three-dimensional
Reason and contrast treatment, finally by face 3-D view and different information fusion display.User can also be by network access face pair
Than Platform Server, the human face three-dimensional model on server is obtained, or upload the human face three-dimensional model of oneself, can also will be right
Share to Platform Server or third-party server than result.
3）The present invention is capable of achieving to be contrasted the human face three-dimensional model of user with the human face three-dimensional model of star, judges to use
Face's difference between family and star, meets the psychological needs of user, with preferably recreational.The present invention can also be by user's
Human face three-dimensional model is contrasted with the human face three-dimensional model of good friend, judges the face's difference between user and good friend, with compared with
Good social interaction.
Brief description of the drawings
Examples of the present invention will be described by way of reference to the accompanying drawings, wherein：
Fig. 1 is the system schematic block diagram of face comparison system in the present invention.
Fig. 2 is the schematic flow sheet of face control methods in the present invention.
Fig. 3 is the schematic block circuit diagram of face contrast mobile terminal in the present invention.
Specific embodiment
All features disclosed in this specification, or disclosed all methods or during the step of, except mutually exclusive
Feature and/or step beyond, can combine by any way.
This specification（Including any accessory claim, summary）Disclosed in any feature, unless specifically stated otherwise,
Equivalent by other or with similar purpose alternative features are replaced.I.e., unless specifically stated otherwise, each feature is a series of
An example in equivalent or similar characteristics.
Scheme one：Face comparison system.
As shown in figure 1, the present invention proposes a kind of face comparison system based on three-dimensional image.
Embodiment 1.1, face comparison system of the present invention mainly includes：Three-dimensional reconstruction unit, face comparison unit, display are single
Unit, comparison database and the three-dimensional scanner being arranged on mobile terminal, the mobile terminal include mobile phone, flat board, can wear
Wear equipment etc..
The three-dimensional scanner, face three-dimensional information and facial image for gathering user.Heretofore described three
Dimension scanner is fixed image acquisition device on mobile terminals.If mobile terminal is using the 3 D stereo skill based on binocular vision
Art, then described image collector include binocular camera.If mobile terminal is using the 3 D stereo skill based on photometric stereo vision
Art, then described image collector include camera and light source, such as using visible image capturing head and visible point of light light source, or visible ray
Camera and area source（Using display screen as light source）, can also use infrared pick-up head and infrared light spot light source.If mobile whole
End includes camera and structured light projector using the 3 D stereo technology based on structure light, then described image collector.
The three-dimensional reconstruction unit, three-dimensional reconstruction, generation first are carried out according to the face three-dimensional information and facial image
Human face three-dimensional model, and first human face three-dimensional model is exported to the display unit shown.The three-dimensional reconstruction list
Unit may be additionally configured to：According to the type of three-dimensional scanner, such as class of the port according to three-dimensional scanner or face three-dimensional information
Type, judges the type of three-dimensional scanner, calls corresponding algorithm to carry out three-dimensional reconstruction.
The face comparison unit, for will be stored in first human face three-dimensional model and the comparison database the
Two human face three-dimensional models are contrasted, and judge the difference between first human face three-dimensional model and second human face three-dimensional model
Different information, and the different information is exported to the display unit shown.The different information generally comprises difference section
Domain and the variance data of the diff area, may also comprise similarity information, strengths and weaknesses information.
Embodiment 1.2, on the basis of embodiment 1.1, present system may also include characteristic area division unit, feature
The input of area division unit is connected with three-dimensional reconstruction unit, receives the first human face three-dimensional model, and according to the first face three
The characteristic point of dimension module divides characteristic area, and its output end is connected with the input of face comparison unit, is easy to face to contrast single
When the first human face three-dimensional model and the second human face three-dimensional model are contrasted, the characteristic area that there will be difference is labeled as unit
Diff area, and calculate the variance data of each diff area.
The characteristic area may include ocular, brow region, nasal region, mouth region, cheek region, chin area
Multiple combination in domain, forehead region and ear region, but determine which region, Ke Yishi be divided into according to system requirements
User specifies characteristic area to be contrasted according to the demand of oneself, and characteristic area in the present invention is three-dimensional feature area
Domain, can from multiple angle acquisition data, judge difference.
Certainly, characteristic area can be also further segmented according to the actual requirements.
1st, ocular, it may include eyelid region, canthus region, pouch region, tear ditch region, periocular area etc. are various
Combination, can be finely divided according to the actual requirements.
1. eyelid region, can be used to gather eyelid data, determine that user is single-edge eyelid or double-edged eyelid.
2. canthus region, can be used to gather inner eye corner data and external eyes angular data, determine eyes spacing and eye widths, also
Eyelid data can be gathered.
3. pouch region, can be used to gather pouch data, determine whether the size of pouch and pouch, can also be according to pouch
Whether size and position judgment are sleeping silkworm, and pouch is palpebra inferior edema, is a kind of oedema phenomenon, and sleeping silkworm is to be close to eyelid lower edge
As about four to seven millimeters of banding bulges of " silkworm ", flesh pouch is also, crouch silkworm ovalize, the mellow and full smoothness of lines, eye
The nearly triangle of bag, it is linear such as bag-shaped.
4. tear ditch region, can be used to gather tear ditch data, determine whether user has the size of tear ditch and tear ditch；Tear ditch be from
Inner eye corner starts to extend to chase of the palpebra inferior near nasal side, and tear ditch more seriously, even extends to cheek, exists on the face
After tear ditch, easily it is old for one's age, the age is bigger, and tear ditch is more obvious.
5. periocular area, can be used to gather crow's feet data, livid ring around eye data etc..
2nd, brow region, can be used to gather brow region, and the eyebrow type of identifying user, typically no necessary further subdivision is somebody's turn to do
Region.
3rd, nasal region, it may include the multiple combination such as region in nose region, nasal bridge region, people, can be used to judge nose type,
Such as recognize hump nose, aquiline nose, wry nose, upturned nose, low nose, nose wide.
1. nose region, can be used to gather nose base data and such as nose height, shape, blackhead nose data, wherein
Nose substrate, i.e., the base part that nose lower end is connected with upper lip can be divided into nose pillar substrate, wing of nose substrate and nostril base.
2. nasal bridge region, can be used to gather nose bridge widths and length.
3. region in people, can be used to gather sized data in people, in people, between nose pillar substrate and lip paddy, in people
It is long to be old for one's age.
4th, mouth region, can be used to gather lip data, corners of the mouth data, upper lower lip thickness data etc..
5th, cheek region, can be used to gather shape of face data, dimple data, cheek plumpness, skin data etc., skin number
According to can such as wrinkle, the colour of skin, color spot, acne data.
6th, chin area, can be used to gather the data such as chin shape, size.
7th, forehead region, can be used to gather the data such as forehead width, forehead plumpness, wrinkle, hair line.
8th, ear region, can be used to gather the data such as ear type, ear-lobe, ear location, size.
Embodiment 1.3, on the basis of embodiment 1.1 or embodiment 1.2, present system also includes difference situation judging
Unit, is processed by contrast, after determining diff area, can also be graded and/or be scored by difference situation judging unit
Treatment.General, difference situation judging unit determines first human face three-dimensional model and the second face three according to different information
The corresponding variance data in diff area and the diff area between dimension module, judges the difference grade/scoring of the diff area.
Its grading code of points can be according to the difference between the first human face three-dimensional model and the second human face three-dimensional model
Degree is evaluated, and the difference value can be the maximum different value in diff area, or the average difference values in diff area,
Certainly can also be the difference value that other modes are tried to achieve.Difference situation judging unit by the diversity factor of each diff area with it is default
Discrepancy threshold be compared, if diversity factor to fall into certain discrepancy threshold interval, for the diff area assigns the discrepancy threshold area
Between corresponding grade or score value.
Grading code of points can also be according to judging whether to be adapted to lift face to carry out grading scoring, according to diff area
Diversity factor, associating between diff area and adjacent feature region, such as profile, shape, size factor judge that diff area is
No suitable lift face, and the suitable threshold value of lift face grade of fit and lift face is compared, grading scoring is carried out to diff area, it is more suitable
The region of lift face, its grade higher, scores higher.
Further, can also be according to the difference of each diff area grade/human face three-dimensional model of score calculation first and
The similarity of two human face three-dimensional models, difference grade higher, difference scoring is higher, and similarity is higher.
The data of the first human face three-dimensional model and the second human face three-dimensional model and normal data can be also compared, judged
Relative to the strengths and weaknesses information of the second human face three-dimensional model at the diff area of the first human face three-dimensional model, user's face is such as detected
During the ocular of threedimensional model, judge that the eye of user includes double-edged eyelid, and the second selected human face three-dimensional model is simple eye
Skin, according to the eyelid strengths and weaknesses data recorded in normal data, indicates the strengths and weaknesses information of diff area, and normal data can be by
Service provider pre-sets, and the hobby that can also gather user carrys out dynamic renewal.Such as because current double-edged eyelid are more liked by masses, clothes
Business business presets double-edged eyelid better than single-edge eyelid；Can also be according to user to single-edge eyelid and the favorable rating of double-edged eyelid, it is described
Favorable rating can be extracted according to the thumb up data of user, marking data etc..
Further, diff area is differently shown always according to difference grade/scoring, display mode includes word mark
Note display, colouring discrimination show, actual situation line shows etc..
Label character shown, word index is such as done on the diff area of first human face three-dimensional model of user, marks difference
The different informations such as different grade, variance data, can also list the other informations such as suggestion, prompting, similarity.
Colouring discrimination shows, such as fills different colors, root on the diff area of first human face three-dimensional model of user
According to the effect of cold-warm color gradual change, the diff area to different diversity factoies/lift face grade of fit is distinguished by display.
Actual situation line is shown, such as first human face three-dimensional model of user is shown with solid line, by second in comparison database
Human face three-dimensional model is shown in phantom, and is shown by the overlap of solid line and dotted line, can intuitively represent two profiles of model
Difference.
Certainly, display when can also merge multiple display modes, with provide the user more rich information and more intuitively
Effect, further, can also set up display control switch, and user can select to open and close difference letter according to the demand of oneself
Breath display function.
Embodiment 1.4, on the basis of any one of embodiment 1.1 ~ 1.3, the comparison database includes the star that is stored with
Star's database of human face three-dimensional model, accordingly, second human face three-dimensional model may include star's human face three-dimensional model.
User can browse the people of the star for having uploaded after the human face three-dimensional model of oneself is gathered in comparison database
Face three-dimensional model, after user selects certain human face three-dimensional model of star, system automatically by the human face three-dimensional model of user with it is bright
The human face three-dimensional model of star is analyzed, and different information is shown on display interface, and user can be directly perceived by the system
Ground understands difference between oneself face and star face in detail, understand oneself specific different information and between star face,
Similarity or strengths and weaknesses information etc., can also be operated to human face three-dimensional model, and difference situation is checked from multiple angles.
Embodiment 1.5, on the basis of any one of embodiment 1.1 ~ 1.4, the comparison database may also comprise and be stored with
Good friend's database of good friend's human face three-dimensional model, accordingly, second human face three-dimensional model may include good friend's face three-dimensional mould
Type.
User can browse that good friend has uploaded and public after the human face three-dimensional model of oneself is gathered in comparison database
The human face three-dimensional model opened, after user selects certain human face three-dimensional model of good friend, system is automatically by the face three-dimensional mould of user
Type is analyzed with the human face three-dimensional model of good friend, and different information is shown on display interface, and user can be by this
System intuitively understands the difference between oneself face and good friend face in detail, understands oneself the specific difference and between star face
Information, similarity or strengths and weaknesses information etc., can also be operated to human face three-dimensional model, and difference shape is checked from multiple angles
Condition.
Embodiment 1.6, on the basis of any one of embodiment 1.1 ~ 1.5, present system also includes shared cell, is used for
After to the first human face three-dimensional model setting authority of user, share to network data base, so that the good friend of user calls, also can use
Share to Platform Server or third-party server in by face comparing result.
It should be noted that, the present invention proposes a kind of face comparison system based on three-dimensional image, in the system
Unit, device can be integrated in same device, form the mobile terminal proposed such as scheme three, wherein, display is single
Unit can be the touch display screen of mobile terminal；Comparison database can utilize the memory of mobile terminal；Three-dimensional scanner is fixed
In the image acquisition device of mobile terminal, if carrying out three-dimensional reconstruction, including binocular camera based on binocular vision, if being based on luminosity
Stereo matching carries out three-dimensional reconstruction, then the spot light for coordinating including camera and with camera, if carrying out three-dimensional based on structure light
Rebuild, then structured light projection device for coordinating including camera and camera, etc.；In addition, three-dimensional reconstruction unit and face contrast
Unit can be the program module in mobile terminal, and its function is called the computer program in memory by the processor of mobile terminal
With the hardware module in realization, or mobile terminal, the microprocessor for such as being cooperated with the core processor of mobile terminal
Device.
Unit, device in system of the present invention can also be separately positioned in different devices, by multiple
Device is constituted, such as by headend equipment mobile terminal and rear end equipment server group into the mobile terminal with 3-D scanning function
It is connected with back-end server by communication mode wirelessly or non-wirelessly, wherein, three-dimensional reconstruction unit, face comparison unit, display
Unit and comparison database can concentrated setting on one server, it is also possible to distribution is arranged on multiple servers, it is also possible to
Unit module is configured in the terminal according to actual conditions, another part unit module is configured on the server, its
Specific embodiment is versatile and flexible, can be according to actual conditions depending on.
Scheme two：Face control methods based on three-dimensional image.
As shown in Fig. 2 being directed to another aspect of the present invention, the present invention proposes a kind of people based on three-dimensional image
Face control methods, the inventive method can be realized based on each unit, device in scheme one or scheme three.
Embodiment 2.1, the face control methods is mainly included the following steps that：
Face-scanning step：By the three-dimensional scanner on mobile terminal, the face three-dimensional information and facial image of user are gathered；
Three-dimensional reconstruction step：Three-dimensional reconstruction is carried out according to the face three-dimensional information and facial image, the first face of generation is three-dimensional
Model, and first human face three-dimensional model is shown；
Face contrasts step：First human face three-dimensional model is entered with the second human face three-dimensional model of storage in comparison database
Row contrast, judges the different information between first human face three-dimensional model and second human face three-dimensional model；
Step display：By the different information and first human face three-dimensional model fusion display.
The different information generally comprises the variance data of diff area and the diff area, may also comprise similarity letter
Breath, strengths and weaknesses information etc..Display mode mainly shows including label character, colouring discrimination shows, actual situation line shows etc..
Embodiment 2.2, on the basis of embodiment 2.1, further, the three-dimensional reconstruction step and face contrast step
Between also include：Characteristic area partiting step, the characteristic point according to the first human face three-dimensional model divides characteristic area；Afterwards, exist
In face contrast step, the first human face three-dimensional model is contrasted with the second human face three-dimensional model, the feature having differences
Zone marker is diff area, and determines the variance data of each diff area.
The characteristic area may include ocular, brow region, nasal region, mouth region, cheek region, chin area
Multiple combination in domain, forehead region and ear region, but determine which region, Ke Yishi be divided into according to system requirements
User specifies characteristic area to be contrasted according to the demand of oneself.
Embodiment 2.3, on the basis of embodiment 2.1 or embodiment 2.2, further, after face contrast step also
Including：Difference situation judging step, the variance data of each diff area is compared with default difference reference data, really
The difference grade of fixed each diff area and/or difference scoring.Its grading code of points refers to the content described in scheme one.
Embodiment 2.4, on the basis of any one of embodiment 2.1 ~ 2.3, further, comments according to difference grade or difference
Divide and label and/or color lump are set to each diff area, and label and/or color lump are included the phase in the first human face three-dimensional model
Answer on characteristic area.
Embodiment 2.5, on the basis of any one of embodiment 2.1 ~ 2.4, further, the face control methods is also wrapped
Include shared step：Authority is set to first human face three-dimensional model of user first, then by the first human face three-dimensional model share to
Network data base, the good friend in order to user calls.The shared step can also by the face comparing result of user share to
Shared platform, there is provided the social interaction server based on images share.
Embodiment 2.6, on the basis of any one of embodiment 2.1 ~ 2.5, further, face contrast step includes bright
Star contrastive pattern：When the contrast being compared with the faceform of star for receiving user's selection is instructed, from the contrast
Star's human face three-dimensional model is called in database as second human face three-dimensional model, by first human face three-dimensional model with
Star's human face three-dimensional model is contrasted, and judges different information between the two.
Embodiment 2.7, on the basis of any one of embodiment 2.1 ~ 2.6, further, face contrast step includes
Friendly contrastive pattern：When the contrast being compared with the faceform of good friend for receiving user's selection is instructed, from the contrast
Good friend's human face three-dimensional model that good friend shares is called in database as second human face three-dimensional model, by first face
Threedimensional model is contrasted with good friend's human face three-dimensional model, judges different information between the two.
Scheme three：Face contrast mobile terminal based on three-dimensional image.
For another aspect of the present invention, the present invention proposes a kind of face contrast movement based on three-dimensional image
Terminal, mobile terminal proposed by the invention can be mobile phone, flat board, wearable device etc., can be used to carry into execution a plan described in two
Face control methods.
As shown in figure 3, mobile terminal proposed by the invention mainly includes：Processor, display screen, memory and it is arranged on
Three-dimensional scanner on terminal body.
Wherein, the processor is connected with display screen, memory and three-dimensional scanner signal respectively；The three-dimensional scanner
Face three-dimensional information and facial image for gathering user；The memory is used to store computer program；The memory
It is configured to using the processor with computer program so that any one that the mobile terminal performs at least scheme two is implemented
The step of included in face control methods described in mode.
The three-dimensional scanner can be binocular solid collector, photometric stereo collector, structure light solid collector and TOF
Any one in three-dimensional collector.
The computer program can be packaged into face contrast APP, and be arranged on for face contrast APP and swept with three-dimensional by user
After retouching the mobile terminal of device, processor runs the APP, and the people of user can be gathered by three-dimensional data port controlling three-dimensional scanner
Face 3-D view, then performs corresponding three-dimensional process and contrast treatment, then by display port, by face 3-D view again
Merged with different information and shown.
Further, the mobile terminal also includes communication module, and one end and the processor of the communication module electrically connect
Connect, its other end, for carrying out data interaction with Platform Server, accesses storage by network and Platform Server data cube computation
The data such as the second human face three-dimensional model in Platform Server, it may also be used on shared user data to Platform Server or other
Third-party platform server.
Further, the memory can also include customer data base, for storing the first human face three-dimensional model, be easy to
User checks and operates the faceform for having stored.
Further, the memory can be also used for store the second human face three-dimensional model, such as include star's database and
Good friend's database, is easy to user to complete face contrast operation off-line manner using mobile terminal, saves user's networking processing
Flow.
The invention is not limited in foregoing specific embodiment.The present invention is expanded to and any in this manual disclosed
New feature or any new combination, and disclose any new method or process the step of or any new combination.
Claims (10)
1. a kind of face comparison system based on three-dimensional image, it is characterised in that：Contrasted including three-dimensional reconstruction unit, face
Unit, display unit, comparison database and the three-dimensional scanner being arranged on mobile terminal；
The three-dimensional scanner, face three-dimensional information and facial image for gathering user；
The three-dimensional reconstruction unit, three-dimensional reconstruction is carried out according to the face three-dimensional information and facial image, generates the first face
Threedimensional model, and first human face three-dimensional model is exported to the display unit shown；
The face comparison unit, for the second people that will be stored in first human face three-dimensional model and the comparison database
Face three-dimensional model is contrasted, and judges the difference letter between first human face three-dimensional model and second human face three-dimensional model
Breath, and the different information is exported to the display unit shown.
2. a kind of face comparison system based on three-dimensional image according to claim 1, it is characterised in that also include：
Characteristic area division unit, for dividing characteristic area according to the characteristic point of the first human face three-dimensional model；
The face comparison unit is contrasted the first human face three-dimensional model with the second human face three-dimensional model, there will be difference
Characteristic area is labeled as diff area, and determines the variance data of each diff area.
3. a kind of face comparison system based on three-dimensional image according to any one of claim 1 ~ 2, its feature exists
In：The comparison database include be stored with star's human face three-dimensional model star's database and/or be stored with what good friend shared
Good friend's database of good friend's human face three-dimensional model；
When the comparison database includes star's database, accordingly, second human face three-dimensional model includes star's face
Threedimensional model, face comparison unit is contrasted first human face three-dimensional model of user and star's human face three-dimensional model, is judged
Different information between user's face and star's face；
When the comparison database includes good friend's database, accordingly, second human face three-dimensional model includes good friend's face
Threedimensional model, face comparison unit is contrasted first human face three-dimensional model of user and good friend's human face three-dimensional model, is judged
Different information between user's face and good friend's face.
4. a kind of face control methods based on three-dimensional image, it is characterised in that comprise the following steps：
Face-scanning step：By the three-dimensional scanner on mobile terminal, the face three-dimensional information and facial image of user are gathered；
Three-dimensional reconstruction step：Three-dimensional reconstruction is carried out according to the face three-dimensional information and facial image, the first face of generation is three-dimensional
Model, and first human face three-dimensional model is shown；
Face contrasts step：First human face three-dimensional model is entered with the second human face three-dimensional model of storage in comparison database
Row contrast, judges the different information between first human face three-dimensional model and second human face three-dimensional model；
Step display：By the different information and first human face three-dimensional model fusion display.
5. a kind of face control methods based on three-dimensional image according to claim 4, it is characterised in that described three
Also include between dimension reconstruction procedures and face contrast step：Characteristic area partiting step, according to the spy of the first human face three-dimensional model
Levy dot-dash point characteristic area；Afterwards, in face contrast step, the first human face three-dimensional model is entered with the second human face three-dimensional model
The characteristic area having differences, is labeled as diff area, and determine the variance data of each diff area by row contrast.
6. a kind of face control methods based on three-dimensional image according to claim 5, it is characterised in that face pair
Than also including after step：Difference situation judging step, by the variance data of each diff area and default difference reference number
According to being compared, difference grade and/or the difference scoring of each diff area are determined.
7. a kind of face control methods based on three-dimensional image according to claim 6, it is characterised in that：According to difference
Different grade or difference scoring set label and/or color lump to each diff area, and label and/or color lump are included the first
On the individual features region of face three-dimensional model.
8. a kind of face control methods based on three-dimensional image according to claim 4, it is characterised in that also include：
Shared step, to the first human face three-dimensional model setting authority of user after, share to network data base, so that the good friend of user adjusts
With.
9. a kind of face control methods based on three-dimensional image according to any one of claim 4 ~ 8, its feature exists
In face contrast step includes star contrastive pattern and/or good friend contrastive pattern；
In star contrastive pattern, when the contrast being compared with the faceform of star for receiving user's selection is instructed,
Star's human face three-dimensional model is called from the comparison database as second human face three-dimensional model, by first face
Threedimensional model is contrasted with star's human face three-dimensional model, judges different information between the two；
In good friend contrastive pattern, when the contrast being compared with the faceform of good friend for receiving user's selection is instructed,
Good friend's human face three-dimensional model that good friend shares is called from the comparison database as second human face three-dimensional model, by institute
State the first human face three-dimensional model to be contrasted with good friend's human face three-dimensional model, judge different information between the two.
10. a kind of face based on three-dimensional image contrasts mobile terminal, it is characterised in that including：
Processor；
Three-dimensional scanner, it is connected to the processor, face three-dimensional information and facial image for gathering user；
Display screen, it is connected to the processor；
Memory, it is connected to the processor, for storing computer program；
The memory and computer program are configured to using the processor so that mobile terminal execution is at least performed
The step of face control methods is included as any one of claim 4 ~ 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710299508.XA CN106934073A (en) | 2017-05-02 | 2017-05-02 | Face comparison system, method and mobile terminal based on three-dimensional image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710299508.XA CN106934073A (en) | 2017-05-02 | 2017-05-02 | Face comparison system, method and mobile terminal based on three-dimensional image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106934073A true CN106934073A (en) | 2017-07-07 |
Family
ID=59429363
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710299508.XA Pending CN106934073A (en) | 2017-05-02 | 2017-05-02 | Face comparison system, method and mobile terminal based on three-dimensional image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106934073A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106618734A (en) * | 2016-11-04 | 2017-05-10 | 王敏 | Face-lifting-model-comparison imprinting device |
| CN107481317A (en) * | 2017-07-31 | 2017-12-15 | 广东欧珀移动通信有限公司 | The facial method of adjustment and its device of face 3D models |
| CN108090450A (en) * | 2017-12-20 | 2018-05-29 | 深圳和而泰数据资源与云技术有限公司 | Face identification method and device |
| CN108366246A (en) * | 2018-04-20 | 2018-08-03 | 盎锐（上海）信息科技有限公司 | Filming apparatus and information output method for shooting 3D images |
| CN108769647A (en) * | 2018-04-20 | 2018-11-06 | 盎锐（上海）信息科技有限公司 | Video generation device and image generating method based on 3D video cameras |
| CN108898546A (en) * | 2018-06-15 | 2018-11-27 | 北京小米移动软件有限公司 | Face image processing process, device and equipment, readable storage medium storing program for executing |
| CN109521936A (en) * | 2018-11-13 | 2019-03-26 | 盎锐（上海）信息科技有限公司 | Image checking device and method with comparing function |
| CN110309074A (en) * | 2019-07-03 | 2019-10-08 | 腾讯科技（深圳）有限公司 | A kind of test method and device |
| CN110826517A (en) * | 2019-11-12 | 2020-02-21 | 北京云迹科技有限公司 | Authentication method and device and cloud information processing method |
| CN111354478A (en) * | 2018-12-24 | 2020-06-30 | 黄庆武整形医生集团(深圳)有限公司 | Shaping simulation information processing method, shaping simulation terminal and shaping service terminal |
| CN111538970A (en) * | 2020-07-08 | 2020-08-14 | 德能森智能科技（成都）有限公司 | Cloud platform system based on intelligent Internet of things |
| CN114944030A (en) * | 2022-05-19 | 2022-08-26 | 杭州海康威视数字技术股份有限公司 | Access control method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050057569A1 (en) * | 2003-08-26 | 2005-03-17 | Berger Michael A. | Static and dynamic 3-D human face reconstruction |
| CN103745208A (en) * | 2014-01-27 | 2014-04-23 | 中国科学院深圳先进技术研究院 | Face recognition method and device |
| CN104376594A (en) * | 2014-11-25 | 2015-02-25 | 福建天晴数码有限公司 | Three-dimensional face modeling method and device |
| CN105427385A (en) * | 2015-12-07 | 2016-03-23 | 华中科技大学 | High-fidelity face three-dimensional reconstruction method based on multilevel deformation model |
| CN106384106A (en) * | 2016-10-24 | 2017-02-08 | 杭州非白三维科技有限公司 | Anti-fraud face recognition system based on 3D scanning |
-
2017
- 2017-05-02 CN CN201710299508.XA patent/CN106934073A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050057569A1 (en) * | 2003-08-26 | 2005-03-17 | Berger Michael A. | Static and dynamic 3-D human face reconstruction |
| CN103745208A (en) * | 2014-01-27 | 2014-04-23 | 中国科学院深圳先进技术研究院 | Face recognition method and device |
| CN104376594A (en) * | 2014-11-25 | 2015-02-25 | 福建天晴数码有限公司 | Three-dimensional face modeling method and device |
| CN105427385A (en) * | 2015-12-07 | 2016-03-23 | 华中科技大学 | High-fidelity face three-dimensional reconstruction method based on multilevel deformation model |
| CN106384106A (en) * | 2016-10-24 | 2017-02-08 | 杭州非白三维科技有限公司 | Anti-fraud face recognition system based on 3D scanning |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106618734A (en) * | 2016-11-04 | 2017-05-10 | 王敏 | Face-lifting-model-comparison imprinting device |
| CN107481317A (en) * | 2017-07-31 | 2017-12-15 | 广东欧珀移动通信有限公司 | The facial method of adjustment and its device of face 3D models |
| CN108090450A (en) * | 2017-12-20 | 2018-05-29 | 深圳和而泰数据资源与云技术有限公司 | Face identification method and device |
| CN108090450B (en) * | 2017-12-20 | 2020-11-13 | 深圳和而泰数据资源与云技术有限公司 | Face recognition method and device |
| CN108366246A (en) * | 2018-04-20 | 2018-08-03 | 盎锐（上海）信息科技有限公司 | Filming apparatus and information output method for shooting 3D images |
| CN108769647A (en) * | 2018-04-20 | 2018-11-06 | 盎锐（上海）信息科技有限公司 | Video generation device and image generating method based on 3D video cameras |
| CN108898546B (en) * | 2018-06-15 | 2022-08-16 | 北京小米移动软件有限公司 | Face image processing method, device and equipment and readable storage medium |
| CN108898546A (en) * | 2018-06-15 | 2018-11-27 | 北京小米移动软件有限公司 | Face image processing process, device and equipment, readable storage medium storing program for executing |
| CN109521936A (en) * | 2018-11-13 | 2019-03-26 | 盎锐（上海）信息科技有限公司 | Image checking device and method with comparing function |
| CN111354478A (en) * | 2018-12-24 | 2020-06-30 | 黄庆武整形医生集团(深圳)有限公司 | Shaping simulation information processing method, shaping simulation terminal and shaping service terminal |
| CN110309074A (en) * | 2019-07-03 | 2019-10-08 | 腾讯科技（深圳）有限公司 | A kind of test method and device |
| CN110309074B (en) * | 2019-07-03 | 2024-03-29 | 腾讯科技（深圳）有限公司 | Test method and device |
| CN110826517A (en) * | 2019-11-12 | 2020-02-21 | 北京云迹科技有限公司 | Authentication method and device and cloud information processing method |
| CN111538970B (en) * | 2020-07-08 | 2020-12-22 | 德能森智能科技（成都）有限公司 | Cloud platform system based on intelligent Internet of things |
| CN111538970A (en) * | 2020-07-08 | 2020-08-14 | 德能森智能科技（成都）有限公司 | Cloud platform system based on intelligent Internet of things |
| CN114944030A (en) * | 2022-05-19 | 2022-08-26 | 杭州海康威视数字技术股份有限公司 | Access control method and device |
| CN114944030B (en) * | 2022-05-19 | 2024-02-09 | 杭州海康威视数字技术股份有限公司 | Access control method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106934073A (en) | Face comparison system, method and mobile terminal based on three-dimensional image | |
| CN107123160A (en) | Simulation lift face system, method and mobile terminal based on three-dimensional image | |
| CN101779218B (en) | Makeup simulation system, makeup simulation apparatus, makeup simulation method, and makeup simulation program | |
| EP3479351B1 (en) | System and method for digital makeup mirror | |
| JP3639476B2 (en) | Image processing apparatus, image processing method, and recording medium recording image processing program | |
| CN108171789B (en) | Virtual image generation method and system | |
| US10789748B2 (en) | Image processing device, image processing method, and non-transitory computer-readable recording medium storing image processing program | |
| CN108229278A (en) | Face image processing process, device and electronic equipment | |
| US20060188144A1 (en) | Method, apparatus, and computer program for processing image | |
| CN105139438A (en) | Video face cartoon animation generation method | |
| CN109147024A (en) | Expression replacing options and device based on threedimensional model | |
| CN103945104B (en) | Information processing method and electronic equipment | |
| EP3579176A1 (en) | Makeup evaluation system and operation method thereof | |
| US11069089B2 (en) | Information processing apparatus, information processing method, and computer program product | |
| KR20090098798A (en) | Method and device for the virtual simulation of a sequence of video images | |
| CN108513089A (en) | The method and device of group's video session | |
| JP2010211308A (en) | Makeup advice device, the makeup advice method and program | |
| JP2020113061A (en) | Information processing device, information processing method, and program | |
| KR101516465B1 (en) | Method and apparatus for making avatar | |
| US9330300B1 (en) | Systems and methods of analyzing images | |
| US7916902B2 (en) | Album creating apparatus, album creating method, and album creating program | |
| CN105975920A (en) | Method and system for trying glasses | |
| CN109255328A (en) | User's makings determines method and device | |
| CN109255327A (en) | Acquisition methods, face's plastic operation evaluation method and the device of face characteristic information | |
| CN109145865A (en) | Face standard level calculating method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170707 |