CN109003298A - virtual glasses matching method and system - Google Patents
virtual glasses matching method and system Download PDFInfo
- Publication number
- CN109003298A CN109003298A CN201710406144.0A CN201710406144A CN109003298A CN 109003298 A CN109003298 A CN 109003298A CN 201710406144 A CN201710406144 A CN 201710406144A CN 109003298 A CN109003298 A CN 109003298A
- Authority
- CN
- China
- Prior art keywords
- frame
- user
- nose
- indicates
- face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Geometry (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Analysis (AREA)
Abstract
The present invention relates to a kind of virtual glasses matching method and systems, user is provided and uses computer apparatus or hand-held device, utilize the image for the user oneself that shooting or scanning obtain, after filtering out a plurality of alternative frames with mirror application program, the alternative frame is successively virtually tried on and selects suitable frame.Virtual glasses matching method includes: the digital image of shooting or the face for obtaining user；Parse or measure the digital image and obtain wide interpupillary distance, face, bridge of the nose height, nose bridge widths and eye-ear distance from face feature in it is any；A plurality of alternative frames are filtered out from frame data bank based on the face feature numerical data；And user is allowed successively virtually to try a plurality of alternative frames on, it uses and selects suitable frame.
Description
Technical field
It is especially a kind of to be penetrated at image in software method the present invention relates to the technology that a kind of offer user selects glasses
The mode of reason provides user's method and system that virtual glasses are matched in flat image or stereopsis.
Background technique
Generally glasses company is the first choice of consumer that selection is worn glasses on the market, consumer can in glasses company or
After hospital obtains the information of optometry, frame and eyeglass can be matched to the hotel owner to get the right lensses for one's eyeglasses that glasses company or hospital cooperate, often
See and various frame is introduced by company personnel, consumer is allowed to try on before mirror, later eyeglass pattern needed for reselection, then industry
Person according to some wearing data creating glasses of consumer, will wear data such as eyeglass lens power and interpupillary distance, two positions,
Wearing height, mirror surface camber and mirror holder tilt angle on the bridge of the nose etc..Most of data be allow consumer when getting glasses by
It self wears and feels to inform that server just adjusts immediately.
Summary of the invention
In order to overcome the above-mentioned deficiency of the prior art, the invention discloses a kind of virtual glasses matching methods, provide user
Using computer apparatus or hand-held device shooting or the image for scanning oneself, meet according to the face of oneself or head feature apolegamy
Glasses, and the image for wearing virtual glasses can be shown on the display screens of computer apparatus immediately, be reached as looked in the mirror one
As instant preview effect, and allow user's elasticity selection glasses type virtual experience purpose.
Virtual glasses matching method of the invention includes image obtaining step: shooting or the numerical digit for obtaining user face
Image；Face feature numerical value measurement step: parsing or measure the digital image and obtains that the interpupillary distance of user, face are wide, the bridge of the nose is high
Degree, nose bridge widths and eye-ear distance from face feature in it is any；Frame screening step: it is provided based on the face feature numerical value
Expect and use equation 1:P=-1.036X2(wherein, P is frame width (mm) for+23.365X-2.089Y+Z ± 5；X is to use
The bridge of the nose height (mm) of person；Y is the nose bridge widths (mm) of user；Z is the eye-ear distance of user from (mm)) from frame data bank
In filter out a plurality of alternative frames；And frame deciding step: by with mirror application user for described a plurality of standby
It selects frame successively virtually to be tried on and selects suitable frame；Wherein the mirror application program of matching is including at least image transmission
Interface, frame screening interface and frame virtually try interface on；Wherein the image transmission interface is to receive and transmit user
Image of face；The frame screening interface is the frame screening conditions to receive user and is based on the frame screening conditions
A plurality of alternative frames are selected from frame data bank；It is to allow user for described a plurality of standby that the frame, which virtually tries interface on,
Frame is selected successively virtually to be tried on.
The present invention more proposes a kind of virtual glasses matching method, further comprises that will identify that object is worn in user
In face, and user is shot to establish digital image；According to two of user in the position identification stereopsis of identification object
The position of eyeball, nose and two ears is to obtain face feature information step；Numerical data is sieved based on the face feature and is used
Equation 1:P=-1.036X2(wherein, P is frame width (mm) for+23.365X-2.089Y+Z ± 5；X is the bridge of the nose of user
Highly (mm)；Y is the nose bridge widths (mm) of user；Z is the eye-ear distance of user from (mm))；Or use equation 3:R=
(wherein, R indicates mirror pin length (mm) to Z+13+F；Z indicates eye-ear distance from (mm)；F indicates upper lower limit value (mm), it is typically in the range of 0~
The range of 40mm) a plurality of alternative frames are selected from frame data bank；By above-mentioned mirror application user of matching for described
A plurality of alternative frames are successively virtually tried on and select suitable frame.
According to a certain specific embodiment, the present invention can also provide a kind of virtual glasses matching method, wherein the number
Position image can be bidimensional image, 3-dimensional image or augmented reality image.
According to a certain specific embodiment, the present invention can also provide a kind of virtual glasses matching method, wherein described
It is further included among frame screening step and a plurality of alternative frames is filtered out based at least two face feature；
For example, using equation 2:M=180-Q=180-Tan-1(X/ (Y/2)) (wherein, M is nose support angle；Y indicates nose bridge widths；X
Indicate bridge of the nose height: Q indicates bridge of the nose gradient.)；Such as (wherein, R indicates that mirror pin is long using equation 3:R=Z+13+F
It spends (mm)；Z indicates eye-ear distance from (mm)；F indicates upper lower limit value (mm), is typically in the range of the range of 0~40mm).
According to a certain specific embodiment, the present invention can also provide a kind of virtual glasses matching method, and the present invention may be used also
To provide a kind of virtual glasses matching method, wherein the frame deciding step further comprises will be described in a display screens
Digital image in conjunction with the alternative frame, for user determine frame if appropriate for.
According to a certain specific embodiment, the present invention can also provide a kind of virtual glasses matching method, wherein the mirror
Further comprise frame concentration step after frame screening step: screening conditions being manually entered by user, and are based on the sieve
Conditional filtering is selected to go out a plurality of alternative frames.
According to a certain specific embodiment, the present invention can also provide a kind of virtual glasses matching method, wherein the sieve
Condition is selected to can be the width of frame, bridge of the nose gradient, nose support away from width, nose support distance degree, mirror pin length, shape and color
Any one of or more than one.
According to a certain specific embodiment, the present invention can also provide a kind of virtual glasses matching method, wherein the face
It is formula that portion's width, which meets following close:
The wide T=-1.036X of face2+23.365X-2.089Y+Z
(wherein, T be user face is wide, bridge of the nose height that X is user, Y are the nose bridge widths of user, Z be using
The eye-ear distance of person).
Also, because the screening range P of frame width is about to be roughly equal to face's width to add and subtract a bound threshold value.Above and below described
Threshold value is limited, for example, it may be 5mm or other numerical value.Therefore, when the bound threshold value is set as 5mm, the frame is wide
The screening range P of degree just meets following equation 1:
P=-1.036X2+ 23.365X-2.089Y+Z ± 5------- (equation 1)
According to a certain specific embodiment, the present invention can also provide a kind of virtual glasses matching method, wherein the mirror
Frame further includes entity wearing step after determining step: the selected frame entity of user is taken out from warehouse for using
Person wears and is confirmed whether to meet demand.
According to a certain specific embodiment, the present invention can also provide a kind of virtual glasses matching method, wherein the mirror
Frame screening step, the frame concentration step and the frame deciding step can repeat to implement.
In addition to aforementioned state sample implementation, the present invention separately proposes a kind of virtual glasses apolegamy system, and being includes frame data bank
With computer apparatus.Cloud server is for storing complex eye glass frame model；Computer apparatus has processing unit, camera shooting single
Member, display unit, communication unit and storage element, processing unit be electrically connected at camera unit, display unit, communication unit with
Storage element, communication unit network are connected to cloud server, and mirror application program is matched in storage element storage.Camera unit for pair
User shoots digital image, and processing unit matches mirror application program to execute, and obtains the first face feature and second of user
Face feature,；It is virtually to try interface on including at least image transmission interface, frame screening interface and frame with mirror application program；
Wherein the image transmission interface is the image of face to receive and transmit user；The frame screening interface is to receive
The frame screening conditions of user simultaneously select a plurality of alternative frames based on the frame screening conditions from frame data bank；It is described
It is that user is allowed successively virtually to try a plurality of alternative frames on that frame, which virtually tries interface on,；.
According to a certain specific embodiment, the present invention can also provide a kind of virtual glasses apolegamy system comprising: a mirror
Frame data bank, for storing plural auxiliary spectacles frame；And a computer apparatus, the computer apparatus have a processing unit, a camera shooting
Unit, a display unit, a communication unit and a storage element, the processing unit are electrically connected at the camera unit, one
Display unit, the communication unit and the storage element, the communication unit network is connected to the frame data bank, described
Mirror application program is matched in storage element storage one, and the processing unit executes described with mirror application program；It is wherein described to match mirror application
Program may include: the image transmission interface to receive and transmit the image of face of user, the frame sieve to receive user
Select condition and based on the frame screening conditions filtered out from frame data bank a plurality of alternative frames frame screening interface,
And the frame successively virtually tried on for a plurality of alternative frames virtually tries interface on；Wherein the frame, which screens, is
Based on the face feature numerical data and use equation 1:P=-1.036X2+ 23.365X-2.089Y+Z ± 5 (wherein, P
For frame width (mm)；X is the bridge of the nose height (mm) of user；Y is the nose bridge widths (mm) of user；Z is the eye of user
Ear distance (mm)) a plurality of alternative frames are filtered out from frame data bank.
According to a certain specific embodiment, the present invention can also provide a kind of virtual glasses apolegamy system, wherein the number
Position image can shoot via camera unit or be sent to the processing unit via the communication unit and obtain.
Virtual glasses matching method provided by the present invention and system provide user and can select through graphical user interface
Frame type and frame relevant parameter are selected, glasses apolegamy system of the invention can provide eye glass frame mould according to the condition of interpupillary distance
Type.Apolegamy system can be by the instant digital image for being plotted in user of selected eye glass frame model, and according to making
Shape of face adjust automatically frame size, nose support position or mirror pin length of user etc..
Characteristics and implementation for the present invention, hereby schema being cooperated to make most preferred embodiment, detailed description are as follows.
Detailed description of the invention
The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.
Fig. 1 is hardware configuration diagram of the invention.
Fig. 2 is the flow diagram of state sample implementation of the invention.
Fig. 3 is eye-level schematic lines schematic diagram of the invention.
Fig. 4 is the three-dimensional digital image schematic diagram on user head of the invention.
Fig. 5 is the schematic diagram of the digital image of present invention shooting user's side face.
Fig. 6 is that the image in one embodiment of the invention uploads schematic diagram.
Fig. 7 is the frame screening schematic diagram in one embodiment of the invention.
Fig. 8 is virtually to try schematic diagram in one embodiment of the invention.
Fig. 9 is the three-dimensional head phantom shooting schematic diagram in another embodiment of the present invention.
Primary clustering symbol description: 110: frame data bank；111: eye glass frame model；112: frame basic data；
120: computer apparatus；121: processing unit；122: camera unit；123: display unit；124: communication unit；125: storage is single
Member；131: digital image；132: matching mirror application program；30: face image；301: eye-level schematic lines；510: identification object；
520: user；601,602: ear；611,612: ear feature describes a little；603: nose；631,632,633: nose feature
Description point；613: brow ridge camber schematic lines；D: distance；701: ear head connection signal line；702: eyeball surface schematic lines.
Specific embodiment
It please refers to shown in Fig. 1, is virtual glasses apolegamy system architecture schematic diagram of the invention.Virtual glasses of the invention
Apolegamy system includes frame data bank 110 and computer apparatus 120.110 network of frame data bank is linked to computer apparatus 120.Mirror
More eye glass frame models 111 and frame basic data 112 are stored in frame data bank 110.Eye glass frame model 111 of the invention
Other than plane eye glass frame figure, it is also possible to three-dimensional eye glass frame image.Each group of eye glass frame model 111 has each
From preset frame basic data 112, frame basic data 112 include at least eyeglass material, mirror pin length, nose support angle,
Nose support width, frame width and frame color.Computer apparatus 120 of the invention is via comparison frame basic data 112 and uses
The specified frame screening range in frame screening step and after several alternative frames for selecting, further according to the specified of user
Appointed frame is identified from alternative frame and automatically wears in user's image of face and is adjusted correspondingly, and is used with allowing
Person itself evaluates and decides whether to meet its demand.
Computer apparatus 120 has processing unit 121, camera unit 122, display unit 123, communication unit 124 and storage
Unit 125.Processing unit 121 is electrically connected at camera unit 122, display unit 123, communication unit 124 and storage element
125.It is computer (computer) that the type of computer apparatus 120, which does not limit, is also possible to mobile phone (mobile phone)
Or tablet computer (tablet) etc. has the electronic device of the computing capability.Camera unit 122 is for shooting digital image 131
(digital image).Heretofore described digital image 131 can be via captured by camera unit 122 or recording
The planar image or stereopsis of the user arrived；Or it is also possible to be sent to processing unit 121 via communication unit 124
User planar image or stereopsis.
Display unit 123 can also show augmented reality (Augmented in addition to showing captured digital image 131
Reality, abbreviation AR) image and operation augmented reality image in object.For convenience of description, display unit of the invention
123 for user's viewing picture and input operation instruction through touch control display screen.For example, when computer apparatus 120 is clapped
When taking the photograph stereopsis, user can be through the object in the scaling viewing digital image 131 of display unit 123, or rotation numerical digit
The movement such as object in image 131.In the situation of other application, computer apparatus 120 can be carried out through man-machine interface (HID)
Relevant operation.Communication unit 124 can be outer through network connection for being connected to frame data bank 110, communication unit 124,
Frame data bank 110 can also be connected to cable mode.
Storage element 125 stores the apolegamy record course with mirror application program 132 and user.It is wrapped with mirror application program 132
Include the position of each face feature of two eyes, nose and two ears in the digital image 131 that can be used in identifying user etc.
And the numerical data of distance, angle for measuring above-mentioned various face features etc.；.With mirror application program 132 in addition to knowing with face
Not and outside the function of automatic tracing, user's relevant interface for selecting eye glass frame model 111 is also provided；Include: receiving and
It transmits the image transmission interface of image of face of user, the frame screening conditions to receive user and is screened based on the frame
Condition selected from frame data bank a plurality of alternative frames frame screening interface and for a plurality of alternative frames according to
The secondary frame virtually tried on virtually tries interface on.For the identification of the face feature of the various digital images 131 of further explanation
The pairing process of process and eye glass frame model 111 please cooperate refering to what is shown in Fig. 2, the virtual glasses matching method of the present invention includes
Following steps:
Step S210: shooting or the digital image for obtaining user face；
Step S220: parsing or measures the digital image and obtains face feature；
Step S230: a plurality of alternative frames are filtered out based on the face feature；
Step S240: user successively virtually tries a plurality of alternative frames on and selects suitable mirror
Frame.
In this state sample implementation, the face's flat image or stereopsis of user can be further parsed via step S210
To obtain image of face characteristic data, image of face characteristic data include interpupillary distance between two eyes in face,
Interpupillary distance, face be wide, bridge of the nose height, nose bridge widths and eye-ear distance from face feature in it is any.Firstly, for example, being taken via camera shooting
In the case where the digital image for obtaining user, computer apparatus 120 shoots the positive digital image 131 of user.With that is, processing is single
Mirror application program 132 is matched in 121 operation of member, and is loaded into digital image 131 and is shown image in display unit 123.If making
User be not recorded in computer apparatus 120, then can star and carry out image for digital image 131 with mirror application program 132
The identification of feature.Then, the digital image of the face of the user further can be parsed or measured via step 220；It changes
Yan Zhi, can be automatically positioned from digital image 131 with mirror application program 132 or voluntarily chosen by user pupil, face it is wide,
Bridge of the nose height, nose bridge widths and eye-ear distance from each face feature locations, use to obtain wide interpupillary distance, face, bridge of the nose height,
Nose bridge widths and eye-ear distance from each face feature data information.
In addition, display unit 123 can jump now another input interface, the frame for providing input user screens range.
It, can be at least two as included in digital image 131 with mirror application program 132 among the frame screening step
The face feature as frame screen range and filter out a plurality of alternative frames.
For example, such as equation 2:M=180-Q=180-Tan can be used with mirror application program 132-1(X/(Y/
2)) (wherein, M is nose support angle (°)；Y indicates nose bridge widths (mm)；X indicates that bridge of the nose height (mm): Q indicates bridge of the nose gradient
(°).)；Such as (wherein, R indicates mirror pin length (mm) using equation 3:R=Z+13+F；Z indicates eye-ear distance from (mm)；
F indicates upper lower limit value (mm), is typically in the range of the range of 0~40mm) filter out a plurality of alternative frames.
In addition, user can open eye glass frame model selection interface, and specified screening item from computer apparatus 120
Part is wide interpupillary distance, face, eye-ear distance or nose bridge widths.Processing unit 130 is provided based on screening conditions specified by user from frame
It is shown in selection interface after filtering out the frame for meeting the screening conditions in material library 110.User can be from selection interface
It watches every eye glass frame model 111 and the style of preference is selected virtually to be tried on.When user selects any eye glass frame
When model 111, processing unit 130 is combined eye glass frame model 111 with digital image 131, and will be shown in void in conjunction with picture
It is quasi- try interface on and checked for user try picture on.
In this state sample implementation, digital image 131 captured by user is for user's face image 30.It is carrying out virtually
In the step S240 tried on, processing unit 121 can further include execution according to the bridge of the nose position of user and eye glass frame
The nose support position of model 111 judges and determines to be classified as the whether suitable function of alternative eye glass frame model 111.In addition, place
Reason unit 121 can also further draw corresponding eye-level schematic lines according to the eyes of user, as shown in Figure 3.Processing
Unit 121 can also further judge simultaneously according to nose support above-mentioned and eye-level schematic lines via with mirror application program 132
Whether decision is classified as alternative eye glass frame model 111 suitable.In general, eye glass frame model for user face most
Best placement is " user's horizontal line tangent with the level datum line of eyes palpebra inferior and mirror holder ", this horizontal line can also define
For such as eye-level schematic lines 301.In addition, user can also be with automatic moving eye glass frame model 111 in the position of user face
Set, use be classified as in alternative a plurality of eye glass frame models 111 described in observation and judgement any one be only it is most suitable.
Other than state sample implementation above-mentioned, the present invention can separately apply the amplification in user and eye glass frame model 111
The combination in real border.It include frame data bank 110 and computer apparatus 120, hardware frame in the virtual glasses apolegamy system of this implementation state
Structure and composition please cooperate with reference to Fig. 1.The hardware framework and component of this state sample implementation act on, connection for hardware identical as Fig. 1
Just not repeated explanation.
The camera unit 122 of this state sample implementation is other than shooting single image, the shooting digital image that can also continue
131, use the Image compounding of the stereopsis and eye glass frame model 111 applied to user.This state sample implementation includes that will identify
Object is worn in the face of user, and shoots user to establish digital image；It is identified according to the position of identification object three-dimensional
Two eyes, nose of user and the position of two ears are in image to obtain face feature information；It is screened based on the face feature
A plurality of alternative frames out；And user is virtually tried on, to select suitable frame.
In this state sample implementation, it is possible, firstly, to wear identification object 510 in user 520 on the face.Identify object 510
It can be glasses, card or detector.In general, the wearing position of identification object 510 can be set in turn according to development company
Fixed different position.For example, identification object 510 can be placed in 520 forehead of user, cheek two sides or nose.Assuming that
Identification object 510 is configured on the forehead of user 520.It can be according to the actual size of identification object 510 with mirror application program 132
The image-zooming ratio of object 510 is identified in DD discriminating digit image 131.Processing unit 121 can have according to image-zooming ratio
Example further two eyes of automatic identification user 520, the position of nose and two ears function.It can with mirror application program 132
To be selected from data bank multiple according to the first face feature of the position of eyes, nose and ear is screened range as frame
Several alternative frames.Also, first face feature, which can be two ears in the front image of user 520, connect shape with eyes
At linear distance (face is wide).
In addition, other positions of the face of user 520 can also be shot by computer apparatus 120 in this state sample implementation
The number of distance, elevation angle set obtained image, and then obtain from the image forehead, cheek two sides or nose etc. etc.
Come according to data as first face feature.For example, the left and right sides by overlooking shooting user 520 can be used for example
The image of face or shape of face.The present invention defines respective face feature according to different face locations are shot respectively.
In addition, in this state sample implementation, can also use the second face feature, third face feature, the 4th face feature,
Or other features.Specifically, for example, eyes when the second face feature can be the front of user 520 with side are cut
Face to ear distance (that is, eye-ear distance).Spacing when third face feature can be the front of user 520 on the inside of two eyes
Nasal width, the nasal height degree with the nose when 520 side of user of digital image 131.4th face feature can be in digital image
131 when overlooking user 520 two eyes a brow ridge camber.
Fig. 4 is the three-dimensional digital image 131 on 520 head of user.Three-dimensional digital image is scanned through stereoscopic camera
520 head of user obtains, and obtains the digital image 131 on 520 head of user.As shown in figure 4, the head phantom 60 of user is wrapped
The image of ear 601,602 and the image of nose 603 are included.In a state sample implementation, ear feature can be used and describe a little
611,612 come as the second face feature；According to the position of nose 603 and nose feature description point 631,632 can also be drawn,
633 come as third face feature；It can also be and come with the radius of curvature or radian of brow ridge camber schematic lines 613 as the 4th face
Portion's feature.
Alternatively, it is also possible to as shown in figure 5, using by one in the shooting obtained digital image 131 of 520 side face of user
Ear head connection signal line 701, between eyeball surface schematic lines 702 at a distance from, i.e. the distance d of ear to eyeball surface is done
For the second face feature.Second face feature used above, third face feature, the 4th face feature are only to illustrate
, arbitrarily can be changed and be corrected not departing within the scope of spirit of that invention, being familiar with the technology all should be apparent that this
Deng being also included within the scope of the present invention.
Cooperate shown in Fig. 4, computer apparatus 120 according to the digital image 131 obtained with mirror application program 132 capture eyes,
Nose, ear and head dummy image feature, for example, when by the wide length of face be set as T millimeter, the bridge of the nose be highly set as X millimeters, nose width
It is set as Y millimeters and when ear to the vertical range of nose (eyeball surface) is set as Z millimeters；It is obtained by such as above-mentioned practice big
The face feature data of amount and using Mathematical Fitting carry out big data analysis after, the inventors of the present invention study discovery frame width (P),
Bridge of the nose height (X), nose bridge widths (Y) and eye-ear distance have function ratio certain as shown in following equation sequence 1 between (Z)
Example relationship:
P=T ± 5=-1.036X2+ 23.365X-2.089Y+Z ± 5 ... (equation 1)
(wherein, P is frame width (mm)；
T is that the face of user is wide (mm)；
X is the bridge of the nose height (mm) of user；
Y is the nose bridge widths (mm) of user；
Z is the eye-ear distance of user from (mm).)
Count greatly with and using Mathematical Fitting also, the present inventor measures further to plurality of spectacle-frame
According to analysis as a result, discovery face wide (T), bridge of the nose gradient (Q), mirror pin length (R), frame width (P), nose support angle (M), nose
Depth of beam (X), nose bridge widths (Y) and eye-ear distance are from the correlation having more than to a certain degree between (Z).For example, nose support angle
M and bridge of the nose gradient (Q) face are wide in the presence of the relationship as shown in following equation sequence 2:
Nose support angle M=180-Q=180-Tan-1(X/ (Y/2)) ... (equation 2)
(wherein, M indicates nose support angle (°)
Y indicates nose bridge widths (mm)；
X indicates bridge of the nose height (mm):
Q indicates bridge of the nose gradient (°).)
It is carried out greatly in addition, the present inventor measures further to plurality of spectacle-frame with and using Mathematical Fitting
Data analysis as a result, discovery mirror pin length (R) and eye-ear distance between (Z) exist the relationship as shown in following equation sequence 3:
R=Z+13+F ... (equation 3)
(wherein, Z indicates eye-ear distance from (mm)；
R indicates mirror pin length (mm)
F indicates upper lower limit value (mm), is typically in the range of the range of 0~40mm.)
Then, user can open frame screening interface from computer apparatus 120, and specified screening conditions are pupil
Wide, eye-ear distance, nose bridge widths or bridge of the nose height away from, face.Processing unit 130 is based on screening conditions specified by user from mirror
It is shown on frame screening interface after filtering out the frame for meeting the screening conditions in frame data bank 110.User can be from mirror
Every eye glass frame model 111 is watched on frame screening interface and the style of preference is selected virtually to be tried on.When user selects
When any eye glass frame model 111, processing unit 130 is combined eye glass frame model 111 with digital image 131, and will be combined
Picture be shown in virtually try on interface for user viewing try picture on.
In addition, user further manual mode input can also screen item in another state sample implementation of the invention
Part, width, nose support angle, mirror pin length, color or shape including frame, uses the quantity for adjusting alternative frame.
When user selects the width of frame further as screening conditions, can be done with wide about one limits that add of face
For the correction value of screening conditions, for example, with the wide ± 5mm of face as the screening conditions of frame；Then, processing unit 121 is by foundation
The frame screening conditions set by the user and filter out a plurality of alternative frames.
The correcting mode of frame screening conditions illustrated above is only not depart from spirit of that invention model to illustrate
Enclose it is interior arbitrarily can be changed and be corrected, be familiar with the technology all and should be apparent that these be also included in the scope of the present invention with
It is interior.
When user inputs nose support angle as screening conditions, processing unit 121 can filter out corresponding mirror according to table 1
Frame.In addition, nose support angle M can also convert via following equation sequence 2 and be obtained.
M=180-Q=180-Tan-1(X/ (Y/2)) ... (equation 2)
(wherein, M indicates nose support angle (°)
Y indicates nose bridge widths (mm)；
X indicates bridge of the nose height (mm):
Q indicates bridge of the nose gradient (°).)
Table 1
Remarks: Q indicates bridge of the nose gradient (degree)；Y indicates nose bridge widths (mm)；X indicates bridge of the nose height
(mm)；W indicates nose support away from width (mm)；S indicates nose support distance degree (mm)
Also, the long corrected value of mirror pin can be inputted when user selects mirror pin length as screening conditions；Then, locate
Reason unit 121 can filter out the frame for meeting user's setting according to following equation sequence 3:
R=Z+13+F ... (equation 3)
(wherein, Z indicates eye-ear distance from (mm)；
R indicates mirror pin length (mm)；
F indicates upper lower limit value (mm), is typically in the range of the range of 0~40mm.)
In the above state sample implementation, the technology for shooting or executing face recognition when scanning 520 image of face of user can refer to this
Case before patent inventor: U.S. Patent Application No. 14/447652 (date of application: on July 31st, 2014)；And penetrate known ruler
The technology that very little references object calculates the ratio of true interpupillary distance and virtual interpupillary distance can refer to the patent application case of identical inventor: the U.S.
Patent application the 14/469569th (date of application: on August 26th, 2014) with No. 14/447652.Also, it is taken the photograph through solid
The technology of the fine image of face of the 3D camera lens scanning face of shadow machine can refer to 3D map and face algorithm, such as inventor
U.S. Patent Application No. 13/649170, Chinese patent application the CN201310117970.5th etc., so that system matches data
After eye glass frame model 111 in library, allow user can be directed through computer apparatus 120 with automatic acquirement meet oneself size and
Good-looking true frame.
The selection course of user of the invention for the different shapes of face to clearly illustrate is hereby specific with embodiment 1-3 below
Illustrate virtual glasses matching method of the invention.
Embodiment 1
Of the invention match mirror application program firstly, opening.Then, referring to Fig. 6, it uploads schematic diagram for user image,
User A can recognize the source that image is selected in target source: comprising 3D camera shooting, 2D camera shooting, upload camera shooting；Or selection converges
Entering face's information will previously analyze in face's news file remittance program；Alternatively, it is also possible to select input face's information with hand
Flowing mode directly inputs the numerical value of each feature of face.In the present embodiment, user A is to choose biography from image transmission interface midpoint
Then the option of camera shooting selects the place path of digital image shelves from target source selection interface, by face front and side
Digital image shelves be uploaded in spectacles matching system, camera shooting in image transmission interface identification status display success, it is known that the present invention
Obtained the face feature data of user as shown in table 2 below with mirror application program.
Then, using above-mentioned equation 1, equation 2, equation 3, calculate separately appearance width of frame (mm), nose support angle
Spend (degree), mirror pin length (mm) etc. and screening conditions A1, A3 to be frame.
Table 2
P=-1.036X2+ 23.365X-2.089Y+Z ± 5 ... (equation 1)
M=(180-Q)=180-Tan-1(X/ (Y/2)) ... ... (equation 2)
R=Z+13+F (mm) ... ... ... ... (equation 3)
Then, referring to FIG. 7, it screens schematic diagram for frame；Show that the face of user A is special in frame screening interface
Levy information, including face's width, bridge of the nose height, nose bridge widths and eye-ear distance from.User A is more than identification information interface is specified
The intersection person in frame screening conditions A1, A3 stated.For example, with A1 frame width 138.7mm as the screening conditions of frame, so
Application program is screened from frame data bank automatically afterwards, and total filters out the alternative frame that 318 pairs meet above-mentioned condition；And
It is carried out filtering out 387 pairs by mirror pin length.Mirror pin length falls in 131mm to the eye glass frame between 141mm；Nose support angle be
Between 47.82 degree to 55.68 degree, average value is 53.26 degree, confirms the angle for being adjusted to be suitble to consumer when shipment.In A1, A3
Intersection quantity be 184, consumer can just screen after frame try on.
Then, referring to FIG. 8, it is the schematic diagram virtually tried on, user A is to click preference in alternative frame
Frame style, then the image of face of the frame being selected and user A is combined by application program automatically, and will combine picture
Face, which is shown in, virtually to be tried among interface, so that user A is from virtually trying the effect checked and tried among interface on.
After user A is chosen over alternative frame and watches and try picture on, selected appearance and modeling meets the frame of expectation,
The option of "Yes" is selected in the screening frame style for virtually trying right side in interface on, frame has been selected in expression；Then hotel owner's meeting
The frame entity being consistent is taken out from warehouse according to the selected frame data of user A to wear and be confirmed whether for user A
Meet demand.
Embodiment 2
Of the invention match mirror application program firstly, opening.Same as Example 1ly, user B can recognize target source
The source of middle selection image comprising 3D camera shooting, 2D camera shooting, uploads camera shooting；Or selection imports face's information and will previously analyze
Face's news file imports in program；It is each alternatively, it is also possible to select input face's information to directly input face in a manual manner
The numerical value of feature.In the present embodiment, user B is selection 3D camera shooting as Image sources；Referring to Fig. 9, it is user B
Three-dimensional head phantom shoot schematic diagram, using the head of stereoscopic camera scanning user B to obtain the three-dimensional head of user B
Through by Wi-Fi, directly by image transmission into spectacles matching system, the camera shooting identification state in image transmission interface is aobvious after portion's image
It is shown as function, it is known that the face feature data that user B as shown in the table has been obtained with mirror application program of the invention.
Then, using above-mentioned equation 1, equation 2, equation 3, calculate separately appearance width of frame (mm), nose support angle
Spend (degree), mirror pin length (mm) etc. and screening conditions B1, B3 to be frame.
Table 3
Then, specified with the intersection person in above-mentioned frame screening conditions B1, B3 in frame screening interface.For example, with B1
Frame width (133.5mm) and B3 mirror pin length (138mm) are as the screening conditions of frame, and then application program is automatically from mirror
Frame data bank is screened, and total filters out the alternative frame that 58 pairs meet above-mentioned condition.The width of the 58 pair of glasses frame
128.5mm is fallen between 138.5mm, average value 133.5mm；Mirror pin length falls in 133mm between 143m, and average value is
138mm；Nose support width falls in 11.5 between 15.5mm, and average value is in 13.9mm.
Then, user B clicks the frame style of preference in alternative frame, and then application program will be selected automatically
The head phantom of frame and user B is combined, and will be shown and be tried among interface virtually in conjunction with picture, so as to user B from
Virtually try the effect checked and tried among interface on.
After user B is chosen over alternative frame and watches and try picture on, selected appearance and modeling meets the frame of expectation,
The option of "Yes" is selected in the screening frame style for virtually trying right side in interface on, frame has been selected in expression；Then, Dian Jiahui
The frame entity being consistent is taken out from warehouse according to the selected frame data of user B to wear and be confirmed whether for user B
Meet demand.
Embodiment 3
The of the invention with mirror application program of running gear is installed on firstly, opening.Then, direct taking the photograph with running gear
As alignment lens user C exists so that the head phantom of user C appears on the display screens of running gear by user C
Head is rotated before pick-up lens to obtain the face feature data of user C as shown in table 4 below.
Then, using above-mentioned equation 1, equation 2, equation 3, calculate separately appearance width of frame (mm), nose support angle
Spend (degree), mirror pin length (mm) etc. and screening conditions C1, C3 to be frame.
Table 4
Then, specified with the intersection person in above-mentioned frame screening conditions C1, C3 in frame screening interface.For example, with C1
Frame width (125.5mm), C3 mirror pin length (125mm) or nose bridge widths are as the screening conditions of frame, then application program
Automatically it is screened from frame data bank, total filters out the alternative frame that 45 pairs meet above-mentioned condition.The 45 pair of glasses mirror
The width of frame falls 120.2 between 130.2mm, average value 125.2mm；Mirror pin length falls in 120 between 130mm, is averaged
Value is 125mm；Bridge of the nose gradient is between 27.4 degree to 33.8 degree, and average value is 31.4 degree.
Then, user C clicks the frame style of preference in alternative frame, and then application program will be selected automatically
Frame, which is shown in, virtually to be tried among interface, and user C can synchronize its head phantom through the pick-up lens of running gear
It is shown in and virtually tries interface on, and adjust its head phantom via moving-head and virtually trying the position among interface on, by
To check the effect tried on.
After user C is chosen over alternative frame and watches and try picture on, selected appearance and modeling meets the frame of expectation,
The option of "Yes" is selected in the screening frame style for virtually trying right side in interface on, frame has been selected in expression；Then hotel owner's meeting
The frame entity being consistent is taken out from warehouse according to the selected frame data of user C to wear and be confirmed whether for user C
Meet demand.
In conclusion according to the virtual glasses matching method and system of above-described embodiment description, wherein in addition to utilizing plane
Image obtains outside the interpupillary distance for determining eye glass frame model, also uses anaglyph spectacles analogue technique, and user penetrates graphical user
Interface selects frame type and frame relevant parameter, and system can provide eye glass frame model according to the condition of interpupillary distance, however, more
It can further be obtained at a distance from ear to eyeball surface, according to the feature of nose acquirement bridge of the nose height according to eyeball and ear location
With width and brow ridge camber, allow user can be through computer apparatus, such as running gear, so that it may automatically find and meet
Oneself size and hobby and the pattern for determining glasses reach the mesh that the virtual glasses to get the right lensses for one's eyeglasses such as parent to glasses company are matched
's.
Although the present invention is disclosed above with preferred embodiment above-mentioned, however, it is not to limit the invention, any to be familiar with
Alike those skilled in the art, without departing from the spirit and scope of the present invention, when can make some changes and embellishment, thus it is of the invention special
Sharp protection scope must regard subject to the institute of claim appended by this specification defender.
Claims (8)
1. a kind of virtual glasses matching method, which is characterized in that
Image obtaining step: shooting or the digital image for obtaining user face；
Face feature numerical value measurement step: parsing or measure the digital image and obtain the bridge of the nose height of user, nose bridge widths,
And eye-ear distance from face feature data information；
Frame screening step: data information is sieved based on the face feature and is selected from frame data bank using following equation 1
A plurality of alternative frames out:
P=-1.036X2+ 23.365X-2.089Y+Z ± 5 (equation 1)
Wherein, P is frame width (mm)；
X is the bridge of the nose height (mm) of user；
Y is the nose bridge widths (mm) of user；
Z is the eye-ear distance of user from (mm)；And
Frame deciding step: user successively virtually tries a plurality of alternative frames on and selects suitable mirror
Frame.
2. virtual glasses matching method according to claim 1, which is characterized in that further wrapped in frame screening step
It includes using following equation 2 and selects a plurality of alternative frames from frame data bank:
M=180-Q=180-Tan-1(X/ (Y/2)) (equation 2)
Wherein, M indicates nose support angle (°)；
Y indicates nose bridge widths (mm)；
X indicates bridge of the nose height (mm):
Q indicates bridge of the nose gradient (°).
3. virtual glasses matching method according to claim 1, which is characterized in that further wrapped in frame screening step
It includes using following equation 3 and selects a plurality of alternative frames from frame data bank:
R=Z+13+F (mm) (equation 3)
Wherein, R indicates mirror pin length (mm)；
Z indicates eye-ear distance from (mm)；
F indicates upper lower limit value (mm), is typically in the range of the range of 0~40mm.
4. virtual glasses matching method according to claim 1, which is characterized in that work as user in frame deciding step
Then include using following equation 2 in the rear of frame deciding step when failing to select the frame for being suitble to wearing, further to
Selected a plurality of alternative frames are screened in the frame screening step:
M=180-Q=180-Tan-1(X/ (Y/2)) (equation 2)
Wherein, M indicates nose support angle (°)；
Y indicates nose bridge widths (mm)；
X indicates bridge of the nose height (mm):
Q indicates bridge of the nose gradient (°).
5. virtual glasses matching method according to claim 1, which is characterized in that work as user in frame deciding step
Then include using following equation 3 in the rear of frame deciding step when failing to select the frame for being suitble to wearing, further to
Selected a plurality of alternative frames are screened in the frame screening step:
R=Z+13+F (equation 3)
Wherein, R indicates mirror pin length (mm)；
Z indicates eye-ear distance from (mm)；
F indicates upper lower limit value (mm), is typically in the range of the range of 0~40mm.
6. virtual glasses matching method according to claim 5, which is characterized in that the face feature data information is into one
Step includes wide interpupillary distance, face, nose support distance degree, mirror pin length, at least any one in shape and color.
7. a kind of virtual glasses match system, which is characterized in that
Frame data bank, for storing plural pair of glasses frame model；And
Computer apparatus, the computer apparatus have processing unit, camera unit, display unit, communication unit and storage element, institute
It states processing unit and is electrically connected at the camera unit, display unit, the communication unit and the storage element, the communication
Unit network is connected to the frame data bank, and mirror application is matched in the storage element storage one, and the processing unit executes
It is described to match mirror application；Wherein it is described be with mirror application include: image of face to receive and transmit user
Image transmission interface, the frame screening conditions to receive user are simultaneously based on the frame screening conditions from frame data bank
Select the mirror that the frame of a plurality of alternative frames screens interface and successively virtually tried on for a plurality of alternative frames
Frame virtually tries interface on；The processing unit is based on the face feature and filters out a plurality of alternative mirrors from frame data bank
Frame；The display unit shows the alternative frame and in conjunction with the digital image of the user, for user's selection and
Determine suitable frame.
8. virtual glasses according to claim 7 match system, which is characterized in that the digital image is single via camera shooting
Member shooting is sent to the processing unit via the communication unit and obtains.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710406144.0A CN109003298A (en) | 2017-06-02 | 2017-06-02 | virtual glasses matching method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710406144.0A CN109003298A (en) | 2017-06-02 | 2017-06-02 | virtual glasses matching method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109003298A true CN109003298A (en) | 2018-12-14 |
Family
ID=64572649
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710406144.0A Pending CN109003298A (en) | 2017-06-02 | 2017-06-02 | virtual glasses matching method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109003298A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109978655A (en) * | 2019-01-14 | 2019-07-05 | 明灏科技（北京）有限公司 | A kind of virtual frame matching method and system |
| US20220300728A1 (en) * | 2021-03-22 | 2022-09-22 | Snap Inc. | True size eyewear experience in real time |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070098230A1 (en) * | 2005-10-28 | 2007-05-03 | Konica Minolta Holdings, Inc. | Authentication system, registration system, and program |
| CN105469072A (en) * | 2015-12-14 | 2016-04-06 | 依视路国际集团（光学总公司） | Method and system for evaluating matching degree of glasses wearer and the worn glasses |
| CN106023068A (en) * | 2016-05-18 | 2016-10-12 | 广东工业大学 | Glasses frame try-on method, apparatus and system |
-
2017
- 2017-06-02 CN CN201710406144.0A patent/CN109003298A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070098230A1 (en) * | 2005-10-28 | 2007-05-03 | Konica Minolta Holdings, Inc. | Authentication system, registration system, and program |
| CN105469072A (en) * | 2015-12-14 | 2016-04-06 | 依视路国际集团（光学总公司） | Method and system for evaluating matching degree of glasses wearer and the worn glasses |
| CN106023068A (en) * | 2016-05-18 | 2016-10-12 | 广东工业大学 | Glasses frame try-on method, apparatus and system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109978655A (en) * | 2019-01-14 | 2019-07-05 | 明灏科技（北京）有限公司 | A kind of virtual frame matching method and system |
| US20220300728A1 (en) * | 2021-03-22 | 2022-09-22 | Snap Inc. | True size eyewear experience in real time |
| US12067804B2 (en) * | 2021-03-22 | 2024-08-20 | Snap Inc. | True size eyewear experience in real time |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12067689B2 (en) | Systems and methods for determining the scale of human anatomy from images | |
| CN108427503B (en) | Human eye tracking method and human eye tracking device | |
| CN105008987B (en) | The design system of eyeglass, feed system, method for designing and manufacture method | |
| EP2749207B1 (en) | Eyeglasses-wearing simulation method, program, device, eyeglass lens-ordering system and eyeglass lens manufacturing method | |
| JP6023801B2 (en) | Simulation device | |
| CN103501406B (en) | Image collecting system and image collecting method | |
| US20140293220A1 (en) | Fitting glasses frames to a user | |
| US20130002814A1 (en) | Method for automatically improving stereo images | |
| CN104036169B (en) | Biological authentication method and biological authentication apparatus | |
| EP3029511A1 (en) | Multiple-reference based system and method for ordering eyeglasses | |
| CN104834901A (en) | Binocular stereo vision-based human face detection method, device and system | |
| EP3635478B1 (en) | Method, device and computer program for determining a close-up viewpoint | |
| WO2008040918A2 (en) | Display device for stereoscopic display | |
| CN105308494A (en) | Method for determining at least one value of a parameter for customising a visual compensation device | |
| JP2017524163A (en) | Determination of user data based on image data of the selected spectacle frame | |
| US20150049952A1 (en) | Systems and methods of measuring facial characteristics | |
| KR20150102941A (en) | Method for helping determine the vision parameters of a subject | |
| KR20170071967A (en) | Method for recommending glass in online shopping mall | |
| CN110446967B (en) | Computer-implemented method for determining a representation of an edge of a spectacle frame or a representation of an edge of a spectacle lens | |
| KR102444768B1 (en) | Method and apparatus for measuring local power and/or power distribution of spectacle lenses | |
| CN109003298A (en) | virtual glasses matching method and system | |
| CN103690171A (en) | Glasses measuring and matching device, glasses measuring and matching server and glasses measuring and matching method | |
| TWI663561B (en) | Virtual glasses matching method and system | |
| JP2013226397A (en) | Apparatus for measuring objective near field distance and method and system for manufacturing spectacle lens using the apparatus for measuring objective near field distance | |
| JPH08266465A (en) | Simulation apparatus for eye optical system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20181214 |
|
| WD01 | Invention patent application deemed withdrawn after publication |