CN103413118A - On-line glasses try-on method - Google Patents

On-line glasses try-on method Download PDF

Info

Publication number
CN103413118A
CN103413118A CN2013103044149A CN201310304414A CN103413118A CN 103413118 A CN103413118 A CN 103413118A CN 2013103044149 A CN2013103044149 A CN 2013103044149A CN 201310304414 A CN201310304414 A CN 201310304414A CN 103413118 A CN103413118 A CN 103413118A
Authority
CN
China
Prior art keywords
glasses
eyes
picture
try
pupil position
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2013103044149A
Other languages
Chinese (zh)
Other versions
CN103413118B (en
Inventor
毕胜
李勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhuhai Necessary Industrial Technology Co ltd
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201310304414.9A priority Critical patent/CN103413118B/en
Publication of CN103413118A publication Critical patent/CN103413118A/en
Application granted granted Critical
Publication of CN103413118B publication Critical patent/CN103413118B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Processing Or Creating Images (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

The invention relates to an on-line glasses try-on method. The method comprises the following steps of uploading a head portrait picture, recognizing outlines of the two eyes of the head portrait picture, horizontally displaying a glasses picture selected by a user on a screen, analyzing the glasses picture selected by the user and the outlines of the two eyes, analyzing the pupil positions of glasses and the pupil positions of the eyes, moving the glasses picture to enable the middle points of the pupil positions of the glasses to align the middle points of the pupil positions of the eyes, rotating the glasses picture according to the positions of the eyes and zooming the glasses picture according to the pupil distance of the glasses and the pupil distance of the eyes. According to the on-line glasses try-on method, the glasses can be automatically matched with the facial form, and the effect that users with different facial forms can automatically try the glasses on is achieved.

Description

Online glasses try-on method
Technical field
The present invention relates to online virtually trying field, relate in particular to a kind of glasses try-on method of on-line operation.
Background technology
In recent years, along with the fast development of internet, ecommerce has become a kind of very important marketing method, and the scale of China E-Commerce Business in 2012 has reached 8.1 trillion yuan, and wherein shopping at network has reached 1 trillion yuan Renminbi.Affect that ecommerce further develops except payment logistics etc., a key factor is customer experience.Ecommerce and the maximum difference of tradition commercial affairs are that the buyer can't be used or dress experience to commodity really before purchase.In the ecommerce practice, various schemes of trying on have online appearred for this reason.
Yet the scheme of online try-on is usually based on fixing model's picture, the consumer is difficult to judge whether article are suitable own, or does the judgement made mistake, and causes bad user's experience, and this has limited the development of ecommerce to a great extent.Therefore, select if can make each user carry out article with reference to s own situation, can improve greatly user's experience.
Try on online and comprise online try-on garment, shoes and hats and glasses etc., wherein, a gordian technique in online glasses try-in is the glasses automatic Matching.Current online glasses try-in technology is that glasses are placed on the fixed position of the model head picture preset, or on screen, is providing instrument to allow client manually locate on head portrait.But these modes can't let user experiencing the effect of in person trying on, make the user usually can abandon this more simple and convenient mode of on-line purchase glasses, but select solid shop/brick and mortar store to buy.
Therefore, how to improve online glasses try-in technology, can see the effect of in person wearing while making user's on-line selection buy glasses, experience thereby obtain better user, become businessman and can obtain in this field the key issue of great development.
The information that is disclosed in background technology part of the present invention only is intended to deepen the understanding to general background technology of the present invention, and should not be regarded as admitting or imply that in any form this information structure has been prior art known in those skilled in the art.
Summary of the invention
The purpose of this invention is to provide a kind of online glasses try-on method.Particularly, the head portrait picture location eye position the automatic method of locating glasses position and angle that by analyzing the client, provide.At present, face recognition technology has been obtained very large development, and is widely used in the fields such as security fields (for example, monitor, gate control system, information security etc.) and digital photographing.Yet, in ecommerce, seldom use face recognition technology.The present invention engages face recognition technology with online glasses try-on method, experience for the consumer provides good user.Online glasses try-on method of the present invention comprises: a kind of online glasses try-on method, it is characterized in that, and said method comprising the steps of:
1) user uploads the head portrait picture that comprises face and two eyes;
2) identify the housing of two eyes in described head portrait picture;
3) the glasses picture level of the user being selected is presented in screen;
4) the glasses picture of user's selection and the housing of described two eyes are analyzed, analyzed the pupil position of glasses and the pupil position of eyes;
5) move described glasses picture, make the mid point of the pupil position of glasses align with the mid point of the pupil position of eyes;
6) according to the position of eyes, the glasses picture is rotated;
7) according to the interpupillary distance of eyes and the interpupillary distance of glasses, the glasses picture is carried out to convergent-divergent.
Preferably, described step 2) comprise that further the described housing that identifies two eyes in described head portrait picture is the rectangle housing.
Preferably, the housing that described step 2) further comprises two eyes that identify can be the housing varied in size.
Preferably, in described step 4), analyze the pupil position of eyes, further comprise the angle of inclination of the line of the pupil position of analyzing eyes.
Preferably, described step 6) further comprises the line of the pupil position of glasses is alignd with the line of the pupil position of eyes.
Preferably, described step 6) further comprises according to the angle of inclination of the pupil position line of eyes the glasses picture is rotated.
Preferably, described step 7) further comprises according to the proportionate relationship of glasses pupil and eyes interpupillary distance, the glasses picture is carried out to convergent-divergent.
Preferably, the rotation of glasses and convergent-divergent can add the three-dimensional perspective effect, and described three-dimensional perspective effect realizes based on the angle of inclination of eye pupil line and/or the size of two eyes housings.
By Figure of description and with accompanying drawing one, be used from the specific embodiment that some principle of the present invention is described, the further feature that the present invention has and advantage will become clear or more specifically be illustrated.
The accompanying drawing explanation
Fig. 1 is the process flow diagram according to online glasses try-on method of the present invention;
Fig. 2 uploads the schematic diagram of the original image of head portrait picture and selected glasses for the user;
Fig. 3 is for showing the schematic diagram through the housing of automatically knowing others face housing and two eyes;
Fig. 4 shows the glasses pupil position of calculating by analysis and the schematic diagram of eye pupil position;
Fig. 5 is for showing the schematic diagram at mobile glasses and alignment center;
Fig. 6 is for showing the schematic diagram that glasses are rotated;
Fig. 7 is for showing the schematic diagram that glasses is carried out to convergent-divergent;
Fig. 8 is for showing the schematic diagram of user's wearing spectacles final effect.
It should be understood that each feature of the present invention shown in accompanying drawing may adopt the mode of simplifying to mean to a certain extent, and not necessarily in strict accordance with scale.Specific design feature of the present invention disclosed herein, comprise for example specific dimensions, orientation, position and shape, will partly according to concrete application and environment for use, determine.
Reference numeral in the accompanying drawings means identical or equivalent part of the present invention in whole several accompanying drawings.
Embodiment
For clearer explanation content of the present invention, the invention will be further described below in conjunction with accompanying drawing and exemplary embodiment, but be to be understood that this description do not really want the present invention is limited to this exemplary embodiment.On the contrary, the present invention will not only cover this exemplary embodiment, but also cover various replacements, that change, equivalence with other embodiment, it can be included in the spirit and scope of the present invention that claim limits.
According to an aspect of the present invention, the process flow diagram according to the online glasses try-on method of exemplary embodiment of the present invention has been shown in Fig. 1.
In step S101, the user uploads the head portrait picture that comprises face and two eyes.This head portrait picture can be the picture that is stored in subscriber's local, can be also that the user takes the picture of directly uploading by camera, as shown in Figure 2.
In step S102, automatically identify the housing of face's housing and two eyes.According to the head portrait picture that the user uploads, utilize third party's instrument to analyze identification to picture.In a specific embodiment of the present invention, this third party's instrument can be the OpenCV image analysis module, certainly, also can adopt other image analysis tool and face identification system.
In step S103, whether judgement identification automatically is successful.If identify successfully, demonstrate the housing of face and the housing of two eyes, as shown in Figure 3; For example, if recognition failures, can only identify eyes, or do not identify eyes, to the user feedback None-identified, ask the user to upload or take new photo.
In a specific embodiment of the present invention, the face's housing automatically identified and the housing of two eyes are rectangle housings.In other embodiments, this housing can be also the housing of other shapes.
In another specific embodiment of the present invention, the housing of two eyes that automatically identify can be the housing varied in size.
In step S104, the user selects glasses.To after head portrait picture recognition success, the user can select glasses, and as shown in Figure 4, glasses can horizontal positioned and are presented in same screen or view with head portrait picture.
In step S105, determine respectively the pupil position of glasses and eyes, and calculate the position skew of glasses and eyes.At first, selected glasses are analyzed, determined the pupil position of glasses.In a specific embodiment, the pupil position of glasses can be got the position of glasses width 25%, height 30%.In another specific embodiment, the pupil position of glasses can be chosen in the database of the selected glasses of correspondence.Fig. 4 mid point A1 and A2 mean the pupil position of glasses.What can expect is that according to the style difference of glasses, the pupil position of these glasses can be arranged on different applicable positions.Then, the pupil position of eyes is positioned to the center of the eyes housing identified, is some B1 and the B2 shown in Fig. 4.After determining the position of pupil, calculate the position skew between glasses pupil position and eye pupil position.In a specific embodiment, with the mid point A of two pupil positions calculating glasses and the mid point B of the pupil position of two eyes, and the distance between 2 of AB, the position of calculating between glasses pupil position and eye pupil position is offset.
In addition, in step S105, also to analyze the angle of inclination of the line B1-B2 of two eye pupil positions.
In step S106, the location glasses.According to the distance between 2 of AB, glasses are moved to the upper position be applicable to of human face, that is, the mid point A of glasses pupil position is alignd with the mid point B of eye pupil position, as shown in Figure 5.If the head portrait picture that the user uploads is the front face image, such as certificate photo etc., so now basically by the eyeglasses-wearing success.Yet the face in the head portrait picture that people upload has certain angle of inclination usually, and use the first-class equipment of cell-phone camera to autodyne more to be difficult to the head portrait picture of taking as certificate photo.Therefore, also needing to carry out following step adjusts the position of glasses.
In step S107, the rotation glasses.Now, the pupil position mid point A of glasses overlaps with eye pupil position mid point B.Angle of inclination according to the line B1-B2 of two eye pupil, be rotated the pupil position line A1-A2 of glasses around its mid point A, until align with the pupil position line B1-B2 of eyes, as shown in Fig. 4-Fig. 6.Can see, glasses are worn according to the angle of face in head portrait picture fully.
Due to the interpupillary distance of glasses and the difference between the eyes of user interpupillary distance, also need to carry out step S108, glasses are carried out to convergent-divergent.According to the ratio of eyes interpupillary distance and glasses interpupillary distance, make the convergent-divergent that carries out of glasses integral body, thereby be applicable to user's face size, as shown in Figure 7.In another embodiment of the application, also can select voluntarily scaling by the user, to meet individual requirements.
In another embodiment of the present invention, the rotation of glasses and/or convergent-divergent can add the three-dimensional perspective effect, this three-dimensional perspective effect for example can be based on the angle of inclination of eye pupil line and/or the size of two eyes housings is realized, meets further attractive in appearance or individual demand with this.
The final effect that has shown user's wearing spectacles in Fig. 8.
Method of the present invention, by the analysis according to user's head portrait, is calculated the relative position of glasses pupil and eye pupil, automatically glasses and shape of face, angle is mated, and reaches the effect that any shape of face all can be tried on automatically.
Aforementioned description to concrete exemplary embodiment of the present invention is for the purpose with illustration is described.Limit the present invention is not thought in these descriptions, or the present invention is defined as to disclosed precise forms, and obviously, according to above-mentioned instruction, can much change and change.Exemplary embodiment is selected and the purpose described is to explain certain principles of the present invention and practical application thereof, thereby made others skilled in the art can realize and utilize various exemplary embodiment of the present invention and various selection and change.Scope of the present invention is intended to be limited by claims and equivalents thereof.

Claims (8)

1. an online glasses try-on method, is characterized in that, said method comprising the steps of:
1) user uploads the head portrait picture that comprises face and two eyes;
2) identify the housing of two eyes in described head portrait picture;
3) the glasses picture level of the user being selected is presented in screen;
4) the glasses picture of user's selection and the housing of described two eyes are analyzed, analyzed the pupil position of glasses and the pupil position of eyes;
5) move described glasses picture, make the mid point of the pupil position of glasses align with the mid point of the pupil position of eyes;
6) according to the position of eyes, the glasses picture is rotated;
7) according to the interpupillary distance of eyes and the interpupillary distance of glasses, the glasses picture is carried out to convergent-divergent.
2. online glasses try-on method according to claim 1, is characterized in that, described step 2) comprise that further the described housing that identifies two eyes in described head portrait picture is the rectangle housing.
3. online glasses try-on method according to claim 1 and 2, is characterized in that, described step 2) comprise that further the housing of two eyes that identify can be the housing varied in size.
4. online glasses try-on method according to claim 1, is characterized in that, in described step 4), analyzes the pupil position of eyes, further comprises the angle of inclination of the line of the pupil position of analyzing eyes.
5. online glasses try-on method according to claim 1, is characterized in that, described step 6) further comprises aligns the line of the pupil position of glasses with the line of the pupil position of eyes.
6. online glasses try-on method according to claim 5, is characterized in that, described step 6) further comprises according to the angle of inclination of the pupil position line of eyes the glasses picture is rotated.
7. online glasses try-on method according to claim 1, is characterized in that, described step 7) further comprises according to the proportionate relationship of glasses pupil and eyes interpupillary distance, the glasses picture is carried out to convergent-divergent.
8. according to claim 1,6 or 7 described online glasses try-on methods, it is characterized in that, the rotation of glasses and convergent-divergent can add the three-dimensional perspective effect, and described three-dimensional perspective effect realizes based on the angle of inclination of eye pupil line and/or the size of two eyes housings.
CN201310304414.9A 2013-07-18 2013-07-18 Online glasses try-on method Active CN103413118B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310304414.9A CN103413118B (en) 2013-07-18 2013-07-18 Online glasses try-on method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310304414.9A CN103413118B (en) 2013-07-18 2013-07-18 Online glasses try-on method

Publications (2)

Publication Number Publication Date
CN103413118A true CN103413118A (en) 2013-11-27
CN103413118B CN103413118B (en) 2019-02-22

Family

ID=49606127

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310304414.9A Active CN103413118B (en) 2013-07-18 2013-07-18 Online glasses try-on method

Country Status (1)

Country Link
CN (1) CN103413118B (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104408764A (en) * 2014-11-07 2015-03-11 成都好视界眼镜有限公司 Method, device and system for trying on glasses in virtual mode
CN105095841A (en) * 2014-05-22 2015-11-25 小米科技有限责任公司 Method and device for generating eyeglasses
CN105303619A (en) * 2015-10-27 2016-02-03 深圳市朗形网络科技有限公司 Generation method of sequential images and mobile terminal
CN105354792A (en) * 2015-10-27 2016-02-24 深圳市朗形网络科技有限公司 Method for trying virtual glasses and mobile terminal
CN105678686A (en) * 2015-12-30 2016-06-15 北京金山安全软件有限公司 Picture processing method and device
CN105809507A (en) * 2016-02-29 2016-07-27 北京酷配科技有限公司 Virtualized wearing method and virtualized wearing apparatus
CN105975920A (en) * 2016-04-28 2016-09-28 上海交通大学 Method and system for trying glasses
CN106203364A (en) * 2016-07-14 2016-12-07 广州帕克西软件开发有限公司 System and method is tried in a kind of 3D glasses interaction on
CN107025628A (en) * 2017-04-26 2017-08-08 广州帕克西软件开发有限公司 A kind of virtual try-in method of 2.5D glasses and device
CN107945102A (en) * 2017-10-23 2018-04-20 深圳市朗形网络科技有限公司 A kind of picture synthetic method and device
CN109712103A (en) * 2018-11-26 2019-05-03 深圳艺达文化传媒有限公司 From the eyes processing method and Related product of the Thunder God picture that shoots the video
CN109978655A (en) * 2019-01-14 2019-07-05 明灏科技(北京)有限公司 A kind of virtual frame matching method and system
CN110349269A (en) * 2019-05-21 2019-10-18 珠海随变科技有限公司 A kind of target wear try-in method and system
CN110533775A (en) * 2019-09-18 2019-12-03 广州智美科技有限公司 A kind of glasses matching process, device and terminal based on 3D face

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1971608A (en) * 2006-12-04 2007-05-30 谢亦玲 Picture database processing method for computerized 3D glasses fitting and apparatus thereof
CN101059871A (en) * 2007-05-17 2007-10-24 谢亦玲 Computer glasses-selecting equipment
KR20100050052A (en) * 2008-11-05 2010-05-13 김영준 Virtual glasses wearing method
CN102867321A (en) * 2011-07-05 2013-01-09 艾迪讯科技股份有限公司 System and method for eyeglasses virtual try-on interactive service

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1971608A (en) * 2006-12-04 2007-05-30 谢亦玲 Picture database processing method for computerized 3D glasses fitting and apparatus thereof
CN101059871A (en) * 2007-05-17 2007-10-24 谢亦玲 Computer glasses-selecting equipment
KR20100050052A (en) * 2008-11-05 2010-05-13 김영준 Virtual glasses wearing method
CN102867321A (en) * 2011-07-05 2013-01-09 艾迪讯科技股份有限公司 System and method for eyeglasses virtual try-on interactive service

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
李鹃: "基于特征点定位的虚拟试戴的研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105095841A (en) * 2014-05-22 2015-11-25 小米科技有限责任公司 Method and device for generating eyeglasses
CN104408764A (en) * 2014-11-07 2015-03-11 成都好视界眼镜有限公司 Method, device and system for trying on glasses in virtual mode
CN104408764B (en) * 2014-11-07 2017-05-24 成都好视界眼镜有限公司 Method, device and system for trying on glasses in virtual mode
CN105303619A (en) * 2015-10-27 2016-02-03 深圳市朗形网络科技有限公司 Generation method of sequential images and mobile terminal
CN105354792A (en) * 2015-10-27 2016-02-24 深圳市朗形网络科技有限公司 Method for trying virtual glasses and mobile terminal
CN105303619B (en) * 2015-10-27 2018-11-06 深圳市朗形网络科技有限公司 A kind of sequence image generation method and mobile terminal
CN105678686A (en) * 2015-12-30 2016-06-15 北京金山安全软件有限公司 Picture processing method and device
CN105678686B (en) * 2015-12-30 2019-06-14 北京金山安全软件有限公司 Picture processing method and device
CN105809507A (en) * 2016-02-29 2016-07-27 北京酷配科技有限公司 Virtualized wearing method and virtualized wearing apparatus
CN105975920A (en) * 2016-04-28 2016-09-28 上海交通大学 Method and system for trying glasses
CN105975920B (en) * 2016-04-28 2019-11-26 上海交通大学 A kind of glasses try-on method and system
CN106203364A (en) * 2016-07-14 2016-12-07 广州帕克西软件开发有限公司 System and method is tried in a kind of 3D glasses interaction on
CN106203364B (en) * 2016-07-14 2019-05-24 广州帕克西软件开发有限公司 System and method is tried in a kind of interaction of 3D glasses on
CN107025628A (en) * 2017-04-26 2017-08-08 广州帕克西软件开发有限公司 A kind of virtual try-in method of 2.5D glasses and device
CN107945102A (en) * 2017-10-23 2018-04-20 深圳市朗形网络科技有限公司 A kind of picture synthetic method and device
CN109712103A (en) * 2018-11-26 2019-05-03 深圳艺达文化传媒有限公司 From the eyes processing method and Related product of the Thunder God picture that shoots the video
CN109978655A (en) * 2019-01-14 2019-07-05 明灏科技(北京)有限公司 A kind of virtual frame matching method and system
CN110349269A (en) * 2019-05-21 2019-10-18 珠海随变科技有限公司 A kind of target wear try-in method and system
CN110533775A (en) * 2019-09-18 2019-12-03 广州智美科技有限公司 A kind of glasses matching process, device and terminal based on 3D face
CN110533775B (en) * 2019-09-18 2023-04-18 广州智美科技有限公司 Glasses matching method and device based on 3D face and terminal

Also Published As

Publication number Publication date
CN103413118B (en) 2019-02-22

Similar Documents

Publication Publication Date Title
CN103413118A (en) On-line glasses try-on method
CN114730101B (en) System and method for adjusting inventory eyeglass frames using 3D scanning of facial features
US11428960B2 (en) Method and system to create custom, user-specific eyewear
US20180268458A1 (en) Automated recommendation and virtualization systems and methods for e-commerce
KR20040097200A (en) System and Method for 3-Dimension Simulation of Glasses
CN106157360A (en) A kind of three-dimensional modeling method based on dual camera and device
CN105809507A (en) Virtualized wearing method and virtualized wearing apparatus
US20110071804A1 (en) Method And The Associated Mechanism For 3-D Simulation Stored-Image Database-Driven Spectacle Frame Fitting Services Over Public Network
CN105678391A (en) Multiple-reference based system and method for ordering eyeglasses
CN108898460A (en) Virtual fit method and device
KR102167109B1 (en) Method for providing online glasses selling service
CN103690171A (en) Glasses measuring and matching device, glasses measuring and matching server and glasses measuring and matching method
WO2015172229A1 (en) Virtual mirror systems and methods
WO2014030163A1 (en) Garment and accessories fitting
CN109829794A (en) A kind of virtual fit method and virtual fitting system based on mobile terminal
JP2024531840A (en) SYSTEM AND METHOD FOR DIGITAL MEASUREMENT OF AN OBJECT - Patent application
CN109393614A (en) A kind of software tool for dimensional measurement of cutting the garment according to the figure

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C53 Correction of patent of invention or patent application
CB03 Change of inventor or designer information

Inventor after: Bi Sheng

Inventor before: Bi Sheng

Inventor before: Li Yong

COR Change of bibliographic data

Free format text: CORRECT: INVENTOR; FROM: BI SHENG LI YONG TO: BI SHENG

C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20201224

Address after: Building 8, No.1, hagongda Road, Tangjiawan Town, Zhuhai City, Guangdong Province

Patentee after: ZHUHAI SUIBIAN TECHNOLOGY Co.,Ltd.

Address before: 100016 Room 301, unit 4, building 10, no.6, North East Fourth Ring Road, Chaoyang District, Beijing

Patentee before: Bi Sheng

CP03 Change of name, title or address
CP03 Change of name, title or address

Address after: 519080 Building 8, No.1, Harbin Institute of technology, Tangjiawan Town, Zhuhai City, Guangdong Province

Patentee after: Zhuhai necessary Industrial Technology Co.,Ltd.

Address before: Building 8, No.1, hagongda Road, Tangjiawan Town, Zhuhai City, Guangdong Province

Patentee before: ZHUHAI SUIBIAN TECHNOLOGY Co.,Ltd.