CN112669100A - Interactive glasses frame fitting system and method - Google Patents
Interactive glasses frame fitting system and method Download PDFInfo
- Publication number
- CN112669100A CN112669100A CN201910978954.2A CN201910978954A CN112669100A CN 112669100 A CN112669100 A CN 112669100A CN 201910978954 A CN201910978954 A CN 201910978954A CN 112669100 A CN112669100 A CN 112669100A
- Authority
- CN
- China
- Prior art keywords
- module
- frame
- image
- glasses
- augmented reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides an interactive glasses frame try-on system and method, which combines the portrait of a consumer with the images of various glasses frames by utilizing an augmented reality module, so that the consumer can directly see the effect of trying on the glasses frames on a display device to determine which glasses frame to choose, and then inform service personnel of the glasses frame expected to be chosen, thereby enabling the consumer to try on various different glasses frames as much as possible.
Description
Technical Field
The present invention relates to a system and a method for trying on a spectacle frame, and more particularly, to a system and a method for trying on a spectacle frame in an interactive manner by selecting different combinations of a spectacle frame and a portrait using augmented reality.
Background
With the progress of society, people have an increasing trend of reading books and watching video programs, people with myopia and astigmatism have more and more people, and people with presbyopia have a considerable proportion of the people with myopia and astigmatism as the ages, so that glasses required for vision correction gradually become a necessity. Because the glasses are worn on the face, in addition to the comfort of wearing the glasses, the aesthetic design of the glasses and the matching of the aesthetic design and the contour of the face, even the matching of the aesthetic design and the wearing of the glasses become a part of the wearing style of people.
The traditional glasses row usually can arrange a plurality of types of glasses frames in a show window, and is provided with glasses, a consumer selects a favorite glasses frame from the glasses frames arranged in the show window firstly, and informs a service worker, the service worker takes the glasses frame out of the show window and hands the glasses frame to the consumer, the consumer wears the glasses frame in front of the mirrors, and the consumer watches whether the overall appearance of the glasses frame matched with the face and the wearing of the glasses frame is satisfactory or not by watching images reflected by the mirrors, and feels whether the glasses frame is comfortable or not by actually matching the glasses frame.
However, in the above-mentioned traditional glasses fitting manner, the service staff must take out the glasses frames from the show window one by one and deliver them to the customer, and the customer then fits in front of the mirror one by one, which is a very tedious process, in such a cumbersome process, the interest of the customer in purchasing will be gradually reduced, and the customer must physically fit the glasses frames to experience the comfort.
Disclosure of Invention
In view of the above, the present invention provides an interactive glasses frame try-on system and method, which utilizes an augmented reality module to combine the portrait of the consumer with the images of various glasses frames, so that the consumer can directly see the effect of trying on the glasses frames on the display device to determine which glasses frame to choose, and then inform the service staff of the glasses frame desired to be chosen, thereby allowing the consumer to try on various glasses frames as desired. The interactive glasses frame try-on system can use a plurality of face capturing lenses to capture the characteristics of all parts of the face of the consumer, calculate the optimal glasses frame size of the consumer according to the characteristics of all parts, select the glasses frame size, and know the preference of the consumer by judging the facial expression of the consumer when trying on, so that one or more optimal glasses frames are selected from the database and recommended to the consumer.
An embodiment of the interactive glasses frame fitting system of the invention comprises an image interactive unit and a service unit, wherein the service unit is in signal connection with the image interactive unit. The image interaction unit can interact with consumers, and the remote service unit provides operation and information required by the image interaction unit. The image interaction unit includes: an image capturing device, a display device and a host device. The image capturing device comprises at least one lens and is used for capturing an image of a specific area and generating an image signal; the display device is used for simultaneously displaying a plurality of frames; the host device is in signal connection with the image acquisition device and the display device and comprises an image receiving and storing module and a webpage display module, the image receiving and storing module is in signal connection with the image acquisition device, receives the image signal and stores the image signal to form image data, and the webpage display module is in signal connection with the display device and transmits at least one webpage data to the display device for display. The service unit comprises a first service device and a second service device. The first service device is in signal connection with the host device and comprises an image identification module and an enhanced reality generation module; the image identification module is in signal connection with the image receiving and storing module, receives and identifies the image data, and correspondingly generates a portrait object if the image data is identified to contain a portrait; the augmented reality generating module is in signal connection with the image identifying unit and receives the portrait object to generate augmented reality webpage data, and the augmented reality webpage data are transmitted to the webpage display module of the host device. The second service device is in signal connection with the host device and the first service device and comprises a display interface switching module, an eyeglass frame database module and an eyeglass frame selecting module; the display interface switching module is in signal connection with the data receiving and transmitting module of the host device and is used for switching between a standby interface and a trial interface; the spectacle frame database module is connected with the first service device in a signal mode and stores a plurality of spectacle frame codes; the spectacle frame selection module is in signal connection with the spectacle frame database module and is used for receiving a selection signal and selecting a spectacle frame code from the spectacle frame database module according to the selection signal; when the image identification module of the first service device generates the portrait object, the first service device transmits a control signal to the second service device, so that the display interface switching module is switched to the fitting interface from the standby interface, the first service device obtains the glasses frame substitute code selected by the glasses frame code selecting unit of the second service device, the augmented reality generating module generates a corresponding glasses frame object according to the glasses frame code, adds the glasses frame object into the augmented reality webpage data, and enables the glasses frame object to be overlapped with the portrait object.
An embodiment of the interactive eyeglass frame fitting method of the present invention comprises the following steps: capturing an area image; identifying the area image; if the area image is identified to contain a portrait, displaying an augmented reality frame and generating a portrait object, wherein the augmented reality frame contains the portrait object; selecting at least one spectacle frame image from a plurality of spectacle frame images, and correspondingly generating a spectacle frame object; adding the glasses frame object into the augmented reality frame and superposing the glasses frame object on the human face object; and storing the portrait item and the glasses frame item.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a system block diagram of one embodiment of an interactive eyeglass frame fitting system of the present invention;
FIG. 2 is a view of the display device of the interactive eyewear frame fitting system of FIG. 1 in a standby mode;
FIG. 3 is a view of the interactive eyeglass frame fitting system of FIG. 1 in a fitting mode, showing a display device;
FIG. 4 is a flowchart of an interactive eyeglass frame fitting method according to an embodiment of the present invention;
FIG. 5 is a schematic diagram illustrating a transition from a standby interface to a try-on interface in the interactive eyeglass frame try-on method of the present invention;
FIG. 6a is a schematic diagram of a consumer selecting a spectacle frame with a touch display according to the interactive spectacle frame fitting method of the present invention;
FIG. 6b is a schematic diagram of a consumer selecting a spectacle frame with a mobile device in the interactive spectacle frame fitting method according to the present invention;
FIG. 7a is a schematic diagram illustrating an analysis of a behavior of an eyeglass frame selected by a consumer in an interactive eyeglass frame fitting method according to the present invention;
FIG. 7b is a schematic diagram illustrating statistics of glasses frames selected by a consumer in the interactive glasses frame try-on method according to the present invention;
fig. 8 is a system block diagram of another embodiment of an interactive eyeglass frame fitting system of the present invention.
Detailed Description
Please refer to fig. 1, which illustrates an embodiment of an interactive eyeglass frame fitting system according to the present invention. The interactive glasses frame fitting system 100 of the present invention includes an image interaction unit 10 and a service unit 20. The image interaction unit 10 can display information to the consumer and accept the information input by the consumer, thereby generating an interactive function with the consumer. The service unit 20 provides operations or data required for the image interaction unit 10 to display information. The following are described separately.
The image interaction unit 10 includes an image capturing device 11, a display device 12 and a host device 13. The image capturing device 11 and the display device 12 may be disposed in, for example, a department of the department of retail of the glasses company, the image capturing device 11 includes an image capturing lens 111, the image capturing lens 111 may be fixed to face a region in the space to continuously capture images of the region, and the display device 12 may simultaneously display a plurality of frames. In the present embodiment, in order to facilitate interaction with the consumer, the image capturing lens 111 of the image capturing device 11 can detect whether the consumer stays in front of the display device 12, so the area may be an area in front of the display device 12, such as an area in a glasses row room for the consumer to try on or an area outside the glasses row room, like a corridor. The display device 12 may be a large-sized liquid crystal display screen, such as a 42-inch or more liquid crystal display screen, and the display device 12 may be arranged vertically or horizontally, depending on the requirement, in this embodiment, the display device 12 is arranged vertically.
The host device 13 is connected to the image capturing device 11 and the display device 12, and the host device 13 includes an image receiving and storing module 131 and a web page display module 132. The host device 13 further includes a host control module 133, a host data transceiver module 134, and a touch module 135. The image receiving and storing module 131 is connected to the image capturing device 11, and the image signal captured by the image capturing device 11 is transmitted to the image receiving and storing module 131 and stored in the image receiving and storing module 131 to be image data. The web page display module 32 is in signal connection with the display device 12, and the web page display module 132 can receive the web page data, generate a picture, and transmit the picture to the display device 12 for display. The image receiving and storing module 131 and the web page display module 132 are both connected to the host control module 133 through signals, the host control module 133 is connected to the host data transceiver module 134 through signals, the image data in the image receiving and storing module 131 can be read by the host control module 133 and then transmitted to the outside through the host data transceiver module 134, and the web page data from the external server can also be received by the host data transceiver module 134 and then transmitted to the web page display module 132 through the host control module 133. If the display device 12 is a touch display device, the touch module 135 receives a selection signal from the display device 12, the selection signal can be generated by the sensing element of the display device 12 after the consumer presses the frame image displayed on the display device 12, and the host control module 133 transmits the selection signal to the outside through the host data transceiver module 134.
The service unit 20 comprises a first service device 21 and a second service device 22, the first service device 21 generates the augmented reality, and the second service device 22 provides data related to the glasses frame and can analyze the facial features of the consumer to recommend the most suitable glasses frame.
The first service device 21 is signally connected to the host device 30. In the embodiment, the first service device 21 is connected to the host device 30 via the network N, for example, a website (URL) of the first service device 21 is stored in the host device 30, and the host device 30 can receive the web page data provided by the first service device 21 by connecting to the website of the first service device 21. The first service device 21 includes an image recognition module 211 and an augmented reality generation module 212. The first service device 21 further includes a first control module 213 and a first data transceiver module 214. The image recognition module 211 and the augmented reality generating module 212 are in signal connection with the first control module 213, and the first control module 213 is in signal connection with the first data transceiving module 214.
The image recognition module 211 is connected to the image receiving and storing module 131 of the host device 13 by signals, as mentioned above, the image capturing lens 111 of the image capturing device 11 continuously captures the image of the specific area, and transmits the captured image to the image receiving and storing module 131 to be stored as image data, the image data is transmitted to the first service device 21 via the network N, and is transmitted to the image recognition module 211 by the first control module 213 after being received by the first data transceiving module 214, the image recognition module 211 recognizes the image data, if the image data is recognized to include a portrait, a portrait object is correspondingly generated, the augmented reality generation module 212 receives the portrait object via the first control module 213 to generate augmented reality webpage data, the augmented reality webpage data is transmitted to the webpage display module 132 of the host device 13, the web page display module 132 displays the augmented reality web page on the display device 12.
The second service device 22 is connected to the host device 13 and the first service device 21 by signals, and in the embodiment, the second service device 22 is connected to the host device 13 and the first service device 21 via the network N. The second service device 22 includes a display interface switching module 221, a spectacle frame database module 222 and a spectacle frame selecting module 223. The second service device 22 further includes a second control module 224 and a second data transceiver module 225. The second control module 224 is in signal connection with the display interface switching module 221 and the glasses frame selecting module 223, and the glasses frame selecting module 223 is in signal connection with the glasses frame database module 222.
The display interface switching module 221 is connected to the host control module 133 of the host device 13 and the image recognition module 211 of the first service device 21 by signals, if the image data is recognized by the image recognition module 211 to contain a portrait, the first control module 213 of the first service device 21 sends a control signal to the display interface switching module 221 of the second service device 22, at this time, if the interactive glasses frame fitting system 100 is in the standby mode (the interface displayed by the display device 12 is the standby interface), the display interface switching module 221 switches the standby mode to the fitting mode, and the display device 12 displays the fitting interface, and in addition, when the image data is not recognized by the image recognition module 211, the first control module 213 of the first service device 21 sends a control signal to the display interface switching module 221 of the second service device 22, the display interface switching module 221 switches the try-on mode back to the standby mode.
The eyeglass frame database module 222 stores a plurality of eyeglass frame codes, the eyeglass frame selection module 223 is in signal communication with the eyeglass frame database module 222 and is configured to receive a selection signal, such as the selection signal generated by the consumer pressing the display device 12 as described above, and the eyeglass frame selection module 223 selects an eyeglass frame code from the eyeglass frame database module 222 according to the selection signal.
The second service device 22 further includes an advertisement data providing module 226 and a glasses frame matching storage module 227. The advertisement data providing module 226 and the glasses frame matching storage module 227 are both in signal connection with the second control module 224, and the advertisement data providing module 226 provides advertisement web page data to the web page display module 32 of the host device 13. The eyeglass frame matching storage module 227 is used for storing the code of the eyeglass frame selected by the consumer and the portrait of the consumer.
When the interactive eyeglass frame try-on system 100 is in a standby state, the display interface switching module 221 switches the interface to a standby interface, and the standby interface displayed by the display device 12 is mainly an advertisement webpage. As shown in fig. 2, the screen of the standby interface is shown, and includes frames P1 to P4. The frame P1 may play an advertisement film, which may be a streaming advertisement film, the frame P2 may be a plurality of advertisement images played in a slide show, the frame P3 may be the operation instruction of the interactive eyeglass frame fitting system 100 of the present invention, and the frame S4 is a frame that normally displays the image of the area captured by the image capturing lens 111 of the image capturing device 11. The advertisement data providing module 226 provides the advertisement web page data to the web page display module 32 of the host device 13, and the web page display module 32 forms the advertisement web page data into an advertisement web page frame to be played in the frame P1 or P2 of the display device 12, and in another embodiment, the advertisement web page frame may also cover the area of the frame P1 or P2.
When a consumer enters the area shot by the image capturing lens 111 of the image capturing device 11, the image capturing lens 111 captures an image of the area, and transmits an image signal to the image receiving and storing module 131 for storage to become image data, the image data is transmitted to the image identifying module 211 of the first service device 21, after the image data is identified by the image identifying module 211, the image data identifies that the image of the area has a portrait, then the first control module 213 sends a control signal to the display interface switching module 221 of the second service device 22, the display interface switching module 221 switches the standby interface to a fitting interface, and generates a portrait object according to the identified portrait, and the portrait object is fused in augmented reality.
The frame W1 is an instruction for the interactive glasses frame try-on system 100 of the present invention, the frame W2 plays advertisement web pages or movies, the frame W3 plays augmented reality web pages, the frame W3 can embed the augmented reality web page frame in the frame by using an embedded frame (i-frame), the frame W4 plays web pages browsed and selected by the glasses frame, and the frame W5 displays an operation instruction for switching the glasses frame and quick response matrix code (QR code) that can be read by the mobile device, where the QR code corresponds to the website of the first service device 21.
Therefore, the consumer can see his/her image on the augmented reality web page, and in the case that the display device 12 is a touch display device, the user can select the glasses frame desired to try on in the frame W4 through a touch component (selection device) of the touch display device, such as a touch panel. When the glasses frame desired to be tried is selected, the selection signal is transmitted from the touch module 135 to the second service device 22, the glasses frame selection module 223 of the second service device 22 reads the corresponding glasses frame code from the glasses frame database module 222 according to the selection signal and transmits the corresponding glasses frame code to the augmented reality generation module 212 of the first service device 21, the augmented reality generation module 212 integrates the image of the selected glasses frame into the augmented reality web page and superimposes the image on the portrait object, so that the consumer can see the image of the selected glasses frame worn by the head portrait of the consumer from the frame W3.
In another embodiment, the mobile device M reads the quick response matrix map code in the frame W5 to connect to the augmented reality generating module 212 of the first service device 21, a plurality of images of the glasses frames appear on the touch screen of the mobile device M, after the consumer selects the glasses frame desired to try on, the mobile device M (selecting device) sends a selection signal to the second service device 22 via the network N, and the glasses frame selecting module 223 reads the corresponding glasses frame code from the glasses frame database module 222 according to the selection signal.
After the frame selection module 223 reads the frame code from the frame database module 222, the frame code may be stored in a temporary memory module, the augmented reality generation module 212 of the first service device 21 sends a request for obtaining the frame code to the second service device 22 at a predetermined time interval, for example, the augmented reality generation module 21 sends a request for obtaining the frame code every 1 second, and the second service device 22 receives the request and transmits the frame code in the temporary memory module to the augmented reality generation module 212 of the first service device 21, so as to generate a picture that the corresponding frame is superimposed on the portrait. When the customer selects another pair of glasses frames, the glasses frame selecting module 223 reads the corresponding glasses frame code from the glasses frame database module 222 and stores the corresponding glasses frame code in the temporary memory module instead of the previous pair of glasses frame codes, so that when the augmented reality generating module 212 of the first service device 21 sends a request to the second service device 22 and obtains the current glasses frame code, the augmented reality generating module 212 determines whether the glasses frame code is changed, if so, the augmented reality generating module 212 adds the corresponding glasses frame object to the augmented reality according to the obtained glasses frame code, and the customer can see on the frame W3 that the selected glasses frame is superimposed on his/her image.
When the consumer leaves the area in front of the display device 12, that is, after the consumer leaves the area of the image captured by the image capturing lens 111 of the image capturing device 11, the image captured by the image capturing lens 111 is transmitted to the image recognition module 211 of the first service device 21, and after the image recognition module 211 recognizes the image, it is determined that the image does not have a human image, the first control module 213 sends a control signal to the display interface switching module 221 of the second service device 22, the display interface switching module 221 switches the try-on interface back to the standby interface, and the image displayed by the display device 12 is switched from the image displayed in fig. 3 back to the image displayed in fig. 2.
In addition to the above-mentioned selection of the glasses frame desired to be tried on the display device 12 or the mobile device M by the consumer and the display of the result after the trial wearing on the display device 12, the interactive glasses frame try-on system 100 of the present invention can also recommend an appropriate glasses frame to the consumer according to the face shape and the preference of the consumer, and the related devices and functions are described in detail below.
The image capturing device 11 further includes a plurality of face capturing lenses 112, and the face capturing lenses 112 are connected to the image receiving and storing module 131 in a signal manner. The face capturing lenses 112 are arranged to capture features of a face from different angles, in this embodiment, the face capturing lenses 112 are arranged in a circular arc shape, for example, the face capturing lenses 112 are disposed on a plastic frame or an iron frame, so that the face capturing lenses 112 are about 15 cm away from the consumer and are arranged in a semicircular shape from the left ear to the right ear of the consumer, and images of different parts of the face are captured from different angles through the face capturing lenses 112.
In addition, after the face capturing lens 112 determines that the area image captured by the image capturing lens 111 has a human image according to the recognition result of the image recognition module 211 of the first service device 21, the first control module 213 sends a control signal to the host control module 133 of the host device 13, the host control module 133 starts the face capturing lens 112, and the plurality of face images captured by the face capturing lens 112 are transmitted to the image receiving and storing module 131.
The second server 22 further comprises a facial feature measurement module 228 and a data analysis module 229. The facial feature measurement module 228 and the data analysis module 229 are in signal communication with the second control module 224.
The plurality of face images are transmitted from the image receiving and storing module 131 to the facial feature measuring module 228. The facial feature measurement module 228 can obtain a three-dimensional image of the face of the consumer by using the images captured by the face capture lenses 112, and obtain the size of each part of the face of the consumer. The size of each part of the consumer's face is transmitted to the data analysis module 229, and then the data analysis module 229 obtains the size of the glasses frame suitable for consumption through a proper operation formula. For example, the relationship between the size of the eyeglass frame and the size of the facial features described in application No. 106118167 filed by the inventor of the present invention is as follows:
calculation formula regarding the width of the eyeglass frame:
P＝-1.036X2+23.365X-2.089Y+Z±5
wherein, P is the width (mm) of the spectacle frame; x is the bridge height (mm) of the nose of the user; y is the user's nose bridge width (mm); z is the user's eye-ear distance (mm));
formula for calculating the angle of the nose pad:
M＝180-Q＝180-Tan-1(X/(Y/2))
wherein M represents a nose pad angle (°); y represents the width of the nose bridge (mm); x represents nasal bridge height (mm): q represents nose bridge inclination (°);
formula for calculating the temple length of the eyeglass frame:
R＝Z+13+F
wherein Z represents an eye-ear distance (mm); r represents temple length (mm); f represents an upper limit value (mm) and a lower limit value (mm), and is generally in the range of 0 to 40 mm.
After the data analysis module 229 calculates the optimal eyeglass frame size, the eyeglass frame selection module 223 selects one or more eyeglass frames suitable for the consumer from the eyeglass frame code database 222 according to the calculated eyeglass frame size and displays the selected eyeglass frames on the display device 12 or the mobile device M of the consumer to recommend the consumer to make a selection, and after the consumer selects the selected eyeglass frame, the eyeglass frame selection module 223 transmits the selected eyeglass frame code to the augmented reality generation module 212 of the first service device 21 to integrate the corresponding eyeglass frame object into the augmented reality image.
In addition, the display device 12 may also be provided with a speaker, when the consumer enters the area in front of the display device 12, and the image captured by the image capturing lens 111 of the capturing device 11 is recognized to have a portrait, the host device 13 provides voice guidance, and the voice guidance is emitted by the speaker of the display device 12, so as to attract the consumer to approach the display device 12, and the consumer can walk to a specific position through the voice guidance, so that the face capturing lens 112 can accurately capture the image of each part of the face.
In another embodiment, a start button may be disposed beside the display device 12 or a start image may be disposed directly on the display device 12 (touch display). When the consumer enters the area in front of the display device 12, the display device 12 still displays the standby interface, and the display device 12 is not switched to the fitting interface until the consumer presses the start button or touches the start image.
Since the interactive eyeglass frame try-on system 100 of the present invention has a plurality of face capturing lenses 112 and captures images of the face from different angles, the real size of each part of the face of the consumer can be obtained, and then the size of each part of the eyeglass frame can be calculated according to the real size of each part of the face by the above formulas.
In addition to providing the face capturing lenses 112 in front of the display device 12, in another embodiment, the consumer can also use the camera lens of the mobile device M, for example, the front lens of the smart phone, to capture the image of the face of the consumer at different angles, for example, the image is captured right in front of the face and at the positions of 30 degrees and 60 degrees on both sides of the face and right in front of the face, and transmit the captured image to the face feature measuring module 228 of the second service device 22 via the network N, as mentioned above, the image captured by the mobile device M is synthesized into a three-dimensional image by the face feature measuring module 228 and the data analyzing module 229 calculates the preferred size of the glasses frame according to the above formulas.
In addition, the data analysis module 229 analyzes the facial expression of the consumer with respect to the image obtained by the facial feature measurement module 228. When the consumer views the screen of the try-on glasses frame displayed by the display device 12, the likes and dislikes of the result of the try-on are expressed in facial expressions, so the face capture lens 112 continuously captures the facial images of the consumer, and the facial feature measurement module 228 synthesizes three-dimensional images, and then the data analysis module 229 analyzes the facial images to determine the expressions of the consumer, such as smiling, satisfaction, strangeness, disappointment, etc. In addition, the data analysis module 229 also analyzes the eyeglass frame selected by the multi-digit consumer and stored in the eyeglass frame collocation storing module 227 and uses the analyzed eyeglass frame as the experience value of the recommended eyeglass frame.
The data analysis module 229 may determine the age and sex of the consumer based on the face image, and may determine which family the consumer belongs to based on the clothing in the image, such as office workers or students, or determine the consumption habit based on the clothing or accessories, such as pursuing fashion or giving priority to practical use. The data after each determination is stored, and the big data analysis can obtain various empirical values, and the data analysis module 229 can learn to increase the accuracy of the determination, so the data analysis module 229 can be an artificial intelligence system. When a consumer's image appears, the data analysis module 229 may analyze the image and obtain feature values, such as the height of the nose bridge, the width of the nose bridge, the distance between the eyes and ears, or the age range, or the consumption habit, for various human features, after comprehensively judging the various feature values, and after learning according to the big data of the mass data, it may directly make the most accurate judgment to recommend one or more glasses frames suitable for the consumer.
Please refer to fig. 4, which illustrates an embodiment of the interactive eyeglass frame fitting method according to the present invention.
In step S1, an area image is captured, for example, as shown in fig. 1, the area in front of the display device 12 is captured by the image capturing lens 111 of the image capturing device 11. The process then proceeds to step S2.
In step S2, the area image is recognized and determined whether the area image includes a portrait, for example, as shown in fig. 1, the area image is transmitted to the image recognition module 211 of the first service device 21 for recognition, and according to the recognition result, if the area image does not include a portrait, the process returns to step S1, and if the area image includes a portrait, the process proceeds to step S3.
In step S3, an augmented reality frame including the portrait object is displayed and a portrait object is generated, for example, as shown in fig. 1, the augmented reality generating module 212 of the first service device 21 generates augmented reality web page data and displays an augmented reality web page by using an embedded frame (i-frame), the portrait of the consumer is integrated in the augmented reality web page, please refer to fig. 5, when the region image captured by the image capturing lens 111 includes a portrait, the frame of the display device 12 is switched from the frame shown in fig. 2 to the frame shown in fig. 3, the augmented reality generating module 212 generates an augmented reality frame W3, and the frame selecting module 223 generates the frame W4. Then, the process proceeds to step S4.
In step S4, at least one frame image is selected from the plurality of frame images and a corresponding frame object is generated, for example, the frame selection module 223 of the second service device 22 generates a frame web page data, which includes a plurality of frame images and is displayed in the frame W4 of the display device 12 in fig. 3. The consumer can select one of the glasses frames, and the augmented reality generating module 212 integrates the selected glasses frame image into the augmented reality webpage and superimposes the image on the portrait to generate the try-on effect. Then, the process proceeds to step S5.
In step S5, the portrait item and the glasses frame item are stored. When the customer is satisfied with the fitting result, the frame code and the image of the customer can be stored in the eyeglass frame collocation storage module 227, and then the process goes to step S6.
In step S6, the face feature of the person in the captured area image is calculated, and the eyeglass frame most suitable for the consumer is calculated from the relationship between the eyeglass frame size and the face feature size described in application No. 106118167 filed by the inventor of the present invention. The process then proceeds to step S7.
In step S7, the display device 12 displays the eyeglass frame most suitable for the consumer, for example, directly displays the image of the eyeglass frame most suitable for the consumer, and displays the image as a text on the eyeglass frame most suitable for the consumer.
Referring to fig. 6a and 6b, in step S4, at least one frame image is selected from the plurality of frame images, and the frame can be selected by the display device 12 or the mobile device M. As shown in fig. 6a, when the display device 12 is a touch display, the glasses frame selecting module 223 generates a glasses frame selecting web page, and the glasses frame selecting web page is displayed on the display device 12, the glasses frame selecting web page may include images of the glasses frames arranged in a row, a line or an array, an image scrolling up and down or left and right may be set on the glasses frame selecting web page, a consumer may scroll the glasses frame image left and right or up and down by operating the image scrolling up and down or left and right, and the glasses frame selecting web page explicitly marks the glasses frame image to be selected currently, for example, the glasses frame image to be selected currently is amplified or added with a frame.
The consumer may use his/her own mobile device M as a remote controller for selecting the glasses frame, and fig. 6b shows a process of selecting the glasses frame by using the mobile device M. The quick response matrix code is displayed on the screen displayed on the display device 12, and the consumer can scan the displayed quick response matrix code on the screen using the mobile device M of the consumer and thereby connect to the eyeglass frame selection web page, and the consumer can select a desired eyeglass frame on the mobile device M.
In addition, as shown in fig. 7a, when the consumer tries on the glasses frame, the information of trying on the glasses by the consumer can be collected at the same time, for example, which glasses frame the consumer of certain face shape prefers, facial features can be obtained from calculation and analysis of the portrait, and then a better combination of the face shape and the glasses frame matching can be analyzed by matching with the shape of the glasses frame selected by the consumer, and when the consumer with the face shape appears, the system can directly recommend the better glasses frame to the consumer. After a plurality of consumers use the interactive glasses frame try-on system, the interactive glasses frame try-on system can collect massive try-on information, various patterns of the consumers matched with the glasses frames can be obtained from the try-on information, learning and prediction can be performed, and for consumers who are less contacted with the interactive glasses frame try-on system or consumers who are not contacted with the interactive glasses frame try-on system, the interactive glasses frame try-on system can also make more correct judgment through experience values learned by the massive try-on information so as to recommend a proper glasses frame.
As shown in fig. 7b, the interactive glasses frame try-on system of the present invention can also analyze the selection information of the glasses frame, analyze the number of times that various glasses frames are selected for try-on, and obtain the information of the preference degree of each glasses frame by the consumer.
Please refer to fig. 8, which illustrates another embodiment of the interactive eyeglass frame fitting system of the present invention. The structure of the interactive eyeglass frame fitting system 100' of the present embodiment is substantially the same as that of the embodiment shown in fig. 1, and therefore the same elements are given the same symbols and description thereof is omitted. In the present embodiment, the image interaction unit 10' is a mobile device such as a smart phone or a tablet computer as a whole, the host device 13 is a motherboard of the mobile device, the display device 12 is a screen of the mobile device, and the image capturing device 11 only has an image capturing lens 111, which is a photographing lens of the mobile device.
The user can install the application program for trying on the glasses frame in the mobile device. When a user wants to try on the glasses frame, after the application program of the glasses frame is started, the user's portrait is directly captured by the camera of the mobile device, the captured portrait is transmitted to the image receiving and storing module 131, and then transmitted to the augmented reality generating module 212 of the first service device 21 through the network N, after the augmented reality generating module 212 generates augmented reality web page data, the web page data is transmitted to the web page display module 132 of the image interaction unit 10 (mobile device) and displayed on the display device 12 (screen of the mobile device), if the screen of the mobile device is a touch screen, the user can use the touch module 135 to operate the image displayed on the display device 12 to select different glasses frames so as to match with the portrait for trying on the glasses frame. In addition, since the mobile device has only one lens, if the user wants to obtain three-dimensional data of the portrait, the application program trying on the glasses frame can guide the user to shoot the portrait from various angles so as to synthesize the three-dimensional portrait, for example, the application program can present a picture for guiding shooting, respectively guide the user to shoot the front, left 45 degree, left, right 45 degree and right side of the portrait, and then transmit the picture to the facial feature measuring module 228 of the second service device 22, measure the size of each feature of the user's face, and then analyze the picture through the data analysis module 229, and obtain the glasses frame most suitable for the user.
In addition to installing the application program for trying on the glasses frame directly on the mobile device, in another embodiment, the application program for trying on the glasses frame may be embedded in a software for execution, such as a social platform embedded with a facebook or a microblog. When the user browses the webpage of the community platform, the application program for trying on the glasses frame can be started in the webpage, then the application program captures the portrait of the user according to the method, selects the glasses frame or generates three-dimensional portrait data, and after analysis, the most suitable glasses frame is recommended to the user.
In summary, the present invention has been described with reference to the above embodiments, but the present invention is not limited to these embodiments. Those skilled in the art to which the invention pertains will readily appreciate that various modifications and adaptations can be made without departing from the spirit and scope of the invention; for example, the technical contents exemplified in the above embodiments are combined or changed to new embodiments, and such embodiments are also regarded as the contents of the present invention. Accordingly, the protection sought herein includes the claims set forth below and any claims that fall within the scope of the claims.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (10)
1. An interactive eyewear frame fitting system, comprising:
an image interaction unit, comprising:
the image capturing device comprises at least one image capturing lens, wherein the at least one image capturing lens faces a specific area, captures an image of the specific area and generates an image signal;
a display device which displays a plurality of frames simultaneously in a picture; and
the host device is in signal connection with the image acquisition device and the display device and comprises an image receiving and storing module and a webpage display module; the image receiving and storing module is connected with the image capturing device in a signal mode, receives the image signal and stores the image signal to form image data; the webpage display module is in signal connection with the display device and transmits at least one webpage data to the display device for display; and
a service unit, the signal is connected to the image interaction unit, the service unit includes:
the first service device is in signal connection with the host device and comprises an image identification module and an augmented reality generation module; the image identification module is in signal connection with the image receiving and storing module, receives and identifies the image data, and correspondingly generates a portrait object if the image data is identified to contain a portrait; the augmented reality generating module is in signal connection with the image identifying unit and receives the portrait object to generate augmented reality webpage data, and the augmented reality webpage data are transmitted to the webpage display module of the host device; and
the second service device is in signal connection with the host device and the first service device and comprises a display interface switching module, a spectacle frame database module and a spectacle frame selecting module; the display interface switching module is in signal connection with the host device and the first service device and switches between a standby interface and a try-on interface according to the identification result of the image data; the spectacle frame database module is connected with the first service device in a signal mode and stores a plurality of spectacle frame codes; the spectacle frame selection module is in signal connection with the spectacle frame database module and is used for receiving a selection signal and selecting a spectacle frame code from the spectacle frame database module according to the selection signal;
when the image recognition module of the first service device generates the portrait object, the first service device transmits a control signal to the second service device, so that the display interface switching module is switched from the standby interface to the fitting interface, the first service device obtains the glasses frame code selected by the glasses frame code selecting unit of the second service device, the augmented reality generation module generates a corresponding glasses frame object according to the glasses frame code, adds the glasses frame object into the augmented reality webpage data, and enables the glasses frame object to be superposed on the portrait object.
2. The interactive eyewear frame fitting system of claim 1, wherein the image interaction unit further comprises a selecting device in signal connection with the eyewear frame selecting module of the second service device, and configured to generate the selecting signal and transmit the selecting signal to the eyewear frame selecting module.
3. The system as claimed in claim 1, wherein the image interaction unit is a mobile device, the mobile device includes a motherboard, a screen and a camera lens, the motherboard is the motherboard, the display device is the screen, and the image capturing device is the camera lens.
4. The interactive eyeglass frame fitting system as claimed in claim 1, wherein the display device is a touch display, the selection device is a touch component, the touch component is disposed on the display device, the host device further comprises a touch module, the touch component is in signal connection with the touch module, and the touch module is in signal connection with the eyeglass frame selection module of the second service device.
5. The interactive eyewear frame fitting system of claim 2, wherein the second server further comprises an eyewear frame matching storage module in signal connection with the eyewear frame selection module, the selection device transmits a control signal to the second server, and the second server stores the eyewear frame code selected by the eyewear frame selection module and the portrait object in the eyewear frame matching storage module to form eyewear frame matching data.
6. The interactive eyeglass frame fitting system as claimed in claim 1 or 5, wherein the second service device further comprises an advertisement data providing module in signal connection with the web page display module of the host device, the advertisement data providing module transmitting advertisement web page data to the web page display module.
7. The interactive eyewear frame fitting system of claim 1, wherein the image capturing device comprises a plurality of face capturing lenses, the face capturing lenses are arranged to capture a face image from different angles to obtain a plurality of face image data, and the face capturing lenses are activated after the image recognition module of the first service device recognizes a face.
8. The interactive eyewear frame fitting system of claim 7, wherein the second server comprises a facial feature measurement module, the facial feature measurement module is connected to the image capturing device, receives the facial image data, and calculates a plurality of facial feature values, the facial feature values comprise a nose bridge height, a nose bridge width, and an eye-ear distance.
9. The interactive eyewear frame fitting system of claim 8, wherein the second server further comprises a data analysis module, the data analysis module is connected to the facial feature measurement module, the data analysis module receives and analyzes the facial feature values, sends a control signal to the eyewear frame selection module, selects an eyewear frame code from the eyewear frame code database, and transmits the eyewear frame code to the augmented reality generation module, and the augmented reality generation module adds an eyewear frame object corresponding to the eyewear frame code to the augmented reality web page data.
10. An interactive eyeglass frame fitting method, comprising:
capturing an area image;
identifying the area image;
if the area image is identified to contain a portrait, displaying an augmented reality frame and generating a portrait object, wherein the augmented reality frame contains the portrait object;
selecting at least one spectacle frame image from a plurality of spectacle frame images, and correspondingly generating a spectacle frame object;
adding the glasses frame object into the augmented reality frame and superposing the glasses frame object on the portrait object;
storing the portrait item and the eyeglass frame item;
calculating the facial features of the portrait and analyzing to obtain the most suitable glasses frame; and
displaying the most suitable glasses frame.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910978954.2A CN112669100A (en) | 2019-10-15 | 2019-10-15 | Interactive glasses frame fitting system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910978954.2A CN112669100A (en) | 2019-10-15 | 2019-10-15 | Interactive glasses frame fitting system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112669100A true CN112669100A (en) | 2021-04-16 |
Family
ID=75400076
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910978954.2A Pending CN112669100A (en) | 2019-10-15 | 2019-10-15 | Interactive glasses frame fitting system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112669100A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113674053A (en) * | 2021-08-13 | 2021-11-19 | 沈阳化工大学 | Virtual intelligent display system of try-on mask |
| CN114895747A (en) * | 2022-03-24 | 2022-08-12 | 青岛海信智慧生活科技股份有限公司 | Intelligent display device, glasses recommendation method, glasses recommendation device and media |
-
2019
- 2019-10-15 CN CN201910978954.2A patent/CN112669100A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113674053A (en) * | 2021-08-13 | 2021-11-19 | 沈阳化工大学 | Virtual intelligent display system of try-on mask |
| CN114895747A (en) * | 2022-03-24 | 2022-08-12 | 青岛海信智慧生活科技股份有限公司 | Intelligent display device, glasses recommendation method, glasses recommendation device and media |
| CN114895747B (en) * | 2022-03-24 | 2023-09-15 | 青岛海信智慧生活科技股份有限公司 | Intelligent display device, glasses recommendation method, device and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12130499B2 (en) | Systems and methods for previewing adjustments to stock eyewear frames using a 3D scan of facial features | |
| US10983368B2 (en) | Systems and methods for creating eyewear with multi-focal lenses | |
| JP6966443B2 (en) | Image display system, head-mounted display control device, its operation method and operation program | |
| US20180350148A1 (en) | Augmented reality display system for overlaying apparel and fitness information | |
| US20190228448A1 (en) | System, Platform and Method for Personalized Shopping Using a Virtual Shopping Assistant | |
| US9153074B2 (en) | Wearable augmented reality eyeglass communication device including mobile phone and mobile computing via virtual touch screen gesture control and neuron command | |
| US20240078584A1 (en) | System Platform and Method for Personalized Shopping Using an Automated Shopping Assistant | |
| CN111066051B (en) | System, platform and method for personalized shopping using automated shopping assistant | |
| US20180357670A1 (en) | Dynamically capturing, transmitting and displaying images based on real-time visual identification of object | |
| KR20160037074A (en) | Image display method of a apparatus with a switchable mirror and the apparatus | |
| CN105678391A (en) | Multiple-reference based system and method for ordering eyeglasses | |
| US20210110161A1 (en) | Interactive try-on system and method for eyeglass frame | |
| KR20180093721A (en) | Apparatus and Method for Displaying and advertisement Server | |
| US20160335615A1 (en) | Wearable display device for displaying progress of payment process associated with billing information on display unit and controlling method thereof | |
| CN112669100A (en) | Interactive glasses frame fitting system and method | |
| KR102340904B1 (en) | System and method for virtual fitting based on augument reality | |
| WO2012054983A1 (en) | Eyewear selection system | |
| KR102174053B1 (en) | A method for operating a glasses fitting system using a smart mirror | |
| CN113592592B (en) | Method for generating glasses frame fitting effect diagram and glasses frame virtual fitting system | |
| KR20220124052A (en) | Kiosk for Personalized Eyeglasses Guide and Method Thereof | |
| KR20220124053A (en) | Kiosk System for Eyeglasses Recommend Guide of Optical Store and Operation Method Thereof | |
| US20240242441A1 (en) | Fit prediction based on detection of metric features in image data | |
| US20240249477A1 (en) | Fit prediction based on feature detection in image data | |
| KR20150108560A (en) | Accessory recommending apparatus, control method thereof, computer readable medium having computer program recorded therefor and accessory recommending system | |
| KR20190127479A (en) | Method for Providing Augmented Glasses Service Based on Mobile Web |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20210416 |
|
| WD01 | Invention patent application deemed withdrawn after publication |