KR102174053B1 - A method for operating a glasses fitting system using a smart mirror - Google Patents

Abstract

Disclosed is a method of operating a spectacle fitting system using a smart mirror. To this end, the present invention provides the steps of preparing a glasses fitting system using a smart mirror, transmitting a first image captured by a camera to the first touch screen unit when a subject is identified in the smart mirror, and a first touch screen unit Preparing a second image by recognizing and editing a person's face in the subject of the first image by a computer program built into the first image, and a first spectacle fitting photo obtained by combining arbitrary glasses with the second image to the first screen unit. Outputting, and outputting, to the first screen unit, a second eyeglass fitting picture in which the similar glasses are synthesized in a second image when similar glasses displayed on the second touch screen unit are selected, and displayed on the second touch screen unit Provides a method of operating a spectacle fitting system using a smart mirror comprising the step of outputting a third spectacle fitting picture in which other similar spectacles are combined with a second image when other similar glasses are selected. According to the present invention, it is possible to increase the advertising effect and the customer's purchase will.

Description

{A method for operating a glasses fitting system using a smart mirror}

The present invention relates to a method of operating a spectacle fitting system, and more particularly, when a customer sees his or her appearance on a mirror exposed to the outside, the customer displays the appearance of fitting glasses It relates to a method of operating a virtual glasses fitting system using a smart mirror that can increase the willingness to purchase glasses.

The radical development of computer and communication technologies has brought great changes to human society. Along with this, with the advent of various computers, such as portable notebooks, tablet computers, and smart phones, the various equipment used in opticians is more effective in combination with the Internet and intelligent software that can move the equipment more efficiently. It is evolving in the direction of diversification/multifunctionalization.

Glasses are becoming fashion like clothes and accessories, and are recognized as a part of fashion that creates individuality. Depending on what material and design they wear, they play an important role in making people think about their fashion sense and personality.

When choosing glasses, consider the optical and cosmetic aspects of the glasses. When wearing glasses, it is the optical aspect that complements human vision to ensure normal vision and enables daily life without discomfort.In terms of optical, the opinion of experts such as opticians rather than the opinion of general eyeglass buyers It has a greater impact. In other words, in the case of the selection of lenses reflecting the frequency of glasses by measuring acuity, the weight of the glasses, etc., it is necessary to select according to an accurate prescription by a specialist rather than a consumer's preference.

However, in terms of beauty, the choice of the shape of the eyeglass frame according to the consumer's face shape and the color of the lenses of the sunglasses can be selected by the consumer by receiving expert advice. Conventionally, eyeglass buyers went to an optician to try on their own glasses, and received advice from experts such as an optician to choose glasses that fit their face shape.

Meanwhile, internet shopping is increasing due to the recent increase in electronic commerce through the internet. In this case, there is a limitation in that the consumer has to purchase only by looking at the catalog or appearance of the product he wants to buy. In particular, when the product to be purchased is sensitive to a person's body and body shape, it is difficult to purchase the product that a consumer wants through conventional internet shopping. Therefore, there is a need for a method in which consumers choose the product that best suits them after putting the product they want to purchase on their body.

In particular, in the case of glasses, online sales through the Internet or the like have many difficulties in providing an environment in which consumers can select glasses that suit themselves well. Unlike in the case of clothing, accessories, and hats, glasses can be viewed as a medical device to protect human vision in addition to cosmetic aspects such as fashion, so it is difficult to sell online by choosing glasses by consumers without the help of experts. Do.

Along with this, the current method, in which consumers must visit an optician directly and try on the glasses they want to purchase, and then select the glasses that best suit them, still has a lot of room for improvement.

The problem to be achieved by the technical idea of the present invention is that when a customer sees himself through a virtual eyeglass fitting system exposed to the outside, an arbitrary eyeglass fit is displayed, allowing the customer to purchase glasses. It is to provide a method of operating a virtual glasses fitting system using a smart mirror that can increase purchase motivation.

An operating method of a glasses fitting system using a smart mirror according to an embodiment of the inventive concept includes a smart mirror capable of showing a subject and a smart mirror unit having a camera capable of photographing the subject near the smart mirror, A second touch screen in which a first touch screen unit capable of fitting and outputting glasses to a person's face from the captured image, and a menu screen capable of changing the shape of glasses among images of the first touch screen unit are prepared Preparing a glasses fitting system using a smart mirror having a unit, transmitting a first image captured by the camera to the first touch screen unit when a subject is identified in the smart mirror, and the first touch screen unit Recognizing a face of a person in the subject of the first image by a computer program built into the device, and preparing a second image that can be synthesized by arbitrary glasses by editing the face recognized in the first image to a predetermined size. The computer program embedded in the first touch screen unit outputs, to the first screen unit, a first spectacle fitting picture obtained by synthesizing arbitrary glasses with the second image, and displayed on the second touch screen unit When similar glasses are selected, outputting a second glasses fitting picture in which the similar glasses are combined with the second image to the first screen unit, and when other similar glasses displayed on the second touch screen are selected, the second image And outputting, to the first screen unit, a photo of a third spectacle fitting in which the other similar spectacles are synthesized.

According to an embodiment of the present invention, it is suitable to use a motion detection sensor installed near the smart mirror as a method of identifying a subject in the smart mirror.

Preferably, after the step of outputting the second glasses fitting photo or the third glasses fitting photo to the first screen unit, when a prescription reflecting menu displayed on the second touch screen unit is selected, a prescription is applied to the second touch screen unit. Displaying a selection menu, and when a specific prescription is selected from the displayed prescription selection menu, modifying the second eyeglass fitting picture or the third eyeglass fitting picture according to the specific prescription in a computer program embedded in the first touch screen unit Steps and outputting the corrected second or third glasses fitting photo to the first touch screen may be further performed.

Meanwhile, the first touch screen unit may further include an auxiliary display screen displaying a plurality of screens in which various types of similar glasses are fitted to the second image.

Therefore, according to the above-described technical idea of the present invention, since the customer can individually fit the virtual glasses to suit their appearance or fashion style without the help of an optician, eye-related products, such as glasses, color lenses and sunglasses It can contribute to the sales promotion of the optician by raising the willingness to purchase the back.

In addition, since the customer alone can virtually perform the fitting of his or her own glasses reflecting the prescription, there is an advantage of being able to check the appearance of his or her own glasses even before the prescription is made.

In addition, since the time when there is no person in the smart mirror can be recognized by the motion detection sensor and the advertisement screen can be displayed through the first touch screen part of the eyeglass fitting system through this free time, it plays the role of an excellent billboard outside the optician. Can be done.

1 is a schematic front view of a glasses fitting system using a smart mirror according to a preferred embodiment of the present invention.
FIG. 2 is a front view illustrating a first touch screen part and a second touch screen part of a glasses fitting system using a smart mirror according to an embodiment of the present invention.
3 is a flowchart for explaining a method of operating a glasses fitting system using a smart mirror according to a preferred embodiment of the present invention.
FIG. 4 is a flowchart illustrating an operating method in which a prescription menu is reflected among the operating method of the eyeglass fitting system using the smart mirror of FIG. 3.

In order to fully understand the configuration and effects of the present invention, preferred embodiments of the present invention will be described with reference to the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various forms and various modifications may be made. However, the description of the embodiments is provided to complete the disclosure of the present invention, and to fully inform the scope of the invention to those of ordinary skill in the art to which the present invention belongs.

Singular expressions include plural expressions, unless the context clearly indicates otherwise. For example, terms such as "comprises" or "have" are used to designate the existence of features, numbers, steps, actions, components, parts, or a combination thereof described in the specification, and one or more other features or numbers , Steps, actions, components, parts, or a combination thereof may be interpreted as being added.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which the present invention belongs. Terms as defined in a commonly used dictionary are interpreted as having a meaning consistent with the meaning in the context of the related technology, and are not interpreted as an ideal or excessively formal meaning unless explicitly defined in the present application. .

Hereinafter, the present invention will be described in detail by describing a preferred embodiment of the present invention with reference to the accompanying drawings. The same reference numerals in each drawing indicate the same members.

1 is a schematic front view of a glasses fitting system using a smart mirror according to a preferred embodiment of the present invention.

Referring to FIG. 1, a glasses fitting system 100 using a smart mirror according to a preferred embodiment of the present invention includes a smart mirror unit 200, a first touch screen unit 300, and a second touch screen unit 400. ). The arrangement of the smart mirror unit 200, the first touch screen unit 300, and the second touch screen unit 400 is shown as an example to explain the present invention, and is separated or positioned during the actual application and implementation process. May change.

Inside the smart mirror unit 200, a smart mirror 220 capable of projecting a person's appearance, and a first image by photographing a subject projected on the smart mirror by being disposed in a space adjacent to the smart mirror 220 There is a camera 210 capable of making a camera and a motion detection sensor 230 disposed in a space adjacent to the smart mirror 220 and capable of detecting movement of an object in the smart mirror 220. The arrangement of the smart mirror 220, the camera 210, and the motion detection sensor 230 for detecting the motion of an object may be subjected to various modifications in the process of applying the present invention.

The first touch screen unit 300 may include a built-in computer that operates a touch screen therein and a computer program stored in the computer. The computer program driven by the built-in computer of the first touch screen unit 300 operates the eyeglass fitting system 100 using a smart mirror according to the present invention, and a peripheral device, a smart mirror 220, a camera 210, and a 2 Responsible for controlling the touch screen unit 400. In addition, the computer program of the first touch screen unit 300 may perform a function of processing and editing a transmitted image.
The computer program of the first touch screen unit 300 receives the first image captured by the smart mirror 220 from the camera 210 and edits it, and recognizes an arbitrary eyeglasses, and the edited person photo is a second It can perform a function of combining it with an image. In addition, the first touch screen unit 300 displays a plurality of photos in which various types of glasses are fitted together with a main display screen to help the customer select glasses suitable for their fashion or appearance. It may include an auxiliary display screen that can be given.

The second touch screen unit 400 displays a prescription reflecting menu and various types of glasses, and a second image that is a portrait photograph of glasses corresponding to a menu selected by a customer's selection set by a touch method reflected on a smart mirror It performs a function that can be synthesized in The first touch screen unit 300 and the second touch screen unit 400 may be designed integrally or may be prepared in a separate form.

FIG. 2 is a front view illustrating a first touch screen part and a second touch screen part of a glasses fitting system using a smart mirror according to an embodiment of the present invention.

Referring to FIG. 2, the second touch screen unit 300 may largely include a main display screen 310 and an auxiliary display screen 320. The main display screen 310 is a screen in which a computer program embedded in the touch screen performs face recognition by a customer photographed in the smart mirror of FIG. 1, and then displays a glasses fitting picture in which an arbitrary pair of glasses is virtually fitted. to be.

At this time, the arbitrary spectacles may be glasses of a type that is recently popular. Further, the arbitrary glasses may be glasses appropriately selected according to the shape of the face after performing face recognition in a computer program embedded in the touch screen. For example, in the case of a round face, glasses with a round frame can be applied, and in the case of an angled face, glasses with an appropriate angle can be applied to virtually synthesize a person image. . The method of editing the image captured by the smart mirror and applying arbitrary glasses to synthesize it may be implemented in various forms according to the designer of the computer program in the first touch screen unit 300.

In addition, the second touch screen unit 300 is fitted with various types of other similar glasses to a second image, which is an image edited so that the first image captured by the camera in the smart mirror can be synthesized into arbitrary glasses. And a secondary display screen 320 that displays one or more screens. One picture is shown in the drawing, but after the customer selects and fits a different type of similar glasses on the second touch screen unit 400, the fitted image is stored in the first touch screen unit 300 icon ( By pressing 330, the auxiliary display screen 320 may be additionally displayed. Then, two images are displayed on the auxiliary display screen 320. Accordingly, through the auxiliary display screen 320, the customer can check his or her appearance of fitting various types of glasses in one screen. Therefore, you can get help in choosing glasses that are best suited to your face shape or fashion style, or similar eyewear products such as sunglasses, color lenses and sports glasses.

On the other hand, although not shown in the drawing, the second and third touch screen units 300 and 400 are provided with icons for transmitting an image in which glasses or eyeglasses are fitted to their face to an e-mail or social network system (SNS) account. ) Can be installed additionally. In addition, the main display screen 310 is prepared to display a selected advertisement during a time when no photographing occurs from the camera, that is, a period in which the motion detection sensor does not detect the motion in front of the smart mirror, so that it can also serve as a billboard have.

A first menu 410, a second menu 420, and a prescription reflecting menu 430 may be displayed on the second touch screen unit 400. The first menu 410 may perform a function of displaying various types of similar glasses 440 and other similar glasses 450 as shown in the picture displayed below. In addition, the second menu 420 may perform a function of displaying spectacle items such as color lenses, sunglasses, and sports glasses. Finally, the prescription reflecting menu 430 is a menu that can apply the contents of a prescription in the form of a computer file created at the optician's office to glasses or spectacle supplies on the main display screen 310. The prescription in the form of a computer file, such as the distance from the center of the pupil to the center of both eyes (PD: Pupillary distance), right eye (OD: Oculus Dexter), left eye (Oculus sinister), eye power (SPH: Spherical), etc. A variety of information is included, and the computer program embedded in the first touch screen unit 300 interprets the digitized details of the prescription and displays the second image by combining glasses or eyewear items selected by the customer. It is desirable to be designed to reflect.

3 is a flowchart illustrating a method of operating a glasses fitting system using a smart mirror according to a preferred embodiment of the present invention.

Referring to FIG. 3, a smart mirror capable of showing a subject as shown in FIG. 1 described above, a camera capable of photographing the subject near the smart mirror, and a smart mirror unit equipped with a motion detection sensor, and a person in the captured image Using a smart mirror including a first touch screen unit capable of fitting and outputting arbitrary glasses to the face, and a second touch screen unit having a menu screen capable of changing the shape of glasses among the images of the first touch screen unit. The glasses fitting system is prepared (S100).

Thereafter, when a subject is identified in the smart mirror through the motion detection sensor, the first image captured by the camera is transmitted to the first touch screen unit (S200). To this end, it is appropriate that the smart mirror unit and the first touch screen unit are connected to each other by a wired or wireless device suitable for transmission.

Subsequently, a computer program built into the first touch screen unit recognizes the face of a person in the subject of the first image, and edits the face recognized in the first image to a predetermined size, thereby synthesizing arbitrary glasses. A second image is prepared (S300). Next, the computer program embedded in the first touch screen unit outputs a first spectacle fitting picture obtained by synthesizing arbitrary spectacles with the second image to the first screen unit as shown in the picture of the main display screen of FIG. 2 (S400). do. In this case, the arbitrary glasses may be glasses that are recently popular or glasses selected to suit the shape of the face in the second image.

Subsequently, when similar glasses displayed on the second touch screen unit 400 in FIG. 2, for example, glasses having a shape such as 440 of FIG. 2 are selected (S500), the similar glasses are synthesized in the second image. The second glasses fitting picture is output to the first screen unit (S600). At this time, the customer may store the second glasses fitting picture output as needed on the auxiliary display screen (320 in FIG. 2).

In addition, when other similar glasses displayed on the second touch screen unit, for example, glasses of reference numeral 450 are selected (S700), the computer program built into the first touch screen unit is a third unit in which the other similar glasses are combined with the second image. A picture of fitting glasses may be output to the first screen (S800). Even at this time, the customer saves the third eyeglass fitting picture output as needed on the auxiliary display screen (320 in Fig. 2), and compares it with the other displayed eyeglass fitting pictures, and selects glasses or eyewear products optimized for their appearance and style. You can choose.

FIG. 4 is a flowchart illustrating an operating method to which a prescription reflecting menu is applied among the operating method of the eyeglass fitting system using the smart mirror of FIG. 3.

Referring to FIG. 4, first, in order to apply the prescription reflecting menu according to the present invention, a prescription for a customer is made in a digitized file form at an optician, and the prescription file is a computer program embedded in the first touch screen through wired or wireless. Should be sent to In addition, it is appropriate that the computer program includes a program routine that can interpret the prescription file.

When the above-described method of operating the eyeglass fitting system using the smart mirror of FIG. 3 is performed, a prescription reflecting menu is selected by the customer in a touch method in steps S400 to S800 in the second touch screen unit (P100).

Then, the second touch screen unit displays a prescription selection menu through a new screen (P200). Such a prescription selection menu is suitably a menu designed to select a specific individual through name, social security number, prescription issuance date, etc., and can be implemented in various forms depending on the computer program designer.

Subsequently, when a specific prescription is selected (P300) from the displayed prescription selection menu, the second or third eyeglass fitting picture is corrected (P400) according to the specific prescription in a computer program built into the first touch screen unit. . Finally, the revised second or third glasses fitting photo is outputted to the first touch screen (P500).

It is apparent that the present invention is not limited to the above-described embodiment, and many modifications are possible by those of ordinary skill in the art within the technical idea to which the present invention belongs.

100: glasses fitting system using a smart mirror,
200: smart mirror unit, 210: camera,
220: smart mirror, 230: motion detection sensor,
300: first screen unit, 310: main display screen,
320: auxiliary display screen, 330: save icon,
400: second screen unit, 410, 420: second menu,
430: prescription reflecting menu, 440: similar glasses,
450: Other similar glasses.

Claims (3)

A smart mirror that can show a subject and a smart mirror unit in which a camera capable of photographing the subject is installed in the vicinity of the smart mirror, and a first touch screen that can output by fitting arbitrary glasses to a person's face from the captured image Preparing a glasses fitting system using a smart mirror including a second touch screen unit on which a menu screen capable of changing the shape of glasses among images of the first touch screen unit is prepared;
When a subject is identified using a motion detection sensor installed near the smart mirror, the first image captured by the camera is transmitted to the first touch screen unit by an operation of a computer program driven by the built-in computer of the first touch screen unit. step;
Recognizing a person's face from the subject of the first image by a computer program built into the first touch screen unit;
Preparing a second image that can be synthesized by arbitrary glasses by editing the face recognized in the first image to a predetermined size by a computer program embedded in the first touch screen unit;
The computer program embedded in the first touch screen unit outputs, to the first touch screen unit, a first spectacle fitting photo obtained by combining arbitrary glasses with the second image;
When the similar glasses displayed on the second touch screen unit are selected, a computer program built in the first touch screen unit outputs, to the first touch screen unit, a second spectacle fitting picture in which the similar glasses are combined with the second image. step;
And outputting, to the first touch screen unit, a third eyeglass fitting picture in which the other similar glasses are combined with the second image when other similar glasses displayed on the second touch screen unit are selected. Operating method of a glasses fitting system using. delete The method of claim 1,
After the step of outputting the second spectacle fitting photo or the third spectacle fitting photo to the first touch screen unit, when a prescription reflecting menu displayed on the second touch screen unit is selected,
The computer program embedded in the first touch screen unit comprises: displaying a prescription selection menu on the second touch screen unit;
If a specific prescription is selected from the displayed prescription selection menu, modifying the second eyeglass fitting picture or the third eyeglass fitting picture according to the specific prescription in a computer program embedded in a first touch screen unit; And
And outputting the second glasses fitting photo or the third glasses fitting photo modified by a computer program embedded in the first touch screen unit to the first touch screen. How to operate the system.

Images