KR20220015201A - Contact dispalying stand, contact-lense virtual fitting system with the same and method for genetrating virtural fitting image of selected contact-lense with the system - Google Patents

Abstract

The present invention relates to a contact lens display stand, a virtual contact lens fitting system to generate a virtual wearing image through artificial intelligence learning, and a virtual contact lens fitting method using the same. According to the present invention, the virtual contact lens fitting system comprises: a contact lens display stand (20) disposed in a store to have a plurality of lens cubes accommodating contact lenses arranged therein and receiving a user's ID information; and a server (30) receiving the ID information from the contact lens display stand (20) to transmit ID linkage information stored corresponding to the ID information and contact lens information. The contact lens display stand (20) transmits selected contact lens information among a plurality of pieces of contact lens information to the server (30). A virtual fitting image of the user for the selected contact lens is generated through image learning by a plurality of calculations on the basis of the selected contact lens information received from the contact lens exhibition display (20) and the user's contact lens non-wearing image information and user's preset contact lens wearing image information included in the ID linkage information.

Description

Contact lens exhibition stand, contact lens virtual fitting system, and contact lens virtual fitting method using the same

The present invention relates to a lens cube, a contact lens display stand, a contact lens virtual fitting system, and a contact lens virtual fitting method using the same, and more particularly, to generate a wearing image for a contact lens selected or recommended by a user through image learning It relates to a contact lens virtual fitting system, a contact lens virtual fitting method using the same, a lens cube, and a contact lens display stand.

A contact lens is a lens for correcting or improving visual acuity by being in close contact with the front surface of the eyeball. Contact lenses are used not only for medical purposes, but also when the glasses are cloudy or dangerous for occupational purposes, and are used for cosmetic purposes, when the use of glasses is not desired or to improve the appearance of the prosthetic eye.

Since these contact lenses coincide with the optical axis of the line of sight and the lens, not only there is no aberration, but there is no difference in the size of the retina due to the different refractive indices on the left and right, so that the object does not appear double or distorted, so the field of view is wide and the eyesight is improved It is widely used because of In recent years, colored contact lenses, which are implemented by coating various colors on the lenses, are gaining popularity.

Due to the increase in the types of contact lenses, opticians that sell contact lenses have secured display space to display various types of contact lenses so that consumers can easily see them.

However, when the contact lenses are displayed for publicity or sales, it is difficult to store them due to the characteristics of the contact lenses, and it is difficult to easily see many types of contact lenses having various colors. In addition, since it is difficult to wear a contact lens sample, the seller inspects the consumer's eyesight and then sells a product suitable for the eyesight according to the consumer's choice without the wearing process.

Therefore, there is a problem in that the consumer has to purchase the contact lens without checking the wearing state.

In order to solve this problem, Utility Model Registration No. 0470737 (2014.01.07) discloses a contact lens dry display device. The device disclosed in the above publication includes a case made of a transparent acrylic material for accommodating a contact lens, and a base plate to which a plurality of cases are fixed, and the purchaser can visually check the product name and price of the contact lens on the base plate There is provided an explanatory unit that allows the user to do so, and an example unit in which a picture wearing a contact lens is arranged.

However, since such a conventional device shows information about contact lenses as printed text or photos, the size increases as the number of contact lenses displayed increases, and there is a simple limitation in information provided to consumers.

That is, there is a very high possibility that a gap may occur between images after wearing by a wearer only with simple contact lens image information. In addition, due to the influence of non-contact and the existing risk of infection due to the influence of COVID-19, it was impossible to purchase after wearing contact lenses, resulting in a significant discrepancy between the image that the consumer thought before purchase and the image worn after purchase.

In order to solve this problem, as a part of the prior art, a device for outputting a wearing image by simply synthesizing a contact lens image with a user's face image has been developed. However, in the case of such a simple composite image, there is still a gap between the simple output image and the image after actual wearing.

Registered Utility Model Publication No. 0470737 (2014. 01. 07)

The present invention is to solve the problems of the prior art as described above, and an artificial intelligence learning process using contact lens information such as previously known wearing or non-wearing images of contact lenses and contact lenses selected by the user or recommended contact lens information. An object of the present invention is to provide a contact lens virtual fitting system or a contact lens virtual fitting method that generates a newly created virtual wearing image through

A contact lens virtual fitting system according to the present invention for solving the above object includes a user terminal 10 capable of transmitting user ID information and user's preset contact lens wearing image information through an installed application, and the user and a server 30 capable of transmitting the ID information from the terminal 10 and the ID linkage information and contact lens information stored in response to the ID information, wherein the user terminal 10 includes the user contact lens non-wearing image information and the The selected contact lens information selected from the contact lens information is transmitted to the server 30, and the user's contact lens non-wearing image information and the selection contact lens information and the ID linkage information of the user included in the ID linkage information are transmitted from the user terminal 10. It provides a contact lens virtual fitting system (1) including a server (30) that generates a virtual fitting image of a user through image learning through a plurality of calculations based on preset contact lens wearing image information.

In the contact lens virtual fitting system, the server 30 includes: a server communication unit 35 that transmits/receives to and from the user terminal 10 through a communication network, and a server that stores data received from the server communication unit 35 The storage unit 33, the server communication unit 35 and the server storage unit 33 are controlled, and the user contact lens non-wearing image information and the selection contact lens information and the ID linkage information are obtained from the user terminal 10 . It may include a server control unit 31 that processes the preset contact lens wearing image information of the user included in the image processing and generates a virtual fitting image of the user through image learning.

In the contact lens virtual fitting system, the server control unit 31 includes: a control module 311 for controlling the server communication unit 31 and the server storage unit 33, and image learning of the control module 311 According to a control signal, image information of the user's pre-set contact lens wearing image information included in the user's contact lens non-wearing image information and the selection contact lens information and the ID linkage information from the user terminal 10 is image-processed and image learning is performed according to a control signal It may include an AI module 313 that generates a virtual fitting image of a user through

The contact lens virtual fitting system may include an image processing module 315 for extracting and processing an eyeball region image from the user's contact lens non-wearing image information and the preset contact lens wearing image information.

In the contact lens virtual fitting system, the control module 311 includes a communication storage control module 3115 for applying a communication and storage signal for controlling the server communication unit 31 and the server storage unit 33; The AI module 313 may include an AI control module 3111 that applies a learning control signal for image learning, and an image processing control module 3113 that applies an image processing control signal to the image processing module 315 . .

In the contact lens virtual fitting system, the AI module 313 includes: an AI neural network module 3131 that receives the user's contact lens non-wearing image information and the user's preset contact lens wearing image information and executes a plurality of calculations ) and an AI learning module 3133 that applies an AI learning signal to the AI neural network module 3131 according to the learning control signal of the AI control module 3111 .

In the contact lens virtual fitting system, the AI neural network module 3131 is configured to: use at least the user contact lens non-wearing image information and input image information of the contact lens information to apply a weight to the contact lens through a plurality of calculations. A generator 31311 for generating the contact lens wearing generic image information for It may include a discriminator 31313 that determines whether the contact lens wearing generative image information is real or fake.

In the contact lens virtual fitting system, the AI learning module 3133 applies a learning control signal to the generator 31311 and the discriminator 31313 of the AI neural network module 3131, but the AI learning When the module 3133 applies a generation learning control signal to the generator 31311, the AI learning module 3133 to determine that the contact lens wearing generative image information input by the discreminator 31313 is real. ) may adjust the complex calculation weight of the generator 31311 .

In the contact lens virtual fitting system, the AI learning module 3133 applies a learning control signal to the generator 31311 and the discriminator 31313 of the AI neural network module 3131, but the AI learning When the module 3133 applies a discremination learning control signal to the discriminator 31313, the contact lens wearing generative image information generated by the generator 31311 and input to the discriminator 31313 The AI learning module 3133 may adjust the complex calculation weight of the discriminator 31313 so that the discriminator 31313 determines that is a fake.

In the contact lens virtual fitting system, the AI learning module 3133 applies a learning control signal to the generator 31311 and the discriminator 31313 of the AI neural network module 3131, but the AI learning When the module 3133 applies a discremination learning control signal to the discriminator 31313, the contact lens wearing generative image information generated by the generator 31311 and input to the discriminator 31313 The AI learning module 3133 adjusts the complex calculation weight of the discriminator 31313 so that the first discriminator 313131 of the discriminator 31313 determines that is a fake, and the AI learning module ( When 3133) applies a discremination learning control signal to the discriminator 31313, the contact lens wearing generative image information generated by the generator 31311 and input to the discriminator 31313 is actually The AI learning module 3133 may adjust the complex calculation weight of the discriminator 31313 so that the second discriminator 313132 of the discriminator 31313 determines that it is .

In the contact lens virtual fitting system, the image processing module 315: Using the learning result from the AI neural network module 3131 and the selection contact lens information, virtual fitting of the user wearing the selection contact lens It may include an image generating module 3153 that generates an image.

In the contact lens virtual fitting system, the image processing module 315 includes: an image extraction module 3151 capable of extracting an image of an eyeball region from the image information of the user not wearing contact lenses and the preset contact lens wearing image information of the user may include

In the contact lens virtual fitting system, the user terminal 10 may include a terminal input unit 13 including a terminal camera capable of inputting image information of the user.

According to another aspect of the present invention, the user's ID information is transmitted to the server 30 through an application installed in the user terminal 10, and the ID information linked to the user's ID information and contact lens information are requested. Information transmission and information request step (S10), and information transmission and information transmission step (S11) in which ID linkage information and contact lens information linked to the user's ID information are transmitted from the server 30 to the user terminal 10 (S11) And, through the application installed in the user terminal 10, the user's preset contact lens wearing image and the user's image acquisition and storage step (S13, S15), the user, A user image transmission step (S16) in which the preset contact lens wearing image and user contact lens non-wearing image information are transmitted to the server (S16), and selection contact information selected from among the contact lens information is transmitted to the server 30 A lens information transmission step (S17), and the user's preset contact lens wearing image and the user's contact lens non-wearing image information received by the server 30 are stored as ID linkage information corresponding to the user's ID information. User image server A storage step (S18) and, based on the user's preset contact lens wearing image and the user's contact lens not wearing image information, generating a virtual fitting image of the user for the selected contact lens through image learning through a plurality of calculations It provides a contact lens virtual fitting method comprising a user wear image processing step (S19) having a user image AI processing step (S193).

In the contact lens virtual fitting method, the user wear image processing step (S19) is, before the user image AI processing step (S193) is executed, a user image correction step of correcting using the user's eye image information (S191) may further include.

In the contact lens virtual fitting method, the user image correction step (S191) is: provided in the server control unit 31 of the server 30, the server communication unit 31 of the server 30 and the server storage unit 33 ), an image information input step (S1911) in which the user's contact lens non-wearing image information and the preset contact lens wearing image information are input to the image processing module 315 of the control module 311 for controlling the image information input step (S1911), and the image processing In the image extraction module 3151 of the module 315, the target image extraction step (S1913) of extracting an image of the eyeball region from the user's contact lens non-wearing image information and the user's preset contact lens wearing image information (S1913), and the image processing The image extraction module 3155 of the module 315 may include a target image correction step (S1915) of correcting the image of the eyeball region among the preset contact lens wearing image information.

In the contact lens virtual fitting method, the step of extracting the target image ( S1913 ) includes: a sclera of an eye area among the user's contact lens not wearing image information and the user's preset contact lens wearing image information ) of the target image scratcher extraction step (S19131) of extracting an image of the region, and the pupil iris (pupil, iris; pupil) of the eyeball region among the image information of the user not wearing contact lenses and the preset contact lens wearing image information of the user ), the target image of extracting the image of the iris (虹彩) region may include a pupil iris extraction step (S19133).

In the contact lens virtual fitting method, the target image correction step (S1915) includes: checking the target image sclera (sclera) region extracted in the target image sclera extraction step (S19131) (S19151) ), the target image sclera correction calculation step (S19153) of confirming color correction data using image information of the target image sclera region, and the target image sclera correction calculation step ( By using the color correction data confirmed in S19153), image information of the pupil iris (pupil, iris) region of the target image and the sclera (sclera) of the target image It may include a target image correction execution step (S19155) of extracting the target image correction for correcting the image information of the region.

In the contact lens virtual fitting method, the user image AI processing step (S193) includes: an image data input confirmation step of inputting and confirming the user's preset contact lens wearing image and the user's contact lens not wearing image information (S1931); A wearing generating image generating step (S1933) of generating a wearing generating image of the user wearing a preset contact lens through a plurality of calculations using the user's contact lens non-wearing image information and the preset contact lens information; The generator 31311 and the discriminator 31313 of the AI neural network module 3131 on the server 30 side perform a plurality of calculations using the user's preset contact lens wearing image and the wearing generating image. Through the image learning step (S1935) in which the image is learned through, and the generator 31311 of the AI neural network module 3131 learned in the image learning step (S1935), at least the user contact lens non-wearing image information and input of contact lens information It may include a fitting image output step (S1937) of generating contact lens wearing generic image information for other contact lenses through a plurality of calculations that can be weighted using the image information to be used.

In the contact lens virtual fitting method, the image learning step (S1935) includes: the AI learning module 3133 provided in the AI learning module 3133 of the control module 311 learns from the discriminator 31313 By applying a control signal, the contact lens wearing generic image information generated by the generator 31311 and input to the discriminator 31313 is compared with the user's preset contact lens wearing image, A discriminator learning step (S19351) in which the AI learning module 3133 adjusts the complex calculation weight of the discriminator 31313 so that the discriminator 31313 determines that the narrative image information is a fake; The AI learning module 3133 provided in the AI learning module 3133 of the control module 311 applies a learning control signal to the discriminator 31313, and the discriminator 31313 is inputted to the contact lens. The AI learning module 3133 may include a generation learning step (S19353) of adjusting the complex calculation weight of the generator 31311 to determine that the worn generic image information is real.

According to another aspect of the present invention, the present invention provides a contact lens display stand 20 in which a plurality of lens cubes accommodating contact lenses disposed in a store are arranged and the user's ID information can be received, and the contact lens display stand 20 ) and a server 30 capable of receiving the ID information from and transmitting ID linkage information and contact lens information stored in response to the ID information, and the contact lens display stand 20 is a selected selection of the contact lens information The contact lens information is transmitted to the server 30 , and the user's contact lens non-wearing image information and the user's preset contact lens information included in the selected contact lens information and the ID linkage information from the contact lens exhibition stand 20 . Provided is a contact lens virtual fitting system (1) in which a virtual fitting image of a user for the selected contact lens is generated through image learning through a plurality of operations in the server (30) based on the wearing image information.

In the contact lens virtual fitting system (1), the contact lens display stand (20) includes: a stand housing (21) disposed in an offline store and having a preset inclination, and the stand housing (21) is disposed on one side, A stand cover 23 forming an inner space, is disposed in the inner space of the stand cover 23 and the stand housing 21, is connected to the lens cube 40, and is in electrical communication, and the lens cube ( 40) a stand touch panel 25 for applying an electrical signal, and a stand display 271 for displaying a virtual fitting image of a user generated through image learning through a plurality of operations in the server 30 A stand output unit 27, a stand input unit 29 for inputting user ID information, a stand communication unit 28 that communicates with at least the server 30, stores user ID information, and the server 30 ) applies a block control signal to the lens cube 40 side through the stand storage unit 24 for storing contact lens information transmitted from the stand touch panel 25 and the lens cube 40 side Receive selected contact lens information from among the contact lens information, transmit the user ID information and the selection contact lens information to the server 30, and the selection contact through image learning through a plurality of operations in the server 30 It may include a stand control unit 22 that applies a communication control signal to the stand communication unit 28 to receive the user's virtual fitting image generated with respect to the lens information.

In the contact lens virtual fitting system (1), the server (30) includes: a server communication unit (35) for transmitting and receiving to and from the contact lens exhibition stand (20) through a communication network, and a server communication unit (35) received from the server communication unit (35). A server storage unit 33 for storing data, the server communication unit 35 and the server storage unit 33 are controlled, and the user contact lens non-wearing image information and the selection contact are obtained from the contact lens display stand 20 . It may include a server control unit 31 that processes the preset contact lens wearing image information of the user included in the lens information and the ID linkage information and generates a virtual fitting image of the user through image learning.

In the contact lens virtual fitting system (1), the server control unit (31) includes: a control module (311) for controlling the server communication unit (31) and the server storage unit (33), and the control module (311) According to an image learning control signal of It may include an AI module 313 that generates a fitting image.

The contact lens virtual fitting system 1 may include an image processing module 315 for extracting and processing an eyeball region image from the user's contact lens non-wearing image information and the preset contact lens wearing image information.

In the contact lens virtual fitting system (1), the control module (311) is a communication storage control module (3115) that applies a communication and storage signal for controlling the server communication unit (31) and the server storage unit (33) and an AI control module 3111 for applying a learning control signal for image learning of the AI module 313, and an image processing control module 3113 for applying an image processing control signal to the image processing module 315. You may.

In the contact lens virtual fitting system (1), the AI module 313 is: An AI neural network that receives the user's contact lens non-wearing image information and the user's preset contact lens wearing image information and executes a plurality of calculations It may include a module 3131 and an AI learning module 3133 that applies an AI learning signal to the AI neural network module 3131 according to the learning control signal of the AI control module 3111 .

In the contact lens virtual fitting system 1, the AI neural network module 3131 is configured to: use at least the user contact lens non-wearing image information and input image information of the contact lens information through a plurality of calculations that can be weighted A generator 31311 that generates contact lens wearing generic image information for a corresponding contact lens, and a plurality of calculations that can be weighted using the corresponding contact lens wearing generic image information and the user's preset contact lens wearing image information It may include a discriminator 31313 that determines whether the corresponding contact lens wearing generic image information is real or fake.

In the contact lens virtual fitting system 1, the AI learning module 3133 applies a learning control signal to the generator 31311 and the discriminator 31313 of the AI neural network module 3131, When the AI learning module 3133 applies a generation learning control signal to the generator 31311, the AI learning to determine that the contact lens wearing generative image information to which the discriminator 31313 is input is real The module 3133 may adjust the complex calculation weight of the generator 31311 .

In the contact lens virtual fitting system 1, the AI learning module 3133 applies a learning control signal to the generator 31311 and the discriminator 31313 of the AI neural network module 3131, When the AI learning module 3133 applies a discriminator learning control signal to the discriminator 31313, the contact lens wearing agent generated by the generator 31311 and input to the discriminator 31313 The AI learning module 3133 may adjust the complex calculation weight of the discriminator 31313 so that the discriminator 31313 determines that the narrative image information is fake.

In the contact lens virtual fitting system 1, the AI learning module 3133 applies a learning control signal to the generator 31311 and the discriminator 31313 of the AI neural network module 3131, When the AI learning module 3133 applies a discriminator learning control signal to the discriminator 31313, the contact lens wearing agent generated by the generator 31311 and input to the discriminator 31313 The AI learning module 3133 adjusts the complex calculation weight of the discriminator 31313 so that the first discriminator 313131 of the discriminator 31313 determines that the narrative image information is a fake, and the AI When the learning module 3133 applies a discremination learning control signal to the discriminator 31313, the contact lens wearing generative image generated by the generator 31311 and input to the discriminator 31313 The AI learning module 3133 may adjust the complex calculation weight of the discriminator 31313 so that the second discriminator 313132 of the discriminator 31313 determines that the information is real.

In the contact lens virtual fitting system 1, the image processing module 315: Using the learning result from the AI neural network module 3131 and the selection contact lens information, the user wearing the selection contact lens It may include an image generation module 3153 that generates a virtual fitting image of .

In the contact lens virtual fitting system (1), the image processing module 315 includes: an image extraction module capable of extracting an image of an eyeball region from among the user's contact lens non-wearing image information and the user's preset contact lens wearing image information 3151 may be included.

In the contact lens virtual fitting system (1), a user terminal (10) capable of transmitting at least user ID information through an installed application is further provided, and the stand communication unit (28) of the contact lens display stand (20) is a stand A wireless terminal communication unit 281 may be included, and the stand wireless terminal communication unit 281 may establish a communication state with the server 30 for the user's ID information through the user terminal 10 .

In the contact lens virtual fitting system 1, the stand input unit 29 may include a stand optical input unit 291 for inputting the user's preset contact lens wearing image information or the user's contact lens not wearing image information.

In the contact lens virtual fitting system (1), the contact lens display stand (20) may further include a lens cube holder (50) for preventing the plurality of lens cubes (40) from sliding.

In the contact lens virtual fitting system (1), the lens cube holder (50) is an internal space formed by the stand housing (21) and the stand cover (23), and is disposed between the stand housing (21) and the A lens cube holder base (51) positioned so that the stand touch panel (25) is disposed, and a lens cube holder base counterpart (53) disposed at a lower end of the lens cube, the lens cube holder base (51) and at least one of the lens cube holder base counterpart 53 may be a magnet.

In the contact lens virtual fitting system (1), the contact lens display stand (20) is disposed between the stand housing (21) and the stand cover (23) to form a space between the stand spacers (60) may include.

In the contact lens virtual fitting system (1), the stand spacer (60) may be provided with a stand spacer through hole (61) allowing the plurality of lens cubes (40) to pass through.

According to another aspect of the present invention, the user's ID information is transmitted to the server 30 from the contact lens exhibition stand 20 in which a plurality of lens cubes accommodating contact lenses disposed in the store are disposed, and the user's ID information is In the information transmission and information request step (S20) of requesting the linked ID link information and contact lens information, the ID link information and contact lens information linked to the user's ID information in the server 30 are transferred to the contact lens display stand ( 20) information transmission and information transmission step (S21), and a lens information display step of displaying the contact lens information as an image on the stand display 271 of the stand output unit 17 of the contact lens exhibition stand 20 (S22), the lens selection step (S23) in which the contact lens information selected by the user is input through the lens cube 40 by the user, and the information on the selected contact lens selected in the lens selection step (S23) Based on the selection lens information transmission step (S24) transmitted to the server 30 and the user's preset contact lens wearing image and the user's contact lens not wearing image information, the selection contact through a plurality of calculations through image learning ID selection lens wearing eye image creation step (S19) having a user image AI processing step (S193) for generating a virtual fitting image of the user for the lens, and the selection contact generated in the user wearing image processing step (S19) A selection contact lens wearing image transmission step (S25) of transmitting the user's virtual fitting image for the lens to the contact lens stand 20, and displaying the user's virtual fitting image in the contact lens display stand 20 It provides a contact lens virtual fitting method comprising a selection contact lens wearing image output step (S26).

In the contact lens virtual fitting method, a user terminal (10) capable of transmitting at least user ID information is further provided, and the user ID information is transmitted from the user terminal (10) to the contact lens display stand (20) It may include an ID information transmission step (S20-1).

According to another aspect of the present invention, the user's ID information is transmitted to the server 30 from the contact lens exhibition stand 20 in which a plurality of lens cubes accommodating contact lenses disposed in the store are disposed, and the user ID Information transmission and information request step (S20) for requesting ID link information and contact lens information linked to the information, ID link information linked to the user's ID information in the server 30, and a recommendation contact recommended for the user ID link information confirmation and contact lens information confirmation step (S21a) for confirming contact lens information including lens information, and based on the user's preset contact lens wearing image and user's contact lens non-wearing image information and recommended contact lens information So, through a plurality of calculations, the ID recommendation lens wearing eye image generating step (S19a) having a user image AI processing step (S193) to generate a virtual fitting image of the user for the recommended contact lens through image learning (S19a) and , ID link information linked to the user's ID information in the server 30, contact lens information including recommended contact lens information (by individual or rank) recommended for the user, and ID recommended contact lens wearing eye image Information transmission and information transmission step (S21a) transmitted to the contact lens exhibition stand 20, and a selection contact lens wearing image output step (S21b) of displaying the virtual fitting image of the user in the contact lens exhibition stand 20 (S21b) ) may be included.

In the contact lens virtual fitting method, the contact lens information including the requested contact lens information is imaged on the stand display 271 of the stand output unit 17 of the contact lens exhibition stand 20. Lens information display Information on the selected contact lens selected in the step S22a, the lens selection step S23 in which the contact lens information selected by the user is input through the lens cube 40 by the user, and the lens selection step S23 Based on the selection lens information transmission step (S24) transmitted to the server 30 and the user's preset contact lens wearing image and the user's contact lens non-wearing image information, the selection through image learning through a plurality of calculations A user wearing image processing step (S19) having a user image AI processing step (S193) for generating a virtual fitting image of a user for a contact lens, and the selection contact lens generated in the user wearing image processing step (S19) A selection contact lens wearing image transmission step (S25) of transmitting the virtual fitting image of the user to the contact lens stand 20 (S25), and a selection contact that displays the virtual fitting image of the user in the contact lens display stand 20 It may include a lens wearing image output step (S26).

In the contact lens virtual fitting method, a user terminal (10) capable of transmitting at least user ID information is further provided, and the user ID information is transmitted from the user terminal (10) to the contact lens display stand (20) It may include an ID information transmission step (S20-1).

According to another aspect of the present invention, the present invention is a contact lens display stand arranged in a store, a plurality of lens cubes accommodating contact lenses are arranged, the user's ID information can be received, and the ID stored in response to the ID information In connection with the server 30 capable of transmitting linkage information and contact lens information, the selected contact lens information selected from the contact lens information is transmitted to the server 30, and is included in the selection contact lens information and the ID linkage information Based on the user's contact lens non-wearing image information and the user's preset contact lens wearing image information, a virtual fitting image of the user generated for the selected contact lens through image learning through a plurality of calculations in the server 30 It provides a contact lens display stand 20 capable of receiving and displaying an image.

According to another aspect of the present invention, the present invention includes a contact lens display stand 20 in which a plurality of lens cubes 40 accommodating contact lenses disposed in a store are arranged and the user's ID information can be received, and the contact lenses and a server 30 capable of receiving the ID information from the exhibition stand 20 and transmitting ID linkage information and contact lens information stored in response to the ID information, wherein the contact lens exhibition stand 20 includes the contact lenses The selected contact lens information from among the information is transmitted to the server 30, and the user's contact lens non-wearing image information and the user's image information included in the selection contact lens information and the ID linkage information from the contact lens exhibition stand 20 Based on the preset contact lens wearing image information, a virtual fitting image of the user for the selected contact lens is generated through image learning through a plurality of calculations in the server 30, and the lens cube 40 includes: A lens housing 410 that can accommodate a contact lens and can be disposed on the contact lens display stand 20, and a lens cube light source unit 440 that can emit light toward the contact lens disposed on the lens housing 410. It provides a contact lens virtual fitting system (1), characterized in that.

In the contact lens virtual fitting system (1), the contact lens display stand (20) includes: a stand housing (21) disposed in an offline store and having a preset inclination, and the stand housing (21) is disposed on one side, A stand cover 23 forming an inner space, is disposed in the inner space of the stand cover 23 and the stand housing 21, is connected to the lens cube 40, and is in electrical communication, and the lens cube ( 40) a stand touch panel 25 for applying an electrical signal, and a stand display 271 for displaying a virtual fitting image of a user generated through image learning through a plurality of operations in the server 30 A stand output unit 27, a stand input unit 29 for inputting user ID information, a stand communication unit 28 that communicates with at least the server 30, stores user ID information, and the server 30 ) applies a cube control signal to the lens cube 40 side through a stand storage unit 24 for storing contact lens information transmitted from the stand touch panel 25, and the lens cube 40 side Receive selected contact lens information from among the contact lens information, transmit the user ID information and the selection contact lens information to the server 30, and the selection contact through image learning through a plurality of operations in the server 30 and a stand control unit 22 that applies a communication control signal to the stand communication unit 28 to receive the user's virtual fitting image generated with respect to the lens information, wherein the lens cube 40 is configured to: It may include a lens cube switch 460 that generates a changed signal, and a lens cube connection part 450 that is in electrical communication with the stand lens cube switch 460 and can be connected to the stand touch panel 25 side.

In the contact lens virtual fitting system 1 , the lens cube light source unit 440 includes: a lens cube light source 441 disposed on at least a part of the lens cube substrate 420 disposed inside the lens cube housing 410 . ) and the lens cube housing cover body disposed at the lower end of the lens seating part 4115 to the upper side of the lens cube light source 441 to receive the light generated from the lens cube light source 441 to seat the lens cube housing cover body lens It may include a lens cube light transmitting unit 443 that transmits to the unit 4115 side.

In the contact lens virtual fitting system (1), the lens cube substrate (420) includes: a lens cube light source substrate (421) on which the lens cube light source (441) is disposed, and the lens cube connection part (450) electrically It may include a lens cube main board 423 connected thereto, and a lens cube board connection part 425 connecting the lens cube light source board 421 and the lens cube main board 423 .

In the contact lens virtual fitting system (1), the lens cube (40) further includes a lens cube elastic part (430) for elastically supporting the lens cube housing (410),

The lens cube switch 460 may generate a signal change when the lens cube elastic part 430 is pressed and a position change of the lens cube housing 410 occurs.

In the contact lens virtual fitting system (1), the lens cube elastic part (430) includes: a lens cube elastic body (431) movably received and disposed on the lens cube housing (410) side, and the lens cube housing ( A lens cube elastic support part 433 having one end opposite to the lens cube elastic body 431 side to the 410) side is formed to be in contact with the lens cube elastic body 431 may be included.

In the contact lens virtual fitting system (1), the lens cube housing (410) comprises: a lens cube housing body (413) positioned on the contact lens display stand (20), and a lens cube housing body (413) It may include a lens cube housing cover 411 that is relatively movably disposed on the upper side.

In the contact lens virtual fitting system (1), the lens cube housing body (413) includes: a lens cube housing body base (4133) positioned and seated on the contact lens display stand (20) side, and the lens cube housing body A lens cube housing body main part 4131 extending from one end of the base 4133 to form an inner space together with the lens cube housing cover 411 may be included.

In the contact lens virtual fitting system (1), the lens cube housing cover (411) includes: a lens cube housing cover body (4111) disposed to be exposed to the outside, and extending to the lower end of the lens cube housing cover body (4111) The lens cube housing cover body 4111 is formed such that the formed lens cube housing cover body extension 4113, contact lenses can be seated and disposed, and are visually exposed to the outside through the lens cube housing cover body 4111. The lens cube housing cover body may include a lens seating part 4115 disposed in the inner space.

In the contact lens virtual fitting system 1, the lens cube switch 460 includes: a lens cube fixing switch disposed on the lens cube housing body 413 side and electrically connected to the lens cube connection part 450 ( 461 ) and a lens cube movable switch 463 disposed on the side of the lens cube housing cover 411 and capable of intermittently contacting the lens cube fixing switch 461 .

In the contact lens virtual fitting system (1), the lens cube connection part 450 includes: a lens cube inner connection part 451 connected to the lens cube fixing switch 461 side, the stand touch panel 25 and It may include a lens cube outer connecting portion 453 connected to each other, and a lens cube connecting portion 455 connecting the lens cube inner connecting portion 451 and the lens cube outer connecting portion 453 to each other.

In the contact lens virtual fitting system (1), the contact lens display stand (20) includes a lens cube holder base (51) disposed inside the stand housing (21), and the lens cube (40) includes: It may include a lens cube holder base corresponding portion 53 that is fixed in position to correspond to the lens cube holder base (51).

In the contact lens virtual fitting system (1), the lens cube holder base (51) includes one of a magnetic material and a magnet, and the lens cube holder base counterpart (53) includes the other one of a magnetic material and a magnet, , may be disposed on the lens cube housing body 413 .

In the contact lens virtual fitting system (1), the stand lens position holder (211, 211a) may include an anti-slip pad on the bottom surface of the lens cube housing body (413).

In the contact lens virtual fitting system (1), the contact lens exhibition stand (20) includes: a stand display that displays a user's virtual fitting image generated through image learning through a plurality of calculations in the server (30) A stand output unit 27 including a 271 , a stand input unit 29 to which user ID information is input, and a stand communication unit 28 communicating with the server 30 and the lens cube 40 , , a cube control signal to the lens cube 40 side through the stand storage unit 24 that stores user ID information and the contact lens information transmitted from the server 30 and the stand communication unit 28 and receives selected contact lens information from among the contact lens information from the lens cube 40 side, and transmits the user ID information and the selection contact lens information to the server 30 to receive a plurality of and a stand control unit 22 that applies a communication control signal to the stand communication unit 28 so as to receive the user's virtual fitting image generated for the selection contact lens information through image learning through the operation of the lens cube, Reference numeral 40 denotes: a lens cube switch 460 that generates a signal changed by a user's selection operation, a lens cube control unit 44 that receives a signal from the lens cube switch 460, and the lens cube control unit 33 ) may include a lens cube communication unit 48 forming a signal transmission with the stand communication unit 28 according to the communication control signal.

In the contact lens virtual fitting system (1), when the user operates the lens cube switch (460), the lens cube control unit (44) is the lens cube (40) selected by the user through the lens cube communication unit (48) You can also pass selection information for .

In the contact lens virtual fitting system (1), in the server (30), the contact lens information including ID link information linked to the user's ID information and the recommended contact lens information for the user is displayed on the contact lens Delivered to the stand 20, the contact lens display stand 20 transmits information to the lens cube 40 corresponding to the requested contact lens information, and the lens cube 40 corresponding to the requested contact lens information ), the lens cube control unit 44 may receive the requested contact lens information from the contact lens display stand 20 through the lens cube communication unit 48 .

In the contact lens virtual fitting system 1, the lens cube control unit 44 of the lens cube 40 corresponding to the requested contact lens information applies a light output control signal to the lens cube light source unit 440. may be

According to another aspect of the present invention, as a lens cube arranged in a store and arranged on a contact lens display stand 20 capable of receiving user's ID information and accommodating a contact lens, the contact lens display stand 20 and a server 30 capable of receiving ID information and transmitting ID linkage information and contact lens information stored in response to the ID information, and the contact lens display stand 20 displays selected contact lens information selected from among the contact lens information. transmitted to the server 30, and from the contact lens exhibition stand 20, the user contact lens non-wear image information and the user's preset contact lens wearing image information included in the selected contact lens information and the ID link information Based on a plurality of calculations in the server 30, when a user's virtual fitting image for the selection contact lens is generated through image learning, a contact lens can be accommodated therein and the contact lens display stand 20 ) and a lens housing 410 disposed in the lens housing 410 and a lens cube light source unit 440 capable of emitting light toward the contact lens disposed in the lens housing 410 is provided.

The contact lens virtual fitting system and the contact lens virtual fitting method according to the present invention are a contact lens including a user's preset contact lens wearing image and a user's non-wearing image, as well as a user's selected contact lens or a recommended contact lens, etc. By using the lens information, it is possible to generate contact lens wearing generic image information for the contact lens wearing the selected contact lens or the recommended contact lens selected by the user through the learning process of artificial intelligence.

The contact lens virtual fitting system and the contact lens virtual fitting method according to the present invention are a learning process through an image learning step. Image information capable of removing or minimizing the sense of heterogeneity with the actual worn image due to the difference in the user's iris or corneal thickness. can be generated and output.

The contact lens virtual fitting system and the contact lens virtual fitting method according to the present invention generate color correction data using RGB values of pixels in the Scraera region in the image of the eyeball region, and correct the data in the Scraera region and the pupil iris region for shooting. A more accurate image generation process may be performed by correcting image errors or deviations due to environmental differences.

The contact lens virtual fitting system, the contact lens virtual fitting method, and the contact lens display stand according to the present invention provide a more accurate wearing image to store visitors in an offline store to assist in product selection, thereby reducing the cost required for each store visitor in the store. By minimizing time, increasing product sales, and minimizing the gap with actual wear, it is possible to provide predictability to product buyers and increase store credibility.

The contact lens virtual fitting system and the contact lens virtual fitting method according to the present invention, the contact lens display stand and the lens cube are matched to the product selected through the light source display for the selection contact lens selected to the store visitor in the offline store. It can also provide convenience in product selection.

1 is a schematic configuration diagram of a contact lens virtual fitting system according to an embodiment of the present invention.
2 is a configuration diagram of a server of a contact lens virtual fitting system according to an embodiment of the present invention.
3 is a block diagram of a server control unit of a contact lens virtual fitting system according to an embodiment of the present invention.
4 is a block diagram of a user terminal of a contact lens virtual fitting system according to an embodiment of the present invention.
5 to 7 are schematic configuration diagrams of a control module, an AI module, and an image processing module of a contact lens virtual fitting system according to an embodiment of the present invention.
8 is a flowchart of a contact lens virtual fitting method of a contact lens virtual fitting system according to an embodiment of the present invention.
9 to 12 are schematic diagrams of image display items of an application of a user terminal of a contact lens virtual fitting system according to an embodiment of the present invention.
13 to 17 are diagrams showing the extraction of the eyeball region from the eye image of the contact lens virtual fitting method of the contact lens virtual fitting system according to an embodiment of the present invention, and the process of correcting the target image of the Scraera region, the puple and the iris region; to be.
18 to 20 are flowcharts of an image correction process of a contact lens virtual fitting method of a contact lens virtual fitting system according to an embodiment of the present invention.
21 is a schematic configuration diagram of an AI neural network module of a contact lens virtual fitting system according to an embodiment of the present invention.
22 to 25 are flowcharts of an image running step of a contact lens virtual fitting method of a contact lens virtual fitting system according to an embodiment of the present invention.
26 is an exemplary diagram of a contact lens display stand disposed in an offline store.
27 is another exemplary diagram of a contact lens display stand of a contact lens virtual fitting system disposed in an offline store.
28 is an exploded perspective view of the contact lens display stand of FIG. 27 .
29 is a block diagram of a contact lens display stand of a contact lens virtual fitting system according to another embodiment of the present invention.
30 and 31 are control flowcharts of a contact lens virtual fitting system according to another embodiment of the present invention.
32 is a block diagram of a lens cube disposed on a contact lens display stand of a contact lens virtual fitting system according to another embodiment of the present invention.
33 is a schematic cross-sectional view of a lens cube disposed on a contact lens display stand of a contact lens virtual fitting system according to another embodiment of the present invention.
34 to 36 are partially enlarged cross-sectional views of the detailed part of FIG. 33 .
37 is a block diagram of another example of a lens cube disposed on a contact lens display stand of a contact lens virtual fitting system according to another embodiment of the present invention.
FIG. 38 is a partially enlarged cross-sectional view of a detailed part of FIG. 37 .
39 is a block diagram of a lens cube disposed on a contact lens display stand of a contact lens virtual fitting system according to another embodiment of the present invention.

Hereinafter, a contact lens display device according to the present invention will be described with reference to the drawings.

As shown in the figure, the contact lens virtual fitting system 1 according to an embodiment of the present invention includes one or more user terminals 10 and a server 30, and in some cases, one or more offline fittings in the following description. It may also include one or more contact lens display stands 20 arranged in the store.

At least one user terminal 10 of the present invention, that is, the user terminal 10 may be a separate dedicated terminal, but may be a customer-owned terminal capable of installing a dedicated application such as a smartphone, and in some cases, through a web page, etc. Various selections are possible, such as a PC terminal that can be connected to the server 30, a notebook terminal, or a tablet that can be implemented. The user terminal 10 may transmit the user's ID information and the user's preset contact lens wearing image information through the installed application. Here, the user ID information is information that can be individually recognized by the user, and may be individually cooked for each specific design specification in consideration of factors such as personal information protection, or may take a configuration in which a separate personal de-identification process is mounted in some cases. Various configurations are possible. In addition, here, the user's preset contact lens wearing image information may be transmitted from the user terminal 10 to the server 30, where the preset contact lens refers to a contact lens for which the corresponding contact lens product information is known, and the user The preset contact lens wearing image information refers to wearing image information in a state in which a user wears a contact lens that can be confirmed by the presence of corresponding product information. The user's preset contact lens wearing image information includes image information stored in the user terminal 10, and the user terminal 10 includes a separate optical input unit, i.e., the photographed image information acquired through a camera. . That is, the user terminal 10 includes a terminal input unit 13 , and the terminal input unit 13 includes a terminal camera capable of inputting user image information.

More specifically, the user terminal 10 includes a terminal control unit 11 , a terminal input unit 13 , a terminal output unit 15 , and a terminal communication unit 17 .

The terminal input unit 13 is an input unit for inputting user ID information through the user terminal 10 . In the case of the user terminal 10 implemented as a smartphone, it may be implemented as a touch input unit capable of touch input, and the user terminal 10 . ) of the terminal output unit 15 may be implemented as a display, and the terminal input unit 13 and the terminal output unit 15 may be implemented as an integrated module such as a touch screen.

The terminal input unit 13 may include an information input means such as a keyboard, and may include a microphone for inputting voice information and sound information. As described above, the terminal input unit 13 inputs user's image information. It may include a possible terminal camera.

The terminal output unit 15 may include a terminal sound output unit 153 such as a speaker for outputting voice or sound in addition to the terminal optical output unit 151 such as a display implemented as a touch screen.

The terminal communication unit 17 may include a terminal server communication unit 171 capable of communicating with the server 30 through a network, and in some cases, a terminal stand communication unit 173 for communicating with the contact lens display stand 20 of an offline store. ) may be included. The terminal stand communication unit 173 may include a terminal stand wireless short-range communication unit or a terminal stand wired short-range communication unit, and when implemented as a terminal scan wireless short-range communication unit, a wireless communication protocol method such as Wi-Fi Direct or Bluetooth may be used. Various selections are possible within the range that can transmit ID information and user's preset contact lens wearing image information.

The terminal control unit 11 is in electrical communication with the terminal input unit 13, the terminal communication unit 17, and the terminal output unit 15, and applies an input control signal or a communication control signal to them to control the operation of each component. However, through the control process of the terminal control unit 11, input and transmission of user ID information and user's preset wearing image information, reception of a fitting image to be described later, contact lens information, etc. may be received and output controlled.

The server 30 may store, use, and transmit/receive various information including contact lens information related data and user related data for contact lenses. The server 30 in this embodiment can transmit ID information and contact lens information stored in response to ID information and ID information from the user terminal 10, and other contacts through image learning through a plurality of operations to be described below. It is also possible to create a virtual fitting image in which a user wears a lens, and transmit and transmit it.

That is, the user terminal 10 according to an embodiment of the present invention transmits selected contact lens information selected from the user contact lens non-wearing image information and contact lens information to the server 30 , and the server 30 transmits the user terminal 10 ) receives the user's pre-set contact lens wearing image information included in the user's contact lens non-wearing image information and the selection contact lens information and ID link information from ), and based on these information, the user's virtual Create a fitting image. Here, the selection contact lens refers to a contact lens selected by the user from among the contact lens information transmitted to the user terminal 10 by the user.

More specifically, the server 30 includes a server communication unit 35 , a server storage unit 33 , and a server control unit 31 .

The server communication unit 35 transmits/receives to and from the user terminal 10 through a communication network. The user terminal 10 of the contact lens virtual fitting system 1 in this embodiment also includes a terminal communication unit 17 as described above, and the terminal communication unit 17 communicates with the server 30, the server 30 ) of the server communication unit 35 transmits/receives to and from the user terminal 10 through the terminal communication unit 17 and the communication network. The server communication unit 35 of the server 30 executes various software programs and/or instruction sets stored in the memory unit to perform various functions required for the present invention, a central processing unit, a user I/F, an operating system ( (not shown) and memory for storing various necessary data, external communication port, printing device I/F, etc., in the form of an aggregate of hardware and software driving the same, and may be implemented as a part of an independent device or general-purpose processing device The communication, communication network or communication network may include, for example, at least one of LTE, LTE-A, 5G, WCDMA, CDMA, UMTS, Wibro, and GSM as a cellular communication protocol, and the communication network is wired and wireless, etc., may be configured regardless of communication types, such as a personal area network (PAN), a local area network (LAN), a metropolitan area network (MAN), and a wide area network (WAN). Network), etc., and the communication, communication network, and communication network may be a well-known World Wide Web (WWW), infrared (Infrared Data Association; IrDA) or Bluetooth (Bluetooth) or low-power Bluetooth (Bluetooth Lowenergy) and RF wireless communication include various communication methods.

The server storage unit 33 stores data received from the server communication unit 35 , and the server control unit 31 controls the server communication unit 35 and the server storage unit 33 . The server control unit 31 processes the user's preset contact lens wearing image information included in the user's contact lens non-wearing image information and the selection contact lens information and ID linkage information from the user terminal 10, and image processing the user's virtual image through image learning. Create a fitting image.

More specifically, the server control unit 31 includes a control module 311 and an AI module 313 . Each of these components may be formed of an actual physical individual element, or may be formed in the form of an integrated chip, but may be formed as a functional individual element, and various selections are possible according to design specifications.

The control module 311 controls the server communication unit 31 and the server storage unit 33 . The control module 311 provides a server communication control signal to the server communication unit 31 and a server storage control signal to the server storage unit 33 . is applied to control the operation of each module.

The AI module 313 operates according to the image learning control signal of the control module 311 , and the AI module 313 image-processes image information and generates a virtual fitting image. More specifically, the AI module 313 image-processes the user's preset contact lens wearing image information included in the user's contact lens non-wearing image information and the selection contact lens information and ID linkage information from the user terminal 10 . Also, the AI module 313 generates a virtual fitting image of the user through image learning using image information processed according to the learning control signal of the control module 311 .

The server control unit 31 includes an image processing module 315, and the image processing module 315 may extract and process an eye region image from the user's user contact lens non-wearing image information and preset contact lens wearing image information.

More specifically, the control module 311 includes a communication storage control module 3115 , an AI control module 3111 , and an image processing control module 3113 .

The communication storage control module 3115 applies a communication and storage signal for controlling the server communication unit 31 and the server storage unit 33 to transmit/receive data to and from the user terminal 10 through the server communication unit 31 . The AI control module 3111 applies a learning control signal for image learning of the AI module 313 to implement the image learning operation of the AI module 313 . The image processing control module 3113 applies an image processing control signal to the image processing module 315 .

The image processing module 315 includes an image generating module 3153 that generates an image. The image generating module 3153 of the image processing module 315 receives an image processing control signal from the image processing control module 3113 . generates a virtual fitting image of a user who wears the selection contact lens using the learning result and the selection contact lens information in the AI neural network module 3131 .

In some cases, the image processing module 315 may further include an image extraction module 3151 in addition to the image generating module 3153 . That is, the image processing module 315 includes an image extraction module 3151, and the image extraction module 3151 can extract an image of the eyeball region from the user's contact lens non-wearing image information and the user's preset contact lens wearing image information. do. The image extraction module 3151 extracts only an important area, ie, an eye area, from among the user's contact lens wearing image or the user's contact lens not wearing image to minimize the computational load, thereby increasing the computation speed, and removing unnecessary image computation process. Cost minimization may be achieved.

A separate image correction module 3155 for correcting image deviation due to environmental differences during image extraction or image shooting may be included, and such a correction function may be integrated into the image extraction module or image generation module. Various modifications are possible depending on the The image correction module 3155 may perform various functions, such as correcting an extracted image or partially correcting a finally learned and output image. The image correction module 3155 may execute the user image correction step (S191) of the user worn image processing step (S19) of a modification of the contact lens virtual fitting method according to an embodiment of the present invention to be described later, the user image correction step (S191) may be corrected using the user's eyeball image information before execution of the user image AI processing step (S193).

The AI module 313 includes an AI learning module 3133 in addition to the AI neural network module 3131, and the AI learning module 3133 is an AI neural network module 3131 according to the learning control signal of the AI control module 3111. The AI learning signal is applied to, the AI learning module 3133 is configured to apply a separate learning control signal in this embodiment, but in some cases, the learning control signal application function is integrated into the AI control module 3111. Various configurations are possible according to design specifications, such as taking

On the other hand, as described above, the AI control module 3111 is operated according to the image learning control signal of the control module 311 to process image information and generate a virtual fitting image, the AI control module 3111 ), the AI module 313 operating according to the control signal of the user terminal 10 processes the image information of the user's preset contact lens wearing image information included in the user's contact lens non-wearing image information and the selection contact lens information and ID linkage information from the user terminal 10. However, this image processing is done through artificial intelligence learning.

That is, by using the user's preset contact lens wearing image information included in user ID information and lens data and ID linkage information, input stored artificial intelligence algorithm or machine learning algorithm through machine learning or artificial intelligence learning, for example, CNN (Convolution Neural Network), etc., to generate a virtual fitting image of a user for a new contact lens through artificial intelligence learning using user ID-linked information such as age and iris color in user ID information. can

The AI neural network module 3131 generates a virtual fitting image of the user wearing the selection contact lens using the learning result and the selection contact lens information from the AI neural network module 3131, and various choices are made within a range that can be transmitted so that it can be output. Although possible, in this embodiment, the case of using Generative Adversarial Networks (GAN) will be mainly described, but the present invention is not limited thereto, and various selections of various neural network structures are possible.

A generative adversarial network used as an embodiment of the present invention is a part of a deep neural network structure composed of two or a plurality of networks, in which one network is at least antagonistic to another network, or in other words, mutually antagonistic. It refers to a neural network structure that is operated to perform a purpose.

The image processing module 315 includes an image generating module 3153 that generates an image. The image generating module 3153 of the image processing module 315 receives an image processing control signal from the image processing control module 3113 . uses the learning information learned from the AI neural network module 3131, and the AI neural network module 3131 according to an embodiment of the present invention includes a generator 31311 and a disk limiter 31313.

More specifically, in FIG. 21, an example of the AI neural network module 3131 of the present invention is shown, and the rectangular figure of the configuration indicated by reference numeral 31311 is exemplarily shown to shape a layer, and the present invention is limited thereto. it is not The AI neural network module 3131 of the present invention includes a generator 31311 and a discriminator 31313 as shown in FIG. Generative image information for wearing the contact lens is generated through a plurality of calculations that can be weighted using the input image information, and the discriminator 31313 is configured to include the generic image information for wearing the contact lens and the user's dictionary. By using the set contact lens wearing image information, it is determined whether the corresponding contact lens wearing generic image information is real or fake through a plurality of calculations that can be weighted, and weights or parameters are adjusted in a direction to minimize the value of the loss function. Execute a predetermined learning function.

That is, the generator 31311 and the discriminator 31313 perform a learning process to achieve mutually opposing goals in a competitive relationship with each other, and through this, in the final generator 313111 through the enhancement of each learning function, Create an image that is difficult to distinguish the generated generative image information from the real one. In this embodiment, the generator 31311 and the discriminator 31313 are backpropagated to a non-linear activation function structure in a plurality of hierarchical structures, respectively, in implementing the deep learning neural network. It is designed using the backpropagation principle, and the product of weights or parameters is used as the input value of the neurons of the next layer in the output values of the neurons of a plurality of layers, and the activation function ( Activation function) is applied to execute the learning process to find the optimal weight, and the weight is initially randomly selected, but in the direction of minimizing the loss function, that is, the loss function value is transmitted to the weights of each layer through back propagation. can be updated in such a way as to achieve the achievement of competing objectives in this learning process.

The generator 31311 of the present invention generates the contact lens wearing generic image information for the corresponding contact lens through a plurality of calculations that can be weighted using at least the user's contact lens non-wearing image information and the input image information of the contact lens information, and , the discriminator 31313 determines whether the corresponding contact lens wearing generic image information is real or fake through a plurality of calculations that can be weighted using the contact lens wearing generic image information and the user's preset contact lens wearing image information decide whether That is, the generator 313111 generates the contact lens wearing generative image information for the contact lens that is difficult to distinguish from the real possible from the user contact lens not wearing image information and the input image information of the contact lens information, and vice versa, the discriminator ( 31313) uses the contact lens wearing generic image information and the user's preset contact lens wearing image information to determine whether or not a fake as a generated image rather than an actual image with a high possible probability.

More specifically, the AI learning module 3133 includes a generator 31311 and a discriminator 31313 included in the AI neural network module 3131 to learn the generator 31311 included in the AI neural network module 3131 . However, when the AI learning module 3133 applies the generation learning control signal to the generator 31311, the discriminator 31313 executes a predetermined learning process. At this time, the AI learning module 3133 adjusts the complex calculation weights of the generator 31311, and the adjustment of these complex calculation weights or parameters means that the contact lens wearing generative image information to which the discriminator 31313 is input is real. It is determined in the direction to be judged, and the generator 31311 generates as close to an actual image as possible, so that the discriminator 31313 learns not to distinguish fakes.

In addition, the AI learning module 3133 is provided in the generator 31311 and the discriminator 31313 provided in the AI neural network module 3131 to learn the discriminator 31313 provided in the AI neural network module 3131. When the learning control signal is applied, but the AI learning module 3133 applies the discremination learning control signal to the discriminator 31313, the discriminator 31313 is generated by the generator 31311 and the discriminator ( The AI learning module 3133 adjusts the complex calculation weight of the discriminator 31313 to determine that the contact lens wearing generative image information input to 31313 is a fake, so that the discriminator 31313 is a fake For example, learn to select close to 100%.

Hereinafter, a contact lens virtual fitting method through the contact lens virtual fitting system 1 of the present invention will be described with reference to the drawings.

A contact lens virtual fitting method according to an embodiment of the present invention includes information transmission and information request step (S10), information transmission and information transmission step (S11), user image acquisition and storage step (S13, S15), and user image It includes a transmission step (S16), a selection contact lens information transmission step (S17), a user image server storage step (S18), and a user worn image processing step (S19).

First, in the information transmission and information request step (S10), the user's ID information is transmitted to the server 30 through the application installed in the user terminal 10, and the ID linkage information and contact lens information linked to the user's ID information are provided. is requested That is, in the information transmission and information request step ( S10 ), the user terminal 10 may provide a user terminal code including user ID information through an application installed in the user terminal 10 , and the user ID information is the user ID. , age, iris color, etc., in some cases, may include more specific personal information such as age, name, address, phone number, etc. They may be stored on the server 30 side, and they may be stored encrypted to prevent the risk of privacy violation due to personal information leakage, or may be configured with a minimum amount of data features to provide user convenience.

That is, as shown in the drawing, a screen for executing an application in the user's user terminal 10 is shown, and the server 30 can be accessed through the user's user ID information.

In addition, the user ID linkage information may include contact lens information selected or purchased by the user or reviewed by user reviews, and this information may be stored in the server 30 .

In the information transmission and information sending step (S11), the server 30 transmits ID link information and contact lens information linked to the user's ID information to the user terminal 10. In the information transmission and information sending step (S11) The server 30 checks and transmits user ID linkage information corresponding to the user's ID information input from the user terminal 10, and at the same time transmits contact lens information, that is, information on the latest updated contact lens product. . At this time, in the contact lens information, big data-processed customized contact lens information related to user ID linkage information, that is, the user's review, selection or purchase information and user ID is reflected in consideration of features such as age, gender, season, and weather. It may include big data processing and recommended contact lens information. As shown in the figure, the user ID linkage information transmitted from the server 30 and the information on the contact lens product may be displayed on the display screen of the terminal output unit 15 of the user terminal 10, Contact lens product information or user reviews may be displayed.

Then, the user image acquisition and storage step (S13, S15) is executed, in the user image acquisition and storage step (S13, S15) through the application installed in the user terminal 10, the user's preset contact lens wearing image and the user contact lens An image from which non-wearing image information is acquired is acquired and stored, and the user image acquisition and storage steps (S13 and S15) may include a user image acquisition step (S13) and a user image storage step (S15), wherein the user image is already stored in the user terminal When stored in the terminal storage unit 19 of (10), various modifications are possible according to design specifications, such as not requiring a separate user image storage step.

Then, the user image transmission step (S16) is executed. In the user image transmission step (S16), the user's preset contact lens wearing image and the user's contact lens not wearing image information are transmitted from the user terminal 10 to the server 30 do. Here, the user's preset contact lens wearing image refers to image information taken while the user is wearing a contact lens that has already been purchased or worn, and information about the contact lens, that is, which contact lens is worn and taken Product information such as a product name or a model name for confirmation may be transmitted at the same time.

For example, as shown in the figure, the photographed or stored user's worn image or not worn image is transmitted to the server 30, and this image information may be stored in the form of user ID linkage information, which is a user terminal It can also be checked in the application of

After the user image transmission step (S16) is executed, the selection contact lens information transmission step (S17) is executed. Among the contact lens information displayed on the application of the user terminal 10, information on the contact lens selected by the user, that is, the selection Contact lens information is transmitted to the server 30 . That is, the selection contact lens information selected in the user terminal 10 is selected as shown in the drawing, for example, 'M007 Burgerdy Brown', and the selection information of the corresponding product is the selection contact lens information to the server 30 side. is sent

In the selection contact lens information transmission step (S17), the server 30 receives the selected selection contact lens information among the contact lens information from the user terminal 10 side, and then the server 30 stores the information in the server 30 The user image server storage step (S18) is executed, and the user's preset contact lens wearing image and the user's contact lens not wearing image information received by the server 30 in the user image server storage step (S18) correspond to the user's ID information It is stored as ID linkage information. In this process, as described above, various configurations are possible according to design specifications, such as a process of de-identification of individuals for personal information protection may be added.

Then, the user wearing image processing step (S19) is executed, the server 30 generates a virtual fitting image of the user wearing the selection contact lens selected by the user. That is, the user wear image processing step (S19) includes the user image AI processing step (S193), the server 30 in the user image AI processing step (S193) the selection contact lens through image learning through a plurality of operations Generates a virtual fitting image of the user for , this generation process is based on the user's preset contact lens wearing image and the user's contact lens not wearing image information.

On the other hand, in some cases, the user worn image processing step (S19) of the modified example of the contact lens virtual fitting method according to an embodiment of the present invention may include a user image correction step (S191), the user image correction step (S191) may further include a user image correction step (S191) of correcting using the user's eye image information before the execution of the user image AI processing step (S193). This correction process is performed by a separate image processing module 315 Various modifications are possible, such as being executed in the image correction module 3155 or integrally executed in other image extraction modules or image generation modules. In this embodiment, the case in which the image correction module performs correction will be mainly described. That is, since the image conditions of the transmitted images photographed and transmitted by the user are different, a correction process to minimize the effect on accurate image learning may be further executed. It may include an information input step (S1911), a target image extraction step (S1913), and a target image correction step (S1915). First, the control module 311 provided in the server control unit 31 of the server 30 in the image information input step (S1911) to control the server communication unit 31 and the server storage unit 33 of the server 30 In the image processing module 315 , the user's contact lens non-wearing image information and preset contact lens wearing image information are input.

Then, in the target image extraction step (S1913), the image of the eyeball region is extracted from the image extraction module 3151 of the image processing module 315, the user's contact lens non-wearing image information and the user's preset contact lens wearing image information. That is, as shown in the drawing, the eyeball region is checked among the images of the entire face, the corresponding eyeball region is selected as the target image, and the target image of the target region is extracted.

More specifically, the target image extraction step (S1913) includes the target image scratcher extraction step (S19131) and the target image puple iris extraction step (S19133). In the target image sclera extraction step (S19131), an image of a sclera (sclera) region of the eyeball region is extracted from the user's contact lens non-wearing image information and the user's preset contact lens wearing image information. There is a high possibility that a color difference between photographed images may occur due to a difference in various photographing conditions according to a camera as an acquired photographing device or a circumferential illuminance situation. Accordingly, images of sclera (sclera) regions (Asn, Asw) of the eye area are extracted from the user's contact lens not wearing image information and the user's preset contact lens wearing image information in an embodiment of the present invention do. This may minimize the deviation according to the photographing state of the color of the remaining pupil or iris region by extracting the so-called white of the eye, that is, the white region and correcting the color through this.

After the target image scratch extraction step (S19131) is executed, in the target image puple iris extraction step (S19133), the pupil iris (pupil, iris) of the eyeball area among the user contact lens non-wearing image information and the user's preset contact lens wearing image information and a target image puple iris extraction step (S19133) of extracting images of pupil (瞳孔) and iris (虹彩) regions (Apn, Apw).

For example, the drawing shows an image of a user wearing a contact lens and an image of a user not wearing a contact lens, which are taken in different shooting environments. Among the user's contact lens not wearing image information and the user's preset contact lens wearing image information, The sclera (sclera) region of the eyeball region is denoted by reference numerals Asw and Asn, and similarly, the pupil iris (pupil, The iris; pupil and iris) regions are denoted by reference numerals Apn and Apw, respectively, indicating the wearing case and non-wearing case of the Sclera region, and the reference numeral CL designating a contact lens.

A difference occurs in the RGB values of the white color of the pixels in the scratch area according to the difference in the environment in which the image is acquired and photographed. In consideration of this situation, the target image correction step S1915 is executed. That is, in the target image correction step (S1915), the image of the eyeball region among the preset contact lens wearing image information is corrected in the image extraction module 3155 of the image processing module 315. More specifically, the target image correction step (S1915) includes a target image sclera region checking step (S19151), a target image sclera correction calculation step (S19153), and a target image correction execution step (S19155).

In the target image sclera (sclera) region confirmation step (S19151), the target image sclera (sclera) region extracted in the target image sclera extraction step (S19131) is checked, and the target image The scratch correction calculation step (S19153) is executed. That is, in the target image sclera correction calculation step ( S19153 ), color correction data is checked using image information of the sclera region of the target image, and the white color of the sclera region of the extracted target image is determined Check the color deviation using the displayed RGB value to check the color correction data.

A target image correction execution step ( S19155 ) is executed using the color correction data confirmed in the target image scratch correction calculation step ( S19153 ). That is, by using the color correction data confirmed in the target image scratch correction calculation step ( S19153 ), image information of the target image pupil, iris (pupil, iris) region and the target image scratch The image information of the (sclera; sclera) area can be color corrected. By using the color deviation of the scratcher area, it is converted into color correction data, and the image of the pupil or iris area of the target image and the image of the scratcher area are corrected to confirm more accurate image information.

Then, the user image AI processing step (S193) of the user wearing image processing step (S19) is executed, in the user image AI processing step (S193), the server 30 selects contact lenses through image learning through a plurality of operations Generates a virtual fitting image of the user for , this generation process is based on the user's preset contact lens wearing image and the user's contact lens not wearing image information.

More specifically, the user image AI processing step (S193) includes an image data input confirmation step (S1931), a wearing generating image generation step (S1933), an image learning step (S1935), and a fitting image output step (S1937) do.

In the image data input confirmation step ( S1931 ), the user's preset contact lens wearing image and the user's contact lens non-wearing image information are input and confirmed. That is, the user ID linkage information stored in the server storage unit 33 of the server 30 and the user's preset contact lens wearing image and the user's contact lens not wearing image information are checked.

Then, the wearing generating image generation step ( S1933 ) is executed using the user's preset contact lens wearing image and the user's contact lens non-wearing image information confirmed in the image data input confirmation step ( S1931 ). In the wearing generating image generating step (S1933), a wearing generating image in which the user's preset contact lens is worn is generated through a plurality of calculations using the user's contact lens not wearing image information and the preset contact lens information. The generating image is generated by the generator 313111 of the Ai neural network module 3131, and this image generation is performed through adjustment and generation of RGB values of image pixels.

Then, the image learning step (S1935) is executed. In the image learning step (S1935), the generator 31311 and the discriminator 31313 of the AI neural network module 3131 on the server 30 side, the user's Image learning is performed through a plurality of calculations using a preset contact lens wearing image and the wearing generating image. More specifically, the image learning step (S1935) includes a discremination learning step (S19351) and a generation learning step (S19353), and in the discremination learning step (S19351), the AI learning module of the control module 311 The AI learning module 3133 provided in 3133 applies a learning control signal to the discriminator 31313 .

As such, when the discriminator 31313 receives a learning control signal from the AI learning module 3133, a predetermined learning process is executed. In comparing the preset contact lens wearing images of , contact lens wearing generic image information input to the discreminator 31313 is generated by the generator 31311 . At this time, the discriminator 31313 is learned to determine that the contact lens wearing generic image information is fake, and the AI learning module 3133 adjusts the complex calculation weight of the discriminator 31313 .

On the other hand, in the generation learning step ( S19353 ), the AI learning module 3133 provided in the AI learning module 3133 of the control module 311 applies a learning control signal to the discriminator 31313 . At this time, the AI learning module 3133 adjusts the complex computation weight of the generator 31311. This adjustment of the complex computation weight of the generator 31311 means that the contact lens wearing generative image information to which the discriminator 31313 is input is actually It is done in the direction to judge that it is

After the image learning step (S1935) is executed, the fitting image output step (S1937) is executed. At least through the generator 31311 of the AI neural network module 3131 learned in the image learning step (S1935), the user contact lens Generative image information for wearing contact lenses for other contact lenses is generated through a plurality of calculations that can be weighted using image information not worn and input image information of contact lens information. That is, by using the selection contact lens information selected by the user and the user's contact lens non-wearing image information to the generator 31311 learned through the image learning step (S1935), the selection contact lens information newly selected by the user is worn by the user. To create a virtual virtual image, if the image of the eye area is extracted and trained in advance, image processing and output in the form of synthesizing the virtual image wearing the user's selection contact lens information for the eye area over the entire face of the user may be executed have.

Meanwhile, in the previous embodiment, a virtual virtual fitting image for a contact lens selected or recommended by the user through AI learning based on the user's information input through the user terminal 10 and the preset contact lens wearing image and non-wearing image Although the system and method for deriving the ? have been described, in this process, the implementation of the contact lens virtual fitting system of the present invention may be made through an offline store. That is, the contact lens virtual fitting system 1 according to another embodiment of the present invention includes a contact lens display stand 20 and a server 30 as shown in FIG. 26, unlike in the previous embodiment, in which case Accordingly, a configuration in which the user terminal 10 is further provided may be taken. Although the contact lens display stand of the contact lens virtual fitting system of the present invention may take the configuration shown in FIG. 26, it may have a tiltable movable structure or a fixed tilted structure, so that the inclined structure as shown in FIGS. 28 and 28 may take

The present invention includes a contact lens display stand 20, the contact lens display stand arranged in the store of the present invention, a plurality of lens cubes for accommodating contact lenses are arranged, the user's ID information can be received, ID information In connection with the server 30 capable of transmitting the stored ID link information and contact lens information in response, the selected contact lens information selected from the contact lens information is transmitted to the server 30, and included in the selection contact lens information and ID link information Based on the user's contact lens non-wearing image information and the user's preset contact lens wearing image information, the server 30 receives a virtual fitting image of the user generated for the selected contact lens through image learning through a plurality of calculations. An image can be displayed on the contact lens display stand 20 .

That is, as shown in FIG. 26 , a contact lens display stand 20 arranged in an offline store is shown, and a plurality of lens cubes 40 are arranged on the contact lens display stand 20 arranged in the store. and contact lenses CL may be accommodated in each lens cube. The contact lens display stand 20 may receive user ID information of the user. A method for the contact lens exhibition stand 20 to receive user ID information of a user may be input through wired or wireless communication or a separate input unit. That is, the method of transmitting the user ID information of the user to the contact lens display stand 20 may be through the stand input unit 29 to be described later of the contact lens display stand 20 , or the contact lens display stand 20 . Various modifications are possible, such as being made through the stand communication unit 28 .

The server 30 has substantially the same specific configuration as in the previous embodiment, but focusing on the differences, the server 30 receives user ID information from the contact lens display stand 20 and responds to the ID information. The stored ID linkage information and contact lens information can be transmitted to the contact lens display stand 20 .

In addition, the contact lens exhibition stand 20 transmits the selected contact lens information among the contact lens information to the server 30, and the server 30 transmits the selection contact lens information and ID link information from the contact lens exhibition stand 20 to the Based on the included user contact lens non-wearing image information and the user's preset contact lens wearing image information, the server 30 generates a virtual fitting image of the user for the selected contact lens through image learning through a plurality of operations. .

The process of generating the virtual virtual fitting image in the server 30 is the same as the structure in the previous embodiment. When explaining the difference, the difference from the previous embodiment is that the user ID information and the selection contact lens information are displayed as contact lenses. Received from the stand 20, and in some cases, the user's contact lens non-wearing image information and the user's preset contact lens wearing image information may also be received from the contact lens display stand 20 or may have a structure already stored in the server 30. , if it is stored in the server 30 in advance, it may be a case that it has already been transmitted and stored from the application of the user terminal 10, or it may be a case that it has already been acquired and transmitted from the contact lens exhibition stand 20 and stored in the server 30, etc. If it is already stored, it may be stored in the server storage unit 33 of the server 30 as user ID linkage information.

More specifically, the contact lens display stand 20 includes a stand housing 21 , a stand cover 23 , a stand touch panel 25 , a stand output unit 27 , a stand input unit 29 , and a stand It includes a communication unit 28 , a stand storage unit 24 , and a stand control unit 22 .

The stand housing 21 is disposed in an offline store (SHOP) and has a preset inclination. Although the stand housing 21 is shown as having a simple box-shaped structure in this embodiment, in some cases, a wheel is provided at the bottom to provide an offline store Various modifications are possible according to design specifications, such as to facilitate position transfer within the vehicle or to provide a wheel lock to prevent unwanted movement.

In the present embodiment, the stand housing 21 may take a configuration in which at least a portion of the front portion and the flat portion have an inclined arrangement having a preset angle to maximize spatial utility in the store. A stand cover 23 is disposed on the inclined portion of the stand housing 21 , and the stand cover 23 engages with the stand housing 21 to form an internal space to enable accommodating arrangement of other components.

The stand cover 21 has a stand housing 21 disposed on one side to form an internal space. More specifically, in the present embodiment, a plurality of holes are formed in the front surface of the stand cover 21 to allow the receiving arrangement of the lens cube to be described later. The stand cover 21 in this embodiment may take a plate structure formed of a hard material, but in some cases, it is implemented in a simple film form so that it is appropriate for event planning such as seasonal or event promotion in offline stores. It may take a configuration in which various changes such as the position of the hole and the catch phrase of the surface are possible, and as another modification, the stand cover 21 may take a plurality of configurations to take a composite structure of a plate and a cover film, etc. Various modifications are possible.

In some cases, the contact lens display stand 20 may include a component further disposed between the stand cover 21 and the stand housing 23 . That is, the contact lens display stand 20 may include a stand spacer 60, which is disposed between the stand housing 21 and the stand cover 23 to form a gap between the two. have. For example, when the stand cover 21 is implemented as a film type, it does not have sufficient rigidity, and thus a display function may be restricted, and a stand spacer ( 60), it is possible to smoothly maintain the position of the stand cover 21 so that the display function can be smoothly performed.

On the other hand, although the stand spacer 60 is implemented in a plate type in this embodiment, various modifications are possible, such as being implemented in a plurality of blocks in some cases. As in this embodiment, the stand spacer 60 is implemented in a plate type and has a predetermined thickness In the case of having , the stand spacer 60 has a stand spacer through hole 61 to allow the plurality of lens cubes 40 to be disposed through and to increase the degree of freedom of arrangement to enable smooth positioning. The sphere 61 preferably has a structure formed to correspond to the stand cover through hole 211 formed in the stand cover 21 .

The stand touch panel 25 is disposed in the inner space of the stand cover 23 and the stand housing 21, is connected to the lens cube 40, and is in electrical communication, and applies an electrical signal to the lens cube 40, The stand touch panel 25 functions as an electrical connector connecting the lens cube 40 and the stand control unit 22 (refer to FIG. 29 ) of the contact lens display stand 20 to be described later in this embodiment. The stand touch panel 25 may be formed in a plurality of matrix wiring structures, and may have a structure in which signal input/output is possible at a position in contact with the connection terminal side of the lens cube side. Through this configuration, information on the corresponding lens cube and the set position value of the stand touch panel 25 are transmitted to the stand control unit 22, and the corresponding lens cube is set at a specific position in the stand touch panel 25, and , a signal from the corresponding lens cube is transmitted to the stand control unit 22 through the stand touch panel 25 , and a signal from the stand control unit 22 is transmitted to the corresponding lens cube side through the stand touch panel 25 . .

The stand output unit 27 includes a stand display 271 that displays a virtual fitting image of a user generated through image learning through a plurality of operations in the server 30 . That is, the stand output unit 27 may output virtual contact lens virtual fitting image information generated from the server 30 according to a stand output control signal of the stand control unit 22 to be described below. ) can be variously modified, such as may further include a stand speaker that forms a sound output in addition to the display output.

The stand input unit 29 may be used for inputting user ID information or for inputting information for matching the position of each lens cube to the stand control unit 22 on the stand touch panel 25, the stand input unit 29 Various modifications are possible, such as may be implemented in the form of a conventional keyboard, mouse, or touch screen input device, or may be implemented in the form of an input port such as a USB terminal.

The stand communication unit 28 communicates with at least the server 30 , and some functional overlaps exist with the stand input unit 29 in terms of input/output of information, so that a partially integrated structure may be adopted. The stand communication unit 28 may execute communication with the server communication unit of the server 30 through a network, and in some cases, input/output of user ID information through wired/wireless communication with the user terminal 10 or a plurality of operations selected by the user Various modifications are possible according to design specifications, such as performing a transmission function such as a contact lens virtual fitting image for a corresponding contact lens calculated through .

That is, the stand communication unit 28 may include a stand server communication unit 281 and a stand short-distance communication unit 283, and the stand server communication unit 281 may achieve wired, wireless or wired/wireless communication with the server 30, The stand short-distance communication unit 283 may communicate with other devices in the offline store, for example, the user terminal 10 of the user, and in some cases a plurality of lens cubes disposed on the contact lens display stand 20 and It is also possible to form a communication connection structure of

The stand storage unit 24 stores user ID information and stores contact lens information transmitted from the server 30 according to the stand storage control signal of the stand control unit 20 , and the stand storage unit 24 stores the server 30 . ) may store information about the updated contact lenses transmitted from.

The stand control unit 22 applies a block control signal to the lens cube 40 side through the stand touch panel 25 and receives selected contact lens information from the contact lens information from the lens cube 40 side, and user ID information and by transmitting the selection contact lens information to the server 30 to receive the user's virtual fitting image generated for the selection contact lens information through image learning through a plurality of operations in the server 30. Communication to the stand communication unit 28 Apply a control signal. That is, the stand server communication unit 281 of the stand communication unit 28 transmits and receives signals with the server communication unit 35 of the server 30 , and the stand short-range communication unit 283 of the stand communication unit 280 is the user terminal 10 of the user. ) may form a communication connection structure with a plurality of lens cubes disposed on the terminal communication unit 19 or the contact lens display stand 20 of the .

The server 30 in this embodiment includes a server communication unit 35, a server storage unit 33, and a server control unit 31, and is substantially the same as in the previous embodiment, but the server in this embodiment The communication unit 35 transmits and receives to and from the contact lens exhibition stand 20 through a communication network, the server control unit 31 controls the server communication unit 35 and the server storage unit 33, and the contact lens display stand 20 User contact lens non-wearing image information, selection contact lens information, and user's preset contact lens wearing image information included in ID linkage information can be image-processed and a virtual fitting image of the user can be generated through image learning. As described above, the lens non-wearing image information, the selection contact lens information, and the user's preset contact lens wearing image information included in the ID linkage information may be transmitted from the contact lens display stand 20, or the user's user terminal Various configurations are possible, such as (10) through being transmitted from the user terminal 10 and stored in the storage unit 33 of the server 30 .

On the other hand, the stand input unit 29 includes a stand optical input unit 291 (refer to FIG. 26 ). The stand optical input unit 291 is implemented as a camera, and the stand optical input unit 291 implemented as a camera is a preset contact of the user. Lens wearing image information or user contact lens non-wearing image information may be input. In the drawings, the stand input unit 29 is illustrated as being integrally formed outside the stand display 271 , but this is an example, and the stand optical input unit 291 of the present invention is not limited thereto, and various modifications are possible.

On the other hand, the contact lens display stand 20 according to an embodiment of the present invention may further include a lens cube holder 50, which prevents the sliding of the plurality of lens cubes 40. do. The front part formed by the stand housing 21 and the stand cover 23 of the contact lens display stand 20 according to this embodiment is inclined at a preset angle to minimize the space occupancy in the offline store, Due to this inclined structure, there is a high possibility that the lens cube 40 disposed therein slips in the display state, and the lens cube holder 50 of the present invention prevents the lens cube 40 from sliding and prevents unwanted movement You may.

The lens cube holder 50 according to an embodiment of the present invention includes a lens cube holder base 51 and a lens cube holder base counterpart 53 . The lens cube holder base 51 is an internal space formed by the stand housing 21 and the stand cover 23 and is positioned so that the stand touch panel 25 is disposed between the stand housing 21 and the stand housing 21 . In addition, the lens cube holder base counterpart 53 is disposed at the lower end of the lens cube, and at least one of the lens cube holder base 51 and the lens cube holder base counterpart 53 may be a magnet. That is, when the lens cube holder base 51 is a magnetic material, the lens cube holder base counterpart 53 is a magnet, and when the lens cube holder base 51 is a magnet, the lens cube holder base counterpart 53 may be a magnetic material. have. In this embodiment, the lens cube holder base counterpart 53 may be implemented with a magnet, and may take a configuration to fix the position in an inclined structure by an attraction force by a magnetic force.

Hereinafter, a contact lens virtual fitting method including the contact lens display stand of the present invention is provided. Although the contact lens virtual fitting method is different in that it is performed between the contact lens display stand 20 and the server 30, the configuration is almost similar to the previous embodiment, and the difference will be mainly described.

As shown in FIG. 30, the contact lens virtual fitting method includes an information transmission and information request step (S20), an information transmission and information transmission step (S21), a lens information display step (S22), and a lens selection step (S23). ), a selection lens information transmission step (S24), a user wearing image processing step (S19), a selection contact lens wearing image transmission step (S25), and a selection contact lens wearing image output step (S26), including information In the transmission and information request step (S20), the user's ID information is transmitted to the server 30 from the contact lens exhibition stand 20 in which a plurality of lens cubes accommodating contact lenses disposed in the store are disposed, and the user's ID information ID link information and contact lens information linked to are requested, and in the information transmission and information transmission step (S21), the ID link information and contact lens information linked to the user's ID information in the server 30 are displayed on the contact lens display stand 20 ), and in the lens information display step (S22), the contact lens information is displayed as an image on the stand display 271 of the stand output unit 17 of the contact lens display stand 20, and in the lens selection step (S23), the user The contact lens information selected by the user is inputted through the lens cube 40 by the .

In addition, in the ID selection lens wearing eye image generation step (S19), based on the user's preset contact lens wearing image and the user's contact lens not wearing image information, the user's virtual for the selection contact lens through image learning through a plurality of calculations and a user image AI processing step (S193) of generating a fitting image. Here, the user image AI processing step (S193) included in the ID selection lens wearing eye image generation step (S19) refers to the step for generating the contact lens virtual fitting image in the previous embodiment, and the redundant description is omitted. .

In the selection contact lens wearing image transmission step (S25), the user's virtual fitting image for the selection contact lens generated in the ID selection lens wearing eye image generation step (S19) is transmitted to the contact lens stand 20 .

Then, after the selection contact lens wearing image transmission step (S25) is finished, the selection contact lens wearing image outputting step (S26) is executed, the selection contact lens wearing image outputting step (S26) is the contact lens display stand (20) By displaying the user's virtual fitting image on the screen, the virtual contact lens virtual fitting image for the selected contact lens selected by the user displayed by the consumer who visited the offline store is outputted, and the contact selected by the consumer who visited the offline store visually It is also possible to check the virtual wearing image generated by the generator for the lens and to further enhance the convenience of purchasing contact lenses such as new products.

Meanwhile, in this embodiment, the user ID information may be directly input through the stand input unit 29 of the contact lens display stand 20 in the contact lens display stand 20 arranged in the offline store, but the stand input unit ( 29), information transmission or input through the terminal communication unit 19 of the user's user terminal 10 may be performed using the stand communication unit 28 described above. That is, the contact lens virtual fitting system 1 of the present invention may further include a user terminal 10 in addition to the contact lens display stand 20 and the server 30, and in this case, the contact lens virtual fitting system 1 The contact lens virtual fitting method may include an ID information transmission step (S20-1), wherein the ID information transmission step (S20-1) may be executed before the information transmission and information request step (S20), and the ID information transmission step In step S20 - 1 , the user's ID information is transmitted from the user terminal 10 to the contact lens display stand 20 .

In the previous embodiment, the case of outputting a virtual selection contact lens virtual fitting image synthesized from the facial image of a user or consumer who visited the offline store through image learning of the selected contact lens in the corresponding lens block in the offline store was described. The present invention is not limited thereto, and the user operates an application in the user terminal 10 to check information on the contact lens that has already been selected before visiting the offline store, and to generate and output a virtual image for the contact lens. Various modifications are possible, such as being able to provide a service.

In addition, in the preceding embodiment, the case of outputting a virtual selection contact lens virtual fitting image synthesized from the facial image of a user or consumer who visited the offline store through image learning of the selected contact lens selected in the lens block in the offline store is described in the previous embodiment. However, the present invention is not limited thereto, and by operating the application in the user terminal 10 of the user, review contents that have already been selected or confirmed before visiting the offline store, search data of other users, etc. are linked with the user's ID link information to make big data Various modifications are possible, such as a configuration for generating and outputting a virtual image for the contact lens by processing and checking information on the contact lens recommended to the user.

That is, as shown in FIG. 31, the contact lens virtual fitting method through the contact lens virtual fitting system 1 of the present invention includes the information transmission and information request step (S20), ID linkage information confirmation and contact lens information confirmation step It includes (S21a), ID recommendation lens wearing eye image generation step (S19a), and information transmission and information transmission step (S21a), in which the information transmission and information request step (S20) accommodates contact lenses placed in the store ID information of the user is transmitted to the server 30 from the contact lens exhibition stand 20 in which a plurality of lens cubes are disposed, and requests for ID linkage information and contact lens information linked to the user ID information.

After the information transmission and information request step (S20) is executed, the ID link information check and contact lens information check step (S21a) is executed, and at this time, the server 30 recommends the ID link information linked to the user's ID information and the user Confirmation of contact lens information including the requested contact lens information (by individual or by rank) is made.

Then, the ID recommendation lens wearing eye image generation step (S19a) is made, based on the user's preset contact lens wearing image and the user's contact lens not wearing image information and the requested contact lens information, the image through a plurality of calculations Generates a virtual fitting image of the user for the recommended contact lens through learning, where step S193 included in the ID recommendation lens wearing eye image generation step (S19a) is an image through the learned AI module in the previous embodiment It is replaced with the above in terms of generation, and redundant descriptions are omitted.

After the ID recommendation lens wearing eye image generation step (S19a) is made, information transmission and information transmission step (S21a) and the selection contact lens wearing image output step (S21b) are performed.

First, in the information transmission and information transmission step (S21a), contact lens information including ID linkage information linked to the user's ID information in the server 30 and recommended contact lens information (by individual or rank) recommended for the user And ID recommendation contact lens wearing eye image is transmitted to the contact lens display stand (20).

Then, the ID recommendation contact lens wearing image output step (S21b) is executed. In the ID recommendation contact lens wearing image output step (S21b), the recommended recommended contact lens information is displayed on the contact lens display stand 20 of the user. The virtual fitting image is displayed on the stand display 271 of the contact lens display stand 20 . Such image display may be performed through an application in the user's user terminal.

After the ID request contact lens wearing image output step (S21b) is executed, the lens information display step (S22a) is executed. In the lens information display step (S22a), contact lens information including the requested contact lens information is displayed. By displaying an image on the stand display 271 of the stand output unit 17 of the stand 20 , a user or a consumer who visits an offline store can image the latest updated contact lens information.

After the lens information display step (S22a) is executed, the lens selection step (S23) is performed. In the lens selection step (S23), the contact lens information selected by the user is inputted by the user through the lens cube (40).

After the lens selection step (S23) is executed, the selection lens information transmission step (S24) is executed. In the selection lens information transmission step (S24), information about the selection contact lens selected in the lens selection step (S23) is transmitted to the server 30 ) is sent to That is, in the lens selection step (S23), information on the contact lens selected through the lens cube 40 disposed on the inclined surface of the contact lens display stand 20 of the offline store is transmitted through the stand control unit 22 through the stand communication unit 28 is transmitted to the server 30 via

Then, the ID selection lens wearing eye image generation step (S19) is executed, in the ID selection lens wearing eye image generation step (S19), based on the user's preset contact lens wearing image and the user's contact lens not wearing image information, Generates a virtual fitting image of a user for a selection contact lens through image learning through the operation of , and the process of generating a worn image generated through image learning of the generator and discriminator is the same as described above.

After the user wearing image processing step (S19) is executed, the selection contact lens wearing image transmission step (S25) is carried out, the selection contact lens wearing image transmission step (S25) is the selection contact generated in the user wearing image processing step (S19) The user's virtual fitting image for the lens is transmitted to the contact lens stand 20 .

After the selection contact lens wearing image transmission step S25 is executed, in the selection contact lens wearing image outputting step S26 , the virtual fitting image of the user is displayed on the contact lens display stand 20 .

Even in this case, the contact lens virtual fitting system further includes a user terminal 10 capable of transmitting at least the user's ID information, and the contact lens virtual fitting method includes the user terminal 10 before the information transmission and information request step S20 is executed. ) from the ID information transmission step (S20-1) is executed, and the user's ID information may be transmitted from the user terminal 10 to the contact lens exhibition stand 20 .

On the other hand, the contact lens virtual fitting system 1 of the present invention includes a contact lens display stand 20 and a server 30 , and the contact lens display stand 20 includes a plurality of lens cubes 40 . . As in the previous embodiments, in the contact lens display stand 20 in another embodiment of the present invention, a plurality of lens cubes 40 for accommodating contact lenses disposed in a store are arranged, and the user's ID information is received. The available contact lens display stand 20 and the server 30 may receive ID information from the contact lens display stand 20 and transmit stored ID linkage information and contact lens information in response to the ID information. At this time, the contact lens exhibition stand 20 transmits the selected contact lens information among the contact lens information to the server 30, and the user included in the selection contact lens information and the user ID linkage information from the contact lens exhibition stand 20 Based on the contact lens non-wearing image information and the user's preset contact lens wearing image information, the server 30 executes a plurality of calculations to perform image learning, and as a result of this image learning, the user's virtual for the selection contact lens The fitting image is generated as described above.

At this time, the lens cube 40 includes a lens cube housing 410 and a lens cube light source unit 440 , and the lens cube housing 410 can accommodate a contact lens therein and is placed on the contact lens display stand 20 . It can be disposed, and the lens cube light source unit 440 is configured to emit light toward the contact lens disposed in the lens cube housing 410 .

More specifically, the lens cube housing 410 includes a lens cube housing body 413 and a lens cube housing cover 411 . The lens cube housing body 413 is disposed while being seated on the contact lens display stand 20 , and the lens cube housing cover 411 is relatively movably disposed on the upper side of the lens cube housing body 413 .

The lens cube housing body 413 includes a lens cube housing body base 4133 and a lens cube housing body main part 4131 . The lens cube housing body base 4133 is positioned and seated on the contact lens display stand 20 side, and the lens cube housing body main part 4131 is formed extending from one end of the lens cube housing body base 4133 to cover the lens cube housing. (411) together to form an inner space.

As shown in the drawing, the lens cube housing cover 411 includes a lens cube housing cover body 4111 , a lens cube housing cover body extension part 4113 , and a lens cube housing cover body lens seating part 4115 . do.

The lens cube housing cover body 4111 is exposed to the outside, and the lens cube housing cover body extension part 4113 is formed to extend at the lower end of the lens cube housing cover body 4111, and the lens cube housing cover body lens seating part ( 4115 is disposed in the inner space formed by the lens cube housing cover body 4111 so that the contact lens can be seated and visually exposed to the outside through the lens cube housing cover body 4111 .

As described above, the lens cube light source unit 440 is configured to emit light toward the contact lens CL disposed in the lens cube housing 410 , and the lens cube light source unit 440 includes the lens cube light source 441 and , and a lens cube light transmission unit 443 . The lens cube light source 441 is disposed on at least a portion of the lens cube substrate 420 disposed inside the lens cube housing 410 , and the lens cube light transmission unit 443 moves the lens toward the upper side of the lens cube light source 441 . It is disposed at the lower end of the cube housing cover body lens seating part 4115 and transmits light generated from the lens cube light source 441 to the lens cube housing cover body lens seating part 4115 side. That is, the light generated by the lens cube light source 441 passes through the lens cube light transmitting unit 443 through the lens cube housing cover body lens receiving unit 4115 and is emitted toward the contact lens mounted and disposed on the upper surface thereof. In this case, the lens cube housing cover body lens seating part 4115 is preferably formed of a transparent material or at least a material that allows white light to be emitted to prevent color distortion.

The lens cube substrate 420 on which the lens cube light source 441, etc. is disposed, more specifically, includes a lens cube light source substrate 421, a lens cube main substrate 423, and a lens cube substrate connection part 425, The lens cube light source substrate 421 has a lens cube light source 441 disposed on one surface, and the lens cube main substrate 423 is electrically connected to a lens cube connection part 450 described below. At this time, the lens cube board connection part 425 connects the lens cube light source board 421 and the lens cube main board 423 , and the lens cube board connection part 425 may be formed of a flexible substrate or formed with a separate wiring structure. Various modifications are possible depending on the design specifications, such as can be.

On the other hand, the lens cube housing 410 of the present invention may take a relatively movable configuration. That is, the lens cube 40 may further include a lens cube elastic part 430 for elastically supporting the lens cube housing 410, and the lens cube switch 460 detects a selection operation of a user or a store visitor, A signal change is generated accordingly. That is, a selection process for generating a wearing image by selecting the lens cube 40 disposed on the contact lens display stand 20 disposed in the offline store (SHOP) occurs, and at this time, the lens cube switch 460 is a selection signal by generating a selection information from the lens cube is transmitted from the lens cube control unit 44 of the lens cube 40 through the lens cube connection unit 450 to the server 30 through the contact lens display stand 20 and to the selection contact lenses It enables to generate and output a virtual fitting image of a selection contact lens from information about it.

In this selection process, in order to facilitate tactile recognition of the selection operation of the customer visiting the store, the position of the lens cube housing 410 can be changed.

The lens cube 40 further includes a lens cube elastic part 430 , the lens cube elastic part 430 includes a lens cube elastic body 431 and a lens cube elastic support part 433 , the lens cube elastic body 431 . ) is movably received and arranged on the side of the lens cube housing 410 , the lens cube elastic body 431 is on the lens cube housing cover body extension 4113 of the lens cube housing body 411 of the lens cube housing 410 . It is arranged to be accommodated in the formed lens cube elastic body accommodating part 41131. In addition, the lens cube elastic support part 433 is formed in contact with the lens cube elastic body 431 at one end on the opposite side of the lens cube elastic body 431 side toward the lens cube housing 410 so that the lens cube elastic support part 433 is One end of the lens cube elastic body 431 is formed to be in contact with the lens cube elastic body 431 accommodated in the lens cube elastic body accommodating part 41131 from one surface of the lens cube housing body base 4133 . Through such a configuration, it is possible to provide a sense of selection according to a physical location change when the offline store visitor selects the lens cube 40 disposed on one surface of the displayed contact lens display stand 20 .

In the case of such a position change structure, as shown in the drawings, a lens cube switch 460 having a contact structure may be further included as a component for detecting a selection operation according to a physical position change. The lens cube switch 460 detects a selection operation of a user or a store visitor and generates a signal change accordingly. That is, the contact lens display stand 20 includes a stand output unit 27 including a stand housing 21 , a stand cover 23 , a stand touch panel 25 , a stand display 271 , and a stand input unit. 29, the stand communication unit 28, the stand storage unit 24, and the stand control unit 22 are the same as described above, and the lens cube 40 includes the lens cube switch 460 and the lens. It includes a cube connection part 450, and as shown enlarged by reference numeral C, the lens cube connection part 450 includes a lens cube inner connection part 451, a lens cube outer connection part 453, and a lens cube connection connection part 455. includes The lens cube inner connection part 451 is connected to the lens cube fixing switch 461 side, and the lens cube outer connection part 453 is connected to the stand touch panel 25, for example, a stand touch of the stand touch panel 25. It is connected to the panel touch unit 251 (see FIG. 36), and the lens cube connecting unit 455 connects the lens cube inner connecting unit 451 and the lens cube outer connecting unit 453, and in this embodiment, the lens cube inner connecting unit ( 451), the lens cube outer connection part 453, and the lens cube connection connection part 455 have been mainly described with respect to the structure in which the insert is injected into the lens cube housing body base 4133, but in some cases, a separate wiring structure may be taken. Various modifications are possible.

When the lens cube elastic part 430 is pressed and a position change of the lens cube housing 410 occurs, a signal change is generated, and at this time, the lens cube switch 460 generates a changed signal by a user's selection operation, the lens The cube connection part 450 is in electrical communication with the lens cube switch 460 , and the lens cube connection part 450 is connectable to the stand touch panel 25 side.

The lens cue switch 460 includes a lens cube fixing switch 461 and a lens cube operating switch 463 . The lens cube fixing switch 461 is disposed on the lens cube housing body 413 side and electrically connected to the lens cube connection part 450 , and the lens cube operation switch 463 is disposed on the lens cube housing cover 411 side, and Contact with the lens cube fixing switch 461 is possible. That is, the lens cube fixing switch 461 and the lens cube movable switch 463 are disposed on opposite sides of the lens cube housing body 413 and the lens cube housing cover 411 that are movable relative to each other, the lens cube housing The body 413 and the lens cube housing cover 411 may generate a signal change of predetermined selection information due to relative motion.

The lens cube holder 50 according to an embodiment of the present invention includes a lens cube holder base 51 and a lens cube holder base counterpart 53 . The contact lens display stand 20 includes a lens cube holder base 51 disposed inside the stand housing 21 , wherein the lens cube 40 corresponds to the lens cube holder base 51 and is fixed in position. and a holder base counterpart (53).

At this time, as shown in the area enlarged by reference numeral B in FIG. 35 , the lens cube holder base 51 includes one of a magnetic material and a magnet, and the lens cube holder base counterpart 53 is formed of a magnetic material and a magnet. The other one may be included and may be disposed on the lens cube housing body 413, and this configuration is the same as described above.

Although the lens cube holder 50 according to an embodiment of the present invention has been described as the vertical center of the suction sphere by magnetic force, it may include an anti-slip structure using frictional force in some cases. That is, the stand lens position holders 211 and 211a in the present embodiment may include an anti-slip pad disposed on the bottom surface of the lens cube housing body 413 as enlarged by reference numeral D in the drawing. The material of the stand lens position holder 211a implemented as an anti-slip pad can be selected in various ways in a range that causes friction. In addition, in this case, various modifications are possible according to design specifications, such as the magnetic adsorption structure and the non-slip pad may be provided alternatively or selectively or both.

Although the lens cube switch 460 has a contact-type switching structure in the previous embodiment, the present invention is not limited thereto, and a non-contact switching structure may be formed. That is, as shown in the drawing, the lens cube switch 460a may be implemented as a touch-sensitive non-contact switch formed inside the lens cube housing cover body 4111 . In this case, the lens cube switch 460a may be implemented as a capacitive switch or may be implemented in a transparent panel type due to characteristics, and various modifications are possible according to design specifications. At this time, the lens cube 40 further includes a lens cube elastic part 430 for elastically supporting the lens cube housing 410 , and the elastic operation is not a physical position change for an actual switching operation, but a tactile sense of a simple operating state. A configuration that enables enemy recognition may be implemented.

In the previous embodiments, the structure of transmitting the selection operation signal of the lens cube through the stand touch pad 25 has been described, but the present invention takes a configuration excluding the connection structure between the stand touch pad and the lens cube connection unit 450 other than this structure. may be

The contact lens display stand 20 in this embodiment includes a stand output unit 27 , a stand input unit 29 , a stand communication unit 28 , a stand storage unit 24 , and a stand control unit 22 . However, the stand output unit 27 displays the user's virtual fitting image generated through image learning through a plurality of calculations in the server 30, and the stand input unit 29 receives the user's ID information, and the stand The communication unit 28 communicates with the server 30 and the lens cube 40 , and the stand storage unit 24 stores user ID information, stores contact lens information transmitted from the server 30 , and the stand control unit 22 applies a cube control signal to the lens cube 40 side through the stand communication unit 28 and receives selected selection contact lens information from among the contact lens information from the lens cube 40 side, user ID information and selection contact information By transmitting the lens information to the server 30, the server 30 sends a communication control signal to the stand communication unit 28 to receive the virtual fitting image of the user generated for the selection contact lens information through image learning through a plurality of operations. approve

Here, the lens cube 40 includes a lens cube switch 460 , a lens cube control unit 44 , and a lens cube communication unit 48 .

The lens cube switch 460 generates a signal changed by a user's selection operation. The lens cube switch 460 may be implemented as a contact type or non-connection type switch, and the lens cube control unit 44 is a lens cube switch ( 460, the lens cube communication unit 48 communicates with the stand communication unit 28 according to the communication control signal of the lens cube control unit 33.

Through this configuration, when the user operates the lens cube switch 460 , the lens cube control unit 44 transmits selection information about the lens cube 40 selected by the user through the lens cube communication unit 48 .

In the server 30 , the contact lens information including ID link information linked to the user's ID information and the recommended contact lens information for the user is transmitted to the contact lens display stand 20 , and the contact lens display stand 20 ) transmits information to the lens cube 40 corresponding to the requested contact lens information, and the lens cube control unit 44 of the lens cube 40 corresponding to the requested contact lens information is a contact lens display stand 20 It receives the requested contact lens information from the lens cube communication unit 48. At this time, the lens cube control unit 44 of the lens cube 40 corresponding to the requested contact lens information applies a light output control signal to the lens cube light source unit 440 to enable the offline store visitor to visually easily recognize it. can At this time, the lens cube light source unit 440 that executes the light output function according to the light output control signal applied by the lens cube control unit 44 of the lens cube 40 corresponding to the requested contact lens information outputs a plurality of colors. Possible device configurations may also be taken.

1...Contact Lens Virtual Fitting System 10...User Terminal
20...contact lens display stand 30...server
40...Lens Cube

Claims (25)

A contact lens display stand 20 in which a plurality of lens cubes accommodating contact lenses disposed in the store are disposed and the user's ID information can be received;
and a server 30 capable of receiving the ID information from the contact lens exhibition stand 20 and transmitting ID linkage information and contact lens information stored in response to the ID information,
The contact lens exhibition stand 20 transmits selected contact lens information selected among the contact lens information to the server 30,
Based on the user contact lens non-wearing image information and the user's preset contact lens wearing image information included in the selected contact lens information and the ID linkage information from the contact lens exhibition stand 20, in the server 30 A contact lens virtual fitting system (1) in which a virtual fitting image of a user for the selected contact lens is generated through image learning through a plurality of operations.
The method of claim 1,
The contact lens display stand 20 includes:
a stand housing 21 disposed in an offline store and having a preset inclination;
a stand cover 23 on which the stand housing 21 is disposed on one side to form an internal space;
A stand touch panel ( 25) and
a stand output unit 27 including a stand display 271 for displaying a virtual fitting image of a user generated through image learning through a plurality of operations in the server 30;
a stand input unit 29 to which the user's ID information is input;
a stand communication unit 28 that communicates with at least the server 30;
a stand storage unit 24 for storing user ID information and for storing contact lens information transmitted from the server 30;
A block control signal is applied to the lens cube 40 side through the stand touch panel 25, and selected contact lens information selected among the contact lens information is transmitted from the lens cube 40 side, the user ID information and The stand communication unit ( A contact lens virtual fitting system (1) comprising a stand control unit (22) for applying a communication control signal to (28).
3. The method of claim 2,
The server 30 includes:
a server communication unit 35 for transmitting and receiving to and from the contact lens exhibition stand 20 through a communication network;
a server storage unit 33 for storing data received from the server communication unit 35;
The server communication unit 35 and the server storage unit 33 are controlled, and the user's contact lens non-wearing image information and the selection contact lens information and the ID linkage information from the contact lens display stand 20 include the user's A contact lens virtual fitting system (1) including a server controller (31) for image processing the preset contact lens wearing image information and generating a virtual fitting image of a user through image learning.
4. The method of claim 3,
The server control unit 31 is:
a control module 311 for controlling the server communication unit 31 and the server storage unit 33;
According to the image learning control signal of the control module 311, the user's contact lens non-wear image information and the selected contact lens information and the user's preset contact lens wearing image information included in the ID linkage information are image-processed and imaged A contact lens virtual fitting system (1) comprising an AI module (313) that generates a virtual fitting image of a user through learning.
5. The method of claim 4,
Contact lens virtual fitting system (1) comprising an image processing module (315) for extracting an eye area image from the user's contact lens not wearing image information and the preset contact lens wearing image information.
6. The method of claim 5,
The control module 311 is
a communication storage control module 3115 for applying a communication and storage signal for controlling the server communication unit 31 and the server storage unit 33;
An AI control module 3111 for applying a learning control signal to image learning of the AI module 313;
A contact lens virtual fitting system (1) comprising an image processing control module (3113) for applying an image processing control signal to the image processing module (315).
7. The method of claim 6,
The AI module 313 includes:
an AI neural network module 3131 that receives the user's contact lens non-wear image information and the user's preset contact lens wear image information and executes a plurality of calculations;
Contact lens virtual fitting system (1) comprising an AI learning module (3133) for applying an AI learning signal to the AI neural network module (3131) according to the learning control signal of the AI control module (3111).
8. The method of claim 7,
The AI neural network module 3131 includes:
A generator (31311) for generating at least the user contact lens non-wearing image information and contact lens wearing generic image information for the corresponding contact lens through a plurality of calculations that can be weighted using the input image information of the contact lens information and;
Discrimi for judging whether the corresponding contact lens wearing generic image information is real or fake through a plurality of calculations that can be weighted using the corresponding contact lens wearing generic image information and the user's preset contact lens wearing image information A contact lens virtual fitting system (1) comprising a nator (31313).
9. The method of claim 8,
The AI learning module 3133 applies a learning control signal to the generator 31311 and the discreminator 31313 of the AI neural network module 3131,
When the AI learning module 3133 applies a generation learning control signal to the generator 31311, the AI learning to determine that the contact lens wearing generative image information to which the discriminator 31313 is input is real A contact lens virtual fitting system (1), characterized in that a module (3133) adjusts the complex computation weight of the generator (31311).
9. The method of claim 8,
The AI learning module 3133 applies a learning control signal to the generator 31311 and the discreminator 31313 of the AI neural network module 3131,
When the AI learning module 3133 applies a discriminator learning control signal to the discriminator 31313, the contact lens wearing agent generated by the generator 31311 and input to the discriminator 31313 Contact lens virtual fitting system (1), characterized in that the AI learning module (3133) adjusts the complex calculation weight of the discriminator (31313) so that the discriminator (31313) determines that the narrative image information is a fake ).
9. The method of claim 8,
The AI learning module 3133 applies a learning control signal to the generator 31311 and the discreminator 31313 of the AI neural network module 3131,
When the AI learning module 3133 applies a discriminator learning control signal to the discriminator 31313, the contact lens wearing agent generated by the generator 31311 and input to the discriminator 31313 The AI learning module 3133 adjusts the complex calculation weight of the discriminator 31313 so that the first discriminator 313131 of the discriminator 31313 determines that the narrative image information is a fake,
When the AI learning module 3133 applies a discriminator learning control signal to the discriminator 31313, the contact lens wearing agent generated by the generator 31311 and input to the discriminator 31313 The AI learning module 3133 adjusts the complex calculation weight of the discriminator 31313 so that the second discriminator 313132 of the discriminator 31313 determines that the narrative image information is real A contact lens virtual fitting system (1).
8. The method of claim 7,
The image processing module 315 includes:
Contact comprising an image generation module (3153) for generating a virtual fitting image of a user wearing the selection contact lens by using the learning result from the AI neural network module (3131) and the selection contact lens information Lens virtual fitting system (1).
13. The method of claim 12,
The image processing module 315 includes:
and an image extraction module (3151) capable of extracting an image of an eye area from the user's contact lens non-wearing image information and the user's preset contact lens wearing image information (1).
3. The method of claim 2,
A user terminal 10 capable of transmitting at least the user's ID information through the installed application is further provided,
The stand communication unit 28 of the contact lens exhibition stand 20 includes a stand wireless terminal communication unit 281 , and the stand wireless terminal communication unit 281 transmits the ID information of the user through the user terminal 10 . A contact lens virtual fitting system (1), characterized in that it establishes a communication state with the server (30).
3. The method of claim 2,
The stand input unit (29) comprises a stand optical input unit (291) for inputting the user's preset contact lens wearing image information or the user's contact lens not wearing image information, the contact lens virtual fitting system (1).
3. The method of claim 2,
The contact lens display stand (20) is a contact lens virtual fitting system (1), characterized in that the lens cube holder (50) is further provided to prevent the sliding of the plurality of lens cubes (40).
17. The method of claim 16,
The lens cube holder 50 includes:
A lens cube holder base 51 positioned so that the stand touch panel 25 is disposed between the stand housing 21 and the inner space formed by the stand housing 21 and the stand cover 23;
and a lens cube holder base corresponding part 53 disposed at the lower end of the lens cube,
A contact lens virtual fitting system (1), characterized in that at least one of the lens cube holder base (51) and the lens cube holder base counterpart (53) is a magnet.
3. The method of claim 2,
The contact lens display stand (20) is disposed between the stand housing (21) and the stand cover (23) and includes a stand spacer (60) forming a gap therebetween. (One).
19. The method of claim 18,
The stand spacer (60) is a contact lens virtual fitting system (1), characterized in that it is provided with a stand spacer through hole (61) that allows the penetration arrangement of the plurality of lens cubes (40).
ID information of the user is transmitted to the server 30 from the contact lens exhibition stand 20 in which a plurality of lens cubes accommodating contact lenses disposed in the store are disposed, and ID linkage information and contact lens information linked to the user ID information Information transmission and information request step (S20) to request,
An information transmission and information transmission step (S21) in which the ID linkage information and contact lens information linked to the user's ID information are transmitted from the server 30 to the contact lens exhibition stand 20;
A lens information display step (S22) of displaying the contact lens information on the stand display 271 of the stand output unit 17 of the contact lens display stand 20 as an image;
A lens selection step (S23) of inputting contact lens information selected by the user through the lens cube 40 by the user;
A selection lens information transmission step (S24) in which information about the selection contact lens selected in the lens selection step (S23) is transmitted to the server 30;
Based on the user's preset contact lens wearing image and the user's contact lens not wearing image information, a user image AI processing step of generating a virtual fitting image of the user for the selected contact lens through image learning through a plurality of calculations (S193) ) ID selection lens wearing eye image creation step (S19) having, and
A selection contact lens wearing image transmission step (S25) of transmitting the user's virtual fitting image for the selection contact lens generated in the user wearing image processing step (S19) to the contact lens stand 20 (S25);
A contact lens virtual fitting method comprising a selection contact lens wearing image output step (S26) of displaying the user's virtual fitting image on the contact lens exhibition stand (20).
21. The method of claim 20,
A user terminal 10 capable of transmitting at least ID information of a user is further provided, and the ID information of the user is transmitted from the user terminal 10 to the contact lens exhibition stand 20 (S20-1) ) A contact lens virtual fitting method comprising a.
ID information of the user is transmitted to the server 30 from the contact lens exhibition stand 20 in which a plurality of lens cubes accommodating contact lenses disposed in the store are disposed, and ID linkage information and contact lens information linked to the user ID information Information transmission and information request step (S20) to request,
ID link information confirmation and contact lens information confirmation step (S21a) of confirming contact lens information including ID link information linked to the user's ID information and recommended contact lens information for the user in the server 30; ,
Based on the user's preset contact lens wearing image, the user's contact lens not wearing image information, and the requested contact lens information, through a plurality of calculations to generate a virtual fitting image of the user for the recommended contact lens through image learning User image AI processing step (S193) with ID recommendation lens wearing eye image generation step (S19a) and,
In the server 30, ID link information linked to the user's ID information, contact lens information including recommended contact lens information (by individual or rank) recommended for the user, and ID recommended contact lens wear image Information transmission and information transmission step (S21a) transmitted to the contact lens exhibition stand 20,
A contact lens virtual fitting method comprising a selection contact lens wearing image output step (S21b) of displaying the user's virtual fitting image on the contact lens exhibition stand (20).
23. The method of claim 22,
A lens information display step (S22a) of displaying the contact lens information including the requested contact lens information on the stand display 271 of the stand output unit 17 of the contact lens display stand 20 as an image (S22a);
A lens selection step (S23) of inputting contact lens information selected by the user through the lens cube 40 by the user;
A selection lens information transmission step (S24) in which information about the selection contact lens selected in the lens selection step (S23) is transmitted to the server 30;
Based on the user's preset contact lens wearing image and the user's contact lens not wearing image information, a user image AI processing step of generating a virtual fitting image of the user for the selected contact lens through image learning through a plurality of calculations (S193) ) a user wearing image processing step (S19) having, and
A selection contact lens wearing image transmission step (S25) of transmitting the user's virtual fitting image for the selection contact lens generated in the user wearing image processing step (S19) to the contact lens stand 20 (S25);
A contact lens virtual fitting method comprising a selection contact lens wearing image output step (S26) of displaying the user's virtual fitting image on the contact lens exhibition stand (20).
A user terminal 10 capable of transmitting at least ID information of a user is further provided, and the ID information of the user is transmitted from the user terminal 10 to the contact lens exhibition stand 20 (S20-1) ) A contact lens virtual fitting method comprising a.
As a contact lens display stand placed in a store,
A plurality of lens cubes for accommodating contact lenses are arranged and the user's ID information can be received,
In connection with the server 30 capable of transmitting ID link information and contact lens information stored in response to the ID information, the selected contact lens information selected from among the contact lens information is transmitted to the server 30,
Based on the user's contact lens non-wearing image information and the user's preset contact lens wearing image information included in the selection contact lens information and the ID linkage information, the server 30 performs a plurality of operations through image learning A contact lens display stand 20 capable of displaying an image by receiving the user's virtual fitting image generated for the selected contact lens.

Images