JP2003030494A - Support system for selecting spectacles - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a support system for selecting spectacles for enabling a customer to easily select glasses that fits the customer. SOLUTION: The system is provided with an image inputting part for inputting an mage of a customer face part, an analyzing part for finding face part data showing characteristics of the face part on the basis of the image of the face part, a recording part storing spectacles data comprising a spectacles image and various pieces of data related to the spectacles, a spectacles selecting part for selecting spectacles on the basis of the face part data and a prescribed criterion, an image compositing part for generating a composited image obtained by superimposing the image of the selected spectacles on the image of the face part, and a displaying part for displaying the composited image.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a virtual spectacles wearing system capable of evaluating and selecting the appearance of spectacles when the spectacles are worn by an image obtained by superimposing an image of the spectacles on the image of the face of a purchaser. Regarding

[0002]

2. Description of the Related Art When selecting eyeglasses for purchase, a customer evaluates the appearance of a person who actually wears the eyeglasses by mirroring them in a mirror at a spectacle store. However, since the lens is not attached to the spectacles worn, a customer who needs strong spectacles cannot see well and cannot fully confirm. As an apparatus for solving the above-mentioned problems, there is an apparatus for displaying an image of a face of a customer wearing spectacles. In either case, it is necessary to visit the spectacle store.

A virtual wearing system for glasses that virtually wears glasses on a computer and enables selection of preferred glasses is disclosed in, for example, Japanese Unexamined Patent Application Publication No. 11-120213, in which a customer's face image and glasses image (frame image, or further lens image). There is disclosed a device capable of displaying an image combined with an image to which an image is added) and recognizing the appearance when the user wears glasses.

Further, Japanese Patent Laid-Open No. 10-124574 discloses a system for virtually trying on and arranging clothes, furniture, etc. by comparing three-dimensional data concerning a customer's property or body with three-dimensional data concerning a product, Further about the customer 3
It is disclosed that when the personal database storing the dimensional data and the catalog database storing the three-dimensional data data on the products are located at remote places, the two types of data are collected in one place via the communication means. Glasses are given as an example of the product.

Some glasses are sold at so-called net shops that sell articles via the Internet, but many of them simply show an image of the glasses on the site and allow them to be selected.

[0006]

There are an extremely large number of types of spectacles depending on the combination of rimless, half rim, full rim type, the shape and size of the lens frame (vertical width * size), the material, the color, and the like. When selecting and wearing the real thing at the spectacle store, the selection is made from the range in stock at the spectacle store. All eyeglasses registered in are selected. Thus, it is very difficult to select the eyeglasses that suit one's own from among such a great variety. The term "fits for myself" as used herein means that the size is appropriate, that it fits well.

It is an object of the present invention to provide a spectacle selection support system that allows a customer to easily select spectacles that suit him or her.

[0008]

SUMMARY OF THE INVENTION To achieve the above object, the present invention provides an image input section for inputting an image of a customer's face, and a face showing the features of the face based on the image of the face. An analysis unit that obtains data, a recording unit that stores an image of eyeglasses and eyeglass data that includes various data related to the eyeglasses, an eyeglass selection unit that selects eyeglasses based on the face data and the eyeglass data, and An image combining unit that generates a combined image in which the image of the selected glasses is superimposed on the image of the face portion,
A spectacles selection support system, comprising: a display unit that displays the composite image.

The spectacles selection support system comprises a customer system, a server system, and a communication means for connecting the customer system and the server system so that data can be exchanged, and the customer system receives the image input. Unit, the analyzing unit, the image combining unit, and the display unit, the analyzing unit outputs the face data to the server system, the image combining unit displays the image of the selected glasses. The system may be obtained from the server system, the server system may include the eyeglasses selection unit, and may send the image of the selected eyeglasses to the customer system.

The analysis unit may be an image analysis unit that analyzes the image of the face portion and obtains face portion data indicating the characteristics of the face portion. In each of the above-mentioned systems, the face data may include data regarding the size of the face, data regarding the shape of the face, or data regarding the skin color of the face.

Another aspect of the present invention for achieving the above object is to:
An image input unit to which an image of a customer's face is input, an analysis unit that obtains face data indicating the characteristics of the face based on the image of the face, and an image of glasses is superimposed on the image of the face. An image combining unit that generates a combined image, a display unit that displays the combined image, and the face data obtained by the image analysis unit are output to the outside, and the spectacles selected based on the face data are displayed. A customer system of an eyeglasses selection support system, comprising: an input / output unit that receives an image from the outside.

Still another object of the present invention to achieve the above object is to provide a storage unit in which an image of eyeglasses and eyeglass data including various data relating to the eyeglasses are recorded, and face data indicating the features of the customer's face. An input unit that receives the data, an eyeglass selection unit that selects eyeglasses based on the face data and the eyeglass data, and an output unit that outputs the image of the selected eyeglass and the eyeglass data to the outside. It is a data server of the eyeglasses selection support system.

Still another aspect of the present invention for achieving the above object, is a record in which an image input section for inputting an image of a customer's face portion, eyeglass data including an image of eyeglasses and various data relating to the eyeglasses is stored. Unit, a spectacle selection unit that selects spectacles based on the data indicating the power of a spectacle lens and the spectacle data, and an image that generates a composite image in which the image of the selected spectacle is superimposed on the image of the face portion. A spectacles selection support system comprising a synthesizing unit and a display unit for displaying the synthetic image.

The image of the customer's face portion input to the image input unit includes an image of a state in which glasses are worn, and the spectacle selection unit analyzes the image to obtain the power of the spectacle lens of the spectacles. An image analysis unit may be further included, or data indicating the power of the spectacle lens may be transmitted from the customer system to the server system.

In each of the above-mentioned systems, it is preferable that the spectacles selection section obtains the edge thickness of the spectacle lens when the spectacles are put in the spectacles and displays the edge thickness when the spectacles are put in the spectacles on the display section. . The eyeglasses selection support system includes a customer system, a server system, and a communication unit that connects the customer system and the server system so that data can be exchanged. The customer system includes the image input unit. The image composition unit and the display unit are provided, the image composition unit obtains the image of the selected eyeglasses from the server system, and the server system includes the recording unit and the eyeglasses selection unit. A spectacles selection support system, which is equipped with and sends the image of the selected spectacles to the customer system.

In each of the above systems, the image of the face input to the image input unit includes an image of the face of the customer wearing glasses, and the customer system analyzes the image to analyze the image. Further comprising an image analysis unit for obtaining the power of the spectacle lens and outputting it to the server system, or
Data indicating the power of the spectacle lens may be transmitted from the customer system to the server system.

It is preferable that each of the server systems sends the edge thickness of the spectacle lens when put in the spectacles to the customer system. Yet another aspect of the present invention for achieving the above object is configured by a customer system, a server system, and a communication unit that connects the customer system and the server system so that data can be exchanged. An image input unit for inputting an image of a customer's face portion, and a display unit for displaying an image of eyeglasses obtained from the server system, wherein the server system includes the image of the eyeglasses on the display unit by the customer system. Is displayed in a predetermined color, the color display parameter for changing the actually displayed color is sent to the customer system, and the customer system displays the image of the glasses according to the color display parameter received from the server system. This is a virtual wearing system for eyeglasses.

The customer system includes an image input unit for inputting an image of a customer's face portion, and an image synthesizing unit for generating a synthetic image by superimposing the image of the glasses obtained from the server system on the image of the face portion. Further, the display unit may display the composite image according to a color display parameter received from the server system.

When the customer system receives the color display parameter from the server system, the customer system records the current color display parameter and validates the received color display parameter, and ends the selection support by the eyeglasses selection support system. At this time, it is preferable to validate the recorded color display parameter.

[0020]

DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 is a block diagram of a system configuration of an embodiment of the present invention. This system is a customer system 1 used by a customer who is a prospective purchaser of eyeglasses, a server system 2 managed and operated by an eyeglass manufacturer or an eyeglass wholesaler, and a retail store system 3 installed in an eyeglass retail store.
And the Internet network 4.

The customer system 1 is a personal computer comprising a main body unit 10, a display unit 17 such as a CRT, and an input unit 18 such as a keyboard and a mouse. The main body unit 10 is connected to a digital camera (DSC) 19 and the DSC 19 is connected. An image input unit 11 to which an image is input, a storage unit 12 that stores various programs and image data, a connection unit 13 to which the Internet network 4 is connected, an image processing unit 15, and an input unit 1
8, an input / output unit 16 for receiving display data from the display unit 17 and outputting display data to the display unit 17, and a control unit 1 for controlling each unit.
4 and a bus line (not shown) for connecting the above-mentioned respective parts. The DSC 19 may be incorporated in the main body 10 as a part of the main body 10.

The image input unit 11 may be a data reading device for reading the image data from a recording medium on which the image data is recorded. The image processing unit 15 analyzes the customer's face image input from the image input unit 11 to detect the shape and size of the face portion, and an image analyzing unit 15A that superimposes and synthesizes an image of glasses on the face image. Image synthesizing means 1 for creating an image
5B and. The synthetic image is a virtual wear that virtually creates a state in which the customer wears glasses.

The server system 2 includes a main body 20 and a CR.
Display unit 27 such as T and input unit 2 such as keyboard and mouse
A computer system including 8 and a main body 20
Is image data of various programs and images of many glasses,
And data relating to the eyeglasses (hereinafter referred to as eyeglass data), for example, a storage unit 22 that stores the model number, material, color, size and shape of the eyeglasses, a connection unit 23 connected to the Internet network 4, and a storage unit 22. A spectacles selection unit 2 for selecting spectacles from a large number of spectacles data obtained according to a predetermined standard.
5, an input / output unit 26 to which the display unit 27 and the input unit 28 are connected, a control unit 24 that controls each unit, a bus line (not shown) that connects each unit, and the like.

The retail store system 3 includes a main body 30 and a CRT.
And the like display section 37 and keyboard and mouse input section 38
And a computer system consisting of
Is a storage unit 32 that stores various programs and data.
A connection unit 33 connected to the Internet network 4, a sales processing unit 31 that processes sales of sold glasses, a control unit 34 that controls each unit, a bus line (not shown) that connects each unit, and the like. It is composed of.

The Internet network 4 includes connection parts 13, 23,
The customer system 1, the server system 2 and the retail store system 3 are connected via 33 to enable mutual data exchange. Hereinafter, details of a method of trading eyeglasses including virtually wearing eyeglasses using the present system will be described with reference to the flowchart of FIG. The processing indicated by the bold line frame is the processing of the customer system 1, the processing indicated by the chain line frame is the processing of the server system, the processing indicated by the thin line frame is the processing of the retail store system 3, and the processing indicated by the broken line frame is the processing of the customer. It is an act.

First, in step 1 (denoted as S1 in the drawing, the same applies to the other steps), the DSC 19 connected to the image input unit 11 of the customer system 1 does not wear the glasses of the customer. Take an image of the face. At that time, the size calculation basic data that enables the size of the subject to be obtained from the photographed image is held. For example,
The distance from the DSC to the subject and the focal length of the taking lens are attached to the taken image data. Alternatively, an object with a known size is simultaneously captured, or an image is taken with a pattern with a known size as a background.

In step 2, the customer system 1 reads the image data of the face image and displays it on the display unit 17 connected to the input / output unit 16 (FIG. 3). In step 3, the image data is displayed as an image. It is taken into the processing unit 15. Then, in step 4, the image analysis means 15 of the image processing unit 15
A performs image processing to detect the contour of the customer's face and pupils H1 and H2, and obtains the size and shape of the customer's face by referring to the above-mentioned basic dimension calculation data. As for the size and shape of the face portion to be obtained, the face width W, length L, and pupil position (pupil height position H, pupil distance WH) at the pupil height position shown in FIG.
Etc. are included.

Further, the type of face shape analyzed based on the width W of the face portion, the width W1 of the face portion at the height position of H / 2, the length L, etc. (round face, square face, egg face, Home base face etc.) Further other features of the face (for example,
Image processing for obtaining features such as fine eyes, acorns, eyes, and eyes. Hereinafter, various data relating to the size and shape of the face will be referred to as face data.

The absolute value of the dimension of each face portion is not necessarily required to determine the type of the face shape, and the analysis can be performed using the ratio of the dimension of each face portion obtained by the image analysis means 15A. . Alternatively, the standard shape of the facial shape type is stored in the image processing unit 15 in advance, and the standard shape and the image processing unit 1 are stored.
It is also possible to determine the type according to the degree of similarity with the contour shape of the face detected in 5. That is, the standard shape may be overlapped with the contour shape while changing the size and position of the contour shape so as to minimize the squared error therebetween, and the standard shape having the minimum squared error may be obtained.

As the image data of the face image, digital image data of the customer's face recorded in advance on a recording medium such as a compact disk or a floppy (registered trademark) disk and the dimension calculation basic data are used as data as the image input unit 11. It may be read from a reading device, in which case step 1 is omitted. Further, step 4 can be further omitted as a face image with the face data separately analyzed attached.

Then, in step 5, the customer system 1
Accesses the server system 2 through the Internet network 4 according to the operation of the customer, and wears glasses as virtual wear.
Let them choose their favorite glasses. Details of the virtual wear will be described later. The server system 2 may be accessed via a link provided from the retail store system 3 accessed by the customer system 1 to the server system 2.

In step 6, the customer system 1 displays the mounting implementation information input screen (FIG. 4) and displays the mounting information to the customer, that is, the spectacle store that carries out the mounting, the implementation date and time, and the customer name and address. Enter your personal information, and click the "Send" button 6
The mounting information and the model number of the selected glasses are transmitted to the server system 2 according to the selection of 1.

In step 7, the server system 2 notifies the retail store system 3 of the designated spectacle store of the model number of the spectacles, the desired implementation date for mounting, the customer name and the like. Receiving the notification, the retail store system 3 checks the presence or absence of the stock of the specified model number of glasses in step 8, and displays the notified information and the presence or absence of the stock on the display unit 27. Then, if there is stock, immediately if there is no stock, order processing of the eyeglasses of the above model number is performed at a wholesale store, and then proceed to step 9 to notify the customer system 1 of the mounting license. The order processing may be automatically performed, or may be performed in response to a confirmation operation for the display of the stock status. The notification of the implementation license may be sent via the server system 2.

Then, in step 10, the customer goes to the spectacles store designated at the implementation date and time designated in step 6 to mount the spectacles, and determines in step 11 whether or not to purchase the spectacles. When the customer decides to purchase the spectacles in step 11, the process proceeds to step 12, and the retail store system 3 performs the sales process of the spectacles decided to be purchased and finishes the process. When the customer cancels the purchase in step 11, the processing is finished as it is.

Next, the procedure for virtual wearing in step 5 is shown in FIG.
This will be described in detail with reference to the flowchart of FIG. In step 51,
The customer system 1 sends the face data obtained by the image analysis means 15A to the server system 2 connected via the Internet 4. In step 52, based on the face data received by the server system 2, the spectacles selection unit 25 selects any spectacles from the large number of spectacles stored in the storage unit 22 to obtain an image of the spectacles and the spectacle data. Send to system 1. At that time, the glasses selected according to a predetermined criterion are preferentially selected.

The selection based on the predetermined criterion is performed, for example, based on the face size of the face data and the size data of the glasses included in the glasses data. The dimension data includes the dimensions of each part shown in FIG. In the selection, specifically, the eyeglasses in which the difference between the pupil distance WH and the distance EW between the design pupil positions EP1 and EP2 is within a predetermined value is selected. The design pupil positions EP1 and EP2 are design pupil positions used as a reference when determining the shape and size of the spectacle frame, and are included in the spectacle data received from the server system 2. Alternatively, the spectacles whose difference between the width W of the face portion and the total width (inter-hinge distance) WF which is one item of the dimensional data of the spectacles is within a predetermined value are selected. As a result, glasses that can be expected to have good performance are selected.

Further, in accordance with the type and size of the face shape and other characteristics, glasses that are considered to be suitable for the face of the type shape and size and other characteristics are selected. Each eyeglass is classified into a shape type such as a round shape, a square shape, an oval shape, and a drop shape based on the size data. The storage unit 22 stores the shape type of spectacles that is said to be suitable for each type of face shape, and the ratio between the length L of the face and the height TH of the glasses that are said to be suitable.
Further, the shape type of the eyeglasses that is said to be suitable for other characteristics is also stored. The spectacles selection unit 25 refers to these and selects the spectacles. For example, select square glasses for a round face. Alternatively, the spectacles in which the ratio of the length L and the height TH of the spectacles is within a predetermined value range are selected based on the length L of the face portion. These selection criteria will be changed according to the fashion.

The image analysis unit 15A also detects the skin color of the customer's face. Then, the eyeglasses selecting unit 25 is the image analyzing unit 15A.
The eyeglasses of a color that is considered to be suitable are selected based on the skin color detected by. In the selection of the spectacles, in addition to the selection of the spectacle frame, the color, density, dyeing range of the spectacle lens may be included. That is, the respective colors are selected in consideration of the harmony of the skin color, the spectacle frame color, and the spectacle lens color.

The spectacles selection section 25 selects spectacles by also referring to the power of the spectacle lens. That is, in the case of a strong myopia spectacle lens, if the box size of the spectacles (LS * TH in FIG. 8) is large, the edge thickness of the spectacle lens becomes thick and the appearance is poor. Furthermore, the glasses are heavy and uncomfortable to wear. Therefore, a small box size eyeglass is selected as the eyeglass lens for strong myopia.

The power of the spectacle lens is obtained by allowing the customer to input the data of eye examination by an ophthalmologist in advance or the data of the spectacles created previously to the customer system 1 and reading the data into the server system 2, or an approximate value by the image analysis unit 15A. Ask. An example of a method of determining the spectacle lens dioptric power approximate value by the image analysis unit 15A will be described. In steps 1 to 3 of FIG. 2, a face image in a state in which the glasses currently in use are worn is further photographed and captured in the image analysis unit 15A. And step 4
In, the difference between the image with glasses and the image without glasses is detected. A portion of the former image captured through eyeglasses, for example, the size of eyes is smaller (for myopia) or larger (for hyperopia) than the corresponding portion of the latter image. The ratio of the two sizes is larger as the power of the spectacle lens is stronger. Therefore, the approximate dioptric power of the spectacle lens can be obtained from the ratio.

Alternatively, the process of step 4 can be performed as follows. In the face image in the state where the glasses are worn, the portion photographed through the spectacle lens of the outline of the face portion is located inside (in the case of myopia) or outside (in the case of hyperopia) the other portion. The amount of the deviation is larger as the power of the spectacle lens is stronger. Therefore, the approximate dioptric power of the spectacle lens can be obtained from the deviation amount.

Further, prior to step 51, a step of selecting the type of spectacle lens to be used may be provided, and the spectacle selecting section 25 may select spectacles in accordance with the type of spectacle lens selected in the step. it can. For example, when the bifocal spectacle lens is selected, the spectacles having the sizes that can secure the distance area and the near area of the spectacle lens with predetermined sizes are selected. If glass lenses are selected then rimless glasses are not selected. The selection of the color of the spectacle lens in consideration of the skin color and the color of the spectacle frame is performed when a colored lens or a dyeable plastic lens is selected as the spectacle lens in this step.

In step 53, the customer system 1 displays the image of the glasses obtained from the server system 2 on the display unit 17.
(FIG. 6) to let the customer who sees the displayed image of the eyeglasses specify whether or not he / she wants to wear the eyeglasses virtually. That is, the “want to wear virtual” button 43 or the “display other glasses” button 4 displayed to the customer together with the image of the glasses.
Specify one by clicking any one of them with the mouse. When the “display other spectacles” button 41 is designated, the customer system 1 sends a signal requesting the image of the next spectacles to the server system 2, and the image of another spectacle and the spectacle data are transmitted from the server system 2. The image of the glasses that is acquired and displayed on the display unit 17 is updated. "Back" button 4
The display image may be returned to the previous state according to the selection of 2.

In addition to the display of the spectacle image, spectacles when the spectacle lens is fitted from the side are also displayed,
It may be possible to confirm the edge thickness WL of the spectacle lens (FIG. 9). The edge of the spectacle lens is chamfered to selectively make the edge thickness inconspicuous. The chamfering process may require an additional processing fee. It is preferable to display the edge thickness when the chamfering process is performed. In this case, it is more preferable to display both of them at the same time so that they can be compared.

By the way, the edge thickness also changes depending on the refractive index of the material of the spectacle lens used. Materials for eyeglass lenses include glass and plastic, and in each case, there are several types of materials having different refractive indexes. It is preferable to be able to compare changes in the edge thickness depending on the material of the spectacle lens. Of course, it is also possible to let the customer select the material of the spectacle lens to be used in advance and display the change in that range.

Hue is also important for selecting the preferred glasses. Therefore, the displayed glasses image must be displayed in the actual color. On the other hand, the colors displayed on the customer system 1 are various parameters related to the color display set on the customer system 1, such as color temperature, three primary colors (red,
It changes depending on the gain of green and blue) and the cutoff values of the three primary colors. Moreover, since the above-mentioned parameters can be freely changed by the customer, it is unknown in what state they are set. Therefore, when the server system 2 outputs the first image of glasses to the customer system 1, the server system 2 sends the parameters to the server system 2, causes the server system 2 to back up and record the parameters currently in use, and sets the sent parameters. To change.

Furthermore, even if the parameters are the same, the colors displayed may differ depending on the manufacturer and model number of the display device (CRT, liquid crystal display device, etc.). It is preferable to prepare for each model number and send appropriate parameters to the customer system 1 according to the manufacturer of the display device and the model number information obtained from the customer system 1.

The server system 2 uses the set parameters only when the process of FIG. 2 is performed, and when the process of FIG. 2 is finished, the server system 2 performs a process of returning the parameter to the backup recorded parameter. Step 5
2, in step 53, the server system 2 selects a plurality of spectacles and transmits them to the customer system 1, and the customer system 1 displays the images of the plurality of spectacles on the display unit 17 to display the image of the spectacles desired to be virtually worn. May be clicked with a mouse or the number attached to the image of each spectacle may be input with a keyboard to be designated. In this case, the customer may be allowed to specify virtual wear desires for a plurality of glasses at the same time.

In step 54, the image synthesizing means 15B of the image processing unit 15 generates a synthetic image by superposing and synthesizing the image of the specified glasses on the face image, and the display unit 17
Displays the composite image (FIG. 7). A "hope for mounting" button 51 and a "return" button 52 are displayed to display the composite image.
And "implementation designation for mounting" button 53 are displayed at the same time.

When generating the composite image, the image synthesizing unit 15B refers to the size of the face of the customer and the dimensional data of the spectacles obtained by the image analyzing unit 15A to determine the size of the image of the spectacles of the face image. The scale is adjusted to the same scale as the size, and the position at which the image of the glasses is superimposed is determined based on the pupil position detected by the image analysis unit 15A and the design pupil position of the glasses.
Then, the design pupil position of the spectacles for which the virtual wearing desire is designated is sent to the image synthesizing means 15B and used for determining the superposition position of the spectacle image.

The pupil position is not obtained by the image analysis by the image analysis means 15A in step 4, but the customer is made to click the pupil position of the face image with the mouse, and the position on the screen where the mouse is clicked. May be obtained as the position of the pupil. Even if the customer system 1 does not have the image analysis means 15A, it is possible to determine the superposition position of the spectacle image. In addition, the spectacles can be selected by the server system 2 only with a limited selection criterion called the pupil distance.

Further, the size of the face portion can be obtained without using the image analysis means 15A. That is, by the electronic line generating means (not shown) provided in the image processing device 15,
A straight line LH passing through the pupil positions H1 and H2 obtained by clicking the mouse and a straight line LV passing through the midpoints of the pupil positions H1 and H2 and orthogonal to the straight line LH are generated and displayed on the face image (Fig. 3). And the customer straight lines LH and LV
The intersection points P1, P2, P3, and P4 of the contour line of the face portion are clicked with the mouse, and the width W, the length L, and the pupil height H of the face portion are obtained from the position on the screen where the mouse is clicked. Then, next, a straight line LH2 parallel to the straight line LH is applied to the electron line generating means.
At the position of height H / 2, and let the customer click the intersection points P5 and P6 of the straight line LH2 and the contour line of the face with the mouse,
From the position on the screen where the mouse is clicked, the width W1 of the face portion at the position of height H / 2 is obtained.

Similar to the case where the image analysis means 15A is provided,
Glasses can be selected based on the face size. The image synthesizing unit 15B desirably determines that the pupil position of the face image and the design pupil position match with both eyes. If the distance between the pupils of the face image and the distance between the designed pupil positions are different, the vertical direction matches, and in the left-right direction, the amount of deviation between the pupil position of the facial image and the designed pupil position is the same for both eyes, and is symmetrical. Decide to be. In the left-right direction, the vertical bisector of the line connecting the pupil positions of both eyes of the face image may be determined so as to coincide with the symmetrical left and right center lines of the glasses.

Thus, the composite image in which the image of the eyeglasses is automatically superimposed and combined at the correct wearing position on the face image is displayed on the display unit 17. A "hope for mounting" button 51, a "return" button 52, and a "implementation for mounting designation" button 53 are displayed on the display of the composite image.

The image composition means 15A may be provided not in the customer system 1 but in the server system 2. In that case, the customer system 1 sends the face image and the information for specifying the spectacles designated as the virtual wear request, for example, the model number to the server system 2, and the image synthesizing means 15A of the server system 2 sends the synthetic image. Is generated and returned to the customer system 1, and the customer system 1 displays the composite image on the display unit 17. Since the customer system 1 does not require an image synthesizing means, a personal computer having a low function can be used.

The image analysis means 15B may be provided not in the customer system 1 but in the server system 2. In that case, the customer system 1 transmits the face image to the server system 2, and the image analysis means 15B of the server system 2 detects the pupil position and returns the pupil position to the customer system 1. The above process may be performed only once. Then, the customer system 1 uses the pupil position received from the server system 2 to perform the virtual wear. Since the customer system 1 does not need the image analysis means, a personal computer having a low function can be used.

In step 55, the customer looks at the displayed composite image and determines whether it is preferable or not, and if so, selects the "hope for mounting" button 51, and if not, selects the "return" button 52. To do. The above may be repeated to select “hope for mounting” for a plurality of glasses. When the spectacles desired to be mounted are selected, the “mounting execution designation” button 53 is selected. In response to the selection, the process returns to step 6 in FIG. It should be noted that the spectacles desired to be mounted may be selected by simply looking at the displayed spectacle image while omitting the virtual spectacles.

As described above in detail, the customer can easily confirm the face image in a state where the spectacles are worn at the correct positions and select the preferable spectacles. Also, it is possible to easily select fashionable eyeglasses that suit oneself. It should be noted that the retail store system 3 may be provided with the function of the server system 2 to form a virtual eyewear wearing system including the customer system 1 and the retail store system.

Further, the retail store system 3 may be provided with the functions of the server system 2 and the customer system 1 so that a customer who comes to the spectacle store can wear the costume for spectacles.

[0060]

As described above in detail, according to the system of the present invention, spectacles of an appropriate size are selected and recommended according to the face size of the customer, the strength and type of the spectacle lens used. Therefore, the customer can select the appropriately sized glasses in a short time.

Further, it is recommended that the eyeglasses have a shape, size, material and color that are generally suitable for the customer's facial features and skin color. As a result, the customer can easily select the spectacles that suit him.

[Brief description of drawings]

FIG. 1 is a block diagram showing a system configuration of an embodiment of the present invention.

FIG. 2 is a flowchart illustrating a procedure of a transaction method by the system of FIG.

FIG. 3 is a diagram showing an image of a face portion taken in by an image synthesizing unit.

FIG. 4 is a diagram showing a mounting implementation information input screen.

FIG. 5 is a diagram illustrating a detailed procedure of step 5 of FIG.

FIG. 6 is a diagram showing a screen displaying an image of glasses obtained from a server system.

FIG. 7 is a diagram showing a screen displaying an image in which a face image and eyeglasses are combined.

FIG. 8 is a diagram showing dimensional data of each part of eyeglasses.

FIG. 9 is a diagram showing a screen displaying an edge thickness of a spectacle lens when it is fitted to spectacles.

[Explanation of symbols]

1 ... Customer system 2 ... Server system 3 ………… Retail system 4 ... Internet network 11 ... Image input section 15 ... Image processing unit 15A ... Image analysis means 15B ... Image synthesizing means 25 ... Glasses selection section

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) G02C 13/00 G02C 13/00 G06T 3/00 300 G06T 3/00 300

Claims (19)

[Claims] 1. An image input unit for inputting an image of a customer's face portion, an analysis unit for obtaining face portion data showing a feature of the face portion based on the image of the face portion, an image of eyeglasses and various items relating to the eyeglasses. A recording unit that stores spectacle data made up of data, a spectacle selecting unit that selects spectacles based on the face data and the spectacle data, and an image of the selected spectacles is superimposed on the image of the face unit. An eyeglasses selection support system, comprising: an image combining unit that generates a combined image, and a display unit that displays the combined image. 2. The system according to claim 1, comprising a customer system, a server system, and communication means for connecting the customer system and the server system so that data can be exchanged. Includes the image input unit, the analysis unit, the image composition unit, and the display unit, the analysis unit outputs the face data to the server system,
The image composition unit obtains the image of the selected eyeglasses from the server system, the server system has the eyeglasses selection unit, and sends the image of the selected eyeglasses to the customer system. Eyeglass selection support system. 3. The system according to claim 1, wherein the analysis unit is an image analysis unit that analyzes an image of a face portion and obtains face portion data indicating a feature of the face portion. Eyeglass selection support system. 4. The system for supporting selection of eyeglasses according to claim 1, wherein the face data includes data regarding a size of the face. 5. The eyeglasses selection support system according to claim 1, wherein the face data includes data regarding a shape of the face. 6. The eyeglasses selection support system according to claim 1, wherein the face data includes data regarding a skin color of the face. 7. An image input unit to which an image of a customer's face portion is input, an analysis unit for obtaining face portion data indicating a feature of the face portion based on the image of the face portion, and an image of glasses to the face portion. Image combining unit that generates a combined image superimposed on the image of, a display unit that displays the combined image, and output the face data obtained by the analysis unit to the outside, and select based on the face data. And an input / output unit for externally receiving the image of the displayed glasses, the customer system of the glasses selection support system. 8. A storage unit in which an image of eyeglasses and eyeglass data including various data relating to the eyeglasses are recorded, an input unit for receiving face data indicating characteristics of a customer's face, the face data and the eyeglasses. A data server of a spectacles selection support system, comprising: a spectacles selection unit that selects spectacles based on data, and an output unit that outputs the image of the selected spectacles and spectacles data to the outside. 9. An image input unit for inputting an image of a customer's face portion, a recording unit for storing image data of eyeglasses and eyeglass data including various data relating to the eyeglasses, data showing a power of an eyeglass lens, and A spectacle selection unit that selects spectacles based on spectacle data, an image synthesizing unit that generates a synthetic image by superimposing the image of the selected spectacles on the image of the face portion, and a display unit that displays the synthetic image. An eyeglasses selection support system comprising: 10. The system according to claim 9, wherein the image of the customer's face input to the image input unit includes an image of a state in which glasses are worn, and the glasses selection unit displays the image. An eyeglasses selection support system including an image analysis unit that analyzes and obtains the dioptric power of the eyeglass lens of the eyeglasses. 11. The spectacles selection support system according to claim 9, further comprising an input unit for inputting data indicating a power of the spectacle lens. 12. The system according to claim 9, wherein the spectacles selection unit obtains an edge thickness of the spectacle lens when put in spectacles, and the display unit displays the edge thickness. An eyeglasses selection support system. 13. The system according to claim 9, comprising a customer system, a server system, and communication means for connecting the customer system and the server system so that data can be exchanged. Includes the image input unit, the image combining unit, and the display unit, the image combining unit obtains the image of the selected glasses from the server system, the server system, the recording unit And an eyeglasses selection unit, and sends the image of the selected eyeglasses to the customer system. 14. The system according to claim 13, wherein the image of the customer's face input to the image input unit includes an image of a state in which glasses are worn, and the customer system analyzes the image. The eyeglasses selection support system further comprising an image analysis unit that obtains the power of the eyeglass lens of the eyeglasses and outputs the power to the server system. 15. The system according to claim 13, wherein the data indicating the power of the spectacle lens is transmitted from the customer system to the server system. 16. The system according to any one of claims 13 to 15, wherein the server system sends the edge thickness of the spectacle lens when it is put in spectacles to the customer system, and the display unit displays the edge thickness. An eyeglasses selection support system characterized by: 17. A customer system, a server system, and communication means for connecting the customer system and the server system so that data can be exchanged, and the customer system is an image of eyeglasses obtained from the server system. The server system, when the customer system displays the image of the glasses in a predetermined color on the display system, the server system sets the color display parameter that changes the color actually displayed. The customer system displays the image of the eyeglasses according to the color display parameter received from the server system. 18. The system according to claim 17, wherein the customer system uses an image input unit to which an image of a customer's face is input and an image of eyeglasses obtained from the server system as the image of the face. An image synthesizing unit that generates a superimposed synthetic image, and the display unit displays the synthetic image according to a color display parameter that receives the synthetic image from the server system. system. 19. The system according to claim 17, wherein when the customer system receives a color display parameter from the server system, the customer system records the current color display parameter and the received color display parameter. And the recorded color display parameter is validated when the selection assistance by the eyeglasses selection assistance system is ended.