JPH06186505A - Simulation device for frame of spectacles - Google Patents

Abstract

PURPOSE:To provide a simulation device for the frame of spectacles by which an operator can optionally perform such processing as enlarging/reducing, rotating or deforming to the image of the frame of spectacles. CONSTITUTION:A standard structure model matching part 15 matches a standard structure model to the image of the frame of spectacles inputted by an input part 13 for inputting the image of the frame of spectacles or the image of the frame of spectacles read out from a storage part 14 for storing the image of the frame of spectacles. In a processing part 17 for processing the image of the frame of spectacles, the matched structure model is enlarged/ reduced, rotated or deformed and the color information and the variable density information of the image of the frame of spectacles is allocated on the deformed structure model, and the deformed image of the frame of spectacles is produced.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a spectacle frame simulating device for displaying the wearing state of spectacle frames, and in particular, it can arbitrarily enlarge / expand the spectacle frame image.
The present invention relates to an eyeglass frame simulation device capable of performing processing such as reduction, rotation, and deformation.

[0002]

2. Description of the Related Art For example, when a customer buys a spectacle frame at an eyeglass store, the customer has conventionally worn the spectacle frame and viewed it in a mirror or the like, or advises a salesperson or the like. There was a way to get them to do it. However, in such a case, most customers have low eyesight and it is inconvenient to look at a mirror or the like while wearing a spectacle frame without properly prescribed lenses. Also, when trying on several eyeglass frames, it is necessary to change the eyeglass frames each time, which is very troublesome.

As a device for assisting the selection of such a spectacle frame, a device using a method of photographing a state in which the customer wears the spectacle frame and displaying the image, a face image of the customer, and a spectacle frame image. There is a device that uses a method of separately capturing images of the two and combining and displaying the images.

As the latter device, for example, Japanese Patent Laid-Open No. 63-
An example of the eyeglass frame selection assisting device is disclosed in Japanese Patent No. 261218. In this device, in order to match the composite position of the customer's face image and the eyeglass frame image, when the customer's face image is input, the composite image of the face image and the eyeglass frame image is displayed. Move your face,
Corrected to an appropriate position.

[0005]

However, in the above-mentioned conventional method, it is difficult to adjust the photographing position because the images cannot be combined in a desired positional relationship unless the customer moves his / her face by himself, which is very troublesome. Met. Further, in order to display a desired spectacle frame image, it is necessary to actually prepare the spectacle frame and input the spectacle frame image each time, which is inefficient and time-consuming.

Therefore, the present invention is intended to solve such a problem, and its purpose is to allow an operator to arbitrarily perform processing such as enlarging / reducing, rotating, or deforming a spectacle frame image. It is to provide an eyeglass frame simulation device capable of performing the above.

[0007]

A glasses frame simulation apparatus according to the present invention includes at least a face image input means for inputting a face image of a person, a glasses frame image input means for inputting a glasses frame image, and the face image of a person. Among the spectacle frame simulation apparatuses characterized by including an image synthesizing means for synthesizing the spectacle frame images and an image display means for displaying the synthesized image synthesized by the image synthesizing unit, On the other hand, a spectacle frame processing unit capable of performing processing such as enlargement / reduction, rotation, or deformation is provided.

Further, the spectacle frame processing means is provided with a spectacle frame image storage means for storing the spectacle frame image input by the spectacle frame image input means, so that enlargement / reduction and rotation of a plurality of spectacle frame images can be performed. Alternatively, processing such as deformation can be continuously performed.

Further, the spectacle frame processing means has a built-in structural model composed of a set of figures such as a plurality of points, straight lines, curved lines, curved surfaces, or solids having the inside filled therein. Then, the processing of the spectacle frame image is realized by performing processing such as enlargement / reduction, rotation, or deformation.

In addition, in the spectacle frame processing means, a standard spectacle frame of a structural model composed of a set of figures consisting of a plurality of points, straight lines, curved lines, curved surfaces, or solids filled inside A standard structure model suitable for expressing a shape is built-in, and a standard structure model storage means for storing the standard structure model and a standard structure model matching means for matching the standard structure model with an eyeglass frame image are provided. Is characterized by.

[0011]

Embodiments of the present invention will now be described in detail with reference to the drawings.

FIG. 1 is a block diagram showing a schematic structure of an embodiment of the present invention. A face image 21 of a desired person for performing a simulation simulation of wearing a spectacle frame, as shown in FIG. 2, is input to the face image input unit 11 according to the present embodiment. The face image 21 is subjected to various kinds of processing in the face image processing section 12, and a deformed face image 31 as shown in FIG. 3 is generated. The deformed face image 31 is sent to the image composition unit 18. However, the face image input unit 11 and the face image processing unit 12 can be realized by using known devices.

On the other hand, a desired spectacle frame image 41 for performing a wearing simulation as shown in FIG. 4 is inputted to the spectacle frame input section 13. In the eyeglass frame processing unit 110, first, the eyeglass frame image storage unit 1
4, the spectacle frame image 41 can be stored, so that an arbitrary spectacle frame image can be read out at any time if necessary. In the standard structure model matching unit 15, the standard structure model 51 stored in the standard structure model storage unit 16 as shown in FIG. A matching process is performed on the glasses frame image read from the frame image storage unit 14, and a structural model 61 corresponding to the glasses frame image 41 as shown in FIG. 6 is generated, for example.
Similarly, the standard structural model matching unit 15 uses the glasses frame image 41 to process the matched structural model 61 with color information and grayscale information represented by so-called texture mapping.

At this time, texture map information is generated which describes which part of the spectacle frame image 41 the color information / grayscale information is assigned to which position of the structural model 61. The structural model 61 and the texture map information generated by the standard structural model matching unit 15 are used by the spectacle frame image processing unit 17 for spectacle frame deformation processing. The spectacle frame image processing unit 17 enlarges or reduces the structural model 61,
It is rotated or deformed to generate a deformed structure model 71 as shown in FIG. 7, for example. A modified glasses frame image 81 as shown in FIG. 8 is newly generated by allocating color information / grayscale information of the glasses frame image 41 to the modified structure model 71 based on the texture map information.

The image synthesizing unit 18 synthesizes the deformed spectacle frame image 81 and the deformed face image 31 processed by the face image processing unit 12, and a synthetic face wearing spectacle frames as shown in FIG. The image 91 is generated.
If the face image processing unit 12 and the eyeglass frame image processing unit 17 have not performed the processing, the face image 21 input in the face image input unit 11 and the eyeglass frame input in the eyeglass frame image input unit 13 As a composite image of the image 41, a composite face image 101 as shown in FIG. 10 is generated. The synthetic face image 91 or the synthetic face image 101 is displayed on the image display unit 19. Here, the image display unit 19 can be realized by using a known device such as a CRT.

11 and 12 are flowcharts for explaining the operations of the spectacle frame image input unit 13 and the spectacle frame processing unit 110. The operations of the spectacle frame image input unit 13 and the spectacle frame processing unit 110 will be described in detail below with reference to the flowchart.

Step 1101 (input of spectacle frame image): In the spectacle frame image input section 13, the operator inputs a desired spectacle frame image 41 by using an image input device such as a camera. At this time, if the spectacle frame is fixed using a jig or the like, the direction of the spectacle frame and the like can be always input under the same conditions. Further, if the back of the spectacle frame is of a single color, the spectacle frame image can be easily extracted, which is convenient for performing image processing.

Steps 1102 to 1104 (storing spectacle frame image): If it is desired to store the spectacle frame image 41 input in step 1101, step 110
Select'Y 'in 2. In this case, in step 1103, the spectacle frame image 41 is stored in the spectacle frame image storage unit 14. The glasses frame image storage unit 14 is configured by using a known memory or the like. If you want to continue inputting new glasses frame images, select'Y 'in step 1104 and step 11
The processing of 01 is performed. If'N 'is selected in step 1102 or step 1104, step 11
The process proceeds to 05.

Step 1105 (selection of spectacle frame): Either the spectacle frame image 41 input in the image input section 13 or the spectacle frame image stored in the spectacle frame image storage section 14 is selected.

Steps 1106-1109 (matching of standard structure model): The standard structure model matching unit 15 stores the standard structure model stored in the standard structure model storage unit 16 for the eyeglass frame image selected in Step 1105. Align 51. Here, the structural model is
A geometric figure composed of a set of figures such as a plurality of points, straight lines, curves, planes, curved surfaces, or solids filled inside is suitable for representing the shape of an object or the like.
Also, some of the plurality of vertices are designated as feature points. These characteristic points are the most characteristic points for expressing the shape of the spectacle frame, and the approximate shape of the spectacle frame can be expressed by curve approximation using only these plural characteristic points. The standard structural model 51 of the present invention is a standard or average structural model suitable for expressing the shape of a spectacle frame, and is a triangular plane formed by a plurality of vertices and straight lines connecting the vertices. It is composed of a set of (hereinafter, triangular patches). Of course, the shape is not limited to the triangular patch, and a quadrangular plane (square patch) or the like is also possible. One or more standard structure models 51 are stored in the standard structure model storage unit 16.

In step 1106, in step 11
For the glasses frame image selected in 05,
Indicate where each feature point of the standard structure model 51 is located. As an instruction method, for example, a known method such as instructing an eyeglass frame image displayed on the display with a pointing device such as a mouse can be used.

At step 1106, each feature point of the standard structure model 51 and each designated point on the spectacle frame image selected at step 1105 have a one-to-one correspondence. At 1107, each feature point of the standard structural model 51 is moved.

FIG. 13 is a diagram for explaining the interpolation method in step 1108. In step 1108, another vertex is moved using the feature point moved in step 1107. At this time, the positions of the other vertices are obtained by interpolating the positions of the moved characteristic points. As an interpolation method, for example, there is a method of using a curve approximation formula as shown in formulas (1.1) to (1.6). In this method, as shown in FIG. 13, four feature points (P0 to P4) are used to interpolate a vertex Q between two feature points (between P1 and P2).

[0024]

[Equation 1]

[0025]

[Equation 2]

[0026]

[Equation 3]

[0027]

[Equation 4]

[0028]

[Equation 5]

[0029]

[Equation 6]

In the equation (1.1), Q is the position vector of the vertex to be interpolated, and p0 to p3 are the position vectors of the feature points used for the interpolation. a0 to a3 are respective coefficients and are as shown in the equations (1.2) to (1.5), respectively. However,
t changes within the range shown in the equation (1.6). That is, t
= 0 indicates a point that matches P1 and t = 1 indicates a point that matches P2. Of course, not only the above method but also a method suitable for each part of the spectacle frame may be used. In this way, interpolation is performed based on the positions of the feature points for all the vertices.

If the structural model 61 generated in steps 1106-1108 is not what is desired, step 1
In step 109, select'N ', and steps 1106 to 11 are performed again.
08 processing is performed. If “Y” is selected, the process proceeds to step 1201.

Step 1201 (color information / grayscale information processing): In the standard structure model matching unit 15, the step 1
A process of allocating color information and grayscale information of the spectacle frame image selected in step 1105 is performed on the structural model 61 generated in 106 to 1108. That is, the eyeglass frame image is projected on each triangular patch of the structural model 61, and the coordinates in each triangular patch are associated with the color information and the grayscale information of the projected image. This correspondence is generated as texture map information.

Steps 1202 to 1205 (enlargement / reduction of structural model): The structural model 61 matched by the standard structural model matching unit 15 is the eyeglass frame image processing unit 17.
Then, processing such as enlargement / reduction, rotation, or deformation is performed. In either process, basically the structural model 6
A method of moving one feature point and interpolating the other vertices is used. In this step, the process of enlarging / reducing the structural model will be described.

When "Y" is selected in step 1202, the structural model enlargement / reduction processing is performed in step 1203 and subsequent steps. If'N 'is selected, the enlarging / reducing process is not performed, and the process proceeds to step 1206.

At step 1203, the magnification for enlargement or reduction is input. At the same time, a reference point for enlargement / reduction may be input.

FIG. 14 is a diagram for explaining the movement of feature points in step 1204. In step 1204,
The feature points are moved according to the magnification input in step 1203. The movement method is, for example, as shown in FIG. 14, by changing the size of the position vector 143 of the feature point 142 starting from the reference point 141 according to the magnification input in step 1203 (position vector 143 ′). , And the method of moving to the position of the feature point 142 ′. The reference point may be defined in step 1203, or an initial value may be defined in advance.

In step 1205, the other vertexes are interpolated by using the moved feature points. The interpolation method can be performed by the same method as the method described in step 1108.

Steps 1206 to 1209 (Rotation of Structural Model): In this step, processing for rotating the structural model will be described.

When "Y" is selected in step 1206, the process of rotating the structural model is performed in step 1207 and subsequent steps. If “N” is selected, the rotation process is not performed and the process proceeds to step 1210.

At step 1207, the angle of rotation is input. For the rotation angle, for example, a three-dimensional orthogonal coordinate system is defined, and the rotation angle around each coordinate axis (x coordinate, y coordinate, z coordinate) is determined.

In step 1208, step 1207 is executed.
The feature points are moved according to the angle input in. The moving method can be performed using a known technique such as affine transformation. At this time, the origin of the coordinate system and the directions of the coordinate axes may be specified in step 1207, or initial values may be specified in advance.

In step 1209, other vertexes are interpolated using the moved feature points. The interpolation method can be performed by the same method as the method described in step 1108.

Steps 1210 to 1214 (deformation of structural model): If'Y 'is selected in Step 1210,
From step 1211, the process of deforming the structural model is performed. If'N 'is selected, the transformation process is not performed and the process proceeds to step 1214.

In step 1211, a desired moving position is designated for an arbitrary feature point of the structural model 61 in order to deform the structural model. The instruction method is, for example,
First, an arbitrary feature point of the structural model 61 displayed on the display is designated by a pointing device such as a mouse, and then a desired moving position is designated by a pointing device such as a mouse. Such an instruction can be given using a known device or method.

In step 1212, step 1211
The arbitrary feature point designated by is moved.

At step 1213, interpolation of other vertices is performed using the moved feature points. The interpolation method can be performed by a method similar to the method described in step 1108.

As a result of the processing in the above steps, the deformed structure model 71 is generated. If this deformed structure model 71 is not the desired one, step 1214 is executed.
To select'N '. In this case, the process returns to step 1202. If “Y” is selected, the process proceeds to step 1215.

Step 1215 (mapping process): FIG. 15 is a diagram for explaining the mapping process in step 1215. Color information / grayscale information is assigned to the deformed structural model 71 generated in the above steps based on the texture map information generated by the structural model matching unit 15. This can be performed using a method typified by so-called texture mapping.
As shown in FIG. 15, the point P in the triangular patch OAB forming the structural model 61 can be expressed by the equation (2.1) using the position vectors of the points A and B with respect to the point O.

[0049]

[Equation 7]

When the structural model 61 is subjected to processing such as enlargement / reduction, rotation, or deformation in the eyeglass frame image processing unit 17 to generate a deformed structural model 71, the triangular patches OAB constituting the structural model 61 are also generated. , The triangular patches OA′B ′ forming the deformed structure model 71 are deformed as shown in FIG. At this time, the triangular patch OAB
The point P inside corresponds to the point P ′ inside the triangular patch OA′B ′. This point P can be expressed by the equation (2.2) using the position vectors of the points A ′ and B ′ with respect to the point O.

[0051]

[Equation 8]

Similarly, by associating each point in the triangular patch OAB with each point in the triangular patch OA'B ', the color information and the grayscale information of each point can be associated, and as a result, the deformation It is possible to make the spectacle frame image 41 correspond to all triangular patches forming the structural model 71,
The modified glasses frame image 81 is generated.

The processing in the spectacle frame processing section 110 is completed as described above, and the modified spectacle frame image 81 is sent to the image synthesizing section 18.

In addition to the embodiments described above, the eyeglass frame simulation apparatus of the present invention can perform processing such as enlargement / reduction, rotation, or deformation by applying a similar structural model to a face image. Therefore, it is possible to simulate the glasses frame according to various facial expressions.

[0055]

As described above, according to the present invention,
By providing the spectacle frame processing means capable of performing processing such as enlargement / reduction, rotation, or deformation on the spectacle frame image, the spectacle frame image and the face image can be aligned by the processing of the spectacle frame image, The processing for image synthesis is simple and easy. Further, since it is possible to create an arbitrary spectacle frame shape, various spectacle frame shapes can be simulated without inputting an actual spectacle frame image, and the spectacle frame selection time can be shortened. Moreover, it is possible to reduce the product inventory at the store.

Further, according to the present invention, since the spectacle frame processing means is provided with the spectacle frame image storage means for storing the spectacle frame image input by the spectacle frame image input means, a plurality of spectacle frame images can be stored. Processing such as enlargement / reduction, rotation, or deformation can be performed continuously.
Or you don't need to input the deformation instruction each time,
The operation can be simplified. Further, by using the same enlargement / reduction magnification, rotation angle, or deformation instruction data for a plurality of eyeglass frame images, it becomes easy to compare the wearing states of the plurality of eyeglass frames.

Further, according to the present invention, the spectacle frame processing means has a built-in structural model composed of a plurality of points, straight lines, curved lines, curved surfaces, or a set of figures composed of a solid body filled with the inside thereof. As a result, the structural model is subjected to processing such as enlargement / reduction, rotation, or deformation, and further color information / grayscale information is assigned to the structural model, whereby the processing of the eyeglass frame image can be realized with less calculation. Therefore, the device is simplified, the circuit scale is reduced,
The processing speed can be increased.

Further, according to the present invention, among the structural models in which the spectacle frame processing means is composed of a set of figures including a plurality of points, straight lines, curved lines, curved surfaces, or solids filled inside, By incorporating a standard structural model suitable for expressing the shape of the spectacle frame and providing a standard structural model storage unit for storing the standard structural model, the structural model can be easily matched with the spectacle frame image, The time required for processing can be greatly reduced and the operability of the device is improved.

[Brief description of drawings]

FIG. 1 is a block diagram showing a schematic configuration of an embodiment of the present invention.

FIG. 2 is a diagram showing a face image 21 of a desired person.

FIG. 3 is a diagram showing a modified face image 31.

FIG. 4 is a diagram showing a desired spectacle frame image 41.

5 is a diagram showing a standard structural model 51. FIG.

6 is a diagram showing a structural model 61. FIG.

FIG. 7 is a diagram showing a modified structure model 71.

FIG. 8 is a diagram showing a modified glasses frame image 81.

9 is a diagram showing a synthetic face image 91. FIG.

FIG. 10 is a diagram showing a composite face image 101 when no processing is performed in the face image processing unit 12 and the spectacle frame image processing unit 17.

FIG. 11 is a flowchart illustrating operations of the spectacle frame image input unit 13 and the spectacle frame processing unit 110.

FIG. 12 is a flowchart illustrating operations of the spectacle frame image input unit 13 and the spectacle frame processing unit 110.

FIG. 13 is a diagram illustrating an interpolation method in step 1108.

FIG. 14 is a diagram illustrating movement of feature points in step 1204.

FIG. 15 is a diagram illustrating a mapping process in step 1215.

[Explanation of symbols]

 11 ... Face image input unit 13 ... Glasses frame image input unit 14 ... Glasses frame image storage unit 15 ... Standard structure model matching unit 16 ... Standard structure model storage unit 17 ... Glasses frame Image processing unit 18 ... Image combining unit 19 ... Image display unit 110 ... Glasses frame processing unit

Claims (4)

[Claims] 1. At least a face image input means for inputting a person's face image, a glasses frame image input means for inputting a glasses frame image, an image combining means for combining the person's face image and glasses frame image, and the image. Among the spectacle frame simulation apparatuses characterized by comprising an image display means for displaying the synthesized image synthesized by the synthesizing means, in particular, processing such as enlarging / reducing, rotating, or deforming the spectacle frame image. An eyeglass frame simulation device, comprising an eyeglass frame processing means capable of applying the above. 2. The spectacle frame processing means includes a spectacle frame image storage means for storing the spectacle frame image input by the spectacle frame image input means, and continuously enlarges / reduces / rotates a plurality of spectacle frame images. The spectacle frame simulation device according to claim 1, wherein processing such as deformation or deformation is performed. 3. The spectacle frame processing means includes a plurality of points,
Includes a structural model consisting of a set of figures consisting of straight lines, curved lines, curved surfaces, or solids filled inside, and performs processing such as enlargement / reduction, rotation, or deformation on the structural model. The spectacle frame simulation device according to claim 1, wherein the spectacle frame image processing is realized thereby. 4. The spectacle frame processing means includes a plurality of points,
Of the structural model consisting of a set of figures consisting of straight lines, curves, curved surfaces, or solids filled inside,
A standard structure model storing means for storing the standard structure model expressing the average shape of the spectacle frame and storing the standard structure model; and a standard structure model matching means for matching the standard structure model with a spectacle frame image. The eyeglass frame simulation apparatus according to claim 3, further comprising: