JPH11272728A - Spectacle lens image generation method and device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display spectacle lens images expressing the quality of a lens by reproducing the pseudo situation that a surrounding scene is lightly projected on the surface of the lens. SOLUTION: Projected images such as indoor actually projected images or the like projected to the lens and background images viewed through the lens such as the front face images of a person or the like are inputted (S101 and 102). For respective plotting points on a spectacle lens, which picture element of the background images is viewed through the spectacle lens at the plotting point is obtained (S103-108). Also, which picture element of the projected images is projected at the plotting point is obtained based on the shape information of the spectacle lens (S109-112). Further, by turning a color which is the result of adding the color of the picture element in the background images viewed through the spectacle lens and the color of the picture element in the projected images projected to the spectacle lens by a prescribed ratio to the color of the picture element of the plotting point, the spectacle lens images are plotted (S113).

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a spectacle lens image generating method and apparatus for artificially generating an image of a spectacle lens by a computer or the like, and more particularly to a realization of a lens portion of spectacles when spectacles are viewed from the front. The present invention relates to a method and apparatus for artificially generating a generic image.

[0002]

2. Description of the Related Art At a spectacles store, using a computer or the like, the spectacles are superimposed and displayed on the face image of the spectacles purchaser, so that what the spectacles purchaser looks like when wearing certain glasses is presented. There is known a spectacle wearing simulation system that assists spectacle purchasers in selecting spectacles and changing designs. As a method of generating a spectacle lens image in such a system, there is a method of photographing real spectacles in advance and superimposing the image. However, in this method, since only images of glasses that have been photographed in advance can be displayed, for example, a system that can change the outer shape of the lens portion of the glasses (hereinafter, referred to as a lens shape) according to the preference of the eyeglass purchaser is realized. Can not. Therefore, a method of artificially generating an image of a lens portion from information such as a target lens shape is used. For example, a method of drawing a lens image by lowering the luminance of a background portion viewed through the lens or adding a color based on the transmittance or the color of the lens has been used.

[0003]

However, the conventional method of drawing a lens image, which simply changes the brightness and color of the background portion seen through the lens, is inevitably a flat image and cannot express the texture of the lens. was there. The present invention has been made in order to solve the problems of the conventional art, and an object of the present invention is to display a spectacle lens image expressing a texture of a lens in a spectacle lens image generating method and apparatus. It is to provide a technology that becomes possible.

The above and other objects and novel features of the present invention will become apparent from the description of the present specification and the accompanying drawings.

[0005]

SUMMARY OF THE INVENTION Among the inventions disclosed in the present application, the outline of a representative one will be briefly described.
It is as follows.

That is, according to the present invention, a reflected image such as a real image of a room reflected on a lens and a background image viewed through a lens such as a frontal face image of a person are input, and each drawing point on a spectacle lens is input. In the drawing point, it is determined which pixel of the background image is seen through the spectacle lens, and also, which pixel of the reflected image is reflected in the drawing point based on the shape information of the spectacle lens, The spectacles are formed by adding the color of the pixels in the background image seen through the spectacle lens and the colors of the pixels in the reflected image reflected on the spectacle lens at a predetermined ratio to the color of the pixel at the drawing point. It is characterized by drawing a lens image.

[0007]

Embodiments of the present invention will be described below in detail with reference to the drawings.

In all the drawings for describing the embodiments, components having the same function are denoted by the same reference numerals, and their repeated description will be omitted.

[Embodiment 1] FIG. 1 is a flowchart showing a processing procedure of a spectacle lens image generating method according to Embodiment 1 of the present invention. FIG. 2 is a diagram for explaining the eyeglass lens image generation method according to the first embodiment. There are several factors that make us feel the texture of a transparent spectacle lens, but one of the major factors is the reflection of the scene due to slight reflection on the lens surface. In other words, roughly the spherical front and back of the lens, or the front and back of the lens, distorts and reflects the indoor lights and bright windows, and the background seen through the lens appears to overlap. You can feel the existence of a curved transparent object. In the eyeglass lens image drawing method of the present invention, the texture of the lens is expressed by simulating the appearance of the surrounding scene being reflected thinly on the surface of the lens.

Hereinafter, a method of generating an eyeglass lens image according to the present embodiment will be described with reference to FIGS.

First, data relating to a spectacle lens (hereinafter simply referred to as a lens) 201 required for drawing a spectacle lens image is input (step 101). This lens 2
The data relating to 01 include lens shape, lens curvature, lens power, lens transmission color, lens transmittance,
These are the color of the reflected light from the lens coating (a thin film applied to the lens surface to increase the transmittance of the lens), the shape information that is the reflectance of the lens, and the optical information. The data on the lens 201 may be accurate values based on the actual lens obtained from the lens design drawings and measurement results, or may be realistic values not based on the actual lens. It may be an appropriate value such that a drawing result image of the lens can be obtained.

Next, background image data 202 (hereinafter referred to as a background image) that can be seen through the lens 201 is input (step 102), and the background image 202 is enlarged or reduced based on the lens power (hereinafter, referred to as image data). This is called a background image after scaling.) 203 is created (step 103). In other words, the background image 202 is reduced at an appropriate reduction ratio if the power is for a myopic lens, and the background image is enlarged at an enlargement ratio if the power is for a hyperopic lens. It expresses that the background seen through a hyperopic lens looks large.

Next, reflected image data (hereinafter referred to as a reflected image) 204 is inputted (step 10).
4). The reflection image 204 is, for example, a normal indoor image in which a bright window or a light is reflected in the image, and the window or the light is reflected by the curved surface of the front surface of the lens. Next, a drawing result image memory for storing the drawing result image data (hereinafter, referred to as a drawing result image) 205 is prepared (step 105), and the lens target 206 is placed at a designated position on the drawing result image memory (step 105). Step 10
6) The following process is repeated to calculate the color of each pixel in the lens target 206 (step 107).

First, by extracting a pixel color 208 in the scaled background image 203 at the same position as the drawing pixel 207, the background image 2 seen through the lens 201 is extracted.
02 (the background color) (step 10)
8). Next, the line-of-sight direction 209 at the center (drawing point) of the drawing pixel 207 is determined (step 109). The line-of-sight direction refers to the direction from the eye position (viewpoint) when viewing the lens 201 to the gazing point, that is, the drawing point on the lens 201. When creating an image in which the spectacles are viewed from the front, there is no practical problem even if the direction of the optical axis of the lens 201 is regarded as the viewing direction.

Next, the normal direction 210 at the drawing point is determined based on the curvature of the front surface of the lens (step 110). When the front surface of the lens is a spherical surface, the direction from the center of the sphere forming the spherical surface to the drawing point on the front surface of the lens is the normal direction. Next, the specular reflection direction 211 of the line-of-sight direction at the drawing point is determined from the line-of-sight direction 209 and the normal line direction 210 (step 11).
1). The specular reflection direction 211 is a reflection direction when a light ray enters the drawing point at an angle of the viewing direction 209 and is reflected at the drawing point, and is a line symmetry of the viewing direction vector with the normal as the target axis. Obtained by finding a vector.

Next, as shown in FIG.
04 is arranged in parallel to the lens 201, and the specular reflection direction 21 starts from the drawing point of the lens 201.
The position of a pixel in the reflection image 204 located on the extension line of 1 is obtained, and the color (reflection color) 212 of the pixel is obtained (step 112). Finally, the background color 208 obtained in step 108 and the reflection color 21 obtained in step 112
2, the color of the drawing pixel 207 is obtained and stored in the drawing result image memory (step 113). As a specific calculation method of the drawing pixel 207, for example, there is a method as shown in the following equation (1).

[0017]

(Equation 1)

In the above equation (1), the colors are represented by three primary colors (R: red, G: green, B: blue), the color of the drawing pixel 207 is (R, G, B), and the background color 208 To (Rb,
Gb, Bb), and the reflected color 212 is changed to (Rr, Gr, B
r), the transmission color of the lens 201 is (Rt, Gt, Bt),
Change the coating color of the lens 201 to (Rc, Gc, Bc)
And the transmittance of the lens 201 is T1 and the reflectance is T
It is represented by 2. That is, in the above equation (1), the three primary colors (R
For each element of (GB), the background color 208 is colored with the transmission color of the lens 201 and multiplied by the transmittance (T1), and the reflection color 212 is colored with the coating color and multiplied by the reflectance (T2). The combined values are used as the color of the drawing pixel 207. In addition, in the reflection on the lens 201, the reflection of a very bright portion such as a window or an electric light is clearly visible,
The other dark parts often do not show much reflection. In order to obtain such a drawing result, the color of the drawing pixel 207 may be calculated using the result obtained by converting each element of the reflection color (Rr, Gr, Br) by a function as shown in FIG. That is, when the reflection color 212 has a small value (dark) to some extent, the value is converted to a value of almost 0 so that reflection only in a bright portion can be seen. The above processing is repeated until the colors of all the pixels in the lens target 206 are calculated (step 11).
4). As a result, a lens image is generated in the drawing result image memory.

As described above, according to the eyeglass lens image generation of the present embodiment, the background image 202
, And a lens image in which the surrounding scenery (for example, the state of a room) is reflected thinly, and a lens image expressing the texture of a transparent lens can be obtained. In this case, the reflected surrounding scenery reflects the coating color of the lens 201, and furthermore, the background seen through the lens 201 is scaled and colored according to the power and transmission color of the lens 201. An extremely realistic spectacle lens image can be generated. As a result, a face image wearing more realistic glasses can be displayed.

[Embodiment 2] In the eyeglass lens image generating method according to the second embodiment of the present invention, before drawing a lens image, first, the image is reflected at each drawing point in the lens shape of the lens (201 in FIG. 2). The positions of the pixels in the reflected reflected image are obtained in advance and stored in the reflected pixel position table. FIG. 4 is a flowchart showing a procedure for creating a reflection pixel position table used in the eyeglass lens image generation method according to the second embodiment of the present invention. Hereinafter, a procedure of creating a reflection pixel position table used in the eyeglass lens image generation method according to the present embodiment will be described with reference to FIG. First, the maximum lens shape of the lens (the lens before cutting according to the lens shape, that is, a “round lens”) and the curvature of the front surface of the lens are input (step 401). Next, the following processing is repeated for each pixel in the lens target (206 in FIG. 2) (step 40).
2). First, the line-of-sight direction (209 in FIG. 2) at the center (drawing point) of the drawing pixel (207 in FIG. 2) is determined (step 403). Next, the normal direction (210 in FIG. 2) of the front surface of the lens at the drawing point is determined based on the curvature of the front surface of the lens (step 404). Next, the specular direction (211 in FIG. 2) of the line of sight at the drawing point is determined from the line of sight and the direction of the normal (step 405). Next, assuming that the reflection image (204 in FIG. 2) is arranged in parallel to the lens, the positions of the pixels in the reflection image located on the extension line in the regular reflection direction with the drawing point of the lens as the starting point are determined. Then, it is stored in the reflection pixel position table (step 406). The above-described processing is repeated until the processing is executed for all the pixels in the lens target (step 407).

The reflection pixel position table is a two-dimensional table as shown in FIG. Each column of the reflection pixel position table corresponds to each drawing pixel on the maximum lens shape, for example,
Assuming that the position of the drawing pixel is (X, Y), the column in this table where the horizontal index is X and the vertical index is Y is the column corresponding to the drawing pixel. Each column in the reflection pixel position table stores the position (x, y) of a pixel in the reflection image reflected on the pixel corresponding to that column. That is, once this reflection pixel position table is created, for example, (Xn, Y
It can be immediately understood that the pixel in the reflected image reflected on the pixel located at (n) is the pixel located at (xn, yn).

FIG. 6 is a flowchart showing a processing procedure of the eyeglass lens image generating method according to the second embodiment of the present invention. Hereinafter, the spectacle lens image generating method according to the present embodiment will be described with reference to FIG. First, data on a lens necessary for drawing a lens is input (step 40).
8). Data on this lens include lens geometry, lens power, lens transmission color, lens transmission, lens coating (thin film applied to the lens surface to increase lens transmission), lens reflection Rate. Next, a reflection pixel position table calculated and stored in advance is read (step 409), and a background image seen through the lens is input (step 410). Next, image data is created by enlarging or reducing the background image based on the lens power (step 411). Next, a reflected image is input (step 412). Next, a drawing result image memory for storing the drawing result image is prepared (step 413),
The lens target is placed at the designated position on the drawing result image memory (step 414), and the following processing is repeated to calculate the color of each pixel in the lens target (step 415).

First, the color of the pixel in the background image (background color) that is seen through the lens is obtained by extracting the color of the pixel in the background image after the scaling at the same position as the drawing pixel (207 in FIG. 2). (Step 416). Next, it is checked from the reflection pixel position table which pixel in the reflection image is reflected on the drawing point, and the color of the pixel (21 in FIG. 2) is determined.
2) is obtained (step 417). Finally, step 41
Using the background color obtained in step 6 and the reflection color obtained in step 417, the color of the drawing pixel is obtained and stored in the drawing result image memory (step 418). The above processing is repeated until the colors of all the pixels in the lens target are calculated (step 419).

The processing (steps 401 to 407) for creating the reflection pixel position table is performed by the lens 201
Performed with the maximum lens shape. The maximum lens shape is a lens shape before the lens 201 is cut according to the rim shape of the glasses. Thus, a lens image of a lens 201 having an arbitrary lens shape smaller than the maximum lens shape can be generated at a high speed by the processing of Steps 408 to 419 in FIG. As described above, in the present embodiment, the reflection pixel position table is created in advance, and the reflection pixel position table is calculated from the reflection pixel position table without calculating the position of the pixel in the reflection image for each drawing point. By examining which pixel in the image is reflected on the drawing point and obtaining the color of that pixel, the processing amount of the lens image generation processing is reduced.

[Embodiment 3] FIG. 7 is a block diagram showing a schematic configuration of an eyeglass lens image generating apparatus according to Embodiment 3 of the present invention. In the figure, 601 is a lens data storage unit, 602 is a background image memory, 603 is an image enlargement / reduction unit, 604 is a reflection image memory, 605 is a drawing result image memory, and 606 is a lens image generation processing unit. Here, the lens data storage unit 601 stores the input lens shape, lens curvature, lens power, lens transmission color,
Data regarding the lens 201 such as the color of the lens coating and the reflectance of the lens is stored. Background image memory 60
2 stores an image such as a human face image that can be seen through the lens 201 of FIG. The image enlargement / reduction unit 603 enlarges or reduces the background image based on the lens power in order to express an effect in which the background looks small with the near vision lens and the background looks large with the long vision lens. The reflection image memory 604 stores a reflection image to be reflected on the lens. The drawing result image memory 605 stores the drawn lens image. The lens image generation processing unit 606 is a unit that generates a lens image of eyeglasses based on lens data, a background image, and a reflected image.

The operation of the eyeglass lens image generating apparatus according to the present embodiment will be described below. First, the lens data, the background image, and the reflection image are stored in the lens data storage unit 6.
01, background image memory 602, reflected image memory 60
4 is entered. Next, the background image is reduced or enlarged by the image enlargement / reduction unit 603 based on the lens power of the lens data. Next, in the lens image generation processing unit 606,
A lens image is generated using the lens data, the scaled background image, and the reflected image, and a drawing result image memory 605 is generated.
And finally output as a spectacle lens image. The specific lens image generation processing in the lens image generation processing unit 606 is similar to the processing of steps 106 to 114 of the first embodiment, or steps 402 to 407 and steps 414 to 419 of the second embodiment. Therefore, a detailed description of the operation content is omitted here.

In each of the above embodiments, the case where the surrounding scenery (for example, the state of the room) is reflected on the front surface of the lens and reflected in the background image has been described. However, the present invention is not limited to this. May be reflected on the back of the lens and reflected in the background image. Even in such a case, it goes without saying that the eyeglass lens image generation method and apparatus of the present invention can generate a lens image in which the surrounding scenery is reflected on the back surface of the lens and reflected in the background image. As described above, the invention made by the inventor has been specifically described based on the embodiment. However, the present invention is not limited to the embodiment, and can be variously modified without departing from the gist of the invention. Of course, it is.

[0028]

The effects obtained by typical ones of the inventions disclosed in the present application will be briefly described as follows.

(1) According to the present invention, the background image can be seen through the spectacle lens, and the surrounding scenery (for example,
It is possible to create a spectacle lens image that reflects the appearance of a room or the like, and to obtain a spectacle lens image expressing the texture of a transparent spectacle lens.

(2) According to the present invention, the surrounding scenery reflected reflects the coating color of the spectacle lens, and the background seen through the spectacle lens is enlarged according to the power and transmission color of the spectacle lens. Since the image is reduced and colored, an extremely realistic spectacle lens image can be generated. As a result, it is possible to display a face image wearing more realistic glasses.

[Brief description of the drawings]

FIG. 1 is a flowchart illustrating a processing procedure of an eyeglass lens image generation method according to a first embodiment of the present invention.

FIG. 2 is a diagram for explaining a spectacle lens image generation method according to the first embodiment.

FIG. 3 is a graph for explaining one method of correcting the brightness of the reflected image according to the brightness of each pixel of the reflected image in the first embodiment.

FIG. 4 is a flowchart illustrating a procedure for creating a reflection pixel position table used in the eyeglass lens image generation method according to the second embodiment of the present invention;

FIG. 5 is a diagram showing an example of a reflection pixel position table used in the eyeglass lens image generation method according to the second embodiment.

FIG. 6 is a flowchart illustrating a processing procedure of an eyeglass lens image generation method according to the second embodiment of the present invention.

FIG. 7 is a block diagram illustrating a schematic configuration of a spectacle lens image generation device according to a third embodiment of the present invention.

[Explanation of symbols]

Reference numeral 201: lens, 202: background image, 203: background image after scaling, 204: reflected image, 205: drawing result image, 206: lens shape, 207: drawing pixel, 20
8: background color, 209: line-of-sight direction, 210: normal direction, 2
11 Specular reflection direction, 212 Reflected color, 213 Virtual viewpoint, 601 Lens data storage unit, 602 Background image memory, 603 Image scaling unit, 604 Reflected image memory, 605 Drawing result image memory , 606... Lens image generation processing unit.

Continued on the front page (72) Inventor Tsutomu Horikoshi Nippon Telegraph and Telephone Corporation 3-1-2, Nishishinjuku, Shinjuku-ku, Tokyo (72) Inventor Satoshi Suzuki 3-9-1, Nishishinjuku, Shinjuku-ku, Tokyo Nippon Telegraph and Telephone Inside Telephone Co., Ltd. (72) Inventor Takashi Hatanaka 2-7-5 Nakaochiai, Shinjuku-ku, Tokyo, Japan Speaking Company (72) Inventor Yasuyoshi Sakai 2-7.5-7 Nakaochiai, Shinjuku-ku, Tokyo, Japan Inside the corporation

Claims (7)

[Claims] 1. An eyeglass lens image generating method for artificially generating an eyeglass lens image from shape information and optical information of an eyeglass lens, wherein a first image located behind the eyeglass lens and a second image located ahead of the eyeglass lens. A second step of extracting a color of a pixel in the first image located at the same position as a drawing point for generating a spectacle lens image in the lens shape of the spectacle lens; A third method for determining a line-of-sight direction from a virtual viewpoint for generating an eyeglass lens image to a drawing point in the lens shape of the eyeglass lens
And calculating a specular reflection direction on at least one of the front and back surfaces of the spectacle lens with respect to the line of sight obtained in the third step based on the shape information of the spectacle lens.
And a fifth step of extracting a color of a pixel in the second image at a position intersecting with an extension of the specular reflection direction obtained in the fourth step, and a step of extracting the color of the pixel in the second step. Drawing in the target lens shape of the spectacle lens based on the color of the pixel in the first image, the color of the pixel in the second image extracted in the fifth step, and the optical information of the spectacle lens A sixth step of determining a color of a pixel of a spectacle lens image at a point; and a seventh step of repeating the second to sixth steps for all drawing points in the lens shape of the spectacle lens. A spectacle lens image generating method characterized by the above-mentioned. 2. A spectacle lens image generating method for artificially generating a spectacle lens image from shape information and optical information of a spectacle lens, wherein a first image positioned behind the spectacle lens and a second image positioned front of the spectacle lens. A second step of extracting a color of a pixel in the first image located at the same position as a drawing point for generating a spectacle lens image in the lens shape of the spectacle lens; From the reflection pixel position table storing the positions of the pixels in the second image reflected at each drawing point in the lens shape of the spectacle lens created in advance based on the shape information of the spectacle lens, A third step of obtaining the position of a pixel in the second image reflected on the drawing point in the target lens shape and extracting the color of the pixel; and a color of the pixel in the first image extracted in the second step And the third step A fourth step of determining the color of the pixel at the drawing point in the lens shape of the spectacle lens of the spectacle lens image based on the color of the pixel in the second image extracted in the above and the optical information of the spectacle lens And a fifth step of repeating the second to fourth steps for all drawing points in the lens shape of the spectacle lens. 3. The reflection pixel position table includes a first step of preparing a second image located in front of the spectacle lens, and a step of preparing a second image located in front of the spectacle lens from a virtual viewpoint for generating the spectacle lens image. To find the direction of the line of sight to the drawing point of
And calculating a specular reflection direction on at least one of the front and back surfaces of the spectacle lens with respect to the line-of-sight direction obtained in the second step based on the shape information of the spectacle lens.
And calculating and storing the position of a pixel in the second image that intersects the extension line in the specular reflection direction obtained in the third step.
The eyeglass lens according to claim 2, wherein the eyeglass lens is created by the following steps: and a fifth step of repeating the second to fourth steps for all drawing points in the lens shape of the eyeglass lens. Image generation method. 4. The prepared first image, wherein the image located behind the spectacle lens is an image enlarged or reduced based on optical information of the spectacle lens. The eyeglass lens image generation method according to claim 3. 5. A spectacle lens image generating apparatus for artificially generating a spectacle lens image from spectacle lens shape information and optical information, comprising: first means for inputting and storing spectacle lens shape information and optical information; A second means for inputting and storing a first image seen behind the spectacle lens, a third means for inputting and storing a second image seen forward of the spectacle lens, and a fourth means for generating an eyeglass lens image Means, and a fifth means for storing and outputting the generation result of the spectacle lens image, wherein the fourth means includes: The eyeglasses obtained based on the color of the pixel in the first image stored in the second means and located at the same position as the drawing point of the eye, and the shape information of the eyeglass lens stored in the first means Reflected at the drawing point in the lens lens Drawing in the target lens shape of the spectacle lens based on the color of the pixel in the second image stored in the third means and the optical information of the spectacle lens stored in the first means. A spectacle lens image generating apparatus, wherein a color of a pixel in a spectacle lens image at a point is determined. 6. A spectacle lens image generating apparatus for artificially generating a spectacle lens image from spectacle lens shape information and optical information, comprising: first means for inputting and storing spectacle lens shape information and optical information; A second means for inputting and storing a first image seen behind the spectacle lens, a third means for inputting and storing a second image seen forward of the spectacle lens, and a fourth means for generating an eyeglass lens image Means, and a fifth means for storing and outputting the generation result of the spectacle lens image, wherein the fourth means includes: Eyeglasses created in advance based on the color of the pixel in the first image stored in the second means at the same position as the drawing point of the eye and the shape information of the eyeglass lens stored in the first means Projected at each drawing point in the lens lens The color of the pixel in the second image reflected on the drawing point in the lens shape of the spectacle lens obtained from the reflection pixel position table storing the position of the pixel in the second image to be reflected; Determining a color of a pixel in a spectacle lens image at a drawing point in a lens shape of the spectacle lens based on the optical information of the spectacle lens stored in the first means. apparatus. 7. The spectacle lens image generating apparatus according to claim 5, further comprising: means for enlarging or reducing the first image based on the power of the spectacle lens.