JP4750721B2 - Custom glasses manufacturing method - Google Patents

Description

Related applications

  This application is a continuation-in-part of U.S. Application No. 10 / 046,656, entitled “Method for Manufacturing Custom Glasses,” pending on October 25, 2001, which claims its benefit and is incorporated herein in its entirety.

  The present invention generally relates to glasses fitting and methods. In particular, the present invention relates to an eyeglass frame and lens automatic measurement and adjustment system.

  Current eyeglass manufacturing techniques cannot manufacture lenses that accurately correct patient wavefront aberrations. However, new manufacturing techniques that use epoxy resins that are cured to different refractive indices that match the patient's wavefront aberrations open up new challenges for manufacturing methods. In particular, adjusting eyeglasses to the patient's optical axis is most important in the manufacture of eyeglass lenses that correct aberrations other than spherical, cylindrical, and axial aberrations. In order to ensure such precise adjustment, it is necessary to accurately measure the distance from the apex of the cornea to the lens, the inter-pupil distance, and the centering of the optical axis of the spectacle lens to the patient's pupil (or visual axis). There is.

  Historically, eye care professionals have used relatively simple methods to position the eye relative to the spectacle frame. Experts typically measure the distance between two pupils (referred to as “interpupillary distance”) and the height from the center of the pupil to the bottom of the spectacle frame or lens. This latter distance is called “SEG height”. This information is required from the test room to adjust the optical axis of the lens to the axis of both eyes.

  One technique that has been used is to simply mark the center of the pupil above the lens with an oil-colored pencil by eye balling (visual analysis), with a ruler to determine the pupil distance (PD) and SEG height. It was a measure. In recent years, pupil and digital pupils have been used, and the measurement accuracy of PD has been improved. However, the pupil meter does not relate to PD measurement at the position behind the spectacle lens, and other important parameters are SEG height, distance between vertices or pantoscopic tilt (full field or total tilt, pantoscopic tilt). ) Cannot be measured. With the advent of progressive refractive lenses and the development of higher order correction zones, accurate measurement of these parameters is becoming increasingly important.

  US Pat. No. 5,617,155 to Ducarouge et al. Teaches a method for using images to determine the position of a spectacle frame relative to a subject's eye. In particular, this patent describes a technique for automatically detecting the position of a frame and an eye by analyzing the luminance gradient of a certain area of the pupil and the positions of horizontal and vertical lines tangent to the frame. This technology uses a single camera and does not provide metrics from the side, such as distance between vertices and tilt from the line of sight of the frame.

  Mothes US Pat. No. 6,659,609 describes a single camera system, preferably located at a distance of 3 m. This device requires the use of a calibration marker clipped to the spectacle frame, which provides a spatial comparison to determine the scale of the image. Also, as described in the patent, the patient looks at himself in the mirror rather than looking through the device.

  Norton et al., US Pat. No. 5,592,248, describes taking several images from different angles to obtain information for making eyeglasses. In this patent, it is claimed that one camera is used, and the camera is moved to a position necessary for obtaining an image necessary for three-dimensional reconstruction. The use of multiple cameras is discussed in the text, but it does not describe how to use multiple images in a coordinated manner or how to orient multiple cameras spatially with respect to each other, This patent does not allow the use of multiple cameras. Furthermore, image analysis and fiducial marks that automatically determine the position of the subject's pupil are not used, but are simply measured by a reciprocal software ruler on the image.

  Abitbol et al., US Patent Application Publication No. 2003-0123026, describes a three-dimensional camera system whose primary purpose is to digitally model and display eyeglass frames worn by digitally displayed subjects. is doing. However, reconstructing the patient in three dimensions is time consuming and unnecessary for the basic measurements required for eyeglass frame adjustment. Furthermore, the accuracy of commercially available 3D cameras is insufficient for positioning accuracy of less than 0.5 mm, which is usually required for accurate positioning of high-order correction zones.

US Patent No. 5,617,155 U.S. Patent No. 6,659,609 US Patent No. 5,592,248 US Patent Application Publication No. 2003-0123026

A frame adjustment system and method is disclosed. One or more imaging devices capture two or more images of the spectacle frame worn by the subject. The image is analyzed using automatic image processing techniques to identify the relationship between specific points of interest on the frame and the eye position of the subject (person) and the optical center of the lens. Can be arranged at the correct position of the frame. The image processing apparatus determines the inter-pupil distance and the pupil center from the image. The frame placement device can receive the position of one or more lens frames or determine the position of one or more lens frames. The image processing apparatus can accurately determine the pupil center and the SEG height of the correction lens to be adjusted and mounted in a desired spectacle frame.
In a first aspect, an eyeglass frame adjustment system according to the present invention relates to an imaging device configured to capture front and side images of a target field; and to an eyeglass frame captured in the front and side images An image processing device configured to receive and analyze the front and side images to determine a position of the pupil to be configured; and configured to illuminate the object when the imaging device captures the front and side images An illuminator, wherein the illuminator includes a plurality of light sources configured to form a predetermined pattern on a cornea of an object located in the object field. (Form 1)
From the viewpoint, it is preferable that the image processing apparatus determines the position of the pupil based in part on the predetermined pattern. (Form 2)
In a second aspect, an eyeglass frame adjustment system according to the present invention relates to an imaging device configured to capture front and side images of a target field; and to an eyeglass frame captured in the front and side images An image processing device configured to capture features based in part on the detected color and to receive and analyze the front and side images to determine a position of the pupil to be detected; An illuminator configured to illuminate the object when taking a side image, wherein the illuminator includes one or more colored light sources. (Form 3)
In a third aspect, an eyeglass frame adjustment system according to the present invention includes an imaging device configured to capture front and side images of a target field; and forms a predetermined pattern on the cornea within the target field. Analyzing the front and side images to determine, based in part on the predetermined pattern, a position of a pupil associated with the spectacle frame taken in the front and side images; And an image processing apparatus configured to do so. (Form 4)
In the above viewpoint, it is preferable that the imaging device is configured to capture an additional front image while one or more of the plurality of light sources are turned off. (Form 5)
In a fourth aspect, the method for adjusting the correction lens according to the present invention to a spectacle frame includes: taking a front image of a subject wearing the spectacle frame; taking a side image of the subject wearing the spectacle frame; Determination of the position of the lens frame from the captured image; determination of the position of at least one pupil of the object from the captured image; and the pupil center of the correction lens based in part on the position of the lens frame and the position of the pupil Imaging the front image of the object; illuminating the object with a plurality of light sources forming a pattern on at least one cornea of the object; and illuminating the plurality of light sources And taking the front image in between. (Form 6)
In a fifth aspect, a method for adjusting a correction lens according to the present invention to a spectacle frame includes: taking a front image of a subject wearing a spectacle frame; taking a side image of the subject wearing the spectacle frame; Determination of the position of the lens frame from the captured image; determination of the position of at least one pupil of the object from the captured image; and the pupil center of the correction lens based in part on the position of the lens frame and the position of the pupil Imaging the front image of the object; illuminating the object with a plurality of light sources forming a pattern on at least one cornea of the object; and illuminating the plurality of light sources Taking the front image in between; determining the position of the at least one pupil; identifying one or more bright pixels of the corneal image of the subject; identifying one or more dark pixels of the corneal image And said one or more Characterized in that it comprises a; and the identification of some based pupil on the relative relationship between the pixel and said one or more dark pixels. (Form 7)
In a sixth aspect, a method for adjusting a correction lens according to the present invention to a spectacle frame includes: taking a front image of a subject wearing a spectacle frame; taking a side image of the subject wearing the spectacle frame; Determination of the position of the lens frame from the captured image; determination of the position of at least one pupil of the object from the captured image; and the pupil center of the correction lens based in part on the position of the lens frame and the position of the pupil Imaging the front image of the object; illuminating the object with a plurality of light sources forming a pattern on at least one cornea of the object; and illuminating the plurality of light sources Taking the front image in between; and determining the position of the at least one pupil; comparing the taken front image to a predetermined light threshold to identify a bright pixel; Form a bright blob Performing a continuity analysis of the bright pixels for; sorting the bright blobs based in part on the dimensions of the bright blobs; comparing the captured front image to a predetermined dark threshold; Performing a continuity analysis of the dark pixels to form a dark blob; fractionating the one or more dark blobs based on the size of the blob; and the location of the fractionated dark blob and the location of the light blob Determining the position of the pupil based in part. (Form 8)
In a seventh aspect, the eyeglass frame adjustment system according to the present invention is configured to illuminate at least a part of the target field; an imaging device configured to capture front and side images of the target field; A plurality of colored light sources; and configured to analyze the front and side images to determine, based in part on a predetermined pattern, a position of a pupil associated with the spectacle frame taken in the front and side images And an image processing apparatus. (Form 9)
In the above viewpoint, it is preferable that the one or more colored light sources are configured to form a reference mark in the target field, and the image processing apparatus analyzes the front image based in part on the reference mark. (Form 10)
A first two-color beam splitter configured to reflect the side image of the target field to the imaging device at the viewpoint; and a configuration configured to reflect the front image of the target field to the imaging device A second two-color beam splitter being applied;
It is preferable to further contain. (Form 11)
In the above viewpoint, it is preferable that the first two-color beam splitter transmits light having a wavelength different from the wavelength of the light transmitted by the second two-color beam splitter. (Form 12)
In the above aspect, the plurality of colored light sources include a first colored light source and a second colored light source, the first two-color light beam splitter reflects a wavelength corresponding to the first colored light source, and The two-color beam splitter 2 preferably reflects a wavelength corresponding to the second colored light source. (Form 13)
In the above viewpoint, it is preferable that the imaging device captures continuous images, and illumination of each image corresponds to one of the plurality of colored light sources. (Form 14)

  The novel features of the structure and operation of the present invention, as well as the present invention itself, will be best understood by the accompanying drawings associated with the detailed description. Among them, similar reference numerals are used for similar parts.

  FIG. 1 is a wavefront measurement system, generally indicated at 100. In FIG. 1, the wavefront measurement system 100 includes a main housing 101 having a slit 102, and the main housing includes one or two cameras (not shown) for photographing the front surface of a patient (not shown) through the slit 102. Can be placed, but the patient can see a virtual or true fixed target. Further, each has a right housing 104 and a left housing 106 extending from the main housing 101 and having an opening 108 for a camera (not shown).

  In FIG. 2, a side view of the wavefront measurement system of FIG. In FIG. 2, the patient 202 is opposed to the main housing 101 and the slot 102 of the wavefront measurement system. A camera (not shown) installed in the right housing 104 images the temporal region including the ear 204 and the nose 206 of the patient 202. The camera (s) installed in the slot 102 images the eye 208 of the patient 202 and in particular the pupil 210.

  FIG. 3 shows a patient 302 wearing a spectacle frame 304 of known dimensions. The frame 304 has a nose molding 306 and an ear molding 308. Before the nose molding 306 and the ear molding 308 are cured, registration marks 310 and 312 are put on each. An image of the patient 302 wearing the frame 304 is taken by the wavefront measurement system 100, and the wavefront measurement system 100 captures the test frame 304, registration marks 310, 312, or both, and the head of the patient 302 for subsequent eyeglass adjustment. Used to quantify the face more accurately.

  FIG. 4 is an image of the patient's right side, indicated at 400. In FIG. 4, there is a right lens opening 402 attached to the right nose molding 404. Also visible in the image are the patient's right cornea vertex 406 and right ear molding 408. The registration mark 410 on the right nose molding 404 and the registration sign 412 on the right ear molding 408 allow the computer to determine the exact location of the right nose molding 404 and right ear molding 408 and the relationship between each other and the patient's right cornea vertex 406. Useful for making decisions.

  FIG. 5 is a front view of the patient's right side, indicated at 420. In FIG. 5, the patient's right pupil 426, right lens opening 402, right nasal molding 404 and registration mark 410 are visible in the image.

  FIG. 6 is a front view of the patient's left side, indicated by 430. In FIG. 6, the patient's left pupil 427, left lens opening 403, left nasal molding 405, and registration mark 411 are visible in the image.

  FIG. 7 is an image of the patient's left side and is designated 440. In FIG. 7, there is a left lens opening 403 attached to the left nose molding 405. Also visible in the image are the patient's left cornea vertex 407 and left ear molding 409. The registration mark 411 on the left nose molding 405 and the registration mark 413 on the left ear molding 409 indicate that the computer has determined the exact position of the left nose molding 405 and the left ear molding 409 with respect to each other and the patient's left cornea vertex 407. Useful for making decisions.

  After the patient is imaged, the computer examines and stores the left and right side images, including the plastic nose pad 306 and the plastic ear pad 308, and the two front images wearing the test frame 304, from the wavefront measurement system. From the images, the exact location of the plastic nose pad 306 and the plastic ear pad 308 is determined taking into account the relationship between each other and the patient's pupils 426, 427, corneal vertices 406, 407 and the test frame 304.

  FIG. 8 is a front image of the patient's face, indicated at 450. In FIG. 8, a single camera is used to photograph the face, and therefore, the image includes both lens openings 402 and 403, nose moldings 404 and 405, and pupils 426 and 427, respectively.

  FIG. 9 is a flowchart showing the steps of manufacturing custom eyeglasses, indicated by 500. In step 502, the patient looks into the wavefront measuring apparatus to capture an image. When the patient is in the proper position as in FIG. 2, in step 504, the cameras are instructed to image the front and both sides of the patient's face. Since the position of the camera is limited only to the necessity of photographing the both sides and the front of the patient, it is not limited to the arrangement shown in FIG. Step 506 indicates that it is necessary to image at various gaze angles of the patient's eye. When correcting higher-order aberrations, optical alignment of all gaze angles is an important requirement. Therefore, step 506 must be performed to ensure the proper function of the custom glasses. In addition, in step 507, wavefront measurement is required for each of the images taken in step 506. In step 508, the computer processes the information and returns the output to step 510. Output includes patient's pupil position, pupil center, pupil distance, face width, ear position, distance from wavefront measuring device to corneal apex, distance from ear to corneal apex, and patient's for eyeglass adjustment Other parameters required for head and face measurements. Using this information, collectively referred to as lens mounting parameters, custom glasses are manufactured as shown at step 512.

  FIG. 10 is a flow chart illustrating an alternative procedure for manufacturing custom eyeglasses, indicated at 600. In step 602, a plastic material is applied to the area around the patient's nose and ear, as shown in FIG. The plastic material allows a more conventional way to obtain a precise surface profile (profile) around the patient's nose and ears. To associate the molding with the wavefront measuring device, step 604 requires that a registration mark be applied before the molding is cured. The registration mark allows the wavefront measuring device to measure the mold associated with the patient's face. In step 606, a test frame of known dimensions is attached to the uncured plastic material. The registration sign in step 604 may or may not be attached to the frame in step 606. The frame of step 606, the molding of step 602, can be seen in FIG. In step 608, the patient looks into the wavefront measuring apparatus, as in step 502 of FIG. In step 610, the computer saves left and right side images and one or two front images of a patient wearing a test frame including a plastic pad. In step 612, the computer returns exactly the same output as the parameters shown in step 510 of FIG. 9, but with additional information about the test frame and molding. Finally, in step 614, the molding is duplicated or transformed to create a custom spectacle hinge and nose pad for a conventional frame.

  In a preferred embodiment, the various moldings are made of silicone. However, it is understood that any material that can be fitted to a person's head is suitable for this system.

  FIG. 11 is a preferred embodiment of a spectacle measurement system, indicated at 700. System 700 includes a main housing 702 having a right housing 704 and a left housing (not shown in this view) with space for a human head 706 therebetween. The patient's ear 708 is located between the housings on both sides, and the patient's eye 710 is located just before the slot 711 in the main housing 702.

  As shown, the patient sees the actual fixed target 712 along the optical axis 714. Located on the optical axis 714 is a variable angle two-color beam splitter 716 that splits a portion of the light from the patient's eye 710 into a second axis 718. Light passing along the second axis passes through a pair of imaging lenses 720 and 722 and reaches a wavefront sensor 724 such as a Hartmann-Shack sensor.

  In addition to forming the second axis 718, an additional beam splitter 726 can be placed on the optical axis to split a portion of the light on the optical axis to create a third axis 730. Light along the third axis passes through the imaging lens 732 and reaches an imaging device such as a charge coupled device (CCD) camera.

  A virtual second target 742 is provided on the second optical axis 740 when focusing at different focal lengths for eye analysis. In order to allow a part of the light passing through the second optical axis to reach the wavefront sensor 724, the beam splitter 716 rotates at an angle 744 and moves in the direction of (arrow view) 746, so that the splitter 716 Appropriately located on the second optical axis 740 (indicated by dotted line 748).

  Using the spectacle measurement system 700 facilitates the manufacture of spectacles by the method 600. By providing a single measurement system for measuring the optical correction required for two different gaze angles or optical axes, a correction lens can be manufactured that exactly matches the patient's needs.

  In order for the patient to optimally benefit from lens correction, the correction lens must be properly adjusted and attached to the spectacle frame. FIG. 12 is a functional block diagram of the automatic frame adjustment system 1200. The system 1200 accurately determines the pupil distance (PD) and SEG height for an individual patient and its spectacle frame. Such a measured value is used for accurate positioning of the correction lens in the spectacle frame, for example.

  The system 1200 may be configured to take one or more images of a patient wearing a spectacle frame that desires to adjust the correction lens. The resulting image is processed to determine information for attaching the lens to the frame, for example, the pupil distance and SEG height for the patient and their spectacle frame.

  System 1200 includes a patient positioning device 1202 that is configured to approximately position a patient's head in a predetermined field of view. The positioning device 1202 can be, for example, a chin rest, a forehead rest, an ear rest, a nose bridge, or other positioning device or a combination thereof. The positioning device 1202 is not limited to a mechanical positioning device, but may include types such as acoustic, visual, or other electrical positioning devices.

  The imaging device 1210 can be configured to capture one or more images of the patient's head showing the relationship between the spectacle frame and a portion of the patient's head. The illuminator 1220 can be configured to illuminate the patient's head and provide or create a reference mark on the captured image. An image processing device 1230 combined with the imaging device 1210 analyzes the captured image. The image processing device 1230 is configured to inspect the captured image and determine the pupil distance, SEG height, and pantoscopic tilt of the spectacle frame. The pantoscopic inclination is an angle with respect to the vertical line of the frame. The distance from each cornea to the lens is usually referred to as the vertex distance, which can also be determined.

  The captured image and the measurement result are output to the display 1260 or another output device such as a printer or a magnetic card writer. A processing device 1240 in communication with the memory 1250 can control some or all of the functions associated with the patient positioning device 1202, the imaging device 1210, the illumination device 1220, the image processing device 1230, and the display 1260. In addition, some or all of the functions performed by the various functional blocks in system 1200 are stored in memory 1250 as one or more instructions readable by the processing device and executed by processing device 1240. For example, in one embodiment, the image processing function is stored as software in the memory 1250 and executed by the processing device 1240 that executes the image processing software.

  The imaging device 1210 includes one or more cameras or other imaging devices. Cameras can be either color or monochrome. Further, the one or more cameras can be configured with a telecentric lens. For example, the imaging device 1210 may include one or more cameras, CMOS cameras, charge coupled devices, photosensitive devices, etc., or other imaging devices. Similarly, the lighting device 1220 includes one or more light sources and may include one or more light filters. For example, the one or more light sources may include incandescent light sources, fluorescent light sources, halogen light sources, xenon light sources, LED light sources, gas discharge light sources, synchrotron light sources, laser light sources, or other light sources. The lighting device 1220 may include a white light source, a colored light source, a visible light source, an invisible light source, or a combination of light sources. Filters may include optical filters, tilt filters, polarizing filters, etc., or other types of filters. In one embodiment, the processing device 1240 controls the time and intensity of illumination from the lighting device 1220. In other embodiments, the one or more lighting devices may include one or more light sources. Light from several light sources can be filtered using an optical filter to color the light from the light source. In that case, the image processing apparatus may be configured to capture a feature by partially detecting the color.

  FIG. 13A is one embodiment of the frame adjustment system shown in FIG. FIG. 13A shows the relationship between the frame adjustment system 1300 and the patient 1308 wearing the spectacle frame 1306. Patient 1308 can be relative to the imaging device using forehead support 1304.

  The imaging device in the system uses two cameras 1310 and 1312 that capture an image of a patient or subject 1308 wearing a spectacle frame 1306. The cameras 1310 and 1312 can be, for example, CMOS cameras.

  The first camera 1310 is arranged to capture a front image of the subject 1308 on a plane that passes through the axis between the eyes and is horizontal to the subject's eyes. Desirably, the first camera 1310 images the patient 1308 through a beam splitter 1330 located at substantially 45 °. The beam splitter 1330 allows the patient 1308 to focus on a distant object without looking at the camera 1310. By using a beam splitter 1330, the subject can advantageously look out of the device and focus on one or more real or fixed targets placed at one or more distances and / or locations within the field of view. Can be combined. By using real or fixed targets at various distances and / or positions, the system can capture and measure the position of the pupil at various eye orientations. For example, the first pupil discrimination is determined using a first set of images taken when the subject is focused on a target placed at a normal reading angle at a normal reading distance. The second pupil discrimination is determined using a second image set that is taken when the subject is focused on a distant object.

  The beam splitter 1330 can alternatively be a partial silver mirror, a two-color filter, or other beam splitter. The subject 1308 can focus on distant objects without the screen being blocked by the first camera 1310 with this system. This ensures that the subject's eye placement is not affected by objects in the near field of view. Such an object in the near field of view affects, for example, the accuracy of the determination of the inter-pupil distance.

  The second camera 1312 is arranged to capture an image substantially perpendicular to the image captured by the first camera 1310. The second camera 1312 may be configured to take a side image of the patient 1308. The second camera 1312 can be positioned so that the camera axis is approximately on the line of the patient's cornea.

  An optional third camera (not shown) can be placed at the top, looking down along a vertical line that coincides between the patient's eyes. Either of the cameras 1310 and 1312 can be configured to capture an image of the patient 1308 at the same time. Alternatively, the cameras 1310 and 1312 can be configured to take images of the patient 1308 sequentially. For example, if the 1310 and 1312 cameras capture images in order, the interval between successive images can be adjusted to minimize movement between images of the patient 1308. As one embodiment of continuous shooting, the camera can repeat shooting at a rate of about 15 frames per second.

  In one other embodiment, a single camera can capture multiple images. For example, one camera is moved before taking a predetermined image. Alternatively, a plurality of images can be taken simultaneously by a single camera by using a filter and a reflector and / or an illumination source having a different wavelength. For example, in the system shown in FIG. 13A, a single wide-angle camera can simultaneously capture front and side images of a patient 1308 using two wavelength-dependent beam splitters and two different wavelengths of illumination. An alternative embodiment with one camera is shown in FIG. 13B.

  Image analysis can be performed using an image processing device (not shown) to determine the position and angle of the frame at the patient 1308. For example, the positions of a plurality of cameras and image capturing are defined by a calibration procedure so that a subject photographed by the camera 1310 is three-dimensionally arranged and measured in software. The calibration procedure may include, for example, placing and photographing something like a calibrator or a calibration accessory in the field of view of the cameras 1310, 1312. The image processing device is calibrated using the captured image of the calibration accessory.

  The calibration is taken so that every camera in the system is calibrated in relation to the other cameras. The calibration procedure is performed using a three-dimensional spatial configuration accessory. By the calibration of the camera, the spatial relationship between items captured in each image can be determined by the image processing apparatus.

The calibration accessory can have, for example, a surface with a grid of known dimensions. Images taken with the camera are calibrated with the dimensions of the grid. In one embodiment, the calibration accessory can be a cube with a surface that has a grid of known dimensions. The cube face is placed at an angle of about 45 degrees with respect to the axes of the first and second cameras 1310 and 1312. As a second embodiment, the calibration object is a plane on which a grid with known dimensions is written. This plane is placed at an angle of about 45 degrees with respect to the axes of the first and second cameras 1310 and 1312. In another embodiment, the calibrator is a scale with marks of known dimensions. This scale is placed at an angle of about 45 degrees with respect to the axes of the first and second cameras 1310 and 1312.

  The image of the patient 1308 taken by each camera is analyzed using image recognition software, and the contour of the frame 1306 and the position of the patient's pupil in each image are determined. The image processing apparatus determines the position of the frame 1306 with respect to the eye, and gives the inter-pupil distance and SEG height from the front image, and the inter-vertex distance and pantoscopic tilt coordinates from the side image. A top camera (not shown) can be used to verify that the patient 1308 is aligned with the first and second cameras 1310, 1312. If the image processing apparatus determines that the patient 1308 has not been aligned with respect to the camera, the image processing apparatus uses a partial upper camera image to obtain a measurement value due to an angular shift between the camera and the optical axis of the eye. Additional information can be provided to correct.

  In order to simplify the image processing function, the system can use controlled lighting. There are two purposes for this controlled illumination. Uniform indirect illumination can illuminate the frame 1306 and the face to better perform the image processing procedure. In order to further enhance the ability of the image processing algorithm to identify the patient's 1308 pupil, a directional point light source or fiducial mark is added in place. The point light source can be configured to reflect the cornea in a special pattern. Using pattern recognition, an image processing device or image processing software can look for special patterns in each image. For example, the determined pattern is two or more points outside the pupil in the front image, and is one reflected light source in the side image. A point light source can have a specific color so that it can be easily distinguished by spectroscopic features in the image. Alternatively, a filter can be placed in front of one or more light sources to change the color or spectrum of the light from the light sources.

  Furthermore, the computer can be controlled by the processing device 1240 in FIG. By repeating the illumination, one image can be taken with the illumination ON. It is also possible to turn off one or more lights before going to the next image so that they are not reflected in the image for detecting the pupil. Continuous images can be taken in a short time so that the movement between images is as small as possible and substantially zero. The two images are overlaid or compared to determine the pupil reflection mark from the light source.

  Alternatively, a uniform light source can be used without using a point light source. In FIG. 13A, a first light source 1342 is disposed along one side of the patient 1308's face. A second light source 1344 is disposed along the opposite side of the patient's 1308 face. Each light source can be, for example, an array of LED light sources or an incandescent lamp. The cornea reflects light from the light sources 1342 and 1344. The spherical cornea reflects light from a substantially localized light source onto the cornea, even from a substantially uniform light source. Thus, a light source, such as 1342, 1344, produces reflected light on each cornea of patient 1308. Each reflected light is substantially localized as a point on the cornea.

  An image processing apparatus (not shown) can detect a reflection point on the cornea from a captured image. For example, the image processing apparatus can search for a high-luminance point in the image. Once these corneal points in the image are identified, the image processing device in turn looks for dark circles of the pupil that are within the specified area of reflection. An image processor can use, for example, connectivity or blob analysis to distinguish pupils. It is preferable that the image processing apparatus can perform a two-dimensional image search to search for a pupil. Thus, the image processing apparatus determines the center of the pupil.

  In one embodiment, the subject 1308 can first shoot without wearing the spectacle frame 1306 and then wear the spectacle frame 1306. Both sets of images are overlaid using features or landmarks common to both images. The image processing apparatus can detect a difference between two images and extract a frame 1306 from the image. This technique is particularly useful when the eyeglasses (frame) 1306 has stylized features or a design that cannot make fiducial marks in the image.

  In addition to pupil positioning, the image processing device determines left and right frame boxes. The spectacle frame frame is used, for example, to determine the SEG height. In one embodiment, eyeglass frame determination may be performed automatically using filters and edge detection algorithms. Alternatively, the spectacle frame can be determined by dragging or drawing on the screen through the user interface so that the outer frame of the spectacle frame image is in contact with the ends of the four sides of the lens frame. For example, the system allows an operator to view an image of patient 1308 and draw an outer frame around each lens frame using a mouse or other input device.

  FIG. 13B is a functional block diagram of an alternative frame adjuster embodiment 1300 that uses a single camera 1310. This functional block diagram shows the positional relationship seen from above the patient or subject 1308 and the frame adjuster 1300 with one camera.

  The camera 1310 passes through a plurality of two-color beam splitters 1352 and 1354 and a wide wavelength beam splitter 1330 that are used to allow the patient 1308 to focus far away without putting the camera 1310 into view. 1308 is configured to shoot. The camera 1310 is arranged in accordance with a visual axis that is substantially parallel to the visual axis of the patient 1308. The camera 1310 can take a side image of the patient 1308 using a first two-color beam splitter 1352 placed in the field of view of the camera 1310. The first two-color beam splitter 1352 can be disposed at an angle of substantially 45 degrees with respect to the visual axis of the camera, for example. The first dichroic beam splitter 1352 can also be positioned approximately along an axis extending from the side of the patient's head substantially perpendicular to the patient's visual axis.

  The second two-color beam splitter 1354 is disposed at an angle of about 45 degrees with respect to the visual axis of the camera 1310 and is disposed behind the first two-color beam splitter 1352. The front image of the patient 1308 is reflected by a wide wavelength band beam splitter 1330 placed in front of the patient 1308. A front image from the wide wavelength band beam splitter 1330 is reflected by the second two-color beam splitter 1354, passes through the first two-color beam splitter 1352, and is captured by the camera 1310.

  Two light sources 1346 and 1348 are used to illuminate the patient 1308. In one embodiment, the first light source 1348 is colored light. Here, colored light means light in a wavelength band (spectrum) that is more limited than that of a white light source. The first light source 1348 can be, for example, a red light source that illuminates the patient 1308 with a light spectrum within a substantially red wavelength or a light source that emits substantially red light. The first two-color beam splitter 1352 filters and reflects the spectrum light corresponding to the spectrum in the light source 1348 and passes light having a wavelength longer or shorter than a predetermined wavelength. Therefore, for example, the first two-color beam splitter 1352 is configured by a red beam splitter that reflects red light and passes green light. Thus, the camera 1310 captures only an image corresponding to the wavelength of the light source in cooperation with the two-color beam splitters 1352 and 1354.

  Similarly, the second light source 1346 may be a colored light source such as a green light source or a light source that emits substantially green light. Second dichroic beam splitter 1354 may be a green beam splitter configured to reflect only green light corresponding to the spectrum in light source 1346. Second dichroic beam splitter 1354 is configured to pass light of all other wavelengths.

The light sources 1346, 1348 need not be green and red light sources, but may be any type of colored light source or a narrow wavelength band light source that emits light in the visible spectrum, invisible spectrum, or a combination thereof.

  In this way, the camera 1310 captures an image that is a composite of the side image reflected by the red light splitter 1352 and the front image reflected by the green light splitter 1354. An image processing device (not shown) can be configured to perform image processing based in part on the spectrum of the captured image. Therefore, by analyzing the red portion of the image, the image processing apparatus can separate the side images. Similarly, by analyzing the green image, an image processing device (not shown) can analyze the front image. Alternatively, the front image and the side image can be taken sequentially and analyzed as separate images.

  Furthermore, the camera 1310 can continuously capture two images. Initially, the light is illuminated only by the red light source 1348 and reflected by the red light splitter 1352, and the camera 1310 captures a side image. For the second image, a front image reflected by the green beam splitter 1354 is captured by the camera 1310 using the green light source 1346. In this way, the continuous shooting method can be used not only for black and white cameras but also for color cameras.

  14 to 16 show a captured image and an image analysis process for obtaining desired information. Although the photographed image shown on the screen is shown in the figure, the image need not be displayed to the operator, and the system can perform image analysis without displaying the image.

  FIG. 14 shows a display screen of a side image 1402 and a front image 1404 of the subject imaged using the frame adjustment system shown in FIG. The screen includes a reference mark added when the image processing apparatus determines the position of the pupil. Further, the image includes a bright spot indicating the determined area as a pupil. The reference mark and the bright spot are added by the image processing apparatus and are not a part of the photographed image.

  A front image 1404 shows a reference mark added by the image processing apparatus and a range identified as a pupil. The image processing apparatus analyzes the reflection from the first light source in the image and determines the position of the first reference mark 1412 in the right eye of the subject. The image processing apparatus can detect, for example, a light intensity peak corresponding to the light source reflection of the subject's cornea. Similarly, the image processing apparatus can determine the position of the second reference mark 1414 corresponding to the reflection of the second light source on the subject's cornea. The image processing device can use the reference mark to determine the pupil 1420 for the right eye. For example, the image processing device can use the fiducial mark as an index to begin continuity or blob analysis to search the dark pupil 1420 range. The right pupil 1420 is shown as a highlighted area in the subject's right eye.

  Similarly, the image processing apparatus can search for the position of the reference mark in the left eye of the subject. The image processing apparatus determines a first reference mark 1432 corresponding to the reflection of the first light source on the left cornea. The image processing device also determines a second fiducial mark 1434 corresponding to the reflection of the second light source on the left cornea. The two reference marks 1432 and 1434 are used by the image processing apparatus to determine the left pupil 1440. The left pupil 1440 is shown as a high brightness range in the left eye of the subject.

  The image processing apparatus similarly analyzes the side image 1402. The image processing apparatus determines the positions of the reference marks 1452 and 1454 corresponding to the light source reflection on the cornea. The image processing device uses fiducial marks 1452 and 1454 to determine the edge of the pupil and cornea 1456.

FIG. 15 is a screen view of a front image including the outline of the frame determined by the frame placement device. The frame positioner can be, for example, a part of the image processing apparatus of FIG.

  Front image 1502 includes an image of a subject wearing desired frame 1510. The position of the frame is arranged as part of the positioning of the correction lens in the frame. In one embodiment, the image processing device determines the positions of the left and right lens frames. The image processing device can determine the position of the frame, for example with continuity or blob analysis, using an edge detection filter of the Sobel or Roberts type. The image processing device can determine a high level of contrast, for example in an image portion near the subject's nose column. The image processor can use edge detection filters and continuity or blob analysis to determine other parts of the frame. Once the image processing device has determined the outline of the frame, it is now possible to determine the position of the frame 1530 that outlines each lens frame. The image processing apparatus determines a frame 1530 having sides 1532, 1534, 1536, and 1538 that are in contact with the side surfaces of the lens frame. The image processing device can use edge detection based in part on blob analysis of the frame, for example.

  For example, the image processing apparatus can determine the position of the lens frame of the correction lens for the left eye. The image processing apparatus determines the left end 1536 of the frame 1530 by determining the inner end of the center portion of the lens frame. Similarly, the image processing apparatus can determine the upper end 1532, the lower end 1534, and the right end 1538 of the frame 1530. The image processing device then repeats the same process for the right eye correction lens frame.

  In an alternative embodiment, two front images of the subject are taken. First, a subject who does not wear a spectacle frame is photographed. The second photograph is taken of a subject wearing a desired spectacle frame. The image processing apparatus aligns the two photographed images using, for example, correlation analysis. Next, the image processing apparatus extracts a difference between the two images and extracts a spectacle frame image. Thus, the image processing apparatus can determine the position of the lens frame through the above process.

  In yet another embodiment, the captured front image 1502 is displayed to the operator. The position of the lens frame is identified by input from the operator. The frame adjustment (adaptation) system will receive input from the operator identifying the position of the lens frame. In one embodiment, the operator uses a mouse to drag a frame 1530 having sides that touch the lens frame. The operator repeats input of the left and right lens frames.

  FIG. 16 is a screen displaying a side image 1602 of a subject wearing a desired spectacle frame. In one embodiment, the image processing device automatically determines the pantoscopic tilt of the frame. As before, the image processing apparatus can automatically determine the pantoscopic tilt by analyzing one or more captured images.

  In one embodiment, the image processing device uses edge detection filters and continuity or blob analysis to identify eyeglass frames in the image. Then, the image processing apparatus measures the angle from the tangent to the front surface of the frame and perpendicularly to determine the pantoscopic inclination of the frame.

  In the second embodiment, two side images of the subject are photographed: an image with a spectacle frame worn and an image with no eyeglass frame. The two images are adjusted and the difference between the images is determined to identify the spectacle frame. The image processor uses edge detection and blob analysis to identify the outline of the frame and determine the tangent that defines the pantoscopic slope.

  In yet another embodiment, the frame adjustment system displays a side image 1602 to the operator. The operator draws or adjusts the tangent of the frame using an input device such as a computer mouse. The tangent defines the pantoscopic slope. The frame adjustment system receives data corresponding to the line for determining the pantoscopic tilt.

  FIG. 17 is a flowchart of a frame adjustment process 1700 performed by the frame adjustment system of FIG. Process 1700 begins with taking front and side images of a subject wearing the desired eyeglass frame. In the system shown in FIGS. 12 and 13, one or more cameras can be controlled by a processing device or control device to capture front and side images of the subject. The processing device can also control one or more light sources of the illuminator during imaging.

  Once the front and side images are taken, process 1700 proceeds to block 1710 where the position of the frame, particularly the left and right lens frames, is determined. In the system of FIG. 12, the frame positioner is integrated in the image processing apparatus. The frame positioner determines the left and right lens frames and also determines the pantoscopic tilt of the frame.

  Once the frame is positioned, the image processing apparatus proceeds to block 1720 and determines the position of the pupil in the image. The image processing apparatus then proceeds to block 1730 where frame adjustment information such as inter-pupil distance and SEG height is determined. Information can be reported or displayed to the operator.

  In one embodiment, image capture, image processing and parameter determination are performed at the same location as the subject, for example in a separate unit. In other embodiments, image capture is performed at the same location as the subject, and image processing, parameter determination, and reporting are performed at a location remote from the subject. In this remote embodiment, imaging can be done at the optometrist's office and image processing can be performed at a remote location where the lens is manufactured and assembled into eyeglasses.

  FIG. 18 is a detailed flowchart of a pupil positioning process 1720 performed by the image processing apparatus. Process 1720 begins at block 1802 where the image processing device compares the captured image against one or more predetermined thresholds. In a color image system, the image processing device compares red, green, and blue pixels with one or more predetermined thresholds to determine the presence of a bright pixel. Pixels that exceed a predetermined threshold are determined to be bright pixels.

  The image processor then proceeds to block 1810 where continuity or blob analysis is performed to determine the bright spot in the image. The image processing apparatus can perform continuity analysis for each pixel that exceeds a predetermined threshold. The image processing device generates one or more blobs based on the continuity analysis.

  The image processor then proceeds to block 1820 where the identified blobs are sorted based on size and shape characteristics. Since the position of one or more light sources is known, the approximate shape and position of the reflection on the cornea is known. Blobs having shapes and positions that do not meet the classification criteria are removed as not corresponding to the reflected light from the subject's cornea.

  The image processing apparatus then proceeds to block 1830 and performs dark pixel threshold discrimination. As before, for a color image, the red, green and blue pixels are compared to one or more predetermined darkness thresholds.

  The image processor then proceeds to block 1840 where continuity or blob analysis is performed on the identified dark pixels. Each dark pixel defines a dark blob. One or more dark pixels can belong to the same dark blob.

  After the dark blobs are defined, the image processing apparatus proceeds to block 1850 and sorts the dark blobs according to, for example, size and shape characteristics. The image processing apparatus identifies the pupil as a roughly dark circle that can be seen in a predetermined region in the image. Dark blobs that do not meet such criteria are excluded.

  Proceeding to block 1860, the image processing device determines the position of the pupil based on the bright blob analysis and the dark blob analysis. The bright spot corresponds to the reflection of the light source. Similarly, the dark spot corresponds to the pupil. Due to the spherical shape of the cornea and the arrangement of the light source with respect to the subject, the bright spot reflection comes close to the pupil region. The image processing apparatus can use bright light reflection as a reference mark to identify the pupil. Thus, the image processing apparatus can use two-dimensional shape analysis in addition to the reference mark to determine the pupil position. Once the pupil is identified, process 1720 ends at 1890.

  The flowcharts of FIGS. 17 and 18 show the operation steps in a specific order. However, it is understood that the order of such steps is not necessarily limited to the order shown in the flowchart. For example, the frame positioning step 1710 and the pupil positioning step 1720 need not be performed in this order, and may be performed in the reverse order. Furthermore, the light / dark blob analysis is possible even if it is not in the order shown in FIG. The flowcharts shown in FIGS. 17 and 18 can be modified including order change, addition, and deletion.

  Thus, a frame adjustment system and method for eyeglass frame adjustment is disclosed. The system takes one or more front and side images of a subject wearing a desired spectacle frame. This system uses an image processing apparatus that uses a two-dimensional image processing algorithm to identify the pupil position of the subject. Furthermore, the image processing apparatus uses a two-dimensional image processing technique for identifying the lens frame and the pantoscopic tilt of the frame. This system can determine the SEG height and interpupillary distance of the lenses within a particular spectacle frame in order to properly adjust the lenses to the frame.

  As described above, the frame adjustment system and method are disclosed in detail and can function satisfactorily, but the description is merely an example of an embodiment of the present invention and is described in the appended claims. It is understood that the invention is not intended to be limited to the specific examples of construction and design shown herein.

1 is a bird's eye view of a preferred embodiment of a wavefront measuring system. It is a side view of a wavefront measuring system. It is a side view of a patient wearing a test frame and a molding. It is a right view of a patient wearing a test frame and a molding. It is a right front view of a patient wearing a test frame and a molding. It is a left front view of a patient wearing a test frame and a molding. It is a left view of a patient wearing a test frame and a molding. It is a front view of a patient wearing a test frame and a molding. It is a flowchart which shows the procedure of the manufacturing step of custom spectacles. It is a flowchart which shows the alternative procedure of the manufacturing step of custom spectacles. It is a side view of the wavefront measuring system which showed the measuring device inside a system. It is a functional block diagram of a frame adjustment system. 2 is a functional block diagram of an embodiment of a frame adjustment system. 2 is a functional block diagram of an embodiment of a frame adjustment system. It is the display screen of the imaged side and front image. It is the screen which displayed the frame placement device on the photoed front image. It is the screen which displayed the frame placement device on the taken side image. It is a flowchart of a frame adjustment method. It is a flowchart of a pupil positioning image processing method.

Claims (14)

An eyeglass frame adjustment system;
An imaging device configured to capture front and side images of the target field;
An image processing device configured to receive and analyze the front and side images to determine the position of the pupil associated with the spectacle frame taken in the front and side images;
An illuminator configured to illuminate the object when the imaging device captures the front image and the side image;
The illuminator includes a plurality of light sources configured to form a predetermined pattern on a target cornea located within the target field .   The system according to claim 1, wherein the image processing apparatus determines the position of the pupil based in part on the predetermined pattern. An eyeglass frame adjustment system;
  An imaging device configured to capture front and side images of the target field;
  Configured to capture a feature based in part on the detected color and to receive and analyze the front and side images to determine the position of the pupil associated with the spectacle frame taken in the front and side images An image processing device;
  An illuminator configured to illuminate the object when the imaging device captures the front image and the side image;
  The illuminator includes one or more colored light sources. An eyeglass frame adjustment system;
An imaging device configured to capture front and side images of the target field;
A plurality of light sources configured to form a predetermined pattern on the cornea within the target field;
An image processing device configured to analyze the front and side images to determine, based in part on the predetermined pattern, the position of a pupil associated with the spectacle frames taken in the front and side images; ;
Including system. The system of claim 4 , wherein the imaging device is configured to capture additional front images while one or more of the plurality of light sources are turned off. Adjusting the correction lens to the spectacle frame;
  Taking a front image of the subject wearing a spectacle frame;
  Taking a side image of the subject wearing the spectacle frame;
  Determining the position of the lens frame from the captured image;
  Determining the position of at least one pupil of the object from the captured image;
  Determining the pupil center of the correction lens based in part on the position of the lens frame and the position of the pupil;
  For taking the front image of the object;
  Illuminating the object with a plurality of light sources forming a pattern on at least one cornea of the object;
  Taking the front image while the plurality of light sources are illuminated;
Including methods. Adjusting the correction lens to the spectacle frame;
  Taking a front image of the subject wearing a spectacle frame;
  Taking a side image of the subject wearing the spectacle frame;
  Determining the position of the lens frame from the captured image;
  Determining the position of at least one pupil of the object from the captured image;
  Determining the pupil center of the correction lens based in part on the position of the lens frame and the position of the pupil;
  For taking the front image of the object;
  Illuminating the object with a plurality of light sources forming a pattern on at least one cornea of the object;
  Taking the front image while the plurality of light sources are illuminated; and
  For determining the position of the at least one pupil;
  Identifying one or more bright pixels of the subject's cornea image;
  Identifying one or more dark pixels of the cornea image;
  Identifying the pupil based in part on a relative relationship between the one or more bright pixels and the one or more dark pixels;
Including methods. Adjusting the correction lens to the spectacle frame;
  Taking a front image of the subject wearing a spectacle frame;
  Taking a side image of the subject wearing the spectacle frame;
  Determining the position of the lens frame from the captured image;
  Determining the position of at least one pupil of the object from the captured image;
  Determining the pupil center of the correction lens based in part on the position of the lens frame and the position of the pupil;
  For taking the front image of the object;
  Illuminating the object with a plurality of light sources forming a pattern on at least one cornea of the object;
  Taking the front image while the plurality of light sources are illuminated; and
  For determining the position of the at least one pupil;
  Comparing the captured front image with a predetermined light threshold to identify light pixels;
  Performing a continuity analysis of the bright pixels to form a bright blob;
  Fractionating the bright blobs based in part on the dimensions of the bright blobs;
  Comparing the taken front image with a predetermined dark threshold;
  Performing a continuity analysis of the dark pixels to form one or more dark blobs;
  Fractionating the one or more dark blobs based on the size of the blob;
  Determining the position of the pupil based in part on the position of the dark blob and the position of the bright blob that have been sorted;
Including methods. An eyeglass frame adjustment system;
An imaging device configured to capture front and side images of the target field;
A plurality of colored light sources configured to illuminate at least a portion of the target field;
An image processing device configured to analyze the front and side images to determine, based in part on a predetermined pattern, a position of a pupil associated with the spectacle frame taken in the front and side images;
Including system. The system of claim 9 , wherein one or more of the colored light sources are configured to form a fiducial mark in the target field, and the image processing apparatus analyzes the front image based in part on the fiducial mark. A first two-color beam splitter configured to reflect the side image of the target field to the imaging device;
A second two-color beam splitter configured to reflect the front image of the target field to the imaging device;
The system according to claim 9 or 10 , further comprising: The system of claim 11 , wherein the first two-color beam splitter passes light of a wavelength different from the wavelength of light that the second two-color beam splitter passes. The plurality of colored light sources include a first colored light source and a second colored light source, the first two-color light beam splitter reflects a wavelength corresponding to the first colored light source, and the second two colors 13. A system according to claim 11 or 12 , wherein the beam splitter reflects a wavelength corresponding to the second colored light source. The system according to claim 13 , wherein the imaging device captures continuous images, and illumination of each image corresponds to one of the plurality of colored light sources.

Images