JP6984071B6 - Lens meter system without equipment - Google Patents

Abstract

The lens meter system may include a mobile device with a camera. The camera may capture a first image of the pattern through the lens away from the camera while the lens is in contact with the pattern. The mobile device may try to determine the size of the lens based on the known characteristics of the first image and pattern. The camera may capture a second image of the pattern while the lens is in the middle position between the camera and the pattern. By converting the second image into an ideal coordinate system and processing it, the distortion of the pattern that may be caused by the lens may be determined. The mobile device may measure the characteristics of the lens based on the distortion. Lens characteristics include spherical power, cylindrical power, and / or astigmatism angle.

Description

The technical field generally relates to determining the formulation of corrective lenses, and more particularly to mobile device lens meters and methods of operation thereof, in one embodiment.

Ophthalmologists, spectacle lens makers, and other lenses professionals often use conventional lens meters to determine the formulation of unknown orthodontic lenses (spherical power, cylindrical power, and axis, etc.). .. In such a lens meter, the light of a light source is usually passed through a pattern and a correction lens mounted on the instrument of the lens meter, and the light is seen by an eyepiece opposite to the light source. By observing the distorted appearance of the pattern through the eyepieces, it is possible to correlate the distortion to the known formulation with respect to the generation of such distortion.

The instrument holds the pattern, corrective lens, and eyepiece at appropriate intervals and configurations from each other. However, the equipment is usually large and heavy, which makes such a configuration awkward and undesired for home or field use. Also, conventional methods of determining the prescription of such corrective lenses do not provide a convenient way of communicating prescription information to others such as ophthalmologists or lens makers. For example, although information can be transmitted by telephone, problems such as the risk of transcription errors arise, which makes it less attractive for individuals to decide on a corrective lens prescription in a convenient environment such as at home or at work. Therefore, a person who decides to prescribe an unknown corrective lens needs to visit a specialist such as an ophthalmologist, which increases the delay and cost of the process.

According to one aspect, the process of determining the characteristics of the lens is to obtain a captured image of the pattern passing through the corrective lens, convert the captured image to an ideal coordinate system, and process the captured image to obtain a reference pattern. It involves determining the overall distortion of the captured image from the to the pattern, determining the distortion of the captured pattern that may result from the corrective lens, and measuring at least one characteristic of the corrective lens. According to one embodiment, the captured image contains a pattern and includes a first region generated by light passing through the orthodontic lens and a second region generated by light not passing through the orthodontic lens. Determining the distortion of the uptake pattern that may result from the corrective lens is performed at least partially with reference to a second region. According to another embodiment, the pattern is a checkered pattern and the second region comprises a boundary. According to another embodiment, transforming the captured image into an ideal coordinate system detects multiple capture reference landmarks in a second region of the captured image and multiple captures from multiple ideal reference landmarks. It involves determining the conversion to a reference landmark and applying this conversion to the capture image.

According to another embodiment, the pattern is the first pattern, the orthodontic lens is the first orthodontic lens, and acquiring a captured image of the pattern passing through the orthodontic lens is the first orthodontic lens. It involves acquiring captured images of a first pattern passing through and a second pattern passing through a second lens.

According to yet another embodiment, processing the captured image to determine the overall distortion from the reference pattern to the pattern of the captured image is to detect multiple capture pattern landmarks in the captured image and to multiple capture pattern landmarks. To determine the conversion from the ideal pattern landmark to multiple capture pattern landmarks, and for the corrective lens, to determine the spherical power measurement result, the cylindrical power measurement result, and the astigmatism angle measurement result from the conversion. including. According to another embodiment, the transformation is a diopter matrix.

According to yet another embodiment, the acquisition of a captured image of at least one pattern through the corrective lens is performed at the first location of the camera lens for at least one pattern and for the camera lens for at least one pattern. Acquiring a second capture image of at least one pattern through the correction lens at the second location, detecting multiple capture pattern landmarks in the second capture image, and multiple ideal pattern lands. Determine the second conversion from the mark to multiple capture pattern landmarks, and for the corrective lens, determine the spherical power measurement result, the cylindrical power measurement result, and the astigmatism angle measurement result from the second conversion. It further includes selecting from the first conversion and the second conversion a suitable conversion in which the spherical power measurement result and the cylindrical power measurement result have extreme values.

According to yet another embodiment, the captured image is captured by a camera with a camera lens and the corrective lens is positioned in a known location with respect to the camera lens and pattern. According to another embodiment, determining the distortion of the captured image that may be caused by the corrective lens is to determine the distance between the camera lens and the pattern, the distance, the spherical power measurement result, and the cylindrical power. It involves determining at least one focal length of the corrective lens with reference to the measurement results.

According to one embodiment, measuring at least one characteristic of a corrective lens comprises determining the formulation of a corrective lens that includes at least spherical power, cylindrical power, and axial power. According to another embodiment, acquiring a captured image of a pattern passing through a correction lens is performed by passing through a camera lens, a first pattern passing through a first correction lens, and a second pattern passing through a second correction lens. These two patterns, including the acquisition of captured images, are such that when the first orthodontic lens and the second orthodontic lens are positioned in known locations with respect to the camera lens and the first and second patterns. They are separated from each other so that acquisition of captured images of the first pattern through the first corrective lens and the second pattern through the second corrective lens can be performed.

According to another embodiment, the process determines from the captured image the first location of the camera lens of the lens meter from which the captured image was captured and to a second location relative to the first location. It further includes identifying the orientation, guiding the user of the lens meter to a second location, and capturing a second captured image of the pattern passing through the corrective lens.

According to another aspect, the lens meter is coupled to the camera, the visual display, and the camera to acquire a captured image of the pattern passing through the corrective lens, and to convert the captured image into an ideal coordinate system. The captured image is processed to determine the overall distortion from the reference pattern to the captured image pattern, to determine the distortion of the captured image that may be due to the corrective lens, and to measure at least one characteristic of the corrective lens. It comprises a processor configured to do so.

According to one embodiment, the captured image contains a pattern and includes a first region generated by light passing through the orthodontic lens and a second region generated by light not passing through the orthodontic lens. .. According to another embodiment, the processor transforms the captured image into an ideal coordinate system by being configured to detect multiple capture reference landmarks in a second region of the captured image. It is further configured to determine the conversion from the ideal reference landmark to multiple capture reference landmarks and to apply this conversion to the capture image.

According to another embodiment, the processor is configured to detect multiple capture pattern landmarks in the capture image by processing the capture image, thereby making the whole from the reference pattern to the pattern of the capture image. Determining the distortion, determining the conversion from multiple ideal pattern landmarks to multiple capture pattern landmarks, and for the corrective lens, from the conversion, to the spherical power measurement results, the cylindrical power measurement results, and astigmatism. It is further configured to do and to determine the angle measurement results. According to another embodiment, the processor acquires a captured image of at least one pattern passing through the corrective lens at the first location and a second of the at least one pattern passing through the corrective lens at the second location. Capturing the captured image, detecting multiple capture pattern landmarks in the second captured image, and determining the second conversion from multiple ideal pattern landmarks to multiple captured pattern landmarks. For the corrective lens, determine the spherical power measurement result, the cylindrical power measurement result, and the astigmatism angle measurement result from the second conversion, and from the first conversion and the second conversion, the spherical power measurement result and It is further configured to select a suitable transformation in which the result of the cylindrical power measurement has an extreme value. According to yet another embodiment, the captured image is captured through the camera lens of the camera and the processor may be attributed to the corrective lens by being configured to determine the distance between the camera lens and the pattern. It is further configured to determine the distortion of the captured image and to determine at least one focal length of the corrective lens with reference to the distance, the spherical power measurement result, and the cylindrical power measurement result. ..

According to one embodiment, the processor is further configured to measure at least one characteristic of the corrective lens by being configured to determine the formulation of the corrective lens, including at least spherical power, cylindrical power, and axial power. It is configured. According to another embodiment, the pattern is printed on a physical medium. According to yet another embodiment, the pattern is displayed on an electronic display device.

According to some embodiments, there is a method of operating a lens meter system, comprising capturing a first image of the pattern through a corrective lens in contact with the pattern by a camera of the lens meter system. Will be done. The method also includes determining the size of the corrective lens based on the first image and pattern by the computer equipment of the lens meter system. The method also comprises capturing a second image of the pattern through the corrective lens by the camera while the corrective lens is in an intermediate position between the camera and the pattern. The method also comprises using a computer device to determine the distortion that may be caused by the corrective lens of the pattern in the second image using the determined size of the corrective lens. The method also comprises measuring at least one characteristic of the corrective lens by a computer device based on the determined strain.

According to another aspect, a mobile device comprising a camera and a processor configured to obtain a first image of the pattern through the corrective lens in contact with the pattern from the camera is provided. The processor is further configured to determine the size of the corrective lens based on the first image and pattern. The processor is further configured to obtain a second image of the pattern passing through the corrective lens from the camera, with the corrective lens in the middle position between the camera and the pattern. The processor is further configured to use the determined size of the corrective lens to determine the distortion that may be caused by the corrective lens of the pattern in the second image. The processor is further configured to measure at least one characteristic of the corrective lens based on the determined strain.

According to another aspect, a lens meter system comprising a pattern having a characteristic of a certain size and a mobile device is provided. The mobile device was configured to use a camera, a memory containing information associated with the size of the pattern and features, and the camera to capture a first image of the pattern through a corrective lens in contact with the pattern. It is equipped with a processor. The processor is further configured to determine the size of the corrective lens based on the first image and pattern by using the information associated with the size of the pattern and features. The processor is further configured to use the camera to capture a second image of the pattern passing through the corrective lens while the corrective lens is in an intermediate position between the camera and the pattern. The processor is further configured to use the determined size of the corrective lens to determine the distortion that may be caused by the corrective lens of the pattern in the second image. The processor is further configured to measure at least one characteristic of the corrective lens based on the determined strain.

Other embodiments, embodiments, and advantages of these exemplary embodiments and embodiments are discussed in detail below. Further, both the above information and the following detailed description are merely explanatory examples of various aspects and embodiments, and are intended to provide a gist or framework for understanding the nature and characteristics of the subject matter of the claims. It shall be understood that there is. "An embodied", "an example", "one example", "another embodied", "another example", "some" "Some embodied cognition", "Some examples", "Other embodied cognition", "an alternate embodied cognition", "Various embodied cognition" , "One embodied", "at least one embodied", "this and other embodied", etc., specific examples and embodiments. References are not necessarily mutually exclusive and are intended to exhibit the particular features, structures, or properties described with respect to the embodiment or example and are included in the embodiment or example as well as other embodiments or examples. May be. As used herein, the appearance of such terms does not necessarily refer to all the same embodiments or examples.

In addition, in the event of inconsistency in the use of terms between the present specification and the literature incorporated herein, the use of the terms in the incorporated literature is a supplement to the specification. In the case of unresolvable inconsistencies, the use of terms herein supersedes. In addition, the accompanying drawings provide explanations and a deep understanding of various aspects and embodiments, which are incorporated herein to constitute a portion thereof. The drawings, in conjunction with other parts of the specification, serve to illustrate the aspects and embodiments described herein as well as the principles and operations of the embodiments and embodiments relating to the claims.

The embodiments of the present invention are not limited to the details of the configurations and the arrangement of the components described in the following description or drawings. The embodiments of the present invention can be realized or implemented in various ways. In addition, the expressions and terminology used herein are for illustration purposes only and are not considered to be limiting. As used herein, the use of "inclusion," "comprising," or "having," "contining," "involving," and variations thereof. It covers the items described below and their equivalents, as well as additional items.

Hereinafter, various aspects of at least one embodiment will be discussed with reference to the accompanying drawings which are not intended to be depicted in proportion to the actual size. The drawings provide explanations and a deeper understanding of various aspects and embodiments, which are incorporated herein to constitute a portion thereof, but are not intended as a limitation of any particular embodiment. .. The drawings, in conjunction with other parts of the specification, serve to illustrate the aspects and embodiments described herein as well as the principles and operations of the embodiments and embodiments relating to the claims. In the figure, the same or substantially the same components shown in various drawings are represented by the same number. For clarity, not all components are coded in all drawings.

It is a figure which showed the lens meter of the prior art. It is a block diagram of the lens meter system which concerns on one or more embodiments. It is a block diagram of the mobile device lens meter which concerns on one or more embodiments. It is a flowchart of the method of operating the mobile device lens meter which concerns on one or more embodiments. It is a figure which showed the reference pattern group which concerns on one or more embodiments. It is a figure which showed the capture image of the reference pattern group of FIG. 5A which concerns on one or more embodiments. It is a figure which showed the capture image of FIG. 5B after conversion to an ideal coordinate system. It is a figure which showed the pattern of the many pattern landmarks and the capture image of a reference pattern group which concerns on one or more embodiments. It is a perspective view of the lens meter system without an instrument of 1st composition which concerns on various aspects of this disclosure. FIG. 3 is a top perspective view of an instrumentless lens meter system having a second configuration according to various aspects of the present disclosure. It is a user interface diagram of the mobile device in operation of the lens meter without an instrument which concerns on various aspects of this disclosure. It is a flowchart of the exemplary operation which can be performed with respect to the operation of the lens meter without an instrument which concerns on various aspects of this disclosure. It is a flowchart of the exemplary operation which can be performed with respect to the operation of the lens meter without an instrument which concerns on various aspects of this disclosure. It is a figure which showed the exemplary architecture of the instrumentless lens meter system suitable for the realization of some embodiments of the present disclosure.

According to one or more embodiments, the disclosed processes and systems allow lens meter devices such as mobile phones to determine properties such as prescriptions for one or more corrective lenses. In some embodiments, the camera captures an image of one or more patterns through the orthodontic lens, and the measurement of distortion of this pattern determines the characteristics of the orthodontic lens by a connected computer device with dedicated software. Will be done. The embodiments discussed herein are configured to measure the properties of one or more corrective lenses as required by known lens meters and without the need for specific spacing and placement enforced by the built-in instrument. A lens meter is described as a device. The lens meter may be a smartphone or tablet device on which dedicated software (eg, an application) is installed to execute the method according to the claims. In some operational scenarios, all of the processes that characterize the corrective lens are performed on the smartphone or tablet (eg, by the processor of the smartphone or tablet). In other operational scenarios, camera images between a smartphone or tablet and one or more remote processors, such as one or more cloud servers, that perform some or all of the processing that determines the characteristics of the orthodontic lens. Alternatively, data such as image metadata may be exchanged. In these other operational scenarios, information indicating the determined characteristics can be transmitted from the remote processor to the smartphone, tablet, and / or other device or system. In some embodiments, the lens meter is a fixed location and one or more components (eg,) capable of measuring the characteristics of the corrective lens without the need for precise separation and placement of the corrective lens and pattern with respect to the lens meter. , A camera embedded in a wall or fixture and communicably coupled to one or more local and / or remote processors). Such a configuration is considered suitable in a retail environment such as an optician or an optician.

The pattern may be displayed on paper or may be displayed on the display of another device such as a laptop computer. In some embodiments, a mobile device (ie, a mobile lens meter) and another device (eg, another device displaying a pattern) can be paired to allow communication and interaction during the measurement process. It may be. In the present specification, the example showing the mobile lens meter as the mobile device itself is for the purpose of explanation only, and it goes without saying that the function discussed in the present specification regarding the "mobile lens meter" is that of the mobile lens meter system. As part of it, it may be run on or with such other devices.

In some embodiments, the two patterns are separated, each through one of a pair of corrective lenses in the spectacle frame when positioned approximately halfway between the pattern and the lens meter and oriented appropriately. It is configured to look like a mobile lens meter. Such a configuration allows for easy and intuitive positioning of mobile lens meters, patterns, and corrective lenses. In addition, the mobile lens meter is configured to determine the distance to the pattern and to take that distance into account when determining the formulation. This design facilitates manual positioning of the element and eliminates the need for equipment. In one embodiment, the pattern is a rectangle displayed on a physical medium or computer display. In some embodiments, the pattern is surrounded by boundaries with features such as reference landmarks used to orient the captured image.

According to one or more embodiments, the disclosed process and system transforms the captured image into an ideal coordinate system to compensate for the orientation of the lens meter with respect to the pattern during the image capture process. In some embodiments, this transformation is performed with reference to the location of the reference landmark in the captured image relative to the location of the reference landmark in the reference pattern group.

According to one or more embodiments, the disclosed process and system determines the overall distortion by processing the capture image to detect and determine the location of many capture pattern landmarks in the capture image. The system determines the transformations that describe the distortion for the corresponding capture pattern landmarks in the capture image from the location of many reference pattern landmarks (in the ideal coordinate system). Conversion representations such as spherical power, cylindrical power, and astigmatism angle (eg, diopter matrix) can be used to determine the measurement result of the corrective lens. The portion of the total distortion caused by the corrective lens (as opposed to the lens of the lens meter) may be partially determined by determining at least one focal length of the corrective lens. In addition, other characteristics of the corrective lens may be measured. The present embodiment is not limited to a spherical cylindrical lens, and has other characteristics such as a single focus lens, a bifocal lens, a trifocal lens, a progressive multifocal lens, a focus adjustable lens, or a lens that corrects high-order aberrations. It is considered suitable for lenses.

According to one or more embodiments, the capture and analysis of multiple images captures, for example, an image captured in the middle between the lens meter and the pattern at the preferred position and / or orientation in which the corrective lens is closest. It may be identified.

According to one or more embodiments, a lens meter comprising a camera, a visual display, and a processor configured to perform the processes described herein is provided. The lens meter may be a dedicated lens meter or a mobile device (eg, a smartphone or tablet device) that runs lens meter software such as a downloadable application.

FIG. 1 shows a conventional optical lens meter system 100 that determines the formulation and / or other unknown properties of the corrective lens 130. The light source 110 passes through the pattern 120 (eg, a transparent target with a printed pattern of known dimensions and arrangement) and the corrective lens 130 (and many standard and objective lenses (not shown)) towards the eyepiece 140. It is suitable. An observer who has his eyes in contact with the eyepiece lens 140 can observe how the light passing through the pattern 120 is distorted by the correction lens 130. By measuring the distortion effect of the straightening lens 130, the user can determine specific characteristics of the straightening lens 130, such as the spherical power, the cylindrical power, and the measurement result of the axis of the straightening lens 130. The lens meter system 100 requires an instrument 150, such as a lens holder 152, to maintain the pattern 120, the corrective lens 130, and the eyepiece 140 in a precisely spaced and oriented arrangement. The optical principle underlying the operation of the lens meter system 100 requires the maintenance of specific spacing and orientation by the instrument 150.

Similarly, the use of digital lens meters allows the imaging of patterns through a single corrective lens, which use distortion in the image to determine the prescription and / or other unknown properties of the corrective lens. do. Like conventional optical lens meters, currently available digital lens meters require corrective lenses, lens meter lenses, and instruments that hold the pattern in precisely spaced and oriented arrangements.

FIG. 2 is a block diagram of the lens meter system 200 according to one or more embodiments. In the embodiment shown in FIG. 2, the system 200 includes a lens meter 210, a correction lens 220, and a pattern 230. During operation, the lens meter 210 captures an image of the pattern 230 passing through the corrective lens 220. The corrective lens 220 distorts the light entering the lens meter 210 by emission or reflection by the pattern 230. The measurement of the strain effect may determine one or more unknown properties of the orthodontic lens 220, such as spherical, cylindrical, and axial measurements.

The captured image of the pattern 230 is normalized by conversion to an ideal coordinate system using a reference landmark in the vicinity of the pattern 230. This normalization compensates for differences in rotation, tilt, and distance in spacing and orientation between the lens meter 210, the corrective lens 220, and the pattern 230. Therefore, the lens meter system 200 does not require any instrument. After that, also in the ideal coordinate system, the normalized pattern 230 can be compared with the reference pattern, and the distortion effect of the correction lens can be separated from the distortion effect of the lens of the lens meter 210 itself.

In some embodiments, the pattern 230 is displayed on an electronic display (not shown) such as a computer monitor, tablet, or other mobile device, or projected onto a surface by a projector. For example, the pattern 230 may be provided on a website accessible by the lens meter system 200, may be provided by a mobile app running on a mobile device, or may be provided through a mobile app. In another embodiment, the pattern 230 is printed on a physical medium such as paper or plastic.

In some embodiments, the use of two or more patterns may allow the characteristics of two or more corrective lenses to be determined simultaneously. In one preferred embodiment, two spaced patterns are used, where each pattern 230 is a black and white alternating square rotating mutant checkerboard, the number of rows of checkerboards differs by one from the number of columns. Due to this rotational variation property, the lens meter 210 can determine whether the pattern 230 is observed in the correct upright position or is rotated laterally. In one embodiment, pattern 230 is a black and white checkered design with 8 rows and 7 columns. In another embodiment, the pattern 230 has 16 rows and 15 columns. Also, other configurations or color combinations are possible.

FIG. 3 is a block diagram of the lens meter 210 according to some embodiments. In some embodiments, the lens meter 210 is a consumer mobile device (eg, a smartphone or tablet device) or a computer (eg, a laptop computer) that runs dedicated software to perform the actions described herein. Is. In another embodiment, the lens meter 210 is a dedicated lens meter device. The lens meter 210 includes a camera 310 with a lens 312, as well as a processor 320, a user interface 330, a network interface 340, a memory 350, and lens meter software 360. In some embodiments, the camera 310 is an integral component of the lens meter 210. In other embodiments, the camera 310 may be an additional component or accessory. The processor 320 is coupled to the camera 310 and executes software 360 of the image capture function executed by the lens meter 210. In some embodiments, the function of the lens meter 210 may be performed in conjunction with other equipment as part of a higher-level lens meter system. For example, in one embodiment in which the function of the lens meter 210 is performed by a user's smartphone, the smartphone may be paired with the user's laptop computer to control the display of patterns. In this example, the lens meter 210 is considered to include both the user's smartphone and laptop computer.

The user interface 330 receives an input from the user of the lens meter 210 and gives an output. In some embodiments, the user interface 330 allows the user to adjust the position or orientation of the lens meter 210 by displaying to the user the image currently seen through the lens 312 of the camera 310. In some embodiments, the user interface 330 provides the user with physical or on-screen buttons for capturing images by interaction. In another embodiment, the pattern 230 is detected in the image and is automatically captured when certain alignment, size, light and dark, and resolution conditions are met.

The user interface 330 may also give the user instructions to move any of the lens meter 210, the corrective lens 220, and the pattern 230 to different absolute positions or orientations or to different positions or orientations from each other. For example, the user interface 330 may provide the corrective lens 220 until the user positions the lens meter 210 and through the corrective lens 220 at the lens meter 210 so that the corrective lens 220 is positioned at the optimum known position with respect to the lens meter 210 and the pattern 230. Instructions such as "forward movement", "backward movement", "lens meter forward tilt", and graphics until the lens meter 210, the corrective lens 220, and the pattern 230 are aligned so that the pattern 230 can be observed. And the instructions conveyed by the illustrations, or other such commands may be given. In some embodiments, the user interface 330 and / or other components of the lens meter 210 may be emitted at a frequency proportional (or inversely proportional) to the recorded voice instruction or distance from the correct position of the lens meter 210. The above-mentioned instructions may be given so as to be heard by listening sound or the like. In another embodiment, the user interface 330 directs the user once the user has correctly positioned the lens meter 210, the corrective lens 220, and the pattern 230, for example by displaying a "green light" or a thumbs-up gesture icon. May be given. The user interface 330 may also allow the user to interact with other systems or components, for example by instructing the user's physician to send corrective lens prescription information.

In some embodiments, the network interface 340 provides access to software 360 downloads and upgrades. In some embodiments, one or more steps of the process described below may be performed on a server (not shown) or another component different from the lens meter 210. Data may be passed between the lens meter 210 and the server via the network interface 340. In addition, the network interface 340 may be able to automatically upload lens characteristics or prescription information to another entity (eg, your optometrist or another corrective lens supplier).

Some or all of the processes described herein, as well as others, by the lens meter software 360 running on the lens meter 210 or by other systems in communication with the lens meter 210 (eg, via the network interface 340). Functions may be executed.

FIG. 4 is a flowchart of the process 400 for determining the characteristics of the corrective lens according to one or more embodiments. Such embodiments may be implemented using the systems as shown in FIGS. 2 and 3.

This process begins at step 410.

In step 420, the captured image of the pattern is acquired through the corrective lens. The image is captured by a camera (eg, camera 310). In some embodiments, the camera is part of a dedicated lens meter device or is attached to a dedicated lens meter device. In other embodiments, the camera is part of a mobile device (eg, a smartphone or tablet device). In some embodiments, the user is instructed to hold the mobile device with the camera oriented towards the pattern so that the pattern is visible through the orthodontic lens. Then, the image of the pattern is captured by the camera. This image may be captured in response to user instructions such as clicking on a physical button or an interface element on the screen of a mobile device. In other embodiments, the image is automatically captured when a relatively static and stable image is acquired and focused, and the lens meter, corrective lens, and pattern are properly aligned. It may be like this. For example, the accelerometer of a mobile device may be used to determine that the camera is relatively stationary. If an in-focus image is available, the system may attempt to identify the presence or absence of patterns in the image by using known image processing and detection techniques. In some embodiments, multiple images may be captured, and a plurality of images may be captured based on criteria such as the image in which the pattern is most focused and whether the elements are properly aligned. One of the images may be selected and further processed.

In some embodiments, the object may be an image displayed on a computer display. The object may be a pattern whose shape is known and feature points can be easily detected. According to some embodiments, a checkerboard pattern is used.

FIG. 5A shows a pattern group 500 in which patterns 510 and 520 are positioned so as to be used for simultaneous detection of characteristics of two corrective lenses such as two spectacle lenses in a spectacle frame. The patterns 510 and 520 are positioned within the boundary 530. Boundary 530 includes boundary reference landmarks 532, 533, 534, 535 at known locations relative to the boundary 530. Boundary 530 and / or boundary reference landmarks 532, 533, 534, 535 are used to correct the orientation of the captured image in subsequent steps. In one preferred embodiment, four boundary reference landmarks are used, but in some embodiments, only two boundary reference landmarks may be used. In one embodiment, boundary reference landmarks 532, 533, 534, and 535 are located at each of the four inner corners of the boundary 530. Boundary reference landmarks 532, 533, 534, 535 may be markers recognizable in captured images by computer image recognition techniques, use computer image recognition techniques and / or refer to known shapes of pattern group 500. It may be a unique landmark detected by. For example, if the boundary 530 is known to be a rectangle with four inner corners, these four inner corners are located and used as boundary reference landmarks 532, 533, 534, 535. It may be like this.

Further, the patterns 510 and 520 include a plurality of pattern reference landmarks 512. The locations of multiple pattern reference landmarks 512 in the captured image are used in subsequent steps to determine the nature of the distortion caused by the corrective lens. In some embodiments, the pattern reference landmark 512 is located in the adjacent corner of the square within the checkered pattern. The pattern reference landmark 512 may be a marker recognizable in the captured image by computer image recognition technology and / or a landmark detected by the use of computer image recognition technology and / or by reference to a known shape of pattern group 500. It may be.

The locations of the boundary reference landmarks 532, 533 and the pattern reference landmarks 512 are known in pattern group 500. According to these known locations, the pattern group 500 can be used as a reference pattern group in subsequent steps, whereas the locations of the same points in the captured image can be compared.

In some embodiments, the lens meter is configured to operate when the corrective lens of the spectacle frame is halfway between the lens meter and the patterns 510 and 520. Patterns 510 and 520 are such that when the corrective lens is halfway between the lens meter and the pattern 510 and 520, the patterns 510 and 520 are respectively aligned with both the lens meter and one corrective lens. It is composed and separated. Such a configuration can be realized, for example, when the distance between the centers of the patterns 510 and 520 is twice as large as the distance between the centers of the corrective lens. For example, if the distance between the centers of the corrective lenses of the spectacle frame is 77.5 mm, the patterns 510 and 520 may be spaced so that the distance between the centers is 77.5 × 2 = 155 mm. ..

The patterns 510, 520 and / or the boundary 530 are corrected so that when the lens meter captures the image of the pattern through the corrective lens, the aperture of the standard size spectacle frame surrounds the entire pattern in the captured image, that is, the pattern. The size is specified and configured so that the lenses overlap perfectly. Then, the entire opening of the spectacle frame is included in the boundary 530. The captured image is one or more first regions generated by light that has passed through the corrective lens (ie, light distorted by the corrective lens) and light that avoids the corrective lens (ie, light that is not distorted by the corrective lens). ) Is considered to have one or more second regions.

A captured image 550 showing such a configuration can be seen in FIG. 5B. The pattern 510 is entirely contained within the opening 542 of the spectacle frame 540, and the pattern 520 is entirely contained within the opening 544 of the spectacle frame 540. The patterns 510 and 520 in the captured image 550 are distorted by the corrective lens of the spectacle frame 540. Then, the entire spectacle frame 540 is included in the boundary 530. By adopting such a configuration, it is possible to measure the distortion of the patterns 510 and 520 in the captured image due to the corrective lens, while the boundary reference landmarks 532 and 533 are maintained without distortion.

As a matter of course, the pattern group 500 shown in FIGS. 5A and 5B is for illustration purposes, and different configurations, sizes, or types of patterns and / or boundaries are to be adopted within the scope of the present disclosure. It may be omitted as a whole. In some embodiments, two or more images may be captured that are trimmed or restricted so that each contains only one pattern. In another embodiment, one image consisting of both patterns is captured, divided into two images in a subsequent step, and each pattern is processed in parallel. In still other embodiments, video clips of the pattern may be captured, or a plurality of still images may be captured in quick succession.

Further, as a matter of course, lenses having different characteristics distort the pattern in the captured image in a different manner. For example, a lens with a positive power magnifies the pattern in the captured image, so that the pattern passing through the corrective lens looks large. In this situation, the pattern may be sized so that it does not fill the corrective lens because it is too large in the captured image. Similarly, a lens with a negative power reduces the pattern in the captured image, so that the pattern passing through the corrective lens looks small. In this situation, the pattern may be sized so that it is not too small to be identified and processed in a later step in the captured image. Therefore, in some embodiments, the pattern may be displayed on a display device capable of setting the pattern size according to the consideration items such as the characteristics of the lens. In some embodiments, the user may be provided with an interface (via a display device or lens meter 210) for displaying a pattern of a suitable size by resizing the pattern or selecting the characteristics of the lens. In other embodiments, the pattern may be automatically resized by the system to be the correct size in the captured image.

As can be seen in the captured image 550 of FIG. 5B, the boundary 530 is rotated counterclockwise from the horizontal rectangular configuration shown in FIG. 5A, and the patterns 510 and 520 and the boundary 530 of FIG. 5B correspond to each of FIG. 5A. Smaller than the part. Due to these changes, it becomes difficult to directly compare the pattern group 500 of the captured image 550 with respect to the reference pattern group 500.

Therefore, returning to FIG. 4, in step 430, the captured image is converted into an ideal coordinate system. In some embodiments, the captured image is transformed into an ideal coordinate system represented by the reference pattern group 500 of FIG. 5A. The transformation may involve rotating, resizing, cropping, and tilting the image to remove any distortion or inaccuracies caused by the image capture process. In some embodiments, the boundary reference landmarks 532', 533', 534', 535' in the captured image 550 are detected and the captured image 550 is converted using image manipulation techniques to obtain the boundary reference landmarks. The captured image is captured by allowing 532', 533', 534', and 535'to appear in the captured image at the same location as the corresponding boundary reference landmarks 532, 533, 534, and 535 of the reference pattern group 500 of FIG. 5A. Is converted to the ideal coordinate system. The boundary reference landmarks 532', 533', 534', 535' may be detected by computer image recognition technology, and the boundary reference landmarks 532', 533', 534', 535' or each of them. The pixels constituting the above may be configured to have characteristics such as a shape and a color suitable for carrying out such a computer image recognition technique.

In some embodiments, between the boundary reference landmarks 532, 533, 534, 535 in the captured image 550 and the corresponding boundary reference landmarks 532, 533, 534, 535 of the reference pattern group 500 of FIG. 5A. The distance determines the matrix transformation. The matrix transformation then enables the transformation by applying the captured image 550 to some or all of the pixels.

The captured image 550 that appears after conversion to the ideal coordinate system can be seen in FIG. 5C. The boundary reference landmarks 532', 533', 534', and 535'in the captured image 550 after this conversion are in the same positions as the boundary reference landmarks 532, 533, 534, and 535 of the reference pattern group 500 in FIG. 5A.

In step 440, the captured image is processed to determine the total distortion from the reference pattern to the captured image pattern. The total distortion (ie, the distortion caused by the corrective lens as well as the lens of the camera used to capture the image) is to compare the patterns 510 and 520 in the captured image 550 to the patterns in the reference pattern group 500. It may be determined by. In some embodiments, this comparison is performed by comparing the plurality of pattern reference landmarks 512'in the captured image 550 to the plurality of pattern reference landmarks 512 in the reference pattern group 500.

FIG. 6 shows the locations of the plurality of pattern reference landmarks 512'in an exemplary capture image 550 superimposed on the locations of the plurality of pattern reference landmarks 512 in the reference pattern group 500. Distortion (ie, transformation) from the ideal coordinate system to the captured image by using the distance between each pattern reference landmark 512a', 512b' in the captured image and the corresponding reference landmarks 512a, 512b of the reference pattern group. The diopter matrix P that describes the above may be determined.

Prentice's law describes the amount of induced prism in a lens. By using P, Prentice's law of matrix form can be expressed as x _test = Px _ref . Here, x _test is a matrix of the locations of the pattern reference landmarks 512a'and 512b' in the captured image, and x _ref is a matrix of the locations of the corresponding reference landmarks 512a and 512b of the reference pattern group.

The diopter matrix P is given by:

ただし、
Ｐ_ｘ＝Ｓ＋Ｃｓｉｎ^２θ ［２］
Ｐ_ｙ＝Ｓ＋Ｃｃｏｓ^２θ ［３］
Ｐ_ｔ＝－Ｃｓｉｎθｃｏｓθ ［４］
である。

however,
P _x = S + Csin ² θ [2]
_Py = S + Ccos ² θ [3]
P _t = -Csinθ cosθ [4]
Is.

By solving this algebraically, it is possible to determine the value of S (value related to the spherical power of the lens), the value of C (value related to the cylindrical power of the lens), and the value of θ (the astigmatism angle of the lens). can.

The values of S and C describe the distortion caused in the captured image by both the corrective lens and the lens of the camera of the lens meter. Therefore, in step 450, the distortion of the pattern in the captured image that may be caused by the corrective lens is determined. In particular, when the corrective lens is positioned halfway between the camera and the pattern, the focal lengths f _θ and f of the corrective lens along the two orthogonal axes corresponding to θ and θ + 90 ° are given by the following equations. _{θ + 90 °} is determined.

ここで、ｌは、パターンとレンズメータのカメラのレンズとの間の距離である。ｌの値を決定するため、カメラおよび／またはレンズのパラメータが決定されるようになっていてもよいし、データストアから直接アクセス可能であってもよい。いくつかの実施形態において、カメラレンズの焦点距離ｆは、取り込み像またはレンズメータの設定情報におけるメタデータから決定されるようになっていてもよい。パターンの高さｈは、既知であってもよい。距離ｌは、ｆおよび他のパラメータから決定されるようになっていてもよい。物体（たとえば、パターン）からの距離を決定する方法およびシステムについては、２０１６年１月１５日に出願された米国特許出願第１４／９９６，９１７号明細書「ＳＭＡＲＴＰＨＯＮＥ ＲＡＮＧＥ ＦＩＮＤＥＲ」に記載されており、そのすべての開示内容を参照により本明細書に援用する。

Here, l is the distance between the pattern and the lens of the camera of the lens meter. Camera and / or lens parameters may be determined to determine the value of l, or may be directly accessible from the data store. In some embodiments, the focal length f of the camera lens may be determined from the captured image or metadata in the lens meter setting information. The height h of the pattern may be known. The distance l may be determined from f and other parameters. Methods and systems for determining the distance from an object (eg, a pattern) are described in US Patent Application No. 14 / 996,917, "SMARTPHONE RANGE FINDER", filed January 15, 2016. , All of which are disclosed herein by reference.

In step 460, at least one characteristic of the corrective lens is determined. In some embodiments, the corrective lens formulation may be determined by determining the spherical, cylindrical, and axial measurement results of the corrective lens. The measurement result of the spherical surface shows the amount of lens power measured by the diopter. Corrective lenses may be prescribed a specific spherical power to correct myopia or hyperopia in all meridians of the eye. In some embodiments, the spherical power may be signed and a negative value may represent a prescription for myopia and a positive value may represent a prescription for hyperopia.

Cylindrical power indicates the amount of lens power prescribed for astigmatism. The cylindricity may be zero if no correction for astigmatism is prescribed. The results of the cylindrical measurement show that the corrective lens has a first meridian with no additional curvature and a second meridian perpendicular to the first meridian containing the maximum lens curvature to correct astigmatism. ..

Axial power represents the orientation of the second meridian of the cylinder. The axial power may be in the range of 1 ° to 180 °, where 90 ° corresponds to the vertical meridian of the eye and 180 ° corresponds to the horizontal meridian.

Other values of the corrective lens may also be determined, such as the ADD value representing the additional magnification applied to the bottom of the multifocal (eg, bifocal or trifocal) lens.

In some embodiments, the measurement result of the spherical surface, the cylinder, and the axis of the corrective lens may be determined by the following equation.
SPH = 1000 / f _θ [7]

ＡＸＩＳ＝１８０°－θ ［９］
ここで、ＡＸＩＳの決定は、矯正レンズの着用者の視点から実行される。

AXIS = 180 ° -θ [9]
Here, the AXIS determination is carried out from the perspective of the wearer of the corrective lens.

The values of SPH, CYL, and AXIS are displayed on the screen of the lens meter, stored in the memory of the lens meter (eg, database or file), and / or by another party (prescription) via the network interface of the lens meter. It can be delivered to an ophthalmologist, etc. who is affiliated with the owner of the corrective lens for the purpose of confirmation or designation. For example, these processes may be performed by a person who has spectacles but does not know the prescription of the spectacles. The information obtained by the methods discussed herein may be sent to this person's eye care specialist, who will use this information to order new eyeglasses with the correct prescription. be able to.

Process 400 ends at step 470.

In some embodiments, the need to position the corrective lens halfway between the lens meter and the pattern may be reduced. Alternatively, the lens meter and / or the corrective lens may move relative to each other and with respect to the pattern while the lens meter captures multiple images. As described above, the values of S and C may be determined for each image. It is known that S and S + C have extrema (ie, minimal or maximal) when the corrective lens is positioned halfway between the lens meter and the pattern. The image in which S and S + C produce extrema may be used as a reference for the process described herein.

Also, of course, the examples given herein include a corrective lens in the form of spectacles, but the process and system may be held in a suitable orientation and location for performing the process according to the claims. On the premise of this, it may be applicable to other types of corrective lenses such as contact lenses.

In some embodiments, the captured image is not converted to an ideal coordinate system. Rather, as discussed in various embodiments herein, the corrective lens is identical to the first image except that the corrective lens is disposed between the lens meter and the pattern and the corrective lens is removed. Two images, the second "reference" image, are captured. Since there is no lens distortion effect in the second image, the amount of distortion should be determined using the technique discussed for step 440 of Process 400 by comparing the first image directly with the second image. You may do it.

As mentioned above (for example, with respect to Equations 1-9), in the operation of an instrumentless lens meter, it may be useful to place the corrective lens halfway between the lens meter camera and the display pattern. However, it can be difficult for the user to find a suitable midway point.

Further, as described above, in order to identify the extreme values of S and S + C, the corrective lens identifies one of the plurality of images positioned in the middle by capturing a plurality of images while the lens meter is moving. However, if the lens meter and / or the corrective lens moves with respect to each other and with respect to the pattern, the need to position the corrective lens halfway between the lens meter and the pattern may be reduced.

However, identifying S and S + C extrema by capturing, storing, and / or processing multiple images can be expensive (eg, in terms of CPU cycles, memory usage, and / or power). ..

According to various aspects of the present disclosure, the distance l between the pattern and the camera lens of the lens meter, the distance l1 between the pattern and the corrective lens, and / or the distance l2 between the corrective lens and the pattern (eg,). , L-l1) are provided with improved lens meter systems and methods capable of determining. By using one or more of these determined distances, a user's guide and / or lens for placement of the corrective lens at a midway location (eg, l1 = l2) prior to capture of the analytical image. It is possible to compensate the relative position of the lens meter, the corrective lens, and the pattern by the meter.

First, the complementary measurement image captured by the orthodontic lens in contact with the pattern (sometimes referred to herein as the contact image or the first image) is used to determine the absolute size and shape of the orthodontic lens. Thereby, the distances l, l1, and / or l2 can be determined. 7 to 11 show various aspects of operation of the instrumentless lens meter using the contact image.

For example, FIG. 7 is a perspective view of a system 200 in which a lens meter 210, two corrective lenses 220 mounted on the frame 708 of the spectacles 704, and a pattern 230 are arranged for capturing a contact image. In the example of FIG. 7, the pattern 230 is displayed on the display image 700 on the laptop computer 702. The laptop computer 702 may be paired with a lens meter 210 (implemented as a mobile phone in this example). The lens meter 210 may acquire the display characteristics of the laptop 702 display from the laptop 702 and give instructions to the laptop 702 to control the display of the image 700 and / or the pattern 230.

For example, the lens meter 210 acquires information associated with the laptop 702 display, such as the size (eg, height and width) of the laptop 702 display and / or dimensional information indicating the pixel size and density of the display. You may do so. Using this information, the lens meter 210 can determine the absolute physical size adjustment of the features of the pattern 230 and / or direct to the laptop 702. In the example of FIG. 7, a single pattern 230 with a screen width in which the reference landmark 706 is embedded is displayed. In this example, as described above for the boundary reference landmarks 532, 533, 534, and 535, the reference landmark 706 is to be utilized as the boundary reference landmark (eg, for orientation and transformation of the captured image). It may be. In this example, a pattern reference landmark such as the pattern reference landmark 512 is provided in the pattern 230, and / or the feature of the pattern (for example, the intersection corner of the shape such as a square of the pattern) is set as the pattern reference landmark. It can be used as.

In the operation shown in FIG. 7, the correction lens 220 is in contact with the pattern 230 (for example, in contact with the display of the laptop 702 displaying the pattern 230), and the correction lens 220 is inside the correction lens 220 and outside the frame 708. , The frame 708, and the contact image of the pattern 230 are captured by the lens meter 210. In the illustrated configuration, since the corrective lens 220 is in contact with the pattern 230, the pattern 230 is substantially free from distortion due to the corrective lens 220. Therefore, the size of the feature of the pattern in the contact image is known (eg, stored in memory 350) and the corrective lens for pattern 230 (eg, identified by the portion of pattern 230 obscured by the frame 708). The use of the 220 edge location allows the absolute size and shape of each orthodontic lens to be determined.

As shown in the example of FIG. 7, the indication 703 may be provided on the display of the lens meter 210. In other embodiments, instructions 703 may be given in whole or in part on the display of the laptop 702 or another device. FIG. 8 shows an example of an instruction 703 that may be given during lens meter operation using the lens meter 210. As shown in FIG. 8, the indication 703 includes the display 800 of the boundary reference landmark 706 and the boundary reference landmark 706, all based on one or more images captured by the camera of the lens meter 210. The display 800 may include the display 802 of the spectacles 704 in place (including the display 804 and 806 of the frame 708 and the lens 220). As shown, by including the text instruction 801 and / or the graphic instruction 803, the user is in close contact with the pattern 230 as in the configuration of FIG. 7 (for example, in close contact with the screen of the laptop 702). The spectacles 704 may be placed (with the eyeglasses in place) and instructed to capture an image (for example, take a picture).

As shown in FIG. 8, a lens boundary indicator 810 indicating the outer boundary of each of the correction lenses 220 may be displayed. For example, the spectacles 704 may be separated from the display pattern 230 in the image captured by the lens meter 210, resulting in a shape corresponding to the lens 220 based on the location and relative size of the connected components. It may be inferred. After generating the lens boundary indicator 810 based on the inferred lens shape, it can be superimposed on the camera view of the smartphone to give feedback to the user that the lens has been accurately positioned, as shown in FIG. can.

FIG. 8 also shows how the lens meter 210 determines whether one or both of the lenses 220 are partially obstructed (eg, by the user's finger or the temple arm of the eyeglasses). For example, obstruction may be detected by comparing the lens shapes of the two lenses 220 of the spectacles 704 using shape mirroring and / or alignment procedures. Obstruction may be detected when the mirroring shape of one lens is substantially different from the shape of the other lens (for example, when it is smaller than a threshold value).

The exact positioning and shape of the obstruction may be determined by the lens meter 210 by selecting points in the obstruction lens shape that do not match the non-obstruction lens shape. Then, it is also possible to superimpose the obstruction boundary 814 defined by these selected points on the camera view of the smartphone and inform the user of the nature and location of the obstruction so that the user can deal with it. Further, by giving an additional instruction 821, the user may be instructed to remove the obstruction (when an obstruction is detected), or the user may be reminded to avoid the obstruction of the lens. You may.

As described above, in the configuration shown in FIG. 7 in which the corrective lens 220 is in close contact with the pattern 230, when the contact image is captured by the system 200, the boundary with the known size of the characteristic of the pattern 230 (in FIG. 8, the boundary). The absolute size and shape of each orthodontic lens 220 can be determined by comparison (indicated by indicator 810).

After capturing the contact image (eg, in response to user action or automatically as described above), the user is given the corrective lens 220 to move to a substantially midway point between the lens meter 210 and the pattern 230. The instruction 703 may be modified to indicate the instruction.

FIG. 9 is a top perspective view of the system 200 in which the user has moved the spectacles 704 so that the corrective lens 220 is positioned at the intermediate position 900 between the lens meter 210 and the pattern 230. FIG. 9 shows the distance l1 between the pattern 230 and the correction lens 220, l2 between the correction lens 220 and the pattern 230, and the total distance l between the camera and the pattern.

The shape and size of the lens 220 can be identified by real-time processing of the image captured during the movement and positioning of the corrective lens 220, and the distances l1 and l2 can be determined by comparison with the shape and size in the contact image. Is. One or more of these determined distances and / or absolute and / or relative distance graphic indicators (eg, by the display of the lens meter 210) are reported back to the user in real time to the pattern 230. To the desired intermediate position 900, such as an intermediate position where the distance l1 between the corrective lens 220 and the distance l2 between the corrective lens 220 and the pattern 230 are substantially the same (eg, within the range of the difference threshold). It can help the user guide the glasses.

Also, the lens boundary indicator 810 and / or the obstruction indicator 814 is displayed in real time by the lens meter 210 during the movement and positioning of the corrective lens 220 to indicate to the user the position of the corrective lens with respect to the reference landmark 706 and the lens. If one or more of them are blocked, the user may be alerted.

If the contact image processing determines that the distances l1 and l2 are approximately identical (eg, within the range of the difference threshold) based on the known size of the lens 220 (eg, no obstruction is detected), the lens meter. The 210 may indicate that the user has correctly positioned the lens meter 210, the corrective lens 220, and the pattern 230, for example by displaying an icon of "green light" or a thumbs-up gesture. If the desired positioning of the orthodontic lens 220 (eg, in the midpoint position) is achieved, the user may be instructed to capture a lens meter image (eg, a lens power measurement result image). It is also possible to automatically capture the lens meter image. The characteristics of the lens 220 are measured (eg, as described above with respect to FIG. 3) by using the captured lens meter image.

Thus, the information obtained during the positioning of the lens meter 210 and the lens 220 (eg, with less computation and power compared to the iterative computation and comparison of S and S + C as described above) to the user in real time. The wrap-around report can help the user interactively adjust the placement of the glasses and smartphone to achieve the desired imaging conditions. Further, this information (for example, relative distance) can be displayed to the user after capturing the lens meter image. In some embodiments, the lens meter can then provide the option of reacquiring or approving the lens meter image.

Also, of course, FIGS. 7-9 show a common pattern across the display of the laptop 702, but in various scenarios, a plurality of patterns (eg, patterns 510 and for two lenses of eyeglasses). Two patterns such as 520 or three or more patterns for a progressive multifocal lens or a multifocal lens) can be used. However, a single pattern as illustrated and described with respect to FIGS. 7-9 can also be used to determine various characteristics of a multifocal lens, a progressive multifocal lens, or other complex lens configuration. (For example, subregion analysis of captured images). Also, of course, a single contact image and a single lens meter image are described with respect to FIGS. 7-9, but in some situations, multiple contact images and / or multiple lens meters. It is also possible to obtain more accurate results by image capture and aggregation, averaging, or combination and / or common processing. For example, analysis by stacking or combining a plurality of images and / or averaging or combining measurement results from a plurality of images are possible. For example, the lens power estimation operation described herein is affected by the accuracy of multiple quantities of measurement results, such as test pattern distortion in captured images and pattern and lens position and orientation with respect to lens meter equipment. These measurements can be affected by errors, some of which are often uncorrelated. By acquiring a series of similar images and aggregating the derived measurement results of the estimation, the influence of the noise source that is uncorrelated in time can be suppressed.

FIG. 10 is a flow chart of an exemplary process of lens meter operation according to various aspects of the present technology. In the present specification, for the purpose of explanation, an exemplary process of FIG. 10 will be described with reference to the components of FIGS. 2, 3, and 7-9. Further, herein, for purposes of illustration, some blocks of the exemplary process of FIG. 10 are described as occurring sequentially or sequentially. However, multiple blocks of the exemplary process of FIG. 10 can occur in parallel. Also, it is not necessary to execute the blocks of the exemplary process of FIG. 10 in the order shown and / or execute one or more of the blocks of the exemplary process of FIG.

In the illustrated exemplary flow diagram, block 1000 provides patterns such as pattern 230. As described above, the pattern may be a print pattern or with a computer device such as a laptop 702 (eg, the computer device itself and / or a lens meter device such as a lens meter device 210 mounted as a mobile phone). It may be provided (in collaboration).

At block 1002, instructions are given to place the corrective lens in contact with the pattern (eg, in close contact) (eg, by the display of a lens meter device) (see, eg, FIGS. 7 and 9). Although the example of FIG. 10 describes a single corrective lens, the operation of FIG. 10 can be performed on two or more corrective lenses, such as a pair of corrective lenses mounted on a frame.

In block 1004, a first image (eg, contact image) of the pattern is acquired (eg, by a camera of a lens meter) through a corrective lens in contact with the pattern. As described in the present specification, the first image may be automatically acquired by capturing the image with a lens meter device, or may be acquired according to the user's operation. It may be.

At block 1006, the lens meter uses a first image (eg, in the first image, the corrective lens and / or the frame of the corrective lens is separated from the pattern, and in the separated image, the location of the connecting component is located. By identifying, by acquiring the points corresponding to the outer boundary), the outer boundary of the corrective lens is identified. As described above, the boundary indicator such as the boundary indicator 810 of FIG. 8 may be displayed together with the display of the corrective lens.

At block 1008, the lens meter determines if the corrective lens is obstructed. Determining if an orthodontic lens is obstructed involves identifying the irregular edges of a single orthodontic lens or identifying the shape difference between the mirroring shapes of two lenses in eyeglasses. May be (see, for example, Figure 8 and the related description).

If it is determined that the corrective lens is obstructed, at block 1010, the lens meter will include a first image along with an obstruction indicator such as the obstruction indicator 814 of FIG. 8 associated with the display 812 of the user's finger obstructing the lens. May be displayed. While the obstruction is detected, the lens meter may continuously return to blocks 1004, 1006, 1008, and 1010 until the obstruction is removed.

If it is determined that the corrective lens is not obstructed, the block 1012 may store the first image and the identified boundary (eg, in a memory such as the memory 350 of the lens meter).

At block 1014, the size and shape of the corrective lens is determined based on the identified boundaries and patterns. For example, features of known shape and absolute size may be given to the pattern so that the absolute dimensions of the corrective lens can be determined by comparison with the features of the pattern in the contact image. For example, if the pattern includes a square checkered pattern, each width is X mm, and the maximum dimension of the corrective lens extends to Y squares, the maximum dimension of the corrective lens is X × Y mm in length. It is also possible to measure one or more additional dimensions of the lens. By using this information, in any subsequent image, the maximum dimensional length of the lens (pixels of the image) is used with the camera and corrective lens (eg, if the solid angle of the pixel is known). The distance between can be determined. All of the distances l, l1 and l2 described above can be determined from the second image in combination with the features of the pattern of known size.

In block 1018, a second pattern different from the first pattern may be provided. The second pattern may include a plurality of patterns, such as patterns 510 and 520 for a plurality of lenses and / or one or more additional patterns for a multifocal lens or a progressive multifocal lens. However, if necessary, it is possible to continue displaying the pattern displayed by the block 1000 instead of displaying the second pattern.

At block 1020, the lens meter may give an instruction to place the corrective lens at an intermediate position 900, such as an intermediate position between the camera and the pattern of the lens meter device.

In block 1022, with the corrective lens in the intermediate position, the lens meter measures the pattern through the corrective lens (eg, the first pattern provided by block 1000 or the second pattern provided by block 1018). Acquire a second image. Further, in the second image, the outer boundary of the corrective lens may be identified.

At block 1024, the lens meter determines if the corrective lens is obstructed.

If it is determined that the corrective lens is obstructed, at block 1026, the lens meter displays a first image with an obstruction indicator such as the obstruction indicator 814 of FIG. 8 associated with the display 812 of the user's finger blocking the lens. It may be displayed. While the obstruction is detected, the lens meter may continuously return to blocks 1022, 1024, and 1026 until the obstruction is removed.

If it is determined that the corrective lens is unobstructed, block 1028 (eg, known size of corrective lens determined in block 1014, second image, and / or known size of pattern features is used. Thereby) the distance l1 between the camera and the corrective lens and the distance l2 (eg l-l1) between the corrective lens and the pattern are determined.

In block 1030, the lens meter is similar in the distance between the lens meter and the corrective lens and the distance between the corrective lens and the pattern within the range of the difference threshold (for example, the distance l1 is abbreviated as the distance l2). Is it equal?). In this way, it may be determined whether or not the corrective lens is in a desired intermediate position (for example, an intermediate position).

If it is determined that the corrective lens is not in the desired intermediate position, repositioning instructions may be given by the lens meter in block 1032. For example, repositioning instructions may include text-based and / or graphic displays at absolute and / or relative distances l1 and l2 and / or indicators such as graphic arrows or text that instruct the user to move the corrective lens and / or lens meter. It may be included.

While the corrective lens is not in the intermediate position (as determined by calculation and comparison of distances l1 and l2, for example), the lens meter will block 1022, 1024, 1026, 1028 until the corrective lens is in the desired intermediate position. The operations of 1030 and / or 1032 may be repeated continuously.

If it is determined in block 1030 that the corrective lens is in the desired intermediate position, the lens meter may be configured to store in block 1034 a second image of the pattern passing through the corrective lens. Also at block 1030, the lens meter may indicate to the user that the corrective lens has been correctly positioned in the desired intermediate location, for example by displaying a "green light" or thumb-up gesture icon. .. Then, the second image may be automatically captured and stored in response to the detection at the location or the subsequent image capture operation by the user. Thus, the operation of blocks 1030 and 1032 can help guide the user to place the corrective lens halfway between the camera and the pattern for optimal measurement results. However, of course, the operation of blocks 1030 and 1032 may be omitted or blocked in some scenarios, and by using the distance determined in block 1028, between the camera and the pattern. Differences in pattern distortion due to the position of the corrective lens at different locations can be considered.

In block 1036, the second image may be converted into an ideal coordinate system. For example, the second image may be transformed into the ideal coordinate system represented by the reference pattern group 706 in FIG. 7. In this transformation, the second image may be rotated, resized, cropped, and tilted to remove any distortion or inaccuracies caused by the image capture process. In some embodiments, the boundary reference landmark is a reference in the second image by detecting the boundary reference landmark 706 in the second image and transforming the second image using image manipulation techniques. The second image is transformed into an ideal coordinate system by making it appear in the same place as the corresponding boundary reference landmark 706 of the pattern group. The boundary reference landmarks in the second image may be detected by computer image recognition techniques, and the detected boundary reference landmarks or the pixels constituting each of them may be detected by such computer image recognition techniques. It may be configured to have characteristics such as a shape and a color suitable for execution.

In some embodiments, the distance between the boundary reference landmark in the second image and the corresponding boundary reference landmark 706 of the reference pattern group determines the matrix transformation. The matrix transformation then enables the transformation by applying it to some or all of the pixels of the second image.

At block 1038, the second image is processed to determine the overall distortion from the reference pattern to the captured image pattern. The total distortion (ie, the distortion caused by the corrective lens as well as the lens of the camera used to capture the image) is determined by comparing the pattern in the second image to the pattern in the reference pattern. It may be like this. In some embodiments, this comparison refers to a plurality of pattern reference landmarks such as 512'in the second image against a plurality of corresponding pattern reference landmarks such as the pattern reference landmark 512 of the reference pattern group. Performed by comparison. Then, the distortion of the pattern in the captured image that may be caused by the corrective lens (for example, the distance l determined by using the known size of the second image and the feature of the pattern and / or the determined size of the corrective lens is used. It may be decided (by). This determined distance l may be used to determine the distortion of the pattern in the captured image that may be due to the corrective lens, if the corrective lens is somewhere halfway between the pattern and the camera. (For example, in the case of l1 = l2 = l / 2) is based on the above equations 5 and 6. In situations where the corrective lens is not in the middle (eg, l1 ≠ l2), one of ordinary skill in the art will appreciate by modifying the equation to determine the pattern distortion in the captured image that may result from the corrective lens. Determine the possible pattern distortion in the captured image.

At block 1040, a lens meter determines at least one characteristic of the corrective lens. For example, the prescription of the corrective lens may be determined by determining the measurement results of the spherical surface, the cylinder, and the axis of the corrective lens. Other values of the corrective lens may also be determined, such as the ADD value representing the additional magnification applied to the bottom of the multifocal (eg, bifocal or trifocal) lens. In some embodiments, the measurement results of the spherical surface, the cylinder, and the axis of the corrective lens may be determined by the above equations 7, 8, and 9. Therefore, at least one characteristic of the corrective lens may be determined in part based on the measured size of the corrective lens.

The values of SPH, CYL, and AXIS are displayed on the screen of the lens meter, stored in the memory of the lens meter (eg, database or file), and / or by another party (prescription) via the network interface of the lens meter. It can be delivered to an ophthalmologist, etc. who is affiliated with the owner of the corrective lens for the purpose of confirmation or designation. For example, these processes may be performed by a person who has spectacles but does not know the prescription of the spectacles. The information obtained by the methods discussed herein may be sent to this person's eye care specialist, who will use this information to order new eyeglasses with the correct prescription. be able to.

This specification describes various examples in which the operation of the lens meter is performed by the lens meter device 210 (implemented as, for example, a mobile phone or a smartphone), but of course, a part of the lens meter operation or All may be run remotely by the server using images and / or other information captured and transmitted by the mobile device. For example, FIG. 11 comprises a lens meter 210 implemented as a mobile phone, a laptop computer 702 displaying a pattern 230, and a server 1130 communicating with the lens meter 210 and / or the laptop computer 702 via a network 1150. An embodiment of a lens meter system is shown.

As mentioned above, the aspects and functions disclosed herein may be implemented as hardware or software in one or more of these computer systems. These are many examples of computer systems currently in use. Examples of these include network appliances, personal computers, workstations, mainframes, network clients, servers, media servers, application servers, database servers, and web servers, among others. Other examples of computer systems include mobile computer devices such as mobile phones and personal digital auxiliary devices and network devices such as load balancers, routers, and switches. Further, the modes may be set on a single computer system, or the modes may be distributed among a plurality of computer systems connected to one or a plurality of communication networks.

For example, various aspects and functions may be distributed among one or more computer systems configured to serve one or more client computers. In addition, the embodiment may be implemented on a client-server or multi-layer system that includes components distributed among one or more server systems that perform various functions. As a result, the examples are not limited to running on any particular system or group of systems. Further, the embodiments may be implemented in software, hardware, or firmware, or any combination thereof. For this reason, aspects may be implemented within processes, behaviors, systems, system elements, and components that use a variety of hardware and software configurations, such as any particular distributed architecture or network. , Not limited to communication protocols.

With reference to FIG. 3 again, the lens meter 210 may be interconnected with other systems such as server 1130 and also other systems via a network interface 340 connected to a network such as network 1150. You may exchange data with. The network includes any communication network with which a computer system can exchange data. To exchange data over networks, lens meters 210 and networks may use a variety of methods, protocols, and standards, among others fiber channels, Token Ring, Ethernet, wireless Ethernet, Bluetooth, IP. , IPV6, TCP / IP, UDP, DTN, HTTP, FTP, SNMP, SMS, MMS, SS7, JSON, SOAP, CORBA, REST, and web services. To ensure data transfer is secure, the lens meter 210 may transmit data over the network by using various security measures such as TSL, SSL, or VPN.

Various aspects and functions may be implemented as dedicated hardware or software running in one or more computer systems. As shown in FIG. 3, the lens meter 210 includes a camera 310, a processor 320, a user interface 330, a network interface 340, a memory 350, and lens meter software 360.

The processor 320 may execute a series of instructions which are operation data. The processor 320 may be a commercially available processor such as Intel's Xeon, Itanium, Core, Celeron, Pentium, AMD's Opteron, Sun's UltraSPARC, IBM's Power5 +, or IBM's mainframe chip, but on the other hand, any. It may be a type of processor, multiprocessor, or controller. The processor 320 is connected to other system elements such as the memory 350 and the camera 310.

The memory 350 may be used to store programs and data during the operation of the lens meter 210. Therefore, the memory 350 may be a relatively high-performance volatile random access memory such as a dynamic random access memory (DRAM) or a static memory (SRAM). However, the memory 350 may include any device that stores data, such as a disk drive or other non-volatile storage device. In various examples, the functions disclosed herein may be performed by incorporating the memory 350 into a particular structure, and in some cases a unique structure.

The memory 350 also includes a computer-readable and writable non-volatile (persistent) data storage medium in which instructions defining a program that can be executed by the processor 320 are stored. Further, the memory 350 may include information recorded on or in the medium, and this information may be processed by the processor 320 when the program is executed. More specifically, this information may be stored in one or more data structures specifically configured to save storage space or improve data exchange performance. The instruction may be persistently stored as a coded signal, or may cause the processor 320 to perform any of the functions described herein. The medium may be, for example, an optical disk, a magnetic disk, or a flash memory, among others. Various components may be allowed to manage the movement of data between the storage medium and other memory elements, and the examples are not limited to specific data management components. Furthermore, the examples are not limited to any particular memory system or data storage system.

The lens meter 210 also comprises one or more user interfaces 330. The user interface 330 may accept inputs or provide outputs. More specifically, the output device may provide information for external presentation. The input device may accept information from an external source. Examples of interface devices include keyboards, mouse devices, trackballs, microphones, touch screens, printing devices, display screens, speakers, network interface cards, and the like.

Although the lens meter 210 is shown as an example of a kind of computer device capable of realizing various aspects and functions, the embodiment is not limited to the mounting on the lens meter 210 as shown in FIGS. 2 and 3. Various aspects and functions may be realized on one or more computers having architectures or components different from those shown in FIG. For example, the lens meter 210 may include dedicated hardware programmed specifically, such as an application specific integrated circuit (ASIC) tuned to perform the particular operation disclosed herein. However, another example performs the same function using a grid of multiple general purpose computer devices running MAC OS System X with Motorola's PowerPC processor or multiple dedicated computer devices running proprietary hardware and operating systems. You may try to do it.

The lens meter 210 may include an operating system that manages at least some of the hardware elements contained in the lens meter 210. Typically, a processor or controller, such as processor 320, runs the operating system, such as Windows NT, Windows 2000 (Windows ME), Windows XP, Windows Vista, or Windows 7 operating system available from Microsoft. Windows-based operating system, MAC OS System X operating system available from Apple Computer, and many Linux-based operating system categories (eg, available from Red Hat). It may be one of the Enterprise Windows operating system, the Solaris operating system available from Sun Microsystems, or the UNIX operating system available from various sources. Many other operating systems may be used, and the examples are not limited to any particular embodiment.

The processor 320 and the operating system integrally define a computer platform on which application programs in high-level programming languages can be written. These component applications may be executable intermediate bytecode or interpreted code that communicates over a communication network (eg, the Internet) using a communication protocol (eg, TCP / IP). Similarly ,. Aspects may be implemented using object-oriented programming languages such as Net, SmallTalk, Java, C ++, Ada, or C # (C-Sharp). Also, other object-oriented programming languages may be used. Alternatively, functional, scripted, or logical programming languages may be used.

Also, in a non-programming environment (eg, a document generated in HTML, XML, or other format that is responsible for drawing the aspects of a graphical user interface or performing other functions when viewed in the window of a browser program). Various aspects and functions may be implemented. Further, various examples may be implemented as programming elements, non-programming elements, or any combination thereof. For example, while a web page is implemented using HTML, a data object called from within the web page may be described in C ++. Therefore, the above example is not limited to a specific programming language, and any suitable programming language can be used. Accordingly, the functional components disclosed herein may include a wide variety of elements (eg, executable code, data structures, or objects configured to perform the above functions).

The embodiments described above utilize a process of characterizing a corrective lens using a camera of a mobile device. In many different applications, other embodiments may be used to determine the characteristics of the lens, detecting lens scratches, comparing the characteristics of two different lenses, and detecting diffraction (ie, distortion). ) Based on the amount of the structural properties of the lens, or other applications that require the determination of the properties of the lens.

Although a plurality of aspects of at least one example have been described above, those skilled in the art will naturally come up with various changes, modifications, and improvements. For example, the examples disclosed herein may be used in other contexts. Such changes, modifications, and improvements are intended to be part of this disclosure and to be included within the scope of the examples discussed herein. Therefore, the above description and drawings are merely examples.

100 Lens Meter System 110 Light Source 120 Pattern 130 Corrective Lens 140 Eyepiece 150 Instrument 152 Lens Holder 200 Lens Meter System 210 Lens Meter 220 Corrective Lens 230 Pattern 310 Camera 312 Lens 320 Processor 330 User Interface 340 Network Interface 350 Memory 360 Lens Meter Software 500 Pattern group 510, 520 Patterns 512, 512', 512a, 512a', 512b, 512b' Pattern reference landmark 530 Boundary 532, 532', 533, 533', 534, 534', 535, 535' Boundary reference landmark 540 Eyeglass frame 542, 544 Opening 550 Capture image 700 Display image 702 Laptop computer 703 Instruction 704 Eyewear 706 Border reference landmark 708 Frame 800 Display 801 Text indication 802 Display 803 Graphic indication 804, 806 Display 810 Lens boundary indicator 812 Display 814 821 Instruction 900 Intermediate location 1130 Server 1150 Network l, l1, l2 Distance

Claims (20)

It ’s a way to operate the lens meter system.
The camera of the lens meter system captures the first image of the pattern through the corrective lens in contact with the pattern, wherein the pattern is a black and white square grid. That and
The computer equipment of the lens meter system determines the size of the corrective lens based on the first image and the pattern.
The camera captures a second image of the pattern through the corrective lens while the corrective lens is in an intermediate position between the camera and the pattern.
Using the determined size of the corrective lens by the computer device to determine the distortion that can be caused by the corrective lens of the pattern in the second image.
Measuring at least one characteristic of the corrective lens based on the distortion determined by the computer device.
Including, how. It is possible that the pattern contains a plurality of features of known size and determines the size of the corrective lens.
Identifying the outer boundary of the corrective lens in the first image and
Including determining the number of known size features located within the outer border in the first image, the feature of known size positioned within the outer border in the first image. However, the method according to claim 1, wherein the method does not include distortion due to the corrective lens due to contact with the pattern. The method is such that while the corrective lens is in the intermediate position,
Using the computer device to determine the first distance between the corrective lens and the camera using the determined size and the second image.
Using the computer device to determine the second distance between the corrective lens and the pattern using the determined size and the second image.
The method according to claim 1, further comprising. The method of claim 3, wherein determining the strain using the determined size comprises determining the strain using at least one of the first distance and the second distance. 3. The method of claim 3, further comprising instructing the display of the lens meter system to move the camera or the corrective lens based on the first distance and the second distance. Method. A claim that guides the user of the lens meter system to adapt the instructions to the movement of the camera or the corrective lens to change the intermediate position to an intermediate position between the camera and the pattern. Item 5. The method according to Item 5. The method is
The display of the lens meter system provides at least one indication of the first distance and the second distance.
Given the option to reacquire the second image,
3. The method of claim 3. The method is
The method of claim 1, further comprising determining whether the corrective lens is obstructed by the second image by the computer device. The method of claim 8, further comprising displaying the display of the corrective lens and the outer boundary of the corrective lens, as well as the obstruction indicator indicating the obstruction of the corrective lens, based on the second image. The correction lens includes one of the two correction lenses of the spectacles in the second image, and it is determined whether the correction lens is obstructed by determining whether the outer boundary of the correction lens is the two correction lenses. 9. The method of claim 9, comprising determining whether the eye has a shape that is a mirror image of the other shape. Capturing the first image includes capturing a plurality of first images while the orthodontic lens is in contact with the pattern, and determining the size of the orthodontic lens is the plurality. The method of claim 1, comprising aggregating the information associated with the first image. The method of claim 1, wherein the camera comprises a camera of the computer device, the computer device comprises a mobile phone, and the method further comprises displaying the pattern on a display of a different computer device. 12. The method of claim 12, further comprising providing the mobile phone with information associated with the display of the different computer device. It ’s a mobile device,
With the camera
A processor is provided, and the processor is
A first image of the pattern is obtained from the camera through a correction lens in contact with the pattern, and the pattern is a black and white square grid.
Based on the first image and the pattern, the size of the corrective lens is determined.
A second image of the pattern passing through the corrective lens is obtained from the camera with the corrective lens at an intermediate position between the camera and the pattern.
The determined size of the corrective lens is used to determine the distortion of the pattern in the second image that can be caused by the corrective lens.
A mobile device configured to measure at least one characteristic of the corrective lens based on the determined strain. The mobile device further comprises a network interface, further configured such that the processor adjusts the display of the pattern by the remote computer device by communicating with the remote computer device via the network interface. Item 14. The mobile device according to Item 14. The mobile device further comprises a display, the processor operating the display.
The corrective lens is placed in contact with the pattern, and an instruction to capture the first image is given.
The corrective lens is moved to the intermediate position to give an instruction to capture the second image.
14. The mobile device of claim 14, further configured as such. It ’s a lens meter system.
Patterns with multiple features of multiple sizes and
It is equipped with a mobile device, and the mobile device is
With the camera
A memory that stores information associated with the pattern and the size of the feature, and
It is equipped with a processor, and the processor is
Using the camera, a first image of the pattern is captured through a correction lens in contact with the pattern, and the pattern is a black and white square grid.
By using the information associated with the pattern and the size of the feature, the size of the corrective lens is determined based on the first image and the pattern.
Using the camera, while the corrective lens is in an intermediate position between the camera and the pattern, a second image of the pattern passing through the corrective lens is captured.
The determined size of the corrective lens is used to determine the distortion of the pattern in the second image that can be caused by the corrective lens.
At least one characteristic of the corrective lens is measured based on the determined strain.
Lens meter system configured as. 17. The lens meter system according to claim 17, wherein the pattern includes a print pattern. 17. The lens meter system of claim 17, wherein the lens meter system further comprises a computer having a display, wherein the pattern comprises a pattern displayed by the display of the computer. The mobile device receives dimensional information about the display from the computer and uses the dimensional information, the first image, and a known size of the feature of the pattern to determine the size of the corrective lens. 19. The lens meter system according to claim 19.

Images