KR101020893B1 - Method of Measuring Displacement of Eyeball, Recording Media of the same and Apparatus of the same - Google Patents

Abstract

Provided are a recording medium recording an eye displacement measurement method, an eye displacement measurement method, and an eye displacement measurement apparatus. Eye displacement measurement method is a method of measuring the displacement of the eye, generating a three-dimensional eye model, receiving a two-dimensional anterior eye image including the eye, corneal reflection of the anterior eye image and the center of the three-dimensional eye model Matching the pupil, matching the pupil of the 3D eye model to the pupil of the anterior eye image, and using the difference between the pupil center of the 3D eye model and the center of the 3D eye model. It may comprise the step of quantifying. Therefore, the displacement of the eye can be measured quickly. As a result, ophthalmologists can treat patients with strabismus with more accurate and objective data and be able to apply them to a wider range of strabismus studies.

Anterior segment, eye model, strabismus, corneal reflex, pupil, angle distance

Description

Displacement measuring method and recording medium recording the eye displacement measurement method, eyeball displacement measuring method {Method of Measuring Displacement of Eyeball, Recording Media of the same and Apparatus of the same}

The present invention relates to an eyeball displacement measuring method, an eyeball displacement measuring method and a recording medium recording the eyeball displacement measuring device. More specifically, a three-dimensional eyeball displacement measuring method and an eyeball displacement measuring method are described. The present invention relates to a recording medium and an eyeball displacement measuring apparatus.

Methods for measuring the displacement of the eye in the ophthalmic field are required in various treatment areas, and more accurate measurement of the eye displacement is required for more accurate treatment. In particular, in case of strabismus patients, accurate measurement of strabismus angle should be accompanied, so that the strabismus symptom can be alleviated by the treatment of minute surgery.

Recently, many attempts have been made to apply computer-based image processing technology to various medical fields to utilize the diagnosis and treatment of patients. In the field of ophthalmology, attempts have been made to quantitatively analyze the shape and placement of patients' pupils and the distribution of blood vessels on the surface of the eye and use them for measurement and diagnosis of strabismus and fatigue.

Recently, various methods, such as alternating prism occlusion test, have been most widely used as a perspective measurement method. These test methods measure the patient's strabismus by manual measurement and calculation, so that the deviation of the measurement value may appear largely and error may occur according to the experience and skill of the examiner.

In order to make up for the shortcomings of the manual measurement technique, an attempt has been made to measure the degree of strabismus by analyzing a photograph or video image of a patient using a computer. However, in the computer-assisted strabismus technique, since the patient's perspective angle is analyzed using a video camera or a two-dimensional image taken by a camera, there is a limit in actually measuring the perspective angle of an eye having a three-dimensional sphere shape. There is a problem.

An object of the present invention is to provide a method for measuring the displacement of the eye using a three-dimensional eye model.

Another object of the present invention is to provide a recording medium recording a method of measuring the displacement of the eye using a three-dimensional eye model.

Still another object of the present invention is to provide an apparatus for measuring displacement of an eye using a three-dimensional eye model.

Displacement measuring method of the eye according to an embodiment of the present invention for achieving the above object of the present invention, in the displacement measurement method of the eye, generating a three-dimensional eye model; Receiving a two-dimensional frontal eye image including an eyeball; Matching the corneal reflection point of the anterior eye image and the center of the three-dimensional eye model; Matching the pupil of the 3D eye model with the pupil of the anterior eye segment image; And quantifying the displacement of the eyeball included in the anterior eyeball image using a difference between the pupil center of the 3D eye model and the center of the 3D eye model.

Here, at least one of the 3D eye model and the front eye image may be partially transparently expressed.

Here, the step of matching the corneal reflection point of the anterior eye image and the center of the three-dimensional eye model by applying at least one of the movement, rotation, reduction and enlargement to any one of the front eye image and the three-dimensional eye model. The corneal reflection of the anterior eye image may be matched with the center of the 3D eye model.

Here, the step of matching the pupil of the three-dimensional eye model with the pupil of the anterior eye image, the pupil of the three-dimensional eye model by applying at least one of movement, rotation, reduction and enlargement to the pupil of the three-dimensional eye model It may be to match the pupil of the anterior segment image.

According to another aspect of the present invention, there is provided a recording medium recording a displacement measurement method of an eyeball, the recording medium recording method comprising: generating a three-dimensional eye model; Receiving a two-dimensional frontal eye image including an eyeball; Matching the corneal reflection point of the anterior eye image and the center of the three-dimensional eye model; Matching the pupil of the 3D eye model with the pupil of the anterior eye segment image; And quantifying the displacement of the eyeball included in the anterior eyeball image using a difference between the pupil center of the 3D eye model and the center of the 3D eye model.

Displacement measuring device of the eye according to an embodiment of the present invention for achieving another object of the present invention described above, in the eyeball displacement measuring device, generating a three-dimensional eye model, the two-dimensional front including the eye Receiving an ophthalmic image, matching the corneal reflection of the anterior eye image and the center of the three-dimensional eye model, matching the pupil of the three-dimensional eye model to the pupil of the anterior eye image and the three-dimensional eye A control unit for performing a step of quantifying the displacement of the eyeball included in the anterior eye image using the difference between the pupil center of the model and the center of the 3D eye model; A display unit for expressing the 3D eye model and the frontal eye image; An input unit configured to receive at least one of the 3D eye model and the front eye image; And a memory unit for storing the three-dimensional eye model, the anterior eye image, and the quantified eye displacement.

The display unit may partially express at least one of the 3D eye model and the front eye image.

Here, in the control unit, the matching of the corneal reflection point of the anterior eye image and the center of the 3D eye model may include at least one of movement, rotation, reduction, and enlargement of any one of the anterior eye image and the 3D eye model. It may be to match the center of the corneal reflection point and the three-dimensional eye model by applying the.

Here, in the step of matching the pupil of the 3D eye model with the pupil of the anterior eye image by the controller, the 3D eyeball may be applied to at least one of movement, rotation, reduction, and enlargement of the pupil of the 3D eye model. The pupil of the model may be matched to the pupil of the anterior segment image.

According to the recording medium and the eyeball displacement measuring apparatus recording the eyeball displacement measuring method, the eyeball displacement measuring method according to the present invention, it is possible to quickly and accurately measure the eyeball displacement. Therefore, the ophthalmologist can treat patients with strabismus with more accurate and objective data, and apply the objective data to a wider range of strabismus studies.

As the present invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description.

However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all changes, equivalents, and substitutes included in the spirit and scope of the present invention.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "having" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art, and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, with reference to the accompanying drawings, it will be described in detail a preferred embodiment of the present invention. In the following description of the present invention, the same reference numerals are used for the same elements in the drawings and redundant descriptions of the same elements will be omitted.

1 is a flowchart illustrating a method for measuring eyeball displacement according to an embodiment of the present invention.

Referring to Figure 1, the method for measuring the displacement of the eye according to an embodiment of the present invention in the eye displacement measurement method, generating a three-dimensional eye model (step 110); Receiving a 2D anterior eyepiece image including an eyeball (step 120); Registering the corneal reflection point of the anterior eye image and the center of the three-dimensional eye model (step 130); Matching the pupil of the 3D eye model with the pupil of the anterior eye segment image (step 140); And quantifying the displacement of the eyeball included in the front eye image using the difference between the pupil center of the 3D eye model and the center of the 3D eye model (step 150).

First, the step of generating a three-dimensional eye model (step 110) is to shape the eye model as a reference for measuring the displacement of the eye in three dimensions, it may be performed using a graphic-related program. Since it is used to measure the displacement of the eye, it should be shaped to be close to the actual eye shape. Therefore, the 3D eye model may be formed based on experimental data observing various eye shapes. In this case, as experimental data, data such as eye diameter, iris size, and pupil size according to age may be used. In addition, in the step of generating a three-dimensional eye model (step 110), i) assumes that the shape of the eye and the iris is a perfect sphere, and ii) the direction of the line connecting the eye center and the pupil center is the direction of the eye. It can be based on assumptions.

Next, in the step of receiving a 2D anterior eyeball image including an eyeball (step 120), the frontal eye image means an image of a front face of a person, and thus receiving a 2D anterior eyeball image including an eyeball. In operation 120, the moving image or the still image of the front face of the person may be received. An image of the person's front face should include an image of the eyeball. In particular, an image in which an eyeball and a pupil appear in a front face image of a person may be useful as an anterior eye image.

Here, in order to express the 3D eye model and the front eye image, at least one of the 3D eye model and the front eye image may be partially transparent. That is, since the three-dimensional eye model and the anterior eye image must be simultaneously represented, at least one image must be partially transparent so that a human can recognize it. Meanwhile, the three-dimensional eye model and the anterior eye image may not be represented to be recognized by a person, and subsequent steps may be performed through a computer program or the like.

2 is an exemplary view for explaining a three-dimensional eye model and an anterior eye image in the eyeball displacement measuring method according to an embodiment of the present invention.

Referring to FIG. 2, in the eyeball displacement measuring method according to an embodiment of the present invention, the three-dimensional eye model is modeled as a three-dimensional sphere as shown in the left side of (a), and is shaped to be close to the actual eye shape. Spherical coordinate system or Cartesian coordinate system may be used to model 3D spheres. The right side of (a) is an image of the 3D eye model viewed from the front and may be used for registration with an anterior eye image. In particular, the right side of (a) may be partially transparent to be simultaneously displayed with the anterior eye image. The 3D eye model may be modeled using a graphic program.

Referring to FIG. 2 again, in the eyeball displacement measuring method according to an embodiment of the present invention, the anterior eye region image may be a still image as shown in (b), and may be one still image of a video. In particular, a still image including the shape of an eyeball may be used as an anterior eye image. In addition, the anterior segment image should be partially transparent. This is to facilitate the registration at a later stage by simultaneously expressing the 3D eye model and the anterior eye image.

Next, the step (step 130) of matching the corneal reflection point of the anterior eye image and the center of the three-dimensional eye model may include at least one of movement, rotation, reduction, and enlargement of one of the anterior eye image and the three-dimensional eye model. Applying one may match the corneal reflection point of the anterior eye image and the center of the three-dimensional eye model. Here, the corneal reflection point refers to a point formed in the eye when light such as a flash emitted from the camera is reflected from the eye when the photograph is taken and focused on the camera. That is, the corneal reflection point means the reflection point of the camera flash formed in the center of the pupil of the eye when the front part of the person gazing at the camera is photographed using the camera. In patients with strabismus, corneal reflexes may form on the white, not the center of the pupil, even when looking at the camera.

Here, the step (step 130) of matching the corneal reflection point of the anterior eye image and the center of the 3D eye model may be leveling using any one of the anterior eye image and the 3D eye model. have. In order to level using an anterior eye image, the anterior eye image may be rotated so that the line connecting the corneal reflections formed in the eyeball of the anterior eye image is horizontal. This is because they must be aligned horizontally so that they can be aligned with a three-dimensional eye model that is already horizontally aligned. Alternatively, in order to match the angle with the anterior eye image using the three-dimensional eye model, the three-dimensional eye model may be rotated to be parallel with a line connecting corneal reflection points of the anterior eye image.

In addition, after leveling, the operation for centering the corneal reflection point of the anterior eye image and the 3D eye model may be to enlarge or reduce the anterior eye image and the 3D eye model. That is, at least one of moving, rotating, reducing, and enlarging an anterior eye image is applied to the center of a 3D eye model, or applying an at least one of moving, rotating, reducing, and enlarging an eyeball image to a 3D eye model. Your corneal reflexes will be able to meet your needs. In general, it will be easy to center the eye model on the corneal reflection of the anterior eye image using a three-dimensional eye model. By the above operation, the corneal reflection point of the anterior eye image and the center of the 3D eye model may be matched.

3 is an exemplary view for explaining the registration of the corneal reflection point of the anterior eye image and the center of the three-dimensional eye model in the eyeball displacement measuring method according to an embodiment of the present invention.

Referring to FIG. 3, in the eyeball displacement measuring method according to an exemplary embodiment of the present invention, (a) illustrates a method of leveling in a display screen using an eyeball image. After considering the straight line connecting the corneal reflecting points formed in the left and right eyes, it can be seen that the image of the anterior eye part was rotated somewhat clockwise so that the straight line was horizontal. (b) exemplifies the corneal reflection of the anterior segment image and the center of the three-dimensional eye model. After leveling the anterior eye image and matching it to the 3D eye model, apply at least one of movement, rotation, reduction, and enlargement to the 3D eye model, and then the corneal reflection of the anterior eye image and the center of the 3D eye model. It can be seen that this match. In FIG. 3, the corneal reflection point is expressed as a white point, and the center of the 3D eye model is expressed as the intersection of green and purple lines.

Next, matching the pupil of the 3D eye model to the pupil of the anterior eye image (step 140) may include applying the at least one of moving, rotating, reducing, and enlarging the pupil of the 3D eye model to the 3D. The pupil of the eye model may be matched to the pupil of the anterior eye image. In this case, the result of matching in the corneal reflection point of the anterior eye image and the center of the 3D eye model (step 130) should be maintained as it is.

Here, the step (step 140) of matching the pupil of the 3D eye model with the pupil of the anterior eye image may move to the pupil of the 3D eye model to match the size of the pupil expressed in the anterior eye image. It may be to change the size of the pupil of the three-dimensional eye model by applying at least one of, rotation, reduction and enlargement. This is because the pupil center of the anterior eye image and the pupil center of the 3D eye model can be accurately matched with the pupil size, and thus accurate eye displacement can be measured.

The pupil size of the 3D eyeball model may be adjusted to match the pupil size of the anterior eyeball image, and then the position of the pupil of the 3D eyeball model may be moved to match the position of the pupil of the eyeball image. If the pupil position of the 3D eye model is aligned with the pupil position of the anterior eye image, the center of the pupil of the 3D eye model and the pupil center of the anterior eye image will also be aligned. The preparation for measuring the eye displacement using the distance between the center and the center of the 3D eye model is completed.

FIG. 4 is an exemplary view for explaining matching of a pupil of a 3D eye model to the pupil of the anterior eye part image in the method of measuring displacement of an eye according to an embodiment of the present invention.

Referring to FIG. 4, in order to match the pupil of the 3D eye model with the pupil of the anterior eye image in the eye displacement measuring method according to an embodiment of the present invention, (a) corresponds to the size of the pupil of the anterior eye image. It illustrates reducing the size of the pupil of the three-dimensional eye model to fit. (b) illustrates the movement of the pupil position of the 3D eye model to match the pupil position of the anterior eye image. Accordingly, eye displacement can be measured using the distance between the center of the pupil of the 3D eye model and the center of the 3D eye model. In this case, it can be seen that the result of registration in the step (step 130) of matching the corneal reflection point of the anterior eye image and the center of the 3D eye model is maintained.

Next, the step of quantifying the displacement of the eyeball included in the anterior eye image using the difference between the pupil center of the three-dimensional eye model and the center of the three-dimensional eye model (step 150) is a corneal reflection point of the anterior eye image. And matching the center of the 3D eye model (step 130) and matching the pupil of the 3D eye model with the pupil of the anterior eye image (step 140). In one state, the distance between the center of the 3D eye model and the center of the pupil of the 3D eye model may be measured and quantified.

와 같은 수학식을 이용할 수 있을 것이다. 측정된 3차원 안구모델의 중심과 3차원 안구모델의 동공의 중심 사이의 거리를 다양한 용도로 이용하기 위하여 공간을 통과하는 직선거리를 이용할 수 있으며, 구면의 표면을 따라 이어지는 직선을 이용하는 최단거리로 이용될 수도 있을 것이다.The measured displacement in the three-dimensional space may be represented using a rectangular coordinate system or a spherical coordinate system, the transformation of the rectangular coordinate system and the spherical coordinate system

The following equation may be used. In order to use the distance between the center of the measured 3D eye model and the center of the pupil of the 3D eye model for a variety of purposes, a straight line through the space can be used. It may be used.

와 같은 각 변위의 차이를 계산하여 각도 거리(angle distance)의 형태로 정량화할 수도 있을 것이다. 각도 거리는

와 같이 표현될 수 있으며, 여기에서 D가 각도 거리를 나타낸다.In addition, using the measured distance between the center of the three-dimensional eye model and the pupil center of the three-dimensional eye model

It is also possible to quantify the difference in angular displacement, such as Angular distance

It can be expressed as, where D represents the angular distance.

5 is a block diagram illustrating an apparatus for measuring eyeball displacement according to an embodiment of the present invention.

Referring to FIG. 5, an apparatus for measuring displacement of an eye 500 according to an embodiment of the present invention may include generating a 3D eye model, receiving a 2D anterior eyeball image including an eyeball, and the anterior eyeball image. Matching the corneal reflectance of the 3D eye model with the pupil of the 3D eye model; and the pupil center of the 3D eye model and the 3D eye model of the 3D eye model. A controller 510 for performing a step of quantifying the displacement of the eyeball included in the anterior eye image using the difference of the centers; A display unit 520 for expressing the 3D eye model and the frontal eye image; An input unit 530 for receiving at least one of the 3D eye model and the front eye image; And a memory unit 540 for storing the 3D eye model, the anterior eye image, and the quantified eye displacement.

First, generating a 3D eye model, receiving a 2D anterior eyepiece image including an eyeball, matching the corneal reflection point of the anterior eyeball image and the center of the 3D eye model, the 3D eye model Matching the pupil of the pupil to the pupil of the anterior eye image and quantifying the displacement of the eyeball included in the anterior eye image using the difference between the pupil center of the 3D eye model and the center of the 3D eye model. The control unit 510 for performing may be a component that includes a processor of a computer as a component that performs a core operation for measuring the displacement of the eyeball.

The step of matching the corneal reflection point of the anterior eye image and the center of the 3D eye model by the controller 510 may include moving, rotating, contracting, and enlarging at least one of the front eye image and the 3D eye model. It may be to match the corneal reflection point of the anterior eye image with the center of the three-dimensional eye model. The matching of the pupil of the 3D eye model to the pupil of the anterior eye image by the controller 510 may include applying the at least one of movement, rotation, reduction, and enlargement to the pupil of the 3D eye model. The pupil of the dimensional eye model may be matched to the pupil of the anterior eye image. Since the remaining steps of the control unit 510 are as described above, detailed description thereof will be omitted.

Next, the display unit 520 for expressing the 3D eye model and the front eye image may partially express at least one of the 3D eye model and the front eye image. That is, it should correspond to an imaging apparatus capable of partially transparently representing at least one image so that two images can be simultaneously displayed. In addition, the display unit 520 may be used a variety of devices that can represent the image. For example, a computer monitor, a TV screen, and a small LCD display device may be used as the display unit 520.

Next, the input unit 530 for receiving at least one of the 3D eye model and the anterior eye image may be various input devices for inputting image information. For example, a scanner, a keyboard, a mouse, and a communication line used for inputting image information may be used as the input unit 530, and various input devices may be used as the input unit 530.

Next, the memory unit 540 for storing the 3D eye model, the anterior eye image, and the quantified eye displacement is input through the 3D image and the 2D image of the 3D eye model, and the input unit 530. It may be a variety of storage elements for storing a variety of numerical information quantified by measuring at least one eyeball image and eyeball displacement. The memory unit 540 for storage may be a volatile memory, a nonvolatile memory, and a hard disk that may be built into the eye displacement measuring apparatus, and may be a floppy disk, a compact disk, and a USB that are external to the eye displacement measuring apparatus. And the like may be used.

Although described with reference to the above embodiments, those skilled in the art can understand that the present invention can be variously modified and changed without departing from the spirit and scope of the invention described in the claims below. There will be.

1 is a flowchart illustrating a method for measuring eyeball displacement according to an embodiment of the present invention.

2 is an exemplary view for explaining a three-dimensional eye model and an anterior eye image in the eyeball displacement measuring method according to an embodiment of the present invention.

3 is an exemplary view for explaining the registration of the corneal reflection point of the anterior eye image and the center of the three-dimensional eye model in the eyeball displacement measuring method according to an embodiment of the present invention.

FIG. 4 is an exemplary view for explaining matching of a pupil of a 3D eye model to the pupil of the anterior eye part image in the method of measuring displacement of an eye according to an embodiment of the present invention.

5 is a block diagram illustrating an apparatus for measuring eyeball displacement according to an embodiment of the present invention.

Description of the Related Art

510: control unit 520: display unit

530: input unit 540: memory unit

Claims (9)

In the eyeball displacement measurement method, Generating a three-dimensional eye model; Receiving a two-dimensional frontal eye image including an eyeball; Matching the corneal reflection point of the anterior eye image and the center of the three-dimensional eye model; Matching the pupil of the 3D eye model with the pupil of the anterior eye segment image; And And quantifying the displacement of the eyeball included in the anterior eyeball image using the difference between the pupil center of the 3D eye model and the center of the 3D eye model. The method of claim 1, At least one of the three-dimensional eye model and the image of the anterior eye part is characterized in that the displacement measurement method of the eye. The method of claim 1, Matching the corneal reflection point of the anterior eye segment image and the center of the 3D eye model may include applying the at least one of movement, rotation, reduction, and enlargement to any one of the anterior eye segment image and the 3D eye model. A method for measuring eyeball displacement, wherein the corneal reflectance of the image is matched with the center of the 3D eye model. The method of claim 1, Matching the pupil of the three-dimensional eye model to the pupil of the anterior eye image may include applying at least one of movement, rotation, reduction, and enlargement to the pupil of the three-dimensional eye model. A displacement measurement method of the eyeball, characterized in that it matches the pupil of the eye image. In the recording medium recording the eye displacement measurement method, Generating a three-dimensional eye model; Receiving a two-dimensional frontal eye image including an eyeball; Matching the corneal reflection point of the anterior eye image and the center of the three-dimensional eye model; Matching the pupil of the 3D eye model with the pupil of the anterior eye segment image; And Quantifying the displacement of the eyeball included in the anterior eyeball image using the difference between the pupil center of the three-dimensional eye model and the center of the three-dimensional eye model. . In the eyeball displacement measuring device, Generating a three-dimensional eye model, receiving a two-dimensional anterior eye image including an eyeball, matching the corneal reflectance of the anterior eye image and the center of the three-dimensional eye model, the pupil of the three-dimensional eye model Matching the pupil of the anterior eye segment image and quantifying the displacement of the eyeball included in the anterior eye segment image using the difference between the pupil center of the 3D eye model and the center of the 3D eye model. A control unit; A display unit for expressing the 3D eye model and the frontal eye image; An input unit configured to receive at least one of the 3D eye model and the front eye image; And And a memory unit for storing the three-dimensional eye model, the anterior eye image, and the quantified eye displacement. The method of claim 6, The display unit eyeball displacement measuring apparatus, characterized in that for at least one of the three-dimensional eye model and the image of the anterior eye part to partially transparent. The method of claim 6, Matching the corneal reflection point of the anterior eye segment image and the center of the 3D eye model by applying the at least one of movement, rotation, reduction, and enlargement to one of the anterior eye segment image and the 3D eye model The eyeball displacement measuring apparatus, characterized in that for matching the corneal reflecting point of the anterior eye image and the center of the three-dimensional eye model. The method of claim 6, The step of matching the pupil of the 3D eye model with the pupil of the anterior eye part image in the control unit may include applying the at least one of movement, rotation, reduction, and enlargement to the pupil of the 3D eye model. The eyeball displacement measuring apparatus, characterized in that for matching to the pupil of the anterior eye image.

Images