KR102182185B1 - System and method for evaluating ocular motility disturbance and computer readable storage medium - Google Patents

Abstract

The method for evaluating ocular movement disorders according to an embodiment of the present invention includes a reference eye photograph taken of the eyeball when the subject of the eye evaluation is looking at the front, and radiation according to a preset condition for the state where the subject of the eye evaluation is looking at the front. Capturing a plurality of comparative eye photos taken of an eyeball when gazing in a direction; Mapping a rectangular grid to the reference eye photograph so that the pupil and the sclera of the reference eye photograph are included; Extracting the pupil of the reference eye photo to which the grid is mapped and setting the center of the extracted pupil as the reference coordinate, and extracting the pupil of the comparison eye photo and setting the center of the pupil of the extracted comparative eye photo as the comparison coordinate step; Calculate the displacement of the pupil based on the deviation from the reference coordinate to the comparative coordinate, calculate the torsion angle in which the pupil turns, and compare the displacement and rotation angle of the pupil with a preset normal range, Analyzing the movement pattern of the; And determining the presence or absence of a disorder of the eye evaluation subject based on the movement pattern of both eyes.

Description

System and method for evaluating ocular motility disturbance and computer readable storage medium using the system and method for evaluating ocular motility disturbance and computer readable storage medium

The present invention relates to an ocular movement disorder evaluation system and a method for evaluating ocular movement disorders using the same, and more specifically, by comparing the position of the eyeball when the eyeball gazes at the front and the location of the eyeball when gazing at the radial direction The present invention relates to an ocular movement disorder evaluation system capable of quantitatively determining whether or not there is an ocular movement disorder of an eye evaluation target, and a method of evaluating ocular movement disorders using the same.

Eye movement disorders include superior rectus, inferior rectus, medial rectus, lateral rectus, superior oblique, and inferior oblique, which are responsible for eye movement. ) Of the six muscles (see Fig. 2) and the junctional lesions and brain lesions of the nerves and muscles 3, 4, and 6 that govern these muscles.

The analysis of the disorder pattern according to the eye movement allows the eyeball to move to various positions and analyzes the disorder pattern of the eye movement so that the damaged area can be identified, and based on this, the etiology is estimated and examined. However, currently, there is no clear presentation of an evaluation method according to eye movement disorders based on quantitative judgment of eye movement movements, and doctors directly evaluate eye movements with the naked eye to predict the area of the disorder. There is a situation.

This visual evaluation has a side that it is difficult to accurately judge the movements of the eyeballs with subtle changes, so there is a high possibility of misdiagnosis.

Therefore, there is an increasing need to develop a technology that can more clearly and accurately analyze the pattern of eye movement disorders.

(Korean Patent Publication No. 2003-0087101, November 13, 2003)

An object of the present invention is to quantitatively determine whether or not the eye movement is appropriate by comparing the eyeball position when the eyeball is looking at the front and the eyeball position when looking at the radial direction to determine whether or not there is an ocular movement disorder of the eye evaluation subject. It is to provide an ocular movement disorder evaluation system and a method for evaluating ocular movement disorders using the same.

The object of the present invention is not limited to the above-mentioned object, and other objects that are not mentioned will be clearly understood by those of ordinary skill in the art from the following description.

In order to achieve the above object, the eye movement disorder evaluation system according to an embodiment of the present invention includes a reference eye photograph taken of the eyeball when the eye evaluation subject is looking at the front, and the eye evaluation subject is looking at the front. An imaging unit for capturing a plurality of comparative eye photographs obtained by photographing an eyeball when looking at a radiation direction according to a condition preset for a state; And wirelessly communicating with the imaging unit, analyzing the motion pattern of both eyes using the reference eye picture and the plurality of comparative eye pictures received from the imaging unit, and evaluating the eyeball based on the motion pattern of the both eyes. A data storage unit configured to store the reference eye picture and the plurality of comparison eye pictures received from the imaging unit; A rectangular grid is mapped so that the pupil and the sclera are included in the reference eye photograph, the pupil of the reference eye photograph to which the grid is mapped is extracted, and the center of the extracted pupil is set as a reference coordinate, and the pupil of the comparative eye photograph A displacement calculator configured to extract and set the center of the extracted pupil as a comparison coordinate, and calculate a displacement of the pupil based on a deviation from the reference coordinate to the comparison coordinate; In the reference eye photograph, a plurality of virtual lines are radially mapped from the pupil center to the outer peripheral surface of the iris, the lengths of the plurality of virtual lines are measured, and the shape of the iris is determined based on the measured lengths of each virtual line. A rotation angle calculation unit for calculating the rotation angle by comparing the shape of the iris in the reference eye photograph and the plurality of comparative eye photographs; And a disability determination unit that determines whether or not the subject of the eye evaluation has a disability based on the displacement or rotation angle of the pupil.

The method for evaluating ocular movement disorders according to an embodiment of the present invention includes a reference eye photograph taken of the eyeball when the subject of the eye evaluation is looking at the front, and radiation according to a preset condition for the state where the subject of the eye evaluation is looking at the front. Capturing a plurality of comparative eye photos taken of an eyeball when gazing in a direction; Mapping a rectangular grid to the reference eye photograph so that the pupil and the sclera of the reference eye photograph are included; Extracting the pupil of the reference eye photo to which the grid is mapped and setting the center of the extracted pupil as the reference coordinate, and extracting the pupil of the comparison eye photo and setting the center of the pupil of the extracted comparative eye photo as the comparison coordinate step; Calculate the displacement of the pupil based on the deviation from the reference coordinate to the comparative coordinate, calculate the torsion angle in which the pupil turns, and compare the displacement and rotation angle of the pupil with a preset normal range, Analyzing the movement pattern of the; And determining the presence or absence of a disorder of the eye evaluation target based on the movement pattern of both eyes.

The eye movement disorder evaluation system according to an embodiment of the present invention and the eye movement disorder evaluation method using the same can quantitatively calculate the eyeball position when the eyeball is looking at the front and the eyeball position when the eyeball is looking at the radial direction. It is possible to accurately judge the eye movement of the subject, and based on this, more objectively determine and diagnose the presence or absence of the subject's disorder.

The effects of the present invention are not limited to the above-mentioned effects, and other effects that are not mentioned will be clearly understood by those of ordinary skill in the art from the following description.

1 is a conceptual diagram showing a moving state of an eyeball for explaining the present invention.
2 is a conceptual diagram showing the name of the eyeball and the muscles surrounding the eyeball for explaining the present invention.
3 is a flow chart of a method for evaluating ocular movement disorders according to an embodiment of the present invention.
4 is a conceptual diagram illustrating a state in which a grid is mapped to an eyeball according to an embodiment of the present invention.
5A to 5C are conceptual diagrams for explaining a method of calculating an eyeball rotation angle according to an embodiment of the present invention.
6 is a block diagram of an eye movement disorder evaluation system according to an embodiment of the present invention.

The following content merely illustrates the principles of the present invention. A person of ordinary skill in the art can implement the principles of the present invention and invent various devices included in the concept and scope of the present invention, although not clearly described or illustrated herein. In addition, all conditional terms and examples listed in this specification are, in principle, intended to be clearly intended only for the purpose of making the concept of the present invention understood, and should be understood as not limiting to the embodiments and states specifically listed as described above. do.

In addition, it is to be understood that all detailed descriptions listing specific embodiments as well as principles, aspects, and embodiments of the present invention are intended to include structural and functional equivalents of these matters. It should also be understood that these equivalents include not only currently known equivalents, but also equivalents to be developed in the future, that is, all devices invented to perform the same function regardless of structure.

Thus, for example, the block diagrams herein are to be understood as representing a conceptual perspective of exemplary circuits embodying the principles of the invention. Similarly, all flowcharts, state transition diagrams, pseudocodes, etc. are understood to represent various processes performed by a computer or processor, whether or not the computer or processor is clearly depicted and that can be represented substantially in a computer-readable medium. Should be.

The functions of the various elements shown in the figures, including a processor or functional block represented by a similar concept, may be provided by the use of dedicated hardware as well as hardware having the ability to execute software in association with appropriate software. When provided by a processor, the function may be provided by a single dedicated processor, a single shared processor, or a plurality of individual processors, some of which may be shared.

In addition, the explicit use of terms presented as processor, control, or similar concepts should not be interpreted exclusively by referring to hardware capable of executing software, and without limitation, digital signal processor (DSP) hardware, ROM for storing software. It should be understood to implicitly include (ROM), RAM, and non-volatile memory. It may also include hardware in accordance with the common practice.

In the claims of this specification, components expressed as means for performing the functions described in the detailed description include all types of software including, for example, a combination of circuit elements or firmware/microcode that perform the above functions. It is intended to include all methods of performing a function to perform the function, and is combined with suitable circuitry for executing the software to perform the function. Since the invention defined by these claims is combined with the functions provided by the various enumerated means and combined with the manner required by the claims, any means capable of providing the above functions are equivalent to those conceived from this specification. It should be understood as.

The above-described objects, features, and advantages will become more apparent through the following detailed description in connection with the accompanying drawings, whereby those of ordinary skill in the technical field to which the present invention pertains can easily implement the technical idea of the present invention. There will be. In addition, in describing the present invention, when it is determined that a detailed description of a known technology related to the present invention may unnecessarily obscure the subject matter of the present invention, a detailed description thereof will be omitted.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

3 is a flowchart of a method for evaluating ocular movement disorders according to an embodiment of the present invention, FIG. 4 is a conceptual diagram showing a state in which a grid is mapped to an eyeball according to an embodiment of the present invention, and FIGS. 5A to 5C are A conceptual diagram illustrating a method of calculating an eyeball rotation angle according to an embodiment.

3 to 5C, the method for evaluating ocular movement disorders according to an embodiment of the present invention includes the steps of capturing a reference eye picture and a comparative eye picture (S100), mapping a grid (S200), and reference coordinates. And setting the comparative coordinates (S300), analyzing the motion pattern of both eyes (S400), and determining whether the subject has a disability (S500).

First, in the step (S100) of capturing a reference eye photo and a comparative eye photo, an eyeball of an eye evaluation target is captured using an imaging unit. Here, both eyes of the subject of the eye evaluation are photographed, and the radial direction is observed according to a preset condition for the reference eye photograph of the eyeball when the subject of the eye evaluation is looking at the front and the state where the subject of the eye evaluation is looking at the front. It is possible to take a plurality of comparative eye pictures taken of the eyeball during the operation. The captured reference eye picture and comparative eye picture are each stored.

According to an embodiment, a comparative eye photograph is, as shown in FIG. 1, based on when the subject of eye evaluation looks at the front, top, bottom, left, right, top left (upward left), top right (upward right). ), the lower left (lower left) and the lower left (lower right) in 8 directions.

In the step of mapping the grid (S200), a rectangular grid G is mapped to the reference eye photograph so that the pupil P and the sclera S of the reference eye photograph are included. 4 shows a state in which a grid is mapped to an eyeball according to an embodiment of the present invention. To this end, it may further include extracting a region including the pupil and the sclera from the captured photo. In addition, in the step of mapping the grid (S200), the horizontal (A) and vertical (B) lengths of the grid G mapped to the reference eye photograph are extracted. In addition, the length (L) between the upper and lower eyelids may be extracted from the grid-mapped reference eye photograph.

In the step of setting the reference coordinates and the comparison coordinates (S300), the pupil of the reference eye photo to which the grid is mapped is extracted and the center of the extracted pupil is set as the reference coordinate, and the center of the pupil extracted from the comparison eye photo is used as the comparison coordinate. Set.

In the step of analyzing the motion pattern of both eyes (S400), the displacement of the pupil is calculated based on the deviation from the reference coordinate to the comparative coordinate, the torsion angle in which the pupil turns, and the displacement and rotation of the pupil Analyze the motion pattern of both eyes based on the (torsion) angle.

Specifically, the displacement of the pupil is calculated by calculating the deviation of the reference coordinate value, which is the center of the pupil when each eyeball looks in front, and the comparative coordinate value, which is the center of the pupil when looking at each radial direction can do.

In addition, a plurality of virtual lines (a, b, c, d, e, f, g) are radially mapped from the center of the pupil of the eye to the outer peripheral surface of the iris on the reference eye photograph. Here, the plurality of imaginary lines may be a radius from the pupil center to the outer peripheral surface of one side of the iris as shown in FIGS. 5A and 5B, and, unlike shown, a diameter connecting from the pupil center to the outer peripheral surfaces of both sides of the iris. May be. In addition, a plurality of virtual lines may be formed at equal intervals (unit: °) with respect to the iris. Next, the lengths of the plurality of virtual lines are measured, and the iris shape of the reference eye photograph is determined based on the calculated lengths of each virtual line. Here, the iris shape means a shape including from the center of the pupil to the outer peripheral surface of the iris. In addition, in order to accurately determine the shape of the iris, the number of virtual lines is preferably as large as possible.

The iris is formed in an oval shape because the distance from the center point of the pupil to the outer circumferential surface is different, and the distance value from the center point of the pupil to the boundary of the iris remains unchanged during the torsion of the eyeball.

In other words, when comparing the reference eye photograph of FIG. 5A and the comparative eye photograph when the right eye is looking downward as shown in FIG. 5B, there is no change in the lengths of the plurality of virtual lines and the angle between adjacent virtual lines. .

Accordingly, the torsion angle of the eye can be calculated by comparing the shape of the iris in the reference eye photograph and the comparative eye photograph. Referring to Figure 5c, the eyeball can perform a horizontal movement 51 moving along the Y axis, a vertical movement 52 moving along the Z axis, and a rotation movement 53 rotating along the X axis. torsion) angle means the angle that the eyeball rotates around the X axis.

In addition, in the step of analyzing the motion pattern of both eyes (S400), the motion pattern of both eyes is analyzed by comparing the displacement and torsion angle of each pupil of both eyes with a preset normal range. Here, the preset normal range refers to the displacement and rotation angle of the pupil that can be viewed as a medically normal category with respect to the direction in which both eyes are gaze, and may be a value set in consideration of individual deviation.

In the step of determining the presence or absence of a disorder (S500), the presence or absence of a disorder of the eye evaluation target is determined based on the movement pattern of both eyes.

Specifically, the step of determining the presence or absence of a disorder (S500) is in charge of the movement of the eyeball of the eye evaluation target based on the result of comparing the displacement and/or torsion angle of at least one pupil of both eyes with a preset normal range. Determine the presence or absence of a muscle disorder.

For example, in the step of determining the presence or absence of a disorder (S500), if the displacement or torsion angle of the pupil of either eye does not fall within a preset normal range, there is a disorder in the muscle responsible for movement to the normal range of the eyeball. It can be judged as.

In addition, in the step S500 of determining the presence or absence of a disorder, if a difference value between a displacement or a torsion angle of the pupils of both eyes is equal to or greater than a preset threshold, it may be determined that a muscle in charge of moving the eyeball has a disorder. Here, the preset threshold refers to a threshold value at which the difference between the displacement or rotation angle of the pupils of both eyes with respect to the direction in which both eyes are gaze is medically determined to have a muscle disorder, and is a value set in consideration of individual deviations. I can.

In addition, in the step of determining the presence or absence of a disorder (S500), it is possible to determine whether or not the subject of the eye evaluation has ptosis based on the length L between the upper and lower eyelids extracted from the reference eye photograph taken while looking at the front. For example, if the length (L) between the upper and lower eyelids of one eye is less than a preset threshold, or the difference in the length (L) between the upper and lower eyelids of both eyes is more than a preset threshold, it is determined as ptosis. can do.

In addition, according to an embodiment of the present invention, a computer-readable storage medium in which instructions executable by a processor for executing each step of the ocular movement disorder evaluation method as shown in FIG. 3 are recorded may be provided.

6 is a block diagram of an eye movement disorder evaluation system according to an embodiment of the present invention.

Referring to FIG. 6, the system for evaluating eye movement disorders according to an embodiment of the present invention includes an imaging unit 110 and a server 120.

The imaging unit 110 includes a reference eye photograph that captures the eyeball when the eye evaluation subject is looking at the front, and the eyeball when the eye evaluation subject is looking at the radial direction according to a predetermined condition for a state in which the eye evaluation subject is looking at the front. A plurality of photographed comparative eye pictures are taken.

In this case, the image pickup unit 110 may be implemented as an HMD having a photographing module capable of capturing an eyeball. According to an embodiment, a marker may be provided to the subject of eye evaluation through the display frame of the HMD so that the subject of the eye evaluation can gaze in the directions of up, down, left, right, upper left, upper right, lower left, and lower. When watching, the eyeball can be photographed to take a plurality of comparative eye pictures. As described above, when the imaging unit 110 is implemented as an HMD, even if the subject of eye evaluation moves, an image is provided while the HMD is fixed to the head, so that the occurrence of errors that may occur when photographing an eye image can be relatively reduced. do.

In addition, since the imaging unit 110 implemented as an HMD includes a wireless communication module, a reference eye picture and a plurality of comparison eye pictures captured through the HMD can be wirelessly transmitted to the server 120.

However, the imaging unit 110 is not necessarily limited to the HMD, and is worn on the head such as smart glass, smart goggles, and a display-equipped helmet, so that both eyes and the display of the eye evaluation subject are irrespective of the movement of the eye evaluation subject. Is spaced apart by a predetermined distance and can be implemented in a form capable of photographing both eyes of an eye evaluation subject.

The server 120 wirelessly communicates with the imaging unit 110, and analyzes the motion pattern of both eyes using a reference eye picture and a plurality of comparative eye pictures received from the imaging unit 110, and based on the motion pattern of both eyes. As for determining the presence or absence of a disorder of the subject of eye evaluation, it includes a data storage unit 121, a displacement calculation unit 122, a rotation angle calculation unit 123, and a failure determination unit 124.

The data storage unit 121 stores a reference eye picture and a plurality of comparison eye pictures received from the imaging unit 110.

The displacement calculating unit 122 is for calculating the displacement of the pupil by comparing the reference eye photograph and the plurality of comparative eye photographs. According to an embodiment, the displacement calculator 122 maps a rectangular grid so that the pupil and the sclera are included in the reference eye photograph, and extracts the pupil of the reference eye photograph to which the grid is mapped, and is based on the center of the extracted pupil. It is set as coordinates, the center of the extracted pupil is set as the comparative coordinate by extracting the pupil of the comparative eye picture, and the displacement of the pupil is calculated based on the deviation from the reference coordinate to the comparative coordinate. In addition, the displacement calculator 122 may extract a length L between the upper and lower eyelids from the reference eye photograph to which the grid is mapped.

The rotation angle calculation unit 123 radially maps a plurality of virtual lines from the eyeball pupil center of the reference eye photograph to the outer peripheral surface of the iris, measures the lengths of each of the plurality of virtual lines, and connects the ends of the virtual lines to the iris of the iris. Confirm the shape. In addition, the rotation angle calculation unit 123 calculates a torsion angle of the eye by comparing the shape of the iris in the reference eye photo and the comparison eye photo.

The disorder determination unit 124 determines the presence or absence of a disorder of the eye evaluation subject based on the displacement and/or torsion angle of the pupil respectively calculated by the displacement calculation unit 122 and the rotation angle calculation unit 123.

In addition, the disability determination unit 124 determines whether or not the eyelid is ptosis of the eye evaluation subject based on the length L between the upper and lower eyelids calculated by the displacement calculating unit 122.

The server 120 analyzes the movement pattern of both eyes using a reference eye picture and a plurality of comparative eye pictures, and a specific method of determining the presence or absence of a disorder of the eye evaluation target based on the movement pattern of both eyes is shown in FIGS. 3 to 5C. Since it is the same as described in detail with reference to, a redundant description thereof will be omitted.

On the other hand, the embodiments of the present invention disclosed in the present specification and drawings are merely provided specific examples to facilitate the description of the present invention and to aid understanding of the present invention, and are not intended to limit the scope of the present invention. In addition to the embodiments disclosed herein, it is apparent to those of ordinary skill in the art that other modifications are possible based on the technical idea of the present invention.

110: imaging unit 120: server
121: data storage unit 122: displacement calculation unit
123: line angle calculation unit 124: failure determination unit

Claims (7)

A reference photograph of the eyeball when the subject of the eye evaluation is looking at the front, and a plurality of comparison eyes that take an image of the eyeball when the eyeball is looking in the radial direction according to preset conditions for the condition of the eye evaluation subject looking at the front. Taking a picture;
Mapping a rectangular grid to the reference eye photograph so that the pupil and the sclera of the reference eye photograph are included;
Extracting the pupil of the reference eye photo to which the grid is mapped and setting the center of the extracted pupil as the reference coordinate, and extracting the pupil of the comparison eye photo and setting the center of the pupil of the extracted comparative eye photo as the comparison coordinate step;
Calculate the displacement of the pupil based on the deviation from the reference coordinate to the comparative coordinate, calculate the torsion angle in which the pupil turns, and compare the displacement and rotation angle of the pupil with a preset normal range, Analyzing the movement pattern of the; And
It includes the step of determining the presence or absence of a disorder of the eye evaluation subject based on the movement pattern of the both eyes,
Analyzing the movement pattern of both eyes,
In the reference eye photograph, a plurality of virtual lines are radially mapped from the pupil center to the outer peripheral surface of the iris, the lengths of the plurality of virtual lines are measured, and the shape of the iris is determined based on the measured lengths of each virtual line. A method for evaluating eye movement disorders for calculating the torsion angle by comparing an iris shape in a reference eye picture and the plurality of comparative eye pictures.
delete The method of claim 1,
The step of determining the presence or absence of the disorder,
A method for evaluating ocular movement disorders that determines that there is a disorder in the muscle responsible for movement to the normal range of the eye, if the displacement or torsion angle of the pupil of either eye does not fall within the preset normal range.
The method of claim 1,
The step of determining the presence or absence of the disorder,
If the difference between the displacement or torsion angle of the pupils of both eyes is more than a preset threshold, there is a disorder in the muscle responsible for at least one eye movement that does not fall within the preset normal range of the pupil displacement or rotation angle among the binoculars. A method for evaluating eye movement disorders that is judged to be present
The method of claim 1,
The step of determining the presence or absence of the disorder,
Ocular movement disorder judged as ptosis when the length between the upper and lower eyelids of one eye extracted from the reference eye photograph is less than a preset threshold, or the difference in length between the upper and lower eyelids of both eyes is more than the preset threshold Assessment Methods.
A comparison of a plurality of photographs of the eyeball when the subject of the eye evaluation is gazing at the front, and a photograph of the eyeball when the subject of the eye evaluation is gazing in the radial direction according to preset conditions for the condition of the subject’s eyeballing. An image pickup unit for capturing an eye photograph; And
It communicates wirelessly with the imaging unit, analyzes the movement pattern of both eyes using the reference eye picture and the plurality of comparative eye pictures received from the imaging unit, and the disorder of the eye evaluation target based on the movement pattern of the both eyes It includes a server that determines the presence or absence,
The server,
A data storage unit for storing the reference eye picture and the plurality of comparison eye pictures received from the imaging unit;
A rectangular grid is mapped so that the pupil and the sclera are included in the reference eye photograph, the pupil of the reference eye photograph to which the grid is mapped is extracted, and the center of the extracted pupil is set as a reference coordinate, and the pupil of the comparative eye photograph A displacement calculator configured to extract and set the center of the extracted pupil as a comparison coordinate, and calculate a displacement of the pupil based on a deviation from the reference coordinate to the comparison coordinate;
In the reference eye photograph, a plurality of virtual lines are radially mapped from the pupil center to the outer peripheral surface of the iris, the lengths of the plurality of virtual lines are measured, and the shape of the iris is determined based on the measured lengths of each virtual line. A rotation angle calculation unit for calculating a rotation angle by comparing the shape of the iris in the reference eye photograph and the plurality of comparative eye photographs; And
An eye movement disorder evaluation system comprising a disorder determination unit that determines whether or not the subject of the eye evaluation has a disorder based on the displacement or rotation angle of the pupil.
A computer-readable storage medium in which instructions executable by a processor for executing the method for evaluating eye movement disorders according to claim 1 are recorded.

Images